Lecture

Assessment Process Design

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture concludes the course module on tests and assessments, focusing on designing an assessment process. Students should have a solid understanding of criteria like validity, reliability, transparency, fairness, authenticity, and accuracy. They should be able to implement effective measurement approaches in both face-to-face and remote settings, recognize various types of assessments and their purposes, and understand different correction approaches with their trade-offs and advantages, aiming for a wider range of test types while managing workload. The next lecture will cover educational videos.

Official source

Related concepts (9)

Validity (statistics)

Validity is the main extent to which a concept, conclusion or measurement is well-founded and likely corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool (for example, a test in education) is the degree to which the tool measures what it claims to measure. Validity is based on the strength of a collection of different types of evidence (e.g. face validity, construct validity, etc.) described in greater detail below.

Criterion validity

In psychometrics, criterion validity, or criterion-related validity, is the extent to which an operationalization of a construct, such as a test, relates to, or predicts, a theoretical representation of the construct—the criterion. Criterion validity is often divided into concurrent and predictive validity based on the timing of measurement for the "predictor" and outcome. Concurrent validity refers to a comparison between the measure in question and an outcome assessed at the same time.

External validity

External validity is the validity of applying the conclusions of a scientific study outside the context of that study. In other words, it is the extent to which the results of a study can be generalized to and across other situations, people, stimuli, and times. In contrast, internal validity is the validity of conclusions drawn within the context of a particular study. Because general conclusions are almost always a goal in research, external validity is an important property of any study.

Concurrent validity

Concurrent validity is a type of evidence that can be gathered to defend the use of a test for predicting other outcomes. It is a parameter used in sociology, psychology, and other psychometric or behavioral sciences. Concurrent validity is demonstrated when a test correlates well with a measure that has previously been validated. The two measures may be for the same construct, but more often used for different, but presumably related, constructs. The two measures in the study are taken at the same time.

Construct validity

Construct validity concerns how well a set of indicators represent or reflect a concept that is not directly measurable. Construct validation is the accumulation of evidence to support the interpretation of what a measure reflects. Modern validity theory defines construct validity as the overarching concern of validity research, subsuming all other types of validity evidence such as content validity and criterion validity.

Related lectures (32)

Assessment of Learning: Validity and Reliability MOOC: Teaching Science and Engineering

Explores the concepts of validity and reliability in assessment in higher education.

Covers register swapping techniques, consensus algorithms, and winner determination.

Effective Teaching Evaluations: Dimensions and Formulation Tips

Discusses the multidimensional nature of teaching evaluations and offers tips for formulating effective questions.

Reliable Broadcast: Causal Order

Explores reliable broadcast algorithms, focusing on causal order and uniform reliability, with exercises on failure detector properties and memory optimization.

Reliable Broadcast: Overview and Algorithms