Lecture

Measuring Learning: Experimental Design

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

CS-411: Digital education

This course addresses the relationship between specific technological features and the learners' cognitive processes. It also covers the methods and results of empirical studies: do student actually learn due to technologies? In fall 2025, P. Dillenbourg w ...

Description

This lecture covers the experimental design for measuring learning outcomes, including variables, causality, learning gain, retention, and transfer effects. It also discusses biases in experiments, group equivalence, within-subjects designs, and the significance of differences in mean values.

Instructors (2)

Pierre Dillenbourg

A former teacher in elementary school, Pierre Dillenbourg graduated in educational science (University of Mons, Belgium). He started his research on learning technologies in 1984. In 1986, he has been on of the first in the world to apply machine learning to develop a self-improving teaching system. He obtained a PhD in computer science from the University of Lancaster (UK), in the domain of artificial intelligence applications for education. He has been assistant professor at the University of Geneva. He joined EPFL in 2002. He has been the director of Center for Research and Support on Learning and its Technologies, then academic director of Center for Digital Education, which implements the MOOC strategy of EPFL (over 2 million registrations). He is full professor in learning technologies in the School of Computer & Communication Sciences, where he is the head of the CHILI Lab: "Computer-Human Interaction for Learning & Instruction ». He is the director of the leading house DUAL-T, which develops technologies for dual vocational education systems (carpenters, florists,...). With EPFL colleagues, he launched in 2017 the Swiss EdTech Collider, an incubator with 80 start-ups in learning technologies. He (co-)-founded 4 start-ups, does consulting missions in the corporate world and joined the board of several companies or institutions. In 2018, he co-founded LEARN, the EPFL Center of Learning Sciences that brings together the local initiatives in educational innovation. He is a fellow of the International Society for Learning Sciences. He currently is the Associate Vice-President for Education at EPFL.

Patrick Jermann

After studies in Geneva (TECFA) and Pittsburgh (LRDC) I joined EPFL in 2003 to coordinate eLearning projects and conduct research in the field of Computer Supported Collaborative Learning (CSCL). Starting 2013 I am responsible for MOOCs production at the Center for Digital Education (CEDE).Former Associate Editor for the IEEE Transactions on Learning Technologies and former Member of the Editorial Board for the International Journal of Computer Supported Collaborative Learning (iJCSCL). Specialties: Interaction analysis, research methods, statistical methods, prototyping, software development, pedagogical design.

Official source

Related concepts (29)

Design of experiments

The design of experiments (DOE or DOX), also known as experiment design or experimental design, is the design of any task that aims to describe and explain the variation of information under conditions that are hypothesized to reflect the variation. The term is generally associated with experiments in which the design introduces conditions that directly affect the variation, but may also refer to the design of quasi-experiments, in which natural conditions that influence the variation are selected for observation.

Valsery Abbey

Valsery Abbey (Abbaye de Valsery; Abbaye Notre-Dame de Valsery) is a former Premonstratensian abbey located in Cœuvres-et-Valsery, Aisne, France. It was founded in 1124 near the Forest of Retz, which the Premonstratensian canons doubtless helped to clear. Whatever buildings remained of the abbey after the Revolution, when all monastic houses in France were suppressed, were ruined during World War I and abandoned. The site was declared a historic monument site in 1986, since when much investigation and restoration has taken place.

Dependent and independent variables

Dependent and independent variables are variables in mathematical modeling, statistical modeling and experimental sciences. Dependent variables are studied under the supposition or demand that they depend, by some law or rule (e.g., by a mathematical function), on the values of other variables. Independent variables, in turn, are not seen as depending on any other variable in the scope of the experiment in question. In this sense, some common independent variables are time, space, density, mass, fluid flow rate, and previous values of some observed value of interest (e.

Bias

Bias is a disproportionate weight in favor of or against an idea or thing, usually in a way that is closed-minded, prejudicial, or unfair. Biases can be innate or learned. People may develop biases for or against an individual, a group, or a belief. In science and engineering, a bias is a systematic error. Statistical bias results from an unfair sampling of a population, or from an estimation process that does not give accurate results on average. The word appears to derive from Old Provençal into Old French biais, "sideways, askance, against the grain".

Timothy A. Cohn

Timothy A. Cohn (1957 – February 20, 2017) was an American hydrologist with the US Geological Survey, USGS Science Advisor for Hazards (1998–2001), and lecturer at Johns Hopkins University (2006 - ). Cohn served in the office of Senator Bill Bradley (D-NJ) in 1995-97 as a AAAS Congressional Science Fellow, and worked on the unsuccessful Bradley presidential campaign in 2000. After 2005, Cohn was a member of the Governing Board of the American Institute of Physics.

Related lectures (61)

Understanding Statistics & Experimental Design

Explores unequal variances, replication, power, effect size, biases, and their impact on research outcomes.

Signal Detection Theory

Explores Signal Detection Theory and its impact on decision-making processes in statistics and experimental design.

Red Influence: Attractiveness, Desirability, and Status

Explores the effects of red on attractiveness, desirability, and status, emphasizing statistical analysis and the challenges of replication and publication bias.

Experimental Design: Variables and Hypotheses

Covers research questions, hypotheses, variables, and experimental designs in learning experiments.

Measuring Learning Effects