Lecture

Validated-Aware Software

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture discusses the concept of validated-aware software, focusing on the challenges of validating and revalidating systems over time, especially in safety-critical environments. The instructor explains the need for anticipatory real-time runtime assurance to analyze and validate systems continuously. The lecture covers techniques such as emulating sensor readings, reducing tests, and running tests in parallel with the system. It also addresses the importance of validating at the semantics level and the development of a framework to specify application models and generate validation tests. The lecture emphasizes the significance of addressing environmental changes that can impact system functionality and the necessity of robust validation methods to ensure system reliability.

Official source

Related concepts (32)

Software verification and validation

In software project management, software testing, and software engineering, verification and validation (V&V) is the process of checking that a software system meets specifications and requirements so that it fulfills its intended purpose. It may also be referred to as software quality control. It is normally the responsibility of software testers as part of the software development lifecycle.

Cross-validation (statistics)

Cross-validation, sometimes called rotation estimation or out-of-sample testing, is any of various similar model validation techniques for assessing how the results of a statistical analysis will generalize to an independent data set. Cross-validation is a resampling method that uses different portions of the data to test and train a model on different iterations. It is mainly used in settings where the goal is prediction, and one wants to estimate how accurately a predictive model will perform in practice.

Virginia

Virginia, officially the Commonwealth of Virginia, is a state in the Mid-Atlantic and Southeastern regions of the United States between the Atlantic Coast and the Appalachian Mountains. The state's capital is Richmond, its most populous city is Virginia Beach, and Fairfax County is the state's most populous political subdivision. Virginia's population was over 8.68 million, with 35% living within the Greater Washington metropolitan area.

Virginia Tech

Virginia Tech (VT), formally the Virginia Polytechnic Institute and State University (VPI), is a public land-grant research university with its main campus in Blacksburg, Virginia. It also has educational facilities in six regions statewide, a research center in Punta Cana, Dominican Republic, and a study-abroad site in Riva San Vitale, Switzerland. Through its Corps of Cadets ROTC program, Virginia Tech is a senior military college.

Training, validation, and test data sets

In machine learning, a common task is the study and construction of algorithms that can learn from and make predictions on data. Such algorithms function by making data-driven predictions or decisions, through building a mathematical model from input data. These input data used to build the model are usually divided into multiple data sets. In particular, three data sets are commonly used in different stages of the creation of the model: training, validation, and test sets.

Related lectures (64)

Evaluation in NLP

Delves into NLP evaluation, covering gold standards, precision, recall, and statistical significance.

Playing Connect Four

Explores the implementation of Connect Four game functionalities and testing methods.

Prediction tests MOOC: Introduction to Discrete Choice Models

Explores out-of-sample validation and the methodology of cross-validation for testing predictive models.

Training and Testing Games

Emphasizes the importance of separating training and testing data for machine learning models.

Model Assessment and Hyperparameter Tuning