Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Large-scale SQL Processing

In course

CS-422: Database systems

This course is intended for students who want to understand modern large-scale data analysis systems and database systems. It covers a wide range of topics and technologies, and will prepare students to be able to build such systems as well as read and und ...

Description

This lecture covers the execution models for distributed computing in data-intensive applications and systems, introducing the concept of data frames as a space-efficient and computationally-efficient data representation with an extensible SQL-like language. It explains the data model supporting nested and complex types, the key notion of data frames, and their operators for relational operations. The lecture also discusses optimization principles, advantages of the model over traditional SQL, and concludes with the importance of distribution for scalability and the significance of the programming model for expressiveness and performance.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Anastasia Ailamaki

Official source

Ontological neighbourhood

Computer engineering

Databases: Relational databases

Related concepts (11)

Relational database

A relational database is a (most commonly digital) database based on the relational model of data, as proposed by E. F. Codd in 1970. A system used to maintain relational databases is a relational database management system (RDBMS). Many relational database systems are equipped with the option of using SQL (Structured Query Language) for querying and updating the database. The term "relational database" was first defined by E. F. Codd at IBM in 1970. Codd introduced the term in his research paper "A Relational Model of Data for Large Shared Data Banks".

Relational model

The relational model (RM) is an approach to managing data using a structure and language consistent with first-order predicate logic, first described in 1969 by English computer scientist Edgar F. Codd, where all data is represented in terms of tuples, grouped into relations. A database organized in terms of the relational model is a relational database.

Relational algebra

In database theory, relational algebra is a theory that uses algebraic structures for modeling data, and defining queries on it with a well founded semantics. The theory was introduced by Edgar F. Codd. The main application of relational algebra is to provide a theoretical foundation for relational databases, particularly query languages for such databases, chief among which is SQL. Relational databases store tabular data represented as relations. Queries over relational databases often likewise return tabular data represented as relations.

Data model

A data model is an abstract model that organizes elements of data and standardizes how they relate to one another and to the properties of real-world entities. For instance, a data model may specify that the data element representing a car be composed of a number of other elements which, in turn, represent the color and size of the car and define its owner. The corresponding professional activity is called generally data modeling or, more specifically, database design.

Data modeling

Data modeling in software engineering is the process of creating a data model for an information system by applying certain formal techniques. It may be applied as part of broader Model-driven engineering (MDD) concept. Data modeling is a process used to define and analyze data requirements needed to support the business processes within the scope of corresponding information systems in organizations. Therefore, the process of data modeling involves professional data modelers working closely with business stakeholders, as well as potential users of the information system.

Related lectures (37)

Handling Data: Intro to Pandas

Introduces the fundamentals of handling data, emphasizing the importance of Pandas and data modeling for effective analysis.

Data: Clouds and Things

Covers the fundamentals of data, cloud storage, and the Internet of Things.

Relational Databases: Fundamentals MOOC: Geographical Information Systems 1

Covers relational and spatial databases, including storage, management systems, ACID properties, historical typologies, primary and foreign keys, and spatial functions.

Data Modeling: Concepts and Applications

Introduces data modeling concepts, SQL usage, and Pandas library applications for efficient data processing.