Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

File Organization: Storage and Cache Management

In course

CS-422: Database systems

This course is intended for students who want to understand modern large-scale data analysis systems and database systems. It covers a wide range of topics and technologies, and will prepare students to be able to build such systems as well as read and und ...

Description

This lecture covers the organization of files and pages in databases, including storage management, buffer management, and different file storage techniques such as heap files, sorted files, and log-structured files. It also delves into cache organization, multi-level cache systems, and access times, highlighting the trade-offs between speed and size. The instructor explains the average access time calculation in cache systems and the benefits of log-structured files for workloads with many small files. Additionally, the lecture discusses the implementation of heap files using list structures and page directories, as well as the reading and writing processes in log-structured files, emphasizing the pros and cons of this storage approach.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Anastasia Ailamaki

Official source

Ontological neighbourhood

Computer engineering

Computer data storage: Topics in computer data storage

Related concepts (32)

Computer data storage

Computer data storage is a technology consisting of computer components and recording media that are used to retain digital data. It is a core function and fundamental component of computers. The central processing unit (CPU) of a computer is what manipulates data by performing computations. In practice, almost all computers use a storage hierarchy, which puts fast but expensive and small storage options close to the CPU and slower but less expensive and larger options further away.

File system

In computing, a file system or filesystem (often abbreviated to fs) is a method and data structure that the operating system uses to control how data is stored and retrieved. Without a file system, data placed in a storage medium would be one large body of data with no way to tell where one piece of data stopped and the next began, or where any piece of data was located when it was time to retrieve it. By separating the data into pieces and giving each piece a name, the data are easily isolated and identified.

Object storage

Object storage (also known as object-based storage) is a computer data storage that manages data as objects, as opposed to other storage architectures like which manages data as a file hierarchy, and block storage which manages data as blocks within sectors and tracks. Each object typically includes the data itself, a variable amount of metadata, and a globally unique identifier. Object storage can be implemented at multiple levels, including the device level (object-storage device), the system level, and the interface level.

Hierarchical storage management

Hierarchical storage management (HSM), also known as Tiered storage, is a data storage and Data management technique that automatically moves data between high-cost and low-cost storage media. HSM systems exist because high-speed storage devices, such as solid state drive arrays, are more expensive (per byte stored) than slower devices, such as hard disk drives, optical discs and magnetic tape drives. While it would be ideal to have all data available on high-speed devices all the time, this is prohibitively expensive for many organizations.

Storage area network

A storage area network (SAN) or storage network is a computer network which provides access to consolidated, block-level data storage. SANs are primarily used to access data storage devices, such as disk arrays and tape libraries from servers so that the devices appear to the operating system as direct-attached storage. A SAN typically is a dedicated network of storage devices not accessible through the local area network (LAN). Although a SAN provides only block-level access, built on top of SANs do provide file-level access and are known as s.

Related lectures (32)

Storage of geographic information MOOC: Geographical Information Systems 1

Covers the storage of geographic information using vector and grid formats, coordinate reference systems, and image formats.

Data Wrangling with Hive: Managing Big Data Efficiently

Covers data wrangling techniques using Apache Hive for efficient big data management.

Stockage et transmission des données 1: introduction; besoin de structure

Discusses the importance of structuring data for efficient storage and retrieval.

Data Storage and Transmission: Metadata for Disks

Explores the importance of metadata in organizing media libraries and the challenges in retrieving specific works or artists efficiently.

Data Wrangling with Hadoop