Lecture

Leveraging NVMe for GPU Query Processing

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Description

This lecture explores the use of NVMe storage to scale GPU-accelerated query processing beyond main memory, showcasing how modern storage hierarchies can efficiently handle large datasets, the challenges of GPU-enabled servers, and innovative methods for optimizing data transfers.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Official source

Related concepts (13)

NVM Express

NVM Express (NVMe) or Non-Volatile Memory Host Controller Interface Specification (NVMHCIS) is an open, logical-device interface specification for accessing a computer's non-volatile storage media usually attached via the PCI Express bus. The initialism NVM stands for non-volatile memory, which is often NAND flash memory that comes in several physical form factors, including solid-state drives (SSDs), PCIe add-in cards, and M.2 cards, the successor to mSATA cards.

Solid-state storage

Solid-state storage (SSS) is a type of non-volatile computer storage that stores and retrieves digital information using only electronic circuits, without any involvement of moving mechanical parts. This differs fundamentally from the traditional electromechanical storage, which records data using rotating or linearly moving media coated with magnetic material. Solid-state storage devices typically store data using electrically-programmable non-volatile flash memory, however some devices use battery-backed volatile random-access memory (RAM).

Hierarchical storage management

Hierarchical storage management (HSM), also known as Tiered storage, is a data storage and Data management technique that automatically moves data between high-cost and low-cost storage media. HSM systems exist because high-speed storage devices, such as solid state drive arrays, are more expensive (per byte stored) than slower devices, such as hard disk drives, optical discs and magnetic tape drives. While it would be ideal to have all data available on high-speed devices all the time, this is prohibitively expensive for many organizations.

NetApp

NetApp, Inc. is an American data storage and data management services company headquartered in San Jose, California. It has ranked in the Fortune 500 from 2012 to 2021. Founded in 1992 with an initial public offering in 1995, NetApp offers cloud data services for management of applications and data both online and physically. NetApp was founded in 1992 by David Hitz, James Lau, and Michael Malcolm as Network Appliance, Inc. At the time, its major competitor was Auspex Systems.

Object storage

Object storage (also known as object-based storage) is a computer data storage that manages data as objects, as opposed to other storage architectures like which manages data as a file hierarchy, and block storage which manages data as blocks within sectors and tracks. Each object typically includes the data itself, a variable amount of metadata, and a globally unique identifier. Object storage can be implemented at multiple levels, including the device level (object-storage device), the system level, and the interface level.

Related lectures (18)

Storage Technologies: Memory Hierarchy and Disk Storage

Explores memory hierarchy, CPU caches, SSD, HDD, and disk storage anatomy.

Storage Hierarchy: Understanding Data Management Systems

Discusses the storage hierarchy and buffer management in data-intensive systems.

N-ary Storage Model: Page and Record Formats

Explores the N-ary Storage Model, fixed-length and variable-length record formats, and storage hierarchy.

Database Systems: Data Storage

Discusses data storage in database systems, emphasizing efficiency and access times for different storage types.

Architecture Essentials: Understanding Computer Systems