Lecture

General Introduction to Big Data

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Related lectures (64)

Spark Data Frames

Covers Spark Data Frames, distributed collections of data organized into named columns, and the benefits of using them over RDDs.

Introduction to Spark Runtime Architecture

Covers the Spark runtime architecture, including RDDs, transformations, actions, and caching for performance optimization.

Data Science Essentials: Python, Numpy, Pandas, and Scikit-learn

Covers the essentials of Data Science using Python, Numpy, Pandas, and Scikit-learn, including DNA sequence analysis and classification.

Advanced Spark Optimization

Delves into advanced Spark optimization techniques, emphasizing data partitioning, shuffle operations, and memory management.

Integrating Scalable Data Storage and Map Reduce Processing with Hadoop

Covers the integration of scalable data storage and map reduce processing using Hadoop, including HDFS, Hive, Parquet, ORC, Spark, and HBase.

Collaborative Data Science: Tools and Techniques

Introduces collaborative data science tools like Git and Docker, emphasizing teamwork and practical exercises for effective learning.

Big Data Challenges: Scaling to Massive Data

Explores challenges of handling massive data in the era of big data, discussing solutions like MapReduce and Spark.

Introduction to Data Stream Processing: Concepts and Applications

Covers the principles of data stream processing and its applications in real-time data analysis.

Introduction to Data Stream Processing

Covers the fundamentals of data stream processing, including tools like Apache Storm and Kafka, key concepts like event time and window operations, and the challenges of stream processing.

Introduction to Spark Runtime Architecture

Introduces Apache Spark, covering its architecture, RDDs, transformations, actions, fault tolerance, deployment options, and practical exercises in Jupyter notebooks.

Introduction to R Programming for Genetics & Genomics

Introduces a course on Genetics & Genomics, focusing on R programming with interactive exercises.

Digital Image Correlation: Practical

Focuses on the practical application of Digital Image Correlation for civil engineers, covering measuring displacement fields and computing strain fields.

Matlab Programming: Script and Function

Explores Matlab programming with scripts and functions, vectorization, and 2D graphics.

Tissue-level Wave Patterns: Cellular Oscillators and Genetic Waves

Explores tissue-level wave patterns, cellular oscillators, genetic waves, and gene expression patterns in cellular differentiation.

Renku: Collaborative Data Science

Introduces Renku, a platform for collaborative data science enabling reproducibility and promoting code and data reusability.

Logistic Regression: Vegetation Prediction

Explores logistic regression for predicting vegetation proportions in the Amazon region through remote sensing data analysis.

Spectral Estimation Methods

Explores parametric spectrum estimation methods, including line and smooth spectra, and delves into heart rate variability analysis.

Neurophysiological Data Analysis

Explores neurophysiological data analysis, covering AP identification, firing rates, subthreshold activity, FFT spectral analysis, and event-triggered analysis using MATLAB.

Total scattering and PDF analysis

Explores total scattering and PDF analysis in materials science, covering in-situ synthesis, data analysis techniques, and applications in host-guest systems.

In Silico Neuroscience: Data Reproducibility and Reusability

Emphasizes data reproducibility and reusability in in silico neuroscience, focusing on neuroinformatics tools and methods.