Hadoop Ecosystem: Architectural Choices & MapReduce Programming

About
Privacy
Disclaimer

Graph Chatbot

Related lectures (31)

Data Wrangling Techniques: HBase and Hive Integration

Covers data wrangling techniques using HBase and Hive, focusing on integration and practical applications.

Introduction to Spark Runtime Architecture

Introduces Apache Spark, covering its architecture, RDDs, transformations, actions, fault tolerance, deployment options, and practical exercises in Jupyter notebooks.

Hadoop: Execution Models Log in to Mediaspace to watch this video

Explores Hadoop's execution models, fault tolerance, data locality, and scheduling, highlighting the limitations of MapReduce and alternative distributed processing frameworks.

Programming Models: Overview and Examples Log in to Mediaspace to watch this video

Explores programming models for big data processing, including Spark's RDDs and optimizations.

Spark Ecosystem: Architectural Choices Log in to Mediaspace to watch this video

Explores the Spark ecosystem's architectural choices, including RDDs and fault tolerance.

Data Cleaning Challenges: Optimizing Error Detection Log in to Mediaspace to watch this video

Addresses challenges in data cleaning for analysis, proposing optimizations to reduce processing time.

Data-Parallel Programming: Vector & SIMD Processors Log in to Mediaspace to watch this video

Explores data-parallel programming with vector processors and SIMD, and introduces MapReduce, Pregel, and TensorFlow.

Code Optimization: Speeding-up Analyses Log in to Mediaspace to watch this video

Explores techniques to speed up dataflow analyses and discusses the importance of node ordering and post-order traversal.

Dataflow Analysis: Optimization Log in to Mediaspace to watch this video

Explores dataflow analysis for optimization, including equations solving, live variables, reaching definitions, and very busy expressions.

Spark Storage Layer Log in to Mediaspace to watch this video

Explores the Spark ecosystem, Resilient Distributed Datasets, and the storage layer abstraction in Spark.

Programming for Engineers: Advanced MATLAB Techniques Log in to Mediaspace to watch this video

Explores advanced MATLAB techniques, emphasizing vectorization, 'find' function, and plot manipulation.

Page 2 of 2