Course

COM-490: Large-scale data science for real-world data

Summary

This hands-on course covers tools and methods used by data scientists, from researching solutions to scaling prototypes on Spark clusters. Students engage with the full data engineering and data science pipeline, from data acquisition to extracting insights, applied to real-world problems.

Lectures

Instructors (3)

Sofiane Sarni

Teaching & PhD Courses Large-scale data science for real-world data COM-490 This hands-on course covers tools and methods used by data scientists, from researching solutions to scaling prototypes on Spark clusters. Students engage with the full data engineering and data science pipeline, from data acquisition to extracting insights, applied to real-world problems.

Olivier Verscheure

SWISS DATA SCIENCE CENTER Housed at both EPFL and ETH Zurich, the newly created Swiss Data Science Center (SDSC) will address the fragmentation within today's data and analytics landscapes. The SDSC will be composed of a distributed multi-disciplinary team of data scientists and experts in domains including personalized health and personalized medicine, transportation, earth and environmental science, social science and digital humanities, and economics. The center aims to federate data providers, data and

Eric Pierre Bouillet

Eric Bouillet received his PhD degree in Electrical Engineering from Columbia University, New York, NY in June 1999. Eric Bouillet has been working at IBM T.J. Watson Research Center, Hawthorne, NY since June 2004, and at the IBM Smarter City Technical Centre, Dublin from October 2010 to August 2016. While at IBM he has been working on scalable data stream analytics applied to a number of fields, including finances, law-enforcement, telecommunications, environmental monitoring, intelligent transport systems, and aircraft reliability control systems. Before joining IBM Research, Eric Bouillet was at Tellium, Oceanport, NJ where he was part of the research team who invented and designed the first commercial optical mesh restoration network (deployed nationwide and documented in their book Path Routing in Mesh Optical Networks), and at Lucent Technologies’ Mathematical Science Center in the department of Mathematics of Networks and System Research department where he worked on the design optimization and sizing of circuit and packet switched networks. Since September 2016 Eric is the Chief Architect and Head of Engineering of the newly created Swiss Data Science Center, a national R&D center organizationally hosted by both EPFL in Lausanne and ETH Zurich.

Official source

Moodle Page

http://go.epfl.ch/COM-490

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

Summary

Lectures

Instructors (3)

Sofiane Sarni

Olivier Verscheure

Eric Pierre Bouillet

Official source

Moodle Page

http://go.epfl.ch/COM-490

Lectures in this course (40)

Introduction: What do we mean by Data Science?

Introduces the team, provides a crash course on Python, and explores the journey into Data Science and the importance of refining data.

General Introduction to Data Science

Offers a comprehensive introduction to Data Science, covering Python, Numpy, Pandas, Matplotlib, and Scikit-learn, with a focus on practical exercises and collaborative work.

Collaborative Data Science: Tools and Git Workflow

Explores tools like Git and Docker for collaborative data science projects.

Data Wrangling with Hadoop: Storage Formats and Hive

Explores data wrangling with Hadoop, emphasizing storage formats and Hive for big data processing.

Introduction to Spark Runtime Architecture

Introduces Apache Spark, covering its architecture, RDDs, transformations, actions, fault tolerance, deployment options, and practical exercises in Jupyter notebooks.

Related courses (32)

ME-213: Programmation pour ingénieur

Mettre en pratique les bases de la programmation vues au semestre précédent. Développer un logiciel structuré. Méthode de debug d'un logiciel. Introduction à la programmation scientifique. Introduction à l'instrumentation virtuelle. ...

PHYS-467: Machine learning for physicists

Machine learning and data analysis are becoming increasingly central in sciences including physics. In this course, fundamental principles and methods of machine learning will be introduced and practised. ...

CS-471: Advanced multiprocessor architecture

Multiprocessors are basic building blocks for all computer systems. This course covers the architecture and organization of modern multiprocessors, prevalent accelerators (e.g., GPU, TPU), and datacenters. It includes a research project on multiprocessors ...

ME-373: Finite element modelling and simulation

L'objectif de ce cours est d'apprendre à réaliser de manière rigoureuse et critique des analyses par éléments finis de problèmes concrets en mécanique des solides à l'aide d'un logiciel CAE moderne. ...

CS-101: Advanced information, computation, communication I

Discrete mathematics is a discipline with applications to almost all areas of study. It provides a set of indispensable tools to computer science in particular. This course reviews (familiar) topics as diverse as mathematical reasoning, combinatorics, disc ...