skip to page content SBU
95-869 Big Data and Large Scale Computing
Spring 2022

Home
Syllabus
Assignments
Notes

CLASS MEETS:

Time: TUE/THU 3:05PM - 4:25PM
Place: HBH 1204

PEOPLE:

Instructor: Leman Akoglu
  • Email: invert (andrew.cmu.edu @ lakoglu)
  • Office hour: TUE 9-10 PM EDT (on Zoom)

Teaching Assistants:
Maria Lara Cuervo
  • Email: invert (andrew.cmu.edu @ mlaracue)
  • Office hour: THU 9:30-10:30PM EDT (on Zoom)
Yunhan Xu
  • Email: invert (andrew.cmu.edu @ yunhanx)
  • Office hour: MON 5-6PM EDT (on Zoom)

Note that all OHs will be held on Zoom. Please find the Zoom links to individual OHs on Canvas.


COURSE DESCRIPTION:


The rate and amount of data being generated in today's world by both humans and machines are unprecedented. Being able to store, manage, and analyze large-scale data has critical impact on business intelligence, scientific discovery, social and environmental challenges.

The goal of this course is to equip students with the understanding, knowledge, and practical skills to develop big data / machine learning solutions with the state-of-the-art tools, particularly those in the Spark environment, with a focus on programming models in MLlib, GraphX, and SparkSQL. See the syllabus for more details. Students will also gain hands-on experience with MapReduce and Apache Spark using real-world datasets.

This course is designed to give a graduate-level student a thorough grounding in the technologies and best practices used in big data machine learning. The course assumes that the students have the understanding of basic data analysis and machine learning concepts as well as basic knowledge of programming (preferably in Python or Java). Previous experience with Hadoop, Spark or distributed computing is NOT required.

Learning Objectives

By the end of this class, students will
  • gain understanding of the MapReduce paradigm and Hadoop ecosystem
  • understand scalability challenges for common ML tasks
  • study distributed machine learning algorithms
  • understand details of SparkSQL, GraphX, and MLlib (Spark's ML library)
  • implement distributed pipelines in Apache Spark using real datasets

RECOMMENDED TEXTBOOKS:

There is no official textbook for the course. I will post all the lecture notes and several readings on course website.
Below you can find a list of recommended reading.

BULLETIN BOARD and other info

  • We will use the Canvas for course materials, homework deposits, announcements, and grades.
  • We will use Piazza for questions and discussions.
  • Carnegie Mellon 2021-2022 Official academic calendar

MISC - FUN:

Joke-1     Joke-2     Joke-3