Purdue CS440: Large-scale Data Analytics
(Fall 2025)


Course Description

"Big data" has been a buzzword for a long time. Many disruptive techniques have been developed to address various aspects of big data. This course will cover the key concepts, design principles, and systems to analyze large-scale data in order to extract novel and transformative insights. Tentative topics include database fundamentals, big data storage (e.g., HDFS), big data computing frameworks (e.g., Hadoop and Spark), data warehouses, data lakes, graph analytics (e.g., Spark Graph), data streaming (e.g., Spark Streaming), large-scale machine learning (e.g., Spark MLlib), vector databases, and cloud-native data analytics.



Instructor

  • Jianguo Wang
  • Email: csjgwang@purdue.edu (note: must include "[CS440]" in the subject)


Teaching Assistants

  • Shige Liu (liu3529@purdue.edu)
  • Yunan Zhang (zhan4404@purdue.edu)


Logistics

  • When: MW 5:30p-6:20p
  • Where: LWSN 1142
  • Office hour: after class or make appointment
  • Pre-requisites: CS242, CS251, and CS373


Labs and PSOs

Labs and PSOs will start from the 3rd week.
  • L01: Friday 11:30am-1:20pm (DSAI B039)
  • L02: Thursday 9:30am-11:20am (DSAI B039)
  • L03: Wednesday 11:30am-1:20pm (DSAI B039)
  • L04: Wednesday 3:30pm-5:20pm (DSAI B031)


Online communications

  • We'll use Piazza, e.g., announcements, discussions, and Q&A.
  • We'll NOT use Brightspace except for sending emails occasionally.
  • We'll use Gradescope for submitting and grading homeworks.


Textbooks (Optional)

Note that textbooks are optional and the lectures slides are self-contained.


Grading

  • Homeworks: 20% (2 * 10%)
  • Midterm exam: 25%
  • Final exam: 35%
  • Project: 20% (2 * 10%)
    • Projects are related to the labs and will be explained in the labs.
  • Extra credits: 5%


Academic Integrity and More


Schedule

Lecture

Topic
Lec 1 (08/25) Course Introduction
Lec 2 (08/27) Relational DB
Lec 3 (09/01) No class due to Labor day
Lec 4 (09/03) SQL
Lec 5 (09/08) Database Storage
Lec 6 (09/10) Index
Lec 7 (09/15) Query Processing 1
Lec 8 (09/17) Query Processing 2
Lec 9 (09/22) Transaction
Lec 10 (09/24) Concurrency Control
Lec 11 (09/29) Crash Recovery
Lec 12 (10/01) Crash Recovery 2
Lec 13 (10/06) Distributed Databases
Lec 14 (10/08) Hadoop
Lec 15 (10/13) No class due to October break
Lec 16 (10/15) SQL-on-Hadoop
Lec 17 (10/20) Midterm Exam (In-class)
Lec 18 (10/22) Big Data Storage
Lec 19 (10/27) Big Data Storage 2
Lec 20 (10/29) Spark Core
Lec 21 (11/03) Spark SQL
Lec 22 (11/05) Spark ML
Lec 23 (11/10) Spark Streaming
Lec 24 (11/12) Spark Graph
Lec 25 (11/17) Vector Data Analytics
Lec 26 (11/19) Vector Data Analytics 2
Lec 27 (11/24) Vector Data Analytics 3
Lec 28 (11/26) No class due to Thanksgiving holiday
Lec 29 (12/01) Cloud-Native Data Analytics
Lec 30 (12/03) Cloud-Native Data Analytics 2
Lec 31 (12/08) Guest Lecture
Lec 32 (12/10) Review