Course Schedule

Part 1: Data Storage

Week 1

Mon, Jan 20
MLK Day
Wed, Jan 22
Course Introduction
Read: Syllabus
Slides: PDF
Fri, Jan 24
Linux Shell
Setup: GCP VM
Slides: PDF
Worksheet: PDF

Week 2

Mon, Jan 27
Linux Pipelines
Read: Designing Data Intensive Applications, Kleppmann ("Batch Processing with Unix Tools" of Chapter 10)
Slides: PDF
Wed, Jan 29
Docker
Slides: PDF
Worksheet: PDF
Quiz: week 1
Fri, Jan 31
Relational Database Management Systems (RDBMS)
Read: Designing Data Intensive Applications, Kleppmann ("Chapter 1: Reliable, Scalable, and Maintainable Applications")
Slides: PDF

Week 3

Mon, Feb 3
SQL 101: Creating tables
Read: Learning SQL, Beaulieu ("Chapter 2: Creating and Populating a Database")
Released: P1 (MySQL)
Slides: PDF
Wed, Feb 5
Basic SQL queries
  • SELECT
  • FROM
  • WHERE
  • GROUP BY
  • ORDER BY
  • HAVING
  • LIMIT
Read: Learning SQL, Alan Beaulieu (Chapter 3: "Query Primer")
Due: "Who are you?" survey
Quiz: week 2 and before (cumulative)
Fri, Feb 7
SQL subqueries
Read: Learning SQL, Alan Beaulieu (Chapter 9: "Subqueries")

Week 4

Mon, Feb 10
SQL JOINS
Read: Learning SQL, Alan Beaulieu (Chapter 5: "Querying Multiple Tables" and Chapter 10: "Joins Revisited")
Wed, Feb 12
SQL window functions
Read: Learning SQL, Alan Beaulieu (Chapter 16: "Analytic Functions")
Quiz: week 3 and before (cumulative)
Fri, Feb 14
Relational Algebra (RA)
Read: SQL and Relational Theory, C.J. Date ("Chapter 6: SQL and Relational Algebra I: The Original Operators & Chapter 7: SQL And Relational Algebra II: Additional Operators")
Slides: PDF

Week 5

Mon, Feb 17
Non-relational databases: MongoDB
Released: P2 (MongDB)
Due: P1
Slides: PDF
Wed, Feb 19
MongoDB on Docker
Quiz: week 4 and before (cumulative)
Fri, Feb 21
MongoDB API 101

Week 6

Mon, Feb 24
MongoDB Operators
Wed, Feb 26
MongoDB Aggregation
Quiz: week 5 and before (cumulative)
Fri, Feb 28
MongoDB Geospatial Operators

Week 7

Mon, Mar 3
Midterm Review
No TopHat!
Due: P2
Wed, Mar 5
Elasticsearch intro
Slides: PDF
Fri, Mar 7
Elasticsearch API intro
Released: P3 (Elasticsearch)

Week 8

Mon, Mar 10
Elasticsearch: Boosting, highlighting, and aggregations
Wed, Mar 12
Elasticsearch geo queries + Kibana
Quiz: week 7 and before (cumulative)
Fri, Mar 14
Data Generation in Source Systems
Read: Fundamentals of Data Engineering ("Chapter 5: Data Generation in Source Systems")
Slides: PDF
Part 2: Data Integration

Week 9

Mon, Mar 17
Data Ingestion
Read: Fundamentals of Data Engineering ("Chapter 7: Ingestion")
Due: P3
Slides: PDF
Wed, Mar 19
Data Pipeline demo
Quiz: week 8 and before (cumulative)
Fri, Mar 21
Data Transformation: dbt
Released: P4 (ELT)

Week 10

Mon, Mar 24
Spring break
Wed, Mar 26
Spring break
Fri, Mar 28
Spring break

Week 11

Mon, Mar 31
Data Ingestion Considerations
Slides: PDF
Wed, Apr 2
Data Modeling and Normalization
Read: Fundamentals of Data Engineering ("Chapter 8: Queries, Modeling, and Transformation")
Slides: PDF
Quiz: week 10 and before (cumulative)
Fri, Apr 4
Data Modeling Approaches
Read: Fundamentals of Data Engineering ("Chapter 8: Queries, Modeling, and Transformation")
Due (Sat Apr 5): P4
Slides: PDF
Part 3: Predictive Analysis & Visualization

Week 12

Mon, Apr 7
Exploratory Data Analysis (EDA)
Released: P5 (Timeseries Analysis)
Wed, Apr 9
Data Imputation and Interpolation
Quiz: week 11 and before (cumulative)
Fri, Apr 11
Correlation and Resampling

Week 13

Mon, Apr 14
Feature Engineering
Wed, Apr 16
Exponential Moving Average
Quiz: week 12 and before (cumulative)
Fri, Apr 18
ARIMA: Autocorrelation

Week 14

Mon, Apr 21
ARIMA: ADF-test
Wed, Apr 23
Gradient boosting: LightGBM and XGBoost
Due (Thu, Apr 24): P5
Quiz: week 13 and before (cumulative)
Fri, Apr 25
Large Language Model Meta AI (LLaMA)
Released: P6 (LLMs)

Week 15

Mon, Apr 28
LLaMA fine tuning
Wed, Apr 30
Data storytelling
Slides: PDF
Quiz: week 14 and before (cumulative)
Fri, May 2
Final Review
Due (Wed May 7): P6