CS44800: Introduction to Database Systems, Fall 2019

Homework, Projects & Handouts

Homework

Homeworks will be submitted online via Blackboard.

• Homework 1 Due on 09/05/2019 11:59 pm.
• Homework 2 Due on 09/17/2019 11:59 pm.
• Homework 3 Due on 10/3/2019 11:59 pm.
• Homework 4 Due on 11/11/2019 11:59 pm.
• Homework 5 Due on 11/25/2019 11:59 pm.

Projects

• Project 1: Disk vs In-Memory vs Database Due on 09/04/2019 11:59 pm.

The goal for the project is to create a simple database application that supports query operation over a relation. The project consists in three parts. In each part you are asked to implement the backend of the application in a different way (filesystem, in-memory data structures and a embedded database).

[handout] [files]

• Project 2: Buffer Manager Due on 09/25/2019 11:59 pm.

The goal of this project is to implement a simplified version of a Buffer Manager layer, without support of concurrency control or recovery. This project is based on Minibase, a small relational DBMS, structured in several layers.

[handout] [files] [PSO Slides]

• Project 3: Relational Operators Due on 10/16/2019 11:59 pm. [feedback]

The goal of this project is to implement Relational Algebra Operators using the Iterator interface inside a working database system. This project is based on Minibase, a small relational DBMS, structured in several layers.

[handout] [files] [PSO Slides]

• Project 4: Concurrency Control and Recovery Due on 11/20/2019 11:59 pm. [feedback]

The goal of this project is to implement a simplified version of the 2PL protocol used to handle concurrent operations (e.g., transactions). The implementation should prevent deadlocks and handling them properly. The project will give you some practical experience about Chapter 20 (Intro to Transaction Processing Concepts and Theory), 21 (Concurrency Control Techniques) and 22 (Database Recovery Techniques) from the Textbook.

[handout] [files]

• Project 5: Big Data - Apache Spark Due on 12/04/2019 11:59 pm. [feedback]

The goal of this project is getting some experience in Big Data Technologies. For the project, you will use Hadoop Distributed Filesystem and Spark to perform some data processing tasks. We encourage you to start as soon as possible with this project, especially since you need to become familiar with the Purdue Scholar Cluster. Related material will be covered during the PSO sessions.

[handout] [files]

Other Handouts

Implementation

• Operating System Support for Database Management, Michael Stonebraker, Communications of the ACM, Volume 24 Issue 7, Pages 412-418, July 1981. (pdf)
• The Raid Distributed Database System, Bharat Bhargava and John Riedl, IEEE Trans on Software Engineering, 15(6), June 1989. (pdf)
• The design and implementation of INGRES. Michael Stonebraker,ACM Transactions on Database Systems (TODS) 1.3 (1976): 189-222. (pdf)

Secure data warehouse & Privacy Preserving Data Dissemination

• Talk for Secure Data Warehouse
• Secure Data Warehouse
• Privacy Preserving Data Dissemination

Concurrency Control Handouts

• 2PL and Conflict Graph. (pdf)
• Locking-Serializability. (pdf)
• Optimistic-timestamps-Failure-Commitment. (pdf)
• It will help you learn about CC ideas on 2PL, optimistic, time stamps and about transaction failures to help you do the homework.
  You may read the papers on CC under handouts and check sections 2 up to 2.3.2. (pdf)
• You may read slides on chapter 21 (7th edition) up to slides 21-22 and then 27-29 for answers to homework. (pdf)
• Logs, failures, serializability is discussed in slides for chapter 20. (pdf)
• Concurrency Control in Database Systems, Bharat Bhargava, IEEE Trans on Knowledge and Data Engineering,11(1), Jan.-Feb. 1999. (pdf)
• The Transaction Concept: Virtues and Limitations , Jim Gray, VLDB, 1981. (pdf)

Cloud Computing

• Hey, You, Get Off of My Cloud, T. Ristenpart, E. Tromer, H. Shacham, S. Savage.in Proceedings of CCS 2009, pages 199-212. ACM Press, Nov. 2009. (pdf)
• Amazon's response to "Hey, you, get off my cloud". (pdf)
• Above the Clouds: A Berkeley View of Cloud Computing (pdf)

Reading Material

• Design of intelligent query systems for large databases, Bharat Bhargava, in Lecture notes in Computer Science 2005 (pdf)
• ExpoDB: An Exploratory Data Science Platform, Mohammad Sadoghi, CIDR, 2017. (pdf)

NoSQL and Big Data

• NoSQL vs Relational Databases
• Relational Database Management System (RDBMS) vs NoSQL
• RDBMS vs NoSQL: How do you pick?
• Big Data Means at Least Three Different Things by Michael Stonebraker (slides)

Relational Algebra, Normalization and SQL

• Relational Algebra - Tree Optimizations (pdf)
• VLSI for Relational Algebra. Kung, H. T., and Philip L. Lehman.Proceedings of the 1980 ACM SIGMOD international conference on Management of data. ACM, 1980. (pdf)
• Example of proving loss less join (pdf)
• Handout on Natural and Outer Joins & Relational Calculus (pdf)
• Engineering the Object-Relation Database Model in O-Raid (pdf)
• Normalization and lossless joins and FD preservations (pdf)
• SQL Questions & Answers (pdf)
• SQL Tutorial Questions and Answers
• PL/SQL Tutorial code
• JDBC Tutorial code
• Oracle certification exam (sample questions)

Notes from CS641 Multimedia Database Systems

• Notes

Other

• Solid State Drive (SDD)
• How Solid State Drive (SDD) works
• Data Science and Prediction (pdf)
• Private and Trusted Interactions (slides)
• Handout on SAP Software (pdf)
• SAP online training (video)
• High-frequency trading: when milliseconds mean millions