2022-2023 Sem I

This course introduces virtualization techniques and their usage in cloud infrastructure. Students will learn various approaches towards virtualization and get hands-on experience with a modern systems programming language.

Course Information

  • Prerequisites: COL331 or equivalent.

    Note: The course includes programming assignments and thus expects proficiency with systems programming and debugging.

  • Credits: 3-0-2
  • Slot: AA, Mondays and Thursdays 2-3:15pm.
  • Where: LH308
  • TAs:
    • Abhisek Panda: csz202445 AT cse.iitd.ac.in
    • Abhishrut Omprakash Vaidya: siy217558 AT cse.iitd.ac.in
  • Reading material:

Grading criteria

  • 20% labs (programming + analysis assignments)
  • 25% project
  • 5% quizzes
  • 20% minor exam
  • 30% major exam

Supporting systems

  • Discussions should be done on Piazza. Sending emails is discouraged.
  • Labs will be submitted through Moodle. Grades will also be uploaded there.

Acknowledgements

Thanks to Mythilli Vutukuru, IITB and Xi Wang, UoW; parts of this course have been inspired by courses made available by them.

Policies

  • Audit criteria: B grade 40% marks or higher.
  • Ethics: We will employ various methods to catch cheating. Cheating in labs/quizzes will bring zero in that lab/quiz. Cheating twice gets an F in the course.

Late policy

  • To help you cope with unexpected emergencies, you can hand in your Labs solutions late, but the total amount of lateness summed over all the lab deadlines must not exceed 72 hours. You can divide up your 72 hours among the labs however you like; you don’t have to ask or tell us. You can only use late hours only for Labs.
  • 1 quiz in the course can be skipped without penalty.

Tentative topics

We will deeply study a hypervisor written in rust. All the labs and the project will therefore use rust.

  • Getting comfortable with Rust
  • Popek Goldberg theorem
  • Virtualization techniques
    • Software-based virtualization:
      • Full virtualization: Binary translation, shadow paging, ballooning, IO virtualization
      • Paravirtualization: memory virtualization, virtio
    • Hardware-assisted virtualization: KVM, EPT
  • Usefulness
    • Checkpoint/restore
    • Live migration
    • State machine replication
  • What’s new with virtualization?
    • Unikernels
    • Firecracker

Disclaimer: Actual course contents may differ depending on student interest. Reach out to the instructor as soon as possible if there is a particular interest in a topic.

Tentative Schedule

Week Monday Thursday Weekend
1 1 Aug
4 Aug
LEC 1: Introduction.
 
2 8 Aug
LEC 2: OS Background: Virtual memory. Ch: 13-15, 18-20 OSTEP book
11 Aug
Raksha Bandhan
 
3 15 Aug
Independence day
18 Aug
LEC 3: OS Background: Virtualizing CPU Ch: 4-6, OSTEP book
Lab 1 due
4 22 Aug
LEC 4: Rust background: Ownership and borrowing Ch. 4, 10.3, Rust book
25 Aug
LEC 5: Rust background: smart pointers Ch. 15, Rust book
 
5 29 Aug
LEC 6: Rust background: concurrency Ch. 16, Rust book
1 Sep
LEC 7: Trap and emulate hypervisors, Popek-Goldberg Theorem, KVM API
Lab 2 due
6 5 Sep
LEC 8: Rust VMM
8 Sep
LEC 9: Rust VMM
 
7 12 Sep
LEC 10: Shadow page tables. Sec 6.2.2, ToCS’12
15 Sep
LEC 11: Introduce projects. Shadow page tables (2) Sec 4.3, 4.4, 6.2, ASPLOS’06
 
8 19 Sep
LEC 12: Extended page tables. Memory management
22 Sep
Project brainstorming
 
9 26 Sep
Minor exam
29 Sep
LEC 13: Nested virtualization
 
10 3 Oct
Semester break
6 Oct
LEC 14: IO virtualization. Sec 6.1, 6.2, 6.3 of the book
 
11 10 Oct
LEC 15: IO virtualization (2). Sec 6.4.1, 6.4.2 of the book.
Live migration (post copy)
13 Oct
LEC 16: Live migration (pre copy). Virtualization without architectural support. QEMU sec 2
 
12 17 Oct
LEC 17: Virtualization without architectural support. VMWare papers 1 and 2. Xen paper Sec 2.1.1, 2.1.2, 4.2, 4.5.
20 Oct
LEC 18: Fault tolerant virtual machines
 
13 24 Oct
Diwali
27 Oct
LEC 19: Raft
29 Oct
LEC 20: Raft (2)
14 31 Oct
LEC 21: Scalability
Ch.5 of Introduction to Parallel Computing, Struggles with DSM
3 Nov
LEC 22: Spark
 
15 7 Nov
LEC 23: Lightweight Asynchronous Snapshots (Flink), Unikernels
10 Nov
Project presentations
 
16 14 Nov
Project presentations. Firecracker