EE365: Lecture Slides

Spring Quarter 2014

These lecture slides will be updated frequently, both before and after the lecture is covered in class. We will also be adding more lectures, so the numbers will change as well.

  1. Introduction

  2. Shortest path example

  3. Probability and Monte Carlo

  4. Markov chains

  5. Epidemic example

  6. Hitting times

  7. Structure of Markov chains

  8. Value

  9. Cost and reward