Statistics 311/Electrical Engineering 377: Information Theory and Statistics

John Duchi, Stanford University, Fall 2025

Exercises

We will have problem sets due roughly every two weeks, beginning with the first week of class. In effort to upload solutions to the problem sets as quickly as possible once they are due, because this promotes learning well, we will have no extensions to homework. Exercises should be uploaded to Gradescope by 11:59pm the day they are due. All exercises correspond to chapter/exercise numbers in the lecture notes.

  • Problem set 1: 2.1, 2.5, 2.9, 2.10, 2.11, 4.3, 5.1. Due date: Tuesday, October 14.
    Solutions

  • Problem set 2: 6.1, 6.6, 6.7, 7.6, 7.7, 8.11. Extra credit: 6.8–6.9. Due date: Tuesday, October 28.
    Solutions

  • Problem set 3: 9.4, 9.6, 9.9, 11.1, 11.8, 10.3. Due date: Tuesday, November 11.
    Solutions

  • Problem set 4: 10.4, 14.4, 14.7, 15.3, 15.4, 16.1, 16.3 Due date: Tuesday, December 2.
    Solutions

  • Problem set 5 (extra credit): 17.5, 18.7. Due date: Tuesday, December 9.
    Solutions