Information Theory and Coding

Course schedule

Type   Day Hours     Room
Lecture   Monday 13h15 – 15h00     ELA 1
Lecture   Tuesday 13h15 – 15h00     SG 1
Exercises   Tuesday 15h15 – 17h00     SG 1

 

Language:   English
Coefficient / Crédits :   7 ECTS

Grading

Homework:   10%
Midterm Exam:   40%
Final Exam:   50%

 

More Information:

Course catalog description
Course organization
Course outline
Course rules (in English)
Course rules (in French)

back to menu

Staff: Information Theory and Coding

 

instructor   Suhas Diggavi
office   INR 112
phone   38301
email   suhas (dot) diggavi (at) epfl (dot) ch
office hours   upon appointment (send me an email)
    please include the subject line “Course: Information Theory and Coding”
    in any course related email to get a quicker response

 

TA   Shirin Saeedi
office   INR 032
phone   31361
email   shirin (dot) saeedi (at) epfl (dot) ch
office hours   Fridays: 2-3pm

 

TA   Mahdi Jafari
office   BC 046
phone   31354
email   mahdi (dot) jafarisiavoshani (at) epfl (dot) ch
office hours   Tuesdays: 11-12am

 

TA   Hamed Hassani
office   INR 036
phone   37554
email   seyedhamed (dot) hassani (at) epfl (dot) ch
office hours   Wednesdays: 8-9am

 

SA   Eymen Kurdoglu
email   eymen (dot) kurdoglu (at) epfl (dot) ch

 

SA   Mine Alsan
email   mine (dot) aslan (at) epfl (dot) ch

 

SA   Andrei Tudo Sechelea
email   andreitudor (dot) sechelea (at) epfl (dot) ch

 

SA   Jonas Wagner
email   jonas (dot) wagner (at) epfl (dot) ch

back to menu

Announcements & News: Information Theory and Coding

 

  • Lectures start on September 14th.
  • Homework #1 is on the web and is due 29 Sept., 6:00pm, in: INR 032 or INR 036.
  • The office hours have been updated. Please visit here.
  • Homework #2 is on the web and is due 8 Oct., 6:00pm, in INR 036.
  • Homework #3 is on the web and is due 16 Oct., 6:00pm, in INR 036.
  • probability review: This is the notes for the probability review session.
  • Homework #4 is on the web and is due 27 Oct., 6:00pm, in INR 036.
  • Homework #5 is on the web and is due 19 Nov., 6:00pm, in INR 036.
  • Homework #6 is on the web and is due 26 Nov., 6:00pm, in INR 036.
  • Homework #7 is on the web and is due 3 Dec., 6:00pm, in INR 036.

Important Changes to the course schedule
(unless otherwise noted below, the lecture/exercise schedule remains as usual)

  • Exercise session on Tuesday September 15th will be converted into a lecture.

back to menu

Handouts: Information Theory and Coding

  1. Course organization
  2. Course outline
  3. Course rules
  4. Homework 1 (Due on 29 Sept., 6:00pm, in INR 032 or INR 036)
  5. Homework 2 (Due on 8 Oct., 6:00pm, in INR 036)
  6. Homework 3 (Due on 15 Oct., 6:00pm, in INR 036)
  7. Solutions 1
  8. Homework 4 (Due on 27 Oct., 6:00pm, in INR 036)
  9. Solutions 2
  10. More Exercises
  11. Solutions to More Exercises
  12. Solutions 3
  13. Notes on the Lempel-Ziv Algorithm
  14. Solutions 4
  15. Midterm
  16. Homework 5 (Due on 19 Nov., 6:00pm, in INR 036)
  17. Homework 6 (Due on 26 Nov., 6:00pm, in INR 036)
  18. Homework 7 (Due on 3 Dec., 6:00pm, in INR 036)
  19. Homework 8 (Due on 11 Dec., 6:00pm, in INR 036)
  20. Homework 9 (Due on 18 Dec., 6:00pm, in INR 036)
  21. Homework 10
  22. Solutions 5
  23. Solutions 6
  24. Solutions 7
  25. Solutions 8
  26. Midterm solutions
  27. Solutions 9
  28. Solutions 10

 

back to menu

Textbook: T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, 2006.

Reference Material:

  1. R. G. Gallager, Information Theory and Reliable Communication, Wiley, 1968.
  2. D. MacKay, Information Theory, Inference & Learning Algorithms, Cambridge University Press, 2008.
  3. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems, Akademiai Kiado, 1997.
  4. C. E. Shannon, The Mathematical Theory of Communication

back to menu

Additional Material: Information Theory and Coding

  • This is the note on the probability review session.
  • More Exercises (Solution)
  • Here you can find the notes on the Lempel-Ziv algorithm taken from the Information Theory and Coding course given by Prof. Emre Telatar

Here you may find some extra problems with their solutios:

  1. Extra Problems 1 (Solution 1)
  2. Extra Problems 2 (Solution 2)
  3. Extra Problems 3 (Solution 3)
  4. Extra Problems 4 (Solution 4)
  5. Extra Problems 5 (Solution 5)
  6. Extra Problems 6 (Solution 6)
  7. Extra Problems 7 (Solution 7)
  8. Extra Problems 8 (Solution 8)
  9. Extra Problems 9 (Solution 9)
  10. Extra Problems 10(Solution 10)

 

back to menu

Homework Assignments: Information Theory and Coding

We will randomly choose two problems in every homework to grade.

 

  1. Homework 1 (Due on 29 Sept., 6:00pm, in INR 036) ( Solutions 1 )
  2. Homework 2 (Due on 8 Oct., 6:00pm, in INR 036) ( Solutions 2 )
  3. Homework 3 (Due on 16 Oct., 6:00pm, in INR 036) ( Solutions 3 )
  4. Homework 4 (Due on 27 Oct., 6:00pm, in INR 036) ( Solutions 4 )
  5. Homework 5 (Due on 19 Nov., 6:00pm, in INR 036) ( Solutions 5 )
  6. Homework 6 (Due on 26 Nov., 6:00pm, in INR 036) ( Solutions 6 )
  7. Homework 7 (Due on 3 Dec., 6:00pm, in INR 036) ( Solutions 7 )
  8. Homework 8 (Due on 11 Dec., 6:00pm, in INR 036) ( Solutions 8 )
  9. Homework 9 (Due on 18 Dec., 6:00pm, in INR 036) ( Solutions 9 )
  10. Homework 10 ( Solutions 10 )

back to menu