Information Theory and Coding

General: Information Theory and Coding

Course schedule

Type   Day Hours     Room
Lecture   Monday 13h15 – 15h00     ELA 1
Lecture   Tuesday 13h15 – 15h00     SG 1
Exercises   Tuesday 15h15 – 17h00     SG 1

 

Language:   English
Coefficient / Crédits :   7 ECTS

Grading

Homework:   10%
Midterm Exam:   40%
Final Exam:   50%

 

More Information:

Course catalog description
Course organization
Course outline
Course rules (in English)
Course rules (in French)

back to menu

Handouts: Information Theory and Coding

  1. Course organization
  2. Course outline
  3. Course rules
  4. Homework 1
  5. Homework 2
  6. Homework 3
  7. Notes on Lempel-Ziv
  8. Homework 4
  9. Midterm Rules
  10. More Exercises
  11. Homework 5
  12. Homework 6
  13. Homework 7
  14. Homework 8 – due December 4th, before 12:00 noon, in INR 031, 032, or 038
  15. Homework 9 – due December 15th, before 12:00 noon, in INR 031, 032, or 038
  16. Homework 10 – due January 7th, before 12:00 noon, in INR 038
  17. Midterm Exam 2008
  18. Midterm exam statistics
  19. Final Exam 2008

 

back to menu

Textbook: T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, 2006.

Reference Material:

  1. R. G. Gallager, Information Theory and Reliable Communication, Wiley, 1968.
  2. D. MacKay, Information Theory, Inference & Learning Algorithms, Cambridge University Press, 2008.
  3. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems, Akademiai Kiado, 1997.
  4. C. E. Shannon, The Mathematical Theory of Communication

back to menu

Homework Assignments: Information Theory and Coding

We will randomly choose two problems in every homework to grade.

 

  1. Homework 1
  2. Homework 2
  3. Homework 3
  4. Homework 5
  5. Homework 6
  6. Homework 7
  7. Homework 8
  8. Homework 9
  9. Homework 10 due Jan 7th, before 12:00, in INR 038

back to menu