Hide Advanced Options
Courses - Spring 2026
ENEE
Electrical & Computer Engineering Department Site
Open Seats as of
07/17/2026 at 11:30 AM
ENEE627
Information Theory
Credits: 3
Grad Meth: Reg, Aud
Credit only granted for: ENEE627 or ENEE721.
Formerly: ENEE721.
Additional information: Students must have completed ENEE620; or students who have taken courses with comparable content may contact the department.
Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, lossy source coding. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem.