The university continues to monitor the circumstances related to the pandemic. As such, course delivery methods and locations for the Spring 2021 semester will be finalized and published in the Schedule of Classes by December 4, 2020.
Hide Advanced Options
Courses - Spring 2020
ENEE
Electrical & Computer Engineering Department Site
ENEE627
Information Theory
Credits: 3
Grad Meth: Reg, Aud, S-F
Prerequisite: ENEE620.
Credit only granted for: ENEE627 or ENEE721.
Formerly: ENEE721.
Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, lossy source coding. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem.