ECE-GY 6063 Information Theory

3 Credits

Mathematical information measures: entropy, relative entropy and mutual information. Assymptotic equipartition property, entropy rates of stochastic processes. Lossless source encoding theorems and source coding techniques. Channel capacity, differential entropy and the Gaussian channel. Lossy source coding rate distortion theory. Brief overview of network information theory.

Prerequisite(s): Graduate status and ECE-GY 6303 .
Weekly Lecture Hours: 3 | Weekly Lab Hours: 0 | Weekly Recitation Hours: 0