CENG 511

Advanced Information Theory


This course will begin by explaining the methods of types. It will then address the rate distortion theory. It will also cover multiple-users channels and channels with random parameters. Finally, correlated source encoding will be provided.

Method of types
Method of types, large deviation theory
Large deviation theory, conditional limit theorem
Conditional limit theorem, joint and conditional types
Strongly typical sets
Strongly typical sets, rate distortion theory
Rate distortion theory
Rate distortion theory
Rate distortion function
Multiple descriptions
Wyner-Ziv problem
Slepian-Wolf problem
Multiple-Access Channel
Multiple-Access Channel