This course will begin by explaining the methods of types. It will then address the rate distortion theory. It will also cover multiple-users channels and channels with random parameters. Finally, correlated source encoding will be provided.

Course Objectives

To teach the fundamental principles behind modern communication systems To state the difficulties that are experienced during the design of communication systems To give the ability to optimize such systems.

Recommended or Required Reading

T.M. Cover and J.A. Thomas, “Elements of Information Theory”, Wiley, 2nd Edition, 2006. ,Imre Csiszár and J. Körner, “Information Theory: Coding Theorems for Discrete Memoryless Systems”, Akademiai Kiado, 3rd edition, Budapest, 1997. ,R.G. Gallager, “Information Theory and Reliable Communication”, Wiley, 1968. ,G. Kramer, “Topics in Multi-User Information Theory”, Foundations and Trends in Communications and Information Theory, vol. 4, nos. 4–5, pp. 265–444, 2007. ,J.L. Massey, “Applied Digital Information Theory I and II”, lecture notes, Swiss Federal Institute of Technology (ETH), Zurich, Switzerland. ,J.S. Muller, “Asymmetry: The Foundation of Information”, Springer, 2007. ,J.G. Roederer, “Information and Its Role in Nature (The Frontiers Collection)”, Springer, 2005. ,Claude E. Shannon, “A mathematical theory of communication”, Bell System Technical Journal, vol. 27, pp. 379–423 and 623–656, July and October 1948. ,R.W. Yeung, “A First Course in Information Theory”, Kluwer Academic Publishers, 2005.

Learning Outcomes

1. Know basic ideas of information theory.

2. Evaluate the modern communication systems by stating the pros and cons of them

3. Discuss the feasibility of new communication systems

4 Design communication systems

Grading

Midterm: 30%

Research Presentation: 30%

Final Exam: 40%