18-kp-1010-vl Information Theory I

Instructors: Prof. Dr. techn. Heinz Köppl; M.Sc. Matthias Georg Schultheis; Mark Edmund Sinzger

Event type: Lecture

Org-unit: Dept. 18 - Electrical Engineering and Information Technology

Displayed in timetable as: E: VL IT I

Subject:

Crediting for:

Hours per week: 3

Language of instruction: Englisch

Min. | Max. participants: - | -

Course Contents:
This lecture course introduces the fundamentals of information and network information theory.
Outline:
information, uncertainty, entropy, mutual information, capacity, differential entropy, typical sequences, Gaussian channels, basics of source and channel coding, linear block codes, Shannon’s source coding theorem, Shannon’s channel coding theorem, capacity of Gaussian channels, capacity of bandlimited channels, Shannon’s bound, bandwidth efficiency, capacity of multiple parallel channels and waterfilling, Gaussian vector channel, Multiple Access Channel, Broadcast Channel, rate region..

Literature:
1. T.M. Cover and J.A. Thomas, Elements of Information Theory, Wiley & Sons, 1991.
2. Abbas El Gamal and Young-Han Kim, Network Information Theory, Cambrige, 2011.
3. S. Haykin, Communication Systems, Wiley & Sons, 2001.

Preconditions:
Knowledge of basic communication theory und probability theory