Lecture

Random Coding: Achievability and Proof Variants

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

COM-404: Information theory and coding

The mathematical principles of communication that govern the compression and transmission of data and the design of efficient methods of doing so. ...

Description

This lecture by the instructor covers the concept of random coding in information theory, focusing on the achievability of rates through random coding. The lecture discusses the proof variants and slight variations in the proof, emphasizing the achievable rate given a channel. It explores the process of fixing variables and the implications for achieving the desired rate. The lecture also delves into the concept of achievable rates through random coding and the slight variations in the proof process, highlighting the importance of choosing the right words for encoding and decoding. The lecture concludes by discussing the architectural principles of source encoding and decoding, ensuring reliable communication at higher rates.

Instructor

Emre Telatar

I. Emre Telatar received the B.Sc. degree in electrical engineering from the Middle East Technical University, Ankara, Turkey, in 1986. He received the S.M. and Ph.D. degrees in electrical engineering and computer science from the Massachusetts Institute of Technology, Cambridge, in 1988 and 1992 respectively. In 1992, he joined the Communications Analysis Research Department at AT&T Bell Laboratories (later Lucent Technologies), Murray Hill, NJ. He has been at the EPFL since 2000. Emre Telatar was the recipient of the IEEE Information Theory Society Paper Award in 2001. He was a program co-chair for the IEEE International Symposium on Information Theory in 2002, and associate editor for Shannon Theory for the IEEE Information Theory Transactions from 2001 to 2004. He was awarded the EPFL Agepoly teaching prize in 2005. Emre Telatar's research interests are in communication and information theories.

Official source

Related concepts (32)

Architecture

Architecture is the art and technique of designing and building, as distinguished from the skills associated with construction. It is both the process and the product of sketching, conceiving, planning, designing, and constructing buildings or other structures. The term comes ; ; . Architectural works, in the material form of buildings, are often perceived as cultural symbols and as works of art. Historical civilizations are often identified with their surviving architectural achievements.

Information theory

Information theory is the mathematical study of the quantification, storage, and communication of information. The field was originally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s. The field, in applied mathematics, is at the intersection of probability theory, statistics, computer science, statistical mechanics, information engineering, and electrical engineering. A key measure in information theory is entropy.

Shannon's source coding theorem

In information theory, Shannon's source coding theorem (or noiseless coding theorem) establishes the limits to possible data compression, and the operational meaning of the Shannon entropy. Named after Claude Shannon, the source coding theorem shows that (in the limit, as the length of a stream of independent and identically-distributed random variable (i.i.d.) data tends to infinity) it is impossible to compress the data such that the code rate (average number of bits per symbol) is less than the Shannon entropy of the source, without it being virtually certain that information will be lost.

Classical architecture

Classical architecture usually denotes architecture which is more or less consciously derived from the principles of Greek and Roman architecture of classical antiquity, or sometimes more specifically, from the works of the Roman architect Vitruvius. Different styles of classical architecture have arguably existed since the Carolingian Renaissance, and prominently since the Italian Renaissance. Although classical styles of architecture can vary greatly, they can in general all be said to draw on a common "vocabulary" of decorative and constructive elements.

Revivalism (architecture)

Architectural revivalism is the use of elements that echo the style of a previous architectural era that have or had fallen into disuse or abeyance between their heyday and period of revival. Revivalism, in a narrower sense, refers to the period of- and movement within- Western architectural history during which a succession of antecedent and remenescent styles were taken to by architects, roughly from the late 18th century, and which was itself succeeded by Modernism.

Related lectures (46)

Information Theory: Entropy and Capacity

Covers concepts of entropy, Gaussian distributions, and channel capacity with constraints.

Designing Solutions: Prototyping and User Experience

Covers the principles of prototyping and user experience design, emphasizing iterative processes and user feedback in creating effective solutions.

Information Theory and Coding: Source Coding

Covers source coding, encoder design, and error probability analysis in information theory and coding.

Creativity & Design Thinking: Empathy, Ideation, and Implementation

Explores empathy, ideation, and implementation in creativity and design thinking, emphasizing user needs and innovative idea generation.

Information Theory: Source Coding