Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Linear Codes: Dimension and Hamming Weight

In course

COM-102: Advanced information, computation, communication II

Text, sound, and images are examples of information sources stored in our computers and/or communicated over the Internet. How do we measure, compress, and protect the informatin they contain? ...

Description

This lecture covers the concept of linear codes, focusing on the dimension and Hamming weight. The dimension of a linear code is the dimension of the subspace it represents, while the Hamming weight measures the number of non-zero positions in a code word. Examples and theorems related to these concepts are discussed in detail.

Instructors (2)

Michael Christoph Gastpar

Michael Gastpar is a (full) Professor at EPFL. From 2003 to 2011, he was a professor at the University of California at Berkeley, earning his tenure in 2008. He received his Dipl. El.-Ing. degree from ETH Zürich, Switzerland, in 1997 and his MS degree from the University of Illinois at Urbana-Champaign, IL, USA, in 1999. He defended his doctoral thesis at EPFL on Santa Claus day, 2002. He was also a (full) Professor at Delft University of Technology, The Netherlands. His research interests are in network information theory and related coding and signal processing techniques, with applications to sensor networks and neuroscience. He is a Fellow of the IEEE. He is the co-recipient of the 2013 Communications Society & Information Theory Society Joint Paper Award. He was an Information Theory Society Distinguished Lecturer (2009-2011). He won an ERC Starting Grant in 2010, an Okawa Foundation Research Grant in 2008, an NSF CAREER award in 2004, and the 2002 EPFL Best Thesis Award. He has served as an Associate Editor for Shannon Theory for the IEEE Transactions on Information Theory (2008-11), and as Technical Program Committee Co-Chair for the 2010 International Symposium on Information Theory, Austin, TX.

Bixio Rimoldi

Bixio Rimoldi received the Dipl. El.-Ing degree as well as the Dr. ès Sciences degree from the ETHZ, Switzerland. Since 1997, he holds a full professor position at the School of Computer and Communication Sciences at EPFL and he is the director of EPFL's Mobile Communications Laboratory (LCM). Prior to joining EPFL, he was in the faculty of the Electrical Engineering department of Washington University. In 1993, he received a US National Science Foundation Young Investigator Award. In 2000, he was elected to the grade of Fellow of the IEEE. During the period 2002-2009 he has been on the Board of Governors of the IEEE Information Theory Society, where he served in several offices including President. He was co-chairman with Bruce Hajek of the 1995 IEEE Information Theory Workshop on Information Theory, Multiple Access, and Queueing (St Louis, MO), and co-chairman with Jim Massey of the 2002 IEEE International Symposium in Information Theory (Lausanne, Switzerland). He has been a member of the editorial board of "Foundations and Trends on Communications and Information Theory," and was an editor of the European Transactions on Telecommunications. During 2005 and 2006 he was the Director of EPFL's Bachelor program in Communication Systems. His interests are in various aspects of digital communications, information theory, and software-defined radio.

Official source

Ontological neighbourhood

Information engineering

Information theory: Coding theory

Related concepts (23)

Linear code

In coding theory, a linear code is an error-correcting code for which any linear combination of codewords is also a codeword. Linear codes are traditionally partitioned into block codes and convolutional codes, although turbo codes can be seen as a hybrid of these two types. Linear codes allow for more efficient encoding and decoding algorithms than other codes (cf. syndrome decoding). Linear codes are used in forward error correction and are applied in methods for transmitting symbols (e.g.

Linear algebra

Linear algebra is the branch of mathematics concerning linear equations such as: linear maps such as: and their representations in vector spaces and through matrices. Linear algebra is central to almost all areas of mathematics. For instance, linear algebra is fundamental in modern presentations of geometry, including for defining basic objects such as lines, planes and rotations. Also, functional analysis, a branch of mathematical analysis, may be viewed as the application of linear algebra to spaces of functions.

Coding theory

Coding theory is the study of the properties of codes and their respective fitness for specific applications. Codes are used for data compression, cryptography, error detection and correction, data transmission and data storage. Codes are studied by various scientific disciplines—such as information theory, electrical engineering, mathematics, linguistics, and computer science—for the purpose of designing efficient and reliable data transmission methods.

Error correction code

In computing, telecommunication, information theory, and coding theory, forward error correction (FEC) or channel coding is a technique used for controlling errors in data transmission over unreliable or noisy communication channels. The central idea is that the sender encodes the message in a redundant way, most often by using an error correction code or error correcting code (ECC). The redundancy allows the receiver not only to detect errors that may occur anywhere in the message, but often to correct a limited number of errors.

Linear map

In mathematics, and more specifically in linear algebra, a linear map (also called a linear mapping, linear transformation, vector space homomorphism, or in some contexts linear function) is a mapping between two vector spaces that preserves the operations of vector addition and scalar multiplication. The same names and the same definition are also used for the more general case of modules over a ring; see Module homomorphism. If a linear map is a bijection then it is called a .

Related lectures (25)

Linear Codes: Systematic vs Non-Systematic

Explores the creation of systematic linear codes and the transformation of non-systematic codes, showcasing their equivalence and importance in simplifying encoding and decoding processes.

Information Theory: Source Coding, Cryptography, Channel Coding

Covers source coding, cryptography, and channel coding in communication systems, exploring entropy, codes, error channels, and future related courses.

Lecture: Shannon

Covers the basics of information theory, focusing on Shannon's setting and channel transmission.

Minimum Distance Decoding

Explains Minimum Distance (MD) decoding on erasure channels with illustrative examples.

Linear Block Codes: Basics