Lecture

Floating Point Numbers: Representation and Errors

Graph Chat

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.

In course

MATH-251(d): Numerical analysis

This course offers an introduction to numerical methods for the solution of mathematical problems as: solution of systems of linear and non-linear equations, functions approximation, integration and differentiation and solution of differential equations. ...

Description

This lecture covers the basics of floating point numbers, including their representation in a computer, single and double precision, and the dangers of round-off errors. Examples are provided to illustrate the loss of significance and potential overflow errors in real-world applications.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

Pablo Antolin Sanchez

Teaching & PhD PhD Students Philipp Christoph Weder, Davor Dobrota Past EPFL PhD Students as codirector Ondine Chanon Courses Analysis III MATH-202(c) The course studies the fundamental concepts of vector analysis and Fourier-Laplace analysis with a view to their use in solving multidisciplinary problems in scientific engineering. Analysis III (for IC) MATH-203(d) The course studies the fundamental concepts of vector analysis and Fourier-Laplace analysis with a view to thei

Official source

Ontological neighbourhood

Mathematics

Analysis: Numerical analysis

Related concepts (32)

Double-precision floating-point format

Double-precision floating-point format (sometimes called FP64 or float64) is a floating-point number format, usually occupying 64 bits in computer memory; it represents a wide dynamic range of numeric values by using a floating radix point. Floating point is used to represent fractional values, or when a wider range is needed than is provided by fixed point (of the same bit width), even if at the cost of precision. Double precision may be chosen when the range or precision of single precision would be insufficient.

Single-precision floating-point format

Single-precision floating-point format (sometimes called FP32 or float32) is a computer number format, usually occupying 32 bits in computer memory; it represents a wide dynamic range of numeric values by using a floating radix point. A floating-point variable can represent a wider range of numbers than a fixed-point variable of the same bit width at the cost of precision. A signed 32-bit integer variable has a maximum value of 231 − 1 = 2,147,483,647, whereas an IEEE 754 32-bit base-2 floating-point variable has a maximum value of (2 − 2−23) × 2127 ≈ 3.

Half-precision floating-point format

In computing, half precision (sometimes called FP16 or float16) is a binary floating-point computer number format that occupies 16 bits (two bytes in modern computers) in computer memory. It is intended for storage of floating-point values in applications where higher precision is not essential, in particular and neural networks. Almost all modern uses follow the IEEE 754-2008 standard, where the 16-bit base-2 format is referred to as binary16, and the exponent uses 5 bits.

Extended precision

Extended precision refers to floating-point number formats that provide greater precision than the basic floating-point formats. Extended precision formats support a basic format by minimizing roundoff and overflow errors in intermediate values of expressions on the base format. In contrast to extended precision, arbitrary-precision arithmetic refers to implementations of much larger numeric types (with a storage count that usually is not a power of two) using special software (or, rarely, hardware).

Quadruple-precision floating-point format

In computing, quadruple precision (or quad precision) is a binary floating point–based computer number format that occupies 16 bytes (128 bits) with precision at least twice the 53-bit double precision. This 128-bit quadruple precision is designed not only for applications requiring results in higher than double precision, but also, as a primary function, to allow the computation of double precision results more reliably and accurately by minimising overflow and round-off errors in intermediate calculations and scratch variables.

Related lectures (53)

Number Representation and Bitwise Operators

Explores number representation in computers and bitwise operators for practical programming applications.

Floating Point Representation in Computers

Covers the representation of real numbers in a computer using floating point representation and the dangers of significant digit cancellation.

Integer Representation: Positive Integers

Covers the representation of positive integers, binary notation, machine limitations, overflow, and floating-point representation.

Digital Systems: Fixed and Floating Point Arithmetic

Discusses fixed-point and floating-point arithmetic in digital systems, covering operations, representations, and the implications of rounding errors.

Code Generation: Examples, WebAssembly