Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Optimality Conditions: Sufficient Optimality Conditions

Description

This lecture discusses the sufficient optimality conditions for a local minimum of a function, focusing on the positivity of the second derivative. Through examples with different functions, the instructor explains how these conditions are verified and their implications for local and global optima.

In MOOC

Optimization: principles and algorithms - Unconstrained nonlinear optimization

Official source

Related concepts (20)

Second derivative

In calculus, the second derivative, or the second-order derivative, of a function f is the derivative of the derivative of f. Informally, the second derivative can be phrased as "the rate of change of the rate of change"; for example, the second derivative of the position of an object with respect to time is the instantaneous acceleration of the object, or the rate at which the velocity of the object is changing with respect to time. In Leibniz notation: where a is acceleration, v is velocity, t is time, x is position, and d is the instantaneous "delta" or change.

Maximum and minimum

In mathematical analysis, the maximum and minimum of a function are, respectively, the largest and smallest value taken by the function. Known generically as extremum, they may be defined either within a given range (the local or relative extrema) or on the entire domain (the global or absolute extrema) of a function. Pierre de Fermat was one of the first mathematicians to propose a general technique, adequality, for finding the maxima and minima of functions.

Derivative

In mathematics, the derivative shows the sensitivity of change of a function's output with respect to the input. Derivatives are a fundamental tool of calculus. For example, the derivative of the position of a moving object with respect to time is the object's velocity: this measures how quickly the position of the object changes when time advances. The derivative of a function of a single variable at a chosen input value, when it exists, is the slope of the tangent line to the graph of the function at that point.

Derivative test

In calculus, a derivative test uses the derivatives of a function to locate the critical points of a function and determine whether each point is a local maximum, a local minimum, or a saddle point. Derivative tests can also give information about the concavity of a function. The usefulness of derivatives to find extrema is proved mathematically by Fermat's theorem of stationary points. The first-derivative test examines a function's monotonic properties (where the function is increasing or decreasing), focusing on a particular point in its domain.

Symmetric derivative

In mathematics, the symmetric derivative is an operation generalizing the ordinary derivative. It is defined as The expression under the limit is sometimes called the symmetric difference quotient. A function is said to be symmetrically differentiable at a point x if its symmetric derivative exists at that point. If a function is differentiable (in the usual sense) at a point, then it is also symmetrically differentiable, but the converse is not true.

Related lectures (33)

Optimality Conditions: Unconstrained MOOC: Optimization: principles and algorithms - Unconstrained nonlinear optimization

Covers Fermat's theorem, necessary optimality conditions, convexity, and eigenvalue curvature in optimization.

Concavity and Convexity: Analysis of Functions

Explores concavity, convexity, critical points, and singularities in functions.

Continuous Derivatives

Covers the concept of continuous derivatives and their application in analyzing functions and determining critical points.

Optimization Basics

Introduces optimization basics, covering logistic regression, derivatives, convex functions, gradient descent, and second-order methods.

Convexity and Concavity