Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Optimality Conditions: Unconstrained

Description

This lecture covers Fermat's theorem stating that x* is a local minimum of f if f is differentiable around x* and Vf(x*) = 0. It also discusses necessary optimality conditions, such as the positive semidefinite condition for twice differentiable functions and examples illustrating the concept. Additionally, the lecture explores second derivatives, convexity, and eigenvalue curvature in the context of optimization.

In MOOC

Optimization: principles and algorithms - Unconstrained nonlinear optimization

Official source

Ontological neighbourhood

Mathematics

Analysis: Calculus

Related concepts (29)

Differentiable function

In mathematics, a differentiable function of one real variable is a function whose derivative exists at each point in its domain. In other words, the graph of a differentiable function has a non-vertical tangent line at each interior point in its domain. A differentiable function is smooth (the function is locally well approximated as a linear function at each interior point) and does not contain any break, angle, or cusp. If x0 is an interior point in the domain of a function f, then f is said to be differentiable at x0 if the derivative exists.

Second derivative

In calculus, the second derivative, or the second-order derivative, of a function f is the derivative of the derivative of f. Informally, the second derivative can be phrased as "the rate of change of the rate of change"; for example, the second derivative of the position of an object with respect to time is the instantaneous acceleration of the object, or the rate at which the velocity of the object is changing with respect to time. In Leibniz notation: where a is acceleration, v is velocity, t is time, x is position, and d is the instantaneous "delta" or change.

Derivative test

In calculus, a derivative test uses the derivatives of a function to locate the critical points of a function and determine whether each point is a local maximum, a local minimum, or a saddle point. Derivative tests can also give information about the concavity of a function. The usefulness of derivatives to find extrema is proved mathematically by Fermat's theorem of stationary points. The first-derivative test examines a function's monotonic properties (where the function is increasing or decreasing), focusing on a particular point in its domain.

Derivative

In mathematics, the derivative shows the sensitivity of change of a function's output with respect to the input. Derivatives are a fundamental tool of calculus. For example, the derivative of the position of a moving object with respect to time is the object's velocity: this measures how quickly the position of the object changes when time advances. The derivative of a function of a single variable at a chosen input value, when it exists, is the slope of the tangent line to the graph of the function at that point.

Convex optimization

Convex optimization is a subfield of mathematical optimization that studies the problem of minimizing convex functions over convex sets (or, equivalently, maximizing concave functions over convex sets). Many classes of convex optimization problems admit polynomial-time algorithms, whereas mathematical optimization is in general NP-hard.

Related lectures (36)

Tangent to Graph of a Function

Explores finding the equation of the tangent line to a function's graph at a point.

Derivation Term by Term MOOC: Analysis I MOOC: Analysis I (part 6) : Study of functions, limited developments

Introduces the study of functions defined by power series and emphasizes the importance of separately considering boundary points.

Derivatives: Definition and Properties

Explores the definition and properties of derivatives, including slopes of tangent lines and differentiability conditions.

Linear Approximation and Derivative Parametric

Covers linear approximation, parametric derivatives, and differentiability conditions on intervals.

Faster and Projected Gradient Descent: Optimization Techniques