Multivariable optimisation and Lagrange multipliers
An unconstrained local extremum of f(x, y) occurs only where every partial derivative vanishes, and the second-derivative (Hessian) test then tells a maximum from a minimum from a saddle point; when the search is restricted to a constraint g(x, y) = c, Lagrange's method replaces that condition with ∇f = λ∇g — the geometric fact that at a constrained extremum the level curve of f is tangent to the constraint curve.
Practise this conceptFinding where a multivariable function is largest or smallest starts the same way single-variable optimisation does: a smooth local extremum can only sit where every partial derivative is zero, so ∇f = 0 gives a set of candidate points. Unlike the single-variable case, a flat gradient no longer separates neatly into "max" or "min" — it might be a saddle point, flat in one direction and curved oppositely in another. The Hessian (the matrix of second partial derivatives) settles this: its sign pattern distinguishes a genuine maximum, a genuine minimum, and a saddle.
Constrained optimisation changes the question: instead of the best point anywhere in the plane, you want the best point on a curve g(x, y) = c. At that constrained extremum, the level curve of f is tangent to the constraint curve — geometrically, if it weren't tangent, you could slide slightly along the constraint and still improve f. Tangency means the two gradients are parallel, which is exactly the equation ∇f = λ∇g. That equation is not the whole problem, though: solving it only pins down a direction relative to the constraint, so the constraint equation g(x, y) = c must be solved alongside it to get an actual point.
The multiplier λ is not disposable bookkeeping — it measures the sensitivity of the optimal value of f to a small change in the constraint level c, the same interpretation that gives Lagrange multipliers their central role in economics (shadow prices) and physics (constraint forces).
Key ideas
Requires: Partial derivatives
Common misconceptions
- Believes that any point where ∇f = 0 must be a local extremum, without applying the second-derivative (Hessian) test to rule out a saddle point.
- Treats the Lagrange multiplier λ as a leftover algebra symbol with no meaning, rather than the rate at which the optimal value of f changes per unit change in the constraint level c.
- Solves ∇f = λ∇g for a candidate point and stops, forgetting that the original constraint g(x, y) = c is itself a required equation in the system, not just a label on the problem.
Resources
Part of these UT courses
This concept is mapped as covering part of the following course(s) in the University of Tartu curriculum.
- Higher mathematics IIMTMM.00.341