Basics of the Calculus of Variations
A List of Key Points:
• What is a variational problem?
• The problem of Lagrange
• Necessary conditions for the optimum
• Sufficient conditions for the optimum
4/6/2020 @2020 New York University Tandon 310 School of Engineering
A Variational Problem
ConsiderafunctionalJ: F n, withF n denoting the set of functions from to n.
Goal: Find, if possible, an optimal solution x* : n
such that
J x* min J(x)
4/6/2020 @2020 New York University Tandon 311 School of Engineering
Examples of Functional
1)J(x)tb f(x,x,t)dt, (theproblemofLagrange) t
a
2) J x f(x(tb),tb) f(x(ta),ta)
f (x(t),t) tb (the problem of Mayer)
ta
3)J (x) f (x(t),t)tb tb f(x,x,t)dt tt
aa
(the problem of Bolza)
4/6/2020 @2020 New York University Tandon 312 School of Engineering
John Bernoulli’s Brachistochrone Problem (1696)
Find the shortest time of descent of a bead along a wire joining two nearby fixed points.
4/6/2020
@2020 New York University Tandon 313 School of Engineering
P0 g
(x0, y0)
P1 (x1, y1)
4/6/2020 @2020 New York University Tandon 314 School of Engineering
Brachistochrone Problem
Let P (x , y ), P (x , y ) and be 000111
the curve joining these points. Then,
the time T required for a bead to move
from P to P along is: 01
T T dt ds 0v
with speed v ds , ds arc length along . dt
4/6/2020
@2020 New York University Tandon 315 School of Engineering
Bernoulli’s Brachistochrone Problem (cont’d)
At location P (x, y), the bead has: kinetic energy 1 mv2
2 potential energy mgy
Without considering friction, according to conservation law, 1mv2 mgyconstantmgy
4/6/2020
@2020 New York University Tandon 316 School of Engineering
2
0
Bernoulli’s Problem (cont’d)
4/6/2020
@2020 New York University Tandon 317 School of Engineering
If one parameterizes as :yY(x), xxx
01 then v 2gy0Y(x)
On the other hand, ds 1Y(x)2 dx Therefore,
ds x 1Y(x)2
1 dx J(Y)
v x0 2gy0Y(x)
Basic Definitions
Strong relative minimum:
A function xa (t) is said to yield a strong relative minimum
J(xa)overtta,tb if 10s.t.
J(xa)J(x)for xax1,tta,tb .
Weak relative minimum:
J ( xa ) is said to be a weak relative minimum
overtta,tbif 1,20s.t.
J(x)J(x)for x x, x x andtt,t .
a a 1a2 ab
4/6/2020 @2020 New York University Tandon 318 School of Engineering
Basic Definitions
Strongly continuous:
J is strongly continous at xa if 0, 0 s.t.
xxa J(x)J(xa).
A variation x:
A (small) change to a function x x(t), i.e.
x x x.
4/6/2020 @2020 New York University Tandon 319 School of Engineering
Question
4/6/2020
@2020 New York University Tandon 320 School of Engineering
So, how to solve the problem of Lagrange minJ(x)tb f(x,x,t)dt
t a
assuming x is at least continuous.
4/6/2020
First variation @2020 New York University Tandon School of Engineering
321
Necessary Conditions
To this end, consider the increment
J J(xx)J(x)
As a direct application of Taylor formula
around 0, it holds: JJ(xx)|0 2J(xx)
2 2!
2 J 2J 3J
0
2! 3!
J (x x) |0
0,
0. (minimization only)
2J(xx) 2
0
4/6/2020
@2020 New York University Tandon 322 School of Engineering
Necessary Conditions
Therefore, we have necessary optimality conditions:
An Exercise
Let the functional J J(x) be defined as J(x) 1x(t)2 x(t)3 dt
0
for all continuous functions x from [0,1] to ,
i.e. xC0 ([0,1];).
Give the first variation of J , around any given x.
1
4/6/2020 @2020 New York University Tandon 323 School of Engineering
Answer
J J(x;x)12x(t)3x(t)2x(t)dt 0
for any xC0 ([0,1];).
4/6/2020 @2020 New York University Tandon 324 School of Engineering
4/6/2020
@2020 New York University Tandon 325 School of Engineering
Back to the Problem of Lagrange
As a particular case, consider J(x)tb f(x,x,t)dt
t a
J(xx)|
The Problem of Lagrange
ε=0
xf dttb tb f f dtxdt
t xta axx
When the end conditions are fixed (e.g., in Bernoulli’s problem),
xfdttb 0. x ta
Then,
4/6/2020
@2020 New York University Tandon 326 School of Engineering
tb f f dtxdt0.
ta
xx
Proof:
J 0 N f x f x d t c o n s t a n t
tb f f dtxdttb N(t)xtdt
4/6/2020
@2020 New York University Tandon School of Engineering
327
Fundamental Lemma
t x x t aa
N(t)x t b t
t dN(t) b x t dt
tt
t
dt
0
a
a
First‐order Necessary Condition
Any optimal solution must satisfy
f f dt c xx
Curves satisfying the above equation are called “first-variational curves”.
4/6/2020 @2020 New York University Tandon 328 School of Engineering
Consequences of the Necessary Condition
• A Corner Condition
• The Euler‐Lagrange Equation
4/6/2020 @2020 New York University Tandon 329 School of Engineering
A Corner Condition
A corner point is a point at which dx/dt has a jump discontinuity.
At any corner point t tc ,
lim f (x(t), x(t),t) lim f (x(t), x(t),t).
ttc x ttc x thanks to the first-order necessary condition.
4/6/2020 @2020 New York University Tandon 330 School of Engineering
The Euler‐Lagrange Equation
Differentiating both sides of the necessary condition yields:
ELequation: dfxfx0 dt
4/6/2020 @2020 New York University Tandon 331 School of Engineering
Comment
Between corners of x(t), EL equation can be rewritten as
4/6/2020
@2020 New York University Tandon 332 School of Engineering
d2xf dxf f f dt2 xx dt xx xt x
with boundary conditions x(ta ) ca , x(tb ) cb .
Application to the Shortest Distance Problem
For the purpose of illustration, consider the simple of problem of finding the shortest distance between two given points:
P x , y and P x , y . 000111
4/6/2020 @2020 New York University Tandon 333 School of Engineering
The Shortest Distance Problem (cont’d)
Consider curves parameterized as: y (x), forx xx.Then,weintendtominimize
01
the arc length of such curve:
J()x x0
1(x) dx x 1(t) dt x0
4/6/2020
@2020 New York University Tandon School of Engineering
334
1212
The Shortest Distance Problem (cont’d)
A direct application of EL equation yields:
d dt
(t)
0
(t) 1 (t)2
constant
1 (t)2
which, in turn, implies
(t) A, or, (t) At B
where the constants A and B can be determined
from (x ) y , x y . 0011
This is a straight – line segment, as wished !
4/6/2020 @2020 New York University Tandon 335 School of Engineering
4/6/2020
@2020 New York University Tandon 336 School of Engineering
Another Application of EL Equation
Recall that EL equation is often called a two‐point boundary‐value problem:
d 2 x f x x d x f x x f x t f x dt2 dt
with boundary conditions x(ta ) ca ,
x(t ) c . bb
Another Application (cont’d)
Consider the minimization problem
t
minJ(x) b ax2axxax2g(t)xg(t)xdt
ta where
12312
a real constants, a , a 0, g (t)C1. i13i
4/6/2020 @2020 New York University Tandon 337 School of Engineering
Solution
Applying EL equation to the problem yields:
2ax2axg (t)g(t) 1 3 2 1
D e f i n e 2 a 3 , g 0 g 2 g 1 a 2a
11
x(t)cet c et 1 tta e eg (t)d
1220 0 with the constants c , c and t determined by
12a the boundary conditions.
4/6/2020 @2020 New York University Tandon 338 School of Engineering
4/6/2020
@2020 New York University Tandon 339 School of Engineering
Isoperimetric Constraints
Consider a constrained problem of the form
minJ(x)tb f(x,x,t)dt t
a
subjectto: K(x)tb f (x,x,t)dtK
ta 1 1 withK1 aconstant.
A Motivational Example
Goal: find the dimensions of the rectangle having the smallest perimeter among all rectangles with given fixed area A.
4/6/2020 @2020 New York University Tandon 340 School of Engineering
Euler‐Lagrange Multiplier Theorem (Necessary Conditions)
Letx bealocalextremum.Assumethatbothvariations J and K be weakly continuous near x.
Then, at least one of the following conditions holds: 1. K(x;x)0, x.
2. There exists a constant such that J(x;x)K(x;x), x.
4/6/2020 @2020 New York University Tandon 341 School of Engineering
Problem formulation to the example
min J (x) 2(x x ) (Perimeter) 12
subjectto K(x)xx A (Area) 12
x 0, x 0. 12
(Note: Of course, this particular problem can be also considered as a nonlinear optimization task and be solved using Cauchy-Schwarz inequality.)
4/6/2020 @2020 New York University Tandon 342 School of Engineering
Solution to the example
First variations of J and K: J(x;x)2x 2x
K(x;x)xx xx 2112
Clearly,K(x; )0 x 0,x 0. 12
So, the 2nd possibility holds, i.e., , s.t. 2x 2x x*x x*x
122112
4/6/2020 @2020 New York University Tandon 343 School of Engineering
12
Solution to the example (cont’d)
4/6/2020
@2020 New York University Tandon 344 School of Engineering
(2x*)x (2x*)x 0 21 12
(2x*)0, (2x*)0 21
x* x* 12
2
x*x* A,becausex*x*A.
1212 Finally, it is directly checked that
J(x*)J(x), xx*x.
Isoperimetric Theorem
Assume that the function x* (t) is a first-variational curve which results in the minimum of
J (x)tb f(x,x,t)h f (x,x,t)dt at11
a i.e.
t
J (x)J (x*) b f(x*,x*,t)hf(x*,x*,t) dt
with h independent of x,t.
aata 11
1
Further assume that the constraint is satisfied by x* (t).
Then, x*(t) is the minimal solution to the problem.
4/6/2020 @2020 New York University Tandon 345 School of Engineering