Lectures

Math Camp

Lecture 8: Comparative Statics, Envelopes, and Fixed Points

Lectures 6 and 7 solve one optimization problem at a time. Economics rarely stops there: the interesting question is usually how the solution and its value respond when a parameter moves. What does a tax do to the equilibrium price? What does an extra unit of capacity add to profit? The solved problem almost never has a closed form, so the answers must be read from the equations that characterize the solution. This method is called comparative statics. The main tool of comparative statics is the implicit function theorem, which differentiates through a system of equations.

1 The implicit function theorem

1.1 Scalar implicit differentiation

Let F:UF:U\to\mathbb{R} be C1C^{1} on an open set U2U\subseteq\mathbb{R}^{2}, with the arguments written F(x;θ)F(x;\theta): an equation in the endogenous variable xx, indexed by the parameter θ\theta. Suppose a differentiable function x(θ)x(\theta) solves the equation identically, F(x(θ);θ)=0,F\left(x(\theta);\theta\right)=0 , on some interval of parameters. Such a function is a solution branch of the equation. Differentiating the identity using the chain rule from Lecture 4, we get Fx(x(θ);θ)x(θ)+Fθ(x(θ);θ)=0,F_{x}\left(x(\theta);\theta\right)\,x'(\theta) +F_{\theta}\left(x(\theta);\theta\right)=0 , and at any point where Fx0F_{x}\neq0, x(θ)=Fθ(x(θ);θ)Fx(x(θ);θ).x'(\theta) =-\frac{F_{\theta}\left(x(\theta);\theta\right)} {F_{x}\left(x(\theta);\theta\right)} . The calculation is conditional: if a differentiable solution branch runs through the point, its slope is determined by the equation above.

1.2 The system theorem

The same logic runs for systems. Let XnX\subseteq\mathbb{R}^{n} and Θr\Theta\subseteq\mathbb{R}^{r} be open, and let F:X×ΘnF:X\times\Theta\to\mathbb{R}^{n} collect nn equations in the nn endogenous variables xx, with rr parameters θ\theta. The scalar condition Fx0F_{x}\neq0 becomes invertibility of the endogenous Jacobian.

Theorem 1.1 (Implicit function theorem). Let FF be C1C^{1}, let F(x0;θ0)=0F(x^{0};\theta^{0})=0, and let DxF(x0;θ0)\mathrm{D}_{x}F(x^{0};\theta^{0}) be invertible. Then there are neighborhoods 𝒰\mathcal{U} of θ0\theta^{0} and 𝒱\mathcal{V} of x0x^{0} and a unique C1C^{1} function x:𝒰𝒱x:\mathcal{U}\to\mathcal{V} such that x(θ0)=x0andF(x(θ);θ)=0for every θ𝒰,x(\theta^{0})=x^{0} \qquad\text{and}\qquad F\left(x(\theta);\theta\right)=0 \quad\text{for every }\theta\in\mathcal{U} , and for each θ𝒰\theta\in\mathcal{U} the point x(θ)x(\theta) is the only solution of F(x;θ)=0F(x;\theta)=0 in 𝒱\mathcal{V}. The derivative satisfies

DxF(x(θ);θ)Dθx(θ)=DθF(x(θ);θ).\mathrm{D}_{x}F\left(x(\theta);\theta\right)\,\mathrm{D}_{\theta}x(\theta) =-\mathrm{D}_{\theta}F\left(x(\theta);\theta\right) .(1)

We use the system statement without proof; the scalar case can be proved with the tools of Lectures 2 and 4.

Proof (optional, for one equation and one parameter). The two signs are symmetric, so suppose Fx(x0;θ0)>0F_{x}(x^{0};\theta^{0})>0. Since FxF_{x} is continuous, there is a rectangle [x0δ,x0+δ]×[θ0η,θ0+η][x^{0}-\delta,x^{0}+\delta]\times[\theta^{0}-\eta,\theta^{0}+\eta] on which Fx>0F_{x}>0, so on this rectangle FF is strictly increasing in xx for each fixed θ\theta. Since F(;θ0)F(\,\cdot\,;\theta^{0}) increases through its zero at x0x^{0}, F(x0+δ;θ0)>0andF(x0δ;θ0)<0.F(x^{0}+\delta;\theta^{0})>0 \qquad\text{and}\qquad F(x^{0}-\delta;\theta^{0})<0 . Both signs survive small moves of the parameter: FF is continuous in θ\theta, so there is ε(0,η]\varepsilon\in(0,\eta] such that F(x0+δ;θ)>0F(x^{0}+\delta;\theta)>0 and F(x0δ;θ)<0F(x^{0}-\delta;\theta)<0 for every θ\theta within ε\varepsilon of θ0\theta^{0}. For each such θ\theta, the Theorem 3.7 from Lecture 2 gives a solution x(θ)(x0δ,x0+δ)x(\theta)\in(x^{0}-\delta,x^{0}+\delta) of F(x;θ)=0F(x;\theta)=0, and strict monotonicity in xx makes it the only one in the interval: this is the branch. Repeating the argument with a smaller δ\delta traps the branch in a smaller rectangle, so x(θ)x0x(\theta)\to x^{0} as θθ0\theta\to\theta^{0}: the branch is continuous. We take the differentiability of the branch without proof; its derivative is then the chain-rule formula of Section 1.1. ◻

Everything in the theorem is local: invertibility at one solution gives a branch near that solution and carries no information about solutions elsewhere. Equation (1) is the scalar calculation written with matrices: differentiate the identity F(x(θ);θ)=0F(x(\theta);\theta)=0 by the chain rule and solve. For each of the rr parameters, the corresponding column of Dθx\mathrm{D}_{\theta}x solves one linear system with the same coefficient matrix DxF\mathrm{D}_{x}F, as in Lecture 3; in practice, the matrix is inverted once, or each system is solved directly.

Example 1.2 (Incidence of a per-unit tax).

Fix demand and supply primitives a,ca,c\in\mathbb{R} and b,s>0b,s>0. The parameter is the per-unit tax tt. The endogenous variables are the producer price pp and quantity qq; consumers pay p+tp+t. Demand and supply are q=ab(p+t),q=c+sp.q=a-b\,(p+t), \qquad q=c+s\,p . At a reference tax t0t^{0}, suppose an equilibrium x0=(p0,q0)x^{0}=(p^{0},q^{0})^{\top} exists. How do the local equilibrium price p(t)p(t), quantity q(t)q(t), and consumer price p(t)+tp(t)+t respond to the tax?

Solution. With endogenous vector x=(p,q)x=(p,q)^{\top}, equilibrium is the system F(p,q;t)=(qa+b(p+t)qcsp)=0,D(p,q)F=(b1s1),F(p,q;t)= \begin{pmatrix} q-a+b\,(p+t)\\ q-c-s\,p \end{pmatrix} =0 , \qquad \mathrm{D}_{(p,q)}F= \begin{pmatrix} b & 1\\ -s & 1 \end{pmatrix}, with detD(p,q)F=b+s>0\det\mathrm{D}_{(p,q)}F=b+s>0, so Theorem 1.1 applies at any equilibrium: the equilibrium price and quantity are differentiable functions of the tax. Differentiating with respect to tt as in (1), (b1s1)(ptqt)=(b0)pt=bb+s,qt=bsb+s.\begin{pmatrix} b & 1\\ -s & 1 \end{pmatrix} \begin{pmatrix} p_{t}\\ q_{t} \end{pmatrix} = \begin{pmatrix} -b\\ 0 \end{pmatrix} \qquad\Longrightarrow\qquad p_{t}=-\frac{b}{b+s}, \quad q_{t}=-\frac{bs}{b+s} . The consumer price moves by d(p+t)dt=1+pt=sb+s(0,1).\frac{\mathrm{d}(p+t)}{\mathrm{d}t} =1+p_{t} =\frac{s}{b+s}\in(0,1) . The tax splits between the two sides of the market in proportion to the slopes: the producer price falls by b/(b+s)b/(b+s) of the tax, the consumer price rises by the complementary share s/(b+s)s/(b+s), and quantity falls. Note that we never computed the equilibrium.

2 Comparative statics of optimizers and values

2.1 Optimizing systems

When the equations being differentiated are optimality conditions, the implicit function theorem turns into the comparative statics of choice. Let f:X×Θf:X\times\Theta\to\mathbb{R} be C2C^{2} with XnX\subseteq\mathbb{R}^{n} and Θr\Theta\subseteq\mathbb{R}^{r} open. At a parameter θ0\theta^{0}, suppose x0x^{0} is a critical point satisfying Lecture 6’s first-order condition, xf(x0;θ0)=0.\nabla_{x}f(x^{0};\theta^{0})=0 . This is a system F(x;θ)=xf(x;θ)F(x;\theta)=\nabla_{x}f(x;\theta), and its endogenous Jacobian is the Hessian: DxF(x;θ)=Hf(x;θ).\mathrm{D}_{x}F(x;\theta)=H_{f}(x;\theta) . If the Hessian is invertible at (x0;θ0)(x^{0};\theta^{0}), Theorem 1.1 yields a C1C^{1} branch of critical points with Hf(x(θ);θ)Dθx(θ)=Dθxf(x(θ);θ).H_{f}\left(x(\theta);\theta\right)\,\mathrm{D}_{\theta}x(\theta) =-\mathrm{D}_{\theta}\,\nabla_{x}f\left(x(\theta);\theta\right) .

For constrained problems, we differentiate the Lagrange system. For maxxf(x;θ)\max_{x}f(x;\theta) subject to h(x;θ)=0h(x;\theta)=0, Lecture 7’s Lagrangian L(x,μ;θ)=f(x;θ)+μh(x;θ)L(x,\mu;\theta)=f(x;\theta)+\mu\cdot h(x;\theta) produces the system G(x,μ;θ)=(xL(x,μ;θ)h(x;θ))=0G(x,\mu;\theta)= \begin{pmatrix} \nabla_{x}L(x,\mu;\theta)\\ h(x;\theta) \end{pmatrix} =0 in the stacked endogenous vector (x,μ)(x,\mu). Its endogenous Jacobian is written in blocks, each block a matrix whose dimensions are read off the grouping of equations and variables: D(x,μ)G=(HL(x,μ;θ)Dxh(x;θ)Dxh(x;θ)0),\mathrm{D}_{(x,\mu)}G= \begin{pmatrix} H_{L}(x,\mu;\theta) & \mathrm{D}_{x}h(x;\theta)^{\top}\\[1mm] \mathrm{D}_{x}h(x;\theta) & 0 \end{pmatrix}, where HLH_{L} is the Hessian of LL in xx alone. When this matrix is invertible at a stationary feasible pair, the implicit function theorem gives a differentiable branch (x(θ),μ(θ))(x(\theta),\mu(\theta)) of such pairs. Once the branch is established to consist of optimizers and their multipliers, we write it (x*(θ),μ*(θ))(x^{*}(\theta),\mu^{*}(\theta)).

Inequality constraints use the same technique. On a parameter region where the same constraints bind and every slack constraint stays slack, the binding constraints can be carried as equalities and everything above applies; the derivatives are valid strictly within that region, and Section 2.5 discusses what happens at its boundary.

2.2 Envelope theorems

So far we differentiated a critical point of an optimization problem. The second object of comparative statics is the optimized value V(θ)=f(x*(θ);θ),V(\theta)=f\left(x^{*}(\theta);\theta\right) , whose derivative is even simpler.

Theorem 2.1 (Envelope theorems). Assume the functions appearing below are C1C^{1} in (x,θ)(x,\theta).

  1. If x*(θ)x^{*}(\theta) is a differentiable branch of interior optimizers, so that xf(x*(θ);θ)=0\nabla_{x}f(x^{*}(\theta);\theta)=0, then DθV(θ)=Dθf(x*(θ);θ).\mathrm{D}_{\theta}V(\theta) =\mathrm{D}_{\theta}f\left(x^{*}(\theta);\theta\right) .

  2. If x*(θ)x^{*}(\theta) is a differentiable branch of optimizers and μ*(θ)\mu^{*}(\theta) is its differentiable multiplier branch satisfying Lecture 7’s stationarity and feasibility conditions, xL(x*(θ),μ*(θ);θ)=0\nabla_{x}L(x^{*}(\theta),\mu^{*}(\theta);\theta)=0 and h(x*(θ);θ)=0h(x^{*}(\theta);\theta)=0, then DθV(θ)=DθL(x*(θ),μ*(θ);θ)=Dθf+μ*(θ)Dθh,\mathrm{D}_{\theta}V(\theta) =\mathrm{D}_{\theta}L\left(x^{*}(\theta),\mu^{*}(\theta);\theta\right) =\mathrm{D}_{\theta}f+\mu^{*}(\theta)^{\top}\mathrm{D}_{\theta}h , with every derivative on the right taken in θ\theta alone and evaluated along the branch.

  3. For a problem with equalities h(x;θ)=0h(x;\theta)=0 and inequalities g(x;θ)0g(x;\theta)\geq0, suppose x*(θ)x^{*}(\theta) is a differentiable branch of optimizers, μ*(θ)\mu^{*}(\theta) and λ*(θ)\lambda^{*}(\theta) are its differentiable multiplier branches satisfying the KKT conditions, and the active set is constant near the parameter under consideration. Then DθV(θ)=DθL(x*(θ),μ*(θ),λ*(θ);θ)=Dθf+μ*(θ)Dθh+λ*(θ)Dθg.\mathrm{D}_{\theta}V(\theta) =\mathrm{D}_{\theta}L\left(x^{*}(\theta),\mu^{*}(\theta),\lambda^{*}(\theta);\theta\right) =\mathrm{D}_{\theta}f+\mu^{*}(\theta)^{\top}\mathrm{D}_{\theta}h +\lambda^{*}(\theta)^{\top}\mathrm{D}_{\theta}g .

Proof. For the interior case, the chain rule gives DθV=xfDθx*+Dθf,\mathrm{D}_{\theta}V =\nabla_{x}f^{\top}\,\mathrm{D}_{\theta}x^{*}+\mathrm{D}_{\theta}f , and the first term vanishes by stationarity. For the constrained case, the same chain rule step and stationarity xf=(μ*)Dxh\nabla_{x}f^{\top}=-(\mu^{*})^{\top}\mathrm{D}_{x}h give DθV=Dθf+xfDθx*=Dθf(μ*)DxhDθx*.\mathrm{D}_{\theta}V =\mathrm{D}_{\theta}f+\nabla_{x}f^{\top}\,\mathrm{D}_{\theta}x^{*} =\mathrm{D}_{\theta}f-(\mu^{*})^{\top}\mathrm{D}_{x}h\,\mathrm{D}_{\theta}x^{*} . Differentiating the feasibility identity h(x*(θ);θ)=0h(x^{*}(\theta);\theta)=0 gives DxhDθx*=Dθh\mathrm{D}_{x}h\,\mathrm{D}_{\theta}x^{*}=-\mathrm{D}_{\theta}h, and substituting finishes the proof of part 2.

For part 3, let II be the active set, which is constant by hypothesis. The equations h=0h=0 and gI=0g_I=0 form one equality system, so part 2 applies with multipliers (μ*,λI*)(\mu^{*},\lambda_I^{*}). Every inactive multiplier is zero by complementary slackness. Adding those zero terms gives the displayed formula with the full vectors λ*\lambda^{*} and gg. ◻

Notice that Dθx*\mathrm{D}_{\theta}x^{*} does not appear on any right-hand side. To first order, the response of the choice does not affect the value, because the first-order condition makes the objective flat in the choice direction; only the direct effect of the parameter remains.

Example 2.2 (The envelope formula on the quadratic family). For each parameter θ\theta\in\mathbb{R}, the scalar choice variable xx solves maxx0θx12x2.\max_{x\geq0}\ \theta x-\tfrac12x^{2} . The optimizer and value, respectively, are known to be x*(θ)=max{θ,0}x^{*}(\theta)=\max\{\theta,0\} and V(θ)={12θ2,θ>0,0,θ0.V(\theta)= \begin{cases} \tfrac12\theta^{2}, & \theta>0,\\ 0, & \theta\leq0 . \end{cases} (see Example 3.3 in Lecture 6). What does the envelope theorem give for V(θ)V'(\theta) on the interior and corner regimes, and does it agree with the known value function?

Solution.

On the interior regime θ>0\theta>0, part 1 of Theorem 2.1 predicts V(θ)=θ(θx12x2)|x=x*(θ)=x*(θ)=θ,V'(\theta) =\frac{\partial}{\partial\theta} \left(\theta x-\tfrac12x^{2}\right)\Big|_{x=x^{*}(\theta)} =x^{*}(\theta)=\theta , and differentiating 12θ2\tfrac12\theta^{2} directly confirms it. On the corner regime θ<0\theta<0, write the constraint as g(x)=x0g(x)=x\geq0. The active set is constant, x*=0x^{*}=0, and part 3 gives V(θ)=f/θ=x*(θ)=0V'(\theta)=\partial f/\partial\theta=x^{*}(\theta)=0, again matching the derivative of the constant value.

2.3 Interpretation of Lagrange multipliers

Lecture 7 introduced a Lagrange multiplier as an additional unknown in the first-order conditions. We can now interpret that unknown. Start with the equality-constrained problem maxxf(x)subject tor(x)=b.\max_{x}\ f(x) \qquad\text{subject to}\qquad r(x)=b . Here xx is the vector of choice variables, ff and rr are fixed primitives, and bb is the constraint’s right-hand side. Depending on the application, bb could be a budget, capacity, time limit, or available material. Changing bb shifts the constraint and therefore changes the best attainable value.

Using the course’s sign convention, write the constraint and Lagrangian as h(x;b)=br(x)=0,L(x,μ;b)=f(x)+μh(x;b).h(x;b)=b-r(x)=0, \qquad L(x,\mu;b)=f(x)+\mu h(x;b). Let V(b)=f(x*(b))V(b)=f\left(x^{*}(b)\right) be the optimized value. Suppose the optimizer x*(b)x^{*}(b) and its multiplier μ*(b)\mu^{*}(b) form differentiable local branches. The equality-constrained envelope formula, restated for this problem, is V(b)=Lb(x*(b),μ*(b);b)=μ*(b).V'(b) =\frac{\partial L}{\partial b} \left(x^{*}(b),\mu^{*}(b);b\right) =\mu^{*}(b). The last equality follows immediately from the Lagrangian: bb enters LL with coefficient μ\mu. Thus the multiplier is the shadow price of the constraint’s right-hand side—the marginal increase in the optimized value from increasing bb. For a small change Δb\Delta b, the first-order approximation is ΔVV(b+Δb)V(b)μ*(b)Δb.\Delta V \equiv V(b+\Delta b)-V(b) \approx\mu^{*}(b)\,\Delta b. Its units are units of optimized value per unit of bb.

For an upper-bound inequality r(x)br(x)\leq b, use the course’s KKT convention g(x;b)=br(x)0,L(x,λ;b)=f(x)+λg(x;b),λ0.g(x;b)=b-r(x)\geq0, \qquad L(x,\lambda;b)=f(x)+\lambda g(x;b), \qquad \lambda\geq0 . On a differentiable regime with a fixed active set, a binding constraint has V(b)=Lb=λ*(b).V'(b) =\frac{\partial L}{\partial b} =\lambda^{*}(b). A slack constraint has λ*(b)=0\lambda^{*}(b)=0 by complementary slackness and therefore no marginal value on that regime. More generally, if constraint ii is written as gi(x)+ci0g_i(x)+c_i\geq0, a positive cic_i relaxes it and Vci=λi*.\frac{\partial V}{\partial c_i}=\lambda_i^{*}.

The sign of a multiplier cannot be separated from the way its constraint is written. If the equality constraint is instead r(x)b=0r(x)-b=0 with multiplier μ̃*\widetilde\mu^{*}, then μ̃*=μ*\widetilde\mu^{*}=-\mu^{*} and V(b)=μ̃*(b)V'(b)=-\widetilde\mu^{*}(b). Writing the constraint as br(x)=0b-r(x)=0 makes the multiplier itself equal to the shadow price.

Example 2.3 (Capacity valued by the envelope formula). Fix parameters a>0a>0 and K>0K>0. The scalar choice variable qq solves maxqaq12q2subject toq0,g2(q;K)=Kq0.\max_{q}\ aq-\tfrac12q^{2} \qquad\text{subject to}\qquad q\geq0, \quad g_{2}(q;K)=K-q\geq0 . The optimizer and capacity multiplier are known to be q*(a,K)=min{a,K}q^{*}(a,K)=\min\{a,K\} and λ2*(a,K)=max{aK,0}\lambda_{2}^{*}(a,K)=\max\{a-K,0\} (see Example 3.3 in Lecture 7). What do the envelope formulas give for the effects of capacity KK and productivity aa on the value, and do those effects agree with the known closed-form solution?

Solution.

The value function is available in closed form: V(a,K)={12a2,aK,aK12K2,a>K,soVK={0,a<K,aK,a>K,V(a,K)= \begin{cases} \tfrac12 a^{2}, & a\leq K,\\[1mm] aK-\tfrac12 K^{2}, & a>K, \end{cases} \qquad\text{so}\qquad \frac{\partial V}{\partial K}= \begin{cases} 0, & a<K,\\ a-K, & a>K, \end{cases} which is λ2*(a,K)\lambda_{2}^{*}(a,K), as part 3 of Theorem 2.1 predicts with DKf=0\mathrm{D}_{K}f=0 and DKg2=1\mathrm{D}_{K}g_{2}=1: the marginal value of capacity is zero while the capacity constraint is slack and positive once it binds. Differentiating in aa instead gives V/a=min{a,K}=q*(a,K)\partial V/\partial a=\min\{a,K\}=q^{*}(a,K) on both regimes, which is the direct effect Daf=q\mathrm{D}_{a}f=q evaluated at the optimum. On each regime the active set is constant and the branch q*(a,K)q^{*}(a,K) is differentiable, so the formulas apply regime by regime; the switch points belong to Section 2.5.

2.4 Behavior from optimized values

One classical corollary applies the envelope theorem to the theory of the firm.

Example 2.4 (Hotelling’s lemma). A firm chooses an input vector xnx\in\mathbb{R}^{n} and produces output y(x)y(x). The parameters are the output price pp and input-price vector wnw\in\mathbb{R}^{n}, and profit is π(x;p,w)=py(x)wx.\pi(x;p,w)=p\,y(x)-w\cdot x . Suppose x*(p,w)x^{*}(p,w) is a differentiable branch of interior profit maximizers, with maximized profit Π(p,w)\Pi(p,w). What are the derivatives of Π\Pi with respect to pp and each wiw_{i}?

Solution.

Part 1 of Theorem 2.1 gives Πp=y(x*(p,w)),Πwi=xi*(p,w):\frac{\partial\Pi}{\partial p}=y\left(x^{*}(p,w)\right), \qquad \frac{\partial\Pi}{\partial w_{i}}=-x_{i}^{*}(p,w) : the derivative of maximized profit with respect to the output price is the optimal output, and with respect to an input price it is the negative of the optimal input use. Differentiating the value function recovers the firm’s behavior without re-solving its problem. The same calculation with a budget constraint produces Roy’s identity in consumer theory, and with a cost-minimization problem produces Shephard’s lemma; both appear early in the first-year sequence, and both are Theorem 2.1 applied to a particular value function.

2.5 Limits of the formulas

Every formula in this section is local and conditional: it needs a differentiable branch through a regular solution, and for inequality problems it needs the active set to stay constant. The following example shows how the formulas fail where the active set changes.

Example 2.5 (No single marginal value at an active-set change). The scalar choice variable is xx, and the scalar parameter is b>0b>0. Consider maxxxsubject tox0,bx0,1x0.\max_{x}\ x \qquad\text{subject to}\qquad x\geq0, \quad b-x\geq0, \quad 1-x\geq0 . What are the optimizer and value, and how does the value derivative compare with the multiplier on the constraint bx0b-x\geq0 for b<1b<1, b>1b>1, and at the switch point b=1b=1?

Solution.

The feasible set is [0,min{b,1}][0,\min\{b,1\}], and the objective is increasing in xx, so the optimizer and value are x*(b)=V(b)=min{b,1}x^{*}(b)=V(b)=\min\{b,1\}. For b<1b<1 the constraint bx0b-x\geq0 binds alone and carries multiplier 11; for b>1b>1 it is slack and carries multiplier 00. At b=1b=1 both upper constraints are active, stationarity only requires the two multipliers to sum to one, λb*[0,1],λcap*=1λb*,\lambda_{b}^{*}\in[0,1], \qquad \lambda_{\text{cap}}^{*}=1-\lambda_{b}^{*} , and the value function has left derivative 11 and right derivative 00. At the switch point the value function is not differentiable, so there is no single marginal value, and correspondingly the multiplier is not unique.

On either side of the switch, the formulas hold regime by regime. Example 2.2 shows the benign case: the active set changes at θ=0\theta=0, yet the two regime values 12θ2\tfrac12\theta^{2} and 00 join with matching derivative, so the value is differentiable even at θ=0\theta=0. After an active-set change, the value may or may not remain differentiable, and this must be checked.

3 Fixed-point theorems

A fixed-point argument looks for a point that a map sends to itself. This section introduces several theorems that give conditions under which such points exist.

3.1 Fixed points and Brouwer’s theorem

Definition 3.1 (Fixed point). Let XX be a set and f:XXf:X\to X. A point x*Xx^{*}\in X is a fixed point of ff if f(x*)=x*f(x^{*})=x^{*}.

For a function of one variable, a fixed point is a crossing of the graph of ff with the 4545-degree line. Lecture 2 closed with our first fixed point theorem, Brouwer in \mathbb{R}: every continuous f:[a,b][a,b]f:[a,b]\to[a,b] has a fixed point. The proof applied the intermediate value theorem to g(x)=f(x)xg(x)=f(x)-x, which is nonnegative at aa and nonpositive at bb. Figure 3.1 shows the picture: a continuous graph that starts on or above the diagonal and ends on or below it must cross it.

Figure 3.1. A continuous function from [a,b] to itself. At x^{*} the graph of f meets the line y=x, so f(x^{*})=x^{*}.

In n\mathbb{R}^{n} the interval is replaced by a compact convex set.

Theorem 3.2 (Brouwer). Let DnD\subseteq\mathbb{R}^{n} be nonempty, compact, and convex, and let f:DDf:D\to D be continuous. Then ff has a fixed point.

3.2 Set-valued maps and Kakutani’s theorem

Definition 3.3 (Set-valued map). A set-valued map (correspondence) Γ:XY\Gamma:X\rightrightarrows Y assigns to every xXx\in X a nonempty set Γ(x)Y\Gamma(x)\subseteq Y. A fixed point of Γ:XX\Gamma:X\rightrightarrows X is a point x*x^{*} with x*Γ(x*)x^{*}\in\Gamma(x^{*}).

For correspondences, the continuity hypothesis of Brouwer’s theorem is replaced by a condition on the set of pairs {(x,y):xX,yΓ(x)}\{(x,y):x\in X,\ y\in\Gamma(x)\}, the graph of Γ\Gamma: the graph must be a closed set, in the sequential sense of Lecture 2. In words, if xkxx_{k}\to x, ykyy_{k}\to y, and ykΓ(xk)y_{k}\in\Gamma(x_{k}) for every kk, then yΓ(x)y\in\Gamma(x).

Theorem 3.4 (Kakutani). Let DnD\subseteq\mathbb{R}^{n} be nonempty, compact, and convex, and let Γ:DD\Gamma:D\rightrightarrows D have convex values and a closed graph. Then Γ\Gamma has a fixed point.

Example 3.5 (Ties close the gap). The variable is xD=[0,1]x\in D=[0,1]; there are no parameters. Let f:DDf:D\to D be the jump map f(x)=1f(x)=1 for x<12x<\tfrac12 and f(x)=0f(x)=0 for x12x\geq\tfrac12, which has no fixed point. Replace its value at the jump by the whole interval, defining Γ:DD\Gamma:D\rightrightarrows D by Γ(x)={{1}x<12,[0,1]x=12,{0}x>12.\Gamma(x)= \begin{cases} \{1\} & x<\tfrac12,\\ [0,1] & x=\tfrac12,\\ \{0\} & x>\tfrac12. \end{cases} Does Kakutani’s theorem apply, and what is the fixed point? Why would replacing Γ(12)=[0,1]\Gamma(\tfrac12)=[0,1] by the two-point set {0,1}\{0,1\} destroy the conclusion?

Solution.

The jump map ff has singleton values but not a closed graph: the pairs (121k,1)(\tfrac12-\tfrac1k,1) lie in the graph and converge to (12,1)(\tfrac12,1), yet f(12)=0f(\tfrac12)=0. Under Γ\Gamma, the graph gains the vertical segment {12}×[0,1]\{\tfrac12\}\times[0,1] and becomes closed, every value is convex, and Theorem 3.4 applies. The fixed point is visible in Figure 3.2: the segment meets the diagonal at x*=12x^{*}=\tfrac12, and indeed 12Γ(12)\tfrac12\in\Gamma(\tfrac12). If the value at the jump were the two-point set {0,1}\{0,1\} instead, the graph would still be closed, but the value would not be convex and no fixed point would exist. In a game, the interval is the set of mixtures available to a player who is indifferent; allowing the tie restores equilibrium existence.

Figure 3.2. Left: the graph of the jump map passes over the diagonal without touching it. Right: the set-valued map whose value at x=\tfrac12 is [0,1]; the added segment meets the diagonal at x^{*}.

3.3 The contraction mapping theorem

Brouwer and Kakutani establish existence only: they do not say whether the fixed point is unique, and they do not provide a way to compute it. The third theorem strengthens the hypothesis on the map and gives both uniqueness and an algorithm.

Definition 3.6 (Contraction). Let SnS\subseteq\mathbb{R}^{n}. A map f:SSf:S\to S is a contraction with modulus β\beta if 0β<10\leq\beta<1 and f(x)f(y)βxyfor all x,yS.\lVert f(x)-f(y) \rVert\leq\beta\,\lVert x-y \rVert \qquad\text{for all }x,y\in S.

A contraction shrinks the distance between any two points to at most β\beta times its original value. Every contraction is continuous: if xkxx_{k}\to x, then f(xk)f(x)βxkx0\lVert f(x_{k})-f(x) \rVert\leq\beta\lVert x_{k}-x \rVert\to0.

Theorem 3.7 (Contraction mapping theorem). Let SnS\subseteq\mathbb{R}^{n} be nonempty and closed, and let f:SSf:S\to S be a contraction with modulus β\beta. Then ff has exactly one fixed point x*Sx^{*}\in S. Moreover, from any starting point x0Sx_{0}\in S, the iterates xk+1=f(xk)x_{k+1}=f(x_{k}) converge to x*x^{*}, and xkx*βkx0x*.\lVert x_{k}-x^{*} \rVert\leq\beta^{k}\,\lVert x_{0}-x^{*} \rVert .

Remark 3.8 (Why the fixed point is unique). Uniqueness follows in two lines, and the argument uses β<1\beta<1 directly. If x*x^{*} and y*y^{*} are both fixed points, then x*y*=f(x*)f(y*)βx*y*,\lVert x^{*}-y^{*} \rVert =\lVert f(x^{*})-f(y^{*}) \rVert \leq\beta\,\lVert x^{*}-y^{*} \rVert , so (1β)x*y*0(1-\beta)\lVert x^{*}-y^{*} \rVert\leq0. Since β<1\beta<1, this forces x*y*=0\lVert x^{*}-y^{*} \rVert=0, that is, x*=y*x^{*}=y^{*}. The error bound is the same inequality applied kk times: xkx*=f(xk1)f(x*)βxk1x*\lVert x_{k}-x^{*} \rVert=\lVert f(x_{k-1})-f(x^{*}) \rVert \leq\beta\lVert x_{k-1}-x^{*} \rVert.

Note that in Theorem 3.7 the set SS need not be bounded or convex; the strong hypothesis on ff replaces both.

Example 3.9 (A discounted sum as a fixed point). Fix parameters aa\in\mathbb{R} and β(0,1)\beta\in(0,1). The fixed-point variable is xS=x\in S=\mathbb{R}, and the map is T:SST:S\to S defined by T(x)=a+βxT(x)=a+\beta x. Starting from x0=0x_{0}=0, does TT have a unique fixed point, what are the iterates xk+1=T(xk)x_{k+1}=T(x_{k}), and what economic object does their limit represent?

Solution.

We have |T(x)T(y)|=β|xy|\lvert T(x)-T(y) \rvert=\beta\lvert x-y \rvert, so TT is a contraction with modulus β\beta, and its fixed point solves x=a+βxx=a+\beta x: x*=a1β.x^{*}=\frac{a}{1-\beta} . Starting the iteration at x0=0x_{0}=0, xk=a(1+β++βk1)=a1βk1βa1β,x_{k}=a\left(1+\beta+\cdots+\beta^{k-1}\right) =a\,\frac{1-\beta^{k}}{1-\beta} \longrightarrow\frac{a}{1-\beta}, since βk0\beta^{k}\to0 for 0<β<10<\beta<1. The fixed point of “today’s reward plus β\beta times the continuation” is the value of receiving aa in every period, discounted by β\beta. In Lecture 9, the central operator has this form, with a function in place of the number xx.

Table 3.1. The fixed-point theorems used in the first-year sequence. The first two assert existence only; the third requires the contraction property and also gives uniqueness and convergence of iteration.
Theorem The set The map Conclusion
Brouwer (Theorem 3.2) nonempty, compact, convex continuous f:XXf:X\to X a fixed point exists
Kakutani (Theorem 3.4) nonempty, compact, convex convex values, closed graph a fixed point exists

Contraction (Theorem 3.7)

nonempty, closed contraction with modulus β<1\beta<1 exactly one fixed point