17. Recursive Models of Dynamic Linear Economies#

“Mathematics is the art of giving the same name to different things” – Henri Poincare

“Complete market economies are all alike” –   Robert E. Lucas, Jr., (1989)

“Every partial equilibrium model can be reinterpreted as a general equilibrium model.” –   Anonymous

17.1. A Suite of Models#

This lecture presents a class of linear-quadratic-Gaussian models of general economic equilibrium designed by Lars Peter Hansen and Thomas J. Sargent [Hansen and Sargent, 2013].

The class of models is implemented in a Python class DLE that is part of quantecon.

Subsequent lectures use the DLE class to implement various instances that have appeared in the economics literature

  1. Growth in Dynamic Linear Economies

  2. Lucas Asset Pricing using DLE

  3. IRFs in Hall Model

  4. Permanent Income Using the DLE class

  5. Rosen schooling model

  6. Cattle cycles

  7. Shock Non Invertibility

17.1.1. Overview of the Models#

In saying that “complete markets are all alike”, Robert E. Lucas, Jr. was noting that all of them have

  • a commodity space.

  • a space dual to the commodity space in which prices reside.

  • endowments of resources.

  • peoples’ preferences over goods.

  • physical technologies for transforming resources into goods.

  • random processes that govern shocks to technologies and preferences and associated information flows.

  • a single budget constraint per person.

  • the existence of a representative consumer even when there are many people in the model.

  • a concept of competitive equilibrium.

  • theorems connecting competitive equilibrium allocations to allocations that would be chosen by a benevolent social planner.

The models have no frictions such as

  • Enforcement difficulties

  • Information asymmetries

  • Other forms of transactions costs

  • Externalities

The models extensively use the powerful ideas of

  • Indexing commodities and their prices by time (John R. Hicks).

  • Indexing commodities and their prices by chance (Kenneth Arrow).

Much of the imperialism of complete markets models comes from applying these two tricks.

The Hicks trick of indexing commodities by time is the idea that dynamics are a special case of statics.

The Arrow trick of indexing commodities by chance is the idea that analysis of trade under uncertainty is a special case of the analysis of trade under certainty.

The [Hansen and Sargent, 2013] class of models specify the commodity space, preferences, technologies, stochastic shocks and information flows in ways that allow the models to be analyzed completely using only the tools of linear time series models and linear-quadratic optimal control described in the two lectures Linear State Space Models and Linear Quadratic Control.

There are costs and benefits associated with the simplifications and specializations needed to make a particular model fit within the [Hansen and Sargent, 2013] class

  • the costs are that linear-quadratic structures are sometimes too confining.

  • benefits include computational speed, simplicity, and ability to analyze many model features analytically or nearly analytically.

A variety of superficially different models are all instances of the [Hansen and Sargent, 2013] class of models

  • Lucas asset pricing model

  • Lucas-Prescott model of investment under uncertainty

  • Asset pricing models with habit persistence

  • Rosen-Topel equilibrium model of housing

  • Rosen schooling models

  • Rosen-Murphy-Scheinkman model of cattle cycles

  • Hansen-Sargent-Tallarini model of robustness and asset pricing

  • Many more

The diversity of these models conceals an essential unity that illustrates the quotation by Robert E. Lucas, Jr., with which we began this lecture.

17.1.2. Forecasting?#

A consequence of a single budget constraint per person plus the Hicks-Arrow tricks is that households and firms need not forecast.

But there exist equivalent structures called recursive competitive equilibria in which they do appear to need to forecast.

In these structures, to forecast, households and firms use:

  • equilibrium pricing functions, and

  • knowledge of the Markov structure of the economy’s state vector.

17.1.3. Theory and Econometrics#

For an application of the [Hansen and Sargent, 2013] class of models, the outcome of theorizing is a stochastic process, i.e., a probability distribution over sequences of prices and quantities, indexed by parameters describing preferences, technologies, and information flows.

Another name for that object is a likelihood function, a key object of both frequentist and Bayesian statistics.

There are two important uses of an equilibrium stochastic process or likelihood function.

The first is to solve the direct problem.

The direct problem takes as inputs values of the parameters that define preferences, technologies, and information flows and as an output characterizes or simulates random paths of quantities and prices.

The second use of an equilibrium stochastic process or likelihood function is to solve the inverse problem.

The inverse problem takes as an input a time series sample of observations on a subset of prices and quantities determined by the model and from them makes inferences about the parameters that define the model’s preferences, technologies, and information flows.

17.1.4. More Details#

A [Hansen and Sargent, 2013] economy consists of lists of matrices that describe peoples’ household technologies, their preferences over consumption services, their production technologies, and their information sets.

There are complete markets in history-contingent commodities.

Competitive equilibrium allocations and prices

  • satisfy equations that are easy to write down and solve

  • have representations that are convenient econometrically

Different example economies manifest themselves simply as different settings for various matrices.

[Hansen and Sargent, 2013] use these tools:

  • A theory of recursive dynamic competitive economies

  • Linear optimal control theory

  • Recursive methods for estimating and interpreting vector autoregressions

The models are flexible enough to express alternative senses of a representative household

  • A single ‘stand-in’ household of the type used to good effect by Edward C. Prescott.

  • Heterogeneous households satisfying conditions for Gorman aggregation into a representative household.

  • Heterogeneous household technologies that violate conditions for Gorman aggregation but are still susceptible to aggregation into a single representative household via ‘non-Gorman’ or ‘mongrel’ aggregation’.

These three alternative types of aggregation have different consequences in terms of how prices and allocations can be computed.

In particular, can prices and an aggregate allocation be computed before the equilibrium allocation to individual heterogeneous households is computed?

  • Answers are “Yes” for Gorman aggregation, “No” for non-Gorman aggregation.

In summary, the insights and practical benefits from economics to be introduced in this lecture are

  • Deeper understandings that come from recognizing common underlying structures.

  • Speed and ease of computation that comes from unleashing a common suite of Python programs.

We’ll use the following mathematical tools

  • Stochastic Difference Equations (Linear).

  • Duality: LQ Dynamic Programming and Linear Filtering are the same things mathematically.

  • The Spectral Factorization Identity (for understanding vector autoregressions and non-Gorman aggregation).

So here is our roadmap.

We’ll describe sets of matrices that pin down

  • Information

  • Technologies

  • Preferences

Then we’ll describe

  • Equilibrium concept and computation

  • Econometric representation and estimation

17.1.5. Stochastic Model of Information Flows and Outcomes#

We’ll use stochastic linear difference equations to describe information flows and equilibrium outcomes.

The sequence {wt:t=1,2,} is said to be a martingale difference sequence adapted to {Jt:t=0,1,} if E(wt+1|Jt)=0 for t=0,1,.

The sequence {wt:t=1,2,} is said to be conditionally homoskedastic if E(wt+1wt+1Jt)=I for t=0,1,.

We assume that the {wt:t=1,2,} process is conditionally homoskedastic.

Let {xt:t=1,2,} be a sequence of n-dimensional random vectors, i.e. an n-dimensional stochastic process.

The process {xt:t=1,2,} is constructed recursively using an initial random vector x0N(x^0,Σ0) and a time-invariant law of motion:

xt+1=Axt+Cwt+1

for t=0,1, where A is an n by n matrix and C is an n by N matrix.

Evidently, the distribution of xt+1 conditional on xt is N(Axt,CC).

17.1.6. Information Sets#

Let J0 be generated by x0 and Jt be generated by x0,w1,,wt, which means that Jt consists of the set of all measurable functions of {x0,w1,,wt}.

17.1.7. Prediction Theory#

The optimal forecast of xt+1 given current information is

E(xt+1Jt)=Axt

and the one-step-ahead forecast error is

xt+1E(xt+1Jt)=Cwt+1

The covariance matrix of xt+1 conditioned on Jt is

E(xt+1E(xt+1Jt))(xt+1E(xt+1Jt))=CC

A nonrecursive expression for xt as a function of x0,w1,w2,,wt is

xt=Axt1+Cwt=A2xt2+ACwt1+Cwt=[τ=0t1AτCwtτ]+Atx0

Shift forward in time:

xt+j=s=0j1AsCwt+js+Ajxt

Projecting on the information set {x0,wt,wt1,,w1} gives

Etxt+j=Ajxt

where Et()E[()x0,wt,wt1,,w1]=E()Jt, and xt is in Jt.

It is useful to obtain the covariance matrix of the j-step-ahead prediction error xt+jEtxt+j=s=0j1AsCwts+j.

Evidently,

Et(xt+jEtxt+j)(xt+jEtxt+j)=k=0j1AkCCAkvj

vj can be calculated recursively via

v1=CCvj=CC+Avj1A,j2

17.1.8. Orthogonal Decomposition#

To decompose these covariances into parts attributable to the individual components of wt, we let iτ be an N-dimensional column vector of zeroes except in position τ, where there is a one. Define a matrix υj,τ

υj,τ=k=0j1AkCiτiτCAk.

Note that τ=1Niτiτ=I, so that we have

τ=1Nυj,τ=υj

Evidently, the matrices {υj,τ,τ=1,,N} give an orthogonal decomposition of the covariance matrix of j-step-ahead prediction errors into the parts attributable to each of the components τ=1,,N.

17.1.9. Taste and Technology Shocks#

E(wtJt1)=0 and E(wtwtJt1)=I for t=1,2,

bt=Ubzt and dt=Udzt,

Ub and Ud are matrices that select entries of zt. The law of motion for {zt:t=0,1,} is

zt+1=A22zt+C2wt+1  for t=0,1,

where z0 is a given initial condition. The eigenvalues of the matrix A22 have absolute values that are less than or equal to one.

Thus, in summary, our model of information and shocks is

zt+1=A22zt+C2wt+1bt=Ubztdt=Udzt.

We can now briefly summarize other components of our economies, in particular

  • Production technologies

  • Household technologies

  • Household preferences

17.1.10. Production Technology#

Where ct is a vector of consumption rates, kt is a vector of physical capital goods, gt is a vector intermediate productions goods, dt is a vector of technology shocks, the production technology is

Φcct+Φggt+Φiit=Γkt1+dtkt=Δkkt1+Θkitgtgt=t2

Here Φc,Φg,Φi,Γ,Δk,Θk are all matrices conformable to the vectors they multiply and t is a disutility generating resource supplied by the household.

For technical reasons that facilitate computations, we make the following.

Assumption: [Φc Φg] is nonsingular.

17.1.11. Household Technology#

Households confront a technology that allows them to devote consumption goods to construct a vector ht of household capital goods and a vector st of utility generating house services

st=Λht1+Πctht=Δhht1+Θhct

where Λ,Π,Δh,Θh are matrices that pin down the household technology.

We make the following

Assumption: The absolute values of the eigenvalues of Δh are less than or equal to one.

Below, we’ll outline further assumptions that we shall occasionally impose.

17.1.12. Preferences#

Where bt is a stochastic process of preference shocks that will play the role of demand shifters, the representative household orders stochastic processes of consumption services st according to

(12)Et=0βt[(stbt)(stbt)+t2]|J0, 0<β<1

We now proceed to give examples of production and household technologies that appear in various models that appear in the literature.

First, we give examples of production Technologies

Φcct+Φggt+Φiit=Γkt1+dt
gt∣≤t

so we’ll be looking for specifications of the matrices Φc,Φg,Φi,Γ,Δk,Θk that define them.

17.1.13. Endowment Economy#

There is a single consumption good that cannot be stored over time.

In time period t, there is an endowment dt of this single good.

There is neither a capital stock, nor an intermediate good, nor a rate of investment.

So ct=dt.

To implement this specification, we can choose A22,C2, and Ud to make dt follow any of a variety of stochastic processes.

To satisfy our earlier rank assumption, we set:

ct+it=d1t
gt=ϕ1it

where ϕ1 is a small positive number.

To implement this version, we set Δk=Θk=0 and

Φc=[10],Φi=[1ϕ1],  Φg=[01],  Γ=[00],  dt=[d1t0]

We can use this specification to create a linear-quadratic version of Lucas’s (1978) asset pricing model.

17.1.14. Single-Period Adjustment Costs#

There is a single consumption good, a single intermediate good, and a single investment good.

The technology is described by

ct=γkt1+d1t,  γ>0ϕ1it=gt+d2t,  ϕ1>0t2=gt2kt=δkkt1+it, 0<δk<1

Set

Φc=[10], Φg=[01], Φi=[0ϕ1]
Γ=[γ0], Δk=δk, Θk=1

We set A22,C2 and Ud to make (d1t,d2t)=dt follow a desired stochastic process.

Now we describe some examples of preferences, which as we have seen are ordered by

(12)Et=0βt[(stbt)(stbt)+(t)2]J0, 0<β<1

where household services are produced via the household technology

ht=Δhht1+Θhct
st=Λht1+Πct

and we make

Assumption: The absolute values of the eigenvalues of Δh are less than or equal to one.

Later we shall introduce canonical household technologies that satisfy an ‘invertibility’ requirement relating sequences {st} of services and {ct} of consumption flows.

And we’ll describe how to obtain a canonical representation of a household technology from one that is not canonical.

Here are some examples of household preferences.

Time Separable preferences

12Et=0βt[(ctbt)2+t2]J0, 0<β<1

Consumer Durables

ht=δhht1+ct, 0<δh<1

Services at t are related to the stock of durables at the beginning of the period:

st=λht1 , λ>0

Preferences are ordered by

12Et=0βt[(λht1bt)2+t2]J0

Set Δh=δh,Θh=1,Λ=λ,Π=0.

Habit Persistence

(12)Et=0βt[(ctλ(1δh)j=0δhjctj1bt)2+t2]|J0
0<β<1 , 0<δh<1 , λ>0

Here the effective bliss point bt+λ(1δh)j=0δhjctj1 shifts in response to a moving average of past consumption.

Initial Conditions

Preferences of this form require an initial condition for the geometric sum j=0δhjctj1 that we specify as an initial condition for the ‘stock of household durables,’ h1.

Set

ht=δhht1+(1δh)ct, 0<δh<1
ht=(1δh)j=0tδhjctj+δht+1h1
st=λht1+ct, λ>0

To implement, set Λ=λ, Π=1, Δh=δh, Θh=1δh.

Seasonal Habit Persistence

(12)Et=0βt[(ctλ(1δh)j=0δhjct4j4bt)2+t2]
0<β<1 , 0<δh<1 , λ>0

Here the effective bliss point bt+λ(1δh)j=0δhjct4j4 shifts in response to a moving average of past consumptions of the same quarter.

To implement, set

h~t=δhh~t4+(1δh)ct, 0<δh<1

This implies that

ht=[h~th~t1h~t2h~t3]=[000δh100001000010][h~t1h~t2h~t3h~t4]+[(1δh)000]ct

with consumption services

st=[000λ]ht1+ct, λ>0

Adjustment Costs.

Recall

(12)Et=0βt[(ctb1t)2+λ2(ctct1)2+t2]J0
0<β<1, λ>0

To capture adjustment costs, set

ht=ct
st=[0λ]ht1+[1λ]ct

so that

s1t=ct
s2t=λ(ctct1)

We set the first component b1t of bt to capture the stochastic bliss process and set the second component identically equal to zero.

Thus, we set Δh=0,Θh=1

Λ=[0λ] , Π=[1λ]

Multiple Consumption Goods

Λ=[00]  and  Π=[π10π2π3]
12βt(Πctbt)(Πctbt)
μt=βt[ΠΠctΠbt]
ct=(ΠΠ)1βtμt+(ΠΠ)1Πbt

This is called the Frisch demand function for consumption.

We can think of the vector μt as playing the role of prices, up to a common factor, for all dates and states.

The scale factor is determined by the choice of numeraire.

Notions of substitutes and complements can be defined in terms of these Frisch demand functions.

Two goods can be said to be substitutes if the cross-price effect is positive and to be complements if this effect is negative.

Hence this classification is determined by the off-diagonal element of (ΠΠ)1, which is equal to π2π3/det(ΠΠ).

If π2 and π3 have the same sign, the goods are substitutes.

If they have opposite signs, the goods are complements.

To summarize, our economic structure consists of the matrices that define the following components:

Information and shocks

zt+1=A22zt+C2wt+1bt=Ubztdt=Udzt

Production Technology

Φcct+Φggt+Φiit=Γkt1+dtkt=Δkkt1+Θkitgtgt=t2

Household Technology

st=Λht1+Πctht=Δhht1+Θhct

Preferences

(12)Et=0βt[(stbt)(stbt)+t2]|J0, 0<β<1

Next steps: we move on to discuss two closely connected concepts

  • A Planning Problem or Optimal Resource Allocation Problem

  • Competitive Equilibrium

17.1.15. Optimal Resource Allocation#

Imagine a planner who chooses sequences {ct,it,gt}t=0 to maximize

(1/2)Et=0βt[(stbt)(stbt)+gtgt]|J0

subject to the constraints

Φcct+Φggt+Φiit=Γkt1+dt,kt=Δkkt1+Θkit,ht=Δhht1+Θhct,st=Λht1+Πct,zt+1=A22zt+C2wt+1, bt=Ubzt,  and  dt=Udzt

and initial conditions for h1,k1, and z0.

Throughout, we shall impose the following square summability conditions

Et=0βththtJ0<  and  Et=0βtktktJ0<

Define:

L02=[{yt}:yt is a randomvariable in  Jt  and  Et=0βtyt2J0<+]

Thus, we require that each component of ht and each component of kt belong to L02.

We shall compare and utilize two approaches to solving the planning problem

  • Lagrangian formulation

  • Dynamic programming

17.1.16. Lagrangian Formulation#

Form the Lagrangian

L=Et=0βt[(12)[(stbt)(stbt)+gtgt]+Mtd(Φcct+Φggt+ΦiitΓkt1dt)+Mtk(ktΔkkt1Θkit)+Mth(htΔhht1Θhct)+Mts(stΛht1Πct)]|J0

The planner maximizes L with respect to the quantities {ct,it,gt}t=0 and minimizes with respect to the Lagrange multipliers Mtd,Mtk,Mth,Mts.

First-order necessary conditions for maximization with respect to ct,gt,ht,it,kt, and st, respectively, are:

ΦcMtd+ΘhMth+ΠMts=0,gtΦgMtd=0,Mth+βE(ΔhMt+1h+ΛMt+1s)Jt=0,ΦiMtd+ΘkMtk=0,Mtk+βE(ΔkMt+1k+ΓMt+1d)Jt=0,st+btMts=0

for t=0,1,.

In addition, we have the complementary slackness conditions (these recover the original transition equations) and also transversality conditions

limtβtE[Mtkkt]J0=0limtβtE[Mthht]J0=0

The system formed by the FONCs and the transition equations can be handed over to Python.

Python will solve the planning problem for fixed parameter values.

Here are the Python Ready Equations

ΦcMtd+ΘhMth+ΠMts=0,gtΦgMtd=0,Mth+βE(ΔhMt+1h+ΛMt+1s)Jt=0,ΦiMtd+ΘkMtk=0,Mtk+βE(ΔkMt+1k+ΓMt+1d)Jt=0,st+btMts=0Φcct+Φggt+Φiit=Γkt1+dt,kt=Δkkt1+Θkit,ht=Δhht1+Θhct,st=Λht1+Πct,zt+1=A22zt+C2wt+1, bt=Ubzt,  and  dt=Udzt

The Lagrange multipliers or shadow prices satisfy

Mts=btst
Mth=E[τ=1βτ(Δh)τ1ΛMt+τsJt]
Mtd=[ΦcΦg]1 [ΘhMth+ΠMtsgt]
Mtk=E[τ=1βτ(Δk)τ1ΓMt+τdJt]
Mti=ΘkMtk

Although it is possible to use matrix operator methods to solve the above Python ready equations, that is not the approach we’ll use.

Instead, we’ll use dynamic programming to get recursive representations for both quantities and shadow prices.

17.1.17. Dynamic Programming#

Dynamic Programming always starts with the word let.

Thus, let V(x0) be the optimal value function for the planning problem as a function of the initial state vector x0.

(Thus, in essence, dynamic programming amounts to an application of a guess and verify method in which we begin with a guess about the answer to the problem we want to solve. That’s why we start with let V(x0) be the (value of the) answer to the problem, then establish and verify a bunch of conditions V(x0) has to satisfy if indeed it is the answer)

The optimal value function V(x) satisfies the Bellman equation

V(x0)=maxc0,i0,g0[.5[(s0b0)(s0b0)+g0g0]+βEV(x1)]

subject to the linear constraints

Φcc0+Φgg0+Φii0=Γk1+d0,k0=Δkk1+Θki0,h0=Δhh1+Θhc0,s0=Λh1+Πc0,z1=A22z0+C2w1, b0=Ubz0  and  d0=Udz0

Because this is a linear-quadratic dynamic programming problem, it turns out that the value function has the form

V(x)=xPx+ρ

Thus, we want to solve an instance of the following linear-quadratic dynamic programming problem:

Choose a contingency plan for {xt+1,ut}t=0 to maximize

Et=0βt[xtRxt+utQut+2utWxt], 0<β<1

subject to

xt+1=Axt+But+Cwt+1, t0

where x0 is given; xt is an n×1 vector of state variables, and ut is a k×1 vector of control variables.

We assume wt+1 is a martingale difference sequence with Ewtwt=I, and that C is a matrix conformable to x and w.

The optimal value function V(x) satisfies the Bellman equation

V(xt)=maxut{(xtRxt+utQut+2utWxt)+βEtV(xt+1)}

where maximization is subject to

xt+1=Axt+But+Cwt+1, t0
V(xt)=xtPxtρ

P satisfies

P=R+βAPA(βAPB+W)(Q+βBPB)1(βBPA+W)

This equation in P is called the algebraic matrix Riccati equation.

The optimal decision rule is ut=Fxt, where

F=(Q+βBPB)1(βBPA+W)

The optimum decision rule for ut is independent of the parameters C, and so of the noise statistics.

Iterating on the Bellman operator leads to

Vj+1(xt)=maxut{(xtRxt+utQut+2utWxt)+βEtVj(xt+1)}
Vj(xt)=xtPjxtρj

where Pj and ρj satisfy the equations

Pj+1=R+βAPjA(βAPjB+W)(Q+βBPjB)1(βBPjA+W)ρj+1=βρj+β trace PjCC

We can now state the planning problem as a dynamic programming problem

max{ut,xt+1} Et=0βt[xtRxt+utQut+2utWxt],0<β<1

where maximization is subject to

xt+1=Axt+But+Cwt+1, t0
xt=[ht1kt1zt],ut=it

where

A=[ΔhΘhUc[Φc  Φg]1ΓΘhUc[Φc  Φg]1Ud0Δk000A22]B=[ΘhUc[Φc  Φg]1ΦiΘk0] , C=[00C2]
[xtut]S[xtut]=[xtut]  [RWWQ]  [xtut]
S=(GG+HH)/2
H=[Λ  ΠUc[Φc  Φg]1Γ  ΠUc[Φc  Φg]1UdUb  ΠUc[Φc  Φg]1Φi]
G=Ug[Φc  Φg]1[0  Γ  Ud  Φi].

Lagrange multipliers as gradient of value function

A useful fact is that Lagrange multipliers equal gradients of the planner’s value function

Mtk=Mkxt  and  Mth=Mhxt  where Mk=2β[0 I 0]PAoMh=2β[I 0 0]PAo
Mts=Msxt  where  Ms=(SbSs)  and  Sb=[0 0 Ub]
Mtd=Mdxt  where  Md=[ΦcΦg]1[ΘhMh+ΠMsSg]
Mtc=Mcxt  where  Mc=ΘhMh+ΠMs
Mti=Mixt  where  Mi=ΘkMk

We will use this fact and these equations to compute competitive equilibrium prices.

17.1.18. Other mathematical infrastructure#

Let’s start with describing the commodity space and pricing functional for our competitive equilibrium.

For the commodity space, we use

L02=[{yt}:yt is a randomvariable in  Jt  and  Et=0βtyt2J0<+]

For pricing functionals, we express values as inner products

π(c)=Et=0βtpt0ctJ0

where pt0 belongs to L02.

With these objects in our toolkit, we move on to state the problem of a Representative Household in a competitive equilibrium.

17.1.19. Representative Household#

The representative household owns endowment process and initial stocks of h and k and chooses stochastic processes for {ct,st,ht,t}t=0, each element of which is in L02, to maximize

 12 E0t=0βt[(stbt)(stbt)+t2]

subject to

Et=0βtpt0ctJ0=Et=0βt(wt0t+αt0dt)J0+v0k1
st=Λht1+Πct
ht=Δhht1+Θhct,h1,k1  given

We now describe the problems faced by two types of firms called type I and type II.

17.1.20. Type I Firm#

A type I firm rents capital and labor and endowments and produces ct,it.

It chooses stochastic processes for {ct,it,kt,t,gt,dt}, each element of which is in L02, to maximize

E0t=0βt(pt0ct+qt0itrt0kt1wt0tαt0dt)

subject to

Φcct+Φggt+Φiit=Γkt1+dt
t2+gtgt=0

17.1.21. Type II Firm#

A firm of type II acquires capital via investment and then rents stocks of capital to the c,i-producing type I firm.

A type II firm is a price taker facing the vector v0 and the stochastic processes {rt0,qt0}.

The firm chooses k1 and stochastic processes for {kt,it}t=0 to maximize

Et=0βt(rt0kt1qt0it)J0v0k1

subject to

kt=Δkkt1+Θkit

17.1.22. Competitive Equilibrium: Definition#

We can now state the following.

Definition: A competitive equilibrium is a price system [v0,{pt0,wt0,αt0,qt0,rt0}t=0] and an allocation {ct,it,kt,ht,gt,dt}t=0 that satisfy the following conditions:

  • Each component of the price system and the allocation resides in the space L02.

  • Given the price system and given h1,k1, the allocation solves the representative household’s problem and the problems of the two types of firms.

Versions of the two classical welfare theorems prevail under our assumptions.

We exploit that fact in our algorithm for computing a competitive equilibrium.

Step 1: Solve the planning problem by using dynamic programming.

The allocation (i.e., quantities) that solve the planning problem are the competitive equilibrium quantities.

Step 2: use the following formulas to compute the equilibrium price system

pt0=[ΠMts+ΘhMth]/μ0w=Mtc/μ0w
wt0=∣Sgxt/μ0w
rt0=ΓMtd/μ0w
qt0=ΘkMtk/μ0w=Mti/μ0w
αt0=Mtd/μ0w
v0=ΓM0d/μ0w+ΔkM0k/μ0w

Verification: With this price system, values can be assigned to the Lagrange multipliers for each of our three classes of agents that cause all first-order necessary conditions to be satisfied at these prices and at the quantities associated with the optimum of the planning problem.

17.1.23. Asset pricing#

An important use of an equilibrium pricing system is to do asset pricing.

Thus, imagine that we are presented a dividend stream: {yt}L02 and want to compute the value of a perpetual claim to this stream.

To value this asset we simply take price times quantity and add to get an asset value: a0=Et=0βt pt0ytJ0.

To compute ao we proceed as follows.

We let

yt=Uaxt
a0=Et=0βtxtZaxtJ0
Za=UaMc/μ0w

We have the following convenient formulas:

a0=x0μax0+σa
μa=τ=0βτ(Ao)τ ZaAoτ
σa=β1β trace(Zaτ=0βτ(Ao)τCC(Ao)τ)

17.1.24. Re-Opening Markets#

We have assumed that all trading occurs once-and-for-all at time t=0.

If we were to re-open markets at some time t>0 at time t wealth levels implicitly defined by time 0 trades, we would obtain the same equilibrium allocation (i.e., quantities) and the following time t price system

Lt2=[{ys}s=t: ys  is a random variablein  Js  for  stand Es=tβst ys2Jt<+].
pst=Mcxs/[e¯jMcxt],st
wst=∣Sgxs|/[e¯jMcxt],  st
rst=ΓMdxs/[e¯jMcxt],  st
qst=Mixs/[e¯jMcxt],st
αst=Mdxs/[e¯jMcxt],  st
vt=[ΓMd+ΔkMk]xt/[e¯jMcxt]

17.2. Econometrics#

Up to now, we have described how to solve the direct problem that maps model parameters into an (equilibrium) stochastic process of prices and quantities.

Recall the inverse problem of inferring model parameters from a single realization of a time series of some of the prices and quantities.

Another name for the inverse problem is econometrics.

An advantage of the [Hansen and Sargent, 2013] structure is that it comes with a self-contained theory of econometrics.

It is really just a tale of two state-space representations.

Here they are:

Original State-Space Representation:

xt+1=Aoxt+Cwt+1yt=Gxt+vt

where vt is a martingale difference sequence of measurement errors that satisfies Evtvt=R,Ewt+1vs=0 for all t+1s and

x0N(x^0,Σ0)

Innovations Representation:

x^t+1=Aox^t+Ktatyt=Gx^t+at,

where at=ytE[yt|yt1],EatatΩt=GΣtG+R.

Compare numbers of shocks in the two representations:

  • nw+ny versus ny

Compare spaces spanned

  • H(yt)H(wt,vt)

  • H(yt)=H(at)

Kalman Filter:.

Kalman gain:

Kt=AoΣtG(GΣtG+R)1

Riccati Difference Equation:

Σt+1=AoΣtAo+CCAoΣtG(GΣtG+R)1GΣtAo

Innovations Representation as Whitener

Whitening Filter:

at=ytGx^tx^t+1=Aox^t+Ktat

can be used recursively to construct a record of innovations {at}t=0T from an (x^0,Σ0) and a record of observations {yt}t=0T.

Limiting Time-Invariant Innovations Representation

Σ=AoΣAo+CCAoΣG(GΣG+R)1GΣAoK=AoΣtG(GΣG+R)1
x^t+1=Aox^t+Katyt=Gx^t+at

where EatatΩ=GΣG+R.

17.2.1. Factorization of Likelihood Function#

Sample of observations {ys}s=0T on a (ny×1) vector.

f(yT,yT1,,y0)=fT(yT|yT1,,y0)fT1(yT1|yT2,,y0)f1(y1|y0)f0(y0)=gT(aT)gT1(aT1)g1(a1)f0(y0).

Gaussian Log-Likelihood:

.5t=0T{nyln(2π)+ln|Ωt|+atΩt1at}

17.2.2. Covariance Generating Functions#

Autocovariance: Cx(τ)=Extxtτ.

Generating Function: Sx(z)=τ=Cx(τ)zτ,zC.

17.2.3. Spectral Factorization Identity#

Original state-space representation has too many shocks and implies:

Sy(z)=G(zIAo)1CC(z1I(Ao))1G+R

Innovations representation has as many shocks as dimension of yt and implies

Sy(z)=[G(zIAo)1K+I][GΣG+R][K(z1IAo)1G+I]

Equating these two leads to:

G(zIAo)1CC(z1IAo)1G+R=[G(zIAo)1K+I][GΣG+R][K(z1IAo)1G+I].

Key Insight: The zeros of the polynomial det[G(zIAo)1K+I] all lie inside the unit circle, which means that at lies in the space spanned by square summable linear combinations of yt.

H(at)=H(yt)

Key Property: Invertibility

17.2.4. Wold and Vector Autoregressive Representations#

Let’s start with some lag operator arithmetic.

The lag operator L and the inverse lag operator L1 each map an infinite sequence into an infinite sequence according to the transformation rules

Lxtxt1
L1xtxt+1

A Wold moving average representation for {yt} is

yt=[G(IAoL)1KL+I]at

Applying the inverse of the operator on the right side and using

[G(IAoL)1KL+I]1=IG[I(AoKG)L]1KL

gives the vector autoregressive representation

yt=j=1G(AoKG)j1Kytj+at

17.3. Dynamic Demand Curves and Canonical Household Technologies#

17.3.1. Canonical Household Technologies#

ht=Δhht1+Θhctst=Λht1+Πctbt=Ubzt

Definition: A household service technology (Δh,Θh,Π,Λ,Ub) is said to be canonical if

  • Π is nonsingular, and

  • the absolute values of the eigenvalues of (ΔhΘhΠ1Λ) are strictly less than 1/β.

Key invertibility property: A canonical household service technology maps a service process {st} in L02 into a corresponding consumption process {ct} for which the implied household capital stock process {ht} is also in L02.

An inverse household technology:

ct=Π1Λht1+Π1stht=(ΔhΘhΠ1Λ)ht1+ΘhΠ1st

The restriction on the eigenvalues of the matrix (ΔhΘhΠ1Λ) keeps the household capital stock {ht} in L02.

17.3.2. Dynamic Demand Functions#

ρt0Π1[pt0ΘhEtτ=1βτ(ΔhΛΠ1Θh)τ1ΛΠ1pt+τ0]
si,t=Λhi,t1hi,t=Δhhi,t1

where hi,1=h1.

W0=E0t=0βt(wt0t+αt0dt)+v0k1
μ0w=E0t=0βtρt0(btsi,t)W0E0t=0βtρt0ρt0
ct=Π1Λht1+Π1btΠ1μ0wEt{Π1Π1Θh[I(ΔhΛΠ1Θh)βL1]1ΛΠ1βL1}pt0ht=Δhht1+Θhct

This system expresses consumption demands at date t as functions of: (i) time-t conditional expectations of future scaled Arrow-Debreu prices {pt+s0}s=0; (ii) the stochastic process for the household’s endowment {dt} and preference shock {bt}, as mediated through the multiplier μ0w and wealth W0; and (iii) past values of consumption, as mediated through the state variable ht1.

17.4. Gorman Aggregation and Engel Curves#

We shall explore how the dynamic demand schedule for consumption goods opens up the possibility of satisfying Gorman’s (1953) conditions for aggregation in a heterogeneous consumer model.

The first equation of our demand system is an Engel curve for consumption that is linear in the marginal utility μ02 of individual wealth with a coefficient on μ0w that depends only on prices.

The multiplier μ0w depends on wealth in an affine relationship, so that consumption is linear in wealth.

In a model with multiple consumers who have the same household technologies (Δh,Θh,Λ,Π) but possibly different preference shock processes and initial values of household capital stocks, the coefficient on the marginal utility of wealth is the same for all consumers.

Gorman showed that when Engel curves satisfy this property, there exists a unique community or aggregate preference ordering over aggregate consumption that is independent of the distribution of wealth.

17.4.1. Re-Opened Markets#

ρttΠ1[pttΘhEtτ=1βτ(ΔhΛΠ1Θh)τ1ΛΠ1pt+τt]
si,t=Λhi,t1hi,t=Δhhi,t1,

where now hi,t1=ht1. Define time t wealth Wt

Wt=Etj=0βj(wt+jtt+j+αt+jtdt+j)+vtkt1
μtw=Etj=0βjρt+jt(bt+jsi,t+j)WtEtt=0βjρt+jtρt+jt
ct=Π1Λht1+Π1btΠ1μtwEt{Π1Π1Θh[I(ΔhΛΠ1Θh)βL1]1ΛΠ1βL1}pttht=Δhht1+Θhct

17.4.2. Dynamic Demand#

Define a time t continuation of a sequence {zt}t=0 as the sequence {zτ}τ=t. The demand system indicates that the time t vector of demands for ct is influenced by:

Through the multiplier μtw, the time t continuation of the preference shock process {bt} and the time t continuation of {si,t}.

The time t1 level of household durables ht1.

Everything that affects the household’s time t wealth, including its stock of physical capital kt1 and its value vt, the time t continuation of the factor prices {wt,αt}, the household’s continuation endowment process, and the household’s continuation plan for {t}.

The time t continuation of the vector of prices {ptt}.

17.4.3. Attaining a Canonical Household Technology#

Apply the following version of a factorization identity:

[Π+β1/2L1Λ(Iβ1/2L1Δh)1Θh][Π+β1/2LΛ(Iβ1/2LΔh)1Θh]=[Π^+β1/2L1Λ^(Iβ1/2L1Δh)1Θh][Π^+β1/2LΛ^(Iβ1/2LΔh)1Θh]

The factorization identity guarantees that the [Λ^,Π^] representation satisfies both requirements for a canonical representation.

17.5. Partial Equilibrium#

Now we’ll provide quick overviews of examples of economies that fit within our framework

We provide details for a number of these examples in subsequent lectures

  1. Growth in Dynamic Linear Economies

  2. Lucas Asset Pricing using DLE

  3. IRFs in Hall Model

  4. Permanent Income Using the DLE class

  5. Rosen schooling model

  6. Cattle cycles

  7. Shock Non Invertibility

We’ll start with an example of a partial equilibrium in which we posit demand and supply curves

Suppose that we want to capture the dynamic demand curve:

ct=Π1Λht1+Π1btΠ1μ0wEt{Π1Π1Θh[I(ΔhΛΠ1Θh)βL1]1ΛΠ1βL1}ptht=Δhht1+Θhct

From material described earlier in this lecture, we know how to reverse engineer preferences that generate this demand system

  • note how the demand equations are cast in terms of the matrices in our standard preference representation

Now let’s turn to supply.

A representative firm takes as given and beyond its control the stochastic process {pt}t=0.

The firm sells its output ct in a competitive market each period.

Only spot markets convene at each date t0.

The firm also faces an exogenous process of cost disturbances dt.

The firm chooses stochastic processes {ct,gt,it,kt}t=0 to maximize

E0t=0βt{ptctgtgt/2}

subject to given k1 and

Φcct+Φiit+Φggt=Γkt1+dtkt=Δkkt1+Θkit.

17.6. Equilibrium Investment Under Uncertainty#

A representative firm maximizes

Et=0βt{ptctgt2/2}

subject to the technology

ct=γkt1kt=δkkt1+itgt=f1it+f2dt

where dt is a cost shifter, γ>0, and f1>0 is a cost parameter and f2=1. Demand is governed by

pt=α0α1ct+ut

where ut is a demand shifter with mean zero and α0,α1 are positive parameters.

Assume that ut,dt are uncorrelated first-order autoregressive processes.

17.7. A Rosen-Topel Housing Model#

Rt=bt+αhtpt=Etτ=0(βδh)τRt+τ

where ht is the stock of housing at time t Rt is the rental rate for housing, pt is the price of new houses, and bt is a demand shifter; α<0 is a demand parameter, and δh is a depreciation factor for houses.

We cast this demand specification within our class of models by letting the stock of houses ht evolve according to

ht=δhht1+ct,δh(0,1)

where ct is the rate of production of new houses.

Houses produce services st according to st=λ¯ht or st=λht1+πct, where λ=λ¯δh,π=λ¯.

We can take λ¯ρt0=Rt as the rental rate on housing at time t, measured in units of time t consumption (housing).

Demand for housing services is

st=btμ0ρt0

where the price of new houses pt is related to ρt0 by ρt0=π1[ptβδhEtpt+1].

17.8. Cattle Cycles#

Rosen, Murphy, and Scheinkman (1994). Let pt be the price of freshly slaughtered beef, mt the feeding cost of preparing an animal for slaughter, h~t the one-period holding cost for a mature animal, γ1h~t the one-period holding cost for a yearling, and γ0h~t the one-period holding cost for a calf.

The cost processes {h~t,mt}t=0 are exogenous, while the stochastic process {pt}t=0 is determined by a rational expectations equilibrium. Let x~t be the breeding stock, and y~t be the total stock of animals.

The law of motion for cattle stocks is

x~t=(1δ)x~t1+gx~t3ct

where ct is a rate of slaughtering. The total head-count of cattle

y~t=x~t+gx~t1+gx~t2

is the sum of adults, calves, and yearlings, respectively.

A representative farmer chooses {ct,x~t} to maximize

E0t=0βt{ptcth~tx~t(γ0h~t)(gx~t1)(γ1h~t)(gx~t2)mtctΨ(x~t,x~t1,x~t2,ct)}

where

Ψ=ψ12x~t2+ψ22x~t12+ψ32x~t22+ψ42ct2

Demand is governed by

ct=α0α1pt+d~t

where α0>0, α1>0, and {d~t}t=0 is a stochastic process with mean zero representing a demand shifter.

For more details see Cattle cycles

17.9. Models of Occupational Choice and Pay#

We’ll describe the following pair of schooling models that view education as a time-to-build process:

  • Rosen schooling model for engineers

  • Two-occupation model

17.9.1. Market for Engineers#

Ryoo and Rosen’s (2004) [Ryoo and Rosen, 2004] model consists of the following equations:

first, a demand curve for engineers

wt=αdNt+ε1t , αd>0

second, a time-to-build structure of the education process

Nt+k=δNNt+k1+nt , 0<δN<1

third, a definition of the discounted present value of each new engineering student

vt=βkEtj=0(βδN)jwt+k+j;

and fourth, a supply curve of new students driven by vt

nt=αsvt+ε2t , αs>0

Here {ε1t,ε2t} are stochastic processes of labor demand and supply shocks.

Definition: A partial equilibrium is a stochastic process {wt,Nt,vt,nt}t=0 satisfying these four equations, and initial conditions N1,ns,s=1,,k.

We sweep the time-to-build structure and the demand for engineers into the household technology and putting the supply of new engineers into the technology for producing goods.

st=[λ1 0  0] [h1t1h2t1hk+1,t1]+0ct[h1th2thk,thk+1,t]=[δN10000100010000][h1t1h2t1hk,t1hk+1,t1]+[0001]ct

This specification sets Rosen’s Nt=h1t1,nt=ct,hτ+1,t1=ntτ,τ=1,,k, and uses the home-produced service to capture the demand for labor. Here λ1 embodies Rosen’s demand parameter αd.

  • The supply of new workers becomes our consumption.

  • The dynamic demand curve becomes Rosen’s dynamic supply curve for new workers.

Remark: This has an Imai-Keane flavor.

For more details and Python code see Rosen schooling model.

17.9.2. Skilled and Unskilled Workers#

First, a demand curve for labor

[wutwst]=αd[NutNst]+ε1t

where αd is a (2×2) matrix of demand parameters and ε1t is a vector of demand shifters second, time-to-train specifications for skilled and unskilled labor, respectively:

Nst+k=δNNst+k1+nstNut=δNNut1+nut;

where Nst,Nut are stocks of the two types of labor, and nst,nut are entry rates into the two occupations.

third, definitions of discounted present values of new entrants to the skilled and unskilled occupations, respectively:

vst=Etβkj=0(βδN)jwst+k+jvut=Etj=0(βδN)jwut+j

where wut,wst are wage rates for the two occupations; and fourth, supply curves for new entrants:

[nstnut]=αs[vutvst]+ε2t

Short Cut

As an alternative, Siow simply used the equalizing differences condition

vut=vst

17.10. Permanent Income Models#

We’ll describe a class of permanent income models that feature

  • Many consumption goods and services

  • A single capital good with Rβ=1

  • The physical production technology

ϕcct+it=γkt1+etkt=kt1+it
ϕiitgt=0

Implication One:

Equality of Present Values of Moving Average Coefficients of c and e

kt1=βj=0βj(ϕcct+jet+j)
kt1=βj=0βjE(ϕcct+jet+j)|Jt
j=0βj(ϕc)χj=j=0βjεj

where χjwt is the response of ct+j to wt and εjwt is the response of endowment et+j to wt:

Implication Two:

Martingales

Mtk=E(Mt+1k|Jt)Mte=E(Mt+1e|Jt)

and

Mtc=(Φc)Mtd=ϕcMte

For more details see Permanent Income Using the DLE class

Testing Permanent Income Models:

We have two types of implications of permanent income models:

  • Equality of present values of moving average coefficients.

  • Martingale Mtk.

These have been tested in work by Hansen, Sargent, and Roberts (1991) [Sargent et al., 1991] and by Attanasio and Pavoni (2011) [Attanasio and Pavoni, 2011].

17.11. Gorman Heterogeneous Households#

We now assume that there is a finite number of households, each with its own household technology and preferences over consumption services.

Household j orders preferences over consumption processes according to

 (12) Et=0βt[(sjtbjt)(sjtbjt)+jt2]J0
sjt=Λhj,t1+Πcjt
hjt=Δhhj,t1+Θhcjt

and hj,1 is given

bjt=Ubjzt
Et=0βtpt0cjtJ0=Et=0βt(wt0jt+αt0djt)J0+v0kj,1,

where kj,1 is given. The jth consumer owns an endowment process djt, governed by the stochastic process djt=Udjzt.

We refer to this as a setting with Gorman heterogeneous households.

This specification confines heterogeneity among consumers to:

  • differences in the preference processes {bjt}, represented by different selections of Ubj

  • differences in the endowment processes {djt}, represented by different selections of Udj

  • differences in hj,1 and

  • differences in kj,1

The matrices Λ,Π,Δh,Θh do not depend on j.

This makes everybody’s demand system have the form described earlier, with different μj0w’s (reflecting different wealth levels) and different bjt preference shock processes and initial conditions for household capital stocks.

Punchline: there exists a representative consumer.

We can use the representative consumer to compute a competitive equilibrium aggregate allocation and price system.

With the equilibrium aggregate allocation and price system in hand, we can then compute allocations to each household.

Computing Allocations to Individuals:

Set

jt=(μ0jw/μ0aw)at

Then solve the following equation for μ0jw:

μ0jwE0t=0βt{ρt0ρt0+(wt0/μ0aw)at}=E0t=0βt{ρt0(bjtsjti)αt0djt}v0kj,1
sjtbjt=μ0jwρt0
cjt=Π1Λhj,t1+Π1sjthjt=(ΔhΘhΠ1Λ)hj,t1+Π1Θhsjt

Here hj,1 given.

17.12. Non-Gorman Heterogeneous Households#

We now describe a less tractable type of heterogeneity across households that we dub Non-Gorman heterogeneity.

Here is the specification:

Preferences and Household Technologies:

12Et=0βt[(sitbit)(sitbit)+it2]J0
sit=Λihit1+Πicithit=Δhihit1+Θhicit , i=1,2.
bit=Ubizt
zt+1=A22zt+C2wt+1

Production Technology

Φc(c1t+c2t)+Φggt+Φiit=Γkt1+d1t+d2t
kt=Δkkt1+Θkit
gtgt=t2, t=1t+2t
dit=Udizt, i=1,2

Pareto Problem:

12λE0t=0βt[(s1tb1t)(s1tb1t)+1t2]12(1λ)E0t=0βt[(s2tb2t)(s2tb2t)+2t2]

Mongrel Aggregation: Static

There is what we call a kind of mongrel aggregation in this setting.

We first describe the idea within a simple static setting in which there is a single consumer static inverse demand with implied preferences:

ct=Π1btμ0Π1Π1pt

An inverse demand curve is

pt=μ01Πbtμ01ΠΠct

Integrating the marginal utility vector shows that preferences can be taken to be

(2μ0)1(Πctbt)(Πctbt)

Key Insight: Factor the inverse of a ‘covariance matrix’.

Now assume that there are two consumers, i=1,2, with demand curves

cit=Πi1bitμ0iΠi1Πi1pt
c1t+c2t=(Π11b1t+Π21b2t)(μ01Π11Π11+μ02Π2Π21)pt

Setting c1t+c2t=ct and solving for pt gives

pt=(μ01Π11Π11+μ02Π21Π21)1(Π11b1t+Π21b2t)(μ01Π11Π11+μ02Π21Π21)1ct

Punchline: choose Π associated with the aggregate ordering to satisfy

μ01ΠΠ=(μ01Π11Π21+μ02Π21Π21)1

Dynamic Analogue:

We now describe how to extend mongrel aggregation to a dynamic setting.

The key comparison is

  • Static: factor a covariance matrix-like object

  • Dynamic: factor a spectral-density matrix-like object

Programming Problem for Dynamic Mongrel Aggregation:

Our strategy for deducing the mongrel preference ordering over ct=c1t+c2t is to solve the programming problem: choose {c1t,c2t} to maximize the criterion

t=0βt[λ(s1tb1t)(s1tb1t)+(1λ)(s2tb2t)(s2tb2t)]

subject to

hjt=Δhjhjt1+Θhjcjt,j=1,2sjt=Δjhjt1+Πjcjt ,j=1,2c1t+c2t=ct

subject to (h1,1,h2,1) given and {b1t},{b2t},{ct} being known and fixed sequences.

Substituting the {c1t,c2t} sequences that solve this problem as functions of {b1t,b2t,ct} into the objective determines a mongrel preference ordering over {ct}={c1t+c2t}.

In solving this problem, it is convenient to proceed by using Fourier transforms.  For details, please see [Hansen and Sargent, 2013] where they deploy a

Secret Weapon: Another application of the spectral factorization identity.

Concluding remark: The [Hansen and Sargent, 2013] class of models described in this lecture are all complete markets models. We have exploited the fact that complete market models are all alike to allow us to define a class that gives the same name to different things in the spirit of Henri Poincare.

Could we create such a class for incomplete markets models?

That would be nice, but before trying it would be wise to contemplate the remainder of a statement by Robert E. Lucas, Jr., with which we began this lecture.

“Complete market economies are all alike but each incomplete market economy is incomplete in its own individual way.”   Robert E. Lucas, Jr., (1989)