4 Linear systems
4.1 The linear system objects
Linear systems are a special case of the general systems of the Systems chapter: the continuous-time system with \(F(t, x, u) = A(t)x + B(t)u\) and \(h(t, x, u) = C(t)x + D(t)u\), and its discrete-time counterpart. The objects below carry only the coefficient data. Each is the input of a constructor into the general system, and the semantics — state equation, output equation, trajectories — are defined through that constructor, so every result about general systems applies to linear ones unchanged.
There are two objects per time domain: a linear time-varying (LTV) system with coefficient maps \(A(t), B(t), C(t), D(t)\), and a linear time-invariant (LTI) system with constant matrices. An LTI system is not a different kind of system: it builds the LTV system with constant coefficients, and the general system it describes is the time-invariant system of the Systems chapter, by definition.
4.1.1 Continuous-time LTV systems
A continuous-time linear time-varying (LTV) system with states indexed by \(X\), inputs by \(U\), outputs by \(Y\) and coefficients in \(\mathbb {K}\) is the data of four matrix-valued maps on \(\mathbb {R}\),
describing the continuous-time system (definition 65) \(\dot x = A(t)x + B(t)u\), \(y = C(t)x + D(t)u\) (definition 115).
The continuous-time system (definition 65) with \(F(t, x, u) = A(t)x + B(t)u\) and \(h(t, x, u) = C(t)x + D(t)u\).
The right-hand side of the state equation, \((t, z) \mapsto A(t)\, z + B(t)\, u(t)\): the vector field (definition 81) of definition 115.
At zero input the state equation (definition 116) reduces to \((t, z) \mapsto A(t)\, z\).
At \(z = 0\) the state equation (definition 116) contributes only the input term, \(A(t)\, 0 + B(t)u(t) = B(t)u(t)\). With the input switched off the origin is therefore an equilibrium of the system.
The output equation, \((t, z) \mapsto C(t)\, z + D(t)\, u(t)\): the output map (definition 82) of definition 115.
A map \(x\) is a trajectory of \(s\) under the input \(u\) on a set \(I \subseteq \mathbb {R}\) when it is a trajectory (definition 83) of definition 115:
A trajectory (definition 84) for all time of definition 115.
A Carathéodory trajectory (definition 89) of definition 115.
A continuous-time LTV system is time-invariant when each of its four coefficients takes the same value at every pair of times.
If an LTV system is time-invariant (definition 123), so is the system it describes (definition 67).
4.1.2 Continuous-time LTI systems
A continuous-time linear time-invariant (LTI) system is the data of four matrices \(A \in \mathbb {K}^{X \times X}\), \(B \in \mathbb {K}^{X \times U}\), \(C \in \mathbb {K}^{Y \times X}\), \(D \in \mathbb {K}^{Y \times U}\), describing the LTV system (definition 114) with these constant coefficients, \(\dot x = Ax + Bu\), \(y = Cx + Du\).
The LTV system (definition 114) whose coefficients are the constant maps \(t \mapsto A\), \(t \mapsto B\), \(t \mapsto C\), \(t \mapsto D\).
The LTV system of an LTI system (definition 126) is time-invariant (definition 123).
A time-invariant LTV system (definition 123) is the LTV system of some LTI system. The converse of lemma 127.
Read the coefficients off at \(t = 0\); time invariance says every other time agrees with it.
The continuous-time system (definition 65) of the LTV system of \(s\) (definition 115, definition 126).
The system of an LTI system (definition 129) is the time-invariant system (definition 66) with \(f(x, u) = Ax + Bu\) and \(g(x, u) = Cx + Du\): the two routes from the LTI data to a general system agree.
4.1.3 Discrete-time LTV systems
A discrete-time linear time-varying (LTV) system is the same data as definition 114 with the coefficients indexed by \(\mathbb {N}\) instead of \(\mathbb {R}\), describing the discrete-time system (definition 94) \(x(k+1) = A(k)x(k) + B(k)u(k)\), \(y(k) = C(k)x(k) + D(k)u(k)\) (definition 132).
The forward time domain \(\mathbb {N}\) rather than \(\mathbb {Z}\) matches the discrete solution theory, whose state transition matrix is an ordered product over \([t_0, t)\).
The discrete-time system (definition 94) with \(F(k, x, u) = A(k)x + B(k)u\) and \(h(k, x, u) = C(k)x + D(k)u\).
The right-hand side of the state equation, \((k, z) \mapsto A(k)\, z + B(k)\, u(k)\): the next-state map (definition 103) of definition 132.
At zero input the state equation (definition 133) reduces to \((k, z) \mapsto A(k)\, z\).
At \(z = 0\) the state equation (definition 133) contributes only the input term, \(A(k)\, 0 + B(k)u(k) = B(k)u(k)\). With the input switched off the origin is therefore an equilibrium of the system.
The output equation, \((k, z) \mapsto C(k)\, z + D(k)\, u(k)\): the output map (definition 104) of definition 132.
A sequence \(x\) is a trajectory of \(s\) under the input \(u\) on a set \(I \subseteq \mathbb {N}\) when it is a trajectory (definition 105) of definition 132:
A trajectory (definition 106) for all time of definition 132.
A discrete-time LTV system is time-invariant when each of its four coefficients takes the same value at every pair of times.
If a discrete-time LTV system is time-invariant (definition 139), so is the system it describes (definition 96).
4.1.4 Discrete-time LTI systems
A discrete-time linear time-invariant (LTI) system is the data of four matrices \(A\), \(B\), \(C\), \(D\), describing the discrete-time LTV system (definition 131) with these constant coefficients, \(x(k+1) = Ax(k) + Bu(k)\), \(y(k) = Cx(k) + Du(k)\).
The discrete-time LTV system (definition 131) whose coefficients are the constant maps \(k \mapsto A\), \(k \mapsto B\), \(k \mapsto C\), \(k \mapsto D\).
The LTV system of a discrete-time LTI system (definition 142) is time-invariant (definition 139).
A time-invariant discrete-time LTV system (definition 139) is the LTV system of some LTI system. The converse of lemma 143.
Read the coefficients off at \(k = 0\).
The discrete-time system (definition 94) of the LTV system of \(s\) (definition 132, definition 142).
The system of a discrete-time LTI system (definition 145) is the time-invariant system (definition 95) with \(f(x, u) = Ax + Bu\) and \(g(x, u) = Cx + Du\): the two routes from the LTI data to a general system agree.
4.2 Peano–Baker series and the state transition matrix
For a genuinely time-varying state matrix \(A(t)\), this section constructs the state transition matrix \(\Phi (t,t_0)\) as the Peano–Baker series and proves Theorem 5.1: \(\Phi \) solves the matrix ODE \(\dot\Phi (t,t_0) = A(t)\Phi (t,t_0)\) with \(\Phi (t_0,t_0) = I\), and consequently \(x(t) := \Phi (t,t_0)x_0\) solves \(\dot x = A(t)x\), \(x(t_0) = x_0\).
Standing hypotheses. Throughout this section \(A\) is continuous and satisfies \(\| A(s)\| \le M\) for all \(s\) on the segment between the two times named in each statement. Both are needed: continuity to differentiate the series term by term, the bound to make it converge at all. Statements below do not repeat them.
The \(k\)-th term of the Peano–Baker series for a time-varying state matrix \(A(t)\):
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5 (Peano-Baker series).
The state transition matrix \(\Phi (t,t_0)\), given by the Peano–Baker series
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Theorem 5.1 (Peano-Baker series).
Each term \(P_k(t,t_0)\) of the Peano–Baker series is continuous in \(t\), for \(A\) continuous.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Induction on \(k\): \(P_0\) is constant, and \(P_{k+1}\) is the primitive of a continuous integrand (definition 147), hence continuous by the fundamental theorem of calculus.
If \(\| A(s)\| \le M\) for all \(s\) between \(t_0\) and \(t_1\), then
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Induction on \(k\): bound the integrand \(A(s) P_k(s,t_0)\) pointwise on the segment between \(t_0\) and \(t\), using submultiplicativity of the matrix norm and the induction hypothesis. Split on whether \(t_0 \le t\) or \(t \le t_0\) and integrate the majorant via the power rule, flipping the integral’s orientation (intervalIntegral.integral_symm) in the backward case.
The bound in lemma 150, uniformized to the worst case \(t = t_1\):
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Monotonicity of \(t \mapsto (M|t-t_0|)^k\) on the segment between \(t_0\) and \(t_1\), combined with lemma 150.
The Peano–Baker series \(\sum _{k=0}^\infty P_k(t,t_0)\) converges absolutely, for \(A\) bounded between \(t_0\) and \(t\) (in either order).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Compare against the exponential series \(\sum _k (M|t-t_0|)^k/k!\) via lemma 150 and the comparison test.
\(\Phi (\cdot , t_0)\) is continuous on the segment between \(t_0\) and \(t_1\) (including both endpoints), for \(A\) continuous and bounded by \(M\) there.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
The state transition matrix solves the matrix ODE
for \(t\) strictly between \(t_0\) and \(t_1\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Differentiate the Peano–Baker series term by term, using lemma 150 as the uniform bound needed for term-by-term differentiation of a series. The \(k=0\) term is constant, so peel it off and match the shifted series’ derivative against \(A(t)\Phi (t,t_0)\) using linearity of the sum under left multiplication by \(A(t)\).
\(\Phi (t_0,t_0) = I\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Every term of the Peano–Baker series beyond \(k=0\) integrates over the degenerate interval \([t_0,t_0]\) and vanishes.
Hespanha, Theorem 5.1. \(x(t) := \Phi (t,t_0)\, x_0\) solves
Push theorem 154 through the fixed linear map \(M \mapsto M x_0\) (continuous, since the domain is finite-dimensional).
For a constant matrix \(C\), \(Y(t) := \Phi (t,t_0)\, C\) solves
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Right-multiply theorem 154 by the constant \(C\) (HasDerivAt.mul_const), then reassociate.
\(x(t) := \Phi (t,t_0)\, x_0\) satisfies the integral equation
for every \(t\) between \(t_0\) and \(t_1\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
The fundamental theorem of calculus applied to theorem 156, using \(\Phi (t_0,t_0) = I\) (theorem 155) to fix the initial value.
For a constant matrix \(C\), \(Y(t) := \Phi (t,t_0)\, C\) satisfies the integral equation
for every \(t\) between \(t_0\) and \(t_1\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
The fundamental theorem of calculus applied to theorem 157, using \(\Phi (t_0,t_0) = I\) (theorem 155) to fix the initial value.
4.2.1 Uniqueness
Hespanha, Theorem 5.1. Any solution \(z\) of \(\dot x = A(t)\, x\), \(x(t_0) = x_0\), for \(t\) between \(t_0\) and \(t_1\), coincides with \(x(t) := \Phi (t,t_0)\, x_0\).
Apply the continuous-dependence bound of Theorem 3.4 with zero perturbation: since both solutions share the initial value \(x_0\), the resulting bound on \(\| x(t) - z(t)\| \) collapses to \(0\).
Hespanha, P5.2. For every fixed \(i\), the \(i\)-th column of \(\Phi (t,t_0)\) is the unique solution of \(\dot x = A(t)\, x\), \(x(t_0) = e_i\), where \(e_i\) is the \(i\)-th standard basis vector.
Restatement of theorem 160 at \(x_0 := e_i\), using \(\Phi (t,t_0)\, e_i = (\Phi (t,t_0))_{\cdot ,i}\) (Matrix.mulVec_single_one).
Any solution \(Y\) of \(\dot Y = A(t)\, Y\), \(Y(t_0) = C\), for \(t\) between \(t_0\) and \(t_1\), coincides with \(\Phi (t,t_0)\, C\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5.
Apply the continuous-dependence bound of Theorem 3.4 with zero perturbation: since both solutions share the initial value \(C\), the resulting bound on \(\| Y(t) - Z(t)\| \) collapses to \(0\).
4.2.2 Semigroup, invertibility and composition
Uniqueness is what makes these available: two expressions that solve the same matrix initial value problem must agree, and each identity below is an instance of that.
Hespanha, P5.3. For \(A\) continuous and bounded on \([\tau , t]\), and any \(\tau \le s {\lt} t\),
\(\Phi (\cdot ,\tau )\), re-anchored at \(s\), is an integral solution of the matrix ODE on the segment between \(s\) and \(t\) with initial value \(\Phi (s,\tau )\), hence coincides with \(\Phi (\cdot ,s)\, \Phi (s,\tau )\) there by theorem 162.
Hespanha, P5.4. For \(A\) continuous and bounded on the segment between \(\tau \) and \(t\), \(\Phi (t,\tau )\) is nonsingular and
From theorem 163, generalized to arbitrary order by re-anchoring \(\Phi (\cdot ,\tau )\) at \(t\) and invoking uniqueness there, \(\Phi (\tau ,t)\Phi (t,\tau ) = \Phi (\tau ,\tau ) = I\), so \(\Phi (t,\tau )\) and \(\Phi (\tau ,t)\) are mutual inverses.
For every \(z\) on the segment between \(a\) and \(b\), \(\Phi (z, a) = \Phi (z, b)\, \Phi (b, a)\). Composition with the first argument free.
\(\Phi (\cdot , a)\), re-anchored at \(b\), is an integral solution of \(\dot Y = A(r)Y\) with value \(\Phi (b,a)\) at \(b\); so is \(\Phi (\cdot , b)\Phi (b,a)\). They agree by theorem 162.
Hespanha, P5.3. For any \(s\) on the segment between \(\tau \) and \(t\),
The \(\tau \le s {\lt} t\) ordering in theorem 163 matches the textbook’s literal statement but is not a genuine requirement; the variation-of-constants proof needs the unordered form, where \(s = t_0\) is fixed and \(\tau \) ranges over the whole segment.
lemma 165 gives \(\Phi (s,\tau ) = \Phi (s,t)\Phi (t,\tau )\); left-multiply by \(\Phi (t,s)\) and cancel using \(\Phi (t,s)\Phi (s,t) = I\) (theorem 164).
For every \(\tau \) on the segment between \(t_0\) and \(t\), \(\Phi (t, t_0)\, \Phi (t_0, \tau ) = \Phi (t, \tau )\): composition through a fixed base point. This differs from theorem 166 in which of the three times is required to lie between the others — here the two fixed integration endpoints are the outer ones and \(\tau \) is free, which is the shape variation of constants needs.
theorem 166 with \(\tau \) itself as the middle point gives \(\Phi (t,\tau )\Phi (\tau ,t_0) = \Phi (t,t_0)\); right-multiply by \(\Phi (t_0,\tau )\) and cancel \(\Phi (\tau ,t_0)\Phi (t_0,\tau ) = I\).
With the first argument held fixed, \(\tau \mapsto \Phi (t, \tau )\) is continuous on the segment between \(t\) and \(t_1\) — the mirror of lemma 153, which varies the first argument. Needed wherever \(\Phi (t, \cdot )\) is an integrand, as in variation of constants.
By theorem 164, \(\Phi (t,\tau ) = \Phi (\tau ,t)^{-1}\), so the map is \(\tau \mapsto \Phi (\tau ,t)\) — continuous in its first argument — followed by matrix inversion, which is continuous at every unit.
4.2.3 Variation of constants
With a forcing term \(B(t)u(t)\), the solution acquires a convolution against \(\Phi \). The difficulty is that the elapsed time appears both as the upper limit of integration and inside the integrand; the proof factors the two apart rather than differentiating \(\Phi \) in its second argument.
Hespanha, Theorem 5.2. For continuous \(A\), \(B\) and \(u\), the function
satisfies \(\dot x(t) = A(t)x(t) + B(t)u(t)\) at every interior \(t\).
The obstacle is that \(t\) appears in both the upper limit and the integrand. Factor it out: with \(w(t) := x_0 + \int _{t_0}^{t}\Phi (t_0,\tau )B(\tau )u(\tau )\, d\tau \), whose integrand does not depend on \(t\), the fundamental theorem of calculus gives \(w\) directly, and lemma 167 shows \(x(t) = \Phi (t,t_0)w(t)\). Differentiating that product and cancelling \(\Phi (t,t_0)\Phi (t_0,t) = I\) leaves the claim. \(\Phi \) is thus only ever integrated in its second argument, never differentiated there.
The forced response (definition 172) takes the value \(x_0\) at \(t = t_0\): the forcing integral is over the degenerate interval and \(\Phi (t_0,t_0) = I\). Together with theorem 169 this makes it a solution of the initial value problem, not merely of the differential equation.
Hespanha, Theorem 5.2. Any two continuous integral solutions of the forced system \(\dot x = A(t)x + B(t)u(t)\) with the same initial value \(x_0\) agree on the segment between \(t_0\) and \(t_1\).
For fixed \(t\) the right-hand side \(v \mapsto A(t)v + B(t)u(t)\) is affine in \(v\), hence Lipschitz with constant \(\max (M, 1)\) where \(\| A\| \le M\). Continuous dependence on initial conditions with zero perturbation then bounds \(\| z_1(t) - z_2(t)\| \) by \(0\). The forcing term \(B(t)u(t)\) is common to both solutions and cancels in the difference, so it never enters the Lipschitz estimate.
4.2.4 The forced response as a trajectory
The solution theory above is stated on the coefficient maps \(A\) and \(B\), which is where the analysis lives. The results below restate it for the system object of definition 114: the variation-of-constants formula is a trajectory in the sense of definition 121, which the stability theory quantifies over.
The forced response of \(\dot x = A(t)x + B(t)u(t)\) from the state \(x_0\) at time \(t_0\), given by the variation-of-constants formula
with \(\Phi \) the state transition matrix (definition 148).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Theorem 5.2.
The homogeneous response of \(\dot x = A(t)x\) from the state \(x_0\) at time \(t_0\),
with \(\Phi \) the state transition matrix (definition 148). This is the forced response (definition 172) with the input switched off, and the object Lyapunov stability is stated about.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 8, Definition 8.1.
The homogeneous response (definition 173) takes the value \(x_{0}\) at \(t = t_{0}\), since \(\Phi (t_{0},t_{0}) = I\).
For continuous \(A\), \(B\) and \(u\), the forced response (definition 172) is continuous on the closed segment between \(t_0\) and \(t_1\), endpoints included.
The integrating-factor identity rewrites the response as \(\Phi (z,t_0)\, w(z)\) with \(w(z) = x_0 + \int _{t_0}^{z}\Phi (t_0,\tau )B(\tau )u(\tau )\, \mathrm{d}\tau \), whose integrand does not depend on \(z\) — only the limit does. Continuity of \(w\) is then the ordinary continuity of a primitive, and \(\Phi (\cdot ,t_0)\) is continuous by lemma 153.
The forced response (definition 172) satisfies
for every \(t\) on the closed segment between \(t_0\) and \(t_1\).
This is theorem 169 upgraded to include the endpoints, which the differential form cannot reach: its window has \(t_0\) as an endpoint for every choice of \(t_1\), so \(t_0\) is never interior to it.
The fundamental theorem of calculus, applied to the derivative on the open interval (theorem 169) together with continuity on the closed one (lemma 175), with lemma 170 fixing the initial value.
Let \(s\) be a continuous-time linear system with continuous coefficients \(A\) and \(B\), and let \(u\) be a continuous input. Then the forced response (definition 172) from any state \(x_0\) at any time \(t_0\) is a trajectory of \(s\) (definition 121) — it satisfies the state equation at every \(t \in \mathbb {R}\), with a two-sided derivative.
Restriction to an interval, in particular to the ray \([t_0,\infty )\) that the stability predicates quantify over, is lemma 86.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Theorem 5.2.
For \(t \ne t_0\), apply theorem 169 on a window having \(t\) in its interior; since the window is unordered this covers \(t {\lt} t_0\) as well as \(t {\gt} t_0\), and continuity of \(A\) supplies the bound on the compact segment.
At \(t = t_0\) no such window exists, because the formula is anchored there and \(t_0\) is an endpoint of every window. Instead take the integral form (theorem 176) on \([t_0, t_0+1]\) and on \([t_0-1, t_0]\); each yields a one-sided derivative at \(t_0\) (lemma 35), and the two glue to a two-sided one.
With \(u = 0\) the forced response (definition 172) is the homogeneous response (definition 173): \(\Phi (t,t_0)x_0 + \int _{t_0}^{t}\Phi (t,\tau )B(\tau )\cdot 0\, \mathrm{d}\tau = \Phi (t,t_0)x_0\).
For a continuous-time linear system with continuous coefficients, the homogeneous response (definition 173) from any state \(x_0\) at any time \(t_0\) is a trajectory (definition 121) under zero input.
Definition 8.1 is stated about this map, so this is the form in which the solution theory reaches the stability theory.
theorem 177 at a system with no inputs, where the forcing integral vanishes (lemma 178). The dummy system is an artefact of the proof: only \(A\) appears in the statement, and no hypothesis on \(B\) is needed.
Let \(A\) be continuous and let \(x\) solve \(\dot x = A(t)x\) on \([t_{0}, t_{1}]\). Then
On \([t_{0}, t]\) the solution satisfies the integral equation (lemma 34), so uniqueness for the Peano–Baker solution (theorem 160) identifies it with \(\Phi (\cdot , t_{0}) x(t_{0})\) there.
The homogeneous response (definition 173) is a trajectory of the unforced system (definition 120) on \([t_{0}, \infty )\).
theorem 179, restricted to the ray by lemma 86.
Let \(s\) have continuous \(A\) and let \(\varphi \) be a trajectory of the unforced system on \([t_{0}, t_{1}]\) (definition 120). Then \(\varphi (t) = \Phi (t, t_{0})\, \varphi (t_{0})\) for every \(t \in [t_{0}, t_{1}]\).
theorem 180, after reducing the unforced state equation by lemma 117.
If \(A\) is continuous, the unforced system (definition 74) of definition 115 is forward complete (definition 77).
A trajectory on \([t_0, t_1]\) agrees there with the homogeneous response from its initial state (theorem 182), which is a trajectory on \([t_0, \infty )\) (theorem 181).
4.2.5 The time-invariant case: the matrix exponential
For a constant state matrix the Peano–Baker series sums to the matrix exponential, which is Hespanha’s (6.1)–(6.2). The point of proving it is economy: every property of \(\Phi \) established above for a time-varying \(A\) then holds for \(e^{A(t-t_0)}\) by specialization, with no separate LTI theory. The two exponential facts that need no solution theory at all — the semigroup law (P6.3) and the finite-polynomial form via Cayley–Hamilton (P6.5) — are proved as statements about \(\exp \) and \(A\) alone.
For a constant state matrix \(A\), the \(k\)-th Peano–Baker term collapses to
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 6, equation (6.1).
Induction on \(k\). The \(k = 0\) term is the identity. For the step, \(\Phi _{k+1}(t,t_0) = \int _{t_0}^{t} A\, \Phi _k(s,t_0)\, ds\); substituting the inductive hypothesis pulls \(A^{k+1}\) out of the integral and leaves \(\int _{t_0}^{t}(s-t_0)^k ds = (t-t_0)^{k+1}/(k+1)\), which combines with \(1/k!\) to give \(1/(k+1)!\).
For a constant state matrix \(A\), the state transition matrix is the power series
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 6, equation (6.1).
Sum lemma 184 termwise; the Peano–Baker series converges for any continuous state matrix, a constant one included.
For a constant state matrix \(A\), the state transition matrix is the matrix exponential:
This is the bridge that lets every property already proved for \(\Phi \) in the time-varying setting — existence, uniqueness, the semigroup law, invertibility, variation of constants — be reused for LTI systems by specialization rather than reproved.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 6, equation (6.2).
Both sides are power series in \(A\): lemma 185 for the left, the defining series of \(\exp \) for the right. Match them termwise.
Let \(A\) be constant and let \(z\) be a continuous integral solution of \(\dot x = Ax\), \(x(t_0) = x_0\), on \([t_0, t_1]\). Then \(z(t) = e^{A(t-t_0)}x_0\) for every \(t\) in that interval.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 6, Property P6.1.
The time-varying uniqueness theorem applied at the constant state matrix \(A(\cdot ) \equiv A\), whose bound \(\| A(t)\| \le \| A\| \) is immediate, then rewritten through theorem 186. There is no new ODE content: uniqueness for LTI is uniqueness for LTV at a constant matrix.
Let \(A\) be constant. For each \(i\), the \(i\)-th column of \(e^{A(t-t_0)}\) is the unique continuous integral solution of \(\dot x = Ax\) with \(x(t_0) = e_i\), the \(i\)-th standard basis vector. Equivalently, the columns of the matrix exponential are the solutions from the standard basis.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 6, Property P6.2.
theorem 187 at \(x_0 = e_i\), in the column form supplied by the time-varying column-uniqueness theorem.
4.2.6 The forced response of a time-invariant system
For a time-invariant system the state transition matrix is the matrix exponential, so the variation-of-constants formula collapses to the closed form every textbook writes.
For constant \(A\) and \(B\) the forced response (definition 172) is
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 6.
theorem 186 identifies \(\Phi \) with the matrix exponential, applied once to the homogeneous term and once under the integral sign.
For an LTI system (definition 125) with continuous input \(u\), the closed form
is a trajectory (definition 121) of that system.
theorem 177 at the LTV system of the LTI system (definition 126), whose coefficient maps are constant and so continuous, rewritten by lemma 189.
(Hespanha, equation (5.8)). With \(x\) as in theorem 169, the output \(y(t) = C(t)x(t) + D(t)u(t)\) splits into the homogeneous response and the forced response:
\(v \mapsto C(t)v\) is a continuous linear map and so commutes with the interval integral; the integrand is continuous by lemma 168.
4.3 The matrix exponential and complexification
4.3.1 Complexification
Spectral arguments must happen over \(\mathbb {C}\), because \(\mathbb {R}\) is not algebraically closed, while the systems of interest have real coefficients. Entrywise complexification is the bridge, and these record what it commutes with. The one with content is the transfer of positive definiteness: a real positive-definite matrix remains positive definite against complex vectors, which is what lets a Lyapunov certificate be evaluated against an eigenvector.
For a real matrix \(A\), its complexification \(A_{\mathbb C}\) is obtained by applying \(\mathbb R \hookrightarrow \mathbb C\) to each entry.
If a real matrix \(P\) is positive definite, so is its complexification \(P_{\mathbb C}\), as a Hermitian matrix over \(\mathbb C\).
Write a complex vector as \(v = a + i b\) with \(a, b\) real. Then \(v^{*}P_{\mathbb C}v = a^{\mathsf T}Pa + b^{\mathsf T}Pb\): the imaginary part cancels because \(P\) is symmetric, and the real part is positive because \(v \ne 0\) forces \(a\) or \(b\) to be nonzero.
Over a field the spectrum of a matrix is its set of eigenvalues, which is how a condition on eigenpairs meets the spectral radius.
For a square matrix \(M\) over a field \(K\), \(\mu \in \sigma (M)\) if and only if \(Mv = \mu v\) for some \(v \ne 0\).
4.3.2 Spectral facts about the exponential
These say nothing about trajectories, initial times or state transition matrices — they are facts about \(\exp \) and \(A\) alone, and are proved as such. The complexification bridge is what lets spectral arguments, which must happen over \(\mathbb {C}\), yield bounds on a real exponential; P6.5 collapses the exponential series to a finite polynomial in \(A\). The eigenpair lemma is the half of spectral mapping that is pure power-series algebra, and is what turns an eigenvalue condition on \(A\) into a statement about the growth of \(e^{At}\).
Entrywise complexification commutes with the matrix exponential: for a real matrix \(A\),
where \(\overline{\phantom{A}}\) denotes applying \(\mathbb {R} \hookrightarrow \mathbb {C}\) entrywise. This is the bridge used to transfer spectral facts, which live over \(\mathbb {C}\), to norm bounds on a real exponential.
Entrywise complexification is a continuous ring homomorphism, and \(\exp \) commutes with any such.
Let \(M\) be a square matrix and let \((\mu , v)\) be an eigenpair of \(M\), so that \(Mv = \mu v\). Then
Reference: standard power-series functional calculus for the exponential.
Induction gives \(M^{k}v = \mu ^{k}v\) for every \(k\). The map \(N \mapsto Nv\) is linear and continuous, so it commutes with the sum defining \(e^{M} = \sum _{k} (k!)^{-1} M^{k}\), giving \(e^{M}v = \sum _{k} (k!)^{-1}\mu ^{k} v = e^{\mu } v\).
If \(Av = \mu v\) then \((cA)v = (c\mu )v\).
If \(Av = \mu v\) then \(A^{k}v = \mu ^{k}v\) for every \(k\).
For a square matrix \(A\) over a commutative ring and scalars \(\alpha , \mu \), a vector \(v\) satisfies \((A + \alpha I)v = (\mu + \alpha )v\) if and only if \(Av = \mu v\).
\((\mu I - A)v = 0\) if and only if \(Av = \mu v\).
If every eigenpair \((\mu , v)\) of the complexification of a real matrix \(A\), with \(v \ne 0\), has \(\operatorname {Re}(\mu ) {\lt} 0\), then \(r(e^{A_{\mathbb C}}) {\lt} 1\).
Reference: standard spectral mapping for the matrix exponential.
Reverse spectral mapping: every spectral value of \(e^{A_{\mathbb C}}\) is \(e^{\mu }\) for an eigenvalue \(\mu \) of \(A_{\mathbb C}\), and \(|e^{\mu }| = e^{\operatorname {Re}\mu } {\lt} 1\).
Hespanha, P6.3. For every \(t, \tau \in \mathbb {R}\),
\(tA\) and \(\tau A\) commute, being scalar multiples of the same matrix, so the exponential of the sum factors. The general \(e^{X}e^{Y} = e^{X+Y}\) needs commutativity and is false without it; here it is free.
Hespanha, P6.5. There are scalar functions \(\alpha _0, \dots , \alpha _{n-1} : \mathbb {R} \to \mathbb {R}\) with
The matrix exponential — an infinite series in \(A\) — is a finite polynomial in \(A\) of degree less than \(n\), at the cost of coefficients that are transcendental in \(t\).
Cayley–Hamilton reduces every power \(A^k\) to a combination of \(A^0, \dots , A^{n-1}\), say with coefficients \(\bar a_i(k)\); substituting into the exponential series and exchanging the finite sum over \(i\) with the infinite sum over \(k\) exhibits \(\alpha _i(t) = \sum _k t^k \bar a_i(k)/k!\) as a witness.
The exchange needs those series to converge, which holds because the reduced coefficients grow at most geometrically, \(|\bar a_i(k)| \le CM^k\), dominating each \(\alpha _i\) by a scalar exponential series. That growth bound is the crux of the proof and is established by iteration, not by spectral theory: “multiply by \(X\), reduce modulo the characteristic polynomial” is a fixed linear operation on the \(n\)-dimensional space of polynomials of degree \({\lt} n\), so one step scales the \(\ell ^1\) size of the coefficient vector by at most a constant factor. No eigenvalues and no Jordan form appear anywhere.
4.4 The discrete-time state transition matrix
For \(x(t+1) = A(t)x(t)\) the state transition matrix is an ordered product rather than a series, and the whole theory becomes finite: every proof below is an induction, with no convergence, no differentiation and no Gronwall estimate. Two differences from the continuous case are substantive rather than merely technical. There is no standing bound on \(A\) to carry, since a finite product always converges; and \(\Phi \) need not be invertible, so the semigroup property genuinely requires \(\tau \le s \le t\) instead of holding in any order.
The discrete-time state transition matrix \(\Phi (t,t_0)\):
Formally, the ordered product of \(A\) over \([t_0, t)\), which for \(t \le t_0\) is the empty product \(I\). The system runs forward only, so the \(t {\lt} t_0\) branch carries no meaning; it is there to make the definition total.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, equation (5.11).
\(\Phi (t_0,t_0) = I\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Property P5.5.
The defining product is over the empty range \([t_0, t_0)\).
For \(t \ge t_0\), \(\Phi (t+1, t_0) = A(t)\, \Phi (t, t_0)\). With lemma 205 this is the existence half of Hespanha’s P5.5: the discrete state transition matrix solves the matrix recursion.
Peel the leading factor \(A(t)\) off the defining product.
Hespanha, P5.5. If \(Z(t_0) = I\) and \(Z(t+1) = A(t)Z(t)\) for all \(t \ge t_0\), then \(Z(t) = \Phi (t,t_0)\) for all \(t \ge t_0\).
If \(z(t_0) = x_0\) and \(z(t+1) = A(t)z(t)\) for all \(t \ge t_0\), then \(z(t) = \Phi (t,t_0)x_0\) for all \(t \ge t_0\): the vector form of theorem 207.
Hespanha, P5.6. For each \(i\), the \(i\)-th column of \(\Phi (t,t_0)\) is the unique solution of \(z(t+1) = A(t)z(t)\) with \(z(t_0) = e_i\), for \(t \ge t_0\).
theorem 208 at \(x_0 = e_i\), using \(\Phi (t,t_0)e_i = (\Phi (t,t_0))_{\cdot ,i}\).
Hespanha, P5.7. For \(\tau \le s \le t\),
Unlike the continuous-time case there is no inverse: \(\Phi \) is a product of matrices that need not be nonsingular, so the ordering \(\tau \le s \le t\) is a genuine restriction here rather than an artifact.
Induction on \(t\) from \(s\), chaining lemma 206 at both \(s\) and \(\tau \).
4.4.1 Discrete variation of constants
The discrete variation-of-constants formula
takes the value \(x_0\) at \(t = t_0\): the forcing sum is over the empty range and \(\Phi (t_0,t_0) = I\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Section 5.3 (discrete variation of constants).
For \(t \ge t_0\), the formula of lemma 211 satisfies the forced recursion
Peel the top term off the sum defining \(x(t+1)\) and fold \(A(t)\Phi (t,\tau +1)\) into \(\Phi (t+1,\tau +1)\) termwise by lemma 206, applied once more to the leading \(\Phi (t,t_0)\) term. The peeled term is exactly \(B(t)u(t)\), since \(\Phi (t+1,t+1) = I\).
Any two solutions of \(z(t+1) = A(t)z(t) + B(t)u(t)\) with the same value at \(t_0\) agree for all \(t \ge t_0\).
Induction on \(t\) from \(t_0\). Unlike theorem 171, no Lipschitz condition or Gronwall estimate is needed: the recursion determines each successive value outright, so uniqueness is immediate.
4.4.2 The discrete responses as trajectories
The variation-of-constants formula and its unforced part, named, and read on the system object (definition 131): they are exactly the trajectories of the system from a given initial state, which is the form in which the solution theory reaches the stability theory.
The forced response of \(x(t+1) = A(t)x(t) + B(t)u(t)\) from the state \(x_0\) at time \(t_0\),
with \(\Phi \) the discrete state transition matrix (definition 204). It solves the recursion forward from \(t_0\) only.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Section 5.3.
The homogeneous response of \(x(t+1) = A(t)x(t)\) from the state \(x_0\) at time \(t_0\), \(x(t) = \Phi (t, t_0)\, x_0\): the forced response (definition 214) with the input switched off.
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Section 5.3.
The forced response (definition 214) takes the value \(x_0\) at \(t = t_0\).
For \(t \ge t_0\) the forced response (definition 214) satisfies \(x(t+1) = A(t)x(t) + B(t)u(t)\).
The homogeneous response (definition 215) takes the value \(x_0\) at \(t = t_0\).
\(\Phi (t_0, t_0) = I\) (lemma 205).
For \(t \ge t_0\) the homogeneous response (definition 215) satisfies \(x(t+1) = A(t)x(t)\).
\(\Phi (t+1, t_0) = A(t)\Phi (t, t_0)\) (lemma 206).
For a constant state matrix \(A\), the discrete state transition matrix (definition 204) is \(\Phi (t, t_0) = A^{t - t_0}\).
Reference: Hespanha, Linear Systems Theory (2nd ed.), Chapter 5, Section 5.3.
\(\Phi (t, t_0)\) is the ordered product of \(t - t_0\) factors, all equal to \(A\).
For a discrete-time LTV system \(s\) and input \(u\), the forced response (definition 214) from \(x_0\) at \(t_0\) is a trajectory of \(s\) under \(u\) on \([t_0, \infty )\) (definition 137).
lemma 217, which is the trajectory condition on the nose.
If \(x\) is a trajectory of \(s\) under \(u\) on \([t_0, \infty )\) (definition 137), then \(x(t)\) is the forced response (definition 214) from \(x(t_0)\) at \(t_0\), for every \(t \ge t_0\).
Both satisfy the forced recursion from the same initial value, so they agree by theorem 213.
The homogeneous response (definition 215) from \(x_0\) at \(t_0\) is a trajectory of the unforced system on \([t_0, \infty )\) (definition 137).
If \(x\) is a trajectory of the unforced system on \([t_0, \infty )\) (definition 137), then \(x(t) = \Phi (t, t_0)\, x(t_0)\) for every \(t \ge t_0\).
theorem 208, after reducing the unforced state equation by lemma 134.