The State Space Model and Notation

The (linear) state space model is described in the literature in a few different ways and with varying degree of generality. The description given in this section loosely follows the description given in Durbin and Koopman (2001) (chap. 6, sec. 4). This formulation of SSM is quite general; in particular, it includes nonstationary SSMs with time-varying system matrices and state equations with diffuse initial condition (precise definitions of these terms are given later in this subsection).

Suppose that observations are collected in a sequential fashion (indexed by a numeric variable ) on some variables: vector , which denotes the -variate response values, and the -dimensional vector , which denotes the predictors. Suppose that the observation instances are . The possibility that multiple observations are taken at a particular instance is not ruled out, and the successive observation instances need not be regularly spaced—that is, need not equal . For , suppose () denotes the number of observations recorded at instance . For notational simplicity, an integer-valued secondary index is used to index the data so that corresponds to , corresponds to , and so on. Consider the following model:

     

The following list describes these equations:

  • The observation equation describes the relationship between the -dimensional response vector and the unobserved vectors , , and . The -variate responses are vertically stacked in a column to form this -dimensional response vector . The -dimensional vectors are called states, the -dimensional vector is the regression vector associated with predictors , and the -dimensional vectors are called the observation disturbances. The matrices (of dimension ) and (of dimension ) correspond to the state effect and the regression effect, respectively. The elements of are assumed to be fully known. The states and the disturbances are random sequences. It is assumed that is a sequence of independent, zero-mean, Gaussian random vectors with diagonal covariances, with the diagonal elements denoted by .

  • The state sequence is assumed to follow a Markovian structure described by the state transition equation and the associated initial condition.

  • The state transition equation postulates that a new instance of the state, , is obtained by multiplying its previous instance, , by an -dimensional square matrix (called the state transition matrix) and by adding a random disturbance vector . The -dimensional state disturbance vectors are assumed to be independent, zero-mean, Gaussian random vectors with covariances (not necessarily diagonal).

  • The initial condition describes the starting condition of the state evolution equation. The starting state vector is assumed to be partially diffuse: it is the sum of a mean-zero Gaussian vector and a term that represents the contribution from a -dimensional diffuse vector (a diffuse vector is a Gaussian vector with infinite covariance). The matrix is assumed to be completely known.

  • The observation disturbances and the state disturbances (for ) are assumed to be mutually independent. Either the elements of the matrices , , and and the diagonal elements of the observation disturbance covariances are assumed to be completely known, or some of them can be functions of a small set of unknown parameters (to be estimated from the data). Suppose that this unknown set of parameters is denoted by .

Although this description of the state space model might appear involved, it conveniently covers many variants of the SSMs encountered in practice and precisely describes the most general case that can be handled by the SSM procedure. An important restriction to note about the preceding description of the model formulation is that it assumes that the matrices that appear in the observation equation are free of unknown parameters and that the covariances of the observation disturbances are diagonal. In most practical situations, the model under consideration can be easily reformulated to a statistically equivalent form that conforms to this restriction.

For easy reference, Table 27.4 summarizes the information contained in the SSM equations.

Table 27.4 State Space Model: Notation

Distinct index values at which the observations are recorded

Number of distinct index instances

Number of observations recorded at index ,

Number of response variables in the model

Vertically stacked vector of response values recorded at

Total number of response values in the data set

Number of predictor (regressor) variables in the observation equation

matrix of predictor values recorded at

-dimensional regression vector associated with the predictors

-dimensional observation disturbance vector with diagonal covariance

Dimension of the state vectors

-dimensional state vector

matrix associated with in the observation equation

state transition matrix

-dimensional state disturbance vector

Dimension of the diffuse vector in the state initial condition

,

Diffuse vector in the state initial condition

constant matrix associated with

-dimensional state disturbance vector in the initial condition

Parameter vector


Note: This procedure is experimental.