Shared Concepts and Topics

Joint Hypothesis Tests with Complex Alternatives, the Chi-Bar-Square Statistic

Silvapulle and Sen (2004) propose a test statistic for testing hypotheses where the null or the alternative hypothesis or both involve inequalities. You can test special cases of these hypotheses with the JOINT option in the ESTIMATE and the LSMESTIMATE statement. Consider the k estimable functions $\bL \bbeta$ and the hypotheses $H_0\colon \bL \bbeta = \mb{0}$ and $H_ a\colon \bL \bbeta \geq \mb{0}$ . The alternative hypothesis defines a convex cone $\mc{C}$ at the origin. Suppose that under the null hypothesis $\bL \widehat{\bbeta }$ follows a multivariate normal distribution with mean $\mb{0}$ and variance $\bV$ . The restricted alternative prevents you from using the usual F or chi-square test machinery, since the distribution of the test statistic under the alternative might not follow the usual rules. Silvapulle and Sen (2004) coined a statistic that takes into account the projection of the observed estimate onto the convex cone formed by the alternative parameter space. This test statistic is called the chi-bar-square statistic, and p-values are obtained by simulation; see, in particular, Chapter 3.4 in Silvapulle and Sen (2004).

Briefly, let $\bU$ be a multivariate normal random variable with mean $\mb{0}$ and variance matrix $\bV$ . The chi-bar-square statistic is the random variable

$\begin{eqnarray*} \overline{\chi }^2 & =& \bU ’\bV ^{-1}\bU - Q \\ Q & =& \min _{\btheta \in C} (\bU -\btheta )’\bV ^{-1}(\bU -\btheta ) \end{eqnarray*}$

and it can be motivated by a geometric argument. The quadratic form in Q is the $\bV$ -projection of $\bU$ onto the cone $\mc{C}$ . Suppose that this projected point is $\tilde{\bU }$ . If $\bU \in \mc{C}$ , then Q = 0 and $\tilde{\bU } = \bU$ . If $\bU$ is completely outside of the cone $\mc{C}$ , then $\tilde{\bU }$ is a point on the surface of the cone. Similarly, $\bU ’\bV ^{-1}\bU$ is the length of the segment from the origin to $\bU$ in the $\bV$ -space with norm $||x|| = (\mb{x}’\bV ^{-1}\mb{x})^{1/2}$ . If you apply the Pythagorean theorem, you can see that the chi-bar-square statistic measures the length of the segment from the origin to the projected point $\tilde{\bU }$ in $\mc{C}$ .

To calculate p-values for chi-bar-square statistics, a simulation-based approach is taken. Consider again the set of k estimable functions $\bL \bbeta$ with estimate $\bL \widehat{\bbeta } = \bU$ and variance $\bL \mr{Var}[\hat{\bbeta }]\bL ’ = \bV$ .

First, the observed value of the statistic is computed as

$\overline{\chi }^2_{\mathit{obs}} = \bU ’\bV ^{-1}\bU - Q$

Then, n independent random samples $\bZ _1,\cdots ,\bZ _ n$ are drawn from an $N(\mb{0},\bV )$ distribution and the following chi-bar-statistics are computed for the sample:

$\begin{eqnarray*} \overline{\chi }^2_1 & =& \bZ _1’\bV ^{-1}\bZ _1 - \min _{\btheta \in C}(\bZ _1-\btheta )’\bV ^{-1}(\bZ _1-\btheta ) \\ & \vdots & \\ \overline{\chi }^2_ n & =& \bZ _ n’\bV ^{-1}\bZ _ n - \min _{\btheta \in C}(\bZ _ n-\btheta )’\bV ^{-1}(\bZ _ n-\btheta ) \end{eqnarray*}$

The p-value is estimated by the fraction of simulated statistics that are greater than or equal to the observed value $\overline{\chi }^2_{\mathit{obs}}$ .

Notice that unless $\bU$ is interior to the cone $\mc{C}$ , finding the value of Q requires the solution to a quadratic optimization problem. When k is large, or when many simulations are requested, the computation of p-values for chi-bar-square statistics might require considerable computing time.