PROC SEQDESIGN: Type I and Type II Errors :: SAS/STAT(R) 9.2 User's Guide, Second Edition

The SEQDESIGN Procedure

Type I and Type II Errors

The Type I error is the error of rejecting the null hypothesis when the null hypothesis is correct, and the Type II error is the error of not rejecting the null hypothesis when the null hypothesis is incorrect. The level of significance $\text{[math]}$ is the probability of making a Type I error. The Type II error depends on the hypothetical reference of the alternative hypothesis, and the Type II error probability $\text{[math]}$ is defined as the probability of not rejecting the null hypothesis when a specific alternative reference is true. The power $\text{[math]}$ is then defined as the probability of rejecting the null hypothesis at the alternative reference.

In a sequential design, if the maximum information and alternative reference are not both specified, the critical values are created such that both the specified Type I and the specified Type II error probability levels are maintained in the design. Otherwise, the critical values are created such that either the specified Type I error probability or the specified Type II error probability is maintained.

One-Sided Tests

For a $\text{[math]}$ -stage group sequential design with an upper alternative hypothesis $\text{[math]}$ and early stopping to reject or accept the null hypothesis $\text{[math]}$ , the boundaries contain the upper $\text{[math]}$ critical values $\text{[math]}$ and upper $\text{[math]}$ critical values $\text{[math]}$ , $\text{[math]}$ . At each interim stage, $\text{[math]}$ , the null hypothesis $\text{[math]}$ is rejected if the observed statistic $\text{[math]}$ , $\text{[math]}$ is accepted if $\text{[math]}$ , or the process is continued to the next stage if $\text{[math]}$ . At the final stage $\text{[math]}$ , the hypothesis is either rejected or accepted.

The overall Type I error probability $\text{[math]}$ is given by

$\text{[math]}$

where $\text{[math]}$ is the $\text{[math]}$ spending at stage $\text{[math]}$ . That is, at stage $\text{[math]}$ ,

$\text{[math]}$

At a subsequent stage $\text{[math]}$ ,

$\text{[math]}$

Similarly, the Type II error probability

$\text{[math]}$

where $\text{[math]}$ is the $\text{[math]}$ spending at stage $\text{[math]}$ . That is, at stage $\text{[math]}$ ,

$\text{[math]}$

At a subsequent stage $\text{[math]}$ ,

$\text{[math]}$

With an upper alternative hypothesis $\text{[math]}$ , the power $\text{[math]}$ is the probability of rejecting the null hypothesis for the upper alternative.

$\text{[math]}$

For a design with early stopping to reject $\text{[math]}$ only, the interim upper $\text{[math]}$ critical values are set to $\text{[math]}$ , $\text{[math]}$ , and $\text{[math]}$ . For a design with early stopping to accept $\text{[math]}$ only, the interim upper $\text{[math]}$ critical values are set to $\text{[math]}$ , $\text{[math]}$ , and $\text{[math]}$ .

Similarly, the Type I and Type II error probabilities for a $\text{[math]}$ -stage design with a lower alternative hypothesis $\text{[math]}$ can also be derived.

Two-Sided Tests

For a $\text{[math]}$ -stage group sequential design with two-sided alternative hypotheses $\text{[math]}$ and $\text{[math]}$ , and early stopping to reject or accept the null hypothesis $\text{[math]}$ , the boundaries contain the upper $\text{[math]}$ critical values $\text{[math]}$ , upper $\text{[math]}$ critical values $\text{[math]}$ , lower $\text{[math]}$ critical values $\text{[math]}$ , and lower $\text{[math]}$ critical values $\text{[math]}$ , $\text{[math]}$ . At each interim stage, $\text{[math]}$ , the null hypothesis $\text{[math]}$ is rejected if the observed statistic $\text{[math]}$ or $\text{[math]}$ , $\text{[math]}$ is accepted if $\text{[math]}$ , or the process is continued to the next stage if $\text{[math]}$ or $\text{[math]}$ . At the final stage $\text{[math]}$ and $\text{[math]}$ , the hypothesis is either rejected or accepted.

The overall upper Type I error probability $\text{[math]}$ is given by

$\text{[math]}$

where $\text{[math]}$ is the $\text{[math]}$ spending at stage $\text{[math]}$ for the upper alternative. That is, at stage $\text{[math]}$ ,

$\text{[math]}$

At a subsequent stage $\text{[math]}$ ,

$\text{[math]}$

Similarly, the overall lower Type I error probability $\text{[math]}$ can also be derived, and the overall Type I error probability $\text{[math]}$ .

The overall upper Type II error probability $\text{[math]}$ is given by

$\text{[math]}$

where $\text{[math]}$ is the upper $\text{[math]}$ spending at stage $\text{[math]}$ . That is, at stage $\text{[math]}$ ,

$\text{[math]}$

At a subsequent stage $\text{[math]}$ ,

$\text{[math]}$

With an upper alternative hypothesis $\text{[math]}$ , the power $\text{[math]}$ is the probability of rejecting the null hypothesis for the upper alternative:

$\text{[math]}$

which is

$\text{[math]}$

The overall lower Type II error probability $\text{[math]}$ and power $\text{[math]}$ can be similarly derived.

For a design with early stopping only to reject $\text{[math]}$ , both the interim lower and upper $\text{[math]}$ critical values are set to missing, $\text{[math]}$ , and $\text{[math]}$ , $\text{[math]}$ . For a design with early stopping only to accept $\text{[math]}$ , the interim upper $\text{[math]}$ critical values are set to $\text{[math]}$ , $\text{[math]}$ , and the interim lower $\text{[math]}$ critical values are set to $\text{[math]}$ , $\text{[math]}$ , $\text{[math]}$ , and $\text{[math]}$ , $\text{[math]}$ .

Top of Page