The ENTROPY Procedure

The default estimation technique is normed moment generalized maximum entropy (GME-NM). This is simply GME with the data constraints modified by multiplying both sides by . GME-NM then becomes

There is also the cross entropy version of GME-NM, which has the same form as GCE but with the normed constraints.

### GME versus GME-NM

GME-NM is more computationally attractive than GME for large data sets because the computational complexity of the estimation problem depends primarily on the number of parameters and not on the number of observations. GME-NM is based on the first moment of the data, whereas GME is based on the data itself. If the distribution of the residuals is well defined by its first moment, then GME-NM is a good choice. So if the residuals are normally distributed or exponentially distributed, then GME-NM should be used. On the other hand if the distribution is Cauchy, lognormal, or some other distribution where the first moment does not describe the distribution, then use GME. See Example 12.1 for an illustration of this point.

Note: This procedure is experimental.

 Previous Page | Next Page | Top of Page