Nonlinear Optimization Examples |
The following example is used in many test libraries for nonlinear programming. It appeared originally in Bracken and McCormick (1968).
The problem is to determine the composition of a mixture of various chemicals that satisfy the mixture's chemical equilibrium state. The second law of thermodynamics implies that at a constant temperature and pressure, a mixture of chemicals satisfies its chemical equilibrium state when the free energy of the mixture is reduced to a minimum. Therefore, the composition of the chemicals satisfying its chemical equilibrium state can be found by minimizing the free energy of the mixture.
The following notation is used in this problem:
number of chemical elements in the mixture | |
number of compounds in the mixture | |
number of moles for compound , | |
total number of moles in the mixture, | |
number of atoms of element in a molecule of compound | |
atomic weight of element in the mixture |
The constraints for the mixture are as follows. Each of the compounds must have a nonnegative number of moles.
The problem is to determine the parameters that minimize the objective function subject to the nonnegativity and linear balance constraints. To illustrate this, consider the following situation. Determine the equilibrium composition of compound at temperature and pressure . The following table gives a summary of the information necessary to solve the problem.
=1 | =2 | =3 | ||||
Compound | H | N | O | |||
1 | -10.021 | -6.089 | 1 | |||
2 | -21.096 | -17.164 | 2 | |||
3 | -37.986 | -34.054 | 2 | 1 | ||
4 | -9.846 | -5.914 | 1 | |||
5 | -28.653 | -24.721 | 2 | |||
6 | -18.918 | -14.986 | 1 | 1 | ||
7 | -28.032 | -24.100 | 1 | 1 | ||
8 | -14.640 | -10.708 | 1 | |||
9 | -30.594 | -26.662 | 2 | |||
10 | -26.111 | -22.179 | 1 | 1 |
The following statements solve the minimization problem:
proc iml; c = { -6.089 -17.164 -34.054 -5.914 -24.721 -14.986 -24.100 -10.708 -26.662 -22.179 }; start F_BRACK(x) global(c); s = x[+]; f = sum(x # (c + log(x / s))); return(f); finish F_BRACK; con = { . . . . . . . . . . . . , . . . . . . . . . . . . , 1. 2. 2. . . 1. . . . 1. 0. 2. , . . . 1. 2. 1. 1. . . . 0. 1. , . . 1. . . . 1. 1. 2. 1. 0. 1. }; con[1,1:10] = 1.e-6; x0 = j(1,10, .1); optn = {0 3}; title 'NLPTR subroutine: No Derivatives'; call nlptr(xres,rc,"F_BRACK",x0,optn,con);
The starting point, which must be given to specify the number of parameters, is represented by X0. The first element of the OPTN vector specifies a minimization problem, and the second element specifies the amount of printed output.
The CALL NLPTR statement runs trust-region minimization. In this case, since no analytic derivatives are specified, the F_BRACK module is used to generate finite-difference approximations for the gradient vector and Hessian matrix.
The output is shown in the following figures. The iteration history does not show any problems.
|
Optimization Start | |||
Active Constraints | 3 | Objective Function | -45.05516448 |
Max Abs Gradient Element | 4.4710303342 | Radius | 1 |
Iteration | Restarts | Function Calls |
Active Constraints |
Objective Function |
Objective Function Change |
Max Abs Gradient Element |
Lambda | Trust Region Radius |
||
1 | 0 | 2 | 3 | ' | -47.33413 | 2.2790 | 4.3613 | 2.456 | 1.000 | |
2 | 0 | 3 | 3 | ' | -47.70051 | 0.3664 | 7.0044 | 0.908 | 0.418 | |
3 | 0 | 4 | 3 | -47.73117 | 0.0307 | 5.3051 | 0 | 0.359 | ||
4 | 0 | 5 | 3 | -47.73426 | 0.00310 | 3.7015 | 0 | 0.118 | ||
5 | 0 | 6 | 3 | -47.73982 | 0.00555 | 2.3054 | 0 | 0.0169 | ||
6 | 0 | 7 | 3 | -47.74846 | 0.00864 | 1.3029 | 90.184 | 0.00476 | ||
7 | 0 | 9 | 3 | -47.75796 | 0.00950 | 0.5073 | 0 | 0.0134 | ||
8 | 0 | 10 | 3 | -47.76094 | 0.00297 | 0.0988 | 0 | 0.0124 | ||
9 | 0 | 11 | 3 | -47.76109 | 0.000155 | 0.00447 | 0 | 0.0111 | ||
10 | 0 | 12 | 3 | -47.76109 | 3.385E-7 | 0.000011 | 0 | 0.00332 |
Optimization Results | |||
Iterations | 10 | Function Calls | 13 |
Hessian Calls | 11 | Active Constraints | 3 |
Objective Function | -47.76109086 | Max Abs Gradient Element | 7.3901293E-6 |
Lambda | 0 | Actual Over Pred Change | 0 |
Radius | 0.0033214552 |
The output lists the optimal parameters with the gradient.
|
Optimization Results | |||
Parameter Estimates | |||
N | Parameter | Estimate | Gradient Objective Function |
1 | X1 | 0.040668 | -9.785055 |
2 | X2 | 0.147730 | -19.570111 |
3 | X3 | 0.783154 | -34.792170 |
4 | X4 | 0.001414 | -12.968920 |
5 | X5 | 0.485247 | -25.937841 |
6 | X6 | 0.000693 | -22.753976 |
7 | X7 | 0.027399 | -28.190992 |
8 | X8 | 0.017947 | -15.222060 |
9 | X9 | 0.037314 | -30.444119 |
10 | X10 | 0.096871 | -25.007115 |
Value of Objective Function = -47.76109086 |
The three equality constraints are satisfied at the solution.
|
The Lagrange multipliers and the projected gradient are also printed. The elements of the projected gradient must be small to satisfy a first-order optimality condition.
Copyright © 2009 by SAS Institute Inc., Cary, NC, USA. All rights reserved.