Problem Note 61527: The HP Forest node fails to complete large models
In SAS® Enterprise Miner™, the HP Forest node might fail to complete.
There are no errors or warnings to indicate a problem.
The problem occurs when you are running a large and complex forest model. Example: Maximum Number of Trees is 200 and Maximum Depth is 30.
One possible cause for this issue is that PROC HPFOREST (the procedure that is invoked by the node) uses a SAVE statement to save the model as a binary file (OUTMDLFILE.bin). The size of that file is limited to approximately 2 GB. If the procedure tries to create a larger file, then the node fails to complete.
Click the Hot Fix tab in this note to access the hot fix for this issue.
After you apply the hot fix, a new property, Use as Modeling Node, is available in the HP Forest node. The new property is also available (without applying a hot fix) beginning in SAS® Enterprise Miner™ 14.3. These settings are available:
Yes—(default) The node functions like a modeling node that creates flow and publish score-code, and performs assessment.
No—The node does not create flow or publish score-code. Assessment is not performed.
The model-astore files score.sasast and score.sas files are created.
The SAVE statement is omitted from the PROC HPFOREST invocation when either of the following conditions is true:
- The Variable Selection property is set to No.
- The Variable Selection property is set to Yes and the Variable Importance Method property is set to Loss Reduction.
You can usually avoid building a large OUTMDLFILE.bin file by specifying these settings:
- Use as Modeling Node = No with Variable Selection = No.
- If you want variable selection (Variable Selection = Yes), then use Variable Importance Method = Loss Reduction, not Random Branch Assignments.
Operating System and Release Information
SAS System | SAS Enterprise Miner | Solaris for x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Linux for x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
HP-UX IPF | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
64-bit Enabled Solaris | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
64-bit Enabled AIX | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Windows 7 Professional x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Windows 7 Enterprise x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows Server 2012 Std | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows Server 2012 R2 Std | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows Server 2012 R2 Datacenter | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows Server 2012 Datacenter | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows Server 2008 for x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows Server 2008 R2 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 10 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 8.1 Pro x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 8.1 Pro 32-bit | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 8.1 Enterprise x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 8.1 Enterprise 32-bit | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 8 Pro x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft Windows 8 Enterprise x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
Microsoft® Windows® for x64 | 12.3 | 14.3 | 9.4 TS1M0 | 9.4 TS1M5 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2018-12-04 07:24:09 |
Date Created: | 2017-12-07 11:41:11 |