Problem Note 38636: The Model Comparison node generates incorrect statistics
 |  |  |  |  |
The Model Comparison node in SAS® Enterprise Miner™ creates several statistics for evaluating competing models.
However, the Kolmogorov-Smirnov (KS) statistic generated by the Model Comparison node is incorrect.
When priors are used, the ROC, Gini, and Specificity values reported by the Model Comparison node are also incorrect.
There are no errors or warnings that the values are incorrect. There is no workaround.
Select the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
| Product Family | Product | System | Product Release | SAS Release | ||
| Reported | Fixed* | Reported | Fixed* | |||
| SAS System | SAS Enterprise Miner | Microsoft Windows 2000 Professional | 6.1 | |||
| Microsoft Windows 2000 Server | 6.1 | |||||
| Microsoft Windows 2000 Datacenter Server | 6.1 | |||||
| Microsoft Windows 2000 Advanced Server | 6.1 | |||||
| Microsoft® Windows® for x64 | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows XP 64-bit Edition | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows Server 2003 Enterprise 64-bit Edition | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows Server 2003 Datacenter 64-bit Edition | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft® Windows® for 64-Bit Itanium-based Systems | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows Server 2003 Datacenter Edition | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows Server 2003 Enterprise Edition | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows Server 2003 Standard Edition | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows Server 2008 | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Microsoft Windows XP Professional | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Windows Vista | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| 64-bit Enabled AIX | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| 64-bit Enabled HP-UX | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| 64-bit Enabled Solaris | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| HP-UX IPF | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Linux | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Linux for x64 | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
| Solaris for x64 | 6.1 | 6.1_M3 | 9.2 TS2M3 | |||
A fix for this issue for SAS Enterprise Miner 6.1_M2 is available at:
http://ftp.sas.com/techsup/download/hotfix/HF2/B15.html#38636
The Model Comparison node in SAS Enterprise Miner reports incorrect Kolmogorov-Smirnov statistics. In the presence of priors, the Gini, ROC, and Specificity values area also incorrect.
| Type: | Problem Note |
| Priority: | alert |
| Date Modified: | 2010-02-25 12:52:23 |
| Date Created: | 2010-02-05 16:44:17 |