Problem Note 62442: Gini and KS statistics that are produced by performance monitoring differ from those in a Dynamic Lift report
In SAS® Model Manager, the Gini and KS statistics that are produced by performance monitoring are usually different from the same statistics that are produced in the Dynamic Lift report. The performance monitoring and Dynamic Lift report methods are different. The performance-monitoring Gini and KS statistics are produced using an approximate method that does not sort the observations based on the posterior probability variable.
If the distribution of the posterior-probability variable is skewed, then the two methods produce greater differences. Under this condition, the Dynamic Lift report is more accurate.
You cannot configure performance monitoring so that it uses the more-accurate method.
Click the Hot Fix tab in this note to access the hot fix for this issue.
After you apply the hot fix, you can configure performance monitoring to use the more-accurate method. Configure using either of these approaches:
- Select project Start-up Code. Add the following line. This approach impacts all projects.
%let _MM_USE_EM_ASSESS=1;
- Use a user-defined property to impact only a specific project. Add the following user-defined property for the project:
- key: _mm_use_em_assess
- value: 1
After you take either approach, re-run performance monitoring.
Operating System and Release Information
SAS System | SAS Model Manager | Microsoft® Windows® for x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8 Enterprise 32-bit | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8 Enterprise x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8 Pro 32-bit | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8 Pro x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8.1 Enterprise 32-bit | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8.1 Enterprise x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8.1 Pro 32-bit | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows 8.1 Pro x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2003 Datacenter Edition | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2003 Enterprise Edition | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2003 Standard Edition | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2003 for x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2008 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2008 R2 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2008 for x64 | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2012 Datacenter | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2012 R2 Datacenter | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2012 R2 Std | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows Server 2012 Std | 12.1 | | 9.3 TS1M2 | |
Microsoft Windows XP Professional | 12.1 | | 9.3 TS1M2 | |
Windows 7 Enterprise 32 bit | 12.1 | | 9.3 TS1M2 | |
Windows 7 Enterprise x64 | 12.1 | | 9.3 TS1M2 | |
Windows 7 Home Premium 32 bit | 12.1 | | 9.3 TS1M2 | |
Windows 7 Home Premium x64 | 12.1 | | 9.3 TS1M2 | |
Windows 7 Professional 32 bit | 12.1 | | 9.3 TS1M2 | |
Windows 7 Professional x64 | 12.1 | | 9.3 TS1M2 | |
Windows 7 Ultimate 32 bit | 12.1 | | 9.3 TS1M2 | |
Windows 7 Ultimate x64 | 12.1 | | 9.3 TS1M2 | |
Windows Vista | 12.1 | | 9.3 TS1M2 | |
Windows Vista for x64 | 12.1 | | 9.3 TS1M2 | |
64-bit Enabled AIX | 12.1 | | 9.3 TS1M2 | |
64-bit Enabled Solaris | 12.1 | | 9.3 TS1M2 | |
HP-UX IPF | 12.1 | | 9.3 TS1M2 | |
Linux for x64 | 12.1 | | 9.3 TS1M2 | |
Solaris for x64 | 12.1 | | 9.3 TS1M2 | |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Type: | Problem Note |
Priority: | high |
Date Modified: | 2018-06-22 10:46:40 |
Date Created: | 2018-06-11 11:28:34 |