Problem Note 60433: SAS® High-Performance Analytics jobs on Hadoop fail when run against large data
 |  |  |  |  |
Due to potential memory corruption issues in DS2, SAS High-Performance Analytics procedures might fail when run on Hadoop. When you encounter this problem, you see messages similar to the following:
NOTE: The HPLOGISTIC procedure is executing in the distributed computing environment with x worker nodes.
ERROR: Job job_1234500000000_0999 has failed. Please, see job log for detail. Job tracking URL:http//hpd2.unx.sas:8088/proxy/application_1234500000000_0999/.
The Hadoop YARN log contains errors similar to the following:
2017-03-07 11:40:01,899 WARN [main] org.apache.mapred.YarnChild: Exception running child: java.io.IOException: One or more super reader threads failed to execute.
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
| Product Family | Product | System | SAS Release | |
| Reported | Fixed* | |||
| SAS System | Base SAS | Microsoft® Windows® for x64 | 9.4 TS1M4 | |
| Microsoft Windows 8 Enterprise 32-bit | 9.4 TS1M4 | |||
| Microsoft Windows 8 Enterprise x64 | 9.4 TS1M4 | |||
| Microsoft Windows 8 Pro 32-bit | 9.4 TS1M4 | |||
| Microsoft Windows 8 Pro x64 | 9.4 TS1M4 | |||
| Microsoft Windows 8.1 Enterprise 32-bit | 9.4 TS1M4 | |||
| Microsoft Windows 8.1 Enterprise x64 | 9.4 TS1M4 | |||
| Microsoft Windows 8.1 Pro 32-bit | 9.4 TS1M4 | |||
| Microsoft Windows 8.1 Pro x64 | 9.4 TS1M4 | |||
| Microsoft Windows 10 | 9.4 TS1M4 | |||
| Microsoft Windows Server 2008 | 9.4 TS1M4 | |||
| Microsoft Windows Server 2008 R2 | 9.4 TS1M4 | |||
| Microsoft Windows Server 2008 for x64 | 9.4 TS1M4 | |||
| Microsoft Windows Server 2012 Datacenter | 9.4 TS1M4 | |||
| Microsoft Windows Server 2012 R2 Datacenter | 9.4 TS1M4 | |||
| Microsoft Windows Server 2012 R2 Std | 9.4 TS1M4 | |||
| Microsoft Windows Server 2012 Std | 9.4 TS1M4 | |||
| Windows 7 Enterprise 32 bit | 9.4 TS1M4 | |||
| Windows 7 Enterprise x64 | 9.4 TS1M4 | |||
| Windows 7 Home Premium 32 bit | 9.4 TS1M4 | |||
| Windows 7 Home Premium x64 | 9.4 TS1M4 | |||
| Windows 7 Professional 32 bit | 9.4 TS1M4 | |||
| Windows 7 Professional x64 | 9.4 TS1M4 | |||
| Windows 7 Ultimate 32 bit | 9.4 TS1M4 | |||
| Windows 7 Ultimate x64 | 9.4 TS1M4 | |||
| 64-bit Enabled AIX | 9.4 TS1M4 | |||
| 64-bit Enabled Solaris | 9.4 TS1M4 | |||
| HP-UX IPF | 9.4 TS1M4 | |||
| Linux for x64 | 9.4 TS1M4 | |||
| Solaris for x64 | 9.4 TS1M4 | |||
A fix for this issue for SAS Threaded Kernel DS2 and FedSQL Language Processors 9.41_M2 is available at:
https://tshf.sas.com/techsup/download/hotfix/HF2/A6S.html#60433A fix for this issue for SAS In-Database for Hadoop on Linux 9.42 is available at:
https://tshf.sas.com/techsup/download/hotfix/HF2/U47.html#60433| Type: | Problem Note |
| Priority: | high |
| Date Modified: | 2017-07-21 10:34:31 |
| Date Created: | 2017-05-08 13:33:26 |