Usage Note 57311: SAS/ACCESS® Interface to Hadoop might hang or display unexpected or garbled output if the Hive property hive.exec.compress.output is set to TRUE
If the Hadoop property hive.exec.compress.output is set to TRUE, then jobs that leverage SAS/ACCESS Interface to Hadoop might stop responding or might return unexpected results. Unexpected results can include generating incorrect record counts or character fields that appear to be gibberish. SAS/ACCESS Interface to Hadoop jobs, which apply a WHERE statement or subsets columns, are most likely to see this issue since they generate a MapReduce to generate the output. Unexpected results might also be seen when the Hadoop engine is used in windowing environments such as SAS® Enterprise Guide® or the VIEWTABLE window to do these same types of activities.
Workaround
To circumvent this issue, do one of the following:
- Set hive.exec.compress.output to FALSE either by using PROPERTIES='hive.exec.compress.output=false' in the LIBNAME statement or by setting the property within the hive-site.xml file pointed to by the SAS_HADOOP_CONFIG_PATH environment variable.
- Use the READ_METHOD=JDBC option in the LIBNAME statement. This might result in slower Read performance.
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
SAS System | SAS/ACCESS Interface to Hadoop | Microsoft® Windows® for x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8 Enterprise 32-bit | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8 Enterprise x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8 Pro 32-bit | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8 Pro x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8.1 Enterprise 32-bit | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8.1 Enterprise x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8.1 Pro | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 8.1 Pro 32-bit | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows 10 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2008 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2008 R2 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2008 for x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2012 Datacenter | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2012 R2 Datacenter | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2012 R2 Std | 9.4 TS1M2 | 9.4 TS1M4 |
Microsoft Windows Server 2012 Std | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Enterprise 32 bit | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Enterprise x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Home Premium 32 bit | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Home Premium x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Professional 32 bit | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Professional x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Ultimate 32 bit | 9.4 TS1M2 | 9.4 TS1M4 |
Windows 7 Ultimate x64 | 9.4 TS1M2 | 9.4 TS1M4 |
64-bit Enabled AIX | 9.4 TS1M2 | 9.4 TS1M4 |
64-bit Enabled Solaris | 9.4 TS1M2 | 9.4 TS1M4 |
HP-UX IPF | 9.4 TS1M2 | 9.4 TS1M4 |
Linux for x64 | 9.4 TS1M2 | 9.4 TS1M4 |
Solaris for x64 | 9.4 TS1M2 | 9.4 TS1M4 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Date Modified: | 2017-11-02 15:47:54 |
Date Created: | 2015-12-21 12:18:12 |