Usage Note 61703: Configure SAS/ACCESS® Interface to Hadoop and SAS® Data Loader for Hadoop to support Hortonworks Data Platform (HDP) 2.6.3 or later
 |  |  |  |
HDP 2.6.3 has dropped support for Java 7 and now requires Java 8. Beginning with version 9.4 TS1M6, SAS® will use and support the Java 8 Java Runtime Environment (JRE). Therefore, configuration changes are not required. SAS® 9.4 TS1M5 and earlier continue to use and support a Java 7 JRE for SAS® 9.4 deployments.
This SAS Note pertains to all SAS 9.4 TS1M5 and earlier Hadoop products. SAS 9.4 TS1M5 and earlier does not support SAS® Grid Manager for Hadoop, which at this time is not supported with HDP 2.6.3 or later.
Note: The SAS® Viya® platform and SAS 9.4 TS1M6 both support Java 8 and are not affected by this change. The update described in this note is not required for installations of SAS Viya or SAS 9.4 TS1M6.
Symptoms
When you connect to an HDP 2.6.3 or later cluster, you receive the following error message:
Then, when you execute a LIBNAME connection to your database, you receive the following error:
ERROR: Error in the LIBNAME statement.
If you you execute a DS2 program on a Hive table, you receive the following error:
Also, when you execute the HiveCheck Java stand-alone program against your HDP 2.6.3 or later install to validate your database connection outside of SAS, you get the following message:
If you encounter these errors, you need to complete the steps detailed in the Workaround section.
Workaround
SAS has developed a workaround that enables SAS 9.4 (with the latest hot fixes installed) to work with HDP 2.6.3 or later.
To support HDP 2.6.3 or later, you must first gather the JAR files and configuration files from the HDP cluster, and then replace some of the JAR files with those from an online HDP 2.6.2 repository.
SAS/ACCESS® Interface to Hadoop
Complete the following steps to configure SAS/ACCESS Interface to Hadoop to support HDP 2.6.3 or later:
- Use the SAS® Deployment Manager to download the JAR files and configuration files to the SAS client machine.
- See SAS® 9.4 Hadoop Configuration Guide for Base SAS® and SAS/ACCESS® for details.
- Take note of the client JAR directory on the Specify SAS Hadoop Client Directories page.
- Navigate to the SAS Hadoop client JAR directory that was defined in step 1.
- Remove all HDP 2.6.3 or later JAR files with file names that begin with
"hive" or "tez."
- Download the latest HDP 2.6.2 Hive JAR files from the Hortonworks Index of /repositories/releases/org/apache/hive and place them in the SAS Hadoop client JAR directory.
- Download the latest HDP 2.6.2 Tez JAR files from the Hortonworks Index of /repositories/releases/org/apache/tez and place them in the SAS Hadoop client JAR directory.
SAS® Data Loader for Hadoop
Complete the following steps to configure SAS Data Loader for Hadoop to support HDP 2.6.3 or later:
- Use the SAS® Deployment Manager to download the JAR files and configuration files to the SAS client machine.
- See SAS® 9.4 Hadoop Configuration Guide for Base SAS® and SAS/ACCESS® for details.
- Take note of the client JAR directory on the Specify SAS Hadoop Client Directories page.
- Stop the SAS Data Loader for Hadoop middle tier.
- Navigate to the SAS Hadoop client JAR directory that was defined in step 1.
- Remove all HDP 2.6.3 or later JAR files with filenames that begin with
"hive" or "tez."
- Download the latest HDP 2.6.2 Hive JAR files from the Hortonworks Index of /repositories/releases/org/apache/hive and place them in the SAS Hadoop client JAR directory.
- Download the latest HDP 2.6.2 Tez JAR files from the Hortonworks Index of /repositories/releases/org/apache/tez and place them in the SAS Hadoop client JAR directory.
- Start SAS Data Loader for Hadoop middle tier.
- If you have a clustered SAS middle tier, you must update each SAS Data Loader for Hadoop middle tier using steps 1 through 7.
Note: Hive JAR files from the Hortonworks Index correspond to the Beeline client version. Use the command-line interpreter (CLI) to check the version by running the following command: beeline --version
Beeline Version: 1.2.1000 requires Hive JAR files with the prefix 1.2.1000.2.6.2.#-#/
Beeline Version: 2.1.0 requires Hive JAR files with the prefix 2.1.0.2.6.2.#-#/
Operating System and Release Information
| Product Family | Product | System | SAS Release | |
| Reported | Fixed* | |||
| SAS System | SAS/ACCESS Interface to Hadoop | 64-bit Enabled AIX | ||
| Windows Vista for x64 | ||||
| Windows Vista | ||||
| Windows Millennium Edition (Me) | ||||
| Windows 7 Ultimate x64 | ||||
| Windows 7 Ultimate 32 bit | ||||
| Windows 7 Professional x64 | ||||
| Windows 7 Professional 32 bit | ||||
| Windows 7 Home Premium x64 | ||||
| Windows 7 Home Premium 32 bit | ||||
| Windows 7 Enterprise x64 | ||||
| Windows 7 Enterprise 32 bit | ||||
| Microsoft Windows XP Professional | ||||
| Microsoft Windows Server 2016 | ||||
| Microsoft Windows Server 2012 Std | ||||
| Microsoft Windows Server 2012 R2 Std | ||||
| Microsoft Windows Server 2012 R2 Datacenter | ||||
| Microsoft Windows Server 2012 Datacenter | ||||
| Microsoft Windows Server 2008 for x64 | ||||
| Microsoft Windows Server 2008 R2 | ||||
| Microsoft Windows Server 2008 | ||||
| Microsoft Windows Server 2003 for x64 | ||||
| Microsoft Windows Server 2003 Standard Edition | ||||
| Microsoft Windows Server 2003 Enterprise Edition | ||||
| Microsoft Windows Server 2003 Datacenter Edition | ||||
| Microsoft Windows NT Workstation | ||||
| Microsoft Windows 2000 Professional | ||||
| Microsoft Windows 2000 Server | ||||
| Microsoft Windows 2000 Datacenter Server | ||||
| Microsoft Windows 2000 Advanced Server | ||||
| Microsoft Windows 95/98 | ||||
| Microsoft Windows 10 | ||||
| Microsoft Windows 8.1 Pro x64 | ||||
| Microsoft Windows 8.1 Pro 32-bit | ||||
| Microsoft Windows 8.1 Enterprise x64 | ||||
| Microsoft Windows 8.1 Enterprise 32-bit | ||||
| Microsoft Windows 8 Pro x64 | ||||
| Microsoft Windows 8 Pro 32-bit | ||||
| Microsoft Windows 8 Enterprise x64 | ||||
| Microsoft Windows 8 Enterprise 32-bit | ||||
| Microsoft® Windows® for x64 | ||||
| 64-bit Enabled Solaris | ||||
| HP-UX IPF | ||||
| Linux for x64 | ||||
| Solaris for x64 | ||||
| SAS System | SAS Data Loader for Hadoop | Microsoft® Windows® for x64 | ||
| Microsoft Windows 8 Enterprise 32-bit | ||||
| Microsoft Windows 8 Enterprise x64 | ||||
| Microsoft Windows 8 Pro 32-bit | ||||
| Microsoft Windows 8 Pro x64 | ||||
| Microsoft Windows 8.1 Enterprise 32-bit | ||||
| Microsoft Windows 8.1 Enterprise x64 | ||||
| Microsoft Windows 8.1 Pro 32-bit | ||||
| Microsoft Windows 8.1 Pro x64 | ||||
| Microsoft Windows 10 | ||||
| Microsoft Windows 95/98 | ||||
| Microsoft Windows 2000 Advanced Server | ||||
| Microsoft Windows 2000 Datacenter Server | ||||
| Microsoft Windows 2000 Server | ||||
| Microsoft Windows 2000 Professional | ||||
| Microsoft Windows NT Workstation | ||||
| Microsoft Windows Server 2003 Datacenter Edition | ||||
| Microsoft Windows Server 2003 Enterprise Edition | ||||
| Microsoft Windows Server 2003 Standard Edition | ||||
| Microsoft Windows Server 2003 for x64 | ||||
| Microsoft Windows Server 2008 | ||||
| Microsoft Windows Server 2008 R2 | ||||
| Microsoft Windows Server 2008 for x64 | ||||
| Microsoft Windows Server 2012 Datacenter | ||||
| Microsoft Windows Server 2012 R2 Datacenter | ||||
| Microsoft Windows Server 2012 R2 Std | ||||
| Microsoft Windows Server 2012 Std | ||||
| Microsoft Windows Server 2016 | ||||
| Microsoft Windows XP Professional | ||||
| Windows 7 Enterprise 32 bit | ||||
| Windows 7 Enterprise x64 | ||||
| Windows 7 Home Premium 32 bit | ||||
| Windows 7 Home Premium x64 | ||||
| Windows 7 Professional 32 bit | ||||
| Windows 7 Professional x64 | ||||
| Windows 7 Ultimate 32 bit | ||||
| Windows 7 Ultimate x64 | ||||
| Windows Millennium Edition (Me) | ||||
| Windows Vista | ||||
| Windows Vista for x64 | ||||
| 64-bit Enabled AIX | ||||
| 64-bit Enabled Solaris | ||||
| HP-UX IPF | ||||
| Linux for x64 | ||||
| Solaris for x64 | ||||
| Type: | Usage Note |
| Priority: | high |
| Date Modified: | 2018-01-15 11:37:37 |
| Date Created: | 2018-01-12 15:01:27 |