Support for Hadoop

SAS 9.4 M8

Details about the minimum supported versions for Hadoop distributions and Kerberos are provided in the following table.
Unless noted otherwise:

• SAS software listed below is for SAS 9.4 (9.4 M8) with the latest hot fixes applied.
• SAS 9.4M8 and later provide Limited support for Cloudera CDH and Hortonworks HDP. Per the Cloudera Support lifecycle policy, these offerings are no longer supported.
• SAS/ACCESS Interface to Hadoop on SAS 9.4M8 supports Cloudera Data Platform (CDP) 7.2 for Public Cloud and CDP 7.1 with CDP Private Cloud Data Services 1.5.0 for Private Cloud. Bulk loading (BULKLOAD=YES) is not supported in Private Cloud.
• The HADOOPPLATFORM=SPARK option requires Spark 2.4. This option is available for use with SAS In-Database Code Accelerator for Hadoop, SAS Scoring Accelerator for Hadoop, DATA Step Processing in Hadoop, and SAS High-Performance Analytics.
• Read SAS Support for Alternative Releases of Hadoop Distributions below to understand SAS support for later versions of Hadoop distributions.
• Information about Hadoop JAR files and SAS environment variables for Hadoop is provided in the SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS. Multiple editions of this guide are available.

Footnotes:

[1] In addition, Apache Hadoop 0.23, 2.4.0, and 2.7.1 and later versions are supported as the Hadoop cluster that is co-located with SAS LASR Analytic Serverfor access to SASHDAT on HDFS.
[2] Includes a REST API for job submission that results in better performance.
[3] Includes support for cron syntax in coordinator frequency with Oozie. This functionality is needed to schedule flows with recurring time events.
[4] On a public cloud, HDFS operations through the REST API are supported.
[5] Supported only with the HADOOPPLATFORM=SPARK option.
[6] Version 18 or later of the SAS Embedded Process for Hadoop is required.
[7] The latest SAS hot fixes are required.
[8] Version 19 or later of the SAS Embedded Process for Hadoop is required.
[9] Not supported for use in a public cloud environment because of the limitations of org.apache.hadoop.fs.FSDataOutputStream.
[10] Not supported for use in a public cloud environment.
[11] “And later” versions of CDP are not supported.
[12] Support not available at the initial release of SAS 9.4M8.
[13] For in-database processing in Amazon EMR, SAS must be deployed in Amazon Web Services (AWS).
[14] Only SAS/ACCESS Interface to Hadoop supports CDP 7.1 with CDP Private Cloud Data Services 1.5.0.

Hadoop Security

Details about the supported Hadoop Security configurations

Footnotes:

[1] MapR security and Kerberos are not supported
[2] Kerberos not supported if connecting to MapR from Windows host

Hadoop High Availability

SAS currently supports HDFS HA and Hive HA with Cloudera distributions.

SAS 9.4 M7

Details about the minimum supported versions for Hadoop distributions and Kerberos are provided in the following table.
Unless noted otherwise:

• SAS software listed below is for the seventh maintenance release of 9.4 (9.4 M7) with the latest hotfixes applied.
• The HADOOPPLATFORM=SPARK option requires Spark 2.4. This option is available for use with SAS In-Database Code Accelerator for Hadoop, SAS Scoring Accelerator for Hadoop, DATA Step Processing in Hadoop, and SAS High-Performance Analytics.

• Read SAS Support for Alternative Releases of Hadoop Distributions below to understand SAS support for later versions of Hadoop distributions.
• Information about Hadoop JAR files and SAS environment variables for Hadoop is provided in the SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS. Multiple editions of this guide are available.
• Cloudera Data Warehouse - Data Services is supported (for Hive). SAS 9.4M7F or later is required. Bulk loading (BULKLOAD=YES) is not supported.
• SAS/ACCESS Interface to Hadoop on SAS 9.4M7 supports Cloudera Data Platform (CDP) 7.1 for Public Cloud and CDP 7.1 with CDP Private Cloud Data Services 1.5.0 for Private Cloud. Bulk loading (BULKLOAD=YES) is not supported in Private Cloud.

Footnotes:

[1] In addition, Apache Hadoop 0.23, 2.4.0, and 2.7.1 and later versions are supported as the Hadoop cluster that is co-located with SAS LASR Analytic Serverfor access to SASHDAT on HDFS.
[2] Includes a REST API for job submission that results in better performance.
[3] Includes support for cron syntax in coordinator frequency with Oozie. This functionality is needed to schedule flows with recurring time events.
[4] PROC SQOOP requires patches from Hortonworks: HDP 3.1 patch 3.1.0.29-2. See the Hortonworks site for instructions on applying the patch.
[5] Spark is not supported.
[6] Spark on SAS Servers running on Windows and the Cluster/Survive directive are not supported.
[7] On a public cloud, HDFS operations through the REST API are supported.
[8] Supported only with the HADOOPPLATFORM=SPARK option.
[9] Version 18 or later of the SAS Embedded Process for Hadoop is required.
[10] The latest SAS hot fixes are required.
[11] Version 19 or later of the SAS Embedded Process for Hadoop is required.
[12] Not supported for use in a public cloud environment because of the limitations of org.apache.hadoop.fs.FSDataOutputStream.
[13] Not supported for use in a public cloud environment
[14] Only SAS/ACCESS Interface to Hadoop supports CDP 7.1 with CDP Private Cloud Data Services 1.5.0.

Hadoop Security

Details about the supported Hadoop Security configurations

Footnotes:

[1] MapR security and Kerberos are not supported
[2] Kerberos not supported if connecting to MapR from Windows host

Hadoop High Availability

SAS currently supports HDFS HA and Hive HA with Cloudera and Hortonworks distributions.

SAS 9.4 M6

Details about the minimum supported versions for Hadoop distributions and Kerberos are provided in the following table.
Unless noted otherwise:

• SAS software listed below is for the sixth maintenance release of 9.4 (9.4 M6) with the latest hot fixes applied.
• The HADOOPPLATFORM=SPARK option requires Spark 2. This option is available for use with SAS In-Database Code Accelerator for Hadoop, SAS Scoring Accelerator for Hadoop, DATA Step Processing in Hadoop, and SAS High-Performance Analytics.

• Read SAS Support for Alternative Releases of Hadoop Distributions below to understand SAS support for later versions of Hadoop distributions.
• Information about Hadoop JAR files and SAS environment variables for Hadoop is provided in the SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS. Multiple editions of this guide are available.

[1] In addition, Apache Hadoop 0.23, 2.4.0, and 2.7.1 versions are supported as the Hadoop cluster that is co-located with SAS LASR Analytic Server for access to SASHDAT on HDFS.
[2] Includes a REST API for job submission that results in better performance.
[3] Includes support for cron syntax in coordinator frequency with Oozie. This functionality is needed to schedule flows with recurring time events.
[4] Supports SAS Servers running on Linux for x64 SAS servers only.
[5] Spark is supported with CDH 5.7 and later releases.
[6] Supports Spark 1.6 only.
[7] PROC SQOOP requires patches from Hortonworks: HDP 3.0 patch 3.0.0.14-4 or HDP 3.1 patch 3.1.0.29-2. See the Hortonworks site for instructions on applying the patch.
[8] Supports Cloudera 6.2 and later releases. Spark 2.4 supported on Linux for x64 SAS servers only.
[9] Spark is not supported.
[10] Spark on SAS Servers running on Windows and the Cluster/Survive directive are not supported.
[11] The latest SAS hot fixes are required.
[12] Supports CDP on-premises (private cloud) deployments only.
[13] Supported only with the HADOOPPLATFORM=SPARK option.
[14] Version 18 of the SAS Embedded Process for Hadoop is required.
[15] With the exception of the use of ACCELWHERE option on Windows.

SAS 9.4 M5

Details about the minimum supported versions for Hadoop distributions and Kerberos are provided in the following table.

Notes:

• Unless noted otherwise, SAS software listed below is for the fifth maintenance release of 9.4 (9.4 M5).
• SAS 9.4 M5 and earlier provide Limited support for Hadoop. These releases incorporate Java 7, which is not supported by the vendors of Hadoop distributions.
• Read SAS Support for Alternative Releases of Hadoop Distributions below to understand SAS support for later versions of Hadoop distributions.
• Information about Hadoop JAR files and SAS environment variables for Hadoop is provided in the SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS. Multiple editions of this guide are available.

Footnotes:

[1] In addition, Apache Hadoop 0.23, 2.4.0, and 2.7.1 versions are supported for the Hadoop cluster that is co-located with SAS LASR Analytic Server for access to SASHDAT on HDFS.
[2] Only delimited text files, such as CSV files, are supported for data exchange between the Hadoop version and SAS software shown.
[3] Includes a REST API for job submission that results in better performance.
[4] Recommended. Includes support for cron syntax in coordinator frequency with Oozie. This functionality is needed in order to schedule flows with recurring time events.
[5] Only Linux for x64 SAS servers are supported.
[6] Spark is supported with CDH 5.7 and later releases.
[7] HDP 2.6.3 and later are not supported.
[8] Only Spark 1.6.x is supported.
[9] A patch must be applied to HDP 3 distributions to support PROC SQOOP with Kerberos. Contact your Hadoop vendor for more information regarding the patch (HDP-3.0.0.14-4)

SAS 9.4 M4

Details about the minimum supported versions for Hadoop distributions and Kerberos are provided in the following table.

Notes:

• Unless noted otherwise, SAS software listed below is for the fourth maintenance release of 9.4 (9.4 M4).
• Kerberos supported: MIT Kerberos 5 version 1.9 or later.
• Read SAS Support for Alternative Releases of Hadoop Distributions below to understand SAS support for later versions of Hadoop distributions.
• Information about Hadoop JAR files and SAS environment variables for Hadoop is provided in the SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS. Multiple editions of this guide are available.

Footnotes:

[1] Kerberos not supported.
[2] Connecting to a Kerberos-secured Hadoop cluster is not supported if the environment variable SAS_HADOOP_RESTFUL is set to 1.
[3] Only delimited text files, such as CSV files, are supported for data exchange between the Hadoop version and SAS software shown.
[4] Includes a REST API for job submission that results in better performance.
[5] Recommended. Includes support for cron syntax in coordinator frequency with Oozie. This functionality is needed in order to schedule flows with recurring time events.
[6] Only SAS Servers running on Linux for x64 SAS servers are supported.
[7] Kerberos not supported if connecting from a Windows host.
[8] HDP 2.6.3 and later are not supported

SAS 9.4 M3

Details about the minimum supported versions for Hadoop distributions and Kerberos are provided in the following table.

Notes:

• Unless noted otherwise, SAS software listed below is for the third maintenance release of 9.4 (9.4 M3).
• Read SAS Support for Alternative Releases of Hadoop Distributions below to understand SAS support for later versions of Hadoop distributions.
• Information about Hadoop JAR files and SAS environment variables for Hadoop is provided in the SAS 9.4 Hadoop Configuration Guide for Base SAS and SAS/ACCESS. Multiple editions of this guide are available.