Contents
About
What’s New in SPD Server 5.3 with Hadoop
Introduction to Using SPD Server with Hadoop
Understanding SPD Server with Hadoop
Understanding Apache Hadoop
What Is Required to Run SPD Server with Hadoop?
Enabling SPD Server with Hadoop
Overview: Enabling SPD Server with Hadoop
Checklist to Verify the Hadoop Environment
Obtaining Hadoop Distribution JAR and Configuration Files from Hadoop Cluster
Additional Configuration for Hortonworks
Additional Configuration for a MapR Hadoop Distribution
Additional Configuration for Optimized WHERE Processing on Microsoft Windows
Specifying the Hadoop Parameter File Options
Updating the rc.spds Script
Validating the SPD Server to Hadoop Connection
SPD Server with Hadoop Configuration Examples
Functionality for SPD Server with Hadoop
Overview: Functionality for SPD Server with Hadoop
Understanding the SPD Server Table File Format
SPD Server Restrictions on Hadoop
SPD Server Distributed Locking
Parallel Processing for Data in HDFS
Running SPD Server as a Microsoft Windows Service
SPDSBASE Process
Using the Directory Cleanup Utility with Hadoop
Updating Data in HDFS
WHERE Clause Planner for Hadoop
WHERE Processing Optimization with MapReduce
Macro Variables Reference
SPDSACWH= Macro Variable
SPDSHPRD= Macro Variable
SPDSHPWR= Macro Variable
SPDSSIZE= Macro Variable
Parameter File Options Reference
HADOOP= Parameter File Option
HADOOPACCELJVER= Parameter File Option
HADOOPACCELWH Parameter File Option
HADOOPACLPATH= Parameter File Option
HADOOPCFG= Parameter File Option
HADOOPJAR= Parameter File Option
HADOOPKERBEROS= Parameter File Option
HADOOPKEYTAB= Parameter File Option
HADOOPREALM= Parameter File Option
HADOOPUSER= Parameter File Option
HADOOPWORKPATH= Parameter File Option
MINPARTSIZE= Parameter File Option
ZKPR_CTIMEOUT= Parameter File Option
ZKPR_LTIMEOUT= Parameter File Option
ZKPR_MAXRETRY= Parameter File Option
ZKPR_PORT= Parameter File Option
ZKPR_QUORUM= Parameter File Option
ZKPR_RETRYSLEEP= Parameter File Option
ZKPR_RPRTHRESH= Parameter File Option
ZKPR_STIMEOUT= Parameter File Option
Table Options Reference
ACCELWHERE= Table Option
PARALLELREAD= Table Option
PARALLELWRITE= Table Option
PARTSIZE= Table Option
Recommended Reading
Glossary
Product
Release
SAS Scalable Performance Data Server
5.3
Type
Usage and Reference
Copyright Date
October 2016
Last Updated
18Oct2016