What’s New in SPD Server 5.3 with Hadoop

To use SPD Server with a Hadoop cluster, SPD Server 5.3 now runs on the Microsoft Windows x64 operating system as well as the Linux x64 operating system. In addition, when SPD Server is running as a Microsoft Windows service, you can specify a user ID on the Hadoop cluster. For more information, see Running SPD Server as a Microsoft Windows Service.

SPD Server 5.3 has expanded the supported Hadoop distributions. For the list of supported Hadoop distributions see What Is Required to Run SPD Server with Hadoop?.

With SPD Server 5.3, you can request distributed locking for data stored in HDFS. Distributed locking provides synchronization and group coordination services to clients over a network connection. To request distributed locking, you must include the new ZKPR_PORT= and ZKPR_QUORUM= parameter file options in the spdsserv.parm parameter file. In addition, there are several parameter file options to change default values. For more information, see SPD Server Distributed Locking.

SPD Server 5.3 supports parallel processing for all Write operations in addition to Read operations in HDFS. For more information, see Parallel Processing for Data in HDFS.

Optimized WHERE processing for SPD Server 5.3 now supports SPD Server dynamic cluster tables. For more information, see WHERE Processing Optimization with MapReduce.