This course teaches you how to use SAS programming methods to read, write, and manipulate Hadoop data. Base SAS methods that are covered include reading and writing raw data with the DATA step and managing the Hadoop file system and executing Map-Reduce and Pig code from SAS via the HADOOP procedure. In addition, the SAS/ACCESS Interface to Hadoop methods that allow LIBNAME access and SQL pass-through techniques to read and write Hadoop HIVE or Cloudera Impala tables structures is part of this course. Although not covered in any detail, a brief overview of additional SAS and Hadoop technologies, including DS2, high-performance analytics, SAS LASR Server, and in- memory Statistics, as well as the computing infrastructure and data access methods that support these, is also part of this course.

Lernen Sie, wie Sie / Learn how to

• read and write Hadoop files with the FILENAME statement
• execute and use Hadoop commands with PROC HADOOP
• invoke execution of MapReduce programs and Pig programs in Hadoop within a SAS program
• access Hadoop distributions using the LIBNAME statement and the SQL pass-through facility
• create and use SQL procedure pass-through queries
• use options and efficiency techniques for optimizing data access performance
• join data using the SQL procedure and the DATA step
• use Base SAS procedures with Hadoop
• write programs to create source data for SAS High Performance Analytics programs and execute SAS High Performance Analytics programs to analyze the data in parallel
• write SAS programs to start up a SAS LASR server grid, load data into memory in parallel and process that data in parallel with the IMSTAT procedure.

Zielgruppe / Who should attend

SAS programmers that need to access data in Hadoop from within SAS.

Verfügbare Schulungsformen / Formats available	Dauer
Live Web Class:	14 Stunden

Before attending this course, you should be comfortable programming in SAS and Structured Query Language (SQL). You can gain this experience from the SAS® SQL 1: Grundlagen course. You can gain knowledge of SAS from the SAS® Programmierung 1: Grundlagen course. A working knowledge of Hadoop is helpful.

This course addresses SAS/ACCESS Interface to Hadoop.

Introduction

• What is Hadoop?
• How SAS interfaces with Hadoop

Managing Files and Executing Hadoop Commands, Map-Reduce, and Pig Code

• config.xml and jar files to configure SAS interaction with Hadoop
• The Hadoop FILENAME statement
• Using PROC HADOOP

SAS Access Explicit Pass-Through

• Creating SQL procedure pass-through queries
• Using the SQL pass-through facility
• Using EXECUTE statements and HVEQL DDL to define Hive tables

Using the SAS/ACCESS LIBNAME Engine

• Using the LIBNAME statement for Hadoop
• Using data set options
• Creating views
• Combining tables
• Benefits of the LIBNAME method
• Using PROC HDMD to access delimited data, XML data, and other non-Hive formats
• Performance considerations for the SAS/ACCESS LIBNAME statement
• Copying data from a SAS library to a Hive library

Performance Considerations

Base SAS In-Database Processing

• Overview of SAS In-Database technology
• Using Base SAS procedures with Hadoop

DS2 and Hadoop (Self-Study)

• What is DS2?
• What is HPDS2?
• Methods, packages, and threads

SASHDAT and SASIOLA LIBNAME Engines for High-Performance Analytics and LASR server (Self-Study)