In this course, you use processing methods to prepare structured and unstructured big data for analysis. You learn to organize this data into structured tabular form using Apache Hive and Apache Pig. You also learn SAS software technology and techniques that integrate with Hive and Pig and how to leverage these open source capabilities by programming with Base SAS and SAS/ACCESS Interface to Hadoop, and with SAS Data Integration Studio.
Learn how to
- move data into the Hadoop ecosystem
- use Hive to design a data warehouse in Hadoop
- perform data analysis using Hive Query Language
- join data sources
- perform extract, load, and transformation
- organize data in Hadoop by usage
- perform analysis on unstructured data using Apache Pig
- join massive data sets using Pig
- use user-defined functions (UDFs)
- analyze big data in Hadoop using Hive and Pig
- use SAS programming to submit Hive and Pig programs that execute in Hadoop and store results in Hadoop or return results to SAS
- use SAS programming to move data between the SAS server and the Hadoop Distributed File System (HDFS)
- construct SAS Data Integration Studio jobs that integrate with Hive and Pig processes and the HDFS.
Who should attend
Data scientists and programmers, database administrators, applications developers, and ETL developers who are looking for an in-depth technical overview of data management and extraction for big data and the Hadoop ecosystem
A basic understanding of and experience with UNIX and SQL is preferred. For advanced topics such as user-defined functions, prior programming experience is necessary.
This course addresses SAS/ACCESS, Base SAS, SAS Data Integration Studio software.
