What's New

What's New in SAS Data Integration Studio 4.2 and 4.21


SAS Data Integration Studio versions 4.2 and 4.21 have many new features. The main enhancements that are common to both versions include the following:

The enhancements that are new to SAS Data Integration Studio 4.21 include the following:

Enhanced Job Editor

The Job Editor, the window that is used for building and maintaining jobs, has been completely redesigned. It has many new features, including the following:

New Details Pane for Jobs

The Job Editor has an optional Details pane that enables you to maintain column definitions and mappings, view the status of each transformation when the job is executed, check errors and warnings when the job is executed, view run-time statistics for the job, and change the order in which transformations in the job are executed. The Details pane includes the following tabs:

New Advanced Debugging

Advanced debugging of jobs that are opened in the Job Editor window is supported by the following features:

Enhanced Mapping and Propagation

Mapping and propagation controls enable you to manage the flow of data and the propagation of changes in your jobs. This flexibility is supported by the following features:

Enhanced Workflow

Workflow issues have been enhanced with the following features:

New Transformation Features

Transformations now support the following new features:

Enhanced Data Cleansing and Enrichment

Data cleansing and enrichment have been enhanced by running DataFlux jobs and real-time services on the DataFlux Integration Server. The following transformations have been added to support this process:

New Metadata Reporting

The new Reports feature enables you to generate reports and review the metadata for tables and jobs in a convenient format. You can also generate your own reports by creating a Java report plug-in. You can perform the following tasks with these reports:

Enhanced Tree Structure

The Custom tree is replaced by the Folders tree, which is a new, standard interface in many SAS 9.2 applications. The Folders tree enables you to add custom folders so that you can organize metadata in categories that are meaningful to your organization. The Folders tree might be the interface you use most often when you want to select metadata for update. For more information about the Folders tree, see the "Getting Started" chapter in the SAS Data Integration Studio: User's Guide.

The Inventory tree contains folders for more types of objects. Most of the time, however, SAS Data Integration Studio users work with the same objects as before, such as tables, libraries, and jobs. You can right-click objects in the Inventory tree and select Find In    Folders to find them in the Folders tree.

The Process Library tree is now called the Transformations tree.

The Project tree, a special tree that was used under change management, is now called the Checkouts tree. You can check in objects individually. Set up and administration of change management is easier. There is no need to set up a metadata repository dependency chain.

New Basic Properties Pane

When you click an object such as a table, a transformation, or a job, a list of the main properties for the object is displayed in the Basic Properties pane in the bottom-left corner of the SAS Data Integration Studio desktop. You can turn this feature on and off with the View menu.

Security Enhancements

SAS Data Integration Studio can use the following new security features from the 9.2 Server platform:

Teradata Loader Transformation

The Teradata Table Loader transformation can be added to a process flow when a Teradata table is used as a target. This transformation has a unique Load Technique tab that provides different load options depending on whether the source table is in the same Teradata database as the target table. The Teradata Table Loader transformation also supports the pushdown feature that enables you to process relational database tables directly on the appropriate relational database server.

Restart Jobs from Checkpoints

The restart feature enables you to restart a job at the beginning of a step (transformation) when a job previously failed at that step or a subsequent step. The code for the steps preceding the checkpoint is skipped, and the state is restored from the save-state information that is preserved by the checkpoint code. Then, processing can pick up from the specified transformation.

Push Job Code down to a Database

When both the inputs and outputs of the Extract, SQL Join, Teradata Table Loader, and Table Loader transformations are stored in the same relational database, the code for these transformations can be pushed down to a database server for execution. This option increases performance by shifting data transformation to the most appropriate processing resource.

Specify Table Options

To display most table options, display the properties window for a table and select the new Options tab. The options that are available vary according to the data format of the tables (SAS or DBMS). You can specify table options for the inputs and outputs of most transformations on the new Table Options tab of the properties window for the transformation. The options that are available vary according to the data format of the tables (SAS or DBMS) and whether the table is an input or an output.

Redirect Temporary Output Tables

Transformations in a job typically create temporary work tables as they execute. The default location for these temporary tables is the SAS WORK library. You can now easily redirect these temporary tables to an alternative location, including a DBMS. Redirecting this output can improve performance, support the restart of jobs from a checkpoint, and support the pushdown of work to a third-party database.

Register Netezza and Neoview Tables

You can register Netezza and Neoview tables and include them in SAS Data Integration Studio jobs.

Convert SAS Programs into SAS Data Integration Studio Jobs

The Import SAS Code wizard enables you to analyze a SAS program and to automatically create a SAS Data Integration Studio job that performs the same tasks as the program.

Forecasting Transformation is Available Again

You can use the Forecasting transformation to run the High-Performance Forecasting procedure (PROC HPF) against a warehouse data store. PROC HPF provides a quick and automatic way to generate forecasts for many sets of time-series data or transactional data. The procedure can forecast millions of series at a time, with the series organized into separate variables or across BY groups. The Forecasting transformation provides a simple interface for entering values for various options that are associated with PROC HPF.

Summary of Changes to the Interface

Changes to the interface for SAS Data Integration Studio versions 4.2 and 4.21 include the following:

Trees The Custom tree is replaced by the Folders tab. The Process Library tree is replaced by the Transformations tab. The Quick Properties pane is now called the Basic Properties pane. The Metadata tree is no longer available.
File Menu The File menu includes a New submenu which enables you to register new tables, jobs, and other objects; a Register Tables submenu which enables you to register existing tables; an Import submenu that includes a new Import SAS Code option; and a Connection Profile option (formerly called Metadata Profile).
Edit Menu The Edit menu includes a new Connections option, which displays the Connections window. Use the Connections window to manage the input and output connections for tables or transformations in the Diagram tab of the Job Editor window.
View Menu The View menu now contains Control Order, Layout, Zoom, and Grid options that are specific to jobs. The Comparison Results option is moved to the Tools menu. The View Libname option is moved to the Actions menu.
Check Outs Menu The Check Outs menu replaces the Project menu. The Fetch option is no longer available. For more information, see the change management topic in the user's guide or the online Help.
Actions Menu The Actions menu includes many new features that are mostly related to jobs. For more information, see the section about creating jobs in the user's guide or the online Help.
Debug Menu The Debug menu is new. For more information, see the section about managing jobs in the user's guide or the online Help.
Tools Menu

The Tools menu has a number of changes.The Source Designer option is now Register Tables on the File menu. The Target Designer option is now available by selecting File [arrow] New [arrow] Table. The Transformation Generator option is now available by selecting File [arrow] New [arrow] Transformation. The Update Table Metadata option is now available by selecting Actions [arrow] Update Metadata. The Process Designer option is much simplified and is available by selecting File [arrow] New [arrow] Job. The following options are no longer available: Advanced Aggregation Tuning, Calculated Members, Import Cube, Transformation Importer, Configure Status Handling.

For more information and about the main menus and windows, see the topics under "Windows and Other Components" in the table of contents in the online Help.