Setting Options for Parallel Processing :: SAS® Data Integration Studio 4.902: User's Guide

Problem

You want to use parallel processing and grid processing in SAS Data Integration Studio jobs.

Solution

If you need to enable parallel or grid processing for all jobs, then set global options on the Code Generation tab of the Options window for SAS Data Integration Studio. If you need to enable parallel or grid processing for a single iterative job, then set the options that are available on the Loop Options tab of the properties window for the Loop transformation.

Tasks

The following tables describe how to set options for parallel processing and grid processing in SAS Data Integration Studio jobs.

Global Options (affects all new jobs)
Option	Purpose	Task
Enable parallel processing macros for new jobs	Adds parallel processing macros to the code that is generated for all new jobs.	Select ToolsOptions from the menu bar. Click the Code Generation tab. Specify the desired option.
Grid options set specification	Enables you to specify a collection of grid options, SAS options, and required resources that are associated with a particular SAS client application. A grid options set enables a SAS grid administrator to define a collection of options in SAS metadata that map to one or more SAS client applications. These options are automatically applied to workload submitted to the grid based on the identity of the user accessing the client application.	Select ToolsOptions from the menu bar. Click the SAS Server tab or the Code Generation tab. Specify the desired option.
Workload specification	Enables you to select a default workload specification value for the selected server. The grid workload specification consists of a string value based on the grid server definition setup in SAS Management Console.	Select ToolsOptions from the menu bar. Click the SAS Server tab or the Code Generation tab. Specify the desired option.
Signon options	Specifies options that users can set when the sign-on is performed to the grid server during the submit to grid method of executing. Some examples of sign-on options are cmacvar, connectremote, connectstatus, inheritlib, and tbufsize.	Select ToolsOptions from the menu bar. Click the SAS Server tab. Specify the desired option.
Number of signon retries	Specifies the number of times to retry the sign-on to a grid server if a failure occurs.	Select ToolsOptions from the menu bar. Click the SAS Server tab. Specify the desired option.
Default maximum number of concurrent processes	Sets the number of concurrent processes to one process for each available CPU node for all new jobs. Generally, this is the most effective setting. Select from One process for each available CPU node, Use this number, or Run all processes concurrently.	Select ToolsOptions from the menu bar. Click the Code Generation tab. Specify the desired option.

Local Options (affects the current job or transformation)
Option	Purpose	Task
Enable parallel processing macros	When YES is selected, this option adds parallel processing macros to the code that is generated for the current job. Parallel processing macros are always included in the code that is generated for a Loop transformation.	Click the Options tab in the properties window for the job. Select YES or NO in the field for this option.
Grid options set specification	Enables you to specify a collection of grid options, SAS options, and required resources that are associated with a particular SAS client application. A grid options set enables a SAS grid administrator to define a collection of options in SAS metadata that map to one or more SAS client applications. These options are automatically applied to workload submitted to the grid based on the identity of the user accessing the client application.	Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Workload specification	Enables you to select a default workload specification value for the selected server. The grid workload specification consists of a string value based on the grid server definition setup in SAS Management Console.	Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Wait for all processes to complete before continuing	Specifies that the application server waits for all iterations to complete before continuing with the job workflow.	Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Maximum number of concurrent processes	Sets the number of concurrent processes to one process for each available CPU node for all new jobs. Generally, this is the most effective setting. Select from One process for each available CPU node, Use this number, or Run all processes concurrently.	Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Grid supported job options	Enables you to define the name and value option pairs for the Grid Supported Job Options (JOBOPTS=) parameter.	Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.