Setting Options for Parallel Processing

Problem

You want to use parallel processing and grid processing in SAS Data Integration Studio jobs.

Solution

If you need to enable parallel or grid processing for all jobs, then set global options on the Code Generation tab of the Options window for SAS Data Integration Studio. If you need to enable parallel or grid processing for a single iterative job, then set the options that are available on the Loop Options tab of the properties window for the Loop transformation.

Tasks

The following tables describe how to set options for parallel processing and grid processing in SAS Data Integration Studio jobs.
Global Options (affects all new jobs)
Option
Purpose
Task
Enable parallel processing macros for new jobs
Adds parallel processing macros to the code that is generated for all new jobs.
Select Toolsthen selectOptions from the menu bar. Click the Code Generation tab. Specify the desired option.
Grid options set specification
Enables you to specify a collection of grid options, SAS options, and required resources that are associated with a particular SAS client application. A grid options set enables a SAS grid administrator to define a collection of options in SAS metadata that map to one or more SAS client applications. These options are automatically applied to workload submitted to the grid based on the identity of the user accessing the client application.
Select Toolsthen selectOptions from the menu bar. Click the SAS Server tab or the Code Generation tab. Specify the desired option.
Workload specification
Enables you to select a default workload specification value for the selected server. The grid workload specification consists of a string value based on the grid server definition setup in SAS Management Console.
Select Toolsthen selectOptions from the menu bar. Click the SAS Server tab or the Code Generation tab. Specify the desired option.
Signon options
Specifies options that users can set when the sign-on is performed to the grid server during the submit to grid method of executing. Some examples of sign-on options are cmacvar, connectremote, connectstatus, inheritlib, and tbufsize.
Select Toolsthen selectOptions from the menu bar. Click the SAS Server tab. Specify the desired option.
Number of signon retries
Specifies the number of times to retry the sign-on to a grid server if a failure occurs.
Select Toolsthen selectOptions from the menu bar. Click the SAS Server tab. Specify the desired option.
Default maximum number of concurrent processes
Sets the number of concurrent processes to one process for each available CPU node for all new jobs. Generally, this is the most effective setting. Select from One process for each available CPU node, Use this number, or Run all processes concurrently.
Select Toolsthen selectOptions from the menu bar. Click the Code Generation tab. Specify the desired option.
Local Options (affects the current job or transformation)
Option
Purpose
Task
Enable parallel processing macros
When YES is selected, this option adds parallel processing macros to the code that is generated for the current job.
Parallel processing macros are always included in the code that is generated for a Loop transformation.
Click the Options tab in the properties window for the job. Select YES or NO in the field for this option.
Grid options set specification
Enables you to specify a collection of grid options, SAS options, and required resources that are associated with a particular SAS client application. A grid options set enables a SAS grid administrator to define a collection of options in SAS metadata that map to one or more SAS client applications. These options are automatically applied to workload submitted to the grid based on the identity of the user accessing the client application.
Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Workload specification
Enables you to select a default workload specification value for the selected server. The grid workload specification consists of a string value based on the grid server definition setup in SAS Management Console.
Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Wait for all processes to complete before continuing
Specifies that the application server waits for all iterations to complete before continuing with the job workflow.
Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Maximum number of concurrent processes
Sets the number of concurrent processes to one process for each available CPU node for all new jobs. Generally, this is the most effective setting. Select from One process for each available CPU node, Use this number, or Run all processes concurrently.
Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.
Grid supported job options
Enables you to define the name and value option pairs for the Grid Supported Job Options (JOBOPTS=) parameter.
Click the Loop Options tab in the properties window for the Loop transformation. Specify the desired option.