General Prerequisites for Data Quality Transformations

DataFlux Software

Transformations in the Data Quality folder require either SAS Data Quality Server or DataFlux Data Management Platform. These products are included with SAS enterprise software offerings such as SAS Data Management and SAS Data Integration Server. For more information about configuring DataFlux software for use with SAS Data Integration Studio, see the SAS Data Integration Studio chapter of the SAS Intelligence Platform: Desktop Administration Guide.

Review the DataFlux components that are described in Overview. Identify the components that you want to use in SAS Data Integration Studio, and then configure or create these components. For example, if you want to use a DataFlux standardization scheme in a SAS Data Integration Studio job, you must create the scheme in DataFlux software. For more information, see the DataFlux documentation such as the DataFlux Data Management Studio User’s Guide.

Note: With the exception of the DataFlux Batch Job transformation, which can be used to execute DataFlux dfPower Studio Architect jobs that do not contain macros, the current version of SAS Data Integration Studio works only with the DataFlux Data Management Platform. Other DataFlux dfPower Studio objects must be migrated to the DataFlux Data Management Platform. For more information, see the DataFlux Migration Guide.

Global Options on the Data Quality Tab

After the DataFlux resources have been configured or created, you can specify some global data quality options in SAS Data Integration Studio. SelectTools

Options to display the Options window, and then click the Data Quality tab. The next figure shows some typical values in this tab.

Data Quality Tab

Paths specified in the Data Quality group box are relative to the current SAS Application Server. The group box contains the following items:

Default Locale

specifies the locale that is referenced by SAS data quality jobs when a different locale is not specified in those jobs. The default value is Use the value defined on the server. The default uses the value of the SAS system option DQLOCALE, which is set on the SAS Application Server that executes SAS data quality jobs.

In a standard deployment, the SAS Application Server is not configured to use any specific locale. There are three main ways to set the locale. You can configure the DQLOCALE option on the SAS Application Server that executes SAS data quality jobs. You can select a locale in the Default Locale field above. Also, you can select a locale for an individual data quality transformation in a SAS Data Integration Studio job.

DQ Setup Location

specifies the location of a DataFlux Quality Knowledge Base (QKB). In a standard deployment, the SAS Application Server is configured to use the sample QKB that is provided by SAS Data Quality Server. The sample QKB is typically located at the following path: C:\Program Files\SASHome\SASFoundation\[release_number] \dquality\sasmisc\QltyKB\sample

There are two main ways to set the QKB. You can configure the DQSETUPLOC option on the SAS Application Server that executes SAS data quality jobs. You can also select a QKB in the DQ Setup Location field above.

If you change the global DQ Setup Location, you have the option to apply the new location to data quality transformations in existing jobs. To apply the global DQ Setup Location to a transformation, click the Reset DQ Setup Location button in the appropriate tab, such as the Standardization tab for the Apply Lookup Standardization transformation. The following data quality transformations support this option: Apply Lookup Standardization transformations, Standardize with Definition transformations, and Create Match Codes transformations.

Scheme Repository Type

specifies that the scheme data sets in the specified scheme repository are stored in SAS format (option value NOBFD) or in DataFlux format (option value BFD, the default). The Apply Lookup Standardization transformation uses schemes to standardize data.

Scheme Repository

specifies the location of the scheme data sets that are used by the Apply Lookup Standardization transformation. To display scheme filenames in the transformation, specify:

QKB-root/scheme

To display scheme descriptions in the transformation, specify:

QKB-root

QKB-root is the directory that was specified when the Quality Knowledge Base was installed. QKB-root contains approximately nine subdirectories, with names such as regex, locale, and scheme.

Paths that are specified in the DataFlux Data Management Platform Tools group box are relative to the SAS Data Integration Studio application. This group box contains the following item:

DataFlux Installation Folder

specifies the folder where DataFlux Data Management Studio is installed. Under the 64-bit version of Windows, the default path is

C:\Program
                                 Files (x86)\DataFlux\DMStudio\instance_name

. Use the keyboard, drop-down list, or the Browse button to specify a different installation folder.

If you specify the path to DataFlux Data Management Studio and click OK to save your changes, the next time you start SAS Data Integration Studio, you can run DataFlux Data Management Studio by selecting Tools

DataFlux Data Management Platform Tools

Data Management Studio.