Working with Duplicate-Data Checking Macros

About Working with Duplicate-Data Checking Macros

If you are using a test environment and staging new data for a new data source for the first time, you might not want to implement duplicate-data checking macros. To do so, on the Duplicate Checking page of the Staging Parameters tab of the staging transformation, set the Enable duplicate checking field to No. This setting provides more flexibility as you process different types of sample files. When you are satisfied with the results of your tests, you can purge the IT data mart. You can also choose whether to implement duplicate-data checking by specifying parameters in the staging transformation.
Note: If you edit the generated source code to modify the mode for duplicate-data checking, then your changes to the code are lost if the job is regenerated or redeployed. Although you can save the functionality of the source code to the local file system, the original source code is preserved. In addition, the mode for duplicate-data checking is not updated in the SAS Metadata Repository entries.