DataFlux Data Management Studio 2.5: User Guide

Data Validation Node

You can add a Data Validation node to a data job to analyze the content of data by setting validation conditions. These conditions create validation expressions that you can use to filter data for a more accurate view of that data. The Data Validation node uses the expression language. You can use this language for single and multiple values, single and multiple conditions, and to compare fields. Based on the Boolean result of the expression, the node flags the record or removes it from the output.

Once you have added the node, you can double-click it to open its properties dialog. The properties dialog includes the following elements:

Name - Enables you to enter a name for the node.

Notes - Enables you to open the Notes dialog. You use the dialog to enter optional details or any other relevant information for the input.

The Audit conditions section of the dialog includes the following elements:

Field - When selected, specifies the field name to use in auditing your data using the audit expression.

Operation - When selected, specifies the operation to use to audit your data using the audit expression.

Single/Multiple/Field Value - When selected, specifies one of the following values to use in conjunction with the field name and the operator:

• If you select Single, type a single value in the adjacent field.
• If you select Multiple, click Select to open the Value List and create a list of values.
• If you select Field, select a field from the drop-down list. You can also select check boxes to specify that the field is case insensitive and process wildcards.

Expression - Enables you to enter an expression to use in data validation. You can select View code to review the code in the Expression field and click Edit to modify code. You can also add functions and fields to the expression in the Edit Expression dialog. You can save the expression or insert code from an existing expression file.

Add Condition - Enables you to add the condition you created with Field Name, Operation, and Value to the Expression list. You can use the buttons below the Expression field to refine the condition.

The Audit action section of the dialog includes the following elements:

Row validation - Enables you to specify a pass or fail row condition.

Action - Enables you to specify an action for a selected row condition. When you select Flag row, you can specify a Flag name and a Flag value in the adjoining fields.

You can access the following advanced properties by right-clicking the Data Validation node:

• Action
• Action_Cond
• Action_Name
• Action_Value
• Action_Value_Type
• Conditions
• Manual_Expr
• Manual_Flag