DataFlux Data Management Studio

Exclusive Real Time Clustering Node

You can add an Exclusive Real Time Clustering node to a data job to facilitate near real-time addition of new rows to previously clustered data. Once you have added the node, you can double-click it to open its properties dialog. The properties dialog includes the following elements:

Name - Specifies a name for the node.

Notes - Enables you to open the Notes dialog. You use the dialog to enter optional details or any other relevant information for the input.

Output Cluster ID Field - Enables you to enter a name prefix for collapsed cluster ID fields. If no name is set, this information will not be available on output.

Options - Displays the Options dialog. The dialog includes the following elements:

• Treat blank field values as nulls - When selected, prevents blank field values from being clustered together.
• Do not cluster field - Specifies the name of a field that contains the do not cluster flag. This field should be defined as an integer data type in your data source. If this value in this field is 1, the row will not be clustered with other records having the same clustering criteria. If the value in this field is 0 or Null, the row will be included in the cluster.
• Condition matched field prefix - Specifies a prefix for condition-match fields.

Collapsed Cluster ID Field Prefix - Enables you to enter a name prefix for collapsed cluster ID fields. If no name is set, this information will not be available on output.

Override Clustering Memory Size - When selected, enables you to override the default clustering memory size to set the amount of RAM to use.

The State file section of the dialog includes the following elements:

Backup Path - Enables you to specify a backup path. You can click Browse to navigate to the path.

Backup Prefix - Specifies a prefix to be used when generating state file backups. When initializing the new RTC, you can supply the same prefix (after the path to the state backup files.)

Backup Frequency - Specifies the frequency of backups. When this value is set to 0, backup is done at shutdown only.

Save old State Files - When selected, specifies that old state backup files should not be deleted after the latest state is successfully saved.  

The Conditions section of the dialog includes the following elements:

Available - Displays the fields that you can make available for the next step in your data job. Items displayed in this list are dependent on your data sources and any preceding steps in your data job.

Selected - Displays the fields that will be made available to the next node in your data job. You can click OR to add an OR condition the bottom of the Selected Fields list.

Additional Outputs - Displays the Additional Outputs dialog. This dialog enables you to specify the fields that you can make available to the next node in your data job.

You can access the following advanced properties by right-clicking the Exclusive Real Time Clustering node:

• BACKUPNUMROWS
• BLANKISNULL
• CONDITIONS
• DELAYMEMALLOC
• DONTCLUSTFLD
• FIELD_MAP
• GROUPNULLS
• MEMSIZE
• OUTCOLLAPSEDID
• OUTMATCHCOND
• OUTPUTNAME
• READONLY
• SAVEOLDSTATE
• STATEFILE