What's New in DataFlux Data Management Studio 2.7.1

Overview

This update to DataFlux Data Management Studio 2.7.1 includes the following enhancements:

The main enhancements for DataFlux Data Management Studio 2.7 include the following:

Updates for 2.7.1 and Later

Updates to the Supported Databases for Data Storage

The supported databases for data storage have been updated. For more information, see Supported Databases for Data Storage.

Updates to the Supported Databases for DataFlux Repositories

The supported databases for DataFlux repositories have been updated. For more information, see Storage Methods for Repositories.

Enhancements for Customizing Quality Knowledge Bases

A Quality Knowledge Base (QKB) is a collection of files that store data and logic that define data management operations. SAS software products reference a QKB when performing these operations on your data. You can use DataFlux Data Management Studio to customize a QKB by modifying definitions or creating new definitions for use with your own business data.

You can now copy and paste regular expressions in the Regex Library Editor.

You can now import word, category, and likelihood values from external files in the Vocabulary Editor.

You can now copy and paste rules and categories in the Grammar Editor.

The Familiar Phrase Scheme node in Identification Analysis QKB definitions has been updated. A new property, Scheme lookup is based on, enables you to select whether the scheme is applied to substrings within the input or the full phrase.

Preprocessing regular expression nodes can now be added to Match definitions. Preprocessing Regex Library nodes enable you to use a set of regular expressions to remove or change parts of a string before the string is input to a preprocessing scheme. These nodes can be used to remove diacritics and to manage punctuation, for example. By applying such transformations, you can prepare a string for further processing by subsequent nodes.

Postprocessing regular expression nodes can now be added to Standardization definitions. A Postprocessing Regex Library node enables you to use a set of regular expressions to remove or change parts of a string. These nodes can be used to make final desired transformations that were not performed by previous nodes.

Ability to Log On to a SAS Metadata Server

You must log on to a SAS Metadata Server when you need to access DataFlux Data Management Servers or SAS Federation Servers. These servers must be registered on the metadata server that you select for log on. Note that you can still access a local repository in DataFlux Data Management Studio without logging on to a SAS Metadata Server

DataFlux Data Management Studio still accesses data from data connections defined on the Data riser.

Addition of Netezza as a Supported Database for Data Storage

Netezza 7.2.0.5 has been added to the list of supported databases for data storage in DataFlux Data Management Studio. However, Netezza cannot be used to store a DataFlux repository. Also, note that the Netezza driver is not a Data Direct driver. It must be downloaded from the Netezza site.

DataFlux Data Management Studio 2.7.1 and Later

The following hot fix appears in DataFlux Data Management 2.7.1 and later.

Loqate Node

NOTE: As of July 31, 2023, SAS no longer supports or provides updates for the following data packs:

Users that want to perform US/Canada address verification and geocode jobs, must migrate to the Loqate data packs listed below, prior to July 31, 2023.

After July 31, 2023, the DataFlux Data Management Studio jobs that rely on the discontinued data packs fail and license errors appear. See the DataFlux Data Management Studio and Server 2.9.1: Migration Guide for Data Packs on the SAS Learn & Support DataFlux Data Management Server Documentation page for information about updating to Loqate.

Enrichment Node

Support for USPS, SERP, and Geocoding Data Packs ended July 31, 2023. Jobs should be migrated to the Loqate data packs.

The following Enrichment node options have been removed from DataFlux Data Management Studio: