Problem Note 64067: The DataFlux® Expression Engine returns no tokens or incorrect tokens to SAS® Event Stream Processing when the DQ.PARSE function is used
When you use SAS® Quality Knowledge Base (QKB) with the DataFlux Expression Engine in a SAS Event Stream Processing compute window, the DQ.PARSE function returns either no tokens or incorrect tokens for specified parse definitions.
This issue affects different QKB releases, ranging from QKB 23 to QKB 30.
When you use QKB 23, the DQ.PARSE function always returns the following tokens:
- token #1 = Street Number
- token #2 = Pre-direction
- token #3 = Street Name
- token #4 = Street Type
- token #5 = Post-direction
- token #6 = Address Extension
When you use QKB 27, the DataFlux Expression Engine returns an error that is similar to the following:
Get token name (-1866467305: Invalid token index in Parse definition 'City - State/Province - Postal Code': 3)
When you use QKB 30, the tokens that are returned by the DQ.PARSE function always resemble those for the parse definition "Address":
- token #1 = Recipient
- token #2 = Building/Site
- token #3 = Street
- token #4 = Extension
- token #5 = PO Box
- token #6 = Additional Info
Note: In DataFlux Expression Language 2.5, the DataFlux Expression Engine Language Blue Fusion functions were renamed as Data Quality functions for DataFlux Expression Language 2.7. The parse function mentioned above in DataFlux Expression Language 2.7 is defined as DQ.PARSE, while in DataFlux Expression Language 2.5, it is defined as BF.PARSE. These functions are similar.
Click the Hot Fix tab in this note for a link to instructions about accessing and applying the software update.
For more information about the DataFlux Expression Language, see Expression Language 2.7: Reference Guide.
For more information about the DQ.PARSE function, see the "Data Quality Functions" section of Expression Language 2.7: Reference Guide.
Operating System and Release Information
SAS System | SAS Event Stream Processing Engine | Linux for x64 | 5.2 | 6.1 | | |
Microsoft® Windows® for x64 | 5.2 | 6.1 | | |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
When you use SAS® Quality Knowledge Base (QKB) with the DataFlux Expression Engine in a SAS Event Stream Processing compute window, the DQ.PARSE function returns no tokens or incorrect tokens for specified parse definitions.
Type: | Problem Note |
Priority: | medium |
Date Modified: | 2019-05-02 10:36:57 |
Date Created: | 2019-04-19 15:06:05 |