Problem Note 69753: The dataDiscovery.profile CAS action returns incorrect results for the actual type on some datetime strings
The dataDiscovery.profile CAS action is capable of identifying the actual type of data that is stored in a string field. The logic identifies string fields as one of the following actual types that are based on the contents of the string:
- date
- Boolean
- integer
- real
- generic string
The logic to identify strings as the actual type date correctly handles up to four digits of precision in the millisecond field. However, it is possible for there to be more than four digits of precision in a datetime string. The results are unpredictable when the milliseconds portion of the datetime string contains more than four digits of precision. Datetime strings that contain more than four digits of precision in the milliseconds portion might be identified as either a generic string or as a date. The expected classification is the actual type date for any string that can be recognized as a date. As a result, incorrect output is returned in the dataDiscovery.profile CAS action result set. The incorrect results might also occur in the profile report in SAS Data Explorer.
Workaround
To circumvent the issue, you can format dates with four or fewer digits of precision in the milliseconds portion of the datetime string.
Click the Hot Fix tab in this note for a link to instructions about accessing and applying the software update.
Operating System and Release Information
SAS System | SAS Viya | Microsoft Windows Server 2012 R2 Datacenter | 3.5 | Stable 2022.11 | Viya | Viya |
Microsoft Windows Server 2016 | 3.5 | Stable 2022.11 | Viya | Viya |
Microsoft Windows Server 2019 | 3.5 | Stable 2022.11 | Viya | Viya |
Linux for x64 | 3.5 | Stable 2022.11 | Viya | Viya |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
The dataDiscovery.profile CAS action can incorrectly identify some datetime strings as actual type string instead of actual type date
Type: | Problem Note |
Priority: | high |
Date Modified: | 2023-01-12 09:08:54 |
Date Created: | 2022-12-12 09:01:15 |