SUPPORT / SAMPLES & SAS NOTES
 

Support

Problem Note 19028: Truncation errors might occur when using Unicode SAS with UTF-8 encoding to process 8-bit characters

DetailsHotfixAboutRate It

When you use Unicode SAS with UTF-8 encoding to process an external file that contains 8-bit characters, the following error message might appear:

   ERROR: Truncation occurred.
   FATAL: Unrecoverable I/O error detected in the execution of the data
   step program.  Aborted during the EXECUTION phase

Unicode SAS with UTF-8 encoding uses 1 to 4 bytes to handle Unicode data. It is possible for the 8-bit characters to be expanded by 2 to 3 bytes when transcoding occurs, which causes the truncation error.

You might not see these error messages with English SAS because the limitation is unique to Unicode SAS.

There is no workaround for this issue.

To avoid getting this error, do not use an external file that contains 8-bit characters.

Operating System and Release Information

Product FamilyProductSystemSAS Release
ReportedFixed*
SAS SystemBase SASMicrosoft® Windows® for 64-Bit Itanium-based Systems9.1 TS1M3 SP49.2 TS1M0
Microsoft Windows Server 2003 Datacenter 64-bit Edition9.1 TS1M3 SP49.2 TS1M0
Microsoft Windows Server 2003 Enterprise 64-bit Edition9.1 TS1M3 SP49.2 TS1M0
Microsoft Windows XP 64-bit Edition9.1 TS1M3 SP49.2 TS1M0
Microsoft® Windows® for x649.1 TS1M3 SP49.2 TS1M0
Microsoft Windows 2000 Advanced Server9.1 TS1M3 SP4
Microsoft Windows 2000 Datacenter Server9.1 TS1M3 SP4
Microsoft Windows 2000 Server9.1 TS1M3 SP4
Microsoft Windows 2000 Professional9.1 TS1M3 SP4
Microsoft Windows NT Workstation9.1 TS1M3 SP4
Microsoft Windows Server 2003 Datacenter Edition9.1 TS1M3 SP49.2 TS1M0
Windows Vista9.1 TS1M3 SP49.2 TS1M0
64-bit Enabled AIX9.1 TS1M3 SP49.2 TS1M0
64-bit Enabled HP-UX9.1 TS1M3 SP49.2 TS1M0
64-bit Enabled Solaris9.1 TS1M3 SP49.2 TS1M0
HP-UX IPF9.1 TS1M3 SP49.2 TS1M0
Linux on Itanium9.1 TS1M3 SP49.2 TS1M0
OpenVMS Alpha9.1 TS1M3 SP49.2 TS1M0
Linux9.1 TS1M3 SP49.2 TS1M0
Microsoft Windows XP Professional9.1 TS1M3 SP49.2 TS1M0
Microsoft Windows Server 2003 Standard Edition9.1 TS1M3 SP49.2 TS1M0
Microsoft Windows Server 2003 Enterprise Edition9.1 TS1M3 SP49.2 TS1M0
z/OS9.1 TS1M3 SP49.2 TS1M0
Solaris for x649.1 TS1M3 SP49.2 TS1M0
Tru64 UNIX9.1 TS1M3 SP49.2 TS1M0
* For software releases that are not yet generally available, the Fixed Release is the software release in which the problem is planned to be fixed.