TRUNCATED is a Boolean flag indicating whether the text content of a document file was truncated when creating the SAS data set. The value is set to 0 when the document text is not truncated, and 1 when the document text is truncated.

If TMFILTER identifies a file as truncated, then all additional files TMFILTER processes will be incorrectly flagged as TRUNCATED, even if the complete data was read.

Use the value of the SIZE variable in the SAS data set to determine whether the text data was truncated. SIZE correctly identifies the number of bytes in the file. If SIZE is greater than the value you set for the NUMCHARS or NUMBYTES parameter in TMFILTER, then your document was truncated.

Even if TRUNCATED was set to 1 incorrectly, the data was still processed correctly. The error is only in the setting of the indicator variable value.

Select the Hot Fix tab in this note to access the hot fix for this issue.

Operating System and Release Information

A fix for this issue for SAS Text Miner 3.2 is available at:

A fix for this issue for SAS Enterprise Miner Desktop/Classroom 5.3 is available at: