In SAS Text Miner, contractions like "can't" are not detected as a single term even when they are added in the Multi-word Terms table in the Text Parsing node.

Example:

• 14.1 and later: "can't" is split into "can" and "not"
• prior to 14.1: "can't" is split into "can" and "n't"

To avoid this split, follow these steps:

1. Scan the input text with a SAS® character function, and convert the contraction to separate words throughout the text. Perform this step before using the data set in SAS Text Miner.

   Example: this example code demonstrates using the TRANWORD() character function to convert "can't" to "can not" throughout the text:

   data contraction_text_replace_ds; set contraction_text_ds; txt_col=tranwrd(txt_col, "can't", "can not"); run;

2. In the Text Parsing node, add the new word-pair to the Multi-word Terms table. Specify a blank role.

   Example: add "can not".

   

3. Run the Text Parsing node again.

Operating System and Release Information