Selecting Files to Process

You need to determine the type of data to process. This selection determines the clickstream template job that you need to use as a basis for processing the data. For information about template selection, see Data Source Preparation.

Once you have determined the files to process, collect them in suitable locations such as a high-performing disk or a network location that optimizes performance. Once you have collected the files, you can enter their locations into the LOG_PATHS table. This table provides input to the Directory Contents transformation for the template jobs. Note that you can use wildcard filtering and directory recursion on the Directory Contents Options tab. After you change the settings, run the Directory Contents transformation only and view the output table to ensure that you have selected the desired set of files. The following display shows the LOG_PATHS table and Directory Contents transformation: