DataFlux Data Management Studio 2.7: User Guide

Displaying Run-Time Statistics in SAS Job Monitor

Overview of SAS Job Monitor

If your site has licensed SAS^® Environment Manager and SAS^® Job Monitor, then you can use a web browser to display run-time statistics for DataFlux Data Management Studio jobs and the nodes within those jobs.

SAS Environment Manager is a web-based monitoring solution for a SAS environment. SAS Job Monitor is an optional component of SAS Environment Manager. It reads job logs at specified locations and displays run-time statistics from the logs. If you can access the SAS Environment Manager, then you can select Analyze > SAS Job Monitor to display run-time statistics for DataFlux Data Management Studio data jobs and process jobs.

Prerequisites for Run-Time Statistics in SAS Job Monitor

You cannot use SAS Job Monitor to display run-time statistics for jobs that are executed interactively in DataFlux Data Management Studio. DataFlux Data Management Studio does not generate a unique log for each job.

The jobs must be executed with the dmpexec command or with a DataFlux Data Management Server. For more information about the dmpexec command, see Run a Job Whose Run-Time Statistics Will Be Displayed in SAS Job Monitor. For more information about the server, see Deploying Jobs for Execution on a Data Management Server.

Job statistics are collected from the job log files that are generated by the Monitor logger on the DataFlux Data Management Server. The Monitor logger is active and configured by default. For more information about job statistics and the data management server, see the "Collect Job Status Information with the SAS Job Monitor" topic in the DataFlux Data Management Server: Administrator's Guide.

SAS Job Monitor must be configured to access the logs for DataFlux Data Management Server. For more information, see the following topics in the Help for SAS Job Monitor:

• "Adding Servers for Job Monitoring"
• "Configuring a Server"
• "DataFlux Data Management Server"

The agent for SAS Job Monitor expects the log files to be written in UTF-8. If the log file is written in a different encoding, SAS Job Monitor might not be able to read the log correctly unless you change some default options. These options are described in the topic "DataFlux Data Management Server" in the Help for SAS Job Monitor. For example, suppose that you execute a job on a server, and the server's locale setting results in a job log that is not in UTF-8. You might need to update some default options for SAS Job Monitor, or it might not be able to read the log. This situation is most likely to occur for locales that do not use the Western European encoding.

Usage Notes for Run-Time Statistics in SAS Job Monitor

By default, job node statistics are logged once per job run: when the job has finished executing. If you want to log node statistics while the job is running, then you must change the value for the BASE/MONITOR_FREQUENCY option in the app.cfg file. For more information about this option, see "Configuration Options" in the DataFlux Data Management Studio Installation and Configuration Guide.

If you update the BASE/MONITOR_FREQUENCY option so that performance statistics are taken a regular intervals, be aware that different nodes might be executing during different intervals. The log will contain statistics only for those nodes that executed during a given interval.

The log does not capture run-time statistics for embedded process job nodes. It captures run-time statistics for embedded data job nodes.

The log will not reliably capture the number of times a node was executed in a loop. This is because the iteration rate might be faster than the interval between snapshots, as specified in the BASE/MONITOR_FREQUENCY option.