Overview of Creating Reports Using a Performance Task

Creating Reports Using a Performance Task

You define and execute a performance task for a SAS Model Manager project. The model that you monitor is either the project champion model or a challenger model that is flagged in any version for the project. The process of creating performance reports is a two-step process. First, you run the Define Performance Task wizard to generate the code that creates the performance data results. Then, you execute the generated code. You can execute the code immediately, or you can schedule a date and time at which the task is to run. Information about performance tasks is recorded and can be viewed in the Performance Monitor Job History tab. SAS Model Manager stores the output data in the Resources folder of the default version. To view the performance data results, you select the Performance node in the champion model’s version.

To create performance reports in SAS Model Manager, follow this process:

Ensure that one or more performance data sources are registered using SAS Management Console or that a libref has been defined for the location where the performance data sets are stored.
Ensure that all prerequisites have been completed.
Run the Define Performance Task wizard to generate the SAS code that creates the performance reports.
Execute the generated code or schedule when the generated code is to be executed.
To view the reports, select the Performance node in the champion model’s version.

Determine How to Use the Performance Data Sets

Before you run the Define Performance Task wizard, the performance data sets must be registered in the SAS Metadata Repository by using SAS Management Console or a libref must be defined in SAS Model Manager for the library that contains the performance data sets. For each SAS Model Manager project, you can set up your environment to use the performance data source that is most appropriate for your business process. Here are two methods of collecting performance data:

Method 1: You periodically take a snapshot of an operational data set to create a performance data set. Each time you take a snapshot, you give the performance data set a new name. Each performance data set must be registered in SAS Management Console or stored in a library that has a libref that has been defined in SAS Model Manager. You can create and execute a performance monitoring task each time you take a snapshot, or you can create a performance monitoring task to execute multiple performance data sets in the same task.
Method 2: You take a snapshot of the operational data set to create a performance data set over time, and you reuse the same name for each performance data set every time you take a snapshot. You register the performance data set with SAS Management Console only once. Each time you take a snapshot, you replace the performance data set at the location where the performance data set is registered in SAS Management Console or in the SAS library that you defined for performance data sets.

When you run the Define Performance Task wizard, the name of the performance data source does not change. Because you used the performance data source static name as the Default Performance Table in the project properties, the Data Source column of the Performance Data Options table in the wizard is completed by SAS Model Manager. You modify only the Collection Date and Report Label columns in the table.

The following table summarizes the tasks that are performed if performance reports are run after six months or for reports that are run every month. Use this task and example table to help you determine how you want to name your performance data sets and your SAS Model Manager performance data sources.

Task	Method 1: The Performance Data Set Name Changes	Method 2: The Performance Data Set Name Remains Static
Create a performance data set from model output data	Each month, take a snapshot of the operational data and create a performance data set with a different name: Jul13 Aug13 Sep13 Oct13 Nov13 Dec13	Every month, take a snapshot of the operational data and name the performance data set using the same name: 2013perf
If you are registering the performance data sets in the SAS Metadata Repository, register the performance data sets using the SAS Management Console	Register the data sets monthly or register them all at once before you run the reports.	Register the data sets the first month only.
If the performance data set is accessed by using a libref, store the data set in the SAS library.	Save the performance data set in the SAS library that is defined by a libref in SAS Model Manager.	Save the performance data set in the SAS library that is defined by a libref in SAS Model Manager.
Modifications to make in the Define Performance Task wizard	In Step 3, select one or more performance data sources. For each data source, select a data collection date and enter a date label.	In Step 3, select a data collection date and enter a date label. The Performance data source field contains the static name of the performance data source name because it was specified for the previous execution of the task for this project.
Create the reports	Run the Define Performance Task wizard and execute the reports from the Performance Monitor project node or schedule when the task is to execute. Because each performance data source has a different name, you can run the performance task as desired; the task does not need to be run monthly.	Monthly, run the Define Performance Task wizard and execute the reports from the Performance Monitor project node or schedule when the task is to execute. To ensure that you do not write over important performance data, run the performance task before a new snapshot of the operational data is taken.