Creating Reports Using a Performance Definition

Overview of Creating Reports Using a Performance Definition

You define and execute a performance definition for a project. The model that you monitor is either the project champion model or a challenger model that is flagged in any version for the project. The process of creating performance reports is a two-step process. First, you run the Edit Performance Definition wizard to generate the code that creates the performance data results. Then, you execute the generated code. You can execute the code immediately, or you can schedule a date and time at which the definition is to run. Information about performance definitions is recorded and can be viewed on the Results tab of the Performance page.
To create performance reports:
  • Ensure that one or more performance data sources are registered using SAS Management Console or that a libref has been defined for the location where the performance data sets are stored.
  • Ensure that all prerequisites have been completed.
  • Run the Edit Performance Definition wizard to generate the SAS code that creates the performance reports.
  • Execute the generated code or schedule when the generated code is to be executed.
  • To view the reports, select the Results tab on the Performance page.

Determine How to Use the Performance Data Sets

Before you run the Edit Performance Definition wizard, the performance data sets must be registered in the SAS Metadata Repository. You can register the data sets in the Data category view or you can add tables to an existing library that have already been registered using SAS Management Console. For each project, you can set up your environment to use the performance data source that is most appropriate for your business process. Here are two methods of collecting performance data:
  • Method 1: You periodically take a snapshot of an operational data set to create a performance data set. Each time you take a snapshot, you give the performance data set a new name. Each performance data set must be registered in the SAS Metadata Repository and it must be available in the Data category view. You can create and execute a performance monitoring definition each time you take a snapshot, or you can create a performance monitoring definition to execute multiple performance data sets in the same definition. The best practice is to use the dynamic data sources in the performance definition.
  • Method 2: You take a snapshot of the operational data set to create a performance data set over time, and you reuse the same name for each performance data set every time you take a snapshot. You register the performance data set in the SAS Metadata Repository only once. The performance data set must be available in the Data category view. Each time you take a snapshot, you replace the performance data set at the location where the performance data set is registered.
    When you run the Edit Performance Definition wizard, the name of the performance data source does not change. The Default performance table project property is not populated in the Edit Performance Definition wizard. You modify only the Collection Date and Report Label columns in the table.
The following table summarizes the definitions that are performed if performance reports are run after six months or for reports that are run every month. Use this definition and example table to help you determine how you want to name your performance data sets and your performance data sources.
Definition
Method 1: The Performance Data Set Name Changes
Method 2: The Performance Data Set Name Remains Static
Create a performance data set from model output data
Each month, take a snapshot of the operational data and create a performance data set with a different name:
  • Jul13
  • Aug13
  • Sep13
  • Oct13
  • Nov13
    Dec13
Every month, take a snapshot of the operational data and name the performance data set using the same name:
2013perf
If you are registering the performance data sets in the SAS Metadata Repository, register the performance data sets using SAS Management Console
Register the data sets monthly or register them all at once before you run the reports.
Register the data sets the first month only.
If the performance data set is accessed by using a libref, store the data set in the SAS library.
Save the performance data set in the SAS library that is defined by a libref in SAS Model Manager.
Save the performance data set in the SAS library that is defined by a libref in SAS Model Manager.
Modifications to make in the Edit Performance Definition wizard
In Step 3, select one or more performance data sources. For each data source, select a data collection date and enter a date label.
In Step 3, select a data collection date and enter a date label.
The Performance data source field contains the static name of the performance data source name because it was specified for the previous execution of the definition for this project.
Create the reports
Run the Edit Performance Definition wizard and execute the reports from the Performance page or schedule when the definition is to execute.
Because each performance data source has a different name, you can run the performance definition as desired; the definition does not need to be run monthly.
Monthly, run the Edit Performance Definition wizard and execute the reports from the Performance page or schedule when the definition is to execute.
To ensure that you do not write over important performance data, run the performance definition before a new snapshot of the operational data is taken.