Prerequisites for Running the Define Performance Task Wizard :: SAS(R) Model Manager 3.1: User's Guide

Overview of Prerequisites

Before you run the Define Performance Task wizard, the environment must be set appropriately as follows:

Ensure that the champion model and default version are set.
Ensure that the champion model is a classification model that contains a binary target.
Ensure that the champion model contains a score.sas file. If the performance data set contains the predicted values, the score.sas file can be empty. For more information, see Monitoring Performance of a Model without Score Code.
Ensure that the performance data sets for the time period that you want to monitor are registered in SAS Management Console.
Ensure that the appropriate project and model properties are set.
Ensure that the model output variables are mapped to the project output variables.

After the environment is set, you can run the Define Performance Task wizard.

Ensure That the Champion Model and Default Version Are Set

The Define Performance Task wizard generates report code for the champion model in the default version.

You can determine the default version and the champion model by looking for the Champion Model Icon

icon next to the default version name and the champion model name.

If the default version or the champion model are not set, follow these steps:

Right-click the champion model name and select Set Champion Model. The icon appears next to the champion model name.
Right-click the version name where the champion model resides and select Set Default Version. The icon appears next to the version name.

Ensure That the Champion Model Is a Classification Model That Contains a Binary Target

Performance monitoring reports are valid only for classification models that contain a binary target. You should define only performance tasks for classification models. The champion model must have a function type of classification and must contain a binary target. From the Projects perspective, select the champion model name and verify that the Function property in the specific properties section is set to Classification. For models that are created using SAS Enterprise Miner, select the targetvar.xml file in the model folder and verify that the LEVEL attribute is set to BINARY.

Ensure That the Performance Data Source Is Available

The Define Performance Task wizard requires that the performance data be registered in the SAS Metadata Repository, using SAS Management Console. After the performance data set is registered, update the Default Performance Table model property. From the Projects perspective, select the champion model name. Click the value field of the Default Performance Table property, click the ellipsis button, and select a performance data set from the Select Table window.

If your performance table is not available for selection, your administrator must add the table to the SAS Metadata Repository Data Library Manager using SAS Management Console. For more information, see the SAS Model Manager 3.1 Administrator's Guide.

Ensure That Project Model Properties Are Set

Several properties must be defined in order to generate the model performance reports. From the Project perspective, verify that the following properties are specified:

the project Training Target Variable property
the project Target Event Value property
the project Class Target Level property
the project Output Event Probability Variable
the champion model Score Code Type property

Map Model and Project Output Variables

In order to create the model performance reports, the model output variable must be mapped to the project output variable if the corresponding project variable and the model variable have different names. To map these output variables, follow these steps:

Select the model from the Models node.
In the right pane, click the Model Mapping tab and click the Edit button.
For each project output variable, select a variable from the Model Variables list box.

Prerequisites for Running the Define Performance Task Wizard