Dynamic Lift Reports

About Dynamic Lift Reports

The Dynamic Lift report enables you to view a model's lift at a given point in time or to compare the lift performance of several models on one chart. The Dynamic Lift report creates the following charts:
  • Lift
  • Cumulative Lift
  • Percent Response
  • Cumulative Percent Response
  • Captured Response
  • Cumulative Captured Response
A Dynamic Lift report can be created only for classification models with a binary target.
The charts that are created for a Dynamic Lift report are also created in the Monitoring Report, which creates multiple types of model comparison reports. Before you can create a Dynamic Lift report, certain project and model property settings must be set.
For PMML 4.0 and later models, the Valid variable name option in SAS Management Console must be set to Yes by a SAS Model Manager administrator. For more information, see the SAS Model Manager 12.1 Administrator’s Guide.

Verify Project and Model Property Settings

Verify Project Properties

Select the project name and verify that the following project properties are set:
Default Test Table
Specifies a test table that is listed in the Test Tables data source. The test table must contain the target variable, as well as values for the variables that are defined by the project input variables.
Training Target Variable
Specifies the name of the target variable that was used to train the model. The model must have the same training target variable as the project.
Target Event Value
Specifies the value for the desired target variable event or state. For example, if a model predicts when RESPONSE=YES, then the target event value is YES.
Output Event Probability Variable
Specifies the name of the output event’s probability variable.

Verify Model Properties

For each model in the Dynamic Lift report, click on the model name and verify the specified properties on the following tabs:
Model Mapping
Click the Model Mapping tab and verify that the model variables are mapped to the project variables. If the variable names are the same, you do not need to map the variables. If they are not mapped, click the Model Variables property for each project name, and select a variable name.
Properties
Property
Description
Target Variable
Specifies the name of the target variable. For example, if a model predicts when RESPONSE=YES, then the target variable is RESPONSE.
Score Code Type
Specifies whether the score code runs using a DATA step fragment or SAS code that is not a DATA step fragment.
Note: Dynamic Lift reports are not applicable to models whose Score Code Type property has a value of PMML. For PMML 4.0 and later, a Dynamic Lift report can be created for a PMML model whose Score Code Type is DATA step.

Create a Dynamic Lift Report

After ensuring that the appropriate project and model properties have been set, follow these instructions to create a Dynamic Lift report:
  1. Expand the version folder Version Folder Icon.
  2. Right-click the Reports node and select Reportsthen selectNew Report. The New Report window appears.
    New Report Window Dynamic Lift Report
  3. Select Dynamic Lift Report from the Type list box.
  4. In the Format list box, select the type of output that you want to create. The default is PDF. Other options are HTML, RTF, and Excel.
  5. In the Style list box, select the style for the output. The default is SAS default. Other options are Seaside, Meadow, and Harvest.
  6. In the Select column of the Select Models table, select the boxes for the models that you want to include in the report.
  7. In the Report Properties table, complete the Name and Description properties if you do not want to use the default values. The default value for the Name property uses the form dynamicLift_DdateTtime. The characters @ \ / * % # & $ ( ) ! ? < > ^ + ~ ` = { } [ ] | ; : ‘ " cannot be used in the name.
  8. Click OK. A message confirms that the report was created successfully.
  9. If errors occurred, ensure that the prerequisite properties have been set correctly or correct the reported model configuration error.

See Also