Overview of Model Comparison Reports

What Is a Model Comparison Report ?

The SAS Model Manager model comparison reports are tools that you can use to evaluate and compare the candidate models in a version or across versions to help you select and approve the champion model that moves to production status. The SAS Model Manager model comparison reports are analytical tools that project managers, statisticians, and analysts can use to assess the structure, performance, and resiliency of candidate models.
The reports present information about a number of attributes that can impact model performance. Together, the reports provide qualified information that can serve as the analytical basis for choosing and monitoring a champion model.
Here is a description of the comparison reports:
Model Profile Report
For a single model, this report displays the profile data associated with input, output, and target variables. Profile data includes the variable name, type, length, label, SAS format, measurement level, and role.
Delta Report
This report compares the profile data for two models and notes the differences.
Dynamic Lift Report
The Dynamic Lift report provides visual summaries of the performance of one or more models for predicting a binary outcome variable.
You create Model Comparison reports using the New Report Wizard that you start from a version's Reports node.

Model Comparison Input File

SAS Model Manager uses a test table as the input table for the Dynamic Lift report. Before you run the New Report Wizard to create a Dynamic Lift report, make sure that a test table has been added to the SAS Metadata Repository using SAS Management Console and that the table can be viewed in the Data Sources perspective. Then, specify the test table in the project property Default Test Table.

See Also

Specific Properties for a Project
Creating a Test Table

Model Comparison Output Files

The New Reports Wizard stores the model comparison output files in a report node under the Reports folder. The name of the report node is the value of the Name field that you specified in the New Report Wizard Report Properties table.
Each time you run the New Report Wizard, the wizard creates these files:
  • the report in either HTML, PDF, RTF, or Excel format
  • taskCode.log
  • taskCode.sas
CAUTION:
The wizard overwrites the output files if output files of the same name already exist.
Report File
Description
report-name.html
This file is the report output in HTML format.
report-name.pdf
This file is the report output in PDF format.
report-name.rtf
This file is the report output in RTF format.
report-name.xls
This file is the report output in Excel format.
taskCode.log
This file is the log file that contains messages from running the SAS code to create the report.
taskCode.sas
This file is the SAS code that is used to create the report.
After you create a report, you view the report from the Reports folder.
Note: If you save a report to a local drive, images in the reports, such as graphs, do not appear. The report images are separate files and are stored in the SAS Content Server. Always view reports from the Reports folder.
Copyright © SAS Institute Inc. All rights reserved.