Challenger Models :: SAS(R) Model Manager 13.1: User's Guide

About Challenger Models

You use challenger models to test the strength of champion models. The champion model for a project can have one or more challenger models. A model can be flagged as a challenger model only after a champion model for the project has been selected. A challenger model can be flagged in any version of a project.

Verify that the model is active. If the model expiration date has passed, you cannot set the model as a challenger model.

Note: An authorized user can reset the expiration date to a later date so that it is possible to set the challenger model.

To compare a challenger model to a champion model, you can create and run performance monitoring tasks for the champion model and any challenger models. Then, using the performance data, you can create a Champion and Challenger Performance report. You can also compare challenger models to the champion model using other reports such as the Delta report and Dynamic Lift report that are available through the Reports page. For more information, see Champion and Challenger Performance Reports.

Note: The batch programs for performance monitoring do not support creating challenger model performance reports.

Challenger models can be published to a database, the SAS Metadata Repository, or to a SAS channel that contains the champion model. They can also be published by themselves. If testing determines that the challenger model is the better model, you can replace the champion model by setting the challenger model as the champion model.

Flag a Challenger Model

To flag a challenger model:

On the Models page of a project, select a model and click to flag a model as a challenger to the project champion model. The value in the Role column changes to Challenger.

Note: Alternatively, you can right-click a model and select Flag as challenger.

Clear a Challenger Model

To clear a challenger model:

On the Models page of a project, select a model that is marked as Challenger, and click to clear a flagged challenger model.

Note: Alternatively, you can right-click a model that is marked as Challenger and select Clear. Challenger models can also be cleared when the champion model is cleared or replaced.