Challenger Models

About Challenger Models

You use challenger models to test the strength of champion models. The champion model for a project can have one or more challenger models. A model can be marked as a challenger model only after a champion model for the project has been selected. A challenger model can be flagged in any version of a project. When you flag a model as a challenger model, the Flag Challenger icon

icon appears next to the model.

Before you flag a model as the challenger model, verify that the model is active. If the model expiration date has passed, then you cannot set the model as a challenger model.

Note: An authorized user can reset the expiration date to a later date so that it is possible to set the challenger model.

To compare a challenger model to a champion model, you can create and run performance monitoring tasks for the champion model and any challenger models. Then, using the performance data, you can create a Champion and Challenger Performance report. You can also compare challenger models to the champion model using other reports such as the Delta report and Dynamic Lift report that are available through the New Report wizard. For more information, see Format a Champion and Challenger Performance Report.

Note: The batch programs for performance monitoring do not support creating challenger model performance reports.

Challenger models can be published to a database, the SAS Metadata Repository, or to a SAS channel that has the champion model. They can also be published by themselves. If testing determines that the challenger model is the better model, you can replace the champion model by setting the challenger model as the champion model.

Here are the tasks that are associated with challenger models:

Flag a Challenger Model

Expand the Models folder under the version folder
Right-click the model that you want to use as the challenger model and select Flag as Challenger from the pop-up menu. Click Yes to confirm.
If there are model input variables that are not defined as project input variables, you are prompted to add the input variables. Click Yes to confirm. The model input variables are copied to the project input variables.
If the project output variable has not been mapped to the model output variable, the Set Model Output Mapping window appears. For each project variable, click the Model Variables field and select the model output variable. Click OK.
Verify that the appears beside the challenger model.

Clear a Challenger Model

Expand the Models folder under the version folder .
Right-click the challenger model and select Flag as Challenger.
Click Yes to confirm. The Flag as Challenger check mark is cleared and the challenger flag icon to the right of the model is cleared.

Note: If the version is frozen, then you cannot clear the challenger model unless a SAS Model Manager administrator unfreezes the version first.

Challenger models can also be cleared when the champion model is cleared or replaced.