Monitoring Performance of a Model without Score Code

If you want to monitor the performance of a model for which you no longer have the score code, you can import a model without SAS score code in the score.sas file. If the performance data set contains the predicted values, the score.sas file can be empty.

To monitor the performance of a model without score code, follow these steps:

Prepare the following model files:
- XML file that defines the model input variables (inputvar.xml)
- XML file that defines the model output variables (outputvar.xml)
- XML file that defines the model target variables (targetvar.xml)
- empty SAS score code file (score.sas)
Create a project that has a model function type of Classification, and create a version. You can skip this step if you have already created a project and version.
Verify that the following project properties are set:
- Training Target Variable (for example, bad)
- Target Event Value (for example, 1)
- Class Target Level as Binary (SAS Model Manager 3.1 or later)
- Output Event Probability Variable (for example, score)
In the Project tree, navigate to the project’s version.

MMRootorganizational folderproject folderversion folder
Right-click the Models folder, and select Import FromLocal Files.

Note: If the model already exists you can right-click the model name and select Partial Import to import an empty score.sas file, and then skip to step 11. For more information, see Import Partial Models.
Navigate to the folder on your computer that contains the component files for your model.
Select a classification template from the Choose a model template list.
Enter a text value in the model Name field.
Complete the template fields. Drag the files from the left of the window to the corresponding file property on the right. The following files are required:
- inputvar.xml
- outputvar.xml
- targetvar.xml
- score.sas
Note: The filenames that you created for the model do not have to match the template filenames. However, the file contents must meet the file property requirements. For more information, see Model Template Component Files or Model Template Properties.
Click OK. After SAS Model Manager processes the model import request, the new model appears in the Models folder of your project's version.
Select the model in the project tree, and set the model-specific properties. The value for the Score Code Type property must be set to Data Step.
Right-click the model, and select Set Model Output Mapping in order to set the output variable mappings for the model.
Set the model as the champion model, and set the version that contains the model as the default version. For more information, see Ensure That the Champion Model and Default Version Are Set.
Before defining a performance task, verify that the performance data set is registered in SAS Management Console and contains the following variables:
- model input variables
  
  Note: You must have the variable columns in the table, but the values can be missing.
- target variable
- prediction variables
- variables for characteristic analysis
Define a performance task using the performance data set that contains the predicted values. For more information, see Run the Define Performance Task Wizard.