Prerequisites for Running Batch Performance Reports :: SAS(R) Model Manager 14.1: User's Guide

Overview of Prerequisites for Running Batch Performance Reports

Batch performance reporting requires you to complete several tasks before you can modify the example programs. After the following tasks have been completed, you are ready to modify the example programs:

Determine the channel that is used to publish the project champion model.
Ensure that the champion model has been published from the project folder to a channel.
Create a folder structure on the SAS Model Manager server.

Note: The folder on the SAS Model Manager server that is used in creating batch performance reports must be accessible to the batch performance program.
Store performance data sets on the SAS Model Manager server.
If you are using SAS example programs, copy the example programs to the SAS Model Manager server.
Determine a SAS Model Manager user ID and password to authorize the batch processing.

Publish the Champion Model from the Project Folder

In order to run performance reports in batch, you must publish the champion model from the project folder. The SAS Model Manager performance macros use project metadata when running performance reports.

Whenever you have a new champion model, you must publish the new champion model again.

Create a Folder Structure

Create a folder structure on your SAS Model Manager server to contain the report monitoring files. First, create a root folder to contain performance reporting files for one or more SAS Model Manager projects. You might further organize your file structure by project. The examples in the following table use a classification of HMEQ for the files that are used to create home equity performance monitoring reports. Create folders to contain the following types of files:

Folder Contents	Description	Example
job local path	Specifies the folder that contains the reporting specification data sets that are used by the %MM_RunReports() macro.	c:\mmReports\HMEQ\reportJobs
report output	Specifies the folder that contains data sets and auxiliary files that are created during the creation of the performance reports when the %MM_RunReports() macro is run in test mode.	c:\mmReports\HMEQ\testReportOutput
performance data	Specifies the folder that contains the performance data sets for each time period. Performance data sets can be stored in a DBMS as well. If your performance data set is in a DBMS, then this folder is not necessary.	c:\mmReports\HMEQ\scoreIn
channel	Specifies the folder on the SAS Model Manager server to save the SPK file that is created during the processing of the %MM_GetModels() macro. The SPK file contains the model. When you publish a model to a channel, the published model package file (SPK) is placed in this folder. Note: The channel that you publish a model to must use archive persistence because the %MM_GetModels() macro requires a directory path. The directory path must be the same path that was used for the channel’s persistence. A channel can be shared by multiple model projects. If you do not use the SAS channel that was predefined during the installation of SAS Model Manager, see the Help for the Publishing Framework in SAS Management Console.	c:\mmReports\HMEQ\channel2
model	Specifies the folder to where the SPK model is extracted to by the %MM_GetModels() macro. The macro creates a \scorecode folder that contains the model score code and saves the data set current.sas7bdat, logs.sas7bdat, and processingspk.sas7bdat in the model folder. The current.sas7bdat data set contains project and model information that is used to create the performance monitoring reports.	c:\mmReports\HMEQ\model c:\mmReports\HMEQ\model\scorecode

To ensure that your report data is not lost, regularly back up these report folders.

Obtain Performance Data

The performance data set is a snapshot of a data set that includes scoring input variables and one or more target variables. After the snapshot is available, store the data set in a performance data folder on the SAS Model Manager server.

Determine the Publish Channel

You can determine the channel that was used to publish the model by using one of these methods:

Open a model and select HistoryLog on the Model Properties page. Look for a publish model entry. In this example, the channel name is MMChannel: Jul 5, 2015 9:47:18 PM[sasdemo] "Reg 1" was published to "MMChannel(sas-oma://rdcesx16083.race.sas.com:8561/reposid=A5BXGH17/ITChannel;id=A5BXGH17.BI000001)" successfully.
In SAS Management Console, click the Plug-ins tab and expand the following nodes under SAS Management Console to find the publishing channels that are used by SAS Model Manager: Environment ManagementPublishing FrameworkFoundationChannelsModel Manager Channels. Right-click the channel and select Properties. The channel path is located on the Persistent Store tab.

Note: If the Plug-ins tab does not appear in your view of SAS Management Console, contact your SAS administrator.

Note: A publish channel can be shared by multiple projects.

Copy Example Batch Programs

SAS provides several example programs that you can use to create a batch program that monitors the performance of the champion model. You can find the example programs in the sashelp.modelmgr catalog. The catalog includes these example programs:

reportExample1	contains example SAS code to extract a project or model from the channel using the %MM_GetModels() macro.
reportExample2	contains DATA steps to create performance data that can be used to test the batch programs that create performance monitoring reports.
reportExample3	contains example DATA steps to create the SAS data sets that contain report specifications, such as the project UUID and path, various input variables, the location of the performance data source, alert and warning conditions, and email addresses for report notifications.
reportExample4	contains an example program that are used to define the operating environment using macro variables. This program also contains the DATA steps that are used to create the reports.

You can copy these example programs to the job local path folder and you can modify them for your operating environment.

Determine SAS Model Manager User ID and Password

Performance monitoring reports must specify a validSAS Model Manager user ID and password. The user ID must be in one of the following groups:

Model Manager Users
Model Manager Advanced Users
Model Manager Administrator Users

Prerequisites for Running Batch Performance Reports

Overview of Prerequisites for Running Batch Performance Reports

Publish the Champion Model from the Project Folder

Create a Folder Structure

See Also

Obtain Performance Data

See Also

Determine the Publish Channel

Copy Example Batch Programs

Determine SAS Model Manager User ID and Password

See Also