Prerequisites for Running Batch Performance Reports
Overview of Prerequisites for Running Batch Performance Reports
Batch performance reporting
requires you to complete several tasks before you can modify the example
programs. After the following tasks have been completed, you are ready
to modify the example programs:
-
Determine the channel that is used to publish the project champion model.
-
Ensure that the champion model has been published from the project folder to a channel.
-
Create a folder structure on the SAS Model Manager server.Note: The folder on the SAS Model Manager server that is used in creating batch performance reports must be accessible to the batch performance program.
-
Store performance data sets on the SAS Model Manager server.
-
If you are using SAS example programs, copy the example programs to the SAS Model Manager server.
-
Determine a SAS Decision Manager user ID and password to authorize the batch processing.
Publish the Champion Model from the Project Folder
In order to run performance
reports in batch, you must publish the champion model from the project
folder. The SAS Decision Manager performance macros use
project metadata when running performance reports.
Whenever you have a
new champion model, you must publish the new champion model again.
Create a Folder Structure
Create a folder structure
on your SAS Model Manager server to contain the report monitoring
files. First, create a root folder to contain performance reporting
files for one or more SAS Decision Manager projects. You
might further organize your file structure by project. The examples
in the following table use a classification of HMEQ for the files
that are used to create home equity performance monitoring reports.
Create folders to contain the following types of files:
|
Folder Contents
|
Description
|
Example
|
|---|---|---|
|
job local path
|
Specifies the folder
that contains the reporting specification data sets that are used
by the %MM_RunReports() macro.
|
c:\mmReports\HMEQ\reportJobs
|
|
report output
|
Specifies the folder
that contains data sets and auxiliary files that are created during
the creation of the performance reports when the %MM_RunReports()
macro is run in test mode.
|
c:\mmReports\HMEQ\testReportOutput
|
|
performance data
|
Specifies the folder
that contains the performance data sets for each time period.
Performance data sets
can be stored in a DBMS as well. If your performance data set is in
a DBMS, then this folder is not necessary.
|
c:\mmReports\HMEQ\scoreIn
|
|
channel
|
Specifies the folder
on the SAS Model Manager server to save the SPK file that is created
during the processing of the %MM_GetModels() macro. The SPK file contains
the model.
When you publish a model
to a channel, the published model package file (SPK) is placed in
this folder.
Note: The channel that you publish
a model to must use archive persistence because the %MM_GetModels()
macro requires a directory path. The directory path must be the same
path that was used for the channel’s persistence.
A channel can be shared
by multiple model projects.
If you do not use the
SAS channel that was predefined during the installation of SAS Model
Manager, see the Help for the Publishing Framework in SAS Management
Console.
|
c:\mmReports\HMEQ\channel2
|
|
model
|
Specifies the folder
to where the SPK model is extracted to by the %MM_GetModels() macro.
The macro creates a \scorecode folder that contains the model score
code and saves the data set current.sas7bdat, logs.sas7bdat, and processingspk.sas7bdat
in the model folder. The current.sas7bdat data set contains project
and model information that is used to create the performance monitoring
reports.
|
c:\mmReports\HMEQ\model
c:\mmReports\HMEQ\model\scorecode
|
To ensure that your
report data is not lost, regularly back up these report folders.
Obtain Performance Data
The performance data
set is a snapshot of a data set that includes scoring input variables
and one or more target variables. After the snapshot is available,
store the data set in a performance data folder on the SAS Model Manager
server.
See Also
Determine the Publish Channel
You can determine the
channel that was used to publish the model by using one of these methods:
-
Open a model and select History
Log on
the Model Properties page. Look for a publish
model entry. In this example, the channel name is MMChannel: Jul
5, 2015 9:47:18 PM[sasdemo] "Reg 1" was published to "MMChannel(sas-oma://rdcesx16083.race.sas.com:8561/reposid=A5BXGH17/ITChannel;id=A5BXGH17.BI000001)"
successfully. -
In SAS Management Console, click the Plug-ins tab and expand the following nodes under SAS Management Console to find the publishing channels that are used by SAS Decision Manager: Environment ManagementPublishing
FrameworkFoundationChannelsModel Manager Channels.
Right-click the channel and select Properties.
The channel path is located on the Persistent Store tab.
Note: If the Plug-ins tab does not appear in your view of SAS Management Console, contact your SAS administrator.
Note: A publish channel can be
shared by multiple projects.
Copy Example Batch Programs
SAS provides several
example programs that you can use to create a batch program that monitors
the performance of the champion model. You can find the example programs
in the sashelp.modelmgr catalog. The catalog includes these example
programs:
| reportExample1 | contains example SAS code to extract a project or model from the channel using the %MM_GetModels() macro. |
| reportExample2 | contains DATA steps to create performance data that can be used to test the batch programs that create performance monitoring reports. |
| reportExample3 | contains example DATA steps to create the SAS data sets that contain report specifications, such as the project UUID and path, various input variables, the location of the performance data source, alert and warning conditions, and email addresses for report notifications. |
| reportExample4 | contains an example program that are used to define the operating environment using macro variables. This program also contains the DATA steps that are used to create the reports. |
You can copy these example
programs to the job local path folder and you can modify them for
your operating environment.
Determine SAS Decision Manager User ID and Password
Performance monitoring
reports must specify a validSAS Decision Manager user ID
and password. The user ID must be in one of the following groups:
-
Model Manager Users
-
Model Manager Advanced Users
-
Model Manager Administrator Users
See Also
Configuring Users, Groups, and Roles in SAS Decision Manager: Administrator’s Guide
Copyright © SAS Institute Inc. All Rights Reserved.
Last updated: February 22, 2017