Managing Models Using SAS Model Manager

Using SAS Model Manager, you can organize modeling projects, develop and validate candidate models, assess candidate models for champion model selection, publish and monitor champion models in a production environment, and retrain models. All model development and model maintenance personnel, including data modelers, validation testers, scoring officers, and analysts, can use SAS Model Manager.
SAS Model Manager in a Business Intelligence environment can meet many model development and maintenance challenges. Here are some of the services SAS Model Manager provides:
  • You use a single interface, the SAS Model Manager client, to access all of your business modeling projects. The SAS Model Manager client presents projects in a tree structure, known as the Project Tree.
  • All models are stored in a central, secure model repository.
  • All project or model metadata is readily accessible through the SAS Model Manager client.
  • You can track the progress of your project’s version either by creating processes and activities using the SAS Model Manager Workflow Console or by creating milestones and tasks using a life cycle. You create custom processes and activities or milestones and tasks to meet your business requirements and to match your business processes.
  • Data tables that are registered in SAS Management Console or in an accessible SAS library can be used in SAS Model Manager.
  • The models that you import into SAS Model Manager can be SAS Enterprise Miner models, SAS/STAT linear models, SAS/ETS COUNTEG and SEVERITY models, models that you develop using SAS code, PMML models, or R models. You can create custom model templates for SAS code models so that SAS Model Manager knows exactly what files and metadata are associated with a model.
  • After you import candidate models, you can use SAS Model Manager to schedule and run scoring tasks to validate models.
  • SAS Model Manager has several reports that you can use to compare and assess candidate models. You can also write your own SAS reporting programs to assess candidate models and run them in SAS Model Manager. The aggregated reporting facility enables you to combine multiple reports into a single report.
    SAS Model Manager can also create Basel II model validation reports.
  • After you choose a champion model, you can lock the model and its associated data for future reference or auditing by freezing the containing version.
  • SAS Model Manager uses the SAS Integration Technologies Publishing Framework to publish models to a channel.
  • You can flag challenger models and publish them to a production environment.
  • You can publish models to the SAS Metadata Repository, or you can publish the champion model and challenger models to a database for scoring using the SAS Scoring Accelerator.
  • You can monitor the performance of a champion model in a production environment by scheduling a performance monitoring task to run on a specific day and time, by executing the performance monitoring task using the SAS Model Manager window, or by using SAS Model Manager macros in a batch environment. The performance of challenger models can be monitored in a production environment using the SAS Model Manager window. After the data is collected, you can create a report that compares the performance of the champion and challenger models.
  • SAS Model Manager provides macro programs for you to run model registration to SAS Model Manager and scoring in a batch environment. Another macro registers SAS/STAT item store models and High-Performance Analytic models that were not created in SAS Enterprise Miner to the SAS Metadata Repository. If you create models using the COUNTREG or SEVERITY procedures, SAS Model Manager provides macros for you to generate score code for the models.
  • You can retrain models to respond to data or market changes.
  • SAS Model Manager provides dashboard reports for you to monitor the state of projects using performance monitoring reports, and enables you to view the reports in a web browser.
  • If your environment supports multiple SAS Application Servers, you can select the application server to execute scoring tasks, performance monitoring tasks, and model retrain tasks.
  • Using a query utility, you can look for models by name or identifier, or you can look for tasks.
Any user who is registered in SAS Management Console can be assigned to a SAS Model Manager group, and can then work in SAS Model Manager. SAS Model Manager has three groups.
  • Users in the Model Manager Administrator Users group ensure that all aspects of the modeling project are configured and in working order. Users in the Model Administrator group can perform all tasks within SAS Model Manager.
  • Users in the Model Manager Advanced Users group can perform some of the tasks that the Model Manager Administrator Users group can perform as well as all tasks that users in the Model Manager User group can perform.
  • Users in the Model Manager Users group can perform development, validation, reporting, and publishing tasks with some Write access limitations.
Data source tables are an integral part of the modeling process in SAS Model Manager. You can use project input, output, and scoring output prototype tables to define variables to SAS Model Manager. Data tables are used for scoring, testing, and performance monitoring. Performance data can be created from your operational data.
You can also create multiple projects in a control group. Additional versions can then be created for all projects within the control group. Champion models for all projects within the control group can be monitored for performance, and published to the SAS Metadata Repository. For more information, see Overview of Project Control Groups.