RiskTech Forum

SAS: Model Risk Management: Vital To Regulatory And Business Sustainability

Posted: 1 June 2016  |  Author: Sridhar Sourirajan  |  Source: SAS

Analytical models are the lifeblood of modern financial institutions. Throughout their life cycles, they affect the needs of many different stakeholders across the organization. Adverse consequences result if business decisions are made as a result of misinformed or incorrect model use. 

Accordingly, financial institutions are marshaling their resources to address a variety of analytics and governance challenges underlying current and emerging business and regulatory requirements. As they do, model risk management becomes a pivotal competency. Historically, models were developed in silos without enterprise-level governance, leading to inconsistencies in data quality, quantitative methodology, model usage and validation processes. It is these shortcomings that model risk management is specifically designed to address.

Financial institutions need a centralized capability to manage and track core processes and workflow throughout model life cycle.

The rise of model risk management

Following the 2008 crisis, regulators significantly increased their focus on model risk management. The US Federal Reserve’s regulation SR 11-7 mandates bank holding companies (BHCs) manage and control risk associated with models by using rigorous design, implementation and validation techniques. Model risk management is therefore a critical component of CCAR (Comprehensive Capital Analysis and Review) processes, and banks are required to submit documented evidence of compliance with model governance policies and procedures, model approvals by management, and evidence of effective challenges and their resolution.

In fact, beyond BHCs, financial institutions across the board, from asset managers to insurance providers, understand they must do a better job managing analytical models at the core of their investment, capital allocation, business performance, risk management and compliance processes.

Relying on legacy systems and processes: What can possibly go wrong?

There are various things that can go wrong in the design, development, testing, implementation and usage of models – which in turn leads to adverse consequences from decisions made using incorrect outputs.

Relying on incorrectly functioning models or decisions based on wrong or misused model outputs results in model risk. Model risk can lead to failure to gain regulatory approval for capital plans, financial loss, damage to a bank's reputation and loss of shareholder value. 

There are two fundamental reasons a model can be wrong or suffer performance degradation (loss of uplift):

A model is fundamentally wrong due to incorrect data, the wrong design, the wrong application of theory, an error in the mathematical calculations, or wrong assumptions. Any of these errors will produce incorrect estimates, which when applied against the business objectives, will inevitably result in decisions leading to potentially adverse impacts.

The model design and development is fundamentally correct, but the model is misused or misapplied. A model designed for a specific situation can pose high model risk when used in a different environment with different assumptions. It is very important to define the limitations and scope for a model.

We can trace these challenges back to a lack of control over model governance and workflow, as well as a reliance upon legacy systems that suffer from a number of challenges, including:

Best practices for model risk management
To improve model risk management, you can establish controls and guidelines to measure and address model risk at every stage of the life cycle. Examples of controls and measures include:

To implement best practices for model risk management at your bank, you’ll need the following:

Model risk management as the key to making your business sustainable

Many financial institutions now realize that model risk management is about more than just regulatory compliance – it’s a crucial business function if your business is to be sustainable.

Model risk management becomes a pivotal competency involving a change in culture and the adoption of best practices to measure and mitigate risk associated with using models. With a disciplined and aligned model development and implementation process, effective management of the validation cycle, and a well-defined model usage process supported by strong governance polices, controls and management structure, you are well on your way to a strong model risk management framework that fits into the broader business, risk management and compliance goals of your organization.