CFO Focus: Why Use Multiple CECL Models?

As we continue marching towards final adoption of the Fair Accounting Standards Board’s ASC-326 (a.k.a., current expected credit loss, or CECL for short) in January 2023, community banks and credit unions are fully engaged.

When CECL was released back in 2016, the prevailing thought was that achieving compliance basically meant choosing a model and filling it with data. Everyone thought the biggest challenge would be figuring out how to bridge the gap between the allowance for loan and lease losses calculated by the incurred loss methodology to the CECL ALLL.

Now, financial institutions are discovering that complex risk models require some maintenance and that they need to fully understand how a model works to know whether its results accurately reflect the risk in their loan portfolio.    

What tools do financial institutions have to ensure that their calculated CECL results accurately reflect the risk in their portfolio? Models are built by humans and, as such, share an undeniable characteristic with their builders: They are fallible.

All Models Have Weaknesses, Even The ‘Sophisticated’ Ones

The accounting standards acknowledge that all models have weaknesses and therefore allow practitioners to make qualitative adjustments (i.e., Q factors) to calculated results. Q factors are a tool financial institutions can use to assess risk accuracy but need to be used appropriately. They must:

• Address a weakness of the model (Why is this adjustment necessary?)
• Be supported with quantifiable data (What is the basis for the adjusted amount?)

One can see how it could be tempting to use Q factors to bridge any gap between incurred loss methodology results and CECL results. We have observed this within our client base, albeit rarely; the accounting standard is clear about the need to provide quantitative support for Q factors. Use of Q factors also invites unwanted scrutiny from an auditor or examiner. So, in practice, their use is stigmatized.

If the support for qualitative adjustments is ultimately quantitative, then a perhaps different quantitative model is a better option.

PD/LGD Models

The gold standard for CECL models is probability of default/loss given default models. The benefits of employing PD/LGD models are well known. Their use is directly referenced by Basel II and the Financial Accounting Standards Board. PD/LGD models make use of unique loan characteristics that have high correlation to loss and severity:

• Loan-to-value tatios
• Credit scores (such as FICO)
• Vintage
• Guarantees
• Debt service coverage ratios
• Actual time to maturity

The instrument-level results produced by PD/LGD models can also be integrated with other management analysis:

• Loan pricing
• Customer profitability
• Loan portfolio stress testing
• Merger and acquisition valuation

But one of the primary weaknesses of PG/LGD models is the breadth and depth of data required to produce good results. The data must have:

• Length of history. It’s challenging to build a regression model on a new product.
• Number of observations. When actual loss events are minimal, model results are driven mainly by the peer group results.

Two Common Scenarios, Analyzed

Here are two common scenarios in which an additional model beyond PD/LGD is needed (along with clarification on which model type is most appropriate).

Scenario 1: Industry/peer experience is significantly different from your portfolio loss experience. PD/LGD models require multiple credit cycles of history to calculate correlations between economic indicators and loan losses. To build a model with two credit cycles, we would need instrument-level data back to the year 2000. This is simply not practical. Consequently, most models will rely on publicly available historic data (peer data) to create these correlations.

What happens when a specific financial institution portfolio loss history looks nothing like peer group loss history? Consider the financial institution that has low or no charge-offs over the most recent five-year period. Given the benign credit environment leading up 2020, this has been a common occurrence. Use of peer data correlations to forecast expected losses would cause the CECL reserves to be overstated by millions of dollars. When this FI adopts CECL in 2023, its provision expense under PG/LGD would impair capital by almost $22 million.

Closing that gap with a Q factor isn’t an option. Instead, use a model that is not based on regression or peer data. A roll rate model generates expected losses by measuring the probability of a loan rolling from one delinquency bucket to another (30 to 60, 60 to 90, 90 back to 30, etc.). Roll rate model results are driven by the FI’s unique delinquency and loss experience. The industry is familiar with roll rate models, and they provide completely valid results in this instance. Roll rate does have some weaknesses but may give a better representation of the risk in this example.

Scenario 2: The loan data is missing fields that are critical to PD/LGD results. Instrument-level loan characteristics (LTV, FICO, debt service coverage ratio) provide strong correlations to losses and severity of loss. PD/LGD models make great use of these factors to differentiate loss expectations on the FI’s loans compared to the pool loans. With that data missing, the modeler loses the benefit of the granularity found in PD/LGD. There is, however, another strength of PG/LGD that does not require loan-level detail. That is the loan product lifecycle, which is also associated with vintage models.

Separate from all other influencers of loss, the probability of default of a loan changes over time. Each loan type has a general lifecycle to it. Some, like auto loans, are very predictable.

PD is typically very low in the beginning of the life cycle. The peak PD differs for each product, but after the peak, PD steadily declines over time. A vintage model is very suitable in this situation. The user gives up the granularity of PD/LGD, but still retains the strengths common to both models:

• Loan product life cycle predictability
• Loans originated during the same period tend to experience similar loss through the cycle of these loans. (i.e., vintage effect)
• Wide industry acceptance
• Sensitivity to macroeconomic factors

As pointed out in the beginning of this post, all models have weaknesses. We don’t have to apologize for them or cover them up. On the contrary, our role as risk managers is to call attention to them. By having multiple models available to us and understanding how each model works, we make our best effort at communicating the risk in the portfolio to our stakeholders.

As a consulting services senior manager for ProfitStars®, Jerry Boebel is responsible for the design and delivery of all ALM consulting and client support for over 1,900 banks and credit unions. Boebel has 24 years of broad banking experience that includes retail banking and mortgage insurance. This article was reprinted with permission from the original.