Humans struggle to keep pace with machine learning
Banks and regulators grapple with ‘XAI’ challenge
The financial crisis revealed a few harsh truths to the quantitative finance profession – not least the folly of believing that modelling assumptions will hold true in all market circumstances.
A decade on, the models banks use to power everything from loan decisions to economic forecasting are subject to far more rigorous regulatory scrutiny. For the past several years, the parameters that underpin models, the purpose they’re put to and the governance applied to them have been subject to strict criteria from prudential authorities, forcing banks to implement validation frameworks to cope with the tougher compliance expectations.
But rapid investment in one area of quant research – machine learning – has left banks with a growing number of models that don’t easily fit into the above mould. Models that rely on ML techniques to determine their outputs, particularly more complex deep learning approaches, often defy easy explanation – posing banks a problem when regulators ask them to show their workings.
This problem is cropping up with increasing frequency in banking, but it is not new: practitioners grappling with it in other industries – doctors using image recognition technology to spot tumours, or military leaders developing drones that can spot targets hidden behind layers of defences – have given the field its own, slightly awkward acronym: XAI, or explainable artificial intelligence.
All acknowledge, to varying degrees, that a failure to justify their models’ conclusions will erode trust in their approaches, and ultimately curb the widespread use of such methods in future – even where they offer potentially huge advantages.
It’s the same in banking. Unsurprisingly, regulators are already probing how banks use ML models, even where they only intend to deploy them as challengers for validation purposes – let alone active use.
Models with client-facing applications will not be alone in attracting scrutiny: it would reflect badly on a bank if its chief reporting officer couldn’t explain how the firm’s new ML-based anti-money laundering software verified the source of client funds in response to a regulator’s spot-check.
Banks are clear, however, that the direction of travel on ML research and deployment is only going to run one way – and unequivocal that regulators will have to keep up.
One senior risk manager at a large bank argues watchdogs must invest time and resources in training model validators to understand the rudiments of more complex ML techniques, akin to how banks themselves previously laid on seminars to educate regulators on the quantitative techniques underlying capital models imposed under the original Basel accords, which increased banks’ freedom to model their capital requirements.
Should regulators fail to keep pace with ML model development, he implies, they will be standing in the way of progress.
“Regulators will have to go on the same journey they did 20 years ago on quant models in the primary risk space. They will have to learn, they will have to invest and they will have to deal with it.”
Only users who have a paid subscription or are part of a corporate subscription are able to print or copy content.
To access these options, along with all other subscription benefits, please contact info@risk.net or view our subscription options here: http://subscriptions.risk.net/subscribe
You are currently unable to print this content. Please contact info@risk.net to find out more.
You are currently unable to copy this content. Please contact info@risk.net to find out more.
Copyright Infopro Digital Limited. All rights reserved.
As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (point 2.4), printing is limited to a single copy.
If you would like to purchase additional rights please email info@risk.net
Copyright Infopro Digital Limited. All rights reserved.
You may share this content using our article tools. As outlined in our terms and conditions, https://www.infopro-digital.com/terms-and-conditions/subscriptions/ (clause 2.4), an Authorised User may only make one copy of the materials for their own personal use. You must also comply with the restrictions in clause 2.5.
If you would like to purchase additional rights please email info@risk.net
More on Our take
Quants mine gold for new market-making model
Novel approach to modelling cointegrated assets could be applied to FX and potentially even corporate bond pricing
Thin-skinned: are CCPs skimping on capital cover?
Growth of default funds calls into question clearers’ skin in the game
Quants dive into FX fixing windows debate
Longer fixing windows may benefit clients, but predicting how dealers will respond is tough
Talking Heads 2024: All eyes on US equities
How the tech-driven S&P 500 surge has impacted thinking at five market participants
Beware the macro elephant that could stomp on stocks
Macro risks have the potential to shake equities more than investors might be anticipating
Podcast: Piterbarg and Nowaczyk on running better backtests
Quants discuss new way to extract independent samples from correlated datasets
Should trend followers lower their horizons?
August’s volatility blip benefited hedge funds that use short-term trend signals
Low FX vol regime fuels exotics expansion
Interest is growing in the products as a way to squeeze juice out of a flat market