Financial Stability Board voices concerns over AI “black boxes”

Maria Nikolova

Financial regulators, institutions and consumers are facing the problem of interpretability of AI decisions in areas like trading and investment, FSB warns.

The Financial Stability Board has voiced its concerns about possible risks associated with the increased adoption of artificial intelligence (AI) and machine learning in the financial services sector. In a report entitled “Artificial intelligence and machine learning in financial services. Market developments and financial stability implications”, the FSB notes the numerous advantages of such novel technologies but also highlights some risks that may stem from their use.

One of the biggest risks is that the use of AI and machine learning may create the so-called “black boxes” in decision-making that could result in complicated issues, especially during tail events. In particular, it may be difficult for humans to understand how decisions, such as those for trading and investment, have been formulated.

Given this problem with interpretability, if AI and machine learning based decisions cause losses to financial intermediaries across the financial system, there may be a lack of clarity around responsibility.

The use of complex algorithms could result in a lack of transparency to consumers when it comes to credit scores assigned by AI programs. When using machine learning to assign credit scores make credit decisions, it is generally more difficult to provide consumers, auditors, and supervisors with an explanation of a credit score and resulting credit decision if challenged. Additionally, some argue that the use of new alternative data sources, such as online behaviour or non-traditional financial information, could introduce bias into the credit decision.

With regard to the use of such novel technologies in portfolio management, where AI and machine learning tools are used to identify new signals on price movements and to make more effective use of available data and market research than with current models, one issue is that useful trading signals derived from AI and machine learning strategies may follow a decay function over time, as data are more widely used and hence become less valuable for gaining an edge over other investors.

Another risk stems from a situation where multiple market participants come to use similar AI and machine learning programs in areas such as credit scoring or financial market activities. If machine learning-based traders outperform others, this could in the future result in many more traders adopting similar machine learning strategies. As with any herding behavior in the market, this has the potential to increase financial shocks. Moreover, advanced optimisation techniques and predictable patterns in the behavior of automated trading strategies could be used by insiders or by cybercriminals to manipulate market prices.

High frequency trading (HFT) applications of AI and machine learning could be new sources of vulnerabilities. If a similar investment strategy based on AI and machine learning is widely used in HFT, it might amplify market volatility through large sales or purchases executed almost simultaneously.

Finally, network effects and scalability of new technologies may in the future give rise to third-party dependencies. This could in turn result in the emergence of new systemically important players that could fall outside the regulatory perimeter.

Read this next

Institutional FX

Finalto expands NDFs line-up with Taiwanese dollar

Finalto announced today that it has expanded its non-deliverable forwards (NDFs) offering with the addition of Taiwan’s dollar to its trading platform.


It’s time for FX to Harness Crypto’s Potential

Jonathan Cumberlidge, FX Sales Director for BVNK, makes the case for cryptocurrencies in improving the efficiency and flexibility of foreign exchange trading.

Digital Assets

Owner of OptionMint, OptionKing, and OptionQueen gets 30 months in prison

A US federal judge has sentenced Ohio resident Jared Davis, who was found guilty for his participation in a multi-million fraud scheme carried out by Israeli-run binary options websites.

Executive Moves

iS Prime co-founders Raj Sitlani and Jonathan Brewer leave, but “business as usual”

“For our clients and teams at iS Prime, iS Risk and iS Prime Hong Kong, it is business as usual. We will be increasing our investment in our technology and staff, putting our clients first as we drive the business forwards to maintain our market leadership position.”

Digital Assets

Germany-focused DekaBank taps METACO for digital asset custody offering

“Digital assets are a critical part of the future, a radical new way for how assets will be represented, from currencies to real estate.”


Eventus launches AML solution for TradFi and digital asset space

“Firms operating in traditional financial markets and digital assets alike are facing greater challenges than ever to protect themselves from those presenting a risk to their businesses and reputations, along with their standing with government regulators.”

Industry News

Qomply launches direct-to-FCA trade report solution that bypasses ARM

“Certainly, for back-reporting large volumes of data, QomplyDirect removes extra ARM fees by offering the flexibility of sending reports directly to the FCA via a firm’s own infrastructure.”

Executive Moves

BNP Paribas AM appoints Geoff Dailey as Deputy Head of US Equities

“Geoff has more than 20 years’ experience in the industry and as a key, senior member of the team with a strong investment pedigree and leadership profile, he is the natural successor for Pam.”

Retail FX

BUX joins forces with BlackRock for iShares ETFs offering in 7 European countries

“By joining forces with Blackrock, a renowned expert in financial markets and products, we have created a good solution for clients that are overwhelmed by the choice of products and don’t know how and when to start investing. Together, BUX and BlackRock can make a real impact on how Europeans invest and approach their financial future.”