Singapore’s Central Bank Caution: AI Not Yet Ready for Monetary Policy, Warns Experts

Written Posted on

Edwards therefore suggested the best role for current LLMs in central bank modelling toolkits “is to use them in satellite models that complement core structural models.”

Singapore's Central Bank Caution

Singapore’s Central Bank Caution: According to a senior policymaker at Singapore’s central bank, the Monetary Authority, artificial intelligence technology is not yet appropriate for policy development.

“Central banks have had to answer difficult questions over the past year about our collective failure to foresee the persistence of inflation after the pandemic, which has undermined the usefulness of our models,” Edward S Robinson, deputy managing director for economic policy at the Monetary Authority, said in a speech at the National University of Singapore’s 2024 Advanced Workshop for Central Bankers on Monday.

Singapore’s Central Bank Caution: AI Not Yet Ready for Monetary Policy, Warns Experts

“Consequently, we may ask if economists should be paying more attention to recent advances in data analytics and artificial intelligence (AI) technologies to improve our forecasts and models,” he added.

The answer to that question is yes – and no.

AI has already demonstrated that it can help policymakers, which is why he said “yes.”.

Check Out: China’s AI Surgical Breakthrough: Meta’s Llama 2.0 Powers Revolutionary Chatbot Assistance

“AI/ML techniques have been used to identify anomalous financial transactions, help supervisors sift through large volumes of text data submitted by financial institutions to identify vulnerable areas, and generate dynamic measures of inflation expectations using social media posts,” he explained.

Edwards then praised AI/ML modelling approaches for “their ability to let the data flexibly determine the functional form of the model,” as that capability “potentially allows AI/ML models to capture non-linearities in economic dynamics in a way that mimics expert (human) judgement.”

Generative AI goes even further: “State-of-the-art large language models trained on vast amounts of data can generate alternate scenarios, specify and simulate basic economic models and beat experts at forecasting inflation,” he enthused.

But LLMs have limitations, so Edwards also offered a “no.”

“The flexibility of this class of models is also a drawback: AI/ML models can be ‘fragile’ in that their output is often highly sensitive to the choice of model parameters or prompts provided,” Edwards observed. Combined with opacity of output, “this flaw makes it difficult to parse the underlying drivers of the process being modelled.”

He also noted that current LLMs “struggle with logic puzzles and mathematical operations, suggesting that they are not yet capable of providing credible explanations for their own predictions.”

Edwards therefore suggested the best role for current LLMs in central bank modelling toolkits “is to use them in satellite models that complement core structural models.”

“Beyond using AI techniques independently for forecasting tasks, this could extend to ‘semi-structural’ approaches connecting AI methods to economic theory.” He also sees “promising applications” for deep learning as a tool to “estimate economic relationships, such as the Phillips Curve, that underpin standard macroeconomic models.”

According to Edwards, MAS’s current models “rigorously incorporating the most relevant new developments, while retaining their core theoretical foundations.” He said, “As the central bank develops a deeper understanding of artificial intelligence, we could begin to integrate it into our workhorse models.”.”

Check Out: The Future of Learning: Reskilling and Rethinking in the AI Age

As long as organizations like MAS intervene to ensure the technology works, he said, policymakers’ efficiency could be improved.

In general, he viewed AI as a positive development for MAS.

“The path ahead for economic modelling is an exciting one,” he concluded. “Ongoing shifts in the global economy are throwing up new questions for our models, and the techniques we can bring to bear to answer them grow ever richer.”

Loading more posts...