Evaluating AI for Finance: Is AI Credible at Assessing Investment Risk Appetite?

Divij Chawla, Ashita Bhutada *, Do Duc Anh, Abhinav Raghunathan, Vinod SPCathy Guo , Dar Win Liew , Prannaya Gupta, Rishabh Bhardwaj, Rajat Bhardwaj, Soujanya Poria Walled AI Labs Supported by: Infocomm Media Development Authority, Singapore · 2025

Read Evaluating AI for Finance: Is AI Credible at Assessing Investment Risk Appetite? by Divij Chawla, Ashita Bhutada *, Do Duc Anh, Abhinav Raghunathan, Vinod SPCathy Guo , Dar Win Liew , Prannaya Gupta, Rishabh Bhardwaj, Rajat Bhardwaj, Soujanya Poria Walled AI Labs Supported by: Infocomm Media Development Authority, Singapore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18953.txt.

Introduction

Divij Chawla and co-authors test, in a 2025 study, whether AI systems can fairly judge how much investment risk a person can accept. Such judgments gate real financial advice, so they must not swing with traits like country or gender.

The team fed careful user profiles to leading commercial and open models and watched the scores. Changing only a profile's country or gender shifted risk scores widely: one top model rated Nigerian and Indonesian profiles riskier. Some models matched expected scores for low and mid risk, but none stayed consistent across regions and groups. The authors warn current systems break fairness rules in finance.

Catalog record

CREATORDivij Chawla, Ashita Bhutada *, Do Duc Anh, Abhinav Raghunathan, Vinod SPCathy Guo , Dar Win Liew , Prannaya Gupta, Rishabh Bhardwaj, Rajat Bhardwaj, Soujanya Poria Walled AI Labs Supported by: Infocomm Media Development Authority, Singapore
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18953

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating AI for Finance: Is AI Credible at Assessing Investment Risk Appetite? Divij Chawla, Ashita Bhutada *, Do Duc Anh, Abhinav Raghunathan, Vinod SPCathy Guo , Dar Win Liew , Prannaya Gupta, Rishabh Bhardwaj, Rajat Bhardwaj, Soujanya Poria Walled AI Labs Supported by: Infocomm Media Development Authority, Singapore Abstract We assess whether AI systems can credibly evaluate investment risk appetite—a task that must be thoroughly validated before automation. Our analysis was conducted on proprietary systems (GPT, Claude, Gemini) and open-weight models (LLaMA, DeepSeek, Mistral), using carefully curated user profiles that reflect real users with varying attributes such as country and gender. As a result, the models exhibit significant variance in score distributions when user attributes—such as country or gender—that should not influence risk computation are changed. For example, GPT-4o assigns higher risk scores to Nigerian and Indonesian profiles. While some models align closely with expected scores in the Low- and Mid-risk ranges, none maintain consistent scores across regions and demographics, thereby violating AI and finance regulations. Equal contribution, Lead contributors, email: [email protected] 1 Introduction Artificial intelligence (AI)—particularly generative AI powered by large language models (LLMs)—is rapidly reshaping multiple industries. These technologies assist with a variety of complex tasks, from drafting emails and writing code to conducting research—activities that have traditionally required significant time and domain expertise Chiarello et al. (2024) . Recent industry reports underscore AI’s rapid adoption: Gartner predicts over 80% of enterprises will deploy generative AI by 2026 Gartner (2023) , and IDC finds 92% of AI adopters report significant productivity gains—averaging 3.7× ROI, with some achieving tenfold returns IDC (2024) . While these trends highlight AI’s transformative benefits, they also raise critical challenges in high-stakes, regulated sectors like finance. Why Focus on Evaluating AI in Finance? The financial sector handles sensitive personal data and makes decisions with far-reaching consequences. AI is increasingly integrated into processes like credit risk assessment, loan approvals, fraud detection, and investment advisory. However, AI models are not flawless. Inaccurate or biased predictions from these systems can result in serious harms: unfair loan denials, misallocation of capital, discrimination against certain demographic groups, and breaches of regulatory compliance—including frameworks such as the EU AI Act, GDPR (General Data Protection Regulation), Fair Lending Laws (such as the U.S. Equal Credit Opportunity Act (ECOA)), and Monetary Authority of Singapore (MAS) Fairness, Ethics, Accountability and Transparency principles. Investment risk appetite (or risk tolerance ) refers to an investor’s willingness and capacity to endure financial losses or volatility in pursuit of potential returns. We define credibility as the degree to which an AI model accurately predicts an individual’s risk appetite, measured along two axes: 1. Correctness : The extent to which the AI’s predicted tolerance scores align with ideal risk profiles. 2. Consistency : The stability of AI predictions across user characteristics, such as gender and nationality. Thus, we rigorously evaluate the credibility of current AI models in assessing investment risk appetite by asking whether the model predicted scores accurately reflect users’ financial situations and stated preferences (correctness), and whether these predictions remain stable and unbiased across users from different demographic groups, such as gender or country of origin (consistency). To evaluate AI models on the risk tolerance prediction task, we construct a benchmark dataset, FinRiskEval , consisting of 1,720 user profiles. Each profile includes 16 carefully selected features related to financial status, investment goals, and other risk-relevant characteristics, grouped into categories such as financial stability, income, and investment objectives (see Figure 1 ). The profile-specific ground truth tolerance scores are mathematically computed using a total risk score expression ( Section 3 ) that accounts only for relevant user attributes, each weighted by its impact on the overall score. FinRiskEval captures a diverse population spanning 10 countries with balanced gender representation, enabling robust testing of AI models across a wide range of realistic financial scenarios and demographic groups. Our analysis of eight leading AI models (e.g., GPT, Claude, DeepSeek) uncovers heterogeneous yet interesting findings. Models such as GPT-4o demonstrate strong alignment with true risk tolerance scores for low (conservative)- and mid (moderate)-risk profiles. However, some models exhibit demographic biases; for example, GPT-4o tends to assign higher risk scores to Nigerian and Indonesian profiles, while open-weight models like LLaMA and DeepSeek display inconsistent gender-based scoring trends. Overall, no AI system consistently produces unbiased, accurate risk scores across all demographic groups and countries. These findings highlight the pressing need for standardized evaluation protocols to rigorously benchmark AI systems on fairness and accuracy, as well as improved training and calibration methods to reduce bias and enhance reliability. Additionally, transparent reporting mechanisms are essential to foster trust among users and regulators. 2 Investment Risk Tolerance To benchmark AI models on investment risk tolerance assessment, we first identify the most relevant user features. Our selection draws from regulatory standards FINRA (2012) ; FCA (2018) ; ESMA (2023) ; FSA (2022) ; MAS (2023) , academic research, and industry practices Grable and Lytton (1999) ; Farrell (2006) ; Stanley and Danko (1996) ; Larimore et al. (2009) ; Markowitz (1952) . Together, these sources provide a coherent framework for determining the core variables that influence an individual’s risk appetite and capacity. We discuss these frameworks in detail in section A.2 3 Tolerance Score We quantify the impact of these user features on risk tolerance score by using structured scoring system that evaluates five core dimensions: Personal & Financial Stability ( PFS ), Investment Strategy & Objectives ( ISO ), Liquidity & Asset Allocation ( LAA ), Market & Currency Risks ( MCR ), and Dependency on Investments ( DOI ). The Risk Tolerance ( RT ) score is calculated using the following formula: \textsc{RT}{}=\text{PFS}+\text{ISO}+\text{LAA}+\text{MCR}+\text{DOI}. Notably, RT does not depend on user demographic features such as country or gender. In this study, we evaluate AI systems based on how they compute RT and whether user demographics play any role in this process. Figure 1: Factors determining investment risk profile. 4 FinRiskEval FinRiskEval consists of user profiles with diverse features relevant for determining the RT score, as well as demographic attributes that should not influence the computation. Each feature (shown in Figure 1 ) is assigned a numeric value (from –2 to +2) based on its intensity for a given user. This results in a diverse set of user profiles with scores ranging from –14 (minimum possible RT) to 28 (maximum possible RT), thus covering the full spectrum of risk appetites. Based on the ground truth RT score, users are categorized into three risk profiles: Conservative (–14–5), Moderate (6–15), and Aggressive (16–28). Personal & Financial Stability. This category assesses an individual’s financial stability and capacity for risk. Younger individuals (under 30) receive +2 points for their higher risk tolerance, while those over 50 generally receive 0. Users without dependents gain +2 points due to greater financial flexibility, whereas those with dependents get –1. High income (above $100K) earns 2 points, while low income (under $50K) results in –1. Debt-to-asset ratios below 20% indicate strong financial footing (+2), whereas ratios above 40% suggest financial vulnerability (–2). Finally, users with expense-to-income ratios below 30% suggests readiness for risk (+2 points), while exceeding 50% indicates constraints (–2). Investment Strategy & Objectives. This category evaluates the investor’s investment goals and strategy.

Read the complete text