Beyond Semantic Similarity: A Two-Phase Non-Parametric Retrieval Workflow for Corporate Credit Underwriting

2026

Read Beyond Semantic Similarity: A Two-Phase Non-Parametric Retrieval Workflow for Corporate Credit Underwriting (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20684.txt.

Introduction

Linus Ng Junjia and four colleagues tackle retrieval for corporate credit underwriting, where analysts mine long, multilingual financial files. Standard retrieval ranks by meaning similarity, which often surfaces passages that are on-topic but useless for a decision. Their two-phase design first gathers a broad pool with word-based and dense multilingual retrieval. A controller then filters by query intent and file structure, and a judge model ranks passages by use for analysis.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19850
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20684

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Semantic Similarity: A Two-Phase Non-Parametric Retrieval Workflow for Corporate Credit Underwriting Abstract \icmlsetsymbol equal* {icmlauthorlist} \icmlauthor Linus Ng Junjiaocbcpresenting \icmlauthor Ezekiel Tee Kongquanocbc,gatech \icmlauthor Kelvin Hengocbc \icmlauthor Kenneth Zhu Keocbc \icmlauthor Zhao Jing Yuanocbc \icmlaffiliation ocbcOCBC, Singapore \icmlaffiliation gatechGeorgia Institute of Technology \icmlcorrespondingauthor [email protected] \icmlcorrespondingauthor [email protected] \icmlcorrespondingauthor [email protected] \icmlcorrespondingauthor [email protected] \icmlcorrespondingauthor [email protected] \printAffiliations 1 Introduction Corporate credit underwriting relies heavily on the analysis of long-form financial documents such as annual reports and industry reports [ 5 ] . Analysts must extract relevant financial indicators, assess risk disclosures, and synthesize insights from documents that can span hundreds of pages and multiple languages [ 5 ] . Retrieval-Augmented Generation (RAG) systems have emerged as a promising approach to assist document-intensive workflows [ 3 , 2 ] . By retrieving supporting passages from external corpora, RAG systems can improve factual grounding and reduce hallucination in language model outputs [ 3 , 2 ] . However, standard RAG pipelines typically prioritize semantic similarity between queries and document passages [ 3 ] . In financial analysis tasks, this objective often fails to align with the needs of analysts [ 5 ] . Financial documents often contain narrative descriptions, regulatory disclosures, and repetitive boilerplate language [ 5 ] . As a result, similarity-based retrieval systems may surface passages that share terminology with the query but lack actionable analytical value [ 6 ] . We refer to this issue as the similarity–utility gap [ 6 ] . To address this challenge, we propose a retrieval architecture designed specifically for enterprise decision-support workflows [ 6 ] . Our system introduces a two-phase pipeline that separates high-recall retrieval from high-precision utility ranking [ 6 ] . The architecture incorporates hybrid lexical-semantic retrieval, adaptive candidate refinement, and a utility-grounded ranking framework in which a language model evaluates passages according to their analytical usefulness [ 5 , 6 ] . The system is designed for deployment in regulated financial environments and operates entirely on-premise using self-hosted open-source models. This ensures compliance with strict data governance policies while maintaining high retrieval performance. Our main contributions are: • A utility-grounded retrieval framework that aligns passage ranking with decision usefulness in credit underwriting tasks. • An adaptive retrieval controller that filters candidate passages using query intent and document structure signals. • A context-aware extraction module that preserves structural information in narrative and tabular financial content. • An enterprise deployment demonstrating large productivity gains for analysts. 2 Related Work Retrieval-Augmented Generation has become a widely adopted approach for grounding large language models in external knowledge sources [ 3 , 2 ] . Early work introduced dense retrieval methods using neural embeddings to retrieve semantically relevant passages from large corpora [ 3 ] . Hybrid retrieval approaches combining lexical search with dense embeddings have further improved recall in heterogeneous document collections [ 4 ] . Recent research has explored the use of language models as evaluators for ranking retrieved content [ 7 ] . These LLM-as-a-Judge approaches leverage the reasoning capabilities of language models to assess the quality and relevance of candidate passages [ 7 ] . Such methods have been applied in question answering, information retrieval evaluation, and ranking tasks. In enterprise settings, RAG systems must also address constraints related to data governance, privacy, and auditability. Financial and legal institutions often require on-premise deployment and traceable source attribution, which introduces additional design considerations beyond model performance. Our work contributes to this literature by proposing a retrieval architecture that explicitly optimizes for analytical utility in enterprise workflows. By combining hybrid retrieval, adaptive candidate control, and utility-based ranking, the system prioritizes passages that contain actionable financial evidence rather than merely semantically similar text. 3 Methodology 3.1 Problem Setting Corporate credit underwriting requires analysts to justify reported financial statements derived from long, heterogeneous financial documents such as annual reports and industry reports. These documents often contain dense narrative sections, multilingual commentary, and unstructured financial tables. Traditional RAG pipelines retrieve passages based primarily on semantic similarity, which frequently results in content that is topically related but not useful for decision-making. We formalize the task as retrieving and ranking a set of document segments that maximize decision utility rather than semantic similarity. Given a user query q and a corpus of long financial documents D=\{d_{1},d_{2},...,d_{n}\} , the objective is to identify a set of passages P^{*}\subset D that contain verifiable evidence relevant to credit underwriting decisions. Our system introduces a two-phase retrieval and re-ranking architecture designed to bridge the gap between semantic similarity and decision utility while operating entirely within an on-premise environment. 3.2 System Overview The proposed architecture consists of five main components: document ingestion, hybrid candidate retrieval, adaptive retrieval controller, utility-grounded re-ranking, and context-aware evidence extraction. The overall pipeline is illustrated conceptually as: q_{\text{statement}}\rightarrow R_{\text{hybrid}}(D)\rightarrow C_{\text{adaptive}}\rightarrow J_{\text{utility}}\rightarrow E_{\text{context}} where q_{\text{statement}} a query supplemented with its corresponding financial statement, R_{\text{hybrid}} retrieves an initial candidate pool, C_{\text{adaptive}} filters candidates using query-aware reasoning, J_{\text{utility}} ranks candidates by decision usefulness, E_{\text{context}} extracts the final evidence 3.3 Document Ingestion Corporate financial documents are segmented into structured sections using document layout cues. Each segment is indexed with metadata that include the source of the document, the title of the section, and the page references. This preprocessing step ensures that downstream components can leverage structural information during retrieval and extraction. 3.4 Phase 1: Hybrid Candidate Retrieval The first phase performs broad retrieval to maximize recall across multilingual and heterogeneous financial documents. Given a query q , we retrieve an initial candidate set C_{0} using a hybrid retrieval strategy that combines keyword retrieval and dense semantic retrieval using multilingual embeddings: C_{0}=\text{TopK}_{\text{kw}}(q,D)\cup\text{TopK}_{\text{embed}}(q,D) In Hybrid retrieval, keyword retrieval preserves precision for financial terminology, while semantic retrieval captures paraphrased or contextual references. The choice of the TopK value represents a critical hyperparameter at this stage: setting it too low risks restricting the candidate pool passed to the subsequent phases, while setting it too high diminishes the value of initial retrieval. With a TopK value set to 50, the result is a high-recall candidate pool of passages for further processing. 3.5 Phase 2: Adaptive Retrieval Controller & Utility-Grounded Re-ranking Not all retrieved passages are useful for credit analysis. Financial reports contain boilerplate disclosures, legal notes, and narrative sections that may be semantically related to a query, but irrelevant to underwriting decisions. To address this issue, we introduce an adaptive retrieval controller that evaluates candidate passages using query intent and document structure. Given candidate passages C_{0}=\{p_{1},...,p_{k}\} , the controller predicts relevance and support for a given passage: Rel_{i}=f(q_{\text{statement}},p_{i},m_{i}) S_{i}=f(q_{\text{statement}},p_{i},m_{i}) U_{i}=f(q_{\text{statement}},p_{i},m_{i}) where: • q_{\text{statement}} is a query supplemented its corresponding financial statement • p_{i} is the candidate passage • m_{i} represents structural metadata • Rel_{i} represents relevancy (boolean) of candidate passage • S_{i} represents evidence support (boolean) of candidate passage • U_{i} represents utility score (numerical score) of candidate passage The controller is implemented using a lightweight language model that evaluates whether a passage is likely to contain relevant and supportive information. This stage produces a refined candidate set: C_{1}=\{p_{i}\in C_{0}\mid(S_{i})\cdot[Rel_{i}]\} where S_{i}\cdot[Rel_{i}] represents the logical condition that S_{i} is effectively nullified unless Rel_{i} succeeds. This mechanism is conceptually related to adaptive retrieval strategies that condition retrieval on model reasoning rather than fixed pipelines [ 1 ] . The remaining candidates

Read the complete text