GRASP: Municipal Budget AI Chatbots for Enhancing Civic Engagement
Jerry Xu 1, Justin Wang 1, Joley Leung 2, Jasmine Gu 2 · 2025
Read GRASP: Municipal Budget AI Chatbots for Enhancing Civic Engagement by Jerry Xu 1, Justin Wang 1, Joley Leung 2, Jasmine Gu 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23299.txt.
Introduction
Jerry Xu and co-authors present a 2025 paper on a chatbot that answers questions about town budgets. Many residents care about local spending but find budget documents hard to follow. General chatbots and web search often give wrong or vague answers on such narrow topics.
Their system, GRASP, pairs a retrieval-augmented generator with an agent workflow that can take steps to answer. It adds careful prompt design, budget knowledge, and checks with town officials. In tests, GRASP answered local budget questions correctly 78 percent of the time. Two leading general models scored 60 and 35 percent. The authors say the tool can cut the time residents spend hunting for clear budget facts.
Catalog record
| CREATOR | Jerry Xu 1, Justin Wang 1, Joley Leung 2, Jasmine Gu 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-23299
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GRASP: Municipal Budget AI Chatbots for Enhancing Civic Engagement Jerry Xu 1, Justin Wang 1, Joley Leung 2, Jasmine Gu 2 Abstract There are a growing number of AI applications, but none tailored specifically to help residents answer their questions about municipal budget, a topic most are interested in but few have a solid comprehension of. In this research paper, we propose GRASP , a custom AI chatbot framework which stands for G eneration with R etrieval and A ction S ystem for P rompts. GRASP provides more truthful and grounded responses to user budget queries than traditional information retrieval systems like general Large Language Models (LLMs) or web searches. These improvements come from the novel combination of a Retrieval-Augmented Generation (RAG) framework (“Generation with Retrieval”) and an agentic workflow (“Action System”), as well as prompt engineering techniques, the incorporation of municipal budget domain knowledge, and collaboration with local town officials to ensure response truthfulness. During testing, we found that our GRASP chatbot provided precise and accurate responses for local municipal budget queries 78% of the time, while GPT-4o and Gemini were only accurate 60% and 35% of the time, respectively. GRASP chatbots greatly reduce the time and effort needed for the general public to get an intuitive and correct understanding of their town’s budget, thus fostering greater communal discourse, improving government transparency, and allowing citizens to make more informed decisions. I Introduction In modern democracies, accessing municipal budget information has become much easier. The main challenge with promoting public awareness of this information now lies in the efficient browsing of the vast amount of information online, and the derivation of comprehensible and accurate summaries of this information. Many local governments release annual budget documents that detail the financial plans for the upcoming fiscal year, as well as provide budget information from previous years. However, despite these documents being available to the public, challenges still remain for users wishing to find accurate budget information. For instance, web searches can direct users to unofficial or outdated documents, and in most general large-language models (LLMs) like ChatGPT, their knowledge base is not updated frequently enough to account for document revisions or newly-released documents. It is crucial that citizens are informed based solely on official and up-to-date documents to ensure that the information they are receiving is as accurate as possible. Even users looking at the latest documents may experience difficulties. For example, lookup in documents (e.g. by “CTRL+F searching”) uses plaintext search rather than semantic search. Therefore, a user investigating the total budget allocated to their municipal public schools may search for “total school budget” rather than “total education budget”, and hence be unable to find the statistic even though the two queries effectively mean the same thing. Another complication in accuracy arises when considering the distinction between “actual” and “projected” values. For example, if someone wishes to find information on the municipal school budget for 2024, they would likely go to the FY2024 budget document. However, since budget documents are made before the fiscal year in question, the value listed in the FY2024 document is merely a projected value. The true value could be found in the FY2025 document after the 2024 fiscal year had ended and the actual budget total was tallied. This is another common pitfall of both web searches and general LLMs. These factors contribute to the overall decrease in public understanding of how their local government allocates its budget, highlighting the need for more intuitive and context-aware information retrieval systems. A chatbot has the potential to resolve those challenges. It is clear that an LLM can process and summarize large amounts of data much more quickly than a human ever can, so the key to creating an ideal informational chatbot is to ensure that its responses are both truthful and grounded (i.e. they are not hallucinations). Our research paper makes two key contributions. First, we propose the GRASP framework to improve the accuracy, completeness, and groundedness of information retrieval systems focusing on the domain of municipal budget, thus increasing resident trust. Secondly, we ensure GRASP is highly generalizable for all towns and cities. II Related Works Our GRASP framework encompasses all of the following topics: II-A Overview of Chatbots Powered by Large Language Models (LLMs) LLMs, such as GPTs (Generative Pre-trained Transformers), represent the forefront of advancements in AI’s ability to process and understand natural language. These models have provided chatbots with the ability to understand and generate human-like responses [ 8 ] . LLMs utilize multiple layers of neural networks, including embedding layers, attention layers, and feed-forward networks, which work together to process input text and generate output content [ 10 ] . Additionally, LLMs are pre-trained on vast textual datasets sourced from the internet, encompassing trillions of words. Studies have evaluated how these models can enhance the accuracy and efficiency of information retrieval [ 3 ] . However, LLMs suffer from hallucinations, moments when the model generates an output that is factually incorrect or fabricated due to the biases or incomplete information present in their training datasets [ 5 ] , thus presenting the need for Retrieval Augmented Generation (RAG). II-B Retrieval-Augmented Generation (RAG) – Optimized LLMs The concept of retrieval-augmented generation was first introduced by Lewis et al. (2021) [ 7 ] . RAG systems introduce a mechanism to retrieve from authoritative external knowledge bases, reducing hallucinations that traditional LLMs suffer from. In addition to hallucinations, traditional LLMs may also contain different versions of a dataset from what is specified as their “cutoff” date, providing users with misleading and incorrect data [ 1 ] . While Fine-Tuning (Dodge et al.,2020) [ 2 ] can be used to inject new knowledge into pre-trained LLMs through a series of specialized training [ 11 ] , RAG systems exhibited higher levels of efficiency and accuracy in responses, consistently outperforming fine-tuned models [ 6 ] [ 11 ] . Because of the various advantages that RAG systems have in retrieving the most up-to-date information, we chose RAG to be the basis of our town budget chatbot. II-C ReAct Agents The ReAct (or ReAct agent) paradigm combines an LLM’s abilities to reason and create action plans, proposing that an agent performs tasks via repeated thoughts-action-observation steps. Specifically, the thoughts step allows for the creation and adaptation of action plans, the action step performs tasks such as gathering information from external sources like knowledge bases, and the observation step analyzes the action’s output and determines if more thoughts-action-observation steps are necessary to respond to the user (iterative refinement) [ 13 ] . ReAct proved to be a capable tool for question-answering and fact verification, for which it utilized HotpotQA [ 12 ] and Fever [ 9 ] respectively. Additionally, when tested against imitation and reinforcement learning models, ReAct outperformed both by an absolute success rate of 34 percent and 10 percent respectively. II-D State of the Art of RAG systems in Government In Brazil, 20 percent of the Public Administration’s estimated 13 trillion USD annual spending is allocated to public works. However, unfinished work is commonplace for legal reasons, including corruption, negatively impacting the entire region. In 2024, Honório et al. created a chat assistant trained on data from Brazilian