Disrupt Your Research Using Generative AI Powered ScienceSage
Yong Zhang, Eric Herrison Gyamfi, Kelly Anderson, Sasha Roberts, Matt Barker · 2025
Read Disrupt Your Research Using Generative AI Powered ScienceSage by Yong Zhang, Eric Herrison Gyamfi, Kelly Anderson, Sasha Roberts, Matt Barker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18479.txt.
Introduction
Yong Zhang and co-authors present ScienceSage, a web app that puts generative AI inside a researcher's own knowledge base, in this 2025 paper. Users load documents, images, audio, and video; the app extracts their content into two indexes, one for vector search and one as a knowledge graph. Web-fetched research reports can join the base too.
Three tools share the base: drafting research reports, chatting with one's documents, and chatting with anything at hand. The authors share the prototype and their lessons, hoping to spur debate on AI's place in speeding and widening research.
Catalog record
| CREATOR | Yong Zhang, Eric Herrison Gyamfi, Kelly Anderson, Sasha Roberts, Matt Barker |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-18479
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Disrupt Your Research Using Generative AI Powered ScienceSage Yong Zhang, Eric Herrison Gyamfi, Kelly Anderson, Sasha Roberts, Matt Barker Abstract Large Language Models (LLM) are disrupting science and research in different subjects and industries. Here we report a minimum-viable-product (MVP) web application called ScienceSage . It leverages generative artificial intelligence (GenAI) to help researchers disrupt the speed, magnitude and scope of product innovation. ScienceSage enables researchers to build, store, update and query a knowledge base (KB). A KB codifies user’s knowledge/information of a given domain in both vector index and knowledge graph (KG) index for efficient information retrieval and query. The knowledge/information can be extracted from user’s textual documents, images, videos, audios and/or the research reports generated based on a research question and the latest relevant information on internet. The same set of KBs interconnect three functions on ScienceSage : ‘Generate Research Report’, ‘Chat With Your Documents’ and ‘Chat With Anything’. We share our learning to encourage discussion and improvement of GenAI’s role in scientific research. ScienceSage Github — https://github.com/zhy5186612/GenAI-ResearchAssistant-ScienceSage Introduction Large Language Models (LLM) are disrupting science and research in different subjects and industries ( Wang et al. 2023 ) . As an example, ChemCrow uses GPT-4 to integrate 18 expert-designed tools to accomplish tasks across organic synthesis, drug discovery and materials design ( M. Bran et al. 2024 ) . There are also tools like ‘REINVENT 4’ specifically designed for a narrow scientific research task. ‘REINVENT 4’ leverages generative AI framework to design small molecules for drug discovery ( Loeffler et al. 2024 ) . LLMs have great potential to disrupt product innovation, consumer research, marketing, and business models etc in consumer packaged goods (CPG) and other industries. These innovation activities generally involve searching, retrieving and summarizing domain specific information and knowledge embedded in multimodal data including text, image, audio and video. The multimodal data could be publicly available on internet and/or proprietary to a specific institution. Retrieval-Augmented Generation (RAG) ( Guu et al. 2020 ) is commonly used to retrieve relevant information from user’s documents and then generate an response to answer a query ( Chen et al. 2023 ) . A regular RAG can indeed generate a response to answer user’s question. However, most of time the answer is a simple paragraph. A researcher may want to have more details about his query. It could be a reference to verify the answer, or facts and mechanism to interpret the answer. Rather than a simple answer, a researcher may also want to have a structural report containing title, sub-title, discussion, conclusion and references etc. Furthermore, the information and knowledge contained in LLMs or user’s data can be outdated. Knowledge from LLMs like ChatGPT generally has a cutoff time for obtaining the training data. Likewise for user’s multimodal data, as an example, a researcher may not be aware of some of the latest articles or technical reports on a given topic. We need capabilities and tools to quickly retrieve the latest relevant information and digest this information for insights. We designed and built a MVP web application ScienceSage to address the above challenges. We first elaborate on the architecture and functionality of this MVP web application. We then proceed to show our evaluations on the RAG component. After briefly mentioning the usage of ScienceSage , we finally discuss challenges, future improvement plans and conclude the article. ScienceSage web application User interface Figure 1 shows the user interface of ScienceSage . The ‘Quick Start Menu’ provides high level explanation of ScienceSage and example questions, demo data, and video to enable quick test use and DIY applications. The ’Generate Research Report’ tab can generate a comprehensive research report based on a user’s research question and the latest information on internet. ScienceSage enables users to edit the built-in prompt template to quickly customize their own report without worrying about the coding and information retrieval. The ’Chat With Your Documents’ tab enables a user to upload their own documents and then chat with a RAG to get quick and concise answers with references and/or a knowledge graph from these documents. The ‘Chat With Anything’ enables a user to upload multimodal data (text, image, audio & video) and then chat with them to get insights. A common set of knowledge bases are used to interconnect ‘Generate Research Report’, ‘Chat With Your Document’ and ‘Chat With Anything’. Users can choose to use an existing KB or to create a new KB as needed. Users can chat with that KB, also store and update knowledge in that KB. The knowledge can be extracted from either user’s multimodal data or research reports generated by ScienceSage . Users don’t have to upload all multimodal data all at once. Practically, it is good to build and update the KB incrementally as it both smooth computational burden and ease user’s effort to curate all data at once. Figure 1: ScienceSage web application For generating a research report, ScienceSage always searches the internet or scientific databases to get the latest information. We designed multi-stage prompts to instruct the LLM to generate a structural and comprehensive research report. It has a hierarchical structure such as title, subtitles, conclusion etc. It also lists the top relevant references. ScienceSage first decomposes the question into a number of queries and then searches the internet. It then return the top relevant urls where the contents are scraped. The scraped websites are then summarized. Finally a comprehensive and structural report is generated using the summaries with the urls as references. Users can set the number of queries and the number of top relevant websites. Users can also limit the search to scientific papers in arXiv database. In that case, the relevant papers are retrieved, summarized, referenced and used to generate the report. The generated report is downloadable and is also automatically saved and indexed in the corresponding KB. The ’Chat With Your Documents’ is achieved through a RAG which can only consume textual data. Users can choose to use a RAG based on vector index, knowledge graph (KG) index or a custom index combining both vector index and KG index. These indices are saved in the corresponding KB selected by users. All three indices are detailed in the section of RAG evaluation. The ‘Chat With Anything’ is achieved through a multimodal RAG. It builds a multimodal index based on any single modality or combination of modalities of data. For now, this multimodal index is session based and we are testing to store and update it in LanceDB. ScienceSage does not save the picture, audio and video data. Instead, it saves indexes of the transcribed text data from both audio and video data in the corresponding KB selected by users. Architecture Figure 2 depicts the architecture of ScienceSage . Streamlit was used to develop the front end user interface in figure 1 . ScienceSage currently supports ChatGPT4 and GPT4-Vision through Azure and a privately deployed LLM Mixtral_8X7B. These are some of the best performing commercial and open source LLMs, respectively. It uses the multilingual Hugging Face all-distilroberta-v1 model as its text embedding model ( Wolf et al. 2020 ) , and open source CLIP model as its image embedding model ( Wolf et al. 2020 ) .