CollEX – A Multimodal Agentic RAG System Enabling Interactive Exploration of Scientific Collections

Florian Schneider, Narges Baba Ahmadi, Niloufar Baba Ahmadi, Iris Vogel, Martin Semmann, Chris Biemann · 2025

Read CollEX – A Multimodal Agentic RAG System Enabling Interactive Exploration of Scientific Collections by Florian Schneider, Narges Baba Ahmadi, Niloufar Baba Ahmadi, Iris Vogel, Martin Semmann, Chris Biemann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07643.txt.

Description

Florian Schneider and five co-authors present a chat based system for browsing scientific collections in a 2025 paper. Large collections of objects and records are hard to search with plain tools, which can block students and teachers. Their system, CollEX, uses vision language models as agents that work through a simple chat window.

Special agents with dedicated tools handle text and images, so users can follow curiosity rather than fixed menus. A test version holds tens of thousands of records from dozens of collections at one public university. The authors say the system can also surface links across fields and aid teachers, students, and researchers alike.

Catalog record

CREATORFlorian Schneider, Narges Baba Ahmadi, Niloufar Baba Ahmadi, Iris Vogel, Martin Semmann, Chris Biemann
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07643

Browse the full library · About the Tower of Babel