WebMap – Large Language Model-assisted Semantic Link Induction in the Web
Shiraj Pokharel, Georg P. Roßrucker, Mario M. Kubek · 2025
Read WebMap – Large Language Model-assisted Semantic Link Induction in the Web by Shiraj Pokharel, Georg P. Roßrucker, Mario M. Kubek (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08763.txt.
Introduction
Shiraj Pokharel, Georg Rossrucker, and Mario Kubek propose new features for WebMap, a system that adds a semantic link layer over the web to help research, in work from 2025. Normal search engines support research tasks poorly. WebMap builds links that show how documents relate in meaning. The add-ons let users find and regroup clusters of documents on the fly. They also add a semantic signpost across the web. A further tool traces a topic back to its origins through linked sources.
Catalog record
| CREATOR | Shiraj Pokharel, Georg P. Roßrucker, Mario M. Kubek |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08763
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WebMap – Large Language Model-assisted Semantic Link Induction in the Web Shiraj Pokharel, Georg P. Roßrucker, Mario M. Kubek Abstract Carrying out research tasks is only inadequately supported, if not hindered, by current web search engines. This paper therefore proposes functional extensions of WebMap , a semantically induced overlay linking structure on the web to inherently facilitate research activities. These add-ons support the dynamic determination and regrouping of document clusters, the creation of a semantic signpost in the web, and the interactive tracing of topics back to their origins. 1 Initial Situation Web search engines exploit the explicit linking structure of the World Wide Web (WWW) to determine the relationships between web documents and assess the relevance and authority of content. Typically, hyperlinks are intentionally created and strategically placed by human efforts. However, it would be beneficial to also use semantically induced links between web documents and their content fragments to indicate topical relations and topically group potentially relevant web search results. This approach could facilitate labor-intensive research processes by automating the identification of relevant connections and topics. Furthermore, as web search engines do not topically group potentially relevant web search results, conducting research using them constitutes a labor-intensive task as it involves having to manually inspect and evaluate the returned results. Therefore, it might be beneficial to return clusters of conceptually similar and related documents that match a query’s intent, too. To this end, in [ 1 ] , we introduced the WebMap , a novel solution to extending the existing linking structure of a hyperlinked network of text documents such as the WWW by a peer-to-peer-based semantic overlay, which induces and represents a distributed graph structure. The paper’s remainder introduces conceptual extensions to WebMap , aimed at enhancing support for research tasks. These extensions, though still in development, are providing functionalities such as dynamic determination and regrouping of document clusters, creation of semantic signposts, and interactive tracing of topics. By conceptualizing these advancements, the paper lays the groundwork for future development and implementation within WebMap to better facilitate research activities on the Web. 2 WebMap’s Architecture The main idea of WebMap is to embed a semantic and meaningful linking mechanism into the existing Web to make navigation and search independent of the existing – rather chronologically evolved – link structure. This is crucial because classical hyperlinks typically point to existing (older) content, putting new content at a disadvantage in terms of discoverability. To achieve this, the global overlay linking structure is designed as a network of so called Cluster Files , generated and provided by the participating peers (web servers). Cluster files are identified by meaningful terms (text-representing centroids, TRCs [ 2 ] ) and consist of two sets of hyperlinks: • a set of links referring to documents (leaves) that are related within the given cluster’s context , and • a set of links pointing to semantically related clusters, realizing traversable, bi-directional edges. Fig. 1 illustrates how the overlaying linking structure of the WebMap extends the present linking structure of the underlying Web. Figure 1: WebMap’s architecture 3 Improving WebMap 3.1 Language Modeling and Large Language Models (LLMs) Let’s take a representative sentence - “A German Shepherd is a [blank]”. Most likely, our guess for [blank] is “dog”, which means that the context provided does not refer to a ”human shepherd with German nationality”. Similarly, assigning a guess or probability to every possible word via mathematical reasoning and computation is called language modeling. Further, language models developed via deep neural networks and the Transformer [ 13 ] architecture with possibly hundreds of billions of programmable connections (called “parameters”) are referred to as Large Language Models (LLMs). Below, we briefly touch upon two of the most successful LLM-families recently. Generative Pre-trained Transformers (GPT) Released by OpenAI, GPTs are types of decoder-only Transformer [ 13 ] -based language models. GPT-1 and GPT-2 are open source while GPT-3 [ 15 ] and GPT-4 [ 16 ] are closed source models [ 14 ] . GPT-3 is the model which excels in tasks that can be provided in natural human language like translation. GPT-4 is a multi-model which can produce text-based outputs from image or text-based inputs. LLaMA Released by Meta, LLaMA [ 17 ] uses the transformer architecture of GPT-3 [ 15 ] , with some modifications in the activation function, positional embeddings and layer-normalization. The latest release is LLaMA-2 [ 18 ] . Thus far, LLaMA models are open-sourced by Meta where the model weights are made publicly available for non-commercial study and research purposes. 3.2 Neural Induction of Local Term Proximity Graphs To derive the globally valid cluster assignment for documents and the necessary relations between clusters, peers of the WebMap make use of individual co-occurrence graphs [ 3 ] that are induced by local text documents and capture simple syntagmatic term relations [ 4 ] . Extracting significant term relations and meaningful topical connections between documents and cluster files therefore greatly depends on the available number, quality, and context of the individual peers’ documents. To obtain more meaningful document assignments and cluster associations in a harmonized manner that is commonly accepted and verifiable, we propose to change the underlying mechanism from using co-occurrence graphs to local term proximity graphs induced by LLMs such as BERT [ 5 ] and its variants, GPT-3 [ 15 ] , GPT-4 [ 16 ] , LLaMA-1 [ 17 ] , LLaMA-2 [ 18 ] , Mistral 7B [ 19 ] , etc. Following the principle of distributional semantics [ 4 ] , LLMs are able to convert input words into (sub)tokens and then into contextualized vector embeddings (high-dimensional real-valued vectors) that capture the words’ meanings in context. To induce the required local term proximity graphs, we hence propose to generally compare the word embeddings of selected and meaningful textual elements such as nouns and proper nouns that appeared together in the local documents using the cosine similarity measure. We will refer to them as terms in the following considerations. The following two approaches to determining the degree of term similarity make sense here: • In the first approach, we compute the embeddings for each occurrence of a selected term in a document. Then, we average these embeddings to create a single term representation for the entire document. After that, we compare the averaged embeddings of each pair of terms using the cosine similarity measure to find out how similar they are in meaning. This method helps us understand their overall semantic relationships within the document. • In the second approach, we compute embeddings for each selected term in the document and compare these embeddings with the embeddings of neighboring terms within each sentence. To address variations in similarity values due to different contexts, we aggregate similarity values for each term pair across multiple occurrences in various contexts. By averaging these similarity values, we obtain a more stable measure of the semantic relationship between terms, which helps capture their general semantic similarity across diverse contexts. In both cases, if the cosine similarity between two elements is higher than a predefined threshold value s , nodes are created for these elements in the local proximity graph and an edge is created between them.