Cosmos 1.0: a multidimensional map of the emerging technology frontier

Xian Gong, Paul X. McCarthy, Colin Griffith, Claire McFarland, Marian-Andrei Rizoiu · 2025

Read Cosmos 1.0: a multidimensional map of the emerging technology frontier by Xian Gong, Paul X. McCarthy, Colin Griffith, Claire McFarland, Marian-Andrei Rizoiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10591.txt.

Introduction

Xian Gong and four co-authors map the emerging technology landscape as data in a 2025 paper. Tracking which technologies are rising, and how they connect, is hard across scattered sources. A shared map would help researchers, firms, and policymakers see the frontier whole.

Their data set holds over twenty-three thousand technology-adjacent entities in a hierarchy. Each entity becomes a hundred-number embedding drawn from rich source text. Clusters group the entities into seven themes and three broader meta-clusters. One hundred emerging technologies were hand-checked as anchors. Extra indices grade each technology's awareness, generality, and depth. Links to encyclopedia, company, and scholarly data validate the map's reach and accuracy.

Catalog record

CREATORXian Gong, Paul X. McCarthy, Colin Griffith, Claire McFarland, Marian-Andrei Rizoiu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10591

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cosmos 1.0: a multidimensional map of the emerging technology frontier Xian Gong, Paul X. McCarthy, Colin Griffith, Claire McFarland, Marian-Andrei Rizoiu Abstract This paper introduces the Cosmos 1.0 dataset and describes a novel methodology for creating and mapping a universe of technologies, adjacent concepts, and entities. We utilise various source data that contain a rich diversity and breadth of contemporary knowledge. The Cosmos 1.0 dataset comprises 23,544 technology-adjacent entities (TA23k) with a hierarchical structure and eight categories of external indices. Each entity is represented by a 100-dimensional contextual embedding vector, which we use to assign it to seven thematic tech-clusters (TC7) and three meta tech-clusters (TC3). We manually verify 100 emerging technologies (ET100). This dataset is enriched with additional indices specifically developed to assess the landscape of emerging technologies, including the Technology Awareness Index, Generality Index, Deeptech, and Age of Tech Index. The dataset incorporates extensive metadata sourced from Wikipedia and linked data from third-party sources such as Crunchbase, Google Books, OpenAlex and Google Scholar, which are used to validate the relevance and accuracy of the constructed indices. Background & Summary Emerging technologies have been shown to deliver the greatest benefits to the economy and society when understood and adopted early, resulting in improved health, environmental outcomes, economic growth, and sustained innovation [ 1 , 2 ] . In the era of the Fourth and even Fifth Industrial Revolution (Industry 4.0 and 5.0), researchers are delving deeply into defining what constitutes emerging technologies [ 3 , 4 ] . These technologies may be entirely new innovations or reimagined applications of existing technologies. Their critical role in national competitiveness [ 5 , 6 ] and a firm’s innovative growth [ 7 ] is increasingly evident. We can see this with the digital transformation of the retail industry. Traditional store-based retailers who adopted the Internet as a communication channel and formed e-alliances experienced a positive impact on firm performance. This is supported by a study reviewing 181 companies across multiple countries, demonstrating the broad impact of digital adoption in the retail sector [ 8 ] . Technologies related to artificial intelligence, smart devices, information and communication technologies, new materials, robotics, automation, sensors, and mechatronics, among others, are proving to be pivotal elements in the competitiveness of both developed and emerging economies [ 4 ] . Both qualitative and quantitative methods are currently used to identify emerging technologies. Traditionally, the most common way is to use qualitative "top-down" processes with panels of experts discussing and voting on critical technologies and themes. Many leading global organisations use this approach, for example, the Organisation for Economic Co-operation and Development (OECD), World Economic Forum (WEF), and MIT Technology Review each produce annual reports on emerging technologies [ 9 , 10 , 11 ] . The best-typified one is the Delphi method, a structured methodology designed to systematically elicit and refine the opinions of experts through iterative rounds of questionnaires and controlled feedback [ 12 ] . Quantitative methods evolve rapidly with text analysis and deep learning techniques. There are two main limitations in current methods of identifying emerging technologies: the types of data used and the "top-down" methodology applied. At an early stage, most data used to explore emerging technologies started with publications, patent information, News articles or a mix of these [ 13 , 14 ] . Counts of keywords, authors, publications, citations, patents, or even News articles are commonly used as data resources of quantitative methods [ 15 , 16 ] . The development of data analysis tools and methods, including natural language processing (NLP), subject-action-object (SAO) structure, similarity matrix, knowledge networks, full-text analysis, and large language models (LLMs), has the potential to enable the creation of new types of data for detecting emerging technologies [ 17 , 18 ] . The vast majority (89%) of data sources on emerging technology forecasting are related to patents, publications and News articles [ 19 ] . The rapid advancement of text-mining techniques enhances data diversity and offers new, unique insights into both explicit and latent knowledge about the nature, structure, and functions of emerging technologies. This paper presents a dataset of two broad components. The first comprises entity embeddings of 23k technology-adjacent entities (TA23k) with a hierarchical structure, including an identifiable subset of 100 manually verified, highly recognisable emerging technologies (ET100). The second component is a set of technology indices that can be used to filter both mature and emerging technologies from the universe of technology-adjacent entities. Those indices study the detection and diffusion of technologies ranging from old inventions to the latest advancements in various research and industry fields included in Wikipedia. This dataset aims to help researchers, policymakers, and corporations make informed decisions, allocate resources wisely, and foster the development of these technologies for sustainable growth and competitive advantage. By identifying these emerging technologies early, stakeholders can better prepare for the changes and opportunities they present, encouraging proactive adaptation and strategic planning. This study uses a "bottom-up" approach to identify and explore the underlying structure of technology-adjacent space by leveraging the Wikipedia corpus and NLP techniques. Wikipedia is edited by numerous experts and contains texts from reliable sources [ 20 , 21 ] . For most technologies, Wikipedia provides relevant description text and links relevant articles using hyperlinks. Wikipedia2Vec, a pre-trained language model with entity embeddings, enables us to filter technology-adjacent articles related to emerging technologies based on cosine similarity [ 22 ] . Entity embeddings provide context-specific representations of real-world entities (Wikipedia article) compared to the more generalised semantic and syntactic information captured by word embeddings. After defining a universe of technology-adjacent entities from the Wikipedia corpus, dimensionality reduction algorithms and clustering algorithms are used to detect and visualise the clusters and hierarchical structure among the technology-adjacent space. The output of this "bottom-up" approach is a three-level hierarchical tree called three meta tech-clusters (TC3), seven theme tech-clusters (TC7) and ET100 from top to bottom level. The ET100 at the bottom level are the 100 emerging technologies that have been manually verified from the larger technology-adjacent universe. In the meantime, we manually name the three meta tehc-clusters and the seven theme tech-clusters based on the typical characters of the cluster of those technologies (See Subsection Hierarchical Structure of Emerging Technologies for more details). Moreover, we collect and create a series of external indices for the final dataset (See Section Data Records for more details). The workflow of the Cosmos 1.0 dataset is shown in Figure 1 . Figure 1 : The repeatable workflow of creating and mapping the Cosmos 1.0 Dataset. It illustrates the simplified process of data collection, taxonomy, all features and potential usages of the Cosmos 1.0 dataset. Methods We aim to leverage large language models to automatically identify rising technologies across a broad spectrum of research areas instead of concentrating on just one area or limiting ourselves to technologies that have only recently gained popularity. Current lists of emerging technologies [ 23 , 24 , 25 ] are often limited and lack depth and complex categorisation. We use insights from language models to streamline the exploration of emerging technologies and to categorise them into clusters with machine-learning methods. We also construct technology indices from reliable third-party sources to quickly and accurately

Read the complete text