UrbanMoE: A Sparse Multi-Modal Mixture-of-Experts Framework for Multi-Task Urban Region Profiling Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirat

Pingping Liu, Jiamiao Liu, Zijian Zhang, Hao Miao, Qi Jiang, Qingliang Li, Qiuzhan Zhou, Irwin King · 2026

Read UrbanMoE: A Sparse Multi-Modal Mixture-of-Experts Framework for Multi-Task Urban Region Profiling Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirat by Pingping Liu, Jiamiao Liu, Zijian Zhang, Hao Miao, Qi Jiang, Qingliang Li, Qiuzhan Zhou, Irwin King (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22746.txt.

Introduction

Pingping Liu and a large team built UrbanMoE, a sparse mixture-of-experts frame that profiles city zones across many tasks at once. Region profiling guides planning and resource use. Their 2026 preprint notes that most tools do one task at a time, missing how a zone's traits interlock.

Their frame mixes data of many kinds and routes each zone to expert sub-models. Joint profiling should catch links a single-task tool would miss. Cities could then plan housing, transit, and services as one problem. The work fits the multi-faceted truth of urban life. It is built for breadth.

Catalog record

CREATORPingping Liu, Jiamiao Liu, Zijian Zhang, Hao Miao, Qi Jiang, Qingliang Li, Qiuzhan Zhou, Irwin King
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22746

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UrbanMoE: A Sparse Multi-Modal Mixture-of-Experts Framework for Multi-Task Urban Region Profiling Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates. Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates ISBN: 979-8-4007-2307-0/2026/04 DOI: 10.1145/3774904.3792701 CCS: Information systems Geographic information systems Pingping Liu, Jiamiao Liu, Zijian Zhang, Hao Miao, Qi Jiang, Qingliang Li, Qiuzhan Zhou, Irwin King Abstract . Urban region profiling, the task of characterizing geographical areas, is crucial for urban planning and resource allocation. However, existing research in this domain faces two significant limitations. First, most methods are confined to single-task prediction, failing to capture the interconnected, multi-faceted nature of urban environments where numerous indicators are deeply correlated. Second, the field lacks a standardized experimental benchmark, which severely impedes fair comparison and reproducible progress. To address these challenges, we first establish a comprehensive benchmark for multi-task urban region profiling, featuring multi-modal features and a diverse set of strong baselines to ensure a fair and rigorous evaluation environment. Concurrently, we propose UrbanMoE, the first sparse multi-modal, multi-expert framework specifically architected to solve the multi-task challenge. Leveraging a sparse Mixture-of-Experts architecture, it dynamically routes multi-modal features to specialized sub-networks, enabling the simultaneous prediction of diverse urban indicators. We conduct extensive experiments on three real-world datasets within our benchmark, where UrbanMoE consistently demonstrates superior performance over all baselines. Further in-depth analysis validates the efficacy and efficiency of our approach, setting a new state-of-the-art and providing the community with a valuable tool for future research in urban analytics 1 1 1 The code is available at https://github.com/JLU-LJM/UrbanMoE . † † cc-license: by 1. INTRODUCTION Urban region profiling, which aims to understand and quantify the fine-grained characteristics of urban areas, is a cornerstone of modern urban computing. Accurate estimations of metrics such as population density ( 8 ; 13 ; 33 ) , economic vitality ( 14 ; 24 ; 1 ; 39 ; 18 ) , and environmental impact ( 25 ; 27 ) are crucial for a wide range of applications, such as smart city planning and policy-making. The rapid growth of diverse web- and IoT-sourced urban data, e.g., satellite imagery, POIs, and sensor networks, offers unprecedented opportunities to capture both physical and functional characteristics of urban areas. Effectively integrating these multi-source data enables more holistic and accurate region profiling, supporting intelligent services that respond adaptively to urban dynamics ( 16 ; 34 ; 36 ) . Recent research on urban region profiling has progressed from single-modality learning to multi-modal fusion. Early works ( 39 ; 14 ; 29 ; 19 ) focused on extracting features from a single source, such as satellite imagery or POIs, to represent urban areas and predict socioeconomic indicators. More recent studies ( 36 ; 15 ; 34 ) have highlighted the importance of integrating heterogeneous data sources to obtain richer urban representations. Inspired by advances in vision-language pretraining, some works ( 38 ; 10 ; 37 ) further explore visual-language alignment for interpretable urban representations, while others ( 11 ; 24 ) incorporate external knowledge and multi-level geospatial aggregation to enhance generalization. Together, these research efforts demonstrate a clear and consistent trend toward comprehensive, multimodal urban profiling. Figure 1. Multimodal multi-task urban region profiling dataset construction. However, existing research in this domain faces two significant limitations. On one hand, the vast majority of current methods ( 10 ; 38 ; 11 ; 36 ) focus on single-task prediction, such as PG-SimCLR or UrbanCLIP. This approach overlooks the practical needs of real-world scenarios where multiple metrics are often required simultaneously. More importantly, it neglects the inherent common patterns and complex interdependencies that exist among different urban tasks. For example, high population density and elevated carbon emissions are often geographically correlated. On the other hand, the field currently lacks a publicly available, well-aligned multi-modal benchmark for evaluating models on multi-modal urban profiling challenges. This absence of a standardized experimental environment hinders fair comparison and impedes reproducible progress in the community. To address the aforementioned limitations, this paper aims to answer the following key research questions: Q1. How can we design a unified framework to solve multi-task urban profiling by effectively capturing the shared patterns and complex relationships among different tasks? Q2. How can the proposed framework achieve high performance without sacrificing computational efficiency, ensuring its practicality for large-scale urban applications? Q3. How can we establish a fair and comprehensive benchmark for the rigorous evaluation and comparison of multi-modal, multi-task region profiling models? Answering these questions presents several significant research challenges. First, the inherent heterogeneity of multi-modal data is a major hurdle. Urban data sources, such as structured POI statistics, unstructured text, and visual satellite image, reside in completely different feature spaces. Designing an effective fusion mechanism that can learn a shared, meaningful representation is non-trivial. Second, effectively modeling inter-task relationships is challenging. While tasks are related, naively sharing all model parameters can lead to "negative transfer," where learning one task degrades the performance of another. The key challenge lies in creating an architecture that enables selective knowledge sharing, capturing common patterns while preserving task-specific knowledge. Finally, there is a fundamental trade-off between model performance and computational efficiency . Sophisticated models capable of handling multi-modal and multi-task learning often come with prohibitively high computational costs, which significantly limit their practical deployment. In this paper, we systematically address these challenges. Our work is summarized as follows: First , to answer Q1 and Q2, we propose a novel sparse multi-modal Mixture-of-Experts framework for multi-task urban profiling, namely UrbanMoE. It employs specialized expert networks to capture diverse data patterns and task correlations, while a sparse gating mechanism ensures that only the most relevant experts are activated for a given input, thus achieving a strong balance between performance and computational cost. Second , to tackle the lack of a standardized evaluation platform (Q3), we construct and release a new benchmark featuring three diverse cities. To provide a holistic view of each region, the benchmark incorporates three distinct data modalities: (1) visual features from satellite images; (2) textural features generated by a Large Language Model (LLM) summarizing POI features; and (3) POI embeddings that represent the count of each POI category, indicating structural information. On this benchmark, we define three corresponding profiling tasks: carbon emission, population, and night light intensity. Figure 1 presents our benchmark’s data processing pipeline, web data of POI feature and satellite image are collected demonstrating how these data sources are organized into a structured pipeline for urban region profiling. Finally , we conduct comprehensive experiments on our benchmark. The results verify that UrbanMoE achieves consistently superior performance against a wide range of baselines. Our in-depth analyses, including extensive ablation studies and gate mechanism visualizations, further validate the efficacy, efficiency, and interpretability of our proposed framework. The main contributions can be summarized as follows: • We establish a benchmark for region profiling, including multi-modal features, multi-task, and diverse baselines, to foster a fair and standardized experimental environment. • For the first time, we propose a sparse multi-modal multi-experts framework, i.e., UrbanMoE, specifically designed to address multi-task urban region profiling. • Extensive experiments on our benchmark with 3 real-world datasets verify the consistently superior performance of our proposed UrbanMoE across

Read the complete text