FujiView: Multimodal Late-Fusion for Predicting Scenic Visibility

Bryceton Bible, Shah Md Nehal Hasnaeen, Hairong Qi · 2026

Read FujiView: Multimodal Late-Fusion for Predicting Scenic Visibility by Bryceton Bible, Shah Md Nehal Hasnaeen, Hairong Qi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00157.txt.

Introduction

Bible, Hasnaeen and Qi present FujiView, a multimodal system and dataset for predicting scenic visibility around Mount Fuji from webcam images plus weather data. Its late-fusion design joins image-derived class scores with numerical weather features to sort visibility into five categories. The dataset holds over 100,000 webcam images from more than 40 cameras, paired with current and forecast weather. Vision features lead short-term nowcasting, while weather forecasts take over beyond one day; late fusion scores about 0.89 accuracy same-day and up to 84% next-day.

Catalog record

CREATORBryceton Bible, Shah Md Nehal Hasnaeen, Hairong Qi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34350
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00157

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FujiView: Multimodal Late-Fusion for Predicting Scenic Visibility Bryceton Bible, Shah Md Nehal Hasnaeen, Hairong Qi Abstract Visibility of natural landmarks such as Mount Fuji is a defining factor in both tourism planning and visitor experience, yet it remains difficult to predict due to rapidly changing atmospheric conditions. We present FujiView , a multimodal learning framework and dataset for predicting scenic visibility by fusing webcam imagery with structured meteorological data. Our late-fusion approach combines image-derived class probabilities with numerical weather features to classify visibility into five categories. The dataset currently comprises over 100,000 webcam images paired with concurrent and forecasted weather conditions from more than 40 cameras around Mount Fuji, and continues to expand; it will be released to support further research in environmental forecasting. Experiments show that YOLO-based vision features dominate short-term horizons such as “nowcasting” and “samedaycasting”, while weather-driven forecasts increasingly take over as the primary predictive signal beyond + 1 +1 d. Late fusion consistently yields the highest overall accuracy, achieving ACC ≈ 0.89 \mathrm{ACC}\approx 0.89 for same-day prediction and up to 84% for next-day forecasts. These results position Scenic Visibility Forecasting (SVF) as a new benchmark task for multimodal learning. 1 Introduction 1.1 Motivation Mount Fuji is one of Japan’s most iconic and sought-after natural landmarks. Due to Japan’s efficient and affordable rail network, tourists can easily reach multiple observation points—including Fuji City, Shizuoka, or the Fuji Five Lakes region near Kawaguchiko—from urban centers like Tokyo in under two hours. However, Mount Fuji’s visibility is notoriously unpredictable, especially during the rainy season (tsuyu) or summer months when cloud cover is frequent. While Mount Fuji is at least partially visible from long distance up to 36% of days per year [ 9 ] , up close good visibility is rare. Our dataset’s measured class distribution (See Figure 1 ) lines up with these long distance visibility statistics, as well as anecdotal claims that approximately 20% of days per year offer “good enough” visibility of the mountain. This presents a major challenge to both casual travelers and photography enthusiasts hoping to glimpse or capture the mountain during their limited time in the country. Figure 1 : Measured class distribution for Fuji visibility In such scenarios, a traveler may wake up with multiple viable destinations but little clarity on where Mount Fuji might be visible. They may be forced to choose between acting immediately with limited visibility or waiting in hopes of better conditions later—potentially missing their only chance. This uncertainty not only affects individual experiences but may also result in missed opportunities for local tourism. By providing more reliable, data-driven visibility information, our system has the potential to guide visitors toward regions with favorable conditions, thereby distributing tourism more effectively across lesser-known but equally accessible towns surrounding Mount Fuji. Such an approach is especially timely given the rise [ 5 , 6 ] in inbound tourism to Japan during peak seasons [ 18 ] —many of which coincide with low visibility periods—and the country’s broader push for regional revitalization. By encouraging travel to areas that may otherwise be overlooked, particularly on days when weather conditions are optimal, this system can support both visitor satisfaction and economic development in peripheral communities. This project seeks not only to provide real-time visibility assessment using webcam feeds, but also to forecast future visibility conditions by combining visual observations with current and predicted meteorological data. Using a multimodal late-fusion approach, our system learns visibility trends across time, enabling informed decisions about when and where Mount Fuji will be visible. The distinction between nowcasting (image-only assessment of present conditions) and true forecasting (predicting visibility hours or days ahead) is central to our design, and highlights the gap our work fills between existing methods and practical traveler needs. Beyond Mount Fuji, the techniques developed in this work could be extended to other natural landmarks and scenic destinations where visibility is critical. The project thus serves both practical and scientific purposes: improving the travel experience through intelligent guidance, supporting seasonal tourism and regional revitalization, and contributing to research on multimodal learning, real-time perception, and environmental forecasting. 1.2 Challenges While Mount Fuji is visible from many vantage points across central Japan, yet its appearance is highly sensitive to local weather and cloud formation. Although webcam feeds and weather forecasts are widely available, no system currently integrates these sources into actionable visibility predictions. Existing tools provide either raw webcam footage or generic forecasts, but do not answer the concrete question of whether the mountain will be visible at a given place and time. Visibility is also not a binary condition but a continuum—ranging from full clarity to partial occlusion, haze, or complete cloud cover. Predicting this spectrum from image and weather data poses challenges such as temporal variation, atmospheric noise, and the fusion of heterogeneous modalities. Moreover, the absence of labeled datasets and standard benchmarks for scenic visibility further complicates model development and evaluation. This project addresses the gap by building a multimodal learning system capable of performing both real-time nowcasting and short-term forecasting of visibility using fused webcam and meteorological data. We formalize this problem as Scenic Visibility Forecasting (SVF) : predicting the perceptual visibility of natural landmarks from multimodal inputs across varying horizons (e.g., immediate nowcasts, same-day samedaycasts, or next-day tomorrowcasts). Unlike generic weather prediction, SVF directly targets visibility as experienced by humans , with outputs defined along a preceptual spectrum (perfect, clear, cloudly, obscured, as shown in Figure 2 ) or collapsed into binary “visible” vs. “not visible” categories. Framing SVF as a benchmark task highlights both the practical importance for travelers and the scientific challenges for multimodal learning. In short, FujiView is designed to help answer the practical question: “ Can I see Mt. Fuji today? Where? What about tomorrow? ” At the same time, SVF is intended to generalize this question beyond Fuji to any natural landmark where visibility matters, and to provide a benchmark for evaluating multimodal techniques in this domain. Figure 2 : Mount Fuji visibility classes 1.3 Contributions This work makes the following contributions: • Large-scale and growing multimodal dataset. We are constructing a continually expanding dataset of webcam images paired with concurrent and forecasted weather conditions from more than 40 locations around Mount Fuji. As of this writing, over 113,000 images have been collected and approximately 26,000 have been manually labeled, with the dataset projected to exceed 320,000 images by the year’s end. This resource will be released publicly and updated over time to support the development of SVF as a benchmark task. • Fusion-based modeling framework. We develop late-fusion models that integrate pretrained image classifiers (e.g., YOLOv8) with structured meteorological features, showing complementary strengths across nowcasting and forecasting. Our experiments reveal that image features dominate same-day prediction, achieving the highest accuracy of 0.89 at +0 d, but their relative contribution decreases with longer horizons as weather forecasts become more predictive. Late fusion yields accuracies of 0.84 at +1 d, 0.77 at +2 d, and 0.72 at +3 d, demonstrating its advantage for multi-day forecasts. • Scenic Visibility Forecasting (SVF) as a benchmark task. We formally define the prediction of landmark visibility from multimodal inputs as a new challenge for the vision community, emphasizing the distinction between nowcasting and forecasting.

Read the complete text