Conditions for well-posed color recovery in scattering media

Grigory Solomatov, Derya Akkaynak Hatter Department of Marine Technologies, University of Haifa, Haifa, IsraelInteruniversity Institute for Marine Sciences, Eilat, Israel · 2026

Read Conditions for well-posed color recovery in scattering media by Grigory Solomatov, Derya Akkaynak Hatter Department of Marine Technologies, University of Haifa, Haifa, IsraelInteruniversity Institute for Marine Sciences, Eilat, Israel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03837.txt.

Introduction

Grigory Solomatov and Derya Akkaynak ask when the true colors of a scene can be recovered from images taken inside a scattering medium, such as water or fog. The problem is intrinsically ill-posed: many color and medium combinations explain the same observation, so error cannot be controlled without understanding the candidate solution space. Two sources of trouble are the projection of spectra onto pixel values and the unknown medium parameters.

The authors show sensor improvements alone cannot fix medium-induced distortion without extra constraints. They identify recovery patterns, cross-pixel relationships that occur naturally in images, and prove that for an ideal hyperspectral camera these patterns restrict the solution to a unique candidate. The result opens a first-principles route to quantitative imaging in scattering environments.

Catalog record

CREATORGrigory Solomatov, Derya Akkaynak Hatter Department of Marine Technologies, University of Haifa, Haifa, IsraelInteruniversity Institute for Marine Sciences, Eilat, Israel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03837

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Conditions for well-posed color recovery in scattering media Grigory Solomatov, Derya Akkaynak Hatter Department of Marine Technologies, University of Haifa, Haifa, IsraelInteruniversity Institute for Marine Sciences, Eilat, Israel Abstract Recovering scene color from images captured in scattering media is a fundamental inverse problem in optical imaging. Yet the problem is intrinsically ill-posed as multiple solutions can explain the same observation, and prediction error cannot be controlled without understanding the space of candidate solutions. Here, we present sufficient conditions under which color recovery in a scattering medium becomes well-posed. Observing that ill-posedness stems from (i) projection of spectral signals onto pixel intensities, and (ii) unknown medium parameters, we demonstrate that sensor improvements alone cannot resolve medium-induced distortions without additional constraints. We identify recovery patterns —cross-pixel relationships that naturally occur in images—and prove, for an ideal hyperspectral camera, that they restrict the solution to a unique candidate. This opens the door to a new class of vision algorithms grounded in first principles, enabling quantitative analysis of images in scattering environments. Image data, while ostensibly an assignment of color values to spatial coordinates, has a remarkable capacity to encode information about the captured scene. The pursuit of automating the extraction of this visual information created the discipline of computer vision, yielding robust and powerful solutions for classification, segmentation, and tracking [ 8 ] . While these advancements have driven substantial progress in fields ranging from autonomous navigation and industrial quality control to medical imaging and ecology, a significant performance gap remains for computer vision in scattering media [ 4 , 14 , 19 , 25 , 24 ] . In contrast to what happens to light as it travels through clear air, which is more or less nothing, a scattering medium transforms light exponentially with distance [ 17 ] . In photographs, this transformation has the effect of distorting colors, reducing contrast, and blurring textures on which standard computer vision algorithms are based [ 2 , 4 , 19 ] . Furthermore, the spectral radiance from the scene toward the camera (inherent scene radiance) cannot directly be linked to the pixel values in the image. This remains true even in RAW format, which linearly encodes the spectral radiance incident at the camera (apparent scene radiance) projected onto the camera’s spectral sensitivity functions [ 1 ] . This limitation neither arises from the non-linear internal processing of consumer cameras, nor from the spectral compression inherent to RGB imaging, but from the unknown modification imposed by the medium itself. As a result, estimating the inherent radiance of a scene in a scattering environment is a fundamentally ill-posed problem, even for a hyperspectral camera with perfect accuracy (see Preliminaries). Addressing this ill-posedness is essential for many computer vision applications [ 3 , 14 , 5 , 7 , 28 , 26 , 18 ] , but it remains unclear whether, and under what conditions, the inherent radiance of scene captured in a scattering medium is recoverable from image data. Without this theoretical foundation, progress is driven by empirical performance rather than by an understanding of what the data can determine in principle, as ill-posed inverse problems can produce visually plausible but fundamentally ambiguous solutions (Fig. 1 ). Fig. 1: Ill-posed problems can have ambiguous solutions . This conceptual example demonstrates that an observed ‘bluish’ image can arise from a colorful scene under a blue illuminant, or a genuinely ‘bluish’ scene under white light, among other possibilities. Without further information, it is impossible to find a unique solution. Here, we address this gap by asking: under what conditions does color recovery become well-posed? By separating ambiguities introduced by the camera from those imposed by the unknown medium, we identify sufficient conditions for eliminating the latter. This perspective shifts the focus from improving algorithms within an ill-posed formulation to reformulating the problem itself so that recovery is provably well-posed. These challenges are perhaps most pronounced in an underwater imaging setting, where the collection of imagery is rapidly expanding through robotics, climate monitoring, and ecological surveys, yet its scientific use remains fundamentally limited by color distortions introduced by water and its constituents [ 16 ] . Correcting these distortions has been treated primarily as an engineering challenge, and most works in the last three decades have presented incremental algorithmic advances. Hence, we use this setting as a representative example, but our analysis and results are broadly applicable to all scattering conditions in which the same image formation model holds (described in the Preliminaries). Color recovery Fig. 2: Color recovery in a scattering medium is inherently ill-posed. Here, given an unprocessed RAW image (left) taken underwater, scene colors are recovered with the Sea-thru algorithm [ 3 ] (right), currently the state-of-the-art, yet limited by the absence of a principled approach for well-posed recovery that we begin to establish here. Original image: Tom Shlesinger. We define the task of recovering inherent scene radiance as (spectral) color recovery . This task is distinct from color enhancement —which is inherently subjective and aims to produce visually pleasing images—as well as from RGB-based reconstruction and restoration methods, which seek colorimetric consistency but are not constrained to recover underlying physical radiance. In contrast, our objective is physically grounded recovery of inherent radiance itself, which indirectly also restores scene visibility (Fig. 2 ). Consequently, a color-recovered image serves as the canonical input that brings the scene into the clear air domain (potentially after whitebalancing), for which the majority of computer vision and machine learning algorithms are optimized. We therefore argue that color recovery is the foundational objective in underwater computer vision, and more broadly in imaging in scattering media, as its successful execution restores the physical signal for all downstream tasks. When is color recovery possible? Surprisingly, despite decades of research into underwater imaging, this fundamental question has remained both unasked and unanswered. In this work, we initiate the first theoretical exploration of the conditions under which the color recovery problem can be well-posed. When color recovery is possible, the underwater camera becomes a scientific measurement device as it reflects physical reality most accurately. Color becomes a reliable physical cue, potentially enabling better segmentation, identification, classification, faster expert annotation, and improved learning. Restored visibility strengthens geometric and motion-based tasks, including visual SLAM, obstacle avoidance, structure-from-motion, and autonomous navigation, making robotic and diver operations more robust and accurate. Furthermore, because recovering inherent radiance necessarily entails solving for the medium’s optical parameters, each image becomes an environmental observation. Thus, placing color recovery on a principled basis would allow the field to move from subjective image enhancement to objective measurements with scientific precision. The data bottleneck Computer vision is no stranger to ill-posed problems: image denoising, monocular depth estimation and intrinsic image decomposition are but a few examples, many of which admit practically useful solutions. Even handwritten digit recognition, where convolutional neural networks saw their first successful real-world application [ 13 ] , is not merely ill-posed, but is ill-defined—lacking a formal specification of what constitutes a valid instance of a given digit. The groundbreaking idea making all of these problems tractable is that a predictive model can be “trained” on labeled examples, which is often much easier than designing a explicit or handcrafted method. Today, we know this

Read the complete text