IRIS: Intersection-aware Ray-based Implicit Editable Scenes
Grzegorz Wilczyński, Mikołaj Zieliński, Krzysztof Byrski, Joanna Waczyńska, Dominik Belter, Przemysław Spurek · 2026
Read IRIS: Intersection-aware Ray-based Implicit Editable Scenes by Grzegorz Wilczyński, Mikołaj Zieliński, Krzysztof Byrski, Joanna Waczyńska, Dominik Belter, Przemysław Spurek (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15368.txt.
Introduction
Wilczynski and co-authors present IRIS, a framework for editable three-dimensional scenes that renders in real time. Neural radiance fields look sharp but train and render slowly, while Gaussian splatting is fast but less flexible. IRIS uses Gaussians as proxies to guide a neural field. An analytic sampling step finds the exact points where rays meet scene parts, which skips empty space. A feature blending rule along each ray replaces costly neighbor searches. The result keeps detail high, renders fast, and allows direct shape edits.
Catalog record
| CREATOR | Grzegorz Wilczyński, Mikołaj Zieliński, Krzysztof Byrski, Joanna Waczyńska, Dominik Belter, Przemysław Spurek |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50507 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15368
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IRIS: Intersection-aware Ray-based Implicit Editable Scenes Grzegorz Wilczyński, Mikołaj Zieliński, Krzysztof Byrski, Joanna Waczyńska, Dominik Belter, Przemysław Spurek Abstract Neural Radiance Fields achieve high-fidelity scene representation but suffer from costly training and rendering, while 3D Gaussian splatting offers real-time performance with strong empirical results. Recently, solutions that harness the best of both worlds by using Gaussians as proxies to guide neural field evaluations, still suffer from significant computational inefficiencies. They typically rely on stochastic volumetric sampling to aggregate features, which severely limits rendering performance. To address this issue, a novel framework named IRIS ( I ntersection-aware R ay-based I mplicit Editable S cenes) is introduced as a method designed for efficient and interactive scene editing. To overcome the limitations of standard ray marching, an analytical sampling strategy is employed that precisely identifies interaction points between rays and scene primitives, effectively eliminating empty space processing. Furthermore, to address the computational bottleneck of spatial neighbor lookups, a continuous feature aggregation mechanism is introduced that operates directly along the ray. By interpolating latent attributes from sorted intersections, costly 3D searches are bypassed, ensuring geometric consistency, enabling high-fidelity, real-time rendering, and flexible shape editing. Code can be found at https://github.com/gwilczynski95/iris . Figure 1 : The framework introduces the Ray Intersection Selector (RIS), which eliminates redundant sampling to achieve high-throughput inference compared to volumetric baselines. This explicit anchor-based representation facilitates seamless integration with physics engines and robust part-level scene editing. Consequently, high-fidelity reconstruction is maintained. 1 Introduction Figure 2 : Overview of the IRIS pipeline. The rendering process begins with the Ray Intersection Selector (RIS) , which analytically determines the precise intersection points between camera rays and 3D Gaussians, thereby significantly reducing the number of required samples. In the subsequent Ray-Coherent Aggregation (RCA) stage, local neural features are aggregated from these intersected primitives utilizing Mahalanobis distance-based weighting to synthesize a continuous latent vector. Shallow MLPs decode this representation into view-dependent color and material density, \sigma . Finally, the neural density is spatially modulated by the explicit Gaussian opacity and integrated via point-based volumetric rendering to produce the final image. The field of three-dimensional scene reconstruction and rendering has been transformed by two competing paradigms: Neural Radiance Fields (NeRF) [ 18 ] and 3D Gaussian Splatting (3DGS) [ 13 ] . NeRF represents scenes as continuous implicit functions, excelling at capturing view-dependent effects and complex geometries through neural synthesis. Conversely, 3DGS utilizes an explicit collection of anisotropic Gaussians, enabling unprecedented rendering speeds and providing a natural pathway for scene manipulation. As demand for interactive, physically plausible 3D content grows, researchers have increasingly turned to hybrid representations that aim to combine NeRF’s high-fidelity continuity with the explicit control of 3DGS. Despite their potential, current hybrid frameworks like EKS [ 33 ] , particularly those based on Gaussian-encoded neural fields, face a severe performance ceiling. The primary bottleneck stems from the adoption of traditional volumetric rendering pipelines. In these systems, rendering a single pixel requires dense sampling of numerous points along a camera ray. For each sampled point, the model must perform a K-Nearest Neighbors (KNN) search to identify and aggregate features from surrounding Gaussians, then pass them through a multilayer perceptron (MLP). This dual burden of redundant ray sampling and computationally intensive KNN lookups scales poorly with scene complexity, often reducing frame rates to non-interactive levels and hindering the integration of real-time physics engines. Counter Bonsai Room RadianceMeshes EKS IRIS (our) Figure 3 : Qualitative comparison on indoor scenes from the Mip-NeRF 360 dataset. Reconstruction fidelity is evaluated against editable baselines: Radiance Meshes and EKS. It is observed that IRIS consistently achieves superior visual quality, effectively recovering high-frequency details that are blurred or lost in competing methods. In this paper, IRIS (Intersection-aware Ray-based Implicit Editable Scenes) is presented, a novel approach that fundamentally rethinks the interaction between rays and neural-encoded Gaussians (see Fig. 1 ). It is observed that dense volumetric sampling is inherently inefficient when the underlying geometry is already explicitly defined by Gaussian primitives. Consequently, instead of reliance on blind stochastic sampling, an analytical ray-intersection strategy is employed. By solving the intersection equations for a ray traversing an oriented ellipsoid, the precise locations that require neural queries are identified, thereby aligning the sampling process with the scene’s explicit structure (see Fig. 3 ). The proposed framework offers three distinct advantages. First, the computational bottleneck of explicit 3D spatial searches is eliminated: local features are aggregated directly along the ray using a sliding-window mechanism, bypassing costly 3D KNN lookups. Second, the efficiency of the neural rendering pipeline is maximized. Rather than relying on stochastic sampling that often queries empty space, the proposed method focuses exclusively on structurally meaningful intersection points. This ensures that every MLP evaluation contributes directly to the surface reconstruction, eliminating the computational redundancy inherent in standard volumetric integration. Finally, the explicit nature of the Gaussian anchors is preserved, ensuring full compatibility with modern physics solvers while simultaneously maintaining the high visual fidelity characteristic of neural fields. Main contributions are as follows: • IRIS is introduced, utilizing the Ray Intersection Selector (RIS) to replace heuristic probabilistic sampling with precise geometric intersections. This approach eliminates empty space processing by evaluating only structurally meaningful samples, significantly accelerating rendering throughput. • A robust pipeline for topology-agnostic editing and physics simulation is established. By leveraging explicit Neural Anchors with RIS, rendering integrity is maintained even when objects traverse beyond the initial training volume, overcoming the spatial constraints of traditional grid-based methods. • High-fidelity rendering is achieved without the typical trade-off between editability and quality. The proposed framework outperforms all editable baselines in challenging indoor environments, delivering reconstruction quality competitive with leading static representations. 2 Related Works Figure 4 : Sampling strategy comparison. The proposed Ray Intersection Selector (RIS) (left) analytically determines precise interaction points with scene primitives, generating meaningful samples in a single pass without processing empty space. In contrast, standard volumetric sampling (right) relies on a heuristic, multi-stage process (coarse and fine) that inherently allocates the computational budget to unoccupied regions. Recent technological advances in 3D reconstruction based on photographs have led to the development of various models, such as NeRF [ 18 ] and Gaussian splatting (GS) [ 13 ] . Currently, solutions that combine the best features of both methods, using Gaussian distributions as a proxy for guiding neural field evaluations, still suffer from significant computational inefficiency. These methods employ stochastic volumetric sampling for feature aggregation, a process that imposes a severe penalty on rendering speed [ 33 ] . Editing 3D scenes represented by NeRFs has consequently become an active research area. A first line of work focuses on semantic-level editing, including object insertion and removal within learned radiance fields [ 15 , 16 , 27 ] . A complementary direction addresses geometric editing directly within the NeRF framework Conerf [ 12 ] , [ 31 ] , Editablenerf [ 32 ] . RIP-NeRF [ 26 ] introduces a novel point-based radiance field representation as the network input. RIP-NeRF [ 26 ] introduces a novel point-based radiance field representation as the network input. NeuralEditor [ 5 ] rendering scheme based on deterministic integration within K-D tree-guided density-adaptive voxels. NeRF-Editing [ 30 ] and NeuMesh [ 29 ] , which found correspondence between the extracted