DepthScape: Authoring 2.5D Designs via Depth Estimation, Semantic Understanding, and Geometry Extraction CCS: Human-centered computing Interactive systems and tools

Xia Su, Cuong Nguyen, Matheus A. Gadelha, Jon E. Froehlich · 2025

Read DepthScape: Authoring 2.5D Designs via Depth Estimation, Semantic Understanding, and Geometry Extraction CCS: Human-centered computing Interactive systems and tools by Xia Su, Cuong Nguyen, Matheus A. Gadelha, Jon E. Froehlich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02263.txt.

Introduction

Designers love 2.5D effects in flat art. Shading and overlap make a flat scene feel deep, but making them by hand is slow. Xia Su and three co-authors built DepthScape in 2025. The tool lets a user drop art straight into a 3D rebuild of a scene.

The tool reads depth, sorts what each thing is, and pulls out shapes. Then art can be placed so it sits in the scene in a natural way. The user works with the AI, not against it. Such tools aim to give flat design the feel of depth, without the need for full 3D craft from each artist.

Catalog record

CREATORXia Su, Cuong Nguyen, Matheus A. Gadelha, Jon E. Froehlich
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02263

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DepthScape: Authoring 2.5D Designs via Depth Estimation, Semantic Understanding, and Geometry Extraction CCS: Human-centered computing Interactive systems and tools Xia Su, Cuong Nguyen, Matheus A. Gadelha, Jon E. Froehlich Abstract . 2.5D effects, such as occlusion and perspective foreshortening, enhance visual dynamics and realism by incorporating 3D depth cues into 2D designs. However, creating such effects remains challenging and labor-intensive due to the complexity of depth perception. We introduce DepthScape, a human-AI collaborative system that facilitates 2.5D effect creation by directly placing design elements into 3D reconstructions. Using monocular depth reconstruction, DepthScape transforms images into 3D reconstructions, where visual contents are placed to automatically achieve realistic occlusion and perspective foreshortening. To further simplify 3D placement through a 2D viewport, DepthScape employs a vision-language model to analyze source images, extracting key visual components as content anchors to enable direct manipulation editing. We evaluate DepthScape among nine participants with varying design skills, confirming the effectiveness of the creation pipeline. We also test on 100 professional stock images to assess robustness, complemented by an expert evaluation that confirms the quality of DepthScape’s results. Figure 1 . We introduce DepthScape , a Human-AI collaborative authoring system for 2.5D visual design. DepthScape takes input image assets and uses 3D reconstruction to estimate its inherent depth information. With AI-assisted design recommendation, users can quickly layout design elements in the implicit 3D space. The output is a visual design with realistic occlusion effects following depth cues in the input image. From left to right shows the pipeline of DepthScape. Top left shows an input asset image, which is a musician figure holding a guitar, while sitting at a wall corner. Below it is its 3D reconstruction, showing the depth information of this image. To the right are four extracted parametric anchors, showing a blue cylinder surface around the guitar, plane on the ground under the figure's feet, plane in the middle of the figure, and a cylinder around the figure. Right shows the design results, which is an album cover with a surrounding ring of text saying "urban melody", while text on the ground says "UIST 2025 Music Track". A ring of music notes surrounds the top of the guitar, and a half-transparent white surface containing text of the tracklist is placed in the background. 1. Introduction Figure 2 . Design result gallery of DepthScape. Top row icons show the formation of designs, with one or multiple Planar, Cylindrical, and Spherical parametric anchors. A list of design results. From left to right: a grassland view with a little house in it, with text showing "SPRING BEATS"; A woman standing in front of a cement wall, with a gray arrow circle surrounding her and a text plane ""Hello" on her right side; A hiking man walking with great effort on a snowy ground, with a text ring surrounding him saying "ACHIEVING GREATNESS"; An European street scene with a church in scene and some tourists on the foreground. A plane with the church name is placed on the church wall, and a plane with "Stories in Blue" is placed in parallel with the ground; A hot air balloon scene, with the front red balloon surrounded by a spiral text saying "Freedom wait for U"; A table with a cake on it. The cake is wrapped with a sphere saying "Black Chocolate" in a repetition. There's also a text saying "THE GOOD FOOD COMPANY" on the tale surface. Humans gain 3D perception from 2D images through depth cues like occlusion, perspective, and shading ( 27 ; 6 ; 15 ) . Leveraging this visual ability, creators have long applied depth-enhancing techniques such as layering and projecting to achieve visual realism. Borrowing from graphics research, we call this type of visual design “ 2.5D design ”, whose perceptual power has long been recognized in Gestalt principles ( 31 ) , visual perception research ( 23 ; 38 ) , and design practice. However, creating 2.5D visual designs can be challenging. Consider Jennifer, a 2D visual designer trying to make a design poster more engaging. Jennifer aims to add 3D effects like a decoration wrap around the model’s body, and a 3D text box near the model’s face ( Figure 2 BC). Simulating 3D effects using pure 2D layer-based design tools like Photoshop or Illustrator is tedious and error-prone. Even minor adjustments, such as rotation or repositioning, demand repeated refinements and strong spatial intuition, making iteration slow and frustrating. Jennifer might consider using a 3D tool like Blender. She could segment the main object ( 33 ) , set up a 3D scene, and block out simple 3D geometry to get accurate depth cues and vanishing points. However, 3D tools have steep learning curves and introduce additional challenges like ensuring the 3D geometries align well with the existing photograph. These tools can be overwhelming for 2D designers who might not be willing to invest time in mastering 3D workflow. In summary, both workflows shift attention from creative exploration to technical problem-solving, rendering the process tedious, error-prone, and resistant to rapid experimentation. A more streamlined approach is to allow 2D designers to simply drop assets into an image and watch them instantly adapt to the right 3D perspective and occlusion of the photograph. We envision a human–AI collaborative approach in which designers remain on the 2D canvas while an AI agent handles complex 3D tasks in the background such as reconstruction, projection, and rendering. The AI agent automatically analyzes the RGB content and depth maps of an image and anchors perspective-correct 3D primitives like planes, cylinders, or spheres on objects in the image space. These “ parametric anchors ” enable 2D assets to be placed with correct perspective and occlusion. Figure 3 show examples of parametric anchors. Users can then drop design assets on these anchors to quickly get 2.5D effects, with the option to refine the result through direct manipulation and detailed parameter configuration. This interaction resembles an offline form of augmented reality scene creation ( 19 ) , allowing designers to author 2.5D effects without mastering traditional 3D modeling. To realize this vision, we developed DepthScape , a web-based tool for simplified 2.5D design. Our goal is to enable both professional and amateur 2D designers to create sophisticated 2.5D effects without adopting a complex 3D workflow. A key contribution of DepthScape is the use of a vision–language model (VLM), GPT-4o ( 16 ) , to orchestrate an RGB–and–depth processing pipeline that automatically generates parametric anchors. We leverage two core capabilities of the VLM—visual reasoning and code generation—to analyze the input image and synthesize custom geometry extraction programs (see Figure 10 A). For example, for the model image in Figure 2 B, DepthScape may produce two programs: one that fits a 3D cylinder to support a wrapping effect around the body, and another that extracts a 3D surface oriented along the model’s gaze direction. Each program ( Figure 10 A) comprises a sequence of connected function calls that perform tasks such as masking, point-cloud cleaning, primitive fitting, and human pose or face analysis. We implement these functions as a reusable library and provide in-context examples to guide the VLM during code generation. A key benefit of this visual programming approach ( 13

Read the complete text