Hybridizing Expressive Rendering: Stroke-Based Rendering with Classic and Neural Methods Journal: IT Professional

Kapil Dev · 2025

Read Hybridizing Expressive Rendering: Stroke-Based Rendering with Classic and Neural Methods Journal: IT Professional by Kapil Dev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00870.txt.

Introduction

Dev surveys how to make computer pictures that look hand-drawn, and how old and new methods might merge. Non-photorealistic rendering trades accuracy for style, from sketchy edges to painterly strokes. The review concentrates on stroke-based rendering, where an image is built from visible marks, and weighs classical tools against recent neural network approaches.

Classical methods offer fine artistic control but limited range; neural methods widen the range but can be harder to steer. The author proposes a hybrid framework that combines them, aiming at pictures with both expressive variety and an artist's hand on the result. The piece appears as a journal survey of where expressive rendering is heading.

Catalog record

CREATORKapil Dev
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00870

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hybridizing Expressive Rendering: Stroke-Based Rendering with Classic and Neural Methods Journal: IT Professional Kapil Dev Abstract Non-Photorealistic Rendering (NPR) has long been used to create artistic visualizations that prioritize style over realism, enabling the depiction of a wide range of aesthetic effects, from hand-drawn sketches to painterly renderings. While classical NPR methods, such as edge detection, toon shading, and geometric abstraction, have been well-established in both research and practice, with a particular focus on stroke-based rendering, the recent rise of deep learning represents a paradigm shift. We analyze the similarities and differences between classical and neural network based NPR techniques, focusing on stroke-based rendering (SBR), highlighting their strengths and limitations. We discuss trade-offs in quality and artistic control between these paradigms, propose a framework where these approaches can be combined for new possibilities in expressive rendering. \jvol XX \jnum XX \paper 8 \jmonth May/June \sptitle DEPARTMENT: Graphically Speaking \chapteri Early Non-Photorealistic Rendering (NPR) research focused on emulating traditional artistic mediums, such as sketching, watercolor, and oil painting, providing foundational insights into computational representation of artistic styles. Techniques like Haeberli’s image-based painting demonstrated how brush strokes could replicate Impressionist effects, illustrating the potential of algorithms to analyze and mimic artistic processes [ 5 ] . As the field evolved, advanced methods like stippling, hatching, and line drawings emerged, emphasizing NPR’s utility in technical illustrations for improving clarity and communication [ 5 , 2 ] . Indeed, as research by Ryan and Schwartz indicates, deliberately moving away from photographic realism, a core principle of NPR, can improve the speed and accuracy of visual perception [ 9 ] (see Figure 1 ). We use the term “Classical NPR” to describe techniques that rely on explicitly programmed rules and algorithms to mimic traditional artistic styles such as sketching, hatching, and painting. By contrast, we refer to “Neural NPR” as the application of deep learning models to achieve expressive renderings. Examples include neural style transfer for applying styles from reference images and generative adversatial networks for synthesizing images in specific artistic styles [ 4 ] . Figure 1 : People respond faster and more accurately to drawings with exaggerated features (left) than they do to photographs (right). © 1956 Ryan and Schwartz [ 9 ] . The evolution of NPR marks a significant shift from handcrafted algorithms grounded in mathematical principles to data-driven models powered by deep learning. Classical or traditional techniques [ 6 ] , such as silhouette rendering and tone shading, relied on explicitly defined geometric and visual rules. For example, stroke-based rendering, exemplified by Hertzmann’s seminal work, depends on geometric constraints to align strokes with image gradients, producing painterly effects but limited in stylistic variation [ 2 ] . Figure 2 : Left: Original image. Right: Intermediate rendering layer (Layer 1) with a specific brush stroke scale we implemented based on Hertzmann [ 2 ] . Additional layers refine stroke detail to produce the final rendering (Algorithm 1 ). See the original paper for other layer examples. However, these deterministic algorithms, while interpretable, often lack the adaptability and stylistic diversity found in deep learning methods. Neural models, trained on extensive datasets, offer a paradigm shift. They learn implicit mappings from input data to stylized outputs, offering greater expressive potential [ 4 ] . Convolutional Neural Networks (CNNs) are commonly used to encode abstractions of texture and contours, facilitating generalization across styles. Algorithm 1 Classical NPR Pipeline Example Input: Natural Image I Output: Stylized Image I_{s} // Feature Extraction Compute gradient map: \nabla I=\left[\frac{\partial I}{\partial x},\frac{\partial I}{\partial y}\right] Extract edges: E=\text{Threshold}(\nabla I) // Hand-Crafted Stylization Apply toon shading: I_{t}=\text{Quantize}(I,n) Apply stroke-based rendering: I_{s}=\sum_{i=1}^{N}S_{i}(E,I_{t}) , where S_{i} represents stroke placement and uses I_{t} for color guidance. Return: Stylized image I_{s} Expanding NPR’s expressive potential, John Lansdown and Simon Schofield authored the first comprehensive review of expressive renderings in 1995 [ 6 ] . Our subsequent review focused specifically on expressive rendering on mobile devices [ 1 ] , highlighting the challenges and opportunities presented by resource-constrained platforms. Aaron Hertzaman and a few others played a key role in development of this field [ 2 , 3 ] . This paper discusses the key algorithmic ideas in both classical and neural NPR algorithms, and the level of artistic control and flexibility available to the users of these techniques. We also propose a hybrid framework where these approaches can be combined to explore possibilities to overcome their current limitations in stylistic control and speed. NPR Algorithm Development Early NPR research focused on techniques like toon shading and edge detection, relying on hand-crafted features that required significant domain expertise. However, the shift to data driven approaches, such as neural style transfer, has enabled more diverse artistic outputs by learning high-level artistic representations directly from reference images. Stroke-Based Methods Advancements in stroke-based rendering (SBR) have significantly influenced NPR [ 2 , 6 ] . These methods use algorithms to place strokes, much like a painter deciding where to add each brushstroke (Figure 2 ). This decision-making process can be represented with a function: Stroke_{n+1}=f(Image_{n},Goal) , where Stroke_{n+1} is the next stroke to be added, Image_{n} is the current state of the image, and Goal represents the desired final image (Algorithm 1 ). The function f represents the algorithm or agent that determines the best stroke to add based on the current image and the goal. Early SBR methods, such as Haeberli’s paint program, were semi-automatic and required user input for stroke placement. Subsequent research introduced automation techniques like image gradient analysis and curve tracing. Modern SBR algorithms leverage deep reinforcement learning to train agents capable of rendering images autonomously, stroke by stroke [ 7 ] . Vision-Based Methods The integration of computer vision techniques marked another turning point in NPR development. Vision-Based Methods use computer algorithms to ‘see’ and ‘analyze’ images, extracting features that guide artistic rendering. We can represent this process with a simple function: Features=g(Image) , where Image is the input image, and Features are the extracted characteristics, such as edges, textures, or salient regions. The function g represents the vision algorithm that performs this extraction, allowing the system to understand and interpret the image’s content for artistic purposes. Early methods relied on low-level image processing, such as the Sobel operator, to detect edges and features [ 6 ] . Over time, higher-level techniques, including image segmentation and salience detection, were incorporated to guide artistic rendering, enabling more perceptually-driven and context-aware styles. Beyond extracting key visual features, style transformation techniques emerged to modify these extracted elements, leading to more artistic flexibility. Figure 3 : This figure shows two stylized renderings of the original content image in Figure 2 , created using Fotor’s GoArt (https://goart.fotor.com/). The style images are located in the top left corners of the stylized results. See algorithm 2 for a general pipeline for creating such images. Algorithm 2 Neural Pipeline 1: Input: Content Image I_{c} , Style Image I_{s} 2: Output: Stylized Image I_{t} 3: // Feature Extraction Using CNN (i.e. \phi ) 4: Extract content features: F_{c}=\phi(I_{c}) 5: Extract style features: F_{s}=\phi(I_{s}) 6: // Style Transfer via Optimization 7: Initialize I_{t}=I_{c} (or random noise) 8: for each iteration do 9: Compute content loss: \mathcal{L}_{content}=||F_{c}-\phi(I_{t})||^{2} 10: Compute style loss using Gram matrices: G_{s}=F_{s}F_{s}^{T},\quad

Read the complete text