FreeSliders: Training-Free, Modality-Agnostic Concept Sliders for Fine-Grained Diffusion Control in Images, Audio, and Video

Rotem Ezra Hedi Zisling Nimrod Berman, Alexey Gorkor Liran Nochumsohn Eliya Nachmani Omri Azencot [0.5em] · 2025

Read FreeSliders: Training-Free, Modality-Agnostic Concept Sliders for Fine-Grained Diffusion Control in Images, Audio, and Video by Rotem Ezra Hedi Zisling Nimrod Berman, Alexey Gorkor Liran Nochumsohn Eliya Nachmani Omri Azencot [0.5em] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00103.txt.

Introduction

Rotem Ezra, Hedi Zisling, and Nimrod Berman introduce FreeSliders, a training-free, modality-agnostic way to steer diffusion models along individual concepts. Concept sliders let users continuously vary one trait, like age or smile, without disturbing other content, but earlier sliders needed per-concept training and architecture-specific tuning. FreeSliders discovers semantic directions through textual contrasts without any training.

Images, audio, and video are all handled by the same approach. Generative media readers get fine-grained control that scales to new concepts and modalities cheaply. Training-free steering matters because the set of traits users want to adjust is open-ended.

Catalog record

CREATORRotem Ezra Hedi Zisling Nimrod Berman, Alexey Gorkor Liran Nochumsohn Eliya Nachmani Omri Azencot [0.5em]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00103

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FreeSliders: Training-Free, Modality-Agnostic Concept Sliders for Fine-Grained Diffusion Control in Images, Audio, and Video Rotem Ezra Hedi Zisling Nimrod Berman, Alexey Gorkor Liran Nochumsohn Eliya Nachmani Omri Azencot [0.5em] Abstract Diffusion models have become state-of-the-art generative models for images, audio, and video, yet enabling fine-grained controllable generation , i.e., continuously steering specific concepts without disturbing unrelated content, remains challenging. Concept Sliders (CS) offer a promising direction by discovering semantic directions through textual contrasts, but they require per-concept training and architecture-specific fine-tuning (e.g., LoRA), limiting scalability to new modalities. In this work we introduce FreeSliders , a simple yet effective approach that is fully training-free and modality-agnostic , achieved by partially estimating the CS formula during inference. To support modality-agnostic evaluation, we extend the CS benchmark to include both video and audio, establishing the first suite for fine-grained concept generation control with multiple modalities. We further propose three evaluation properties along with new metrics to improve evaluation quality. Finally, we identify an open problem of scale selection and non-linear traversals and introduce a two-stage procedure that automatically detects saturation points and reparameterizes traversal for perceptually uniform, semantically meaningful edits. Extensive experiments demonstrate that our method enables plug-and-play, training-free concept control across modalities, improves over existing baselines, and establishes new tools for principled controllable generation. An interactive presentation of our benchmark and method is available at: https://azencot-group.github.io/FreeSliders/ . 1 Introduction Diffusion models have emerged as state-of-the-art generative models, capable of producing realistic and diverse outputs across images, audio, and video ( Rombach et al. 2022 ; Ho et al. 2022 ; Shi et al. 2023 ) . Beyond generating high-quality samples, a central task is controllable generation , the ability to steer the generative process along user-specified signals ( Liu et al. 2023 ; Ho et al. 2022 ) . In particular, text-to-x , where x is a certain modality, has emerged as a powerful control signal for generative models, offering an intuitive human interface and enabling semantically aligned control ( Zhang et al. 2023a ; Zhang et al. 2023b ) . This text-guided capability plays a central role in creative applications, allowing users to produce high-quality content without requiring technical knowledge or professional design skills. An abundance of methods have been proposed to enable flexible, accurate generation and editing of creative content ( Gal et al. 2023a ; Chiu et al. 2025 ; Gaintseva et al. 2025 ) . However, relying solely on text prompts makes it difficult to precisely edit specific attributes and modulate them continuously without affecting unrelated components, for example, adjusting a person’s age without altering their identity, or changing weather intensity without modifying the scene location. This limitation restricts creators’ ability to fully realize their intended specific edits. To enable fine-grained, text-driven control of specific attributes, Gandikota et al. 2024 introduced Concept Sliders (CS), which derives semantic directions from textual contrasts between opposing concepts to target localized edits (e.g., adjusting a person’s apparent age). However, CS requires per-concept training , which is impractical in interactive settings where users may request diverse, unpredictable concepts that cannot be pre-trained. Moreover, CS and others such as ( Sridhar & Vasconcelos 2024 ; Choi et al. 2021 ) often depend on external classifiers or architecture-specific fine-tuning (e.g., LoRA), which may not be available for new backbones, may become infeasible for future models, or may demand deep, model-specific integration. These constraints hinder adoption in new modalities (video, audio) and in rapidly evolving open-source models, motivating architecture- and modality-agnostic, training-free methods that retain fine-grained control without per-concept training or architectural modifications. (a) smiling (b) waviness (c) loudness Figure 1: Sliders: (a) image: gradually increasing/decreasing smile intensity; (b) video: progressively increasing ocean waviness in a sailing scene; (c) audio: spectrograms of a cat’s meow with rising energy in dominant frequencies from top to bottom, indicating successful concept control. In this work, we propose a simple and elegant CS-inspired solution that is training-free and can be seamlessly adapted to new modalities and architectures. Rather than training a model to directly predict the CS update, we partially estimate the CS formula during inference. This design decouples the method from particular model architecture or modality, thereby enabling plug-and-play concept control method. While our approach is theoretically applicable for any modality, current public benchmarks focus primarily on images. To address this gap, we fundamentally extend the Gandikota et al. 2024 image benchmark to include standardized image , video and audio concept editing, constituting, to the best of our knowledge, the first modality-agnostic benchmarking for this task. We hope that this benchmark will help drive the development of architecture or modality-agnostic and training-free methods for fine-grained concept manipulation. Finally, on the extended benchmark, our extensive experiments demonstrate that the proposed simple solution enables fully training-free concept controlling while achieving improved results , albeit with a modest increase in computational cost during inference. Extending the benchmark to multiple modalities raises non-trivial evaluation questions: How should we measure fine-grained control, and can a unified protocol work across modalities? Revisiting work by Gandikota et al. 2024 , we note that CS evaluations rely largely on \Delta CLIP; however, we find that this metric often misaligns with human perception, and its interpretability, i.e., clarifying why a slider is ’good’, can be vague, especially for users without technical experience. We therefore introduce three modality-agnostic properties that an effective slider should satisfy: range (extent of controllable variation), smoothness (consistency and monotonicity of intermediate transitions), and preservation (extent of non-target content change). To capture these properties, we introduce two new metrics grounded in textual alignment and perceptual similarity. In our experimentation, we observe a fundamental challenge shared by our method, the original CS approach, and other variants: all require a scale that specifies how much to increase or decrease a given property. Two issues arise. (i) It is unclear where a concept saturates (e.g., what scale corresponds to the “maximum age” of a person). (ii) Because diffusion traversals are inherently non-linear, linearly stepping the scale often yields non-linear semantic progress, which confuses users and hinders intuitive interaction (e.g., skipping age ranges unless many fine steps are used, which is computationally expensive). To resolve this, we introduce Automatic Saturation and Traversal Detection (ASTD) , a two-stage procedure that (1) estimates saturation by combining conceptual and perceptual scores with a user-tunable trade-off, and (2) fits a data-driven reparameterization curve that rescales the traversal so intermediate steps correspond to perceptually uniform, semantically meaningful changes. Empirically, ASTD has been found to improve the overall score (up to \sim 2\times ). In summary, we present a simple, architecture- and modality-agnostic approach to fine-grained concept control that requires neither per-concept training nor architectural adaptations, enabling seamless use across images, video, and audio. We extend the CS benchmark into the first modality-agnostic evaluation suite for fine-grained control and introduce metrics that more faithfully capture fine-grained control. We further tackle scale selection, saturation, and non-linear traversals with ASTD , a two-stage procedure that detects saturation points and reparameterizes traversals for perceptually uniform changes. Together, these contributions provide a principled, practical, and extensible framework for training-free, fine-grained concept manipulation across modalities. 2 Related Work Controllable generation. Controllability has long been recognized as a fundamental challenge in generative modeling. Early methods for text-to-image diffusion focused on

Read the complete text