AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editing Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3818078 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Semantic networks
Chih-Heng Chang, Keng-Seng Ho, Chih-Yu Tsai, Kuan-Lin Chen, Yi-Hsuan Yang, Jian-Jiun Ding · 2026
Read AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editing Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3818078 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Semantic networks by Chih-Heng Chang, Keng-Seng Ho, Chih-Yu Tsai, Kuan-Lin Chen, Yi-Hsuan Yang, Jian-Jiun Ding (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31053.txt.
Introduction
Chang and colleagues enable music editing that changes traits while keeping rhythm and melody. Steering methods harm structure for edits, while structure adaptors dampen meaning response. Their AnchorSteer couples structure anchoring with found meaning steering. It probes representations to extract clear, unlabeled vectors via a self-taught rebuilding goal, setting traits apart without curated data. During editing, these vectors go into diffusion layers while a structure adaptor keeps structure. Tests on ZoME-Bench show AnchorSteer beats both baselines and gives large meaning changes while keeping structure strong.
Catalog record
| CREATOR | Chih-Heng Chang, Keng-Seng Ho, Chih-Yu Tsai, Kuan-Lin Chen, Yi-Hsuan Yang, Jian-Jiun Ding |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50144 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31053
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editing Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770855.3818078 ISBN: 979-8-4007-2259-2/2026/08 CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Semantic networks Chih-Heng Chang, Keng-Seng Ho, Chih-Yu Tsai, Kuan-Lin Chen, Yi-Hsuan Yang, Jian-Jiun Ding Abstract . Controllable music editing is to modify high-level attributes while strictly preserving rhythmic and melodic structures. However, this task is challenged by a semantic-structural entanglement: steering methods often degrade structure to achieve editing performance, while structural adaptors suppress semantic responsiveness. We propose AnchorSteer , a framework that disentangles this tension by coupling structural anchoring with self-discovered semantic steering. The proposed approach probes internal representations to extract interpretable, label-free concept vectors via a self-supervised reconstruction objective, isolating attributes without curated data. During editing, these portable, plug-and-play concept vectors are injected into diffusion hidden manifolds while a structural adaptor enforces consistency. Variants for unconditioned and conditioned injections are provided to balance robustness and semantic strength. Experiments on ZoME-Bench and subjective tests show that the proposed framework outperforms both steering-only and anchoring-only baselines, enabling significant semantic transformations with high-fidelity structural preservation. † † cc-license: by Resource Availability: Source code: https://github.com/hengtsune1024/AnchorSteer (Zenodo archive: https://doi.org/10.5281/zenodo.20368360 ). Project pages: https://brianchen1120.github.io/project/anchorsteer/ . 1. Introduction With the rapid progress of text-to-music (TTM) generation ( 15 ; 1 ) , the community has increasingly shifted the interest from unconstrained synthesis to controllable music editing . In music editing, the goal is to refine a given source by modifying a target attribute (e.g., instrument or genre) while strictly preserving the source’s musical identity, including its rhythm, melodic contour, and temporal structure. Achieving these dual objectives, precise semantic control together with high-fidelity structural preservation, remains a central challenge for diffusion-based audio models. Existing approaches struggle to balance these two objectives. Training-free editors such as MusicMagus ( 40 ) and Melodia ( 37 ) perform editing primarily through text guidance but often require detailed source captions or precise hyperparameter tuning, making them fragile in practice. To strengthen structural preservation, MuseControlLite ( 30 ) fine-tunes an adaptor to inject explicit structural conditions (e.g., melody), substantially improving content consistency over purely text-guided methods. However, such structural anchoring results in an over-constrained latent space, where the model prioritizes structural conditions at the expense of high-level semantic prompts, leading to weak or inconsistent attribute transfer. This exposes a key problem: can we enforce structural preservation without compromising semantic editability? Figure 1 . Conceptual comparison of music editing paradigms. (a) Semantic steering (red) provides high editability but risks structural drift. (b) Structure anchoring (blue) preserves the musical scaffold but lacks semantic responsiveness due to over-constraints. (c) AnchorSteer (green) treats these as complementary forces. By steering atop an anchored base, the proposed method simultaneously achieves high editability and structural fidelity (upper-right corner). Three side-by-side plots illustrate the trade-off between Structural Fidelity (x-axis) and Semantic Editability (y-axis). (a) Semantic-steering methods are represented by a steep red vector starting from the origin, indicating high editability but low structural fidelity. (b) Structure-anchoring methods are represented by a shallow blue vector, indicating high structural fidelity but limited editability. (c) AnchorSteer, the proposed method, is represented by a green vector reaching the upper-right corner. It is visually depicted as the vector sum of the blue structure-anchoring vector and the red semantic-steering vector, demonstrating that the proposed method achieves both high fidelity and high editability simultaneously. Figure 2 . Spectrogram comparison for Drums-to-Piano editing. Top-to-bottom rows are: Source , Steering-only , Anchor-only (MuseControlLite), and AnchorSteer , respectively The Steering-only approach introduces harmonics but disrupts temporal alignment, whereas the Anchor-only approach preserves onsets but limits semantic transfer. AnchorSteer maintains the temporal scaffold while successfully injecting piano-like harmonics. Figure~2 contrasts the failure modes of steering-only and anchoring-only for Drums$\rightarrow$Piano editing. Steering-only produces clear harmonic patterns but drifts from the source temporal structure, whereas anchoring preserves onsets but limits semantic transfer; AnchorSteer mitigates both by adding piano-like harmonics while maintaining the anchored structure. In parallel, semantic steering has recently matured in computer vision ( 6 ; 12 ; 13 ) : self-discovered directions or concept modules can be extracted from a pre-trained diffusion model using only the generations of the model, and then injected at inference time, without curated datasets, to induce strong high-level changes. Despite its success in vision, this paradigm has not been systematically validated for music editing, where the requirement is editing rather than unconstrained attribute-aligned synthesis. We therefore investigate whether CV-style self-discovered steering ( 13 ) can be directly transferred to music . Our findings suggest it cannot : Steering alone often degenerates into re-synthesis, because musical semantics (e.g., instrument identity) are tightly coupled with temporal events; an unconstrained semantic force can satisfy the target attribute by rewriting the underlying temporal structure instead of preserving the source. Figure 2 visualizes this failure mode: steering introduces piano-like harmonic patterns but breaks alignment with the source temporal structure, indicating a loss of edit fidelity. These observations reveal a fundamental trade-off summarized in Figure 1 : Semantic steering enables strong attribute changes but risks drifting away from the source structure, whereas structure anchoring preserves temporal patterns but can become over-constrained and yield weak semantic transfer. To resolve this tension, we propose AnchorSteer, a framework that explicitly decomposes editing into a structural scaffold ( anchoring ) and a complementary semantic force ( steering ). Concretely, we anchor generation with MuseControlLite while injecting self-discovered concept modules into diffusion hidden states to supply semantic steering. We further provide a portable “plug-and-play” injection module with two operating points: An unconditioned injection that favors structural fidelity under strong anchoring, and a conditioned injection that produces stronger and more robust semantic transfer by adapting the semantic force to the current hidden state, making it effective precisely in the over-constrained regime Figure 2 . Overall, AnchorSteer offers, to our knowledge, a novel framework that makes self-discovered semantic steering practically usable for diffusion-based music editing by coupling it with explicit structural anchoring and state-dependent injection. While our experiments target music editing, the technical kernel of this work lies in the discovery, representation, and utilization of interpretable, label-free concept vectors from a pretrained text-to-music diffusion backbone. These concept vectors are extracted via a self-supervised reconstruction objective without any curated labels, and serve as portable, plug-and-play semantic representations that can be injected into the model’s hidden states to enable controllable generation. From this perspective, the work is centered on the discovery, representation, and utilization of high-level concepts. Our main contributions are summarized as follows. • We identify reusable, label-free editing directions in the hidden states of text-to-music diffusion models, and propose a self-supervised reconstruction objective that extracts them as interpretable concept vectors usable as portable semantic representations. • We propose AnchorSteer , a structure-aware editing framework that couples self-discovered semantic steering with explicit structural anchoring, directly addressing the semantic-structural trade-off identified above. • We design a plug-and-play injection module with two operating points: unconditioned injection for structural fidelity and conditioned injection for stronger semantic transfer under heavy anchoring. • We demonstrate state-of-the-art