GoCoMA : Hyperbolic Multimodal Representation Fusion for Large Language Model- Generated Code Attribution

Nitin Choudhury 1 , Bikrant Bikram Pratap Maurya 1 , Bhavinkumar Vinodbhai Kuwar 1 , Arun Balaji Buduru · 2026

Read GoCoMA : Hyperbolic Multimodal Representation Fusion for Large Language Model- Generated Code Attribution by Nitin Choudhury 1 , Bikrant Bikram Pratap Maurya 1 , Bhavinkumar Vinodbhai Kuwar 1 , Arun Balaji Buduru (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16377.txt.

Introduction

Choudhury, Maurya, Kuwar and Buduru address a forensic question: which language model wrote a given piece of code. Their GoCoMA framework combines two signals, the stylistic fingerprints of the code itself and image-like views of compiled artifacts that capture lower-level byte patterns. Those signals are fused inside a curved, hyperbolic space before being mapped back for a final attribution decision. On two open benchmarks, the combined approach beat both single-signal and flat-space rivals under identical testing rules.

Catalog record

CREATORNitin Choudhury 1 , Bikrant Bikram Pratap Maurya 1 , Bhavinkumar Vinodbhai Kuwar 1 , Arun Balaji Buduru
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27525
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16377

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GoCoMA : Hyperbolic Multimodal Representation Fusion for Large Language Model- Generated Code Attribution Nitin Choudhury 1 , Bikrant Bikram Pratap Maurya 1 , Bhavinkumar Vinodbhai Kuwar 1 , Arun Balaji Buduru Abstract Large Language Models (LLMs) trained on massive code corpora are now increasingly capable of generating code that is hard to distinguish from human-written code. This raises practical concerns, including security vulnerabilities and licensing ambiguity, and also motivates a forensic question: ‘Who (or which LLM) wrote this piece of code?’ We present GoCoMA , a multimodal framework that models an extrinsic hierarchy between (i) code stylometry, capturing higher-level structural and stylistic signatures, and (ii) image representations of binary pre-executable artifacts (BPEA), capturing lower-level, execution-oriented byte semantics shaped by compilation and toolchains. GoCoMA projects modality embeddings into a hyperbolic Poincaré ball, fuses them via a geodesic similarity-based cross-modal attention (GCSA) fusion mechanism, and back-projects the fused representation to Euclidean space for final LLM-source attribution. Experiments on two open-source benchmarks (CoDET-M4 and LLMAuthorBench) show that GoCoMA consistently outperforms unimodal and Euclidean multimodal baselines under identical evaluation protocols. Correspondence: [email protected] I Introduction and Related Work Large language models (LLMs) are now being extensively used in the software engineering field, from writing code sections and debugging to deployment. This significantly accelerates the software development process, but also raises concerns about its security, licensing, and potential for plagiarism. Recent research also shows evidence for LLM hallucinating against packages [ 35 ] . Considering a scenario where a specific LLM is used for code generation and is later found to produce vulnerable code or be brittle against such package hallucination or generate license-related issues, provenance becomes necessary to retrospectively identify and trace the affected code sections to their originating model. LLMs, such as ChatGPT, Gemini, Claude, Copilot, etc., trained on large code corpora, generate code that is nearly indistinguishable from human-written code [ 40 ] . These factors combined motivate an urgent need for robust code authorship attribution (CAA) in software forensics [ 5 , 26 , 41 , 20 ] . Studies have been exploring CAA for a long time, spanning from human authorship attribution to LLM authorship attribution. Research explored various aspects of features, including naming conventions, stylometry, structural motifs from abstract syntax trees (ASTs), data structures, algorithmic choices, and commenting styles, for CAA [ 10 , 22 , 8 , 11 ] . However, relying only on source code features can miss deeper behavioral and structural signals. This led to research examining program behavior-specific features while execution [ 16 , 33 ] . Based on these feature aspects, researchers explored various statistical and deep learning modeling approaches, which includes, n-gram statistics [ 34 , 30 ] ; structural models built from Abstract Syntax Trees, path representations, or token bigrams [ 14 , 9 , 2 ] ; analyses of runtime or behavioural traces [ 38 ] ; and deep-learning systems [ 4 , 3 , 1 ] that learn subtle links between code semantics and author style. In contrast, recent studies show that deep representations can jointly preserve stylometric, structural, and semantic cues, yielding substantially higher attribution accuracy than earlier handcrafted or shallow approaches [ 7 , 6 , 20 ] . Furthermore, recent research on CAA has been shifting towards watermarking approaches [ 23 , 25 ] . LLM watermarking embeds a detectable statistical signature during generation; however, in real-world use, it often becomes unreliable because it only works when the model/provider actually applies the watermarking schemes [ 24 , 32 , 12 ] . Despite extensive exploration, watermarking approaches are not applicable to scenarios where codes generated prior to watermarking, as well as deep representation learning approaches, fail under multilingual setups. We hypothesize that this gap in deep representation learning is due to unexplored low-level signals derived from binary pre-executable artifacts (BPEAs), and how such byte-level representations relate to higher-level stylistic cues in source code . Addressing these gaps, in this work, we propose GoCoMA ( G e o desic similarity-based C r o ss- M odal A ttention), the first framework to jointly analyze source code and its binary pre-executable artifact (BPEA) as an image, as two complementary multimedia signals for CAA. We hypothesize that combining code with BPEA images yields highly discriminative signals for CAA: code PLMs encode high-level lexical, syntactic, and semantic cues, while vision PTMs capture low-level structural and optimization patterns, forming an extrinsic hierarchy. We further posit that Euclidean fusion cannot preserve these hierarchical relations and cross-modal dependencies , motivating a geometry-aware hyperbolic strategy. GoCoMA encodes both modalities, projects their Euclidean embeddings into the Poincaré ball, fuses them with G eodesi C S imilarity–based cross-modal A ttention (GCSA), and maps the fused representation back to Euclidean space for classification. To summarize, the contribution of the work is as follows– • We introduce a multimodal CAA perspective that jointly models source code representations and vision-based representations derived from transformed binary pre-executable artifacts (BPEA), and we study the resulting process-induced (extrinsic) hierarchy across abstraction levels. • We propose GoCoMA , a geometry-aware hyperbolic multimodal framework that exploits this hierarchy via a geodesic similarity-based cross-modal attention (GCSA) fusion mechanism in the Poincaré ball. • We demonstrate improvements over strong unimodal and multimodal Euclidean and hyperbolic baselines, as well as recent LLM-based attribution baselines, on two public benchmarks under identical evaluation protocols. II Preliminaries In this section, we discuss the preliminaries of CAA, including BPEA image transformation, the pre-trained models considered for both code and image modalities, and some basics of hyperbolic space representation. II-A Binary Pre-Executable Artifacts (BPEA) Source code written in different programming languages is compiled into their respective intermediate forms, such as class, object, and bytecode files, collectively referred to as binary pre-executable artifacts (BPEA). These raw bytes contain lower, optimization-level information of the source code. II-B Pre-Trained Models (PTMs) Code Pre-trained Language Models (Code PLMs) We utilize four code PLMs–CodeT5+ [ 39 ] , Qwen2.5-Coder [ 21 ] , UniXcoder [ 19 ] , and CodeBERT [ 15 ] –to extract source-level representations (2304, 2048, 768, and 768 dimensions). These models are objectivewise differently trained: CodeT5+ utilizes denoising/span-corruption with code-text alignment, CodeBERT employs MLM and replaced-token detection, UniXcoder employs unified code-text pretraining for structure-aware embeddings, and Qwen2.5-Coder employs causal autoregressive generation for code reasoning. In contrast, vision PTMs over BPEA images capture low-level compilation footprints (e.g., byte-layout and optimization patterns) that are largely inaccessible from source code alone. Vision PTMs For image-based BPEA representations, we use four vision PTMs–ConvNeXT-Base [ 27 ] , EfficientNetV2-M [ 36 ] , ViT-Base (Patch16, 224) [ 13 ] , and MaxViT-T [ 37 ] –pretrained on large-scale datasets (e.g., ImageNet-21k) but differing in inductive bias. ConvNeXT emphasizes fine-grained local textures, capturing contiguous byte/segment patterns in BPEA images (1024-dimensions). EfficientNetV2-M encodes mid-level hierarchical layouts and clustered regions via scaled CNN representations (1280-dimensions). ViT-Base models long-range spatial dependencies across binary sections using self-attention over 16\times 16 patches, capturing global layout variations (768-dimensions). MaxViT-T combines convolution with multi-axis attention to integrate multi-scale cues from local patterns to overall organization (512-dimensions). We use frozen embeddings (no PTM fine-tuning), and these complementary biases provide a richer BPEA modality for fusion with code PLM representations in GoCoMA . II-C Hyperbolic Fusion Hyperbolic fusion refers to

Read the complete text