From Heuristics to Transformers: A Comprehensive Survey of Type Inference from Stripped Binaries Conference: 2026 6th International Conference on Computer Network Security and Software Engineering; February 06–08, 2026; Qingdao, China 2026 6th International Conference on Computer Network Security and Software Engineering (CNSSE 2026), February 06–08, 2026, Qingdao, China DOI: 10.1145/3803633.3803665 ISBN: 979-8-4007-2195-3/2026/02 CCS: Software and its engineering Language types CCS: Software and its engineering Compilers

Hua Zheng, Yuhang Guo, Kuanishbay Sadatdiynov, Cheng Wen, Muhammad Sadiq, Dugang Liu, Jawwad Ahmed Shamsi, Anam Qureshi · 2026

Read From Heuristics to Transformers: A Comprehensive Survey of Type Inference from Stripped Binaries Conference: 2026 6th International Conference on Computer Network Security and Software Engineering; February 06–08, 2026; Qingdao, China 2026 6th International Conference on Computer Network Security and Software Engineering (CNSSE 2026), February 06–08, 2026, Qingdao, China DOI: 10.1145/3803633.3803665 ISBN: 979-8-4007-2195-3/2026/02 CCS: Software and its engineering Language types CCS: Software and its engineering Compilers by Hua Zheng, Yuhang Guo, Kuanishbay Sadatdiynov, Cheng Wen, Muhammad Sadiq, Dugang Liu, Jawwad Ahmed Shamsi, Anam Qureshi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23692.txt.

Introduction

Zheng and colleagues survey how researchers recover data type information from stripped program binaries, in a 2026 survey paper on software security. Stripped binaries are executable files with symbol tables and debugging data removed, leaving raw machine instructions. Recovering the original types, which values are pointers, structures, or arrays, is central to reverse engineering, vulnerability hunting, and decompilation. Without types, a decompiler cannot turn flat assembly into readable code.

The survey traces the field from early rule based heuristics and constraint solving systems to context aware neural models. It then covers the newest transformer and graph neural network architectures, which read code structure as a graph. Core challenges include meaning lost to compiler optimization and the recovery of structural types such as nested records. The authors close with future directions, including neuro symbolic methods that combine learned models with logical reasoning about program behavior.

Catalog record

CREATORHua Zheng, Yuhang Guo, Kuanishbay Sadatdiynov, Cheng Wen, Muhammad Sadiq, Dugang Liu, Jawwad Ahmed Shamsi, Anam Qureshi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23692

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Heuristics to Transformers: A Comprehensive Survey of Type Inference from Stripped Binaries Conference: 2026 6th International Conference on Computer Network Security and Software Engineering; February 06–08, 2026; Qingdao, China 2026 6th International Conference on Computer Network Security and Software Engineering (CNSSE 2026), February 06–08, 2026, Qingdao, China DOI: 10.1145/3803633.3803665 ISBN: 979-8-4007-2195-3/2026/02 CCS: Software and its engineering Language types CCS: Software and its engineering Compilers Hua Zheng, Yuhang Guo, Kuanishbay Sadatdiynov, Cheng Wen, Muhammad Sadiq, Dugang Liu, Jawwad Ahmed Shamsi, Anam Qureshi Abstract . The recovery of high-level type information from stripped binaries—executables devoid of symbol tables and debugging information—is a cornerstone of software reverse engineering, vulnerability analysis, and decompilation. This survey tracks the evolution of binary type inference from early rule-based heuristics and static analysis to modern deep learning architectures. We analyze the shift from "duck typing" and constraint-solving techniques ( e.g. , BITY, BinSub) to context-aware neural models ( e.g. , EKLAVYA, CATI) and finally to state-of-the-art Transformer and Graph Neural Network (GNN) architectures ( e.g. , SeeType, TYGR). We identify core challenges, including optimization-induced semantics loss and structural type recovery, and propose future research directions in neuro-symbolic inference. † † cc-license: by 1. Introduction The rapid proliferation of software in modern society has made the ability to analyze and understand executable binaries a critical necessity for cybersecurity ( 15 ; 14 ; 29 ) . Whether for the purpose of vulnerability discovery ( 35 ; 34 ; 33 ) and malware analysis ( 37 ) in legacy systems, or verifying the security of closed-source third-party components, the field of binary reverse engineering serves as the primary line of defense. However, the task of understanding a program without access to its source code is an inherently asymmetric struggle ( 24 ) . Fundamentally, compilation is a lossy transformation. High-level programming languages provide developers with powerful abstractions—most notably data types—that impart semantic meaning to raw data ( 27 ) . During compilation, these abstractions are stripped away. What was once a “ struct student_record ” or a “ char* buffer ” is reduced to a generic sequence of loads and stores into fixed-size registers and memory offsets. In "stripped" binaries, the loss is even more severe: symbol tables and debugging information (such as DWARF) are removed to minimize file size and protect proprietary logic, leaving behind a “semantic desert” of raw assembly instructions. The Role of Type Inference. Binary Type Inference (BTI) is the process of reconstructing these high-level types from machine code ( 38 ; 36 ) . It is perhaps the most critical component of a modern decompiler. Precise type information acts as the "glue" that allows a decompiler to transform flat assembly into structured, human-readable C-like code. Without it, pointers cannot be distinguished from integers, and the boundaries of complex data structures ( e.g. , arrays, structures, and unions) remain invisible ( 40 ) . Moreover, type inference is a prerequisite for advanced security applications, such as Control-Flow Integrity (CFI) ( 1 ) , where type-signature matching is used to restrict the possible targets of indirect function calls, thereby mitigating return-oriented programming (ROP) attacks. From Heuristics to Deep Learning. For decades, type inference was the domain of manual expert knowledge. Classic tools like IDA Pro ( 10 ) and Ghidra ( 9 ) relied on rule-based heuristics, often referred to as "Duck Typing"—the logic that if a variable is used as an index into memory, it must be an array or a pointer. While effective for simple cases, these heuristics are brittle. They struggle with aggressive compiler optimizations ( e.g. , -O3 ) that reorder code and reuse registers for multiple variables of different types. Furthermore, the sheer variety of instruction set architectures (ISAs)—from x86 and ARM to MIPS and AArch64—makes it impossible for human analysts to keep pace by writing manual rules for every new compiler idiom. To address these limitations, the research community has recently pivoted toward data-driven approaches. The evolution of BTI can be viewed through three major waves: (1) Constraint-Solving & Logic: Systems like IDA Pro ( 10 ; 8 ) , SmartDec ( 11 ) , Snowman ( 26 ) , and BinSub ( 25 ) , which treat type inference as a mathematical constraint problem, seeking a logically consistent “principal type.” (2) Sequential Neural Models: The application of Natural Language Processing (NLP) techniques, such as Support Vector Machines (SVM) in BITY ( 39 ) , Recurrent Neural Networks (RNNs) in EKLAVYA ( 6 ) and Convolutional Neural Networks (CNNs) in CATI ( 5 ) , which treat assembly instructions as "sentences" to capture local usage context. (3) Structural & Contextual Transformers: The latest frontier, represented by Graph Neural Networks (GNNs) like TYGR ( 41 ) and Transformer-based models like SeeType ( 2 ) . These models capture the global "shape" of data flow and the long-range dependencies of large functions, achieving unprecedented accuracy in reconstructing fine-grained struct types. Objective of this Survey. Despite the significant progress in the field, there remains a lack of a unified perspective on how these diverse methodologies relate to one another. This survey provides a comprehensive analysis of the transition from heuristics to Transformers. We categorize the state-of-the-art based on their underlying representation—be it sequential, graph-based, or algebraic—and evaluate their performance across different architectures and optimization levels. By synthesizing insights from over a dozen seminal works, we identify the recurring challenges of "orphan variables" and structural reconstruction, ultimately outlining a roadmap for the next generation of "Neuro-Symbolic" type inference engines. 2. The Anatomy of Binary Type Inference To understand how high-level types are recovered from a stripped binary, one must first understand the structural chasm between source code and machine code. Figure 1 illustrates the end-to-end workflow of this recovery process, tracing the transformation of a program from its lowest-level representation back to a human-readable high-level form. Binary Type Inference (BTI) is essentially an inverse problem: it attempts to map a low-level, untyped execution environment back to a high-level, typed semantic space. This section breaks down the "anatomy" of this process into its four foundational components, as shown in Figure 2 : Variable Identification, Intermediate Representation (IR) Lifting, Feature Extraction, and the Type Resolution Engine. Figure 1. Type Inference From Binary Code. Figure 2. Overall Binary Type Inference Pipeline. 2.1. Variable Identification and Recovery. The first challenge is identifying the "entities" that require a type. In source code, variables have symbolic names and explicit scopes. In a binary, these are replaced by three types of storage locations: • Registers: Temporary, high-speed storage ( e.g. , rax , ebp ). In optimized code, the same register may hold a pointer at the beginning of a function and an integer at the end. • Stack Offsets: Local variables stored relative to the stack pointer ( esp / rsp ) or base pointer ( ebp / rbp ). • Global/Heap Memory: Fixed addresses in the data section or dynamic addresses returned by allocators like malloc . Table 1. Methodological Comparison Across BTI Research Eras Anatomical Component Heuristic Era ( e.g. , IDA/Ghidra) Sequential Era ( e.g. , EKLAVYA/CATI) Structural Era ( e.g. , SeeType/TYGR/BinSub) Variable Recovery Simple stack/register tracking Metadata-based (DWARF) or basic VSA Advanced program slicing and

Read the complete text