Enterprise Resource Planning Using Multi-type Transformers in Ferro-Titanium Industry

Samira Yazdanpourmoghadam, Mahan Balal Pour, Vahid Partovi Nia · 2026

Read Enterprise Resource Planning Using Multi-type Transformers in Ferro-Titanium Industry by Samira Yazdanpourmoghadam, Mahan Balal Pour, Vahid Partovi Nia (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20696.txt.

Introduction

Samira Yazdanpourmoghadam, Mahan Balal Pour, and Vahid Partovi Nia study planning software for a metal plant. Their 2026 paper deals with enterprise resource planning in the ferro-titanium trade. Such planning must solve hard puzzle-like tasks. Two classic ones are the job-shop problem and the knapsack problem. Both ask how to fit many jobs or goods into tight limits.

Older ways to solve these tasks rely on rules of thumb and search tricks. The authors turn instead to transformer models, the design behind much of modern AI. They use more than one type of transformer for the planning task. The paper sits where deep learning meets plant logistics. It asks if learned models can find near-best plans fast enough to use in daily work.

Catalog record

CREATORSamira Yazdanpourmoghadam, Mahan Balal Pour, Vahid Partovi Nia
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20696

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enterprise Resource Planning Using Multi-type Transformers in Ferro-Titanium Industry Samira Yazdanpourmoghadam, Mahan Balal Pour, Vahid Partovi Nia Abstract Combinatorial optimization problems such as the Job-Shop Scheduling Problem (JSP) and Knapsack Problem (KP) are fundamental challenges in operations research, logistics, and eterprise resource planning (ERP). These problems often require sophisticated algorithms to achieve near-optimal solutions within practical time constraints. Recent advances in deep learning have introduced transformer-based architectures as promising alternatives to traditional heuristics and metaheuristics. We leverage the Multi-Type Transformer (MTT) architecture to address these benchmarks in a unified framework. We present an extensive experimental evaluation across standard benchmark datasets for JSP and KP, demonstrating that MTT achieves competitive performance on different size of these benchmark problems. We showcase the potential of multi-type attention on a real application in Ferro-Titanium industry. To the best of our knowledge, we are the first to apply multi-type transformers in real manufacturing. 1 INTRODUCTION Combinatorial optimization lies at the core of numerous real-world applications, including manufacturing scheduling, transportation planning, resource allocation, agentic artificial intelligence, and robotics. Problems such as the Job-Shop Scheduling Problem (JSP) and Knapsack Problem (KP) are widely studied due to their computational complexity and practical relevance. Traditional approaches—ranging from exact algorithms to heuristic and metaheuristic methods often struggle to balance solution quality and computational efficiency, particularly for large-scale instances. The emergence of neural combinatorial optimization has introduced a paradigm shift, leveraging deep learning models to learn problem structures and generate high-quality solutions. Transformer-based architectures, in particular, have demonstrated remarkable success in sequence modelling and graph-based representations, making them suitable for optimization tasks. We adopt the Multi-Type Transformer (MTT) architecture introduced in [ 4 ] . MTT extends the conventional transformer by integrating multiple attention types, each specialized for distinct structural aspects of the input, thereby enhancing representational capacity and adaptability. We investigate the effectiveness of MTT in solving different sizes of JSP and KP within a unified framework to study the generalizability and scaling of this new tool. Neural combinatorial optimization has emerged as a promising alternative to classical heuristics for solving NP-hard problems such as JSP, and KP. Early works like [ 7 ] introduced attention-based models and reinforcement learning for routing and scheduling tasks. These approaches demonstrated that deep learning can learn problem structures and generate competitive solutions without handcrafted heuristics. Transformers are developed for natural language processing, and have been adapted for combinatorial optimization due to their ability to model long-range dependencies. Standard transformer models employ a single attention mechanism, which works well for homogeneous input structures but struggles with heterogeneous entities common in combinatorial optimization, e.g. jobs and machines in JSP. Figure 1: Overview of the unified MTT pipeline for ERP optimization, KP and JSP are represented using heterogeneous graphs and solved using a shared Transformer backbone with type-specific attention. The advent of neural combinatorial optimization reframed discrete decision-making as sequence modelling and structured prediction. Pointer Networks introduced attention-based pointing to variable-length outputs, enabling end-to-end learning for geometric and routing problems [ 11 ] . Transformers abstracted this idea to a fully attention-based architecture, dispensing with recurrence and convolution while improving scalability and parallelism [ 10 ] . Reinforcement learning approaches subsequently specialized to routing with dynamic state representations, as in [ 8 ] . [ 2 ] established early evidence that policy gradients can discover competitive heuristics without handcrafted rules. Graph representation learning further advanced neural solvers by encoding the structure of discrete problems directly into the model. [ 3 ] combined reinforcement learning with graph embeddings Structure2Vec to learn greedy meta-algorithms for Minimum Vertex Cover, and Max-Cut. Complementary lines applied graph neural networks and specialized architectures to routing and packing tasks, including efficient encoders and problem-aware attention mechanisms [ 5 ] . Together, these approaches improved generalization across instance distributions, revealing inductive biases that are critical for scalability and transfer. More recently, generalist models aim to unify heterogeneous optimization tasks within a single backbone. Multi-type transformer designs and shared representations allow a solver to tackle knapsack, routing, and scheduling with minimal task-specific customization. Examples include the MTT framework and unified architectures that pursue cross-problem learning and lightweight adapters for rapid adaptation. In ERP settings, such generalist solvers are attractive because they can reuse learned abstractions across procurement, blending, routing, and shop-floor scheduling while maintaining acceptable optimality gaps relative to exact baselines [ 6 , 1 , 9 ] . The Multi-Type Transformer (MTT) introduced in GOAL [ 4 ] addresses this limitation by incorporating multiple attention types within the same architecture, see Figure 1 . Each attention type specializes in capturing relationships among distinct entity types, such as job-machine pairs in JSP or item-capacity pairs in KP. This design improves representation learning and enables generalization across diverse combinatorial optimization problems. Recent works like [ 12 ] have demonstrated that multi-type attention can outperform single-type models in both accuracy and adaptability. GOAL integrates multi-type attention blocks with parameter sharing, achieving strong performance across routing, scheduling, and packing tasks without retraining from scratch. MTT offer heterogeneous representation learning for complex problem structures, offers cross-domain generalization, and reduces problem-specific customization. However, challenges remain in computational efficiency for large-scale instances and integration with reinforcement learning for dynamic decision-making. 2 METHODOLOGY We solve two canonical problems, KP and JSP, within a unified graph formulation that exposes heterogeneous node-edge types. For JSP, we use a disjunctive graph with operation nodes, conjunctive edges (technological precedence), and disjunctive edges per machine capturing mutual exclusivity; features include processing times, machine IDs, release/ready times, and partial schedules (dynamic state). This follows established JSP graph formulations in NCO and RL scheduling research, adapted for transformer encoders to avoid hand - engineered features. For KP, we formulate a bipartite graph between items and a single capacity node, where item nodes carry weight and value, and a capacity node accumulates residual capacity; a feasibility mask prevents selections violating capacity. This packing representation is consistent with generalist NCO abstractions that unify heterogeneous COPs. This multi - relational graph makes heterogeneity explicit: jobs versus machines (JSP), and items versus capacity (KP), enabling type - specific attention. Figure 2: Schematic illustration of combinatorial problems studied, the visualization of KP (left panel), and JSP (right panel). 3 COMBINATORIAL BENCHMARKS This section introduces two canonical NP-hard combinatorial optimization problems that frequently arise in ERP and decision-making systems: the (0–1) Knapsack and the Job-Shop Scheduling Problem (JSP). We present their standard mathematical programming formulations, simple visual examples, and discuss their challenges, similarities, and differences for readers familiar with undergraduate-level mathematical programming. 3.1 Knapsack (KP) KP is about having a limited capacity (like weight, budget, time, battery, memory), and a list of things one could include. Each item gives some benefit (usefulness, satisfaction, profit). The problem is about picking the best combination that fits within the limit and gets the most benefit overall. Here we focus on all - or - nothing (0–1 knapsack) whether or not bring the whole item, see Figure 2 (left panel). Given n items with values v_{i}>0 and weights w_{i}>0 , and a capacity W>0 , choose a subset that maximizes total value without exceeding the capacity of the sack W . Let x_{i}\in\{0,1\} indicate whether item i is selected i.e. a binary variable x_{i}\in\{0,1\} . \displaystyle\max_{x\in\{0,1\}^{n}}\quad \displaystyle\sum_{i=1}^{n}v_{i}x_{i} s.t. \displaystyle\sum_{i=1}^{n}w_{i}x_{i}\leq

Read the complete text