Large Language Models for EDA Cloud Job Resource and Lifetime Prediction

Yuxuan Yin, Shengke Zhou, Yunjie Zhang, Ajay Mohindra, Boxun Xu, Peng Li · 2025

Read Large Language Models for EDA Cloud Job Resource and Lifetime Prediction by Yuxuan Yin, Shengke Zhou, Yunjie Zhang, Ajay Mohindra, Boxun Xu, Peng Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19701.txt.

Introduction

Yuxuan Yin and five co-authors present LASER, a tool for a cloud scheduling chore. The chore is to guess how much resource a workflow job will use, and how long it will run. Job records are messy mixes. They hold shell commands, tool settings, dependency graphs, and metadata. Old machine learning flattens all that into fixed vectors and loses meaning.

LASER fine-tunes language models on the job records as text instead. The models learn to output several numbers at once. A science-style number format handles values that span huge ranges. A checked decoding step keeps outputs valid and cuts the time to answer. On chip-design workloads and a new public test set, LASER beat human experts. The test set draws on over half a million GitHub Actions runs.

Catalog record

CREATORYuxuan Yin, Shengke Zhou, Yunjie Zhang, Ajay Mohindra, Boxun Xu, Peng Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-19701

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Large Language Models for EDA Cloud Job Resource and Lifetime Prediction Yuxuan Yin, Shengke Zhou, Yunjie Zhang, Ajay Mohindra, Boxun Xu, Peng Li Abstract The rapid growth of cloud computing in the Electronic Design Automation (EDA) industry has created a critical need for resource and job lifetime prediction to achieve optimal scheduling. Traditional machine learning methods often struggle with the complexity and heterogeneity of EDA workloads, requiring extensive feature engineering and domain expertise. We propose a novel framework that fine-tunes Large Language Models (LLMs) to address this challenge through text-to-text regression. We introduce the scientific notation and prefix filling to constrain the LLM, significantly improving output format reliability. Moreover, we found that full-attention finetuning and inference improves the prediction accuracy of sliding-window-attention LLMs. We demonstrate the effectiveness of our proposed framework on real-world cloud datasets, setting a new baseline for performance prediction in the EDA domain. \uselogo \reportnumber 1 Introduction The semiconductor industry relies heavily on Electronic Design Automation (EDA) tools to design and verify complex ICs. As chip designs grow in complexity, the computational demands of EDA workloads have skyrocketed, leading to a massive migration of these tasks to cloud computing platforms ( Stok 2014 ; Bavikadi et al. 2022 ) . While the cloud offers scalability and flexibility, efficiently managing resources to control costs without compromising performance remains a fundamental challenge ( Liu et al. 2023 ) . Accurate prediction of a job’s compute resource requirements (e.g., CPU, memory, and disk) and its execution time, or lifetime, is crucial for efficient workload prioritization, real time resource provisioning, and long term infrastructure planning. Traditional approaches to this prediction problem often rely on statistical methods or machine learning models like Directed Acyclic Graphs (DAGs) ( Huang 2021 ) , or convolutional graph network Kipf 2016 ; Zhu et al. 2024 . However, these methods require structured, tabular data, forcing engineers to perform extensive and often brittle feature engineering. EDA job configurations are inherently complex and semi-structured, comprising tool settings, design parameters, technology node details, and script configurations. Flattening this rich information into a fixed-length vector is challenging and often leads to a loss of critical contextual information, limiting predictive performance. The recent success of Large Language Models (LLMs) in diverse domains has opened up new possibilities for tackling complex regression tasks through a text-to-text formulation ( Song et al. 2024 ; Song and Bahri 2025 ) . However, such opportunity has not yet been explored for EDA cloud job prediction. For the first time, by representing the entire EDA job configuration as a single string we directly train an LLM to "read" the configuration and "write" the predicted resource and lifetime values. This approach employs LLMs to encode the semi-structured job representations and learn to extract predictive signals from the inherent structure, relation, and dependency of the data. In this paper, we present a framework for fine-tuning LLMs for EDA job prediction. We demonstrate that this first text-to-text regression approach is not only feasible but highly effective: • We provide the first validation of training LLMs on semi-structured EDA data for predicting the resource consumption and lifetime of EDA cloud jobs, establishing a new modeling paradigm for this problem space. • We propose two key techniques to enhance performance: representing numerical outputs in scientific notation to handle large dynamic ranges and using constrained decoding to guide the model’s output, improving both accuracy and robustness. Moreover, we demonstrate that full attention fine-tuning can further improve generation accuracy of a sliding-window pre-trained LLM. • We empirically validate our framework on real-world EDA datasets, demonstrating significant improvements over various manual and heuristic baselines. Figure 1 : Architecture of LLM for EDA workload analysis. The diagram illustrates the system’s four main components: (a) The data flow and conversational example of EDA jobs. (b) Supervised fine-tuning LLM with full attention mechanism to minimize CE loss on ground truth tokens. (c) Vanilla LLM decoding methods and Examples of Wrong generations. (d) The proposed constrained decoding method. 2 Preliminaries 2.1 Background on EDA Workloads EDA workflows consist of a series of computational jobs, such as logic synthesis, place-and-route, timing analysis, and physical verification. These jobs’ performance is highly dependent on a multitude of factors, including but not limited to: Design Characteristics: The size and complexity of the circuit design (e.g., number of logic gates, memory blocks). Tool Configuration: The specific EDA tool, its version, and the multitude of settings and flags used for a particular run. Technology Node: The target semiconductor manufacturing process (e.g., 7nm, 5nm), which dictates physical design rules. Execution Environment: The underlying cloud infrastructure, including VM types and storage solutions. The interplay between these factors creates a high-dimensional and complex feature space. A minor change in a synthesis script could lead to a drastically different netlist and cause a tenfold increase in the runtime of the subsequent place-and-route stage. This sensitivity makes prediction a complicated regression task. 2.2 Problem Formulation Let \mathcal{X} denote the space of heterogeneous EDA job configurations, where a specific job instance X\in\mathcal{X} encapsulates parameters such as dependency graphs, command-line arguments, and hardware constraints. Our objective is to predict a set of performance metrics Y\in\mathbb{R}^{m} , which includes peak memory usage, disk I/O, CPU utilization, and wall-clock execution time. Traditional approaches typically frame this as a regression problem, requiring a feature extraction function \phi:\mathcal{X}\rightarrow\mathbb{R}^{d} to map the complex configuration X into a fixed-size feature vector. A regression model f_{\theta} is then learned such that f_{\theta}(\phi(X))\approx Y . The primary limitation of this paradigm lies in the design of \phi(\cdot) , which often struggles to capture the nuanced semantics of textual and hierarchical data within X . In contrast, we formulate this task as a sequence-to-sequence generation problem. We define a serialization function \psi(\cdot) that transforms the structured job configuration X into a sequence of input tokens \mathbf{x}_{\text{job}}=\psi(X) . Similarly, the target metrics Y are serialized into a target sequence \mathbf{y}=(y_{1},y_{2},\dots,y_{T}) . The goal is to learn the parameters \theta of a Large Language Model (LLM) that approximates the conditional probability distribution: P_{\theta}(\mathbf{y}\mid\mathbf{x}_{\text{job}})=\prod_{t=1}^{T}P_{\theta}(y_{t}\mid\mathbf{x}_{\text{job}},y_{<t}) . 3 Methodology Figure 2 : Histograms illustrating the distribution of key resource metrics from dataset 1. All distributions are heavily right-skewed, indicating a long tail of resource-intensive jobs. Standard approaches for adapting LLMs to regression tasks often involve appending a dense linear layer on top of the final hidden state, minimizing the Mean Squared Error (MSE) on the continuous target metrics Y . However, this method exhibits poor generalization when the target domain is expansive, as is typical for EDA resource metrics like RAM and disk that span several orders of magnitude (e.g., from 0 to 10^{5} ). The limited capacity of the linear head, combined with the difficulty of backpropagating stable gradients across such a wide continuous range, introduces significant training instability. To circumvent this, we treat the prediction task as a sequence-to-sequence problem : by tokenizing the numerical values, we effectively convert the continuous regression into a highly-structured, discrete token-level classification problem. This approach allows us to leverage the intrinsic sequence-modeling capabilities of the Transformer architecture and the stability of the Cross-Entropy loss ( \mathcal{L}_{\text{CE}} ). We outline the key components of our framework, including input representation, our proposed techniques for numerical stability, and the fine-tuning

Read the complete text