SemaTune: Semantic-Aware Online OS Tuning with Large Language Models CCS: Software and its engineering Operating systems CCS: Computer systems organization Performance of systems CCS: Computing methodologies Artificial intelligence

Georgios Liargkovas, Mihir Nitin Joshi, Hubertus Franke, Kostis Kaffes · 2026

Read SemaTune: Semantic-Aware Online OS Tuning with Large Language Models CCS: Software and its engineering Operating systems CCS: Computer systems organization Performance of systems CCS: Computing methodologies Artificial intelligence by Georgios Liargkovas, Mihir Nitin Joshi, Hubertus Franke, Kostis Kaffes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15026.txt.

Introduction

Georgios Liargkovas and three colleagues present TuxBot, a host-side framework for tuning operating systems on live machines with bounded language-model guidance. Existing controllers treat scheduler, power, memory, and input-output knobs as black-box variables chasing one reward. TuxBot instead builds a compact decision context from knob schemas, telemetry, and action history, with fast and slow loops and typed validation before any change reaches the kernel. Across 13 live workloads it lifts stable-phase performance 72.5 percent over defaults.

Catalog record

CREATORGeorgios Liargkovas, Mihir Nitin Joshi, Hubertus Franke, Kostis Kaffes
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75626
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15026

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SemaTune: Semantic-Aware Online OS Tuning with Large Language Models CCS: Software and its engineering Operating systems CCS: Computer systems organization Performance of systems CCS: Computing methodologies Artificial intelligence Georgios Liargkovas, Mihir Nitin Joshi, Hubertus Franke, Kostis Kaffes Abstract . Online OS tuning can improve long-running services, but existing controllers are poorly matched to live hosts. They treat scheduler, power, memory, and I/O controls as black-box variables and optimize a scalar reward. This view ignores cross-knob policy structure, breaks down when application metrics are unavailable, and can send a running service into degraded regions that persist after the bad setting is removed. We present SemaTune, a host-side framework for steady-state OS tuning with bounded language-model guidance. SemaTune turns knob schemas, telemetry, current configuration, recent action–response history, and retrieved prior runs into a compact decision context. A fast loop proposes low-latency updates, a slower loop periodically revises the search strategy, and every proposed change passes through typed validation before reaching kernel or sysctl interfaces. This lets the controller reason about OS-control meaning and indirect performance signals while keeping model cost, latency, and authority constrained. We evaluate SemaTune on 13 live workloads from five benchmark suites while tuning up to 41 Linux parameters. Across the suite, SemaTune improves stable-phase performance by 72.5% over default settings and by 153.3% relative to the strongest non-LLM baseline. A 30-window session costs about $0.20 in model calls. With only host-level metrics, SemaTune still outperforms baselines given direct application objectives by 93.7 percentage points, while avoiding severe degraded regions reached by structure-blind exploration. 1. Introduction Primer on OS tuning : Modern operating systems expose a large runtime control surface for scheduling, power management, memory, and I/O. These settings affect application performance and efficiency, but the best configuration depends on the workload, hardware, and current operating conditions ( 12 ; 3 ; 2 ; 4 ; 28 ; 49 ; 48 ; 17 ) . As those conditions change, static settings are not enough, motivating the online tuning loop we study. Figure 1 shows that loop. A tuner is a host-side controller that runs alongside applications, periodically observes available system and application signals, proposes updates to a set of OS knobs, and uses the resulting measurements to decide the next step. We study tuners that operate out of band: they are not inline on each request, and they are not kernel fast-path controllers such as the CPU scheduler, a packet scheduler, or a TCP congestion controller ( 16 ; 36 ; 30 ; 56 ) . Instead, they perform steady-state online tuning . While services continue to run, the tuner adjusts the parameters of such OS controllers, e.g., the CPU scheduler time slice or the network stack’s polling budget, over seconds-to-minutes timescales to improve sustained application performance rather than going after transient sub-second fluctuations. In principle, this tuning can be done manually by experts using carefully thought-out heuristics. However, that does not scale as manual tuning would effectively require a performance engineer for each workload on each server monitoring changing conditions. Two common ways to automate this loop are Bayesian optimization and reinforcement learning ( 72 ; 82 ; 33 ) . A Bayesian tuner observes a scalar objective, updates a surrogate model over the configuration space, selects the next configuration based on that model, and repeats. An RL tuner treats tuning as sequential decision making. It maps measurements to states, applies knob changes as actions, and improves a policy or value function from observed rewards. Systems such as CherryPick ( 5 ) , SmartConf ( 79 ) , OPPerTune ( 73 ) , TUNA ( 31 ) , MLOS ( 22 ; 55 ) , and SelfTune ( 51 ) show that this style of automation can improve configurations in practice. Lack of semantic understanding : We show that these approaches are not sufficient for the online tuning of a live application’s OS environment because of three recurring failures. First, a tuner can make semantically unsound changes that push the system into an operating region that is hard to recover from. Some are semantically violating, such as minperfpct > maxperfpct (minimum cpu frequency greater than maximum cpu frequency), while others are numerically valid but nonsensical for the target workload, such as combining extreme busy polling, shallow idle states, and very long scheduler windows for a latency-sensitive service. For example, for Memcached under high load, MLOS repeatedly explores such semantically unsound configurations that lead to >47\times tail-latency increase. Second, many real deployments do not expose the application metrics (or app metrics) to the OS. For PostgreSQL running Wikipedia ( 23 ) , replacing the real latency objective with either of two plausible low-level observable system proxies, instructions per cycle (IPC) or cache misses, yields p99 latency 2\times worse than tuning using the application metric. Third, the problem gets harder as the control surface grows ( 1 ; 17 ) . For PostgreSQL running TPC-C, increasing the tuning surface from 1 to 32 knobs sharply degrades p99 latency by 50%. These failures have the same root cause. Bayesian and RL tuners search over numeric or categorical knob values and interpret scalar rewards, but a live OS uses these values to configure coupled scheduling, power, memory, and I/O policies on a running machine. The main challenge is therefore not only search cost, but reasoning about the meaning of knobs, telemetry, and recovery on a live system. Tuner Host Application OS knobs knob updates signals Figure 1. Steady-state online tuning. A host-side tuner updates OS knobs on a running host and uses observed signals to choose the next step. Our approach : Our key insight is that LLMs can help with exactly these failures because they can reason over the meaning of knobs and telemetry, not just their numeric values, i.e., they have a semantic view of the system state. Like a human expert, given knob names, subsystem context, documentation, current telemetry, and recent history, an LLM can interpret candidate configurations in context rather than as isolated numbers. That lets the tuner reject semantically unsound knob combinations, including both conflicting parameters and numerically valid but workload-nonsensical ones, propose safer repairs, and avoid regions that a human operator would not explore on a live system due to their experience, knowledge, and intuition. The same reasoning also helps when direct application metrics are unavailable. Instead of relying on one brittle proxy such as IPC ( 88 ) or cache misses ( 68 ; 10 ; 9 ) , the model can interpret a joint telemetry signature ( 20 ; 71 ; 44 ; 83 ; 61 ) —for example, CPU saturation, run-queue growth, memory pressure, power-state behavior, and I/O wait—and infer whether the workload is moving toward or away from a better operating point without requiring any training. We turn this insight into SemaTune, an LLM-based framework for online OS tuning. SemaTune builds a semantic view of a tuning problem from the tuning goal, the active knob set, current telemetry, and recent system behavior, and uses that context to choose OS configuration updates for live applications. Instead of treating scheduler, power, memory, and I/O knobs as unrelated values, it reasons about them as parts of a joint system. This lets SemaTune remain effective in

Read the complete text