One Pass, Any Order: Position-Invariant Listwise Reranking for LLM-Based Recommendation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809952 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Recommender systems CCS: Information systems Retrieval models and ranking

Ethan Bito, Yongli Ren, Estrid He · 2026

Read One Pass, Any Order: Position-Invariant Listwise Reranking for LLM-Based Recommendation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809952 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Recommender systems CCS: Information systems Retrieval models and ranking by Ethan Bito, Yongli Ren, Estrid He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27599.txt.

Introduction

Bito, Ren, and He propose InvariRank, a listwise reranking tool for language-model recommendation that scores candidates in any presentation order. Listwise rerankers often let candidate order sway item scores and final rankings, so rankings can reflect prompt layout rather than user taste. InvariRank blocks cross-candidate attention with a fixed mask and cancels order effects through shared positional framing under rotary embeddings. It scores all candidates in one forward pass, without multi-order training, and tests show strong ranking quality with stable rankings across orders.

Catalog record

CREATOREthan Bito, Yongli Ren, Estrid He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23879
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27599

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

One Pass, Any Order: Position-Invariant Listwise Reranking for LLM-Based Recommendation Conference: Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 20–24, 2026; Melbourne, VIC, Australia Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’26), July 20–24, 2026, Melbourne, VIC, Australia DOI: 10.1145/3805712.3809952 ISBN: 979-8-4007-2599-9/2026/07 CCS: Information systems Recommender systems CCS: Information systems Retrieval models and ranking Ethan Bito, Yongli Ren, Estrid He Abstract . Large language models (LLMs) are increasingly used for recommendation reranking, but their listwise predictions can depend on the order in which candidates are presented. This creates a mismatch between the set-based nature of recommendation and the sequence-based computation of decoder-only LLMs, where permuting an otherwise identical candidate set can change item scores and final rankings. Such order sensitivity makes LLM-based rerankers difficult to rely on, since rankings may reflect prompt serialization rather than user preference. We propose InvariRank, a permutation-invariant listwise reranking framework that addresses this dependence at the architectural level. InvariRank blocks cross-candidate attention with a structured attention mask, and negates position-induced scoring changes through shared positional framing under Rotary Positional Embeddings (RoPE). Combined with a listwise learning-to-rank objective, the model scores all candidates in a single forward pass, avoiding permutation-based invariance training objectives which require multiple permutations of a candidate set. Experiments on recommendation benchmarks show that InvariRank maintains competitive ranking effectiveness while producing stable rankings across candidate permutations. The results suggest that architectural invariance is a practical route to reliable and efficient LLM-based recommendation reranking. The source code is at https://github.com/ejbito/InvariRank . † † cc-license: by 1. Introduction Large language models (LLMs) are increasingly used for listwise reranking in recommender systems, as they combine item descriptions, user histories, and task instructions within a single conditional scoring process ( 10 ; 12 ; 7 ; 25 ) . In two-stage pipelines, a fixed set of retrieved candidates is passed to the LLM and reranked in one forward pass, making listwise LLM reranking a natural and flexible design choice. However, this use of LLMs introduces a fundamental mismatch. Recommendation candidates form a set, but decoder-only LLMs process them as a sequence. As a result, rankings can depend not only on user preference and item relevance, but also on the arbitrary order in which candidates are serialized. Even when the user history and candidate set are unchanged, simply permuting the candidate order can produce different scores and rankings ( 23 ; 1 ) . This goes beyond prompt sensitivity, such that the ranker may fail to behave as a well-defined ranking function over a candidate set. Such order dependence creates a serious reliability problem for LLM-based recommendation. A model that promotes an item in one serialization but demotes it in another is unstable and difficult to evaluate, reproduce, and deploy. Standard ranking metrics can obscure this issue because they measure the quality of a single observed ranking, while ignoring whether the same candidate set would produce a different ranking under an equivalent presentation. For listwise LLM reranking to be reliable, ranking quality and permutation robustness must both be considered. To address this, we enforce permutation invariance directly at the architectural level. We argue that this sensitivity arises from two architectural sources in decoder-only LLMs. First, cross-candidate attention leakage allows tokens from one candidate to attend to tokens from others, creating order-dependent interference between items. Second, offset drift under Rotary Positional Embeddings (RoPE) changes the relative positional offsets between candidates and the shared user context when candidates are permuted, perturbing attention patterns and item scores ( 23 ; 21 ) . Together, these mechanisms couple predicted relevance to candidate position rather than only to candidate content and user context. Prior work can reduce this behavior, but generally leaves the source of order dependence intact. Inference-time methods such as permutation ensembling improve stability by aggregating multiple candidate orders, but require repeated model calls ( 23 ; 13 ) . Comparison-based prompting avoids some listwise ordering effects by decomposing ranking into smaller decisions, but increases inference cost ( 1 ; 2 ) . Training-time regularization penalizes disagreement across permutations, but the model can still access order information during computation ( 2 ) . We instead remove order-dependent channels architecturally. We design the computation so that each candidate is scored from the shared user context and its own content, while preventing other candidates from influencing its representation. We further use a shared positional framing under RoPE so that each candidate is evaluated under the same positional relationship to the user context, regardless of its position in the serialized input ( 5 ; 21 ) . This makes permutation invariance a property of the model computation rather than an effect of repeated inference or auxiliary loss terms. We make the following contributions. (1) We identify cross-candidate attention leakage and RoPE-induced offset drift as two concrete sources of position bias in decoder-only LLM reranking. (2) We propose InvariRank, a permutation-invariant, single-pass listwise reranker that enforces set-level invariance by design, while retaining listwise learning through a LambdaRank objective. (3) We show that InvariRank maintains competitive ranking effectiveness while substantially improving permutation robustness across benchmarks, providing a practical path toward reliable LLM-based recommendation reranking. 2. Related Work In recommender systems ( 9 ; 30 ; 27 ) , LLMs are commonly deployed as rerankers in two-stage pipelines, where a retrieval model first produces a fixed candidate set because of computational and context-length constraints ( 17 ; 6 ; 26 ; 22 ) . Among pointwise, pairwise, and listwise formulations, listwise reranking has emerged as a particularly effective paradigm for LLMs, as it enables joint scoring of all candidates and leverages global context ( 20 ; 28 ; 31 ; 19 ) . However, recent work shows that listwise LLM rerankers can produce different rankings for the same candidate set when the input order is changed ( 3 ; 13 ; 16 ) . This behavior arises from architectural properties of autoregressive transformers, including causal attention and positional encodings ( 3 ) , which couple predicted relevance to candidate position. As a result, ranking outputs can depend on prompt serialization rather than only on the underlying items and user context. Prior approaches aim to mitigate this effect but do not remove its source. Inference-time methods such as permutation aggregation and greedy selection improve stability by combining multiple candidate orders, but require repeated model calls ( 13 ; 1 ) . Post-hoc calibration methods adjust scores to counteract position bias after scoring has already been affected ( 18 ) . Training-time regularization and position-aware fine-tuning penalize disagreement across permutations, but the model still has access to order information during computation ( 29 ; 2 ) . These approaches reduce variability in outputs, but operate outside the model’s core computation and leave the underlying order dependence intact. A notable training-time method is ALRO ( 2 ) , which encourages invariance through a loss-based formulation by casting ranking as a generative task (e.g., producing sequences such as "A > B > C" ). While effective in explicit-feedback settings, ALRO differs from our setting in two key aspects. It does not operate in a two-stage reranking pipeline over retrieved candidates, and it enforces invariance

Read the complete text