SoccerNet 2026 Player-Centric Ball Action Spotting: Per-Player Attention with Agreement-Based Ensembling
Faisal Altawijri, Ismail Mathkour · 2026
Read SoccerNet 2026 Player-Centric Ball Action Spotting: Per-Player Attention with Agreement-Based Ensembling by Faisal Altawijri, Ismail Mathkour (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28389.txt.
Introduction
Faisal Altawijri and Ismail Mathkour report their system for the SoccerNet 2026 challenge, which spots ball actions player by player in soccer video. The organizers supplied a two-stage pipeline: a detector that scores each player's actions frame by frame, and a sequence model that converts scores and game state into structured events.
Altawijri and Mathkour improve both stages. A temporal transformer lets the detector reason across frames instead of judging each in isolation, and they fixed a scheduler bug that had frozen the learning rate at its warmup value. The sequence model gains two-stage per-player attention, first across players within a frame, then across time for each player. An agreement-based ensemble combines model variants. Their final submission reached a macro-F1 of about fifty-nine on the challenge set.
Catalog record
| CREATOR | Faisal Altawijri, Ismail Mathkour |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 7 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28389
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SoccerNet 2026 Player-Centric Ball Action Spotting: Per-Player Attention with Agreement-Based Ensembling
Faisal Altawijri, Ismail Mathkour
Abstract
1. System Overview
Our system follows the two-stage pipeline provided by the organizers
[
3
]
: (1) a Track-Aware Action Detector (TAAD)
[
4
]
processes video to produce per-player action logits, and (2) a Denoising Sequence Transduction (DST)
[
2
]
autoregressive transformer converts game-state features and TAAD logits into structured event sequences. We contribute improvements to both stages and introduce an agreement-based ensemble strategy. Our final submission achieves
58.94 Macro-F1
on the challenge set.
2. Stage 1: TAAD Improvements
2.1 Architecture: Temporal Transformer
We extend the baseline X3D
[
1
]
-based TAAD with a temporal transformer. After ROI-aligned features are extracted per player per frame, we project them to
d{=}256
dimensions and apply
L{=}4
transformer encoder layers with 8 attention heads, feedforward dimension 1024, GELU activation, and pre-norm ordering. Learnable positional embeddings (up to 50 frames) provide temporal context. The transformer output is projected to 512 dimensions before the 9-class classification head. This allows the model to reason about temporal patterns across frames rather than classifying each frame independently.
2.2 Training Modifications
We identified and fixed a warmup scheduler bug where the learning rate stopped updating prematurely and remained at its warmup value for the remainder of training. Additional training changes: (a) cosine annealing LR scheduler for all layers except X3D, while X3D uses a fixed LR of
5\times 10^{-5}
after warmup; (b) both learning rates divided by
\sqrt{8}
; (c) warmup set to 100 steps with no gradient accumulation; (d) background class weight reduced to 0.05; (e) tracklet count increased from 4 to 6 at epoch 16. The resulting TAAD logits are used as frozen input to all DST experiments.
3. Stage 2: DST Improvements
3.1 Per-Player Attention
The baseline encoder treats the 26-role feature vector as a flat input per frame. We introduce a two-stage per-player attention mechanism before the main transformer encoder. Player features (5 game-state channels + 9 TAAD logit channels per role) are reshaped to per-player representations and processed through two stages.
Stage 1 (Spatial):
Cross-player spatial attention at each frame. Features are reshaped so that all 26 players at each timestep attend to each other via a transformer encoder layer (
d_{p}{=}64
, 4 heads), capturing spatial relationships between players at every moment.
Stage 2 (Temporal):
Per-player temporal self-attention across frames. Each player’s representation from Stage 1 is processed independently across the time dimension with sinusoidal positional encoding, processed by another transformer encoder layer, capturing how individual player states evolve over time.
Figure 1:
DST encoder with spatial-first per-player attention. The decoder (not shown) autoregressively generates (frame, action, role) tuples.
The attended features are mean-pooled across players and concatenated with the game-state logits per frame, then projected and added to the main encoder input. We found that using only game-state features (positions, velocities, visibility) for the per-player attention, excluding TAAD logits, outperforms using all channels.
3.2 Spatial-First Attention Order
We found that processing spatial attention first, then temporal, yields a significant improvement (+1.87% Macro-F1 on validation, from 0.549 to 0.567). The intuition is that understanding spatial player configurations at each frame provides richer context for subsequent temporal reasoning than the reverse order.
3.3 Architectural Diversity
To enable effective ensembling, we train four DST models with different hyperparameters, all using the spatial-first per-player attention mechanism:
Model A
(base): hidden dim 512, 1 player attention layer,
d_{p}{=}64
(0.567 val F1)
Model B
: hidden dim increased to 768 (0.571 val F1)
Model C
: 2 player attention layers with
d_{p}{=}128
(0.572 val F1)
Model D
: parallel attention, where temporal and spatial branches process the raw input independently and their outputs are summed rather than sequentially (0.569 val F1)
All models use 6 encoder/decoder layers, 8 attention heads, dropout 0.1, learning rate
2.5\times 10^{-4}
with exponential decay (factor 0.1 at epochs 3, 6, 8), and are trained for 10 epochs. A checkpoint sweep selects the best-performing epoch per model.
3.4 Inference: Tau Correction
During development, we found that selecting the logit adjustment temperature
\tau
based on per-class optimized Macro-F1 on validation rather than default (raw threshold) Macro-F1 led to suboptimal challenge performance, as per-class thresholds overfit to the 6 validation games (48.0 vs. 48.6 on challenge). Using
\tau{=}0
with default thresholds consistently performs best, and we adopt this for all final predictions.
4. Ensemble Strategy
4.1 Weighted Event Fusion with Agreement Filtering
Given
N
models producing event predictions per game, we ensemble using Weighted Event Fusion: (1) Group all predictions by (team, shirt number, action class). (2) Cluster predictions within
\pm 12
frames via greedy assignment to the nearest cluster center, sorted by score descending. (3) For each cluster with
n
contributing models: compute the average score across contributing models, multiplied by
(n/N)^{0.5}
as an agreement boost. (4) Apply min_models
{=}2
: discard events predicted by fewer than 2 models.
Agreement filtering is the key mechanism: it suppresses false positives (hallucinations from single models) while reinforcing true positives that multiple models agree on. We systematically evaluated NMS, score averaging, max score, and fusion across all model combinations, and fusion with min_models
{=}2
consistently outperforms all alternatives.
4.2 Solo Tackle Exception
Tackle events are extremely rare (26 occurrences across 96 training games) with the lowest per-model F1 (
\sim
0.05–0.15). The agreement filter aggressively removes correct tackle predictions where only one model detects them. We add an exception: tackle predictions bypass the agreement filter and are kept even with single-model support. This preserves recall on the rarest class without affecting other classes.
5. Results
Configuration
Val F1
Challenge F1
DST with improved TAAD
0.541
48.6
+ per-player attention
0.549
–
+ spatial-first order
0.567
55.1
4-model ensemble
0.609
58.9
Table 1:
Progressive improvement. Final ensemble uses Models A–D with fusion, min_models=2, and solo tackle exception.
dri
pas
crs
thr
sho
hea
tac
blk
Model A
.803
.819
.717
.802
.622
.403
.049
.323
Model B
.804
.811
.749
.802
.630
.384
.154
.238
Model C
.821
.824
.728
.788
.629
.378
.054
.351
Model D
.808
.819
.738
.784
.634
.405
.100
.260
Ensemble
.839
.840
.764
.828
.677
.450
.123
.354
Table 2:
Per-class F1 on validation.
Bold
= best,
underline
= second best. The ensemble outperforms all individual models on every class except tackle, where Model B is the strongest.
The ensemble benefits common-to-medium frequency classes (drive through header), where agreement filtering suppresses false positives while preserving recall. The validation-to-challenge gap narrows from
\sim
6 points (single model) to
\sim