Training-Free Continuous Bitrate Control for Scalable Image Coding for Humans and Machines

Yui Tatsumi, Hiroshi Watanabe · 2026

Read Training-Free Continuous Bitrate Control for Scalable Image Coding for Humans and Machines by Yui Tatsumi, Hiroshi Watanabe (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00158.txt.

Introduction

Tatsumi and Watanabe offer a way to tune image codes with no fresh training. Scaled image coding serves both human eyes and machine tasks. Each side needs its own data rate. Smooth rate control for both sides has seen scant work so far.

Their frame shifts step sizes for squeezing based on guessed scale values. This lets each layer set its own rate on a smooth scale. Key traits of each layer stay safe in the shift. Tests show the frame works well in use. They also stress that the split of bits across the two layers holds great weight. The work points to lean, flex-rate codes for mixed use.

Catalog record

CREATORYui Tatsumi, Hiroshi Watanabe
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE7 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00158

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Training-Free Continuous Bitrate Control for Scalable Image Coding for Humans and Machines
Yui Tatsumi, Hiroshi Watanabe

Abstract
Continuous variable-rate compression is highly demanded in real-world applications, but remains underexplored in scalable image coding for humans and machines. In this paper, we propose a training-free variable-rate scalable image coding framework. By adjusting quantization steps based on predicted scale values, the proposed method achieves continuous bitrate control while preserving high-scale information in the machine and enhancement layers. Experimental results demonstrate the effectiveness of the proposed method and highlight the importance of bitrate allocation between the two layers.



I
Introduction

Learned image compression (LIC) has been extended beyond human-oriented reconstruction to image coding for machines (ICM).
Scalable image coding for humans and machines further supports both objectives within a single architecture, making it suitable for applications such as traffic monitoring, where images are mainly analyzed by recognition and only occasionally viewed by humans.

However, most existing LIC-based scalable coding methods do not support continuous bitrate control, which limits their practical applicability.
Since scalable coding methods require two dependent layers for recognition and reconstruction, a dedicated variable-rate method is required to control bitrate allocation between the two layers.

In this paper, we propose a training-free variable-rate scalable image coding framework.
By extending scale-aware adaptive quantization control to each layer, the proposed method enables independent and continuous bitrate control for humans and machines.
We also experimentally highlight the bitrate allocation problem between these layers.
The training-free and flexible control design makes the framework practical for deployment under diverse real-world situations.

II
Related Work

Fig. 1:
Overall architecture of the proposed framework.

II-A

Scalable Image Coding for Humans and Machines

FR-ICMH
[
1
]
is a scalable coding method that achieves high flexibility by efficiently employing the task-agnostic SA-ICM
[
2
]
and compressing explicit feature-level residual information to reconstruct human-oriented images from machine-oriented features in the enhancement layer.
Though effective, it does not support continuous bitrate control.

II-B

Variable-Rate Image Coding for Machines

AQVR-ICM
[
3
]
enables training-free continuous bitrate control for ICM through scale-aware quantization.
Instead of uniformly increasing quantization steps for all latent elements to reduce bpp, it assigns finer quantization to high-scale recognition-relevant components and coarser quantization to others.
This selective protection maintains higher recognition accuracy under the same bpp reduction.

III
Proposed Method

We propose a training-free variable-rate scalable coding framework that extends the scale-aware quantization controller of AQVR-ICM to the two-layer FR-ICMH structure, as shown in Fig.
1
.
Since the enhancement layer encodes residual information, its latents may also exhibit non-uniform importance.

The machine and enhancement layers are independently and continuously controlled by user-given parameters
d_{m}
and
d_{h}
, respectively.
For simplicity, we use
d
and
\sigma
to denote the control parameter and predicted scale parameter of either layer in the following formulation.
Since FR-ICMH employs a channel-wise autoregressive entropy model
[
4
]
, the latent representation in each layer is divided into
N
channel slices.

The controller determines quantization step sizes in two stages.
First, it sets slice-wise lower and upper bounds so that earlier slices, which contain more important features, are quantized more finely.
For the
n
-th slice, these bounds are:

\Delta_{\min}^{(n)}=\begin{cases}d+\frac{n-1}{N}(1-d),&0<d<1,\\
1,&d\geq 1,\end{cases}

(1)

\Delta_{\max}^{(n)}=\begin{cases}1,&0<d\leq 1,\\
1+\frac{n}{N}(d-1),&d>1.\end{cases}

(2)

Second, within each slice, the controller maps the predicted scale values to the slice-wise range.
Let
\sigma_{c,h,w}
denote the scale value at channel
c
and spatial position
(h,w)
.
For channel
c
belonging to the
n
-th slice, we compute

\sigma_{\max}^{(c)}=\max_{h,w}\sigma_{c,h,w},\qquad\sigma_{\min}^{(c)}=\min_{h,w}\sigma_{c,h,w}.

(3)

The adaptive quantization step size is then given by

\Delta_{c,h,w}=\Delta_{\max}^{(n)}-\frac{\sigma_{c,h,w}-\sigma_{\min}^{(c)}}{\sigma_{\max}^{(c)}-\sigma_{\min}^{(c)}+\epsilon}\left(\Delta_{\max}^{(n)}-\Delta_{\min}^{(n)}\right).

(4)

Since the scale parameters can be obtained through the hyperprior network during inference, the controller can be applied to pretrained scalable coding models without training.

TABLE I:
mAP@50:95 (%) comparison with different
d_{m}
values

d_{m}

bpp

Detection

Segmentation

YOLOv5

Mask R-CNN

Mask R-CNN

1

0.227

41.9

35.6

32.1

2

0.186

41.0

34.5

31.2

4

0.143

39.5

32.5

29.2

8

0.103

35.6

28.5

25.5

16

0.069

29.0

21.8

19.1

Fig. 2:
Qualitative comparison of human-oriented reconstructed images.

IV
Experiment

The COCO-val dataset
[
5
]
is used for evaluation. We apply the proposed bitrate control to the highest-bitrate pretrained FR-ICMH model without retraining. Table
I
shows recognition performance for different
d_{m}
values.
As
d_{m}
increases, the bitrate decreases with a gradual accuracy drop. These results are consistent with AQVR-ICM and confirm variable-rate machine-layer control within the scalable coding structure.

Fig.
2
shows reconstructed examples, where the proposed method preserves wall textures more clearly than uniform quantization with lower bpp.
Fig.
3
compares human-oriented compression performance of the proposed method with uniform quantization control, fixed-rate scalable method FR-ICMH, and human-oriented LIC-TCM
[
6
]
.
We fix
d_{m}=4
and vary
d_{h}\in\{1,2,4,8,16\}
for the scalable codecs.
The proposed method outperforms uniform quantization, demonstrating the effectiveness of scale-aware adaptive quantization.

We then analyze the effect of different machine-layer operating points on human-oriented reconstruction quality.
Fig.
4
(a) and Fig.
4
(b) plot the enhancement-layer and total (machine + enhancement layer) bitrates, respectively.
In terms of the enhancement-layer bitrate, smaller
d_{m}
achieves higher PSNR because the enhancement layer receives a more accurate machine-layer representation.
In contrast, with the total bitrate, larger
d_{m}
can provide a better RD trade-off by reducing the machine-layer bitrate.
This indicates that the optimal
d_{m}
depends on the priority between recognition and total human-oriented RD performance, suggesting the need for careful two-layer bitrate allocation in practical applications.

Fig. 3:
Rate-distortion comparison of image reconstruction for human viewing among different methods. Solid/dotted lines indicate scalable/human-oriented codecs, and circle/square markers indicate variable-rate/fixed-rate results.

(a)

Enhancement-layer bitrate

(b)

Total bitrate

Fig. 4:
Effect of
d_{m}
on image reconstruction quality in the proposed method with (a) enhancement-layer and (b) total bitrate.

V
Conclusion

In this paper, we propose a training-free continuous bitrate control method for scalable image compression for humans and machines.
Experimental results demonstrate that the proposed method outperforms the baseline and that the preferred bitrate allocation depends on the target objective.

Read the complete text