Hybrid TD3: Overestimation Bias Analysis and Stable Policy Optimization for Hybrid Action Space

Thanh-Tuan Tran 1 , Thanh Nguyen Canh 2 , Nak Young Chong 2,3 and ∗ Xiem HoangVan 1 · 2026

Read Hybrid TD3: Overestimation Bias Analysis and Stable Policy Optimization for Hybrid Action Space by Thanh-Tuan Tran 1 , Thanh Nguyen Canh 2 , Nak Young Chong 2,3 and ∗ Xiem HoangVan 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01302.txt.

Description

Tran and three colleagues propose Hybrid TD3, a spin-off of Twin Delayed Deep Deterministic Policy Gradient for discrete-smooth hybrid action spaces. There, high-level task choices and low-level joint moves must be jointly tuned. They analyze over-guess bias strictly under twin-critic setups, giving formal bounds and a complete bias ranking across five method variants under synced Gaussian error rules. Building on that analysis, they offer a weighted clipped Q-learning target that averages across discrete actions, getting equal bias cut.

Catalog record

CREATORThanh-Tuan Tran 1 , Thanh Nguyen Canh 2 , Nak Young Chong 2,3 and ∗ Xiem HoangVan 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48278
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.01302

Browse the full library · About the Tower of Babel