RL based Beamforming Optimization for 3D Pinching Antenna assisted ISAC Systems

Qian Gao, Ruikang Zhong · 2026

Read RL based Beamforming Optimization for 3D Pinching Antenna assisted ISAC Systems by Qian Gao, Ruikang Zhong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20654.txt.

Introduction

Qian Gao and Ruikang Zhong use reinforcement learning to optimize beamforming for three-dimensional pinching antenna systems that both sense and communicate. They propose a three-dimensional deployment scheme for the pinching antenna array, aiming to improve integrated sensing and communication performance. Realizing that potential takes joint design.

Antenna positions, time allocation, and transmit power must be optimized together, to maximize the total communication rate under target sensing rates and an energy budget. Pinching antennas, which can be placed along a waveguide where needed, offer a flexible new hardware base for such joint designs.

Catalog record

CREATORQian Gao, Ruikang Zhong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20654

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RL based Beamforming Optimization for 3D Pinching Antenna assisted ISAC Systems Thanks: Qian Gao, and Ruikang Zhong are with the School of Electronic Engineering and Computer Science, Queen Mary University of London, London, E1 4NS, U.K. (e-mail: {q.gao, r.zhong}@qmul.ac.uk). Yue Liu is with the Faculty of Applied Sciences, Macao Polytechnic University, Macao SAR, China. (e-mail: [email protected]) Hyundong Shin is with the Department of Electronics and Information Convergence Engineering, Kyung Hee University, 1732 Deogyeong-daero, Giheung-gu, Yongin-si, Gyeonggi-do 17104, Republic of Korea. (e-mail: [email protected]) Yuanwei Liu is with the Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong. (e-mail: [email protected]). Qian Gao, Ruikang Zhong Abstract In this paper, a three-dimensional (3D) deployment scheme of pinching antenna array is proposed, aiming to enhances the performance of integrated sensing and communication (ISAC) systems. To fully realize the potential of 3D deployment, a joint antenna positioning, time allocation and transmit power optimization problem is formulated to maximize the sum communication rate with the constraints of target sensing rates and system energy. To solve the sum rate maximization problem, we propose a heterogeneous graph neural network based reinforcement learning (HGRL) algorithm. Simulation results prove that 3D deployment of pinching antenna array outperforms 1D and 2D counterparts in ISAC systems. Moreover, the proposed HGRL algorithm surpasses other baselines in both performance and convergence speed due to the advanced observation construction of the environment. I Introduction Integrated sensing and communication (ISAC) has emerged as a transformative paradigm in next-generation wireless systems [ 4 ] . By enabling spectrum and hardware sharing between these two traditionally separate functions, ISAC systems meet requirements of increased spectral efficiency, reduced infrastructure cost, and enhanced situational awareness. Such capabilities are crucial for emerging applications such as autonomous vehicles [ 5 , 15 ] , and WiFi sensing [ 2 ] . Antennas play a vital role in the resource utilization efficiency of ISAC. Various flexible antennas have been proposed to promote the adaptability and performance of ISAC systems. However, existing flexible antennas [ 16 , 10 , 9 ] are with limited antenna variation and their utilization cost is high when antenna number is large. Fortunately, pinching antennas [ 1 ] having the low-cost and highly reconfigurable features became a potential candidate antenna technology for the ISAC system. As dielectric-waveguide-based leaky antennas, pinching antennas can be activated at any position by “pinching” the waveguide, forming on-demand line-of-the-sight (LoS) beams to both users and sensing targets without expensive phase-array hardware. This mobility counters large-scale path loss, enlarges the effective aperture, and naturally supports near-field spherical-wave operation, all of which are beneficial to ISAC throughput and sensing accuracy. Existing ISAC studies [ 14 , 7 , 13 ] for pinching antennas place all elements on a single straight waveguide or on a pair of parallel waveguides lying in the x\!-\!y plane. Although these 1D/2D deployments simplify analysis, they lose elevation diversity, and limit angular coverage. In this paper, we extend existing pinching antenna assisted ISAC system to the 3D configuration. Compared with 1D/2D layouts, the proposed 3D deployment not only offers full-space beam steering for airborne or elevated users and targets but also provides additional spatial degrees-of-freedom (DoFs) that decouple communication and sensing beams. However, the 3D geometry of pinching antennas introduces a larger continuous action space (antenna displacement, TDMA weights, and power allocation) that conventional reinforcement learning (RL) or hand-crafted optimization can barely handle [ 12 ] . We therefore propose HGRL, a heterogeneous graph neural network based reinforcement learning framework that firstly represents the antenna–user–target topology as a time-varying heterogeneous graph and encodes it via a graph neural network (GNN) [ 11 ] ; then utilises a RL policy to jointly adjust 3D antenna positioning, TDMA allocation and transmit power assignment. The main contributions of this paper can be summarized as below: • We formulate the 3D pinching antenna assisted ISAC system as a Markov decision process (MDP) that captures fine-grained resource control. The objective is to maximize the sum communication rate, subject to the target sensing rate and transmit power budget. • We develop HGRL, the first heterogeneous GNN based RL framework for 3D pinching antenna assisted ISAC system, enabling scalable optimization over graph-structured states and mixed action spaces. • We conduct numerical experiments to demonstrate the effectiveness of the proposed 3D pinching antennas and HGRL algorithm in enhancing the ISAC performance. The rest of this paper is organized as follows: Section II illustrates the system model, and problem formulation. In Section III , we propose the HGRL algorithm for antenna positioning and transmit power optimization. Then, the numerical results and performance analysis are provided in Section IV . Finally, we conclude the paper in Section V . II System Model and Problem Formulation In this paper, we propose a 3D pinching antenna assisted downlink ISAC system, as shown in Fig. 1 . We assume that base station (BS) is equipped with three orthogonal waveguides, each aligned along one of the Cartesian axes ( x , y , z ), to jointly serve K single-antenna communication users and detect L sensing targets. Each waveguide contains N pinching antennas (PAs), resulting in M=3N total antennas. The positions of the n th PA on the x -, y -, and z -aligned waveguides are denoted as \psi^{p}_{n_{x}}=(x_{n},0,d) , \psi^{p}_{n_{y}}=(0,y_{n},d) , and \psi^{p}_{n_{z}}=(0,0,z_{n}) , respectively, where d is the fixed elevation above the x - y plane. Communication users and sensing targets are located in the x - y plane, with coordinates \psi^{\text{com}}_{k}=(x_{k},y_{k},0) and \psi^{\text{sen}}_{l}=(x_{l},y_{l},0) , respectively. Due to the limited number of waveguides, we adapt a time-division multiple access (TDMA) scheme to separately serve communication users and sensing targets. Specifically, each time slot t\in\mathcal{T}=\{1,2,\dots,T\} is first divided into different communication proportions q^{\text{com}}_{k,t} , and they satisfy \sum_{k=1}^{K}q^{\text{com}}_{k,t}\leq 1 . Then, targets can be sensed during these proportions by considering communication symbol as radar pulse. Moreover, the configuration of the system is assumed to be fixed during time slot t , but it varies across different slots to optimize the ISAC performance. Fig. 1 : Illustration of the 3D pinching antenna assisted downlink ISAC system. II-A Signal Model The transmitted signal at the BS in time slot t is composed of a combination of the communication signal s^{\text{com}}_{t,k} \displaystyle s_{t}=\sum_{k=1}^{K}z_{k}s^{\text{com}}_{k,t}, (1) where the signal energy is normalized \quad\mathbb{E}[|s_{t}|^{2}]=1 and [z_{1},\cdots,z_{k},\cdots,z_{K}] is a one-hot vector. Then, this signal is fed into waveguides at the same time for signal radiation. For each waveguide, the signals transmitted by PAs are phase-shifted version of each other. The radiation signal can be expressed as \displaystyle\mathbf{s}_{t}=\left[\sqrt{\frac{P}{M}}e^{-j\theta_{1,t}},\cdots,\sqrt{\frac{P}{M}}e^{-j\theta_{N,t}}\right]^{T}s_{t}, (2) where P is the transmit power, \theta_{n,t} is the signal phase shift at n -th PA and \theta_{n,t}=2\pi\frac{|\psi^{p}_{0}-\psi^{p}_{n_{a},t}|}{\lambda_{0}} . Thereof, \psi^{p}_{0} is the location of feed point, a\in\{x,y,z\} denotes the waveguide parallel to different axis, \lambda_{0}=\frac{\lambda}{n_{\text{neff}}} is the waveguide wavelength in a dielectric waveguide, n_{\text{neff}} is the effective refractive index and \lambda represents wavelength. Since the employment of PAs provides LoS channel condition for ISAC, the near-field spherical wave channels for communication user k and sensing target l can be expressed as \displaystyle\mathbf{h}_{k,t}=\left[\frac{\alpha e^{-j\frac{2\pi}{\lambda}|\psi^{\text{com}}_{k,t}-\psi^{p}_{1_{a},t}|}}{|\psi^{\text{com}}_{k,t}-\psi^{p}_{1_{a},t}|},\cdots,\frac{\alpha e^{-j\frac{2\pi}{\lambda}|\psi^{\text{com}}_{k,t}-\psi^{p}_{N_{a},t}|}}{|\psi^{\text{com}}_{k,t}-\psi^{p}_{N_{a},t}|}\right], (3) and \displaystyle\mathbf{h}_{l,t}=\left[\frac{\alpha e^{-j\frac{2\pi}{\lambda}|\psi^{\text{sen}}_{l,t}-\psi^{p}_{1_{a},t}|}}{|\psi^{\text{sen}}_{l,t}-\psi^{p}_{1_{a},t}|},\cdots,\frac{\alpha e^{-j\frac{2\pi}{\lambda}|\psi^{\text{sen}}_{l,t}-\psi^{p}_{N_{a},t}|}}{|\psi^{\text{sen}}_{l,t}-\psi^{p}_{N_{a},t}|}\right], (4) where \alpha=\frac{c}{4\pi f_{c}} is a constant that depends on the speed of light c and the carrier frequency f_{c}

Read the complete text