Deep Learning based Three-stage Solution for ISAC Beamforming Optimization
Qian Gao*, Ruikang Zhong*, and Yuanwei Liu † · 2026
Read Deep Learning based Three-stage Solution for ISAC Beamforming Optimization by Qian Gao*, Ruikang Zhong*, and Yuanwei Liu † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20667.txt.
Introduction
Qian Gao, Ruikang Zhong, and Yuanwei Liu build a deep learning solution, in three stages, for beamforming in integrated sensing and communication systems. In their setup, a base station communicates with several users while also performing target detection. The design problem is to maximize the total communication rate.
The maximization is subject to a transmit power limit and minimum sensing rates for the users. Splitting the solution into three stages makes a coupled problem learnable. Systems that sense and talk through one station are a pillar of planned sixth-generation networks, from traffic monitoring to smart factories.
Catalog record
| CREATOR | Qian Gao*, Ruikang Zhong*, and Yuanwei Liu † |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20667
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Learning based Three-stage Solution for ISAC Beamforming Optimization Qian Gao*, Ruikang Zhong*, and Yuanwei Liu † Abstract In this paper, a general ISAC system where the base station (BS) communicates with multiple users and performs target detection is considered. Then, a sum communication rate maximization problem is formulated, subjected to the constraints of transmit power and the minimum sensing rates of users. To solve this problem, we develop a framework that leverages deep learning algorithms to provide a three-stage solution for ISAC beamforming. The three-stage beamforming optimization solution includes three modules: 1) an unsupervised learning based feature extraction algorithm is proposed to extract fixed-size latent features while keeping its essential information from the variable channel state information (CSI); 2) a reinforcement learning (RL) based beampattern optimization algorithm is proposed to search the desired beampattern according to the extracted features; 3) a supervised learning based beamforming reconstruction algorithm is proposed to reconstruct the beamforming vector from beampattern given by the RL agent. Simulation results demonstrate that the proposed three-stage solution outperforms the baseline RL algorithm by optimizing the intuitional beampattern rather than beamforming. E-mail: {q.gao, r.zhong}@qmul.ac.uk, [email protected] I Introduction Integrated sensing and communication (ISAC), which is also known as dual-functional radar-communication or joint radar-communication, is expected to be a key technology in sixth-generation mobile communication (6G) [ 9 ] . It facilitates the bursting development of plentiful emerging applications, including but not limited to human-computer interaction [ 6 ] , smart home [ 1 ] and internet-of-vehicles [ 10 ] , by providing high-throughput transmission and accurate sensing simultaneously. On the other hand, communication and radar sensing are both evolving towards larger antennas. ISAC systems can not only benefit the spectrum efficiency and implementation cost reduction by resource sharing and hardware reuse but also introduce mutual gains via communication-aided sensing or sensing-aided communication [ 3 ] . Although ISAC has the above advantages, extra efforts are required to execute resource allocation and interference management between communication and sensing functionalities. To tackle these issues, beamforming techniques [ 13 , 12 , 17 ] have been widely studied, as they enable spatial filtering and efficient use of spectral and spatial resources, thereby facilitating the coexistence of dual functionalities. Beamforming optimization has the potential to improve the performance gain of multiple-input multiple-output (MIMO) systems, which has been proven to be effective in MIMO communication and MIMO radar systems [ 11 ] . Following this, a number of researchers have also investigated numerous algorithms to support beamforming optimization in ISAC scenarios. These algorithms can generally be divided into conventional convex optimization based solutions and machine learning based solutions. Convex optimization methods tend to be computational complex when dealing with scenarios involving a large number of parameters [ 16 ] . In contrast, machine learning based solutions can adapt to non-convex and high-dimensional problems, and it dose not have significant complexity in inference. However, they cannot guarantee the optimality of beamforming and are weak in interpretation. As the number of antennas and users increases, deep learning (DL) have more advantages in ISAC beamforming optimization than convex optimization. Existing deep learning-based beamforming optimization approaches typically attempt to directly map the channel state information (CSI) to the beamforming vector. While these methods have demonstrated promising results, they suffer from two key limitations. First, the dimensionality of the optimization variables grows rapidly with the number of antennas and users, leading to increased computational complexity and training difficulty. Second, directly optimizing the beamforming vector lacks interpretability, making it difficult to understand or control the underlying beamforming behavior. To address these limitations, in this paper, we propose a three-stage beamforming optimization solution that decomposes beamforming optimization into feature extraction, beampattern optimization, and beamforming reconstrcution. By optimizing the beampattern, we are able to control the directionality and interference behavior in a more structured manner, while significantly reducing the learning complexity. The main contributions of this paper can be summarized as follows: 1) We consider a full-duplex (FD) ISAC system with two ULAs acting as a transceiver, and formulate a beamforming optimization problem to maximize the sum communication rate under sensing rate and power constraints. To derive the optimal transmit and receive beamforming vectors more intuitional, we transform the beamforming optimization problem to a beampattern optimization problem by multiplying corresponding array response vectors; 2) we design a three-stage solution to decompose the optimization problem into three sub-modules: unsupervised learning based CSI feature extraction module, RL-based beampattern optimization module, and supervised learning based beamforming reconstruction module. Compared to direct RL approaches, the proposed three-stage framework enhances generalization via feature extraction, improves training stability by optimizing in the beampattern domain, and offers better interpretability through the intermediate beampattern representation. II System Model and Problem Formulation We consider a FD ISAC system as shown in Fig. 1 , where a base station (BS) equipped with N_{t} transmit antennas, and N_{r} receive antennas. The transceiver provides downlink communication for K single antenna users and radar sensing for L targets via the same time-frequency resource. To be specific, N_{t} antennas transmit communication signals to the K users and dedicated sensing signals to L targets simultaneously. Then, N_{r} antennas receive the echoes from all targets. We assume the BS antenna arrays are ULAs with a half wavelength antenna spacing, d=\lambda/2 . Thus, the transmit (receive) antenna aperture is D=(N_{t}-1)d . II-A Signal Model We employ a narrowband ISAC signal, \mathbf{x}\in\mathbb{C}^{N_{t}\times 1} , for multi-user downlink communication and multi-target sensing. Following [ 5 ] , the integrated signal can be expressed as \displaystyle\mathbf{x}=\sum_{k=1}^{K}\mathbf{w}_{k}s_{k}+\sum_{l=1}^{L}\mathbf{v}_{l}z_{l}, (1) where \mathbf{w}_{k}\in\mathbb{C}^{N_{t}\times 1} stands for the BS’s transmit beamforming vector for user k , k\in\{1,\dots,K\} , and s_{k}\in\mathbb{C} is the data symbol for user k with \mathbb{E}[|s_{i}|^{2}]=1 . \mathbf{v}_{l}\in\mathbb{C}^{N_{t}\times 1} denotes the transmit beamforming vector associated with target l , l\in\{1,\dots,L\} , and z_{l}\in\mathbb{C} with unit power is the dedicated sensing signal for target l . Here, the signals \{s_{k}\}_{k=1}^{K} and \{z_{l}\}_{l=1}^{L} are assumed to be independent with each other. Moreover, the transmit beamforming vectors should comply with the constraint \sum_{k=1}^{K}||\mathbf{w}_{k}||^{2}+\sum_{l=1}^{L}||\mathbf{v}_{l}||^{2}\leq P_{\text{max}} , considering transmit ULA’s maximum available power budget P_{\text{max}} . Denoting the the downlink channel between transmit ULA and the k -th user as \mathbf{h}_{k}\in\mathbb{C}^{N_{t}\times 1} , the received signal at user k can be given by \displaystyle y^{\text{com}}_{k} \displaystyle=\mathbf{h}_{k}^{H}\mathbf{x}+n_{k} \displaystyle=\mathbf{h}_{k}^{H}\mathbf{w}_{k}s_{k}+\sum_{i=1,i\neq k}^{K}\mathbf{h}_{k}^{H}\mathbf{w}_{i}s_{i}+\sum_{l=1}^{L}\mathbf{h}_{k}^{H}\mathbf{v}_{l}z_{l}+n_{k}, (2) where n_{k}\sim\mathcal{CN}(0,\sigma^{2}_{k}) is the circularly symmetric complex Gaussian noise with variance \sigma^{2}_{k} . Meanwhile, the channels between transmit ULA and the l -th target and between the l -th target and receive ULA are represented as \mathbf{g}_{l,t}\in\mathbb{C}^{N_{t}\times 1} and \mathbf{g}_{l,r}\in\mathbb{C}^{N_{r}\times 1} , respectively. The echos reflected from targets is \displaystyle y^{\text{sen}}_{\text{BS}}=\sum_{l=1}^{L}\mathbf{g}_{l,r}\mathbf{g}^{H}_{l,t}\mathbf{x}+\mathbf{H}_{\text{SI}}\mathbf{x}+\mathbf{n}, (3) where \mathbf{H}_{\text{SI}}\mathbf{x} is the self-interference (SI) due to simultaneous transmission and reception, \mathbf{H}_{\text{SI}}\in\mathbb{C}^{N_{r}\times N_{t}} is the residual SI channel after SI cancellation [ 8 ] , and \mathbf{n}\in\mathbb{C}^{N_{r}\times 1} is the circularly symmetric complex Gaussian noise with variance \sigma^{2}_{r} \mathbf{I}_{N_{r}} . According to [ 14 ] , the radar channel can be expressed as the multiplication of complex path-loss coefficient and steering vector. Thus, ( 3 ) can be rewritten as \displaystyle y^{\text{sen}}_{\text{BS}}=\sum_{l=1}^{L}\alpha_{l}\mathbf{A}(\theta_{l})\mathbf{x}+\mathbf{H}_{\text{SI}}\mathbf{x}+\mathbf{n}, (4) where \alpha_{l} is assumed to be the round path-loss coefficient of target l , and \mathbf{A}(\theta_{l})=\mathbf{a}_{r}(\theta_{l})\mathbf{a}^{\mathbf{H}}_{t}(\theta_{l})\in\mathbb{C}^{N_{r}\times N_{T}} . The transmit steering vector \mathbf{a}_{t}(\theta_{l}) and receive steering vector \mathbf{a}_{r}(\theta_{l}) can characterized as \displaystyle\mathbf{a}_{t}(\theta_{l})=\left[1,e^{-j2\pi\Delta_{t}\sin(\theta_{l})},\dots,e^{-j2\pi(N_{t}-1)\Delta_{t}\sin(\theta_{l})}\right], (5) \displaystyle\mathbf{a}_{r}(\theta_{l})=\left[1,e^{-j2\pi\Delta_{r}\sin(\theta_{l})},\dots,e^{-j2\pi(N_{r}-1)\Delta_{r}\sin(\theta_{l})}\right],