Deep Learning approaches for nuclear binding energy prediction: A comparative study of RNN, GRU and LSTM Models Amir Jalili 1, Feng Pan 2,3, Ai Xi Chen 1, Jerry P. Draayer 3 Abstract This study investigates the application of deep learning models-recurrent neural networks, gated recurrent units, and long short-term memory networks-for predicting nuclear binding energies. Utilizing data from the Atomic Mass Evaluation (AME2020), we incorporate key nuclear structure features, including proton and neutron numbers, as well as additional terms from the liquid drop model and shell effects. Our comparative analysis demonstrates that the gated recurrent units model achieves the lowest root-mean-square error ( σ RMSE \sigma_{\mathrm{RMSE}} ) of 0.326 MeV, surpassing traditional regression-based approaches. To assess model reliability, we validate predictions using the Garvey-Kelson relations, obtaining an error of 0.202 MeV, and further test extrapolation capabilities using the WS, WS3, and WS4 models. The extrapolation analysis confirms the robustness of our approach, particularly in predicting binding energies for nuclei near the driplines. These results highlight the effectiveness of deep learning in nuclear BE predictions, highlighting its potential to enhance the accuracy and reliability of theoretical nuclear models. I Introduction The precise determination of nuclear binding energy (BE) is crucial for understanding the stability and structure of atomic nuclei, as well as the fundamental interactions that govern them. Traditional global models, such as the liquid drop model (LDM) ldm and the Bethe-Weizsäcker (BW) formula ws1 ; ws2 , have long served as the foundation for nuclear mass predictions. While subsequent refinements, including the finite-range droplet model (FRDM) mol and Weizsäcker-Skyrme (WS) model ws4 , have improved predictive accuracy, significant discrepancies persist, particularly near the nuclear drip lines. Different kinds of nuclear mass models have been developed to incorporate more effects, which are known microscopic mass models based on the relativistic r1 ; r2 ; r3 ; r4 ; r5 ; r6 ; r7 ; r8 ; r9 ; r10 ; r11 , and nonrelativistic density functionals with other theoretical models n1 ; n2 ; n3 ; n4 ; n5 ; n6 ; n7 ; n8 ; n9 ; n10 . These challenges necessitate the exploration of alternative approaches that can effectively capture the complex nonlinear dependencies within nuclear data. Theoretical models for nuclear mass predictions can generally be categorized into two main types: global models and local models l1 ; l2 ; l3 ; l4 . Global theoretical models, such as macroscopic-microscopic approaches and nuclear density functional theories pw , aim to describe nuclear masses across the entire nuclear chart by utilizing a unified theoretical framework. While these models provide valuable insights into nuclear structure and large-scale trends, their accuracy may vary in regions where experimental data are scarce. In contrast, local models rely on the assumption of strong correlations between neighboring nuclei and establish predictive relationships based on known experimental masses. These approaches, often referred to as local-type theoretical models, have distinct advantages in regions where experimental data are available, as they can achieve higher predictive accuracy by using well-established nuclear interactions. Among the most notable local models is the Garvey-Kelson (GK) relation gk1 ; gk2 ; gk3 ; gk4 , which exploits linear mass relationships between neighboring nuclei to estimate unknown masses with remarkable precision. Another widely used local approach is the neutron-proton interaction-based mass relation, which incorporates the effects of nucleon interactions to refine mass predictions. Due to their reliance on empirical data, local models demonstrate exceptional accuracy within experimentally known regions. For instance, the GK relation and similar mass relations typically achieve an accuracy of approximately 0.2 MeV l3 , significantly outperforming many global models in these well-characterized regions. However, their extrapolation capabilities are inherently limited, making them less reliable for predicting masses far from experimentally measured nuclei. Consequently, the integration of both global and local models, along with advanced machine learning (ML) techniques, presents a promising avenue for enhancing the precision and robustness of nuclear mass predictions across the entire nuclear landscape. In this paper, we will extend our analysis by testing and evaluating our models using the GK relations, further assessing their reliability and accuracy in predicting nuclear BE. In recent years, ML and deep learning (DL) techniques have emerged as powerful tools for nuclear physics applications, enabling accurate predictions of various nuclear properties. In recent years, neural networks (NN) with various algorithms, along with advanced ML techniques, have been successfully applied to nuclear physics studies boe ; wu . Examples include convolutional NNs lu , support vector machines yuk , and Kolmogorov-Arnold networks ren . Additionally, several NN-based models have been employed for predicting nuclear properties, such as binding energies liu ; niu1 ; zhao ; xie ; niu2 ; gao ; liu2 ; uta ; lov ; zeng ; zhang ; mum , energy spectra he ; wang2 , charge radii jalili1 ; dong ; wu6 , \alpha -decay half-lives li ; jalili2 , and \beta -decay half-lives jalili3 ; niu3 , among others wu7 ; shang1 ; shang2 ; za . Furthermore, kernel ridge regression has been applied for nuclear mass predictions, demonstrating its effectiveness in refining mass models and improving predictive accuracy wu1 ; wu2 ; wu5 . These advancements underscore the increasing role of ML in nuclear physics, providing robust and data-driven approaches for modeling complex nuclear phenomena. Their ability to analyze complex patterns within large datasets has significantly enhanced our understanding of nuclear structure and decay processes, offering new insights beyond traditional theoretical models. Unlike conventional models that rely on predefined functional forms, ML-based methods can extract intricate patterns from large datasets, enabling improved generalization and predictive performance. Among these, recurrent neural networks (RNNs) and their variants-gated recurrent units (GRUs) and long short-term memory (LSTM) networks-are particularly well-suited for sequential data modeling, making them promising candidates for nuclear properties predictions rnn1 ; rnn2 ; rnn3 ; rnn4 ; gru ; lstm . The advantage of RNNs stems from their feedback mechanism, which allows them to retain memory of previous inputs, effectively capturing long-range correlations in nuclear structure. In this study, we employ RNN-based architectures to predict nuclear BE using data from the Atomic Mass Evaluation (AME2020) ame . Our approach integrates nuclear structure features derived from the BW formula, including volume, surface, Coulomb, and pairing terms, alongside shell effects. By dynamically learning weights and feature interactions, our models surpass conventional regression-based approaches. The results demonstrate that GRUs achieve the lowest \sigma_{\mathrm{RMSE}} of 0.326 MeV, significantly outperforming traditional models. To further validate our predictions, we apply the GK relations, which are highly accurate in regions where experimental data are available. To evaluate the reliability of our approach, we embed the mass predictions from three different RNN models into the GK relations and obtain an error of approximately 0.202 MeV for the GRU case. This confirms the effectiveness of DL models in capturing nuclear mass trends with high precision. Given that more than 11,000 nuclei require extrapolation, DL algorithms provide a powerful tool for extending nuclear BE predictions into unmeasured regions. Additionally, we investigate the extrapolation capabilities of our models in regions where experimental data are unavailable. Our study considers the WS ws , WS3 ws3 , and WS4 ws4 models with both relu and tanh activation functions, ensuring the reliability of extrapolated predictions for unmeasured nuclei. This paper is organized as follows: Section II presents the BW formula along with the fitting parameters and details of the RNN, LSTM, and GRU architectures, including data preprocessing and training procedures. Section III discusses the results, covering the evaluation of RNN, GRU, and LSTM models, validation using GK relations, and an analysis of neutron and proton separation energies, mass excess, and extrapolation capabilities for the WS, WS3, and WS4 models. Finally, Section IV concludes the study and outlines future directions for advancing DL-based nuclear binding energy models. II Theory II.1 LDM Traditional feed-forward NNs establish a direct, deterministic mapping between input features ( x ) and output ( y ) by optimizing complex non-linear functions vap0 ; jain . In contrast, RNNs introduce an additional feedback mechanism, where the output of a neuron at a given time step is fed back into the network as an input for the subsequent time step b1 ; b2 ; b3 ; b4 . This feedback structure allows RNNs to effectively model sequential dependencies and long-range correlations within nuclear data, making them particularly suitable for nuclear BE predictions. To construct our model, we employ features extracted from the BW mass formula ws2 ; kirson . The LDM, which serves as the foundation for BW, describes the nucleus in terms of its fundamental constituents: protons ( Z ), neutrons ( N ), and atomic mass number ( A ). The total nuclear binding energy ( E_{\text{B}} ) is expressed as a sum of multiple energy contributions: BE=a_{\text{V}}A-a_{\text{S}}A^{2/3}-a_{\text{C}}\frac{Z(Z-1)}{A^{1/3}}-a_{\text{A}}\frac{(N-Z)^{2}}{A}+\delta(N,Z), (1) where: a_{\text{V}}A represents the volume energy, a_{\text{S}}A^{2/3} accounts for the surface energy, a_{\text{C}}\frac{Z(Z-1)}{A^{1/3}} denotes the Coulomb repulsion energy between protons, a_{\text{A}}\frac{(N-Z)^{2}}{A} corresponds to the symmetry energy associated with neutron-proton imbalance and \delta(N,Z) captures pairing effects and is given by: \delta(N,Z)=\begin{cases}+\delta_{0},&\text{for even }Z,N~(\text{even }A),\\ 0,&\text{for odd }A,\\ -\delta_{0},&\text{for odd }Z,N~(\text{even }A),\end{cases} (2) where \delta_{0}=a_{\text{P}}A^{k_{\rm P}} . Using a least squares fitting (LSF) approach, we determine the optimal values of the coefficients in our model. The resulting \sigma_{\mathrm{RMSE}} for a dataset comprising approximately 3264 nuclei ( Z\geq 8,N\geq 8 ) is found to be 3.29 MeV. The fitted parameter values obtained through the LSF method are as follows: a_{V}=15.45,a_{S}=16.91,a_{C}=0.70,a_{A}=22.62,a_{P}=9.35 and k_{p}=-\frac{3}{4} . These values provide an optimized representation of nuclear BE contributions and serve as key inputs for refining predictive models. Our objective is to apply the RNN architecture to refine these predictions by dynamically learning complex nuclear correlations, thereby reducing the deviation in BE estimations. The \sigma_{\mathrm{RMSE}} reduction achieved through our approach is presented in Fig. 1 . Figure 1: Theoretical predictions for the total binding energy (BE) relative to experimental data from AME2020 for 3,092 nuclei. II.2 RNN, LSTM, and GRU Architectures II.2.1 Simple RNN Architecture RNNs are a specialized class of NNs designed for processing sequential data, such as time series or feature sequences, through feedback connections b1 . Unlike traditional feedforward networks, which handle inputs independently, RNNs incorporate past outputs as additional inputs at each time step. This enables them to retain historical information, allowing RNNs to remember past states when making future predictions. As a result, they are particularly well-suited for tasks that require understanding temporal dependencies. See Fig. 2 Figure 2: Comparison between a Feed-Forward Neural Network (ANN), where inputs are processed in a unidirectional manner, and a RNN, which incorporates feedback connections by passing outputs of processing nodes back into the model to capture sequential dependencies. The concept of RNNs was first introduced by Rumelhart et al. (1986) b1 in a letter published in Nature, which described a self-organizing NN learning procedure. Over the years, RNNs have evolved into various forms, including input-output mapping networks, commonly used for classification and sequential data prediction. A major breakthrough in the field emerged with the demonstration that RNNs can effectively perform credit assignment over long sequences, equivalent to processing information across 1,200 layers in an unfolded network. This advancement significantly improved the ability of RNNs to model complex sequential dependencies. In 1997, one of the most influential architectures, LSTM, was introduced, enabling the processing of longer sequences by addressing the vanishing gradient problem b2 ; sc . Figure 3: (a) Internal structure of a simple RNN cell, (b) architecture of a GRU cell, and (c) structure of an LSTM cell. Here, h_{t} represents the hidden state, and x_{t} denotes the input at time step t . The forget gate ( f_{t} ), input gate ( i_{t} ), and output gate ( y_{t} ) regulate information flow in the LSTM model. C_{t} signifies the cell state at time step t . AF refers to activation functions such as tanh and relu . In this section, we introduce the three most prominent RNN architectures–Simple RNN, LSTM, and GRU–and highlight their significance in predicting nuclear binding energies. The Simple RNN is the most fundamental recurrent architecture. It consists of a simple NN with a feedback connection that enables it to process sequential data of variable length. Unlike feedforward NNs, where each input feature has independent weights, RNNs share weights across multiple time steps, allowing efficient generalization over sequences. In an RNN, the output at a given time step depends on previous time steps and is computed using a recursive update rule. This results in an unfolded computational graph, where weights are shared across time steps. Fig. 3 illustrates an RNN operating on an input sequence x_{t} over t time steps, where t represents the position in the sequence rather than real-world time. The cyclical nature of the computational graph highlights how previous values influence the present step. The unfolded computational graph represents a chain of events, demonstrating the flow of information both forward (computing outputs and losses) and backward (computing gradients during backpropagation). Training RNNs for Nuclear Data Prediction : The training process for nuclear BE prediction involves computing gradients of the loss function concerning the model parameters. This consists of two key steps lip : 1:Forward propagation: Information flows from left to right through the unfolded computational graph. 2:Backpropagation through time: The model iterates backward in time, computing gradients recursively for each node, starting from the final loss and propagating through all previous states. Due to the sequential nature of forward propagation, gradient computations are computationally expensive, as parallelization is not feasible. To efficiently handle training, previously computed states from the forward pass are stored and reused in the backpropagation process. The total loss for a sequence is obtained by summing losses over all time steps. The output o_{t} is passed through a softmax activation function, producing probability distributions over the predicted output categories. One of the major challenges in training RNNs is the vanishing gradient problem, where gradients diminish exponentially as they are backpropagated through time. This leads to ineffective learning over long sequences. To mitigate this issue: tanh is often used as the activation function, as it retains nonzero gradients for longer time steps. We also explore the relu activation function to identify the best-performing configuration for nuclear BE predictions. RNNs can be configured with different types of recurrent connections, affecting how information is transferred between layers: Hidden-to-hidden connections: The RNN produces outputs at each time step, passing information between hidden units across time steps. This corresponds to the standard SimpleRNN architecture. Output-to-hidden connections: Outputs at specific time steps are fed back into hidden units for future time steps, enhancing memory retention. Sequential input to single output: The network processes an entire sequence before generating a single output, commonly used in applications like binding energy prediction. This feature makes RNNs particularly well-suited for learning sequential relationships in nuclear structure data, where the BE exhibits correlations with proton and neutron numbers. An RNN cell takes an input vector x_{t} at time step t , processes it through a hidden state h_{t} , and generates an output y_{t} using the following recurrence relations lip : h_{t}=f(W_{h}x_{t}+U_{h}h_{t-1}+b_{h}) (3) y_{t}=f(W_{y}h_{t}+b_{y}) (4) where: - W_{h} , U_{h} , and W_{y} are weight matrices controlling interactions between inputs, hidden states, and outputs. - b_{h} and b_{y} are bias vectors. - f(\cdot) represents the activation function, typically a hyperbolic tangent tanh or relu . The hidden state h_{t} retains memory of past inputs, allowing RNNs to model nuclear binding energy as a function of historical nuclear configurations. II.2.2 LSTM Architecture Despite their advantages, RNNs suffer from the vanishing gradient problem, which hinders learning over long sequences. To address this, LSTM networks introduce gated memory cells that regulate information flow through input, forget, and output gates b2 . The LSTM equations are given by: f_{t}=\sigma(W_{f}x_{t}+U_{f}h_{t-1}+b_{f}) (5) i_{t}=\sigma(W_{i}x_{t}+U_{i}h_{t-1}+b_{i}) (6) \tilde{C}_{t}=\tanh(W_{C}x_{t}+U_{C}h_{t-1}+b_{C}) (7) C_{t}=f_{t}\odot C_{t-1}+i_{t}\odot\tilde{C}_{t} (8) y_{t}=\sigma(W_{o}x_{t}+U_{o}h_{t-1}+b_{o}) (9) h_{t}=o_{t}\odot\tanh(C_{t}) (10) where: - f_{t} , i_{t} , and o_{t} are the forget, input, and output gates, respectively. - C_{t} is the cell state, maintaining long-term dependencies. - \sigma(\cdot) is the sigmoid function. - The operator \odot represents element-wise multiplication, ensuring that each gate influences only the corresponding elements of the cell state. By incorporating nuclear structure features such as atomic mass ( A ), proton number ( Z ), neutron number ( N ) and others into LSTM networks, we can dynamically learn interactions affecting nuclear BE and improve predictive accuracy. II.2.3 GRU Architecture A GRU is a simplified variant of LSTM that combines the forget and input gates into a single update gate, reducing computational complexity rez . The GRU update equations are: r_{t}=\sigma(W_{r}x_{t}+U_{r}h_{t-1}+b_{r}) (11) z_{t}=\sigma(W_{z}x_{t}+U_{z}h_{t-1}+b_{z}) (12) \tilde{h}_{t}=\tanh(W_{h}(r_{t}\odot h_{t-1})+U_{h}x_{t}+b_{h}) (13) h_{t}=z_{t}\odot\tilde{h}_{t}+(1-z_{t})\odot h_{t-1} (14) where: - r_{t} is the reset gate, determining how much past information to forget. - z_{t} is the update gate, controlling the trade-off between past and new information. - h_{t} is the hidden state update. GRUs provide a computationally efficient alternative to LSTMs while retaining memory for long-term dependencies in nuclear data. This allows GRUs to effectively capture binding energy variations across isotopic chains. By training on binding energy datasets such as AME2020, our RNN, LSTM, and GRU models learn complex interactions between nuclear features, leading to improved generalization and predictive accuracy. The ability of these models to retain sequential dependencies is crucial for extrapolating BE values for unmeasured isotopes, reducing \sigma_{\mathrm{RMSE}} compared to traditional mass models. In this work, we apply DL architectures, including RNNs, LSTMs, and GRUs, to enhance nuclear binding energy predictions. These models dynamically adjust their internal states based on sequential dependencies, making them highly effective for modeling complex nuclear interactions. The subsequent sections will outline our experimental setup, training methodology, and performance evaluation metrics. II.3 Nuclear features as the training, validation and testing sets The properties of an atomic nucleus are fundamentally determined by the number of protons and neutrons it contains, making them the most straightforward choice for input variables in predictive models. However, when dealing with limited datasets, incorporating additional engineered features–beyond these fundamental parameters–can significantly enhance the predictive power of NNs. These engineered features serve as priors that encode critical domain-specific information, a well-established practice in nuclear physics research (e.g., lov ; mum ; dong ; dong2 ). For instance, Ref. dong2 demonstrated that supplementing ( Z ) and ( N ) numbers with two additional features representing pairing interactions and shell-closure effects substantially improved the accuracy of nuclear charge radius predictions compared to Bayesian models that relied solely on N and Z . Similarly, in Ref. dong , further enhancements were observed by incorporating two additional features that account for isospin dependence and local nuclear structure anomalies. These findings highlight the crucial role of feature engineering in improving nuclear BE predictions. In our base model, denoted as RNN3, GRU3 and LSTM3, the input space includes the number of ( N ), the number of ( Z ), and ( A ), with the sole prediction being the nuclear mass. For RNN7, GRU7 and LSTM7, we incorporate additional bulk properties, including the mass number ( A ), A^{2/3} (from volume and surface terms), Z(Z-1)/A^{1/3} from the Coulomb term, (N-Z)^{2}/A from the asymmetry and \delta_{p}=(-1)^{Z}+(-1)^{N}/2 and incorporate information about magic numbers. RNN11, GRU11 and LSTM11, include pairing information, Z_{eo} and N_{eo} , where Z_{eo} ( N_{eo} ) is 0 if Z ( N ) is even and 1 if Z ( N ) is odd, and ( V_{N} ) and ( V_{Z} ), representing number of valance nucleons. The features of the different NNs can be found in Table 1 . To systematically evaluate the impact of feature selection and hyperparameter optimization, we designed three NN configurations with varying input layers. The first network utilizes three input features, the second expands to seven, and the final configuration includes eleven features, aligned with the terms of the LDM to assess deviations and their influence on BE predictions. Table 1: Feature space in different RNNs structure. Model Input x Output y RNN3 , GRU3 , LSTM3 N , Z , A BE RNN7 , GRU7 , LSTM7 N , Z , A , A^{2/3} , Z(Z-1)/A^{1/3} , (N-Z)^{2}/A , \delta_{p} BE RNN11 , GRU11 , LSTM11 N , Z , A , A^{2/3} , Z(Z-1)/A^{1/3} , (N-Z)^{2}/A , \delta_{p} , V_{N} , V_{Z} , Z_{eo} , N_{eo} BE Given that our work involves a multidimensional feature space, we employed common techniques such as grid search and random search to fine-tune the hyperparameters, as detailed in Table III. Figure 4: Distribution of data among the training set (blue circles), validation set (green circles), and testing set (red circles) for RNN models with different splits: (a) 90% training, 5% validation, 5% testing, (b) 80% training, 10% validation, 10% testing, and (c) 70% training, 15% validation, 15% testing. All data sets include nuclei from AME2020 ame . Given the multitude of features, particularly in the domain of nuclear BE prediction using the LDM, where diverse inputs such as N,Z,A , and others are considered. The choice of feature combinations is contingent upon the characteristics of our data, such as the pairing term, Coulomb, or volume and surface terms. In our investigation, we systematically explored all possible combinations through a trial-and-error approach to determine the optimal values. To achieve this, we carefully prepared our training, validation and testing sets, spanning the nuclear landscape from Z,N\geq 8 for absolute BE prediction, utilizing data from the AME2020. In this implementation, we explore three types of RNN architectures. Each model is designed to capture temporal dependencies in the data effectively. The models are configured with specific numbers of units in their recurrent layers: 100 for SimpleRNN and LSTM, and 80 for GRU. The activation functions used are a combination of relu and tanh , which are chosen for their ability to handle the vanishing gradient problem and provide non-linearity. The dataset used for training these models consists of input features and target values, which are split into training, validation, and test sets with varying test sizes (0.1, 0.2, 0.3). The input data is normalized using the StandardScaler to ensure optimal performance during training. Each model is compiled using the Adam optimizer and the mean squared error loss function, which is suitable for regression tasks. The training process involves feeding the scaled input data through the respective RNN layers, followed by a dense output layer that produces the final predictions. The performance of these models is evaluated based on the \sigma_{\mathrm{RMSE}} on the validation and test sets, providing insights into how well each architecture captures the underlying patterns in the data. This comparative analysis helps in understanding the strengths and limitations of each RNN variant for the given task. Table 2: The hyperparameter set of the RNN, LSTM, and GRU models. The i^{th} layer Layer Type AF 0 Input - 1 Recurrent (RNN / LSTM / GRU) relu , tanh 2 Fully Connected relu 3 Output Linear Other hyperparameters Hyperparameter Value Property Batch size 32 - Objective function MSE Loss Optimizer Adam - Learning rate 1\times 10^{-3} - II.4 BE data The dataset used in this study is based on the AME2020 compilation ame , which includes the BE of 3100 nuclei with proton and neutron numbers Z,N\geq 8 , encompassing both measured and extrapolated values. One of the key objectives of this work is to generate reliable predictions that can be valuable for future applications, particularly in nuclear astrophysics. To ensure robust model evaluation, we employ multiple data partitioning strategies with varying training, validation, and testing splits: 90%-5%-5%, 80%-10%-10%, and 70%-15%-15% of the available data. In the first evaluation, we allocate 2,781 nuclei for training and 155 nuclei for testing. The second and third evaluations follow a different partitioning scheme. These different data splits allow us to assess the model’s generalization capability under varying levels of training data availability. See Fig. 4 Additionally, for validation and extrapolation, we incorporate extended datasets for different models ws ; ws3 ; ws4 : • WS model: 11,248 nuclei • WS3 model: 11,824 nuclei • WS4 model: 11,879 nuclei These expanded datasets enable further evaluation of model performance beyond the training regime, providing insights into their predictive reliability across a broader range of nuclear masses. III Results and Discussion III.1 Evaluation of RNN, GRU and LSTM To quantify how well the RNNs can describe nuclear BEs in the training, validation, and testing sets for different activation functions and learning rates, we use the standard deviation \sigma_{\mathrm{RMSE}} between the predicted RNN values, BE^{\mathrm{RNNs}} , and the experimental data from AME2020, defined as \sigma_{\mathrm{RMSE}}=\sqrt{\frac{\sum\limits_{i=1}^{\nu}(BE^{\mathrm{Exp}}_{i}-BE^{\mathrm{RNNs}}_{i})^{2}}{\nu}}, (15) where \nu is the total number of nuclei considered. In this phase of our study, we systematically expanded the input space by introducing new terms based on the BW mass formula. This augmentation aims to enhance the predictive capabilities of our RNN models. Tables III, IV, and V provide a comprehensive evaluation of different test sizes employed across various RNN architectures. Figure 5: The absolute \sigma_{\mathrm{RMSE}} value of BE between RNNs predictions using RNN11, GRU11 and LSTM11 features (see Table V) for 90%,5%,5% . The \sigma_{\mathrm{RMSE}} for all the models are also provided in Table V. Table 3: Comparison of training, validation, and testing \sigma_{\textrm{RMSE}} for RNN3, GRU3, and LSTM3 across different learning rates, model architectures, and activation functions. LR Model AF Training Validation Testing 90%,5%,5% RNN3 tanh 1.1584 1.1289 1.1239 90%,5%,5% RNN3 relu 1.3270 1.6657 1.3647 90%,5%,5% GRU3 tanh 1.0673 1.0419 1.1476 90%,5%,5% GRU3 relu 1.3844 1.2734 1.4251 90%,5%,5% LSTM3 tanh 1.1624 1.1299 1.2123 90%,5%,5% LSTM3 relu 1.2855 1.1604 1.2555 80%,10%,10% RNN3 tanh 1.2281 1.2440 1.1551 80%,10%,10% RNN3 relu 1.3022 1.2619 1.4610 80%,10%,10% GRU3 tanh 1.1056 1.1652 1.0758 80%,10%,10% GRU3 relu 1.3304 1.3929 1.2802 80%,10%,10% LSTM3 tanh 1.1861 1.2573 1.1869 80%,10%,10% LSTM3 relu 1.5782 1.6672 1.6093 70%,15%,15% RNN3 tanh 1.2105 1.1831 1.2231 70%,15%,15% RNN3 relu 1.7970 1.6499 1.6783 70%,15%,15% GRU3 tanh 1.0838 1.0930 1.0192 70%,15%,15% GRU3 relu 1.3233 1.3304 1.3790 70%,15%,15% LSTM3 tanh 1.2303 1.3141 1.2976 70%,15%,15% LSTM3 relu 1.4853 1.3755 1.5193 Table 4: Comparison of training, validation, and testing \sigma_{\textrm{RMSE}} for RNN7, GRU7, and LSTM7 across different learning rates, model architectures, and activation functions. LR Model AF Training Validation Testing 90%,5%,5% RNN7 tanh 0.5912 0.6490 0.6594 90%,5%,5% RNN7 relu 0.7541 0.8457 0.8737 90%,5%,5% GRU7 tanh 0.4447 0.4239 0.5473 90%,5%,5% GRU7 relu 0.6231 0.7203 0.7988 90%,5%,5% LSTM7 tanh 0.6044 0.5541 0.6492 90%,5%,5% LSTM7 relu 0.8475 0.8677 1.0428 80%,10%,10% RNN7 tanh 0.6633 0.7220 0.7431 80%,10%,10% RNN7 relu 0.7897 0.8097 0.8413 80%,10%,10% GRU7 tanh 0.5424 0.5673 0.5681 80%,10%,10% GRU7 relu 0.7476 0.7817 0.7998 80%,10%,10% LSTM7 tanh 0.5390 0.6568 0.6434 80%,10%,10% LSTM7 relu 0.9369 1.1170 1.1298 70%,15%,15% RNN7 tanh 0.7528 0.7999 0.7260 70%,15%,15% RNN7 relu 0.7791 0.9288 0.8483 70%,15%,15% GRU7 tanh 0.5372 0.6290 0.6152 70%,15%,15% GRU7 relu 0.7914 0.9425 0.8951 70%,15%,15%3 LSTM7 tanh 0.5138 0.6363 0.6026 70%,15%,15%3 LSTM7 relu 0.9533 1.0979 1.0413 Table 5: Comparison of training, validation, and testing \sigma_{\textrm{RMSE}} for RNN11, GRU11, and LSTM11 across different learning rates, model architectures, and activation functions. LR Model AF Training Validation Testing 90%,5%,5% RNN11 tanh 0.4931 0.5022 0.6016 90%,5%,5% RNN11 relu 0.5030 0.5388 0.5141 90%,5%,5% GRU11 tanh 0.3294 0.3791 0.4591 90%,5%,5% GRU11 relu 0.5618 0.5518 0.5632 90%,5%,5% LSTM11 tanh 0.4817 0.5537 0.5574 90%,5%,5% LSTM11 relu 0.4942 0.6965 0.6074 80%,10%,10% RNN11 tanh 0.5306 0.5521 0.6023 80%,10%,10% RNN11 relu 0.5707 0.5667 0.5018 80%,10%,10% GRU11 tanh 0.3975 0.5045 0.4332 80%,10%,10% GRU11 relu 0.4617 0.6180 0.5687 80%,10%,10% LSTM11 tanh 0.5075 0.5753 0.5503 80%,10%,10% LSTM11 relu 0.5326 0.7173 0.7356 70%,15%,15% RNN11 tanh 0.4331 0.5071 0.5140 70%,15%,15% RNN11 relu 0.5260 0.5744 0.5150 70%,15%,15% GRU11 tanh 0.4057 0.5084 0.5258 70%,15%,15% GRU11 relu 0.5278 0.5233 0.5272 70%,15%,15% LSTM11 tanh 0.4798 0.5300 0.5791 70%,15%,15% LSTM11 relu 0.4700 0.6147 0.6969 A key observation from the results is the significant deviation in \sigma_{\mathrm{RMSE}} for certain cases. For instance, in Table III, the GRU3 model with the relu activation function exhibits a notable deviation in the testing set ( \sim 1.42 MeV), which is higher compared to the tanh counterpart ( \sim 1.15 MeV). Similarly, LSTM3 with relu activation also demonstrates relatively poor performance, reaching an \sigma_{\mathrm{RMSE}} above 1.6 MeV in some cases. A substantial improvement is observed in Table IV, where RNN7 models incorporating surface and Coulomb terms lead to an approximate 50\% reduction in error compared to RNN3. Notably, GRU7 with tanh activation achieves an \sigma_{\mathrm{RMSE}} of 0.54 MeV in the testing set, contrasting with the relu activation case, which remains closer to 0.80 MeV. Moving to Table V, the most striking improvement is evident in GRU11 models. The transition from GRU3 to GRU11 results in a 68.9\% reduction in \sigma_{\mathrm{RMSE}} , confirming the critical role of feature expansion. GRU11 with tanh activation exhibits the lowest deviation, with training devation values around 0.326 MeV, whereas some RNN11 cases still hover near 0.50 MeV. Overall, our findings suggest that GRU models outperform both standard RNN and LSTM architectures, particularly when employing the tanh activation function. The progressive enhancement from RNN3, GRU3, and LSTM3 to their respective 11-feature variants underscores the necessity of incorporating detailed nuclear properties for more accurate binding energy predictions. Fig. 5 presents a comparative analysis of three different RNN architectures–RNN11, GRU11, and LSTM11–each utilizing 11 input features with the \tanh activation function. The color gradient represents the absolute \sigma_{\mathrm{RMSE}} in MeV, with darker shades indicating lower deviations and brighter colors (yellow-red) highlighting regions of higher error. The error distribution shows a clear trend where deviations are more pronounced for nuclei with low proton ( Z ) and neutron ( N ) numbers. This is particularly evident from the red and yellow regions in the lower left of each subplot. This suggests that the models struggle more with light nuclei, likely due to stronger shell effects and nuclear structure complexities that are not fully captured by the input features. The intricate nature of magic numbers contributes to the sophisticated trends observed, underscoring the complex interplay between model features and the representation of nuclear phenomena. However, it is crucial to admit that some deviations are observed for all cases in light mass nuclei, specifically those near to Z,N =8,20. Regarding the performance across architectures, the GRU11 model exhibits the best overall performance, as indicated by a larger fraction of the domain covered in dark blue to purple shades, which correspond to lower \sigma_{\mathrm{RMSE}} values. The RNN11 model shows more scattered high-error regions, especially in the light-nuclei regime and near the neutron-rich dripline. So, the LSTM11 model also performs well but exhibits slightly larger deviations compared to GRU11, particularly at the neutron-rich and proton-rich extremes. The GRU11 model achieves the lowest error across most of the nuclear chart, making it the most reliable among the tested architectures. Figure 6: Absolute deviations (in MeV) between the GK mass relations and the predicted masses using the RNN11, GRU11, and LSTM11 models. III.2 Evaluation with Garvey-Kelson relations In this section, we emphasize the potential application of the GK mass relations gk1 to validate and further analyze the BE errors of our NN models. The GK relations are known for their exceptional predictive power in nuclear mass evaluations, often yielding errors significantly lower than those found in conventional macroscopic-microscopic or purely microscopic mass formulae. The GK relations for nuclear masses are defined as follows: For nuclei with N\geq Z : \displaystyle M(Z-2,N+2)-M(Z,N) \displaystyle+M(Z-1,N)-M(Z-2,N+1) \displaystyle+M(Z,N+1)-M(Z-1,N+2)\approx 0, (16) and for nuclei with Z