Surrogate-based multiscale analysis of experiments on thermoplastic composites under off-axis loading M. A. Maia, I. B. C. M. Rocha, D. Kovacevic, F. P. van der Meer Abstract In this paper, we present a surrogate-based multiscale approach to model constant strain-rate and creep experiments on unidirectional thermoplastic composites under off-axis loading. In previous contributions, these experiments were modeled through a single-scale micromechanical simulation under the assumption of macroscopic homogeneity. Although efficient and accurate in many scenarios, simulations with low-off axis angles showed significant discrepancies with the experiments. It was hypothesized that the mismatch was caused by macroscopic inhomogeneity, which would require a multiscale approach to capture it. However, full-field multiscale simulations remain computationally prohibitive. To address this issue, we replace the micromodel with a Physically Recurrent Neural Network (PRNN), a surrogate model that combines data-driven components with embedded constitutive models to capture history-dependent behavior naturally. The explainability of the latent space of this network is also explored in a transfer learning strategy that requires no re-training. With the surrogate-based simulations, we confirm the hypothesis raised on the inhomogeneity of the macroscopic strain field and gain insights into the influence of adjustment of the experimental setup with oblique end-tabs. Results from the surrogate-based multiscale approach show better agreement with experiments than the single-scale micromechanical approach over a wide range of settings, although with limited accuracy on the creep experiments, where macroscopic test effects were implicitly taken into account in the material properties calibration. 1 Introduction In many engineering applications, understanding how phenomena at lower scales affect the material behavior at the macroscale is essential. For composite materials, this knowledge can lead to improved designs at lower costs. To achieve this, systematic experiments are needed to characterize the material and the response of the designed structural component, processes that can be costly and time-consuming. Fortunately, with advances in computational power, numerical models based on finite element (FE) can help alleviate the costs of the experimental campaigns by replacing part of these tests with computational simulations. A useful computational model, however, still relies on representative constitutive models and material properties. In that regard, several methods have been proposed to predict the constitutive behavior of complex heterogeneous materials, including composites, with varying degrees of accuracy, generality, and efficiency [ 1 ] . Some can be highly efficient but are also bound to the assumptions made in their formulation, restricting their flexibility. For example, mean-field homogenization schemes (e.g. Mori-Tanaka [ 2 ] and Self-Consistent method) based on Eshelby’s solution [ 3 ] are rather limited regarding the geometric features of the inclusions, volume fraction, stress localization and material nonlinearity. We refer to [ 4 , 5 ] for recent reviews on this type of solution. Another efficient way to predict the homogenized constitutive response of the material is to use mesoscale (ply-level) models. These models have a certain number of parameters that should be calibrated based on experimental data or numerical micromodel simulations. While fast, the balance between the number of parameters, data availability, and ability to predict general loading conditions is not trivial. Mesoscale models can be seriously limited if certain assumptions and interactions are not considered. This is illustrated in [ 6 ] , where a study on a recently developed homogenized orthotropic plasticity model quantified the loss of accuracy due to necessary simplifications such as ignoring the influence of stress in the fiber direction on the plasticity and use of a constant plastic Poisson ratio. At the opposite end of the spectrum in terms of efficiency are multiscale methods, particularly FE 2 . This approach associates the constitutive response of an integration point at the macroscale with the homogenized response of the micromodel, or Representative Volume Element (RVE), leveraging the convenience of using simpler constitutive models at the lower scale of observation. At this level, the explicit microstructure description offers more information on material integrity, and phenomena such as orthotropic behavior, (visco-)plasticity, aging, damage and strain/stress localization can be more easily incorporated. This generality, however, is associated with extreme computational cost, limiting its feasibility in practical applications. Numerous approaches to improve the computational efficiency of FE 2 have been proposed (e.g. parallel computing, fast Fourier transform methods [ 7 ] , clustering-based methods [ 8 , 9 , 10 ] , etc.), but here we focus on the ones based on machine learning techniques. Specifically, frameworks built on top of surrogate models that replace the micromodel problem entirely. A surrogate model typically approximates the mapping between the homogenized quantities and usually consists of a data-driven model trained on snapshots of the micromodel, or in the case of history-dependent materials, sequences of snapshots. Examples include Gaussian Processes (GPs) [ 11 , 12 ] , Deep Neural Networks [ 13 , 14 , 15 ] , Graph Neural Networks [ 16 ] , Transformers [ 17 , 18 ] , Convolution Neural Networks [ 19 ] , Recurrent Neural Networks (RNNs) [ 20 , 21 , 22 , 23 , 24 , 25 ] , frameworks that combine some of these methods with Reduced Order Modeling techniques [ 26 , 27 , 28 ] and, more recently, hybrid models, which combine machine learning techniques with some knowledge of the problem to fulfill thermodynamics and kinematic constraints by construction. Despite the wide popularity in the literature, the purely data-driven models struggle in the extrapolation regime and are often data-hungry, and hybrid models remain specialized to a narrow range of constitutive behavior (e.g. homogeneous and hyperelastic materials [ 29 , 30 ] ). To address those issues, we proposed the Physically Recurrent Neural Networks (PRNNs) [ 31 ] . The idea is to preserve the knowledge we have on constitutive models, specifically the ones employed in the RVE used to generate the high-fidelity data and train the network, by embedding them in an encoder-decoder architecture. This combination results in great generalization properties with small training sets and offers a clear interpretation of its latent space. In our latest development [ 32 ] , we extended the applicability of PRNNs to deal with rate and path-dependent 3D problems in a finite strain formulation. The inclusion of damage models in the PRNN has also been recently addressed in [ 33 ] for the microscale debonding of composite materials. Our starting point are the experimental results and contributions in [ 34 , 35 , 36 ] . In these works, constant strain-rate and creep experiments were modeled at the microscale under the assumption that macroscale variations are negligible. In [ 34 ] , the authors laid the foundations of a custom framework based on a single-scale micromodel simulation with special boundary conditions to emulate a uniaxial stress state in the global frame for a composite with rate-dependent response under arbitrary off-axis loading. Later, the formulation was expanded to include failure analysis for constant strain-rate [ 35 ] , constant stress [ 36 ] and cyclic loading [ 37 ] . For different strain-rates, stress levels and off-axis angles, the micromodel-based formulation was able to accurately reproduce the experimental results in most cases, with the exception of small off-axis angle scenarios, in which a significant difference was observed already prior to failure. This difference suggests a violation of the assumption of macroscopic uniform deformations. However, testing this hypothesis with the same high-fidelity micromodel would require a multiscale approach, which is computationally intractable. Now with the PRNN developed in [ 32 ] , a surrogate-based multiscale analysis comes within reach. Other works that explored the surrogate-based multiscale approach to predict the off-axis homogenized response of composites are [ 38 ] and [ 39 ] . Gao et al. 2020 validated the results against experimental data but did not extend the formulation to account for different strain-rates and temperatures, while Kalina et al. 2023 focused on the numerical modeling aspects considering hyperelastic models only. Lastly, the strain inhomogeneity matter was also discussed in Ma et al. 2023 through the lens of the Digital Image Correlation method. In that case, the authors focused on the characterization of the material for different experimental setups, leaving out details on the computational modeling. In this contribution, we model the constant strain-rate and creep experiments in [ 35 , 36 ] as a multiscale problem with the PRNN as a surrogate model to the homogenized response of a micromodel with history-dependent materials. With this, we contribute to a better understanding of the experiments by testing the hypotheses raised in [ 35 ] and [ 36 ] on the macroscopic strain/stress variability. In addition to that, we illustrate new features of the PRNN for transfer learning, favoring more efficient training and online evaluation. In the following, we discuss the test setup and methods. Then, we assess the performance of the surrogate-based approach on a selection of experiments, showcasing the robustness of the network for multiscale analysis. Finally, we draw the main conclusions of this work in Section 5 . 2 Methods (a) Geometry with dimensions in mm (b) Setup used for creep testing [ 36 ] Figure 1: Schematic representation of UD carbon/PEEK composite system specimen and creep testing setup. In this section, we outline the most relevant aspects of the experimental and numerical setups used to obtain the strain-stress response of a thermoplastic composite system over different off-axis angles, strain-rates and stress levels. 2.1 Experimental setup Coupons were made of carbon fiber reinforced unidirectional tapes and PEEK matrix with fiber volume fraction of 0.4. Two types of experiments are considered: constant strain-rate and creep. The geometry of the coupons manufactured for both experiments is illustrated in Figure 1a , where \theta_{0} is the off-axis angle. The numerical counterpart models only the gauge length, which is 120\text{\,}\mathrm{mm} for the constant strain rate experiments. In these tests, the crosshead speeds were kept constant corresponding to strain-rates ranging between 10^{-6} {\mathrm{s}}^{-1} and 10^{-3} {\mathrm{s}}^{-1} . To record the stress-strain relationship, clip-on expensometers were used. Crosshead displacements were converted to engineering strain, while the resulting force was used to compute the engineering stress. For the creep experiments, the gauge length was 100\text{\,}\mathrm{mm} for the off-axis angles 90\text{\,}\mathrm{\SIUnitSymbolDegree} and 45\text{\,}\mathrm{\SIUnitSymbolDegree} , and 120\text{\,}\mathrm{mm} for the smaller angles 30\text{\,}\mathrm{\SIUnitSymbolDegree} and 15\text{\,}\mathrm{\SIUnitSymbolDegree} . In these experiments, constant force was applied on the coupon, from which the engineering stress was calculated and the crosshead displacements gave the engineering strain. Further details on the experimental setup can be found in [ 35 , 36 ] . 2.2 Multiscale problem formulation To replicate the experiments discussed in the previous section, a concurrent multiscale approach (FE 2 ) can be used. In this case, the macroscopic domain \Omega is discretized into a Finite Element (FE) mesh, with a periodic representative volume element (RVE) \omega nested to each integration point. The RVE consists of another FE model that characterises the heterogeneous material at a length scale significantly lower than the macroscopic one. Figure 2: Scheme of concurrent multiscale framework with two scales (macro \Omega and micro \omega ) for composite material with off-axis loading. In this work, the updated Lagrangian formulation is adopted [ 41 ] . The Cauchy stress and the deformation gradient are the stress and strain measures, respectively. At the microscale, regular constitutive models can be assigned to each of the phases. To solve the micromodel problem, periodic boundary conditions based on the macroscopic deformation gradient \mathbf{F}^{\Omega} are usually employed. Further, if the local coordinate system of the RVE, in which fiber direction is always parallel to \boldsymbol{e}_{1} , is not aligned with the global one, we relate the two coordinate systems through a transformation matrix: \mathbf{Q}_{0}\,(\theta_{0})=\begin{bmatrix}\cos(\theta_{0})&-\sin(\theta_{0})&0\\ \sin(\theta_{0})&\cos(\theta_{0})&0\\ 0&0&1\end{bmatrix}, (1) where \theta_{0} marks the angle between the y -axis and the fiber direction, as depicted in Figure 2 . This matrix allows \mathbf{F}^{\Omega} to be transformed from the global to the local coordinate system: \mathbf{F}_{\textrm{L }}^{\Omega}=\mathbf{Q}_{0}\mathbf{F}^{\Omega}\mathbf{Q}_{0}^{\textrm{T}}, (2) where the subscript “L" refers to the local frame. Once the microscopic problem has converged, a computational homogenization procedure is performed to bridge the two scales: \boldsymbol{\sigma}^{\Omega}_{\textrm{L}}(\mathbf{X}^{\Omega})=\frac{1}{|\omega|}\int_{\omega}\boldsymbol{\sigma}^{\omega}(\mathbf{X}^{\omega})\,\textrm{d}\omega. (3) Similarly, to transform the stress from the local to the global coordinate system, we use: \boldsymbol{\sigma}^{\Omega}=\mathbf{Q}_{0}^{\textrm{T}}\boldsymbol{\sigma}^{\Omega}_{\textrm{L}}\mathbf{Q}_{0}. (4) The formulation is completed with the definition of the macroscopic constitutive tangent \mathbf{D}^{\Omega} . For that, automatic differentiation, perturbation methods based on finite differences or condensation procedures can be used depending on the memory allocation and computational efficiency requirements [ 42 , 43 ] . In this work, our reference solutions are experiments and we do not perform the full-order FE 2 due to the exceedingly high computational cost. The main bottleneck, in this case, comes from the coupling between the two equilibrium problems, where the solution of the macroscopic displacement field defines the boundary condition for the RVEs, which in turn provide the missing homogenized constitutive model, requiring iterative solves of a large number of microscopic FE problems. In Section 2.4 we elaborate on the alternatives to this approach explored in this work. 2.3 Constitutive models In this section, we discuss the two constitutive models used in the composite RVE adopted in the applications. These are exactly the same models as in [ 32 ] and the reference works [ 34 , 35 , 36 ] , and therefore we skip their derivation and only summarize their main features and the novelties explored in this work. The first constitutive model is a hyperelastic transversely isotropic model based on the formulation by [ 44 ] with slight modifications from [ 34 ] , which is assigned to the fibers. For the matrix, we use the Eindhoven Glassy Polymer (EGP), a rate and path-dependent elasto-viscoplastic model. The Cauchy stress from this model consists of three contributions. The first is a hydrostatic one, which is hyperelastic, the second is a hardening part that represents polymer chain reorientation and the last part comes from the driving stress, which is the component that allows for complex behavior to be incorporated and is rate and path-dependent. This component is given by the sum of several Maxwell elements, also known as modes, connected in parallel, and define a Non-newtonian flow for plastic deformations. In each mode, the spring is associated with a shear modulus and the dashpot to a viscosity function that depends on the stress, temperature and aging. It is also possible to consider multiple relaxation processes. 2.4 Alternatives to the full multiscale formulation Figure 3: Alternative approaches to replace full multiscale problem for modeling composites under off-axis loading. In Figure 3 , two alternatives to the full multiscale formulation are presented. Results obtained with both are compared in this paper. Before introducing the proposed surrogate-based multiscale approach, the single-scale micromechanical approach is summarized in this section. The single-scale model consists of a custom constant strain-rate arclength from [ 35 ] , which can be adapted to a force-controled framework to creep analysis [ 36 ] . Although highly efficient and accurate in many scenarios, the assumptions made to simplify the entire specimen macroscopic domain to a single macroscopic point have limited validity. For results presented in this paper, slight changes are implemented with respect to the equations shown in the original formulation for the constant strain-rate case [ 34 ] due to the different choice of stress measure. In [ 34 ] and [ 35 ] , the Cauchy stress was used. Later, in a comparison with the creep experiments, the engineering stresses and strains were taken into account to agree with the engineering strain and stress reported in the experiments [ 36 ] . Here, we follow that choice and use the engineering quantities for comparison at all times. To apply a constant engineering strain-rate ( \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}} ) under uniaxial engineering stress at the global frame ( \sigma_{\textrm{yy}}^{\textrm{eng}} ) on the macroscopic element, equivalent homogenized deformation and stress states need to be derived in the local frame. It is assumed that the specimen edge on which the loading is applied is prevented from rotating, while relative transverse translation is free, resulting in the parallelogram shape illustrated in the scheme depicted in Figure 3 . A special constraint equation was derived by equating F_{\text{yy}} to the value imposed from the input to ensure the global constant strain-rate condition while maintaining a uniaxial stress state in global frame. Finally, to model the creep experiments, a similar framework based on the developments presented so far was proposed in [ 36 ] . The main changes regard the inclusion of the creep stress in the external force components for a force-controlled analysis and the consideration of the following condition: \sigma_{\textrm{yy},\textrm{t}}^{\textrm{eng}}=\min\,\Bigl(\sigma_{\textrm{yy},t-1}^{\textrm{eng}}+\dot{\sigma}_{\textrm{yy}}^{\textrm{eng}}\Delta t,\sigma_{\textrm{yy}}^{\textrm{max}}\Bigr), (5) where \dot{\sigma}_{\textrm{yy}}^{\textrm{eng}} is the engineering stress-rate at the loading phase before reaching the maximum stress level \sigma_{\textrm{yy}}^{\textrm{max}} . 2.5 Physically Recurrent Neural Network (PRNN) In contrast to the microscale-based approach described previously, in this alternative we replace the RVE with a PRNN trained on stress-strain snapshots of it (see Figure 3 ). We summarize in Algorithm 1 the main coordinate system transformations needed to handle global and local frames when evaluating the homogenized stress response. To compute the macroscopic tangent stiffness matrix, we use the chain rule: \mathbf{D}^{\Omega}=\frac{\partial{\widehat{\boldsymbol{\sigma}}^{\Omega}}}{\partial{\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}}}\frac{\partial{\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}}}{\partial{\mathbf{F}^{\Omega}_{\textrm{L}}}}\ \frac{\partial{\mathbf{F}^{\Omega}_{\textrm{L}}}}{\partial{\mathbf{F}^{\Omega}}}, (6) where the second term corresponds to the tangent obtained from the network: \frac{\partial{\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}}}{\partial{\mathbf{F}^{\Omega}_{\textrm{L}}}}=\frac{\partial{\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}}}{\partial{\widehat{\boldsymbol{\sigma}}_{\text{U}}^{\Omega}}}\frac{\partial{\widehat{\boldsymbol{\sigma}}_{\text{U}}^{\Omega}}}{\partial{\mathbf{U}^{\Omega}_{\textrm{L}}}}\ \frac{\partial{\mathbf{U}^{\Omega}_{\textrm{L}}}}{\partial{\mathbf{F}^{\Omega}_{\textrm{L}}}}+\ \frac{\partial{\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}}}{\partial{\mathbf{R}^{\Omega}_{\textrm{L}}}}\ \frac{\partial{\mathbf{R}^{\Omega}_{\textrm{L}}}}{\partial{\mathbf{F}^{\Omega}_{\textrm{L}}}}. (7) Input : homogenized deformation gradient at global frame \mathbf{F}^{\Omega} , time increment \Delta t , initial off-axis angle \theta_{0} Output : homogenized stress \widehat{\boldsymbol{\sigma}}^{\Omega} , tangent stiffness matrix \mathbf{D}^{\Omega} compute transformation matrix \mathbf{Q}_{0} according to Equation 1 based on \theta_{0} transform strain from global to local frame: \mathbf{F}^{\Omega}_{\textrm{L}}\leftarrow\mathbf{Q}_{0}\mathbf{F}^{\Omega}\mathbf{Q}_{0}^{\textrm{T}} perform polar decomposition on strain: \mathbf{R}^{\Omega}_{\textrm{L}},\mathbf{U}_{\textrm{L}}^{\Omega}\leftarrow polarDecomposition ( \mathbf{F}^{\Omega}_{\textrm{L}} ) apply PRNN to stretch tensor: \widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{U}}\leftarrow PRNN ( \mathbf{U}^{\Omega}_{\textrm{L}},\Delta t ) retrieve stress in the original coordinate system at the local frame: \widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}\leftarrow\mathbf{R}_{\textrm{L}}^{\textrm{T}}\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{U}}\mathbf{R}_{\textrm{L}}^{\Omega} transform stress from local to global frame: \widehat{\boldsymbol{\sigma}}^{\Omega}\leftarrow\mathbf{Q}_{0}^{\textrm{T}}\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}\mathbf{Q}_{0} compute tangent stiffness matrix \mathbf{D}^{\Omega} according to Equation 6 return ( \widehat{\boldsymbol{\sigma}}^{\Omega} , \mathbf{D}^{\Omega} ) Algorithm 1 Evaluation of macroscopic integration point using the PRNN For details on implementation, training aspects or architectural choices, the reader is directed to [ 32 ] . Here, we highlight the main features of the network. In the PRNN, we preserve the constitutive models used in the micromodel, as well as their material properties, and embed them in an encoder-decoder architecture, as illustrated in Figure 4a . Through the encoder, we learn a set of values that we interpret as the local strain of fictitious microscopic material points . Then, the constitutive model associated to each point is used to compute stresses and, in case of a history-dependent model, updated internal variables. Storing the internal variables from one time step to another, as illustrated in Figure 4b for a rate and path-dependent model \mathcal{C}_{j}^{\omega} , allows history dependence to arise naturally. Compared to the full-order model, the encoder learns a task analogous to the solution of the original microscale equilibrium problem, and the decoder corresponds to the stress homogenization. (a) Compact representation of PRNN (b) Fictitious material point with history-dependent constitutive model unrolled in time Figure 4: Architecture of PRNN and fictitious material point unrolled in time. Having constitutive models in the network also raises a few constraints that regular NNs do not need to meet. For example, since the output of our encoder are deformation gradients, these must have positive determinant. For that purpose and taking into account the zero strain-stress state ( \mathbf{U}^{\Omega}=\mathbf{I}\rightarrow\widehat{\boldsymbol{\sigma}}^{\Omega}_{\textrm{L}}=\mathbf{0} ), we propose the weights from the encoder to be a symmetric matrix per material point. This arrangement avoids negative determinants and only requires 6 learnable parameters per material point. For the decoder, we employ a sparse architecture, in which only the matching stress components contribute to the macroscopic stress. Therefore, including encoder and decoder, each material point is associated with 12 learnable parameters. As for the constitutive model itself, both models present in the RVE, \mathcal{C}_{\textrm{matrix}}^{\omega} and \mathcal{C}_{\textrm{fiber}}^{\omega} , were embedded in the material layer. The splitting ratio between them is a hyper-parameter, but here we follow with the proportion from our previous contribution: the hyperelastic and elasto-viscoplastic models correspond to 25\text{\,}\% and 75\text{\,}\% of the material points, respectively, rounding the number of hyperelastic models up when the total number of points is even but not divisible by 4. Finally, in the following section, we present the transfer learning strategy used in this work to extrapolate in terms of material properties. Figure 5: From training with micromodel with a set of properties \boldsymbol{\theta}_{(\cdot)}^{\textrm{A}} to extrapolating to micromodel with set of properties \boldsymbol{\theta}_{(\cdot)}^{\textrm{B}} without retraining. 2.6 Transfer learning In this paper, we take a step further and explore how one can leverage the design choices in the material layer to transfer from one set of properties to another. The motivation for that comes from the fact that each mode in \mathcal{C}_{\textrm{matrix}}^{\omega} is associated to 15 internal variables, to account for the full relaxation spectrum, a total of 240 internal variables would be needed per material point evaluated by this constitutive model. Such large sum of internal variables combined with the use of finite differences to compute the derivatives related to the backpropagation in time would slow down training significantly. The solution to that if using regular data-driven surrogate models would involve either training from scratch with the full 16 modes or use some transfer learning strategy, such as warm start. In both cases, additional computational effort would be necessary to (re)train the surrogates. Here, because material properties in the constitutive model are embedded in the material layer, we keep the network trained on a single mode and update the material properties in the network without any retraining. This scheme is illustrated in Figure 5 with the models used in this work, but the approach is general and applicable to other constitutive models. The ability to extrapolate to different material properties in the online phase is yet another benefit of having an explainable function in our latent space. 3 Constant strain-rate experiments In this section, we update the material properties to transfer from a PRNN with single-mode \mathcal{C}_{\textrm{matrix}}^{\omega} model to a multi-mode one. Then, we present the results obtained with the FEPRNN for modeling the constant strain-rate experiments. For this, a displacement controlled analysis was carried out, with the displacements in all three directions being constrained at the bottom and top surfaces of the coupon, except for the y direction at the top, where the specimen is pulled at a constant strain-rate. We employ the adaptive stepping scheme from [ 45 ] to deal with potential convergence issues. In addition to that, we include a brief study on the use of oblique end-tabs as a possible adaptation to the experiments for a more uniform strain distribution. 3.1 From single to multi-mode PRNN To assess the performance of the networks from [ 32 ] trained with single-mode properties in extrapolating to the RVE with the full relaxation spectrum \boldsymbol{\theta}_{\textrm{matrix}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} , we consider the largest training set from that work and keep the same optimal layer size, that is, 144 proportional GP-based curves and 8 material points in total (from which 6 are evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} and 2 by \mathcal{C}_{\textrm{fiber}}^{\omega} ). In this particular application, the update in the material properties offers a further possibility for maximizing efficiency in the transfer learning scheme. Instead of considering the full relaxation spectrum at once, we investigate the gradual mode addition in the online phase. The idea comes from the fact that the latest modes have increasingly small contributions to the elastic regime, and could, in principle, be left out from the PRNN without loss of accuracy, leading to an even faster model evaluation. The gradual mode addition study is illustrated in A , where we found that 5 modes are enough to accurately predict the response of RVEs generated with the full relaxation spectrum. Therefore, for the remainder of this section, we use 5 modes in all FEPRNN simulations. 3.2 Comparison with experimental results We start with the worst case scenario in [ 35 ] : off-axis angle \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ and strain-rate \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ . In Figure 6a , we plot the custom arclength response, referred as “Micro", with and without the fiber rotation update \phi against the experimental stress-strain curve. We also show results from the PRNN-based approach to the multiscale problem, named as “FEPRNN". For this, we use the mesh shown in Figure 3 , consisting of 576 (linear) wedge elements integrated with 1 point, and the PRNN discussed in Section 3.1 as the homogenized constitutive model. (a) Varying boundary conditions in micromodel for \theta_{0} = 15\text{\,}\mathrm{\SIUnitSymbolDegree} (b) Different off-axis angles and micromodel boundary conditions Figure 6: Stress-strain curve for \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ using different methods and boundary conditions for multiple off-axis angles. Figure 6b shows an overview of how the FEPRNN and micromodel-based solutions compare with the experiment for different off-axis angles. Comparing the responses using the micromodel with and without the reorientation angle \phi in Figure 6b , it becomes clear how its effect depends heavily on the initial off-axis angle. Though these are not new results, it is only now possible to verify 1) how well the reorientation angle computed for the micromodel solution matches with the average angle computed from the PRNN-based simulation and 2) how well the assumption of macroscopic homogeneity holds. For this end, we show in Figure 7 the full-field of strains in the loading direction for different off-axis angles. Note how the variation in the macroscopic strain becomes larger as the off-axis angle \theta_{0} decreases. Clearly, the assumption behind the micromechanical analysis, that the specimen is in a macroscopically uniform state, is no longer valid. Figure 7: Macroscopic strains from FEPRNN simulations for \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ and different off-axis angles. To further illustrate the problem, we calculate the reorientation angle \phi at each of the macroscopic integration points with the surrogate-based multiscale approach. For this, we make a parallel with the deformation states in Figure 3 and imagine that there is an equivalent shape of \hat{\mathbf{F}}^{\Omega} , whose side 0\--1 is not moving in direction 2, and therefore \overline{F}^{\Omega}_{21}=0 . From that condition, the angle \phi can be expressed as: \phi=\arctan(\hat{F}^{\Omega}_{21}/\hat{F}^{\Omega}_{11}) (8) where \hat{F}^{\Omega}_{21} and \hat{F}^{\Omega}_{11} are components of the deformation gradient in the local frame (see Equation 2 ). Based on this expression, we compute the simple average of \phi over the entire macroscopic domain for the off-axis angles 45\text{\,}\mathrm{\SIUnitSymbolDegree} and 15\text{\,}\mathrm{\SIUnitSymbolDegree} and compare it with the one calculated by the custom arclength model, as shown in Figure 8 . In addition to the average, the envelope corresponding to the highest and lowest angles over the entire specimen are plotted (the pink shaded areas). Note how the angle variation is dramatically higher in the 15\text{\,}\mathrm{\SIUnitSymbolDegree} case. For both angles, the highest values are located at the center of the specimen (see Figure 8c ) and the lowest ones, close to zero, near the grips, where movement is restricted. In the 45\text{\,}\mathrm{\SIUnitSymbolDegree} case, the mean reorientation angle follows remarkably well the angle computed from the arclength model, which is also translated in the good visual agreement seen in Figure 6 . For the 15\text{\,}\mathrm{\SIUnitSymbolDegree} composite, the envelope of the angle \phi becomes increasingly larger and the single micromodel loses representativeness for the average response of the specimen, more strongly in the averaged stress-strain curve of Fig. 6a than in the mean orientation angle in Fig. 8b . (a) \theta_{0}=$45\text{\,}\mathrm{\SIUnitSymbolDegree}$ (b) \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ (c) Snapshots of full field of angle \phi using PRNN Figure 8: Reorientation angle for different initial off-axis angles for constant strain-rate experiment with \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ . Shaded areas in a) and b) represent the envelope of maximum and minimum values over the entire macroscopic domain, while solid lines correspond to the average. Figure 9: Stress-strain curves for off-axis angle \theta_{0}=$30\text{\,}\mathrm{\SIUnitSymbolDegree}$ and different strain-rates \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}} . In addition to that, the multiscale simulations showed the presence of shear stress, suggesting that the boundary conditions in the experiments are not only far from the assumptions in the arclength model, but also from its initial goal, a uniaxial tensile test. Finally, we illustrate the generality of the framework with two other strain rates for the 30\text{\,}\mathrm{\SIUnitSymbolDegree} case: 10^{-3}\,${\mathrm{s}}^{-1}$ and 10^{-5}\,${\mathrm{s}}^{-1}$ . Figure 9 shows the good match of the two engineering stress-strain curves obtained using the PRNN as the constitutive model with respect to the experimental curves. In both cases, the maximum error is around 5\text{\,}\mathrm{\%} , at the last time step. 3.3 Investigation into alternative setups With the multiscale framework, we can also investigate the influence of the specimen geometry and boundary conditions on the response, which could be interesting in case one seeks to calibrate material models based on engineering stresses and strains coming directly from test frame readings. First, we analyze an alternative geometry with oblique end-tabs. The tab design proposed by Sun and Ilsup 1993 is illustrated in Figure 10 , with \beta given by: \beta=\text{acot}\,(-S_{16}/S_{11}) (9) where S_{16} and S_{11} are the compliance coefficients with respect to the global coordinate system. For linear elasticity, this design ensures a macroscopically homogeneous stress states under uniaxial loading. In the nonlinear case, the compliance coefficients change from one time step to another, but we adopt the values obtained at the undeformed configuration with 5 modes. Figure 10: Alternative coupon geometry with oblique-end tabs. To illustrate the effectiveness of the oblique end-tabs in creating a nearly uniform stress-state, we continue with the most challenging case explored so far: off-axis angle of 15\text{\,}\mathrm{\SIUnitSymbolDegree} and strain-rate of 10^{-4}\,${\mathrm{s}}^{-1}$ . For comparison, we plot the stress-strain curves for \sigma_{\textrm{yy}}^{\textrm{eng}} and \sigma_{\textrm{xy}}^{\textrm{eng}} the two types of end-tabs in Figure 11 . Note that the oblique design is effective in reducing the shear almost to zero. The new geometry also results in a lower engineering stress level in the loading direction (axial). (a) Axial stress (b) Shear stress Figure 11: Stress-strain curves for \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ using straight vs oblique end-tabs. Another way of eliminating shear stress is to allow lateral movement of the specimen. Figure 12 shows the comparison between the two types of end-tabs and different boundary conditions with respect to the experiments. For the oblique design, allowing the lateral movement has little to no impact on the outcome since the shear stress is already quite limited in that case. On the other hand, with the straight end-tabs, allowing the lateral movement reduces the engineering stress by about 10\text{\,}\mathrm{\%} . Figure 12: Stress-strain curves for different end-tab designs and boundary conditions for \theta_{0}=15^{\circ} and \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ . Finally, the full-field stress distribution for the combinations discussed previously is shown in Figure 13 . Note the stress concentration near the edges of the specimen and the higher stress band formed in the diagonal of the coupon, aligned with the fiber direction. These are still present in the (computational) experiment with lateral movement, but are significantly reduced with the use of oblique end-tabs on the right side. Figure 13: Full field of stress predicted by FEPRNN at the same strain level ( \varepsilon_{\textrm{yy}}^{\textrm{eng}}=0.03 ) on specimen with straight and oblique end-tabs with and without lateral movement allowed for \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}=10^{-4}\,${\mathrm{s}}^{-1}$ . 4 Creep experiments In this section, we follow the same structure as in the previous section, only now for the creep experiments. Again, we employ the adaptive stepping scheme [ 45 ] , this time with larger bounds for the time increments as the creep simulations are significantly longer. We keep the same boundary conditions as in Section 3 now with a force controlled analysis according to Equation 5 . 4.1 From one relaxation spectrum to another In [ 36 ] , a new relaxation spectrum for \mathcal{C}_{\textrm{matrix}}^{\omega} with a total of 2 processes and 8 modes was calibrated directly on the creep experiments. In these experiments, no extensometer was used, therefore measurements implicitly take into account the compliance effect of the machine grips. In addition to that, the shear modulus G_{12} was changed from 45 MPa to 5 MPa for \mathcal{C}_{\textrm{fiber}}^{\omega} [ 36 ] . Apart form these properties, since the same micromodel was used, the straightforward option would be to update the material properties in both \mathcal{C}_{\textrm{matrix}}^{\omega} and \mathcal{C}_{\textrm{fiber}}^{\omega} and test the PRNN performance with gradually increasing modes until convergence, in the same fashion as in Section 3.1 . This time, however, direct transfer to the new set of properties was not successful. To better understand the problem, we generated several test sets considering different combinations of matrix and fibers properties and found that the direct update of the material properties works, but on a certain range around the original properties used for training. This study can be found in B . Hence, for modeling the creep experiments, we take a step back and train the PRNNs from scratch with the new set of properties \boldsymbol{\theta}_{\textrm{fiber}}^{\textrm{creep}} and the first 2 modes (the first from each process) from \boldsymbol{\theta}_{\textrm{matrix}}^{\textrm{creep}} . For the training, the same approach and optimization parameters as in [ 32 ] were used with two modifications: 1) when creating the proportional GP-based curves, the time increment in each curve is sampled from a log-uniform distribution \Delta t\sim U\,(10^{-3}\,$\mathrm{s}$,10^{3}\,$\mathrm{s}$) , and 2) the maximum number of epochs was increased to 2000. Then, we apply the same approach as discussed in Section 2.6 and Section 3.1 to go from a network trained on 2 modes from \boldsymbol{\theta}_{\textrm{matrix}}^{\textrm{creep}} to one that predicts the response of a micromodel with the full relaxation spectrum. As this follows the same story-line as Section 3.1 , we leave the model selection and the gradual mode addition discussion for the C . In short, we select the best network with 6 material points (4 evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} and 2 by \mathcal{C}_{\textrm{fiber}}^{\omega} ) trained on 72 curves and tested on 150 curves of the same loading type and material properties. For the remaining FEPRNN simulations, we consider 6 modes in the fictitious points evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} . 4.2 Comparison with experimental results We start the discussion with the \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ cases. Figure 14 shows the strain-time FEPRNN response for the two combinations of off-axis angle and engineering stress, as well as the micromodel results from [ 36 ] , without the consideration of micro-cracking. Similar to the constant strain-rate experiments, for \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ , the effect of the reorientation angle update \phi on the micromodel results is pronounced and a highly inhomogenenous strain field is obtained with the FEPRNN approach, as illustrated in Figure 14c . Despite the offset with respect to the experimental results, the creep response of the FEPRNN again still lies between the two bounds of the micromodel solution, showing that the (surrogate-based) multiscale simulation is vital to account for the macroscopic variations that the micromodel-based approach cannot. (a) \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ , \sigma_{\textrm{yy}}^{\textrm{max}} = 290 MPa (b) \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ , \sigma_{\textrm{yy}}^{\textrm{max}} = 97 MPa (c) Macroscopic strain field predicted by FEPRNN Figure 14: Strain-time curves and macroscopic strain distributions for off-axis angles 15\text{\,}\mathrm{\SIUnitSymbolDegree} and 90\text{\,}\mathrm{\SIUnitSymbolDegree} . Next, we investigate the scenario for which fiber reorientation is not relevant: the \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ case. This time, a uniform macroscopic strain distribution is obtained, as shown in Figure 14c with the snapshots of the macroscopic strain distribution corresponding to the points “c" and “d" marked in Figure 14b . In this case, we obtain satisfactory agreement of the FEPRNN with respect to the creep experiments. To further demonstrate the generality of the PRNN, we consider two different engineering stress levels. In Figure 15 , a satisfactory agreement is achieved for the two stress levels with fixed \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ , with maximum errors below 10\text{\,}\mathrm{\%} . Figure 15: Strain-time curves for \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ and different stress levels \sigma_{\textrm{yy}}^{\textrm{max}} . For \theta_{0}=$45\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \theta_{0}=$30\text{\,}\mathrm{\SIUnitSymbolDegree}$ , the FEPRNN significantly undershoots the engineering strain, reaching at best the same response as the micromodel, as shown in Figure 16 . In Figure 16b specifically, the setup with more uniform macroscopic strain/stress distribution (straight + lateral) is the closest to the micromodel response and to the the experiments. This is the opposite of what is found in Section 3 , where the higher-fidelity reproduction of the experimental setup (straight) allowed better agreement with the experiments. One explanation lies in the fact that in that case, the material properties were calibrated on stress-strain curves obtained from extensometer measurements, while in the creep experiments no extensometer was used. As stated in [ 36 ] , the incorporation of more accurate results would demand the re-calibration of the relaxation spectrum used in \mathcal{C}_{\textrm{matrix}}^{\omega} . With material properties that implicitly consider the machine grip effect, the multiscale simulation is correcting the same effect twice. (a) \theta_{0}=$30\text{\,}\mathrm{\SIUnitSymbolDegree}$ , \sigma_{\textrm{yy}}^{\textrm{max}} = 154 MPa (b) \theta_{0}=$45\text{\,}\mathrm{\SIUnitSymbolDegree}$ , \sigma_{\textrm{yy}}^{\textrm{max}} = 110 MPa Figure 16: Strain-time curves and full-field snapshots for \theta_{0}=$30\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \theta_{0}=$45\text{\,}\mathrm{\SIUnitSymbolDegree}$ and loading time t = 10\text{\,}\mathrm{s} . 5 Conclusion In this paper, we address the challenges observed in [ 35 , 36 ] to model constant strain-rate and creep experiments on unidirectional composites under off-axis loading. In those works, a simplified and efficient approach was proposed based on a single macroscopic point with special boundary conditions to reproduce an (assumed) uniaxial stress state. While successful in many cases, the framework showed limitations with lower off-axis angles. The main hypothesis is that the assumption of macroscopic uniform deformation did not hold in the experiments. To test this hypothesis with the same high-fidelity micromodel, a full multiscale approach would be necessary, which remains computationally prohibitive. However, with the development of the PRNN, a surrogate model recently tested on the same micromodel and constitutive models as in this work [ 32 ] , a surrogate-based multiscale analysis becomes within reach. Building on these contributions, it is now possible to verify the hypotheses raised in [ 35 , 36 ] and to gain insights into the potential macroscopic strain/stress distribution in the experiments. The PRNNs have a hybrid architecture that combines data-driven components and physics-based constitutive models to leverage better generalization properties with limited datasets. They have been used to model the homogenized response of micromodels with a range of constitutive laws, from linear elastic to elasto-viscoplastic models, including the ones considered in this work. With embedded models in the latent space, extrapolation is possible not only in terms of loading types but also in terms of material properties. Here, we harness this feature to simplify and reduce the computational cost of the offline phase by training with a fraction of the set of properties used in the references [ 35 , 36 ] . Specifically, we generate and train the network with the first mode of each process in the elasto-viscoplastic model. Because each mode is associated with many internal variables, and these are at the core of the backpropagation in time, training with fewer modes translates into a more efficient process. We then show that these networks can be successfully transferred to our main task without any re-training effort by directly updating the material properties of the constitutive model. This feature is illustrated in the multiscale applications with the gradual mode addition. From the constant strain-rate experiments, and assuming that the good match between them and the multiscale simulations implies a faithful characterization of the former, we summarize the following findings: 1. Due to the tension/shear coupling, the constrained movement of the specimen by the machine grips, and the straight end-tabs, significant shear is present when the coupon is loaded in tension, except for the extreme cases \theta_{0}=$0\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ ; 2. Allowing free shear deformation of the coupon is not enough to achieve uniform strain and stress distributions. Although it does eliminate the shear stress measured at the top of the coupon, the stress concentration problem is still present (only slightly less so than in the fully constrained case); 3. We observe highly inhomogeneous macroscopic strain and stress fields for the lower off-axis angles, particularly for \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ , with strain and stress concentrations at the corners near the grips of the specimen. In such cases, the large macroscopic variability indicates that the experimental results should not be interpreted as direct uniaxial stress-strain measurements of the composite material; 4. We verify the hypotheses raised in the reference work of the micromechanical model [ 35 ] to explain the lack of fitting for \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ . The experimental response is indeed a combination of material points that rotate to align with the loading direction (at the center of the specimen) and material points that have little to no rotation (near the surface of the end-tabs). For the remaining studied off-axis loading cases, there is moderate ( \theta_{0}=$30\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \theta_{0}=$45\text{\,}\mathrm{\SIUnitSymbolDegree}$ ) to negligible ( \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ ) strain variation; 5. To achieve a more uniform stress-strain uniaxial state in these experiments, we investigate the use of oblique end-tabs. It is confirmed that these also help reduce the stress concentration near the grips and greatly reduce the manifestation of shear stress across the specimen. For the creep experiments, a new set of properties was adopted. This time, they were calibrated directly on the stress-strain experimental creep measurements obtained without the use of extensometers, which implicitly accounts for the machine grip effect. With that, we observe limited accuracy in the multiscale simulations for the intermediary off-axis angles ( \theta_{0}=$30\text{\,}\mathrm{\SIUnitSymbolDegree}$ and \theta_{0}=$45\text{\,}\mathrm{\SIUnitSymbolDegree}$ ) compared to the micromodel solution. Our results highlight the pitfalls of calibrating the material parameters from experiments without reliable strain measurements and under the assumption of homogeneous stress fields For the two remaining cases, opposite scenarios are observed, one where the strain distribution is quite uniform with no machine grip effect ( \theta_{0}=$90\text{\,}\mathrm{\SIUnitSymbolDegree}$ ) and the other with large macroscopic variability ( \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ ). For the former, we obtain a relatively good fit at different engineering stress levels. Whereas for \theta_{0}=$15\text{\,}\mathrm{\SIUnitSymbolDegree}$ , despite the convergence issues and gap between experimental and FEPRNN results, the approximate response is in the middle of the two extreme cases of the micromodel-based approach and follows the same trend as the experiment. These findings, along with the insights from the constant-strain experiments, showcase the potential of PRNNs to enable efficient and robust multiscale analysis under variable loading conditions. Data availability A centralized repository for PRNN developments can be found at https:/github.com/SLIMM-Lab/pyprnn Appendix A Mode addition with properties calibrated for constant-strain rate experiments In Figure 17 , we show several stress-strain curves obtained using the EGP model ( \mathcal{C}_{\textrm{matrix}}^{\omega} ) with different number of modes calibrated for constant-strain rate experiments \boldsymbol{\theta}_{\textrm{matrix}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} . Although the pre-peak regime response can change significantly with more modes, the post-peak response (plastic regime) is the same. For testing the networks trained on single-mode from [ 32 ] in extrapolating to the response of a RVE with the full relaxation spectrum, we select the best network over test set \mathcal{T}_{\textrm{1}} , which consists of 150 curves with the same loading type and material properties as the ones used for training. This loading type is deemed to be representative of unseen loading conditions as it includes different unloading/reloading cycles. Then, on a new test set \mathcal{T}_{\text{16}} with 150 curves generated using the 16 modes in \mathcal{C}_{\textrm{matrix}}^{\omega} , we assess the accuracy of the network by updating the material properties considering a gradual addition of modes in the fictitious material points evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} , as shown in Figure 17b . The error reaches a minimum around 9 modes with 5.9\text{\,}\mathrm{\%} . (a) Uniaxial stress with \Delta\lambda=$1\text{\times}{10}^{-4}$ and \Delta t=$1\text{\,}\mathrm{s}$ (b) Accuracy of PRNN trained on 144 proportional GP-based curves and a single mode over test set \mathcal{T}_{\textrm{16}} considering different number of modes in the fictitious material points evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} Figure 17: Stress-strain curves using \mathcal{C}_{\textrm{matrix}}^{\omega} and PRNN accuracy with different number of modes from \boldsymbol{\theta}_{\textrm{matrix}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} . Appendix B Limitations on the transfer learning for creep experiments The following combination of material properties was considered to generate test sets of 150 proportional GP-based curves each: full relaxation spectrum calibrated for the creep experiments, referred as \boldsymbol{\theta}_{\textrm{matrix}}^{\textrm{creep}} , and varying shear modulus G_{12} in the material properties considered for the fibers \boldsymbol{\theta}_{\textrm{fiber}}^{\textrm{creep}} . The only difference between \boldsymbol{\theta}_{\textrm{fiber}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} and \boldsymbol{\theta}_{\textrm{fiber}}^{\textrm{creep}} is the G_{12} , which changed from 45 MPa to 5 MPa. With the network parameters obtained training on the first mode of \boldsymbol{\theta}_{\textrm{matrix}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} and \boldsymbol{\theta}_{\textrm{fiber}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} , we update the material properties in the fictitious material points with \mathcal{C}_{\textrm{fiber}}^{\omega} to match the corresponding shear modulus being tested, while the modes used in \mathcal{C}_{\textrm{matrix}}^{\omega} were gradually updated with increasing number of modes from the new spectrum. Though the test sets have slightly different stress-strain ranges, the comparison in terms of absolute errors in Figure 18 is meaningful and reveals a few insights. Firstly, going from the 1st mode of one relaxation spectrum ( \boldsymbol{\theta}_{\textrm{matrix}}^{\dot{\varepsilon}_{\textrm{yy}}^{\textrm{eng}}} ) to a multi-mode prediction of another ( \boldsymbol{\theta}_{\textrm{matrix}}^{\textrm{creep}} ) is possible. Second, the best performance is achieved around 5 modes. And lastly, in this case, the change in the shear modulus is the most important parameter in determining how well we can extrapolate. For the value considered in the creep simulations ( G_{\textrm{12}}=5 MPa), the lowest error observed is still quite high, around 9 MPa. Figure 18: Accuracy with gradual mode addition in the fictitious material points evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} of PRNN trained on micromodel simulations with a single mode from \boldsymbol{\theta}_{\textrm{matrix}}^{\dot{\varepsilon}_{\textrm{yy}}} over test sets with micromodel simulations with 8 modes from \boldsymbol{\theta}_{\textrm{matrix}}^{\textrm{creep}} and different fiber shear moduli. Appendix C Training and transfer learning for creep experiments Figure 19a shows the envelope of highest and lowest errors over a validation set \mathcal{V}_{2} with 150 proportional GP-based curves for the different initialization for a number of material layer and training set sizes, from which we select the networks with 6 fictitious material points (4 evaluated by \mathcal{C}_{\textrm{matrix}}^{\omega} and 2 by \mathcal{C}_{\textrm{fiber}}^{\omega} ) trained on 72 proportional GP-based curves. To assess the performance of the PRNNs in extrapolating to more modes, first we select the network with the lowest error over a test set \mathcal{T}_{\textrm{2}} with 150 proportional GP-based curves and same material properties as in the training. Then, on a new test set \mathcal{T}_{\textrm{2}} that considers RVEs with the new full relaxation spectrum, we test the accuracy of that network with a varying number of modes (see Figure 19b ). In this case, the errors reach a minimum around 3\text{\,}\mathrm{MPa} ( \approx 10\text{\,}\mathrm{\%} ) when 4 modes are considered. (a) Envelope of highest and lowest errors from 10 initialization of PRNNs trained on different number of proportional GP-based curves and material layer size over validation set \mathcal{V}_{\textrm{2}} (b) Accuracy with mode addition in PRNN with 6 material points trained on the first two modes over test sets with the full relaxation spectrum \mathcal{T}_{\textrm{8}} Figure 19: Model selection procedure for PRNNs trained on the micromodel with material properties calibrated on creep experiments.