Fast Graph Generation via Autoregressive Noisy Filtration Modeling Markus Krimmel krimmel@biochem.mpg.de, Jenna Wiens wiensj@umich.edu, Karsten Borgwardt borgwardt@biochem.mpg.de, Dexiong Chen dchen@biochem.mpg.de Abstract Existing graph generative models often face a critical trade-off between sample quality and generation speed. We introduce Autoregressive Noisy Filtration Modeling (ANFM), a flexible autoregressive framework that addresses both challenges. ANFM leverages filtration, a concept from topological data analysis, to transform graphs into short sequences of subgraphs. We identify exposure bias as a potential hurdle in autoregressive graph generation and propose noise augmentation and reinforcement learning as effective mitigation strategies, which allow ANFM to learn both edge addition and deletion operations. This unique capability enables ANFM to correct errors during generation by modeling non-monotonic graph sequences. Our results show that ANFM matches state-of-the-art diffusion models in quality while offering over 100 times faster inference, making it a promising approach for high-throughput graph generation. The source code is publicly available at https://github.com/BorgwardtLab/anfm . Reviewed on OpenReview: https://openreview.net/forum?id=3Up81Zq728 1 Introduction Graphs are fundamental structures that model relational data in various domains, from social networks and molecular structures to transportation systems and neural architectures. The ability to generate realistic and diverse graphs therefore holds great promise in many applications, such as drug discovery ( Liu et al., 2018 ; Vignac et al., 2023 ) , network simulation ( Yu & Gu, 2019 ) , and protein design ( Ingraham et al., 2019 ) . The space of drug-like molecules and protein conformations is, for practical purposes, infinite, limiting the effectiveness of in-silico screening of existing libraries ( Polishchuk et al., 2013 ; Levinthal, 1969 ) . Consequently, high-throughput graph generation—the task of efficiently creating new graphs that faithfully emulate properties similar to those observed in a given domain—is thus emerging as a critical challenge in machine learning and generative artificial intelligence. Recent deep learning-based approaches, particularly autoregressive ( You et al., 2018b ; Liao et al., 2019 ; Kong et al., 2023 ) and diffusion models ( Vignac et al., 2023 ; Bergmeister et al., 2024 ) , have shown promise in generating increasingly realistic graphs. However, many current diffusion-based approaches rely on iterative refinement processes involving a large number of steps. This computational burden may hinder their potential for high-throughput applications ( Gentile et al., 2022 ; Gómez-Bombarelli et al., 2016 ) . While autoregressive models are more efficient during inference, they have underperformed in terms of generation quality. Moreover, they might be susceptible to exposure bias ( Ranzato et al., 2016 ) , where performance deteriorates as errors accumulate during sampling and a train-test discrepancy consequently arises. Recent work has explored the use of topological data analysis, particularly persistent homology and filtration ( Edelsbrunner et al., 2002 ; Zomorodian & Carlsson, 2005 ) , for graph representation. A filtration provides a multi-scale view of a graph structure by constructing a nested sequence of subgraphs. This approach has shown potential in various graph analysis tasks, including classification and similarity measurement ( O’Bray et al., 2021 ; Schulz et al., 2022 ) . In the context of generative modeling, filtration-based representations have been used to develop more expressive tools for generative model evaluation ( Southern et al., 2023 ) . However, the application of filtration-based methods for graph generation remains unexplored. In this work, we propose filtrations as a generalization of graph sequence families used in prior autoregressive models ( You et al., 2018b ; Liao et al., 2019 ) , offering a flexible framework to construct sequences for generation. Nonetheless, modeling filtration sequences in a naive manner remains prone to exposure bias. To address this, we introduce Autoregressive Noisy Filtration Modeling (ANFM), a novel approach to fast graph generation that models noise-augmented filtration sequences autoregressively. To generate a target graph, our method produces a short sequence of increasingly dense and detailed intermediate graphs, which interpolate the target graph and the fully disconnected graph. Compared to diffusion models ( Vignac et al., 2023 ; Bergmeister et al., 2024 ) , ANFM requires fewer iterations during sampling, resulting in significantly faster inference speed. By adding noise to the filtration sequences, ANFM learns to simultaneously remove or add edges. As a result, the model can recover from errors during sampling. Additionally, we further mitigate exposure bias with adversarial fine-tuning using reinforcement learning (RL). Our method offers a promising balance between efficiency and accuracy in graph generation, providing a 100-fold speedup over diffusion-based approaches, while substantially outperforming existing autoregressive models in terms of generation quality. In summary, our contributions are as follows: • We propose a novel autoregressive graph generation framework that leverages graph filtration. Our formulation generalizes the graph sequences used by previous autoregressive models that operate via node addition. • We introduce a specialized autoregressive model architecture designed to operate on these graph sequences. • We identify exposure bias as a potential challenge in autoregressive graph generation and propose noise augmentation and adversarial fine-tuning as effective strategies to mitigate this issue. • We conduct ablation studies to evaluate the impact of different components within our framework, demonstrating that noise augmentation and adversarial fine-tuning substantially improve performance. • Our empirical results highlight the strong performance and efficiency of our model compared to recent baselines. Notably, our model achieves inference speed 100 times faster than existing diffusion-based models. 2 Related Work ANFM builds on the concept of graph filtration and incorporates noise augmentation. It is fine-tuned via reinforcement learning to mitigate exposure bias. In the following, we provide a brief overview of related graph generative models (GGMs), approaches to address exposure bias, and applications of graph filtration. Autoregressive GGMs. GraphRNN ( You et al., 2018b ) made the first advances towards deep generative graph models by autoregressively generating nodes and their incident edges to build up an adjacency matrix row-by-row. In a similar fashion, DeepGMG ( Li et al., 2018 ) iteratively builds a graph in a node-by-node fashion. Liao et al. (2019) proposed a more efficient autoregressive model, GRAN, by generating multiple nodes at a time in a block-wise fashion, leveraging mixtures of multivariate Bernoulli distributions. GraphArm ( Kong et al., 2023 ) introduced an autoregressive model that reverses a diffusion process in which nodes and their incident edges decay to an absorbing state. These models share the property that they build graphs by node addition. Hence, they autoregressively generate an increasing sequence of induced subgraphs (i.e., maximal subgraphs on a subset of the nodes). In comparison, the subgraphs we consider in our work do not necessarily need to be induced. Moreover, ANFM may generate sequences that are not monotonic. That is, ANFM may simultaneously add and delete edges. In contrast to autoregressive node-addition methods, approaches by Goyal et al. (2020) and Bacciu et al. (2020) generate graphs through edge-addition following a pre-defined edge ordering. Diffusion GGMs. Diffusion models for graphs such as EDP-GNN ( Niu et al., 2020 ) and GDSS ( Jo et al., 2022 ) , based on score matching, or DiGress ( Vignac et al., 2023 ) , based on discrete denoising diffusion ( Austin et al., 2021 ) , have emerged as powerful generators. However, they require many iterative denoising steps, making them slow during sampling. Hierarchical approaches ( Bergmeister et al., 2024 ) and absorbing state processes ( Chen et al., 2023 ) have subsequently been proposed to allow diffusion models to be scaled to large graphs. In contrast to the noise processes in denoising diffusion models, the filtration processes we consider are in general non-Markovian , necessitating a full autoregressive modeling. In concurrent work, Boget (2025) proposed SID, a modification of discrete denoising graph diffusion in which intermediate states are conditionally independent. This work was motivated by a phenomenon similar to exposure bias, termed compounding denoising errors . Similar to ANFM, the sequences modeled by an absorbing state variant of SID are non-montonic and non-Markovian. Single-Step GGMs. Unlike iterative approaches such as autoregression and diffusion, graph variational autoencoders (VAEs) ( Kipf & Welling, 2016 ; Simonovsky & Komodakis, 2018 ) generate all edges in a single step, reducing computational costs during inference. However, VAEs struggle to model complicated distributions and require graph matching during training, restricting their application to small graphs. Generative adversarial networks (GANs) ( Goodfellow et al., 2014 ) offer an alternative, operating in a likelihood-free fashion and avoiding graph matchings. Despite this advantage, GANs are notoriously difficult to train and suffer from issues such as mode collapse ( Cao & Kipf, 2018 ) . To address these instabilities, Martinkus et al. (2022) proposed SPECTRE, a GAN that first generates a Laplacian spectrum before producing the corresponding graph. RL in Graph Generation. In the context of graph generation, reinforcement learning has been used mainly to generate molecular graphs. You et al. (2018a) trained a generative model for molecules via RL, combining adversarial and domain-specific rewards. In contrast to our work, they only considered molecular graphs and did not use teacher-forcing during training. Taiga ( Mazuz et al., 2023 ) used reinforcement learning to optimize the chemical properties of molecules obtained from a language model pre-trained on SMILES strings. Diffusion models have also been shown to be amenable to RL finetuning, allowing extrinsic non-differentiable metrics to be optimized ( Liu et al., 2024 ) . Exposure Bias. Exposure bias ( Bengio et al., 2015 ; Ranzato et al., 2016 ) refers to the train-test discrepancies autoregressive models face when they are exposed to their own predictions during inference. Errors may accumulate during sampling, leading to a distribution shift and degrading performance. To mitigate this phenomenon in natural language generation, Bengio et al. (2015) proposed a data augmentation strategy to expose models to their predictions during training. In a similar effort, Ranzato et al. (2016) proposed training in free-running mode using reinforcement learning to optimize sequence-level performance metrics. SeqGAN ( Yu et al., 2017 ) , which is the most relevant to our work, also trains models in free-running mode using reinforcement learning. Instead of relying on extrinsic metrics like Ranzato et al. (2016) , it adversarially trains a discriminator to provide feedback to the generative model. GCPN ( You et al., 2018a ) adopts a hybrid framework for generating small molecules, combining adversarial and domain-specific rewards. Graph Filtration. Filtration is commonly used in the field of persistent homology ( Edelsbrunner et al., 2002 ) to extract features of geometric data structures at different resolutions. Previously, graph filtration has mostly been used to construct graph kernels ( Zhao & Wang, 2019 ; Schulz et al., 2022 ) or extract graph representations that can be leveraged in downstream tasks such as classification ( O’Bray et al., 2021 ) . While filtration has also been used for evaluating graph generative models ( Southern et al., 2023 ) , to the best of our knowledge, our work presents the first model that directly leverages filtration for generation. 3 Background In the following, we consider unlabeled and undirected graphs, denoted by G=(V,E) , where V is the set of vertices and E\subseteq V\times V is the set of edges. Without loss of generality, we assume V=\{1,2,\dots,n\} and denote by e_{ij} the edge between nodes i,j\in V . We assume that only connected graphs are presented to our model during training and filter training sets if necessary. Our approach is based on the concept of graph filtration. Graph Filtration. A filtration of a graph G is defined as a nested sequence of subgraphs: G=G_{T}\supseteq G_{T-1}\supseteq\dots\supseteq G_{1}\supseteq G_{0}=(V,\emptyset) (1) where each G_{t}=(V,E_{t}) is a graph sharing the same node set as G_{T}:=G . The filtration satisfies the following properties: (1) E_{t}\subseteq E_{t^{\prime}} for all t:\>f(e)\leq a_{t}\} (2) The sequence (a_{t})_{t=0}^{T} is referred to as the filtration schedule sequence . The choice of the filtration function and the schedule sequence plays a crucial role in effective graph generation. We present a visual example of the filtration process in Figure 1(b) . 4 Autoregressive Noisy Filtration Modeling In this section, we present the Autoregressive Noisy Filtration Modeling (ANFM) approach for graph generation. Given a node set V , our objective is to generate a sequence of increasingly dense graphs \tilde{G}_{0},\tilde{G}_{1},\dots,\tilde{G}_{T} on V . The final graph \tilde{G}_{T} should plausibly represent a sample from the target data distribution. To achieve this goal, ANFM will be trained to reverse a noise augmented filtration process. This section is organized as follows: We present two filtration strategies in Sec. 4.1 . To mitigate exposure bias, we propose a noise-augmentation of the resulting graph sequences in Sec. 4.2 . We then introduce in Sec. 4.3 our autoregressive model that reverses this noisy filtration process. In Sec. 4.4 , we propose a two-staged training scheme for ANFM, introducing an adversarial fine-tuning stage to further address exposure bias. Finally, in Sec. 4.5 we discuss algorithmic differences of ANFM and existing graph generative models. As our proposed method consists of several components, we study their individual contributions in extensive ablation experiments in Sec. 5.4 and Appendix H . Furthermore, implementation details and hyperparameter settings are provided in Appendices E , A , J and D . 4.1 Filtration Strategies In the following, we discuss two primary strategies for the filtration function and schedule. Alternative choices are investigated in Appendix H . Line Fiedler DFS (a) Filtration functions (b) A filtration sequence (c) Training stage I (teacher-forcing) (d) Training stage II (adversarial fine-tuning) Figure 1 : Top: A graph is transformed into a sequence of subgraphs (filtration) by taking sub-levels of a filtration function (i.e., performing edge-deletion according to the order prescribed by the filtration function). Bottom left: the generator is trained via teacher-forcing to reverse the filtration process. Bottom right: the generator is fine-tuned in free-running mode via reinforcement learning on a reward signal output by a discriminator in a SeqGAN-like framework (c.f. Appendix J ). Filtrations from Node Orderings. Many existing autoregressive models operate via node addition and thereby model sequences of nested induced subgraphs ( You et al., 2018b ; Li et al., 2018 ; Liao et al., 2019 ; Kong et al., 2023 ) . We show that similar sequences may be obtained via filtration. In this sense, the filtration framework generalizes the sequences considered by these previous works. Given a graph G , let g:V\to\{1,\dots,n\} be a node ordering, i.e., a bijection. Models that operate via node addition generate a graph sequence (\emptyset,\emptyset)=G[V_{0}]\subseteq\dots\subseteq G[V_{T}]=G, (3) where V_{0},\dots,V_{T} are monotonically increasing sub-levels of g with V_{t}=g^{-1}\left([(-\infty,a_{t}]\right) for some scalars -\infty=a_{0}\leq\dots\leq a_{T}=+\infty , and G[V_{t}] denotes the induced subgraph whose node set is V_{t} . Now we consider the following filtration function f:E\to\mathbb{R} : f(\{u,v\}):=\max\{g(u),g(v)\}\qquad\forall\{u,v\}\in E. (4) It is not hard to verify that this filtration function combined with the filtration schedule \left(a_{t}\right)_{t=0}^{T} , yields a filtration sequence (G_{t})_{t=0}^{T} in which the edge set of G_{t} coincides with the edge set of G[V_{t}] for any t=0,\dots,T . Hence, this filtration closely mirrors the sequence of induced subgraphs, differing only in that the node set does not change over time. We say that graphs in this sequence have induced edge sets . While a filtration function f may be derived from any node ordering, we focus on depth-first search (DFS) orderings in this work, as shown to be optimal among several orderings for autoregressive graph generation in GRAN ( Liao et al., 2019 ) . We visualize resulting edge weights on a planar graph in Figure 1(a) . For filtrations derived from DFS orderings, we choose the filtration schedule a_{t} to linearly increase from a minimum edge weight at t=1 ( a_{1}=2 ) to a maximum edge weight at t=T ( a_{T}=|V| ). Unlike in previous autoregressive models ( You et al., 2018b ; Liao et al., 2019 ; Kong et al., 2023 ) , T is fixed across all graphs. We argue that a fixed T simplifies both training and inference: since sequence lengths are uniform across all graphs, no padding must be applied during training. Additionally, no end-of-sequence signal must be emitted during inference. Line Fiedler Filtrations. In contrast to the family of graph sequences leveraged by node-addition approaches, the filtration framework is not limited to sequences of induced subgraphs. We present the line Fiedler filtration function, which is one particular choice that, in general, yields a sequence of subgraphs with non-induced edge sets. This filtration function is intended to decompose graphs in a local fashion, assigning similar edge weights to neighboring edges. We are motivated by the intuition that it may potentially be beneficial to construct graphs by adding edges that are incident to the same vertex at similar timesteps in the generation process. To achieve this goal, we leverage the first non-trivial eigenvectors of graph Laplacians, called Fiedler vectors . It is known that these eigenvectors represent low-frequency signals on vertices suitable for clustering ( Shi & Malik, 1997 ) and often coloring them in a “continuous gradient”. Since we are interested in coloring the edges of a given graph G , we transition to its line graph ( Harary & Norman, 1960 ) L(G) . Edges in G form vertices in L(G) , and they are adjacent in L(G) if they are incident to a shared vertex in G . The Fiedler vector of L(G) now tends to color its vertices in a continuous gradient, which transfers to a continuous coloring of the edges of G . We choose the line Fiedler filtration function as such a Laplacian eigenvector of L(G) and refer to Appendix M for a more rigorous definition. We visualize the resulting edge weights on a planar graph in Figure 1(a) , demonstrating how it varies across edges in a “continuous gradient”. For 0\leq t\leq T , we propose to define the filtration schedule a_{t} as: a_{t}:=\inf\left\{a\in\mathbb{R}\>:\>\frac{|f^{-1}((-\infty,a_{t}])|}{|E|}\geq\gamma(t/T)\right\}, (5) where f is the line Fiedler filtration function, and \gamma:[0,1]\to[0,1] is a monotonic function governing the rate at which edges are added in the filtration sequence. We choose \gamma(t):=t , leading to an approximately linear increase in the number of edges throughout the graph sequence. We investigate other choices of \gamma in Appendix H . 4.2 Noise Augmentation of Filtrations Our goal is to autoregressively generate sequences of graphs that approximately reverse the filtration processes above. To mitigate exposure bias in autoregressive modeling, previous works have proposed data augmentation schemes to make models more robust to the distribution shift occurring during inference ( Bengio et al., 2015 ) . We propose a simpler yet effective strategy: namely, randomly perturbing intermediate graphs in a filtration sequence G_{0},\dots,G_{T} during the first training stage to expose the model to erroneous transitions. For each intermediate graph G_{t} with 0t=0,\makebox[8.00003pt][c]{.\hfil.\hfil.},T-1, (8) \displaystyle\left(u_{i}^{(t)}\right)_{t=0}^{T-1} \displaystyle:=\operatorname{TRDecoder}_{\theta}\left(\left(w_{i}^{(t)}\right)_{t=0}^{T-1}\right)\qquad \displaystyle\forall\>i=1,\makebox[8.00003pt][c]{.\hfil.\hfil.},|V|, where the first equation defines a structural mixing operation and the second equation defines a temporal mixing operation. For the structural mixing, we use Structure-Aware-Transformer layers ( Chen et al., 2022 ) . Additionally, we incorporate both the timestep t and cycle counts in \tilde{G}_{t} using FiLM ( Perez et al., 2018 ) . These structural features were used previously in other graph generative models such as DiGress ( Vignac et al., 2023 ) . Multiple mixing operations are stacked to form the backbone model. Edge Decoder. To model p_{\theta}(\tilde{G}_{t}|\tilde{G}_{t-1},\dots,\tilde{G}_{0}) , we produce a distribution over possible edge sets of \tilde{G}_{t} . We use a mixture of multivariate Bernoulli distributions to capture dependencies between edges, similar to previous works ( Liao et al., 2019 ; Kong et al., 2023 ) . Mixture distributions are more expressive than simple multivariate Bernoulli distributions, which model the existence of edges independently in each generation step. Given K\geq 1 mixture components, we infer K Bernoulli parameters for each node pair i,j\in V from the node representations v_{i} produced by the backbone model at timestep t-1 : p_{k}^{(i,j)}:=D_{k,\theta}(v_{i},v_{j})\in[0,1], (9) where k=1,\makebox[8.00003pt][c]{.\hfil.\hfil.},K and D_{\cdot,\theta} is some neural network. We enforce that \smash{p_{k}^{(i,j)}} is symmetric and that the probability of self-loops is zero. In addition, we produce a mixture distribution \pi\in\mathbb{R}^{K} in the K-1 dimensional probability simplex from pooled node representations. The architectural details of D_{\cdot,\theta} are provided in Appendix E.3 . The final likelihood is defined as: p_{\theta}(\tilde{E}_{t}|\tilde{G}_{t-1},\makebox[8.00003pt][c]{.\hfil.\hfil.},\tilde{G}_{0}):=\sum_{k=1}^{K}\pi_{k}\prod_{i|\>G)\cdot p_{\theta}^{\mathrm{ANFM}}(G) (12) where p_{\theta}^{\mathrm{label}} generates node and edge attributes. We take inspiration from Li et al. (2020) and train p_{\theta}^{\mathrm{label}} as a variational autoencoder. Variational Inference. Let G:=(V,E) be a graph topology from the training dataset and let l_{V}:V\to\mathcal{X} and l_{E}:E\to\mathcal{Y} be ground-truth node and edge labels for G , respectively. An encoder q_{\phi} maps the labeled graph (G,l_{V},l_{E}) to a distribution over D -dimensional latent node representations \bm{z}\in\mathbb{R}^{V\times D} . A decoder p_{\theta} maps a tuple (G,\bm{z}) , i.e. the graph topology combined with a latent representation, to a distribution over node and edge attributes. In practice, we consider discrete attributes and p_{\theta} parametrizes a product distribution across nodes and edges. If \mathcal{X} or \mathcal{Y} factorize into a product of simpler spaces (i.e., when there are multiple node or edge attributes), p_{\theta} parametrizes a corresponding product distribution over \mathcal{X} or \mathcal{Y} . The encoder q_{\phi} parametrizes a Gaussian distribution with a diagonal covariance matrix. We formulate the typical evidence lower bound ( Kingma & Welling, 2014 ) : p_{\theta}(l_{E},l_{V}\>|\>G)\geq\mathbb{E}_{\bm{z}\sim q_{\phi}(\>\cdot\>|\>G,l_{E},l_{V})}\left[p_{\theta}(l_{E},l_{V}\>|\>G,\bm{z})\right]-D_{\mathrm{KL}}\left(q_{\phi}(\>\cdot\>|\>G,l_{E},l_{V})\>|\>\mathcal{N}(\bm{0},I)\right) (13) Architecture. We implement q_{\phi} and p_{\theta} as GraphGPS ( Rampásek et al., 2022 ) models. Since q_{\phi} operates on edge-labeled graphs, we use GINE message passing layers ( Hu et al., 2020 ) within its graph transformer. The decoder p_{\theta} , on the other hand, only operates on node representations, and we therefore use GIN layers ( Xu et al., 2019 ) . The two GNNs are provided with Laplacian and random walk positional embeddings ( Dwivedi et al., 2022 ) and we use 5% dropout layers ( Srivastava et al., 2014 ) . We feed the node representations produced by p_{\theta} through MLPs to generate distributions over node attributes. To generate a distribution over the attribute of an edge \{u,v\} , we add the node representations corresponding to u and v and feed the resulting vector through an MLP. Training. We train q_{\phi} and p_{\theta} jointly by maximizing a re-weighted version of the ELBO in Eqn. ( 13 ). Specifically, we divide the loss for a given datum (G,l_{E},l_{V}) by |V| , the cardinality of the node set of G . Sampling. To sample attributes, we draw latent node representations \bm{z} from the standard normal distribution. We select the maximum likelihood node and edge attributes from p_{\theta}(\>\cdot\>|\>G,\bm{z}) . The encoder q_{\phi} may be discarded after training. A.2 Details on GuacaMol Experiments Below, we provide details on the molecule graph generation presented in Sec. 5.3 . As described in Appendix A , we train ANFM on the un-attributed molecule topologies of GuacaMol. Independently, we train a VAE to generate attributes conditioned on a topology. To sample a molecule, we first generate a graph using ANFM and label nodes and edges using the VAE. Attributes. We produce edge labels that indicate the bond type between heavy atoms, distinguishing between single, double, triple, and aromatic bonds. To reconstruct the correct molecule from its graph representation, we find that we require require several node attributes. Namely, given an atom (i.e., node), we generate its type (i.e., the element), the number of explicit hydrogens bound to it, the number of radical electrons, and its partial charge. ANFM Hyperparameters. We train an ANFM model using the DFS filtration strategy. In stage I, we use similar hyper-parameters as for the other datasets. We use T=30 filtration steps, a learning rate of 10^{-5} , a local batch size of 64 on two GPUs, and 300k training steps. Throughout stage I training, we monitor validation loss and ensure that the model does not overfit. During training stage II, we use a batch size of 32 and a learning rate of 2.5\times 10^{-8} for the generative model. The discriminator has 3 layers and a hidden dimension of 32. The other hyperparameters of the discriminator and value model match those used in the other experiments. VAE Hyperparameters. We use 5-layer GraphGPS ( Rampásek et al., 2022 ) models for the encoder and decoder, respectively. The hidden dimension is 256 while we choose the latent dimension D to be 8. The Laplacian positional embedding is 3-dimensional while the random walk positional embedding is 8-dimensional. We train for 250 epochs on the GuacaMol dataset, using a batch size of 512, an Adam optimizer ( Kingma & Ba, 2015 ) and a learning rate of 10^{-4} . Model Samples. In Figure 3 , we show uncurated samples from the ANFM model. Figure 3 : Uncurated samples from ANFM model trained on GuacaMol. Appendix B Sampling Complexity of ANFM B.1 Complexity Analysis In the following, we analyze the asymptotic runtime complexity of sampling a graph from our proposed model and the baselines we studied in Section 5 . Proposition B.1 . The asymptotic runtime complexity for sampling a graph with N nodes from an ANFM with T timesteps is: \mathcal{O}(T^{2}N+TN^{3}) (14) Proof. To sample a graph from an ANFM, one has to perform T forward passes through our proposed mixer architecture. These forward passes are preceded by the computation of various graph features, including Laplacian eigenvalues and eigenvectors. This eigendecomposition has complexity \mathcal{O}(N^{3}) . At timestep 0\leq t