Information Degradation and Misinformation in Gossip Networks Thomas Jacob Maranzatto, Arunabh Srivastava, Sennur Ulukus, arunabh@umd.edu, ulukus@umd.edu Abstract We study networks of gossiping users where a source observing a process sends updates to an underlying graph. Nodes in the graph update their neighbors randomly and nodes always accept packets that have newer information, thus attempting to minimize their age of information (AoI). We show that while gossiping reduces AoI, information can rapidly degrade in such a network. We model degradation by arbitrary discrete-time Markov chains on k k states. As a packet is transmitted through the network it modifies its state according to the Markov chain. In the last section, we specialize the Markov chain to represent misinformation spread, and show that the rate of misinformation spread is proportional to the age of information in both the fully-connected graph and ring graph. I Introduction Given a network of n unreliable users, can we characterize the accuracy of information stored at a single user? This paper aims to study this question when the users communicate using a gossiping scheme. Here, a source n_{0} generates and sends updates to a network G=(\mathcal{N},E) , and nodes/users in the network randomly share their status with their neighbors. Packets are timestamped, and when a newer packet reaches some user, the user accepts the new packet and discards their old packet. When the source sends an update to some user, that information has the highest possible quality. Furthermore, as a packet is disseminated in the network, its quality may degrade according to a separate process that depends only on the number of edges the packet has traversed. We formalize our model in Section II . This simple protocol of randomly distributing a packet to a neighbor is known as gossiping . Gossiping has been implemented in databases as a way to keep up-to-date records since at least the 1980s [ 1 ] , and has proven useful in other domains [ 2 ] . Recently, a line of work has emerged investigating the age of information (AoI) in gossip networks. Roughly, age of information is a measure in how out-of-date the information at a single user/node is compared to some global source. In two works of Yates [ 3 , 4 ] , he showed that the AoI of the fully-connected network scales logarithmically with the number of users. Further work by Buyukates, Bastopcu, and Ulukus [ 5 ] showed that the AoI of a ring network scales as \sqrt{n} , and Srivastava and Ulukus [ 6 ] showed that the AoI on a square lattice (grid) scales as n^{1/3} . Maranzatto [ 7 ] also studied random and bipartite networks, and proved the existence of a phase transition for AoI in G(n,p) . Maranzatto and Michelen [ 8 ] showed that the AoI of a user is equivalent to a first-passage percolation process assuming the modeling assumptions made originally by Yates, and gave tight upper and lower bounds for the expected AoI in arbitrary networks. Fig. 1: A gossiping network with one source node generating and sharing updates. The nodes in the network share information with each other. This line of work has shown that, under the modeling assumptions discussed in Section II , networks with high connectivity are able to maintain sub-linear, and in some cases logarithmic, AoI scaling with the number of users. This leaves open questions in information quality, as in large networks, a packet stored at a user has lasted on average a non-constant amount of time. In this interval of time the packet may have incurred some corruption, either at random or by a malicious attack. In previous work, Kaswan and Ulukus [ 9 ] studied numerically the tradeoff between the age of information (AoI) and average proportion of nodes containing misinformation. Their work uses the tools developed by Yates [ 3 ] which involves unrolling certain recursive functions on the graph. The recursive functions are tractable in the AoI setting, but become unwieldy when tracking misinformation. We take a different approach, using first-passage percolation as our main tool to study the degradation of information. The proof of our main result in Section III follows a similar proof technique found in [ 8 ] . Our contribution is twofold. First, in Section III we generalize from misinformation to arbitrary Markovian models of information degradation, thus allowing for more fine-grained analysis of the quality of information stored by any user. Second, in Section IV we specialize the degradation process to have two states, “True” and “False”, and give explicit bounds on misinformation spread in two networks. We study the fully connected network K_{n} , and the ring network C_{n} , and show that the proportion of users with true information is much higher in K_{n} compared to C_{n} . In fact, the rate of information degradation is exponential in the age of information in both networks, and we conjecture that this is true for all gossip networks. If this conjecture holds, then the networks with the best AoI will spread misinformation the slowest. Fig. 2: This figure shows the process of information degradation with time, which we follow with the transfer of a packet to nodes in the network starting from the source. The thinning of the red arrow represents the degradation of the packet being shared between nodes. In this gossiping network, the source sends an update to a node, represented by the red arrow coming from outside. This information is not degraded since it comes directly from the source, thus being represented by the thickest arrow. When this node shares information with the next node, there is information degradation, depending on the associated Markov chain. II System Model and Preliminaries II-A Age and Quality of Information We begin by describing the communication model, where nodes in a graph send natural numbers which can for instance represent versions of a piece of software. Consider a source node n_{0} which sends updates to a network G=(\mathcal{N},E) with n nodes. We let \mathcal{N}=[1,\ldots,n] . The source receives version updates via a Poisson process with rate \lambda_{e} , and sends updates to each v\in G as independent Poisson processes with identical rates \frac{\lambda}{n} . In all graphs we consider, an undirected edge (i,j)\in E enables two-way communication between nodes i and j following two independent Poisson processes, with \lambda_{i}(j)=\frac{\lambda}{\operatorname{deg}(i)} denoting the Poisson rate from i to j , and \lambda_{j}(i)=\frac{\lambda}{\operatorname{deg}(j)} the rate from j to i , where \operatorname{deg}(i) denotes the degree of node i . Note that in general \lambda_{j}(i)\not=\lambda_{j}(i) . All graphs we consider are connected, thus we will never have the edge case \operatorname{deg}(i)=0 . The source and every node in the network contain internal counters; when a node i\in\mathcal{N}\cup\{n_{0}\} communicates to a neighbor j (because i ’s Poisson process updated) i sends its current counter value. The counter for n_{0} increments if and only if the process for n_{0} updates. Contrast this with j\in\mathcal{N} whose counter increments if and only if j receives a newer version from one of its neighbors. Let X_{j}(t) be the number of versions node j is behind n_{0} at time t . In addition to the internal version age counters, each node also contains a variable i\in[0,\ldots,k-1] representing the quality of information it stores. This could for instance model the number of errors in a file, or as we see in Section IV an indicator that a file contains misinformation. These variables represent states in a discrete time Markov chain M=(\mathcal{S},T) with states \mathcal{S}=[0,\ldots,k-1] and transitions T . Then, at all times, node i stores (a copy of) some state in \mathcal{S} . Node n_{0} always stores the initial state, which by convention we take to be 0 . Let S_{i}(t) denote the state stored by node i at time t ; we call S_{i}(t) the quality of information . Let M_{s}(r) denote the distribution on \mathcal{S} induced by running M for r steps starting in state s . Then, when node i receives an update from node j at time t , one of two outcomes is realized: • If X_{i}(t^{-})t,\\ M_{0}(H(i,n_{0})),&\text{ else}.\end{cases} (3) In words, the quality of information at node i is undefined (set to -1) if a packet has not yet reached i at time t , otherwise the quality of information is obtained by running M for the number of edges in the shortest source-to- i path. We prove Theorem 1 in Section III In Section IV , we specialize the quality of information Markov chain to two states \mathcal{S}=\{\mathcal{T},\mathcal{F}\} , representing true and false information, respectively. The motivation for this is to study a simplified model of information mutation, where each node forwards truthful information with probability p , and otherwise “lies” and forwards false information. This is similar to the model considered by Kaswan and Ulukus [ 9 ] , however, in their model nodes will accept incoming truthful packets with the same version age. In their model ‘‘truth prevails’’, and it is not hard to show that the proportion of nodes containing true information in their model stochastically dominates our model. 1 1 1 Let G be a gossip network, and consider the natural coupling between the two models. Then, if node i contains true information at time t in our model, this implies i contains true information in the model proposed in [ 9 ] . Our model is more pessimistic, and assumes that “timeliness prevails”, in that nodes will always prefer the information that first reaches them. Finally, we remark that the computations bounding the hopcount for C_{n} in this section are inspired by similar techniques found in [ 6 ] and [ 5 ] . III Proof of Theorem 1 To prove Theorem 1 , we follow similar techniques to the proof of [ 8 , Theorem 2] , which we restate now. Recall that the age process of a vertex i\in\mathcal{N} is defined as \tilde{X}_{i}(t):=t-N_{i}(t) , where N_{i}(t) is a real number indicating the exact time the packet stored at i was generated by the source. \tilde{X} is just the continuous analog of the version age of information. Theorem 2 ( [ 8 ] ) For any i\in\mathcal{N} and t\geq 0 , the age process of i at time t has distribution given as, \displaystyle\tilde{X}_{i}(t)=\min\{T(i,n_{0}),t\}. (4) The main difference in our setting is considering hopcount instead of first-passage time, but the main idea is the same. The discrete-time Markov chain M is only invoked when a node receives a fresher packet, thus, since the shortest time path from i to the source in G^{\prime} at time t is equal in distribution to the age process, the packet transmitted on this path will be updated by the Markov chain exactly the number of hops on this path. We formalize this intuition now. Proof: [ Theorem 1 ] We give an exact characterization of the minimizing path in terms of G^{\prime} . Consider a modified process where the Poisson process edges in G are reversed, and a single packet is generated at some node i\in\mathcal{N} . In other words, i will act as the source and generate exactly one packet at time t=0 ; let X^{\prime}_{i}(t) be the age process of n_{0} in this new model. By definition, if n_{0} received i ’s packet at time t^{\prime} , then at t\geq t^{\prime} the age is X^{\prime}_{i}(t)=t-t^{\prime} , otherwise it is +\infty . We claim that \inf_{t\geq 0}\{X^{\prime}_{i}(t)\not=\infty\} is equal in distribution to the first passage time T_{G^{\prime}}(i,S) . To be explicit consider the following quantities, \displaystyle\partial_{t} \displaystyle:=\Big\{(u,v):X^{\prime}_{u}(t)=0,X^{\prime}_{v}(t)=+\infty\Big\}, (5) \displaystyle t^{+} \displaystyle:=\inf_{t^{\prime}>t}\Big\{\text{some node with age $+\infty$ receives} \displaystyle\quad\quad\quad\quad\text{the packet from $i$ at time $t^{\prime}$}\Big\}. (6) With probability 1, t^{+}\not=t . Let w^{(u,v)} be the Poisson rate for edge (u,v) in the modified process; observe this is equal to the parameter in the exponential distribution for edge (u,v) in graph G^{\prime} . Furthermore, the event in ( 6 ) involves exactly those edges in the boundary \partial_{t} of the random ball B_{j}(t) , thus by the strong Markov property of the Poisson process, \displaystyle t^{+}=\inf_{(u,v)\in\partial_{t}}\left\{w^{(u,v)}\right\}. (7) If \partial_{t}\not=\emptyset , then \partial_{t}\not=\partial_{t^{+}} , thus the boundary evolves according to the inter-arrival distributions that correspond to the inverted edges in G^{\prime} . Therefore, in the modified process, the age of information at a node n_{0} has distribution given by, \displaystyle X^{\prime}_{i}(t)=\begin{cases}t-T_{G^{\prime}}(i,S),&\text{ if }T_{G^{\prime}}(i,S)\leq t,\\ +\infty,&\text{ otherwise }.\end{cases} (8) Note that ( 8 ) shows that T_{G^{\prime}}(i,S) is the amount of time that passes between i sending a packet and n_{0} receiving it. Again, due to the strong Markov property of the Poisson process, this time is independent of when the packet is sent. Now, in the original model a node only accepts a packet if it contains fresher data and rejects the packet otherwise, thus stale packets will not interact with new packets. Now, let \gamma^{\prime} be the path in G^{\prime} that achieves T_{G^{\prime}}(i,S) . If no such path exists, then X^{\prime}_{i}(t)=+\infty , thus we can set S_{i}(t)=-1 . If the path exists, then with probability 1 \gamma^{\prime} is unique. Note that \gamma^{\prime} corresponds to a path \gamma\in G which is the same, but all edges are reversed; in particular both paths have the same length. Then, any packet that is sent from n_{0} to i along \gamma will have its quality of information mutated by the Markov chain M exactly equal to the length of \gamma^{\prime} , assuming the packet is not overwritten at some point. But by Theorem 2 , T_{G^{\prime}} is equal in distribution to the age process (for large enough t ), thus the packet sent from n_{0} to i in G along \gamma can be coupled to the corresponding path \gamma^{\prime} and will survive. This implies the surviving packet will be mutated by the Markov chain M exactly equal to the number of edges in \gamma . Since \gamma is unique w.p. 1, this is just the hopcount, and hence S_{i}(t)=M_{0}(H(i,n_{0})) . Combining this with the case that a packet has not reached i from n_{0} discussed above completes the proof. \blacksquare IV Misinformation: Comparison of K_{n} and C_{n} Inspired by the study of misinformation spread in networks [ 9 ] , we specialize the Markov chain M to have two states \mathcal{T} and \mathcal{F} with the following transitions: \mathcal{T} \mathcal{F} \mathcal{T} p 1-p \mathcal{F} 0 1 Here, p may vary with the number of vertices n , and the initial state is taken to be \mathcal{T} . From now on, when referring to the Markov chain M we mean the chain on states and transitions defined above. We specialize to this chain in particular because it provides a nice model for studying misinformation spread on a network. On each re-transmission of a truthful packet, there is a 1-p probability the packet is corrupted to be false. Once a packet is false, it cannot recover to be truthful. Since nodes only accept fresher packets, we heuristically expect the distribution of nodes with true versus false information to behave as follows: At large, fixed t there exist some subset of vertices U\subset\mathcal{N} where any u\in U holds a packet that was directly sent to it by the source. By the definition of the model, these vertices hold truthful information. Surrounding any of these u is a random ball containing truthful nodes with the same version age. This is contained in a larger ball where nodes hold false information but have the same version age. Since new packets override old packets, these true/false balls surrounding the u intersect and override each other. Indeed, a vertex v may have contained truthful information at time t^{-} , but at time t accepted a newer packet with false information. Eventually a packet sent far in the past will no longer be present in the network. Recall that M_{\mathcal{T}}(k) is the distribution on \{\mathcal{T},\mathcal{F}\} by running M for k steps starting in state \mathcal{T} . We need the following easy observation. Observation 1 \mathbb{P}[M_{\mathcal{T}}(k)=\mathcal{T}]=p^{k}, and \mathbb{P}[M_{\mathcal{T}}(k)=\mathcal{F}]=1-p^{k}. For any time t , let P_{G}(t)=\frac{1}{n}\sum_{i\in\mathcal{N}}\mathbbm{1}\{S_{i}(t)=\mathcal{T}\} be the proportion of nodes containing truthful information at time t for gossip network G . A key quantity of interest is the limiting average number of nodes that contain truthful information. For any graph G define, \displaystyle P(G):=\lim_{t\to\infty}\mathbb{E}\big[P_{G}(t)\big]. (9) Then, P(G) gives a coarse view of the dynamics of M on G . In light of Theorem 1 , to bound P(G) we need to bound the hopcount in the auxiliary graph G^{\prime} , and bound the mixing time of M . Furthermore, the time limit ensures the system is at equilibrium. We could have equivalently taken the smallest time such that every node in the network has received a packet. Let K_{n} and C_{n} be fully-connected and the grid gossip networks on n vertices, respectively. For notational ease, we set \lambda=1 , but the results are easily extended to arbitrary \lambda . The authors in [ 11 ] show that the expected hopcount between any two vertices in K_{n} with i.i.d. \operatorname{Exp}(1) edge weights is asymptotic to \log n+\gamma-1 , where \gamma is Euler’s constant. In our model, the edge weights in the auxiliary graph depend on if one of the endpoints of (i,j) is the source vertex. If neither vertex is the source, then the edge weight is distributed as \operatorname{Exp}\left(\frac{1}{n-1}\right) . Otherwise, the edge weight is 0 if i is the source, and \operatorname{Exp}\left(\frac{1}{n}\right) if j is the source. Notice that any path achieving the first-passage time will never traverse an edge twice, thus the 0 weight edges can be changed to \operatorname{Exp}\left(\frac{1}{n}\right) weight edges while the hopcount from i to n_{0} remains the same. Furthermore, while rescaling all edge weights by a factor n will rescale the first-passage time, the hopcount will remain the same. Therefore, for large enough n , the expected hopcount for the gossip network K_{n} is \Theta(\log n) . We omit the tedious details, as the proof follows almost verbatim from [ 11 ] and involves an analysis of a coupled branching process. Their result, combined with Observation 1 gives the following result. Theorem 3 The average number of nodes containing truthful information in K_{n} is given by, \displaystyle P(K_{n})=p^{\Theta(\log n)}. (10) Therefore, for any C\in(0,1) , as long as p=C^{-O(\log n)} then P(G)\geq C ; a constant fraction of vertices hold true information. We now focus on bounding the hopcount for the auxiliary cycle gossip network. Lemma 1 For any i\in[n] , the expected hopcount for the auxiliary ring gossip network satisfies, \displaystyle\mathbb{E}H(i,n_{0})=\Theta(\sqrt{n}). (11) Proof: Let C^{\prime}_{n} be the auxiliary graph for the ring gossip network. The edges (i,i+1) and (i,i-1) (taken mod n ) in C^{\prime}_{n} have rates \operatorname{Exp}(1/2) , and the edges (i,n_{0}) have rate \operatorname{Exp}(1/n) . Consider a discrete time Markov chain \{X(t)\}_{t\in\mathbb{N}} on transient states [0,\ldots,n-1] and a single absorbing state n . The transition from state i to state j is given by, \displaystyle p_{ij}=\begin{cases}\frac{n-i}{n+1},&\text{if }j=i+1\text{ and }j\not=n,\\ \frac{i+1}{n+1},&\text{if }j=n\text{ and }i\not=j,\\ 0,&\text{ else.}\end{cases} (12) Notice that there is a coupling between the number of transitions before \{X(t)\} absorbs and number of unique states that can be visited in C^{\prime}_{n} before the first-passage time T(0,n_{0}) . The probability that the chain transitions from state i to i+1 in \{X(t)\} is exactly equal to the probability that a non-source state has a higher probability of being visited than the source state in C^{\prime}_{n} , given that i non-source states have already been visited. Let B(t) be the set of states in C^{\prime}_{n} that can be reached from state 0 with total path weight less than t , and let \partial(B(t)) be the set of edges with one endpoint in B(t) . Let \{Y_{i}\} be a collection of i.i.d. \operatorname{Exp}(\frac{1}{2}) random variables, and \{Z_{i}\} a collection of i.i.d \operatorname{Exp}(\frac{1}{n}) random variables. Then, \displaystyle\mathbb{P}[ \displaystyle\arg\min_{j}\{(i,j)\in\partial(B(t))\}\not=n_{0}:|B(t)|=i] \displaystyle=\mathbb{P}[\min_{i\in\{0,1\}}\{Y_{i}\}<\min_{j\in[i]}\{Z_{j}\}] (13) \displaystyle=\mathbb{P}[\operatorname{Exp}(1)<\operatorname{Exp}(\frac{i}{n})] (14) \displaystyle=\frac{n-i}{n+1}. (15) Therefore, the hopcount is bounded above by the number of transitions before \{X(t)\} absorbs. Now, we compute the expected number of transitions before absorption, \displaystyle\mathbb{E}[ \displaystyle\text{absorbing time of }\{X(t)\}] \displaystyle=\sum_{j=1}^{n}j\cdot\mathbb{P}\big[\{X(t)\}\text{ absorbs after exactly $j$ transitions}\big] (16) \displaystyle=\sum_{j=1}^{n}\frac{j^{2}}{n+1}\prod_{i=0}^{j-2}\frac{n-i}{n+1} (17) \displaystyle\approx\sum_{j=1}^{n}\frac{j^{2}}{n}\prod_{i=0}^{j-2}\left(1-\frac{i}{n}\right) (18) \displaystyle=\sum_{j=1}^{n}\frac{j^{2}}{n}\exp\left(\log\left(\prod_{i=0}^{j-2}\left(1-\frac{i}{n}\right)\right)\right) (19) \displaystyle\leq\sum_{j=1}^{n}\frac{j^{2}}{n}\exp\left(-\sum_{i=0}^{j-2}\frac{i}{n}\right) (20) \displaystyle\approx\sum_{j=1}^{n}\frac{j^{2}}{n}\exp\left(-\frac{j^{2}}{n}\right), (21) where the inequality follows from \log(1+x)\leq x when x>-1 , the first approximation is by replacing n+1 with n , and the last approximation is ignoring lower order terms. Now, using a Riemann sum approximation with step size \frac{1}{\sqrt{n}} and letting n\to\infty , \displaystyle\frac{1}{\sqrt{n}}\sum_{j=1}^{n}\frac{j^{2}}{n}\exp\left(-\frac{j^{2}}{n}\right) \displaystyle=\int_{0}^{\infty}x^{2}e^{-x^{2}}dx (22) \displaystyle=\frac{\sqrt{\pi}}{4}, (23) which implies \mathbb{E}H(i,n_{0})\leq\frac{\sqrt{n\pi}}{4} . An analogous argument for the directed ring with edge weights as \operatorname{Exp}(\frac{1}{2}) gives \mathbb{E}H(i,n_{0})\leq\frac{\sqrt{n\pi}}{8} , which is sufficient. \blacksquare An immediate corollary of Lemma 1 and Observation 1 is the following characterization of the proportion of truthful nodes. Theorem 4 The average number of nodes containing truthful information in C_{n} is given by, \displaystyle P(C_{n})=p^{\Theta(\sqrt{n})}. (24) Therefore, for any C\in(0,1) , if p=C^{-O(\sqrt{n})} then P(G)>C ; a constant proportion of nodes contain truthful information in expectation. V Remarks While in both the fully-connected and ring networks the proportion of truthful nodes decreases with n , the rate of decrease is exponentially slower for the fully-connected network. In both networks, the hopcount scales at the same rate as the first-passage time, hence this is expected. We leave as an interesting open problem the question of showing that all gossip networks have hopcount and first-passage time scaling at the same rate. We also note that our results match the predictions made in simulations performed by [ 9 ] , where they show that decreasing p increases the proportion of vertices holding misinformation. However, in their simulations, even for large p some positive fraction of the vertices hold truthful information. We believe this is because in their model, stale packets with the same version age can interact and convert false packets to true packets as “truth prevails” there. Therefore, as long as the rate from the source is slow enough, and the network facilitates information flow, some proportion of the vertices will contain truthful information. It would be interesting to study their more optimistic model in the first-passage framework, but the interactions of packets on the boundary of the first-passage ball make analysis more delicate.