Applying the maximum entropy principle to neural networks enhances multi-species distribution models
Maxime Ryckewaert, Diego Marcos, Christophe Botella, Maximilien Servajean, Pierre Bonnet, Alexis Joly · 2024
Read Applying the maximum entropy principle to neural networks enhances multi-species distribution models by Maxime Ryckewaert, Diego Marcos, Christophe Botella, Maximilien Servajean, Pierre Bonnet, Alexis Joly (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-19217.txt.
Introduction
Maxime Ryckewaert and co-authors (2024) merge two traditions for mapping where species live: the maximum entropy principle and neural networks. Citizen science has flooded biodiversity databases with presence-only records: sightings saying where a species was seen, never where it was absent. Such data are precious but biased, since observers go where they please. Maxent handles them by choosing the spread-out distribution consistent with environmental features. Neural networks, in contrast, learn features from raw inputs.
Their networks follow the maximum entropy principle, so the model keeps Maxent's principled treatment of presence-only data while gaining deep learning's feature extraction. Many species are modeled in one multi-species framework, letting rare species borrow strength from common ones. This aims at distribution maps that are more accurate and more honest about bias, a combination conservation planning depends on for choosing which habitats to protect.
Catalog record
| CREATOR | Maxime Ryckewaert, Diego Marcos, Christophe Botella, Maximilien Servajean, Pierre Bonnet, Alexis Joly |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 97 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-19217
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Applying the maximum entropy principle to neural networks enhances multi-species distribution models Maxime Ryckewaert, Diego Marcos, Christophe Botella, Maximilien Servajean, Pierre Bonnet, Alexis Joly Abstract The rapid expansion of citizen science initiatives has led to a significant growth of biodiversity databases, and particularly presence-only (PO) observations. PO data are invaluable for understanding species distributions and their dynamics, but their use in a Species Distribution Model (SDM) is curtailed by sampling biases and the lack of information on absences. Poisson point processes are widely used for SDMs, with Maxent being one of the most popular methods. Maxent maximises the entropy of a probability distribution across sites as a function of predefined transformations of variables, called features. In contrast, neural networks and deep learning have emerged as a promising technique for automatic feature extraction from complex input variables. Arbitrarily complex transformations of input variables can be learned from the data efficiently through backpropagation and stochastic gradient descent (SGD). Yet, deep learning was mainly developed for classification problems, and learning robust features and species abundances across space while properly correcting for sampling biases has remained a challenge so far. In this paper, we propose DeepMaxent, which harnesses neural networks to automatically learn shared features among species, using the maximum entropy principle. To do so, it employs a normalised Poisson loss where for each species, presence probabilities across sites are modelled by a neural network. We evaluate DeepMaxent on a benchmark dataset known for its spatial sampling biases, using PO data for calibration and presence-absence (PA) data for validation across six regions with different biological groups and covariates. Our results indicate that DeepMaxent performs better than Maxent and other leading SDMs across all regions and taxonomic groups. The method performs particularly well in regions of uneven sampling, demonstrating substantial potential to increase SDM performances. The method opens the possibility to learn more robust features predicting simultaneously many species to arbitrary large datasets without increased memory requirements. The model likelihood, arising from a Poisson process, makes the method compatible with the integration of more standardised types of data to further increase sampling bias correction. In particular, our approach yields more accurate predictions than traditional single-species models, which opens up new possibilities for methodological enhancement. A Preprint Keywords species distribution modelling \cdot neural networks \cdot maximum entropy principle \cdot deepmaxent \cdot presence-only data \cdot sampling bias \cdot target-group background 1 Introduction In recent years, the rapid growth of citizen science projects has contributed significantly to the expansion of biodiversity databases. Among the different types of data collected, a large amount consists of presence-only (PO) observations ( Callaghan et al., 2022 ; Bonnet et al., 2020 ) . PO records have been instrumental in improving our understanding of species distributions and helping inform conservation strategies ( Carvalho et al., 2011 ; Guisan et al., 2013 ) . Maxent ( Phillips et al., 2006 ) is one of the most widely used and effective methods for Species Distribution Model (SDM) based on PO data ( Warren and Seifert, 2011 ; Elith et al., 2006 ; Elith et al., 2020 ; Valavi et al., 2022 ) . Maxent generates a relative probability of species occurrence across space as a function of environmental variables. This function is applied to various predefined transformations of input environmental variables. Maxent’s output can be interpreted as the probability of observing the species in each site relative to the other sites and knowing that it has been observed once. This probability estimate of Maxent is actually equivalent to the one that is derived from a related Poisson regression or a spatially discretized Poisson process ( Renner and Warton, 2013 ) . Maxent’s name arises from the fact that its formulation leads to finding, among all solutions that fit the PO training data, the one that maximizes the entropy of this spatial probability distribution. This behaviour, in which spatially smooth solutions are favoured for regions with sparse PO data, participated to Maxent’s robust performances against many other SDM methods under such data regimes and in diverse contexts ( Elith et al., 2006 ; Valavi et al., 2022 ) . Yet, a major issue when calibrating SDMs using PO data is spatial sampling bias, which leads to clustering of PO records in areas with high sampling effort, typically of higher accessibility or greater human activity. Such bias can distort SDM outputs, leading to inaccurate species distribution estimates ( Yackulic et al., 2013 ; Fithian et al., 2015 ; Phillips et al., 2009 ) . A wide range of strategies have been proposed to correct for spatial sampling bias in SDMs, including methods based on background points manipulation, spatial filtering of records or explicit bias modelling ( Phillips et al., 2009 ; Boria et al., 2014 ; Fithian et al., 2015 ) . Specifically for Maxent, ( Phillips et al., 2009 ) proposed the Target-Group Background correction (hereafter TGB), which restricts the background sites used by Maxent to those where at least one species was observed among a Target Group of species. This Target Group should contain species being sampled along with the focal one. Phillips et al. (2009) evaluated the TGB correction with Maxent on a large standardized dataset. This correction was also robust in later studies ( Fourcade et al., 2014 ) . Besides its simplicity and empirical robustness, the TGB correction also comes with theoretical guarantees. Indeed, with the assumptions that all species occurrences are drawn from independent Poisson point processes thinned by a same sampling bias, as it is often assumed ( Fithian et al., 2015 ; Botella et al., 2021 ) , and that the TG species cumulated intensities are constant, TGB yields an unbiased estimate of the species relative intensity across sites ( Botella et al., 2020 ) , which then applies within Maxent ( Renner and Warton, 2013 ) . More recent studies have proposed other bias corrections in the context of deep learning based SDMs, by adapting the loss function to weight presences and background points ( Zbinden et al., 2024 ; Gillespie et al., 2024 ) . Feature design, i.e. the definition of pre-defined transformations (features) of the input variables, is an important step in traditional SDMs, including Maxent ( Phillips and Dudík, 2008 ; Komori et al., 2024 ) . Deep learning is a family of data-driven methods that removes the need for feature design by allowing the model to learn arbitrary non-linear features from the data using neural networks, backpropagation and stochastic gradient descent ( Goodfellow et al., 2016 ; Hornik et al., 1989 ; LeCun et al., 1989 ) . While other approaches are also capable of learning non-linear relationships, such as Generalized Additive Models (GAM), Multivariate Adaptive Regression Splines (MARS) or Boosted Regression Trees (BRT), and have been used for SDMs ( Phillips et al., 2009 ) , deep learning methods offer a broader and more flexible class of models that can automatically learn rich, hierarchical features while integrating efficient regularisation strategies to mitigate overfitting ( LeCun et al., 2015 ; Schmidhuber, 2015 ) . Additionally, like other multi-species SDMs do, although typically restricted to the linear case ( Ovaskainen et al., 2017b ; van der Veen et al., 2023 ) . Deep learning based