Darwin Core: an evolving community-developed biodiversity data standard.

Wieczorek J, Bloom D, Guralnick R, Blum S, Döring M, Giovanni R, Robertson T, Vieglais D. · 2012

Read Darwin Core: an evolving community-developed biodiversity data standard. by Wieczorek J, Bloom D, Guralnick R, Blum S, Döring M, Giovanni R, Robertson T, Vieglais D. (2012) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc3253084.txt.

Introduction

John Wieczorek and colleagues described Darwin Core, the community standard for sharing biodiversity data, in this 2012 paper in PLoS ONE. Records of species and specimens live in countless formats on incompatible systems, blocking any unified view of global biodiversity. A shared vocabulary of terms is the essential first step toward putting those records together.

The paper traces how the standard grew and is maintained by its community. It explains the categories of terms the standard defines, the difference between its simple and relational forms, and how people have put it to work. Case studies show extensions into new fields such as metagenomics and genetic resources. The authors close by showing how standardized records combine into knowledge products that map species distributions and track how they shift with environmental change.

Catalog record

CREATORWieczorek J, Bloom D, Guralnick R, Blum S, Döring M, Giovanni R, Robertson T, Vieglais D.
YEAR2012
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC3253084

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Darwin Core: An Evolving Community-Developed Biodiversity Data Standard By John Wieczorek, David Bloom, Robert Guralnick, Stan Blum, Markus Döring, Renato Giovanni, Tim Robertson, David Vieglais, Indra Neil Sarkar Published in: PLoS ONE DOI: 10.1371/journal.pone.0029715 ABSTRACT Biodiversity data derive from myriad sources stored in various formats on many distinct hardware and software platforms. An essential step towards understanding global patterns of biodiversity is to provide a standardized view of these heterogeneous data sources to improve interoperability. Fundamental to this advance are definitions of common terms. This paper describes the evolution and development of Darwin Core, a data standard for publishing and integrating biodiversity information. We focus on the categories of terms that define the standard, differences between simple and relational Darwin Core, how the standard has been implemented, and the community processes that are essential for maintenance and growth of the standard. We present case-study extensions of the Darwin Core into new research communities, including metagenomics and genetic resources. We close by showing how Darwin Core records are integrated to create new knowledge products documenting species distributions and changes due to environmental perturbations. INTRODUCTION Concern over global loss of biodiversity [1]–[5] has resulted in widespread demand for quick, reliable access to high-quality data on the spatio-temporal occurrence of species and their relation to the environment. Initial studies have documented the response by species to diverse agents of environmental change [6]–[7], including alarming vertebrate extinctions [8]. The signature of climate and other environmental changes and their effects on biodiversity is now well documented, and the evidence is overwhelming [9]–[14]. The documentation of global patterns of biodiversity change is an important first step toward a wise, sustainable policy of conservation and management in the face of a changing environment [15]. Such documentation has emerged as a global priority [16]–[18]. A major impediment to creating this documentation is the lack of easily accessible data at the scope and at the scales needed. Most studies documenting biodiversity changes are limited to a few well-studied species or to small temporal and spatial scales [19]. To make effective use of existing data for broad-scale analyses, community coordination is required. Information must be in digital form, accessible, discoverable, and integrated. Each of these criteria presents distinct challenges, some of which are unique to biodiversity-related data. A general challenge of biodiversity data that is shared with many other information domains is the lack of a coordinated publishing and integration system; data repositories tend to be isolated from each other in the absence of standards for data and communication protocols. Heterogeneity in meaning and content of terms creates obstacles in every aspect of data integration and use, including discovery, comparison, and quality assessment. Information communities, especially Library Information Sciences, have a long history of meeting these challenges through the creation and maintenance of standards. Darwin Core [20] is a standard for sharing data about biodiversity – the occurrence of life on earth and its associations with the environment. Darwin Core first emerged around 1999 as a loosely defined set of terms, and progressed through several iterations by different groups resulting in many different variants [21]. A formal set of terms and processes to manage changes were necessary to ensure utility for data integration. These aspects were developed within the Darwin Core Task Group [22] of the Taxonomic Databases Working Group (TDWG; www.tdwg.org) and ratified as a standard in October 2009. The philosophy for Darwin Core development has been to keep the standard as simple and open as possible and to develop terms only when there is shared demand. Darwin Core has a relatively long history of community development and is deployed widely [23]–[24]. For example, the Global Biodiversity Information Facility currently indexes approximately 300 million Darwin Core-formatted records published by more than 340 organizations in 43 countries. Increasingly, Darwin Core is being incorporated in communities beyond that of natural history collections (Figure 1), in which the standard has its roots. [Figure: Scope of Darwin Core: The Standard, deriving from previous standards work (e.g., Dublin Core), describes core sets (e.g., organismal, taxonomic) of characteristics of biodiversity, which are applicable in many biological domains (e.g., Paleontology, Botany).The standard can be extended to cover details of specific sub-disciplines (e.g., Genetic Resources, Herbaria, Taxonomic Checklists). Collaborations with other standards organizations (Genomics Standards Consortium (GSC) extend Darwin Core for new disciplines (Genomics, Metagenomics, Gene Marker Sequences.] In this paper, we describe the Darwin Core standard, its history, status, relationship to other standards, and prospects for further evolution. We also discuss how data sets are brought into Darwin Core compliance and how Darwin Core records are currently shared in a distributed publishing platform. We will demonstrate how Darwin Core continues to extend beyond its original formulation for natural history collections and will present, via use cases, how the standard continues to be reshaped and extended through new collaborations. We close by discussing innovative computational and informatics approaches to improving the scale, scope, and usability of networks that rely on Darwin Core compliant records. METHODS Defining Darwin Core The primary purpose of Darwin Core is to create a common language for sharing biodiversity data that is complementary to and reuses metadata standards from other domains wherever possible. Creating this common language has been particularly challenging, since natural history data curation practices have been developed locally and organically over hundreds of years, have varied between disciplines as well as institutions, and have had limited culture of data sharing. Fundamentally, Darwin Core is a set of terms having clearly defined semantics that can be understood by people or interpreted by machines, making it possible to determine appropriate uses of the data encoded therein. The terms are organized into nine categories (often referred to as “classes”, Figure 2), six of which cover broad aspects (event, location, geological context, occurrence, taxon, and identification) of the biodiversity domain. The remaining categories cover relationships to other resources, measurements, and generic information about records. Especially for the record level, Darwin Core recommends the use of a number of terms from Dublin Core (type, modified, language, rights, rightsHolder, accessRights, bibliographicCitation, references). The full set of current Darwin Core terms with their descriptions is available in the Quick Reference Guide (http://rs.tdwg.org/dwc/terms/). [Figure: Darwin Core Categories: Simple Darwin Core is comprised of seven categories of terms (green).This subset of Darwin Core terms represents descriptive data about organisms that can be represented in one file with one row per record and one column per term. Two additional categories (orange) expand Darwin Core with concepts that require a more complex data structure, such as multiple measurements from a single specimen, and cannot be represented easily in Simple Darwin Core.] The authoritative form of the Darwin Core is a downloadable archive [25], which contains various documents that are also available via web pages (http://rs.tdwg.org/dwc/). Key among the documents is http://rs.tdwg.org/dwc/rdf/dwctermshistory.rdf. This document includes descriptions of all terms, their histories, the relationships among them, and the relations between them and terms from other standards, all in a single file. The document is written in the Resource Description Framework (RDF) format, which is a standard for encoding the semantic structure of web-based resources. The same information is rendered in human-readable form on web pages (Quick Reference Guide, Type Vocabulary, Complete History, Mapping

Read the complete text