Navigating Data Acquisition and Data Quality Validation of Large Databases: Practical Lessons

Nedeene Hudema, Amanda Hutton, Nirmal Sidhu, Xinya Lu, Xue Feng · 2024

Read Navigating Data Acquisition and Data Quality Validation of Large Databases: Practical Lessons by Nedeene Hudema, Amanda Hutton, Nirmal Sidhu, Xinya Lu, Xue Feng (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13177453.txt.

Description

Nedeene Hudema and co-authors share practical lessons on getting and checking large databases. Their 2024 paper comes from a Canadian provincial group with more than twenty years of work with large data sets. Acquiring data can frustrate even seasoned teams, they note. Readying data takes time that is often forgotten. Yet the work is key to sound research.

Their current project adds new data to existing files, across four data sets in all. The deal and variable list were prepared in 2018. Signatures came only in 2023, and work goes on. Many checks are needed to ensure data are of high quality and that limits are known. Probing errors and setting how much error is allowed are central. So are ties with data holders and clear talk.

Catalog record

CREATORNedeene Hudema, Amanda Hutton, Nirmal Sidhu, Xinya Lu, Xue Feng
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE2 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13177453

Browse the full library · About the Tower of Babel