Navigating Data Acquisition and Data Quality Validation of Large Databases: Practical Lessons
Nedeene Hudema, Amanda Hutton, Nirmal Sidhu, Xinya Lu, Xue Feng · 2024
Read Navigating Data Acquisition and Data Quality Validation of Large Databases: Practical Lessons by Nedeene Hudema, Amanda Hutton, Nirmal Sidhu, Xinya Lu, Xue Feng (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13177453.txt.
Description
Nedeene Hudema and co-authors share practical lessons on getting and checking large databases. Their 2024 paper comes from a Canadian provincial group with more than twenty years of work with large data sets. Acquiring data can frustrate even seasoned teams, they note. Readying data takes time that is often forgotten. Yet the work is key to sound research.
Their current project adds new data to existing files, across four data sets in all. The deal and variable list were prepared in 2018. Signatures came only in 2023, and work goes on. Many checks are needed to ensure data are of high quality and that limits are known. Probing errors and setting how much error is allowed are central. So are ties with data holders and clear talk.
Catalog record
| CREATOR | Nedeene Hudema, Amanda Hutton, Nirmal Sidhu, Xinya Lu, Xue Feng |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 2 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |