In Journal of the American Medical Informatics Association : JAMIA
OBJECTIVE : Lack of representative COVID-19 data is a bottleneck for reliable and generalizable machine learning. Data sharing is insufficient without data quality, where source variability plays an important role. We showcase and discuss potential biases from data source variability for COVID-19 machine learning.
MATERIALS AND METHODS : We used the publicly available nCov2019 dataset, including patient level data from several countries. We aimed to the discovery and classification of severity subgroups using symptoms and comorbidities.
RESULTS : Cases from the two countries with the highest prevalence were divided into separate subgroups with distinct severity manifestations. This variability can reduce the representativeness of training data with respect the model target populations and increase model complexity at risk of overfitting.
CONCLUSION : Data source variability is a potential contributor to bias in distributed research networks. We call for systematic assessment and reporting of data source variability and data quality in COVID-19 data sharing, as key information for reliable and generalizable machine learning.
Sáez Carlos, Romero Nekane, Conejero J Alberto, García-Gómez Juan M
COVID-19, biases, data quality, data sharing, dataset shift, distributed research networks, heterogeneity, machine learning, multi site data, variability