Aly Khalifa and Yuan Gao are awarded CIHR CGS-D fellowships for 3-years!
Measuring the Generalizability of AI Models in Healthcare
Unstructured datasets, including medical imaging, electrocardiograms, and natural language data, are gaining attention with advancements in deep convolutional neural networks and large language models. However, estimating the generalizability of these models to new healthcare settings without extensive validation on external data remains challenging. We propose an open source, bias-corrected external accuracy estimate that better estimates external accuracy to within 4% on average by measuring and calibrating for bias induced shortcut learning.