RESEARCH LAB 07 / MEDICINE × MACHINE LEARNING
How much should
we trust it?
Three tests on public medical datasets: how reliable are the probabilities, how wide should prediction intervals be, and what happens when inputs are missing?
Loading recorded experiment results…
METHODS & DOWNLOADS
Want to check the work?
Every split, parameter, prediction, and plot is available. No model was chosen or retuned from these test results. The numerical results shown here are from a completed run, not a live training animation.
Limits of these experiments.
The three cohorts contain 569, 442, and 299 records. Each result comes from one fixed split. Test-row intervals do not include uncertainty from retraining; randomly removed values do not reproduce the differences between hospitals. There is no prospective, external-site, or clinical-utility validation here.
By Brandon Frank Han-Chween Huang