Evaluation & Results
The evaluation will be performed using T1-weighted MR images with manual segmentations of WM, GM and CSF. Automatic segmentations will be evaluated against this manual set – a reference standard, by using various measurements, such as Dice Coefficient (DC), Modified Hausdorff Distance (MHD) and Average Surface Distance (ASD).
We will only provide a rank list for each metric. We will not provide an overall rank list since we think “Everyone is a winner.”
—== Testing Results (24 months) ==—
RANK | TEAM | SUBMISSION DATE | DSC [CSF] | MHD [CSF] | ASD [CSF] | DSC [GM] | MHD [GM] | ASD [GM] | DSC [WM] | MHD [WM] | ASD [WM] | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
KispiToSee | 07/11/2022 | 0.935 | 7.091 | 0.093 | 0.935 | 5.998 | 0.136 | 0.934 | 5.929 | 0.132 | Details | |||
IBIME | 07/18/2022 | 0.935 | 5.948 | 0.091 | 0.935 | 5.511 | 0.133 | 0.933 | 5.683 | 0.132 | Details | |||
DIKU-SMM | 07/22/2022 | 0.909 | 8.390 | 0.136 | 0.916 | 5.864 | 0.175 | 0.916 | 6.466 | 0.167 | Details | |||
Dolphins | 07/29/2022 | 0.933 | 6.927 | 0.096 | 0.934 | 6.121 | 0.138 | 0.933 | 5.979 | 0.133 | Details | |||
nic_vicorob | 07/31/2022 | 0.856 | 7.326 | 0.212 | 0.854 | 5.862 | 0.262 | 0.844 | 5.616 | 0.286 | Details | |||
—== Testing Results (6 months) ==—
RANK | TEAM | SUBMISSION DATE | DSC [CSF] | MHD [CSF] | ASD [CSF] | DSC [GM] | MHD [GM] | ASD [GM] | DSC [WM] | MHD [WM] | ASD [WM] | |||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
KispiToSee | 07/11/2022 | 0.766 | 9.548 | 0.422 | 0.807 | 4.606 | 0.404 | 0.794 | 6.932 | 0.475 | Details | |||
IBIME | 07/18/2022 | 0.767 | 8.502 | 0.401 | 0.807 | 4.431 | 0.384 | 0.803 | 6.487 | 0.454 | Details | |||
DIKU-SMM | 07/22/2022 | 0.740 | 8.634 | 0.423 | 0.805 | 5.069 | 0.394 | 0.791 | 7.016 | 0.473 | Details | |||
Dolphins | 07/29/2022 | 0.761 | 9.328 | 0.431 | 0.796 | 4.452 | 0.405 | 0.782 | 6.932 | 0.503 | Details | |||
nic_vicorob | 07/31/2022 | 0.712 | 10.931 | 0.473 | 0.746 | 5.189 | 0.442 | 0.722 | 7.061 | 0.617 | Details | |||