Result - nntrongnghia/TDSI21-Shoulder-Muscle-Segmentation Wiki

Notes

Each model is trained with 5 folds. Here are the dimensions of our NIfTI images :

Image dimensions 384 px 384 px 180 px
Image spacing 0.6875 mm 0.6875 mm 0.6667 mm

We are working with isotropic voxel dimensions

The different metrics are calculated using a tool coming along the nnUNet framework based upon medpy.

Test evaluation

Dice Score

Model - Class 1 2 3 4 5
3D cascade 0.932 0.888 0.911 0.778 0.949
3D fullres 0.942 0.911 0.922 0.779 0.961
2D 0.909 0.887 0.881 0.705 0.924
2D - RMS prop 0.906 0.881 0.878 0.711 0.919
TransUNet2D 0.909 0.882 0.879 0.692 0.921
TransUNet3D 0.932 0.893 0.912 0.774 0.946

Hausdorff Distance [mm] (100 and 95 percentile)

Model - Class 1 2 3 4 5
3D cascade 11.35 | 2.56 9.64 | 3.39 14.41 | 4.08 11.78 | 5.94 14.85 | 2.31
3D fullres 09.17 | 1.93 8.07 | 2.47 10.02 | 3.54 12.83 | 06.68 08.93 | 01.63
2D 11.19 | 3.00 11.00 | 2.97 21.60 | 5.06 14.68 | 8.11 21.34 | 3.41
2D - RMS prop 19.59 | 3.29 13.27 | 3.75 28.12 | 6.82 16.62 | 8.60 54.40 | 5.56
TransUNet2D 14.98 | 3.42 8.25 | 3.21 15.70 | 5.61 16.53 | 8.72 20.42 | 3.57
TransUNet3D 12.23 | 2.61 9.78 | 3.42 14.39 | 4.08 14.45 | 7.31 14.59 | 2.41

Ensemble on validation

model class1 class2 class3 class4 class5 average
2d 0.8962 0.8500 0.8839 0.7623 0.9250 0.8635
3d_fullres 0.9395 0.8843 0.9279 0.8091 0.9567 0.9035
3d_cascade_fullres 0.9107 0.8515 0.9095 0.7623 0.9461 0.8760
TransUNet2D 0.9077 0.8433 0.9012 0.7382 0.9389 0.8658
TransUNet3D 0.9117 0.8563 0.9094 0.7661 0.9466 0.8780
2d--3d_fullres 0.9244 0.8712 0.9114 0.7938 0.9458 0.8893
2d--3d_cascade_fullres 0.9189 0.8663 0.9085 0.7843 0.9426 0.8841
2d--TransUNet2D 0.9116 0.8470 0.9042 0.7441 0.9416 0.8697
2d--TransUNet3D 0.9172 0.8613 0.9123 0.7719 0.9489 0.8823
3d_fullres--3d_cascade_fullres 0.9347 0.8805 0.9243 0.7964 0.9550 0.8982
3d_fullres--TransUNet2D 0.9140 0.8488 0.9055 0.7457 0.9437 0.8715
3d_fullres--TransUNet3D 0.9199 0.8637 0.9138 0.7751 0.9511 0.8847
3d_cascade_fullres--TransUNet2D 0.9099 0.8465 0.9035 0.7426 0.9412 0.8688
3d_cascade_fullres--TransUNet3D 0.9126 0.8573 0.9107 0.7682 0.9476 0.8793
TransUNet2D--TransUNet3D 0.9139 0.8572 0.9097 0.7620 0.9456 0.8777