Notes

Each model is trained with 5 folds. Here are the dimensions of our NIfTI images :

Image dimensions	384 px	384 px	180 px
Image spacing	0.6875 mm	0.6875 mm	0.6667 mm

We are working with isotropic voxel dimensions

The different metrics are calculated using a tool coming along the nnUNet framework based upon medpy.

Test evaluation

• Each cell contains 4 metrics: DSC | HD | HD95 | ASSD
  • DSC: Dice Score
  • HD: Hausdorff Distance [mm]
  • HD95: Hausdorff Distance 95 percentile [mm]

Dice Score

Model - Class	1	2	3	4	5
3D cascade	0.932	0.888	0.911	0.778	0.949
3D fullres	0.942	0.911	0.922	0.779	0.961
2D	0.909	0.887	0.881	0.705	0.924
2D - RMS prop	0.906	0.881	0.878	0.711	0.919
TransUNet2D	0.909	0.882	0.879	0.692	0.921
TransUNet3D	0.932	0.893	0.912	0.774	0.946

Hausdorff Distance [mm] (100 and 95 percentile)

Model - Class	1	2	3	4	5
3D cascade	11.35 | 2.56	9.64 | 3.39	14.41 | 4.08	11.78 | 5.94	14.85 | 2.31
3D fullres	09.17 | 1.93	8.07 | 2.47	10.02 | 3.54	12.83 | 06.68	08.93 | 01.63
2D	11.19 | 3.00	11.00 | 2.97	21.60 | 5.06	14.68 | 8.11	21.34 | 3.41
2D - RMS prop	19.59 | 3.29	13.27 | 3.75	28.12 | 6.82	16.62 | 8.60	54.40 | 5.56
TransUNet2D	14.98 | 3.42	8.25 | 3.21	15.70 | 5.61	16.53 | 8.72	20.42 | 3.57
TransUNet3D	12.23 | 2.61	9.78 | 3.42	14.39 | 4.08	14.45 | 7.31	14.59 | 2.41

Ensemble on validation

model	class1	class2	class3	class4	class5	average
2d	0.8962	0.8500	0.8839	0.7623	0.9250	0.8635
3d_fullres	0.9395	0.8843	0.9279	0.8091	0.9567	0.9035
3d_cascade_fullres	0.9107	0.8515	0.9095	0.7623	0.9461	0.8760
TransUNet2D	0.9077	0.8433	0.9012	0.7382	0.9389	0.8658
TransUNet3D	0.9117	0.8563	0.9094	0.7661	0.9466	0.8780
2d--3d_fullres	0.9244	0.8712	0.9114	0.7938	0.9458	0.8893
2d--3d_cascade_fullres	0.9189	0.8663	0.9085	0.7843	0.9426	0.8841
2d--TransUNet2D	0.9116	0.8470	0.9042	0.7441	0.9416	0.8697
2d--TransUNet3D	0.9172	0.8613	0.9123	0.7719	0.9489	0.8823
3d_fullres--3d_cascade_fullres	0.9347	0.8805	0.9243	0.7964	0.9550	0.8982
3d_fullres--TransUNet2D	0.9140	0.8488	0.9055	0.7457	0.9437	0.8715
3d_fullres--TransUNet3D	0.9199	0.8637	0.9138	0.7751	0.9511	0.8847
3d_cascade_fullres--TransUNet2D	0.9099	0.8465	0.9035	0.7426	0.9412	0.8688
3d_cascade_fullres--TransUNet3D	0.9126	0.8573	0.9107	0.7682	0.9476	0.8793
TransUNet2D--TransUNet3D	0.9139	0.8572	0.9097	0.7620	0.9456	0.8777