2591 - Supporting High-Precision Stereotactic Radiosurgery: A Multi-Institution Evaluation of a Deep Learning Substructure Model for Brain Organ at Risk Segmentation in MRI
Presenter(s)
E. Szabo1, E. K. Kiss2, A. Z. Kekesi2, B. Kolozsvari2, Z. Karancsi2, B. Deak-Karancsi2, C. Glide-Hurst3, A. M. Baschnagel4, Y. Yan4, R. A. B. Bayliss4, T. M. Seibert5, R. Manger5, D. Do5, C. C. Conlin5, M. Mian6, and L. Rusko2; 1GE Healthcare, Szeged, Hungary, 2GE HealthCare, Budapest, Hungary, 3Department of Human Oncology and Medical Physics, University of Wisconsin–Madison, Madison, WI, 4Department of Human Oncology, University of Wisconsin School of Medicine and Public Health, Madison, WI, 5Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, CA, 6GE Healthcare, Wauwatosa, WI
Purpose/Objective(s): Stereotactic radiosurgery (SRS) delivers very high radiation doses with steep dose gradients, thus accurate organ at risk (OAR) delineation is essential. Recent evidence suggests that dose to brain substructures may relate to critical neurologic functions. To support consistent and precise delineation, we developed a deep learning brain substructure model and evaluated its performance on multi-institutional datasets to ensure robustness across scanners, imaging protocols (without (T1) or with (T1C) contrast), and patient populations.
Materials/Methods: A set of 60 cases (3D Ax T1 BRAVO) were collected at Institution 1, 50 (35 T1C) were used for training, 10 (6 T1C) for testing. The mean FOV (250 mm), slice coverage (170 mm), and pixel size (0.5 mm) were fixed for all scans, but the slice thickness was smaller (0.6/1.2 mm) for T1C scans. Another set of 10 (4 T1C) test cases (3D Ax T1 MP-RAGE) were collected at Institution 2. The mean FOV (256 mm), slice coverage (256 mm), and slice thickness (1 mm) were fixed for all scans, but the pixel size was smaller (0.5/1 mm) for T1C scans. Ground truth contours for 28 organs and substructures including deep gray matter nuclei, and ventricular system were delineated based on radiation therapy guidelines. Using the 50 annotated cases, a multi-class, 3D nnU-Net was trained, and evaluated with DICE similarity. Two-sample T-test was applied to show significant difference.
Results: Table 1 presents the overall and organ specific mean DICE measured in 4 subsets of the total 20 test cases. The results show that the model performed equally on T1 and T1C scans, however, it had significantly (p<0.01) lower accuracy on independent (Institution 2) test data, though the overall difference was modest (84.8% vs. 87.6%). Longer scan extent contributed to the uncertainty in Institution 2 as result of which the model overestimated mainly the brain and the cerebellum in the inferior part that was not covered during training with Institution 1 scans.
Table 1: Model accuracy on different datasetsConclusion: Deep learning-based brain segmentation can achieve high accuracy across standard MR imaging parameters and contrast conditions. Modest performance reduction observed on independent test data highlights the need for expanding training data diversity to further improve generalizability and support more reliable OAR delineation in SRS.
| Organ | Institution 1 | Institution 2 | T1 | T1C |
| Brainstem | 95.3 | 93.0 | 94.2 | 94.0 |
| Chiasma | 77.9 | 80.3 | 77.3 | 80.8 |
| Eye L/R | 95.6 | 93.5 | 93.4 | 95.7 |
| Lacrimal gland L/R | 79.5 | 70.9 | 73.4 | 77.0 |
| Lens L/R | 86.8 | 87.2 | 89.6 | 84.5 |
| Optic nerve L/R | 79.5 | 76.9 | 79.6 | 76.9 |
| Pituitary gland | 79.1 | 73.0 | 72.8 | 79.3 |
| Spinal cord | 85.3 | 81.9 | 85.2 | 82.0 |
| Brain | 98.5 | 96.0 | 97.5 | 97.1 |
| Cerebellum | 95.7 | 93.8 | 94.5 | 95.0 |
| Hippocampus L/R | 87.1 | 84.7 | 86.0 | 85.8 |
| Pallidum L/R | 87.5 | 83.7 | 86.4 | 84.9 |
| Putamen L/R | 91.2 | 88.8 | 91.1 | 88.9 |
| Thalamus L/R | 91.1 | 90.4 | 91.9 | 89.6 |
| Ventricle 3rd | 90.1 | 83.9 | 87.6 | 86.4 |
| Ventricle 4th | 89.3 | 80.9 | 85.2 | 85.0 |
| Ventricle lat. inf. L/R | 76.8 | 77.0 | 75.5 | 78.3 |
| Ventricle lat. L/R | 95.8 | 93.1 | 94.5 | 94.4 |
| All | 87.6 | 84.8 | 86.3 | 86.1 |