A UNIFIED FRAMEWORK WITH SPATIO-TEMPORAL AND MULTI-SCALE FEATURE LEARNING FOR 3D LUNG NODULE DETECTION

Pham Anh Duc1,
1 Trường Đại Học Hồng Đức

Main Article Content

Abstract

Lung nodule detection in CT scans remains a challenging computer vision task due to structural ambiguity and limited annotations. This paper introduces I3DR-Net, a one-stage 3D deep learning framework for joint detection and classification. The model combines a pre-trained I3D backbone for spatio-temporal feature extraction with a modified FPN for enhanced multi-scale representation. Experimental results show competitive performance (≈70–73% accuracy), demonstrating that transfer learning and improved pyramid design effectively enhance detection robustness for computer-aided diagnosis applications.

Article Details

References

[1] National Lung Screening Trial Research Team (2011), Reduced lung-cancer mortality with low-dose computed tomographic screening, New England Journal of Medicine, 365(5), 395-409.
[2] Zhu, W., Liu, C., Fan, W., & Xie, X. (2018), Deeplung: Deep 3d dual path nets for automated pulmonary nodule detection and classification, IEEE winter Conference on Applications of Computer Vision (WACV) (pp. 673-681).
[3] Greenspan, H., Van Ginneken, B., & Summers, R. M. (2016), Guest editorial deep learning in medical imaging: Overview and future promise of an exciting new technique, IEEE transactions on medical imaging, 35(5), 1153-1159.
[4] Ardila, D., Kiraly, A. P., Bharadwaj, S., Choi, B., Reicher, J. J., Peng, L., ... & Shetty, S. (2019). End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography, Nature Medicine, 25(6), 954-961.
[5] Shen, W., Zhou, M., Yang, F., Yang, C., & Tian, J. (2015), Multi-scale convolutional neural networks for lung nodule classification, In International Conference on Information Processing in Medical Imaging (pp.588-599).
[6] Ciompi, F., de Hoop, B., van Riel, S. J., Chung, K., Scholten, E. T., Oudkerk, M., ... & Van Ginneken, B. (2015), Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box, Medical Image Analysis, 26(1), 195-202.
[7] Carreira, J., & Zisserman, A. (2017), Quo vadis, action recognition? a new model and the kinetics dataset, In IEEE Conference on Computer Vision and Pattern Recognition (pp. 6299-6308).
[8] Chen, S., Ma, K., & Zheng, Y. (2019), Med3d: Transfer learning for 3D medical image analysis. arXiv preprint arXiv:1904.00625.
[9] Hatamizadeh, A., Tang, Y., Nath, V., Yang, D., Myronenko, A., Landman, B., ... & Xu, D. (2022), Unetr: Transformers for 3d medical image segmentation, In Proceedings of the IEEE/CVF winter Conference on Applications of Computer Vision (pp. 574-584).
[10] Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D. (2019), Self-supervised learning for medical image analysis using image context restoration, Medical Image Analysis, 58, 101539.
[11] Lin, T. Y., Dollár, P., Girshick, R., He, K., Hariharan, B., & Belongie, S. (2017), Feature pyramid networks for object detection, In IEEE Conference on Computer Vision and Pattern Recognition (pp. 2117-2125).
[12] Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014), Rich feature hierarchies for accurate object detection and semantic segmentation, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 580-587).
[13] Tan, M., Pang, R., & Le, Q. V. (2020), Efficientdet: Scalable and efficient object detection. In the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 10781-10790).
[14] Lin, T. Y., Goyal, P., Girshick, R., He, K., & Dollár, P. (2017), Focal loss for dense object detection, In the IEEE International Conference on Computer Vision (pp. 2980-2988).
[15] Tan, M., & Le, Q. (2019), Efficientnet: Rethinking model scaling for convolutional neural networks, In International Conference on Machine Learning (pp. 6105-6114). PMLR.
[16] Armato III, S. G., McLennan, G., Bidaut, L., McNitt‐Gray, M. F., Meyer, C. R., Reeves, A. P., ... & Clarke, L. P. (2011), The lung image database consortium (LIDC) and image database resource initiative (IDRI): A completed reference database of lung nodules on CT scans, Medical Physics, 38(2), 915-931.
[17] Dou, Q., Chen, H., Jin, Y., Lin, H., Qin, J., & Heng, P. A. (2017), Automated pulmonary nodule detection via 3D convnets with online sample filtering and hybrid-loss residual learning, In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 630-638). Cham: Springer International Publishing.
[18] Hussein, S., Cao, K., Song, Q., & Bagci, U. (2017), Risk stratification of lung nodules using 3D CNN-based multi-task learning, In International Conference on Information Processing in Medical Maging (pp. 249-260). Cham: Springer International Publishing.
[19] Jaeger, P. F., Kohl, S. A., Bickelhaupt, S., Isensee, F., Kuder, T. A., Schlemmer, H. P., & Maier-Hein, K. H. (2020), Retina U-Net: Embarrassingly simple exploitation of segmentation supervision for medical object detection. In Machine learning for health workshop (pp. 171-183). PMLR.
[20] Nasution, A., et al. (2020). Lung nodule detection and classification from Thorax CT-scan using RetinaNet with transfer learning. Journal of King Saud University – Computer and Information Sciences.