Comparative Evaluation of Vision Transformer Architectures for Dental Implant Type Classification in Panoramic Radiographs
Pdf File

Keywords

Dental implant classification
Panoramic radiography
Vision Transformer
Transfer learning
Deep learning
Dental artificial intelligence

How to Cite

Comparative Evaluation of Vision Transformer Architectures for Dental Implant Type Classification in Panoramic Radiographs. (2026). Artificial Intelligence in Applied Sciences, 2(1), 56-61. https://doi.org/10.69882/adba.ai.2026018

Abstract

Accurate identification of dental implant types on panoramic radiographs can support treatment planning, longitudinal follow-up, and prosthetic decision-making when clinical records are incomplete or unavailable. This study comparatively evaluated transformer-based deep learning architectures for the automated classification of endosteal, subperiosteal, transosteal, and zygomatic implants on panoramic dental radiographs. A dataset comprising 5,107 images was divided into training (4,084 images), validation (510 images), and independent test (513 images) subsets. ViT-Base, Swin-Base, PiT-B, DeiT-Base, and ConViT-Base were trained under an identical experimental protocol and compared in terms of accuracy, precision, recall, F1-score, parameter count, and computational complexity. PiT-B achieved the strongest overall performance, with an accuracy of 0.9864, precision of 0.9714, recall of 0.9821, and an F1-score of 0.9764. Confusion-matrix and receiver operating characteristic analyses showed complete test-set classification of the zygomatic and subperiosteal categories, whereas the limited errors were concentrated between endosteal and transosteal implants and between transosteal and subperiosteal implants. PiT-B also exhibited the lowest computational burden among the evaluated architectures, with 72.74 million parameters and 211.067 GFLOPs. These findings indicate that transformer-based models can learn highly discriminative representations of implant morphology and anatomical context from panoramic radiographs, with PiT-B providing the most favorable balance between predictive performance and computational efficiency.

Pdf File

References

Alghamdi, H. S. and J. A. Jansen, 2020 The development and future of dental implants. Dental Materials Journal 39: 167–172.

D’Ascoli, S., H. Touvron, M. L. Leavitt, A. S. Morcos, G. Biroli, et al., 2021 Convit: Improving vision transformers with soft convolutional inductive biases. In Proceedings of the 38th International Conference on Machine Learning, Proceedings of Machine Learning Research, pp. 2286–2296.

Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, et al., 2021 An image is worth 16x16 words: Transformers for image recognition at scale. In International Conference on Learning Representations.

Fawcett, T., 2006 An introduction to roc analysis. Pattern Recognition Letters 27: 861–874.

Felek, T., H. Tercanlı, and R. Ş. Gök, 2025 Evaluating vision transformers and convolutional neural networks in the context of dental image processing: a systematic review. BMC Oral Health 25: 1626.

Guo, C., G. Pleiss, Y. Sun, and K. Q. Weinberger, 2017 On calibration of modern neural networks. In Proceedings of the 34th International Conference on Machine Learning, Proceedings of Machine Learning Research, pp. 1321–1330.

Hand, D. J. and R. J. Till, 2001 A simple generalisation of the area under the roc curve for multiple class classification problems. Machine Learning 45: 171–186.

Heo, B., S. Yun, D. Han, S. Chun, J. Choe, et al., 2021 Rethinking spatial dimensions of vision transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 11936–11945.

Howe, M. S., W. Keys, and D. Richards, 2019 Long-term (10-year) dental implant survival: A systematic review and sensitivity meta-analysis. Journal of Dentistry 84: 9–21.

Hung, K. F., C. Montalvao, R. Tanaka, T. Kawai, and M. M. Bornstein, 2020 The use and performance of artificial intelligence applications in dental and maxillofacial radiology: A systematic review. Dentomaxillofacial Radiology 49: 20190107.

Khairkar, A., 2024 Dental implant dataset. V1.

Kim, J. E., N. E. Nam, J. S. Shim, Y. H. Jung, B. H. Cho, et al., 2020 Transfer learning via deep neural networks for implant fixture system classification using periapical radiographs. Journal of Clinical Medicine 9: 1117.

Kurtulus, I. L., M. Lubbad, O. M. Durmaz Yilmaz, K. Kilic, D. Karaboga, et al., 2024 A robust deep learning model for the classification of dental implant brands. Journal of Stomatology, Oral and Maxillofacial Surgery 125: 101818.

Lee, J.-H. and S.-N. Jeong, 2020 Efficacy of deep convolutional neural network algorithm for the identification and classification of dental implant systems, using panoramic and periapical radiographs: A pilot study. Medicine 99: e20787.

Litjens, G., T. Kooi, B. E. Bejnordi, A. A. A. Setio, F. Ciompi, et al., 2017 A survey on deep learning in medical image analysis. Medical Image Analysis 42: 60–88.

Liu, Z., Y. Lin, Y. Cao, H. Hu, Y. Wei, et al., 2021 Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9992–10002.

Park, W., J. K. Huh, and J. H. Lee, 2023 Automated deep learning for classification of dental implant radiographs using a large multi-center dataset. Scientific Reports 13: 4862.

Perschbacher, S., 2012 Interpretation of panoramic radiographs. Australian Dental Journal 57: 40–45.

Rushton, V. E. and K. Horner, 1996 The use of panoramic radiology in dental practice. Journal of Dentistry 24: 185–201.

Santos-Melo, T., G. C. da Silva, L. E. Serrano, D. A. B. Dos Santos, M. K. S. Teixeira, et al., 2026 Classification of dental implants using supervised deep learning from dental radiographs: A scoping review. Imaging Science in Dentistry 56: 120.

Schwendicke, F., W. Samek, and J. Krois, 2020 Artificial intelligence in dentistry: Chances and challenges. Journal of Dental Research 99: 769–774.

Shamshad, F., S. Khan, S. W. Zamir, M. H. Khan, M. Hayat, et al., 2023 Transformers in medical imaging: A survey. Medical Image Analysis 88: 102802.

Shin, H.-C., H. R. Roth, M. Gao, L. Lu, Z. Xu, et al., 2016 Deep convolutional neural networks for computer-aided detection: Cnn architectures, dataset characteristics and transfer learning. IEEE Transactions on Medical Imaging 35: 1285–1298.

Shorten, C. and T. M. Khoshgoftaar, 2019 A survey on image data augmentation for deep learning. Journal of Big Data 6: 60.

Sokolova, M. and G. Lapalme, 2009 A systematic analysis of performance measures for classification tasks. Information Processing and Management 45: 427–437.

Sukegawa, S., K. Yoshii, T. Hara, T. Matsuyama, K. Yamashita, et al., 2021 Multi-task deep learning model for classification of dental implant brand and treatment stage using dental panoramic radiograph images. Biomolecules 11: 815.

Sukegawa, S., K. Yoshii, T. Hara, K. Yamashita, K. Nakano, et al., 2020 Deep neural networks for dental implant system classification. Biomolecules 10: 984.

Takahashi, T., K. Nozaki, T. Gonda, T. Mameno, M. Wada, et al., 2020 Identification of dental implants using deep learning: Pilot study. International Journal of Implant Dentistry 6: 53.

Tejani, A. S., M. E. Klontzas, A. A. Gatti, J. T. Mongan, L. Moy, et al., 2024 Checklist for artificial intelligence in medical imaging (claim): 2024 update. Radiology: Artificial Intelligence 6: e240300.

Tjoa, E. and C. Guan, 2021 A survey on explainable artificial intelligence (xai): Toward medical xai. IEEE Transactions on Neural Networks and Learning Systems 32: 4793–4813.

Touvron, H., M. Cord, M. Douze, F. Massa, A. Sablayrolles, et al., 2021 Training data-efficient image transformers and distillation through attention. In Proceedings of the 38th International Conference on Machine Learning, Proceedings of Machine Learning Research, pp. 10347–10357.

Tronje, G., U. Welander, W. D. McDavid, and C. R. Morris, 1981 Image distortion in rotational panoramic radiography. iv. object morphology; outer contours. Acta Radiologica: Diagnosis 22: 689–696.

Walter, R. D., S. Wiafe, U. Oyoyo, and M. S. Suprono, 2021 A pilot survey on the prevalence of clinical challenges to identify and restore unknown dental implants. Journal of Oral Implantology 47: 63–67.

Wang, L. and Z. Li, 2026 Transformer-based intelligent detection model for early dental caries in panoramic radiographs. Scientific Reports.

Zhang, X., E. Guo, X. Liu, H. Zhao, J. Yang, et al., 2025 Enhancing furcation involvement classification on panoramic radiographs with vision transformers. BMC Oral Health 25: 153.

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.