Deep Learning for Assessing Severity of Cracks in Concrete Structures


  • Ahmed BaniMustafa Data Science & AI Dept., Isra University, Amman, Jordan
  • Rozan AbdelHalim Computer Science, Middle East University, Amman, Jordan
  • Olla Bulkrock Data Science Department, Princess Sumaya University for Technology, Amman, Jordan
  • Ahmad Al-Hmouz Computer Science Department, Middle East University, Amman, Jordan



Machine Learning, Deep Learning, Structural Health Monitoring (SHM), Concrete Structure, Civil Engineering


Most concrete structures suffer from degradation, where cracks are the most obvious visual sign. Concrete structures must be continuously monitored and assessed to avoid further deterioration, which may lead to a partial or total collapse. This is particularly important when constructing large structures such as towers, bridges, tunnels, and dams. This work aims to demonstrate and evaluate several deep learning approaches that can be used for monitoring and assessing the level of concrete degradation based on the cracks’ visual signs, which can then be embedded in Health Monitoring Systems (SHM). The experimental work in this study involves creating three models: Two were built using ResNet-50 and Xception transfer learning networks. In contrast, the third was built using a customized Sequential Convolutional Neural Network (SCNN) architecture. The dataset comprises 2,000 image samples sampled from a larger dataset that contains 56,000 images and which belong to four severity classes: minor, moderate, and severe, in addition to a normal class for no crack signs. The SCNN model achieved an accuracy of 90.2%, while the Xception and ResNet-50 models scored an accuracy of 86.3% and 70%, respectively.


Alpaydin, E., 2021. Machine learning. MIT Press.

Arbaoui, A., Ouahabi, A., Jacques, S., Hamiane, M., 2021. Concrete cracks detection and monitoring using deep learning-based multiresolution analysis. Electronics 10, 1772.

Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., Baskurt, A., . Sequential deep learning for human action recognition, in: International workshop on human behavior understanding, Springer. pp. 29-39.

Ballard, W., 2018. Hands-on Deep Learning for Images with TensorFlow: Build Intelligent Computer Vision Applications Using TensorFlow and Keras. Packt Publishing Ltd.

Bani Mustafa, A.M., 2012. A knowledge discovery and data mining process model for metabolomics. Thesis. Computer Science Department.

BaniMustafa, A., . Predicting software effort estimation using machine learning techniques, in: 2018 8th International Conference on Computer Science and Information Technology (CSIT), IEEE. pp. 249-256.

BaniMustafa, A., 2019. Enhancing learning from imbalanced classes via data preprocessing: A data-driven application in metabolomics data mining. The ISC International Journal of Information Security 11, 79-89.

Banimustafa, A., Hardy, N., 2020. A scientific knowledge discovery and data mining process model for metabolomics. IEEE Access 8, 209964-210005.

BaniMustafa, A.H., Hardy, N.W., 2012. A strategy for selecting data mining techniques in metabolomics. Springer. book section 18. pp. 317-333.

Billah, U.H., Tavakkoli, A., La, H.M., . Concrete crack pixel classification using an encoder decoder based deep learning architecture, in: International Symposium on Visual Computing, Springer. pp. 593-604.

Cha, Y.J., Choi, W., Büyüköztürk, O., 2017. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering 32, 361- 378.

Chollet, F., . Xception: Deep learning with depthwise separable convolutions, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 1251-1258.

Deng, J., Dong, W., Socher, R., Li, L.J., Kai, L., Li, F.F., . Imagenet: A large-scale hierarchical image database, in: IEEE Conference on Computer Vision and Pattern Recognition, pp. 248-255.

Dorafshan, S., Thomas, R.J., Maguire, M., 2018. Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete. Construction Building Materials 186, 1031-1045.

Dung, C.V., 2019. Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction 99, 52-58.

Farrar, C.R., Worden, K., 2007. An introduction to structural health monitoring. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 365, 303- 315.

Goodfellow, I., Bengio, Y., Courville, A., 2016. Deep learning. MIT press.

He, K., Zhang, X., Ren, S., Sun, J., 2016. Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778.

Jin, H., Ling, C.X., 2005. Using auc and accuracy in evaluating learning algorithms. IEEE Transactions on Knowledge and Data Engineering 17, 299-310.

LeCun, Y., Bengio, Y., Hinton, G., 2015. Deep learning. nature 521, 436-444.

Ling, C.X., Huang, J., Zhang, H., . Auc: A better measure than accuracy in comparing learning algorithms, in: Xiang, Y., Chaib-draa, B. (Eds.), Advances in Artificial Intelligence, Springer Berlin Heidelberg. pp. 329-341.

Park, R., Paulay, T., 1991. Reinforced concrete structures. John Wiley & Sons.

da Silva, W.R.L., de Lucena, D.S., . Concrete cracks detection based on deep learning image classification, in: Multidisciplinary digital publishing institute proceedings, p. 489.

Simonyan, K., Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint URL:

Speckmann, H., Henrich, R., . Structural health monitoring (shm)-overview on technologies under development, in: Proceedings of the 16th World Conference on NDT, pp. 1-8. URL:

Sumitro, S., Hida, K., Diouron, T.L., . Structural health monitoring paradigm for concrete structures, in: 28th Conference on Our World In Concrete & Structures, Singapore, 27-29 August 2003, Conference Documentation Volume XXII, Citeseer. pp. 525-532. URL:

Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A., a. Inception-v4, inception-resnet and the impact of residual connections on learning, in: Thirty-first AAAI conference on artificial intelligence, pp. 1-12.

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z., b. Rethinking the inception architecture for computer vision, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2818-2826.

Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S., 2008. Image-based crack detection for real concrete surfaces. IEEJ Transactions on Electrical and Electronic Engineering 3, 128-135.

Yamane, T., Chun, P.j., 2020. Crack detection from a concrete surface image based on semantic segmentation using deep learning. Journal of Advanced Concrete Technology 18, 493-504.

Yuen, K.V., Kuok, S.C., 2010. Modeling of environmental influence in structural health assessment for reinforced concrete buildings. Earthquake Engineering Engineering Vibration 9, 295-306.

Additional Files



Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.