Green AI-Driven Synthetic Data Generation for Improved Industrial Metal Surface Defect Detection
DOI:
https://doi.org/10.15837/ijccc.2026.6.7591Keywords:
metal surface defect detection, synthetic data generation, generative AI, green AI, human-in-the-loopAbstract
Defect detection of industrial metal surfaces is often limited by the scarcity of annotated data and the high cost of manual labeling, which limits the performance of data-driven inspection systems. This paper presents a Green AI-driven framework for synthetic data generation that efficiently augments industrial defect datasets while minimizing computational and annotation costs. The proposed approach employs a deterministic procedural pipeline to generate synthetic defect images together with aligned segmentation masks at the pixel-level, providing accurate supervision without the computational overhead of deep generative models. The framework is evaluated on the Kolektor Surface-Defect Dataset 2 (KSDD2), which is extended into a hybrid dataset through synthetic augmentation followed by human-in-the-loop validation, to ensure the realism and reliability of the generated samples and annotations. A lightweight state-of-the-art anomaly detection model, SuperSimpleNet, is trained under controlled ablation settings on both the original and hybrid datasets using identical test splits for fair comparison.
Performance is evaluated using both image-level and pixel-level metrics, including AUROC and average precision. Experimental results demonstrate that the proposed hybrid dataset consistently improves defect detection and localization performance while substantially reducing the need for costly data acquisition and manual annotation. Unlike computationally intensive generative approaches based on GANs or diffusion models, the proposed procedural framework synthesizes defects directly within predefined regions, enabling automatic generation of pixel-accurate ground-truth annotations without human intervention. The resulting hybrid dataset improves all evaluation metrics, achieving the largest gain in anomaly localization performance, with AP-loc increasing by 5.3%, while image-level AUROC increases from 0.9840 to 0.9907. By combining efficient synthetic data generation with precise automatic annotation, the proposed approach provides a resource-efficient solution that aligns with Green AI principles.
References
I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. Cambridge, Massachusetts, USA: MIT Press, 2016. [Online]. Available: https://www.deeplearningbook.org/
K. Man and J. Chahl, "A review of synthetic image data and its use in computer vision," Journal of Imaging, vol. 8, no. 11, p. 310, 2022. https://doi.org/10.3390/jimaging8110310
G. Pei, J. Zhang, M. Hu, Z. Zhang, C. Wang, Y. Wu, G. Zhai, J. Yang, and D. Tao, "Deepfake generation and detection: A benchmark and survey," ACM Comput. Surv., vol. 58, no. 11, Apr. 2026. [Online]. Available: https://doi.org/10.1145/3801962 https://doi.org/10.1145/3801962
E. Barbierato and A. Gatti, "Toward green ai: A methodological survey of the scientific literature," IEEE Access, vol. PP, pp. 1-1, 01 2024. https://doi.org/10.1109/ACCESS.2024.3360705
M. Abufadda and K. Mansour, "A survey of synthetic data generation for machine learning," in 2021 22nd International Arab Conference on Information Technology (ACIT), 2021, pp. 1-7. https://doi.org/10.1109/ACIT53391.2021.9677302
Y. Lu, L. Chen, Y. Zhang, M. Shen, H. Wang, X. Wang, C. van Rechem, T. Fu, and W. Wei, "Machine learning for synthetic data generation: A review," 2025. [Online]. Available: https://arxiv.org/abs/2302.04062
X. Wu, L. Xiao, Y. Sun, J. Zhang, T. Ma, and L. He, "A survey of human-in-the-loop for machine learning," Future Generation Computer Systems, vol. 135, pp. 364-381, 2022. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0167739X22001790 https://doi.org/10.1016/j.future.2022.05.014
D. Kundu and B. L. Evans, "Full-reference visual quality assessment for synthetic images: A subjective study," in 2015 IEEE International Conference on Image Processing (ICIP). IEEE, 2015, pp. 2374-2378. https://doi.org/10.1109/ICIP.2015.7351227
T. L. Goff, "Recommendations for public action towards sustainable generative AI systems," CoRR, vol. abs/2402.01646, 2024. [Online]. Available: https://doi.org/10.48550/arXiv.2402.01646
N. Bashir, P. Donti, J. Cuff, S. Sroka, M. Ilic, V. Sze, C. Delimitrou, and E. Olivetti, "The Climate and Sustainability Implications of Generative AI," An MIT Exploration of Generative AI, mar 27 2024, https://mit-genai.pubpub.org/pub/8ulgrckc.
R. Schwartz, J. Dodge, N. A. Smith, and O. Etzioni, "Green ai," Commun. ACM, vol. 63, no. 12, p. 54-63, Nov. 2020. [Online]. Available: https://doi.org/10.1145/3381831 https://doi.org/10.1145/3381831
T. Nazaré, J. Gadelha, E. Nepomuceno, and R. Lozi, "Green computing for energy transition: A survey," IEEE Latin America Transactions, vol. 21, no. 9, pp. 937-948, 2023. https://doi.org/10.1109/TLA.2023.10251799
Y. Zhou, X. Lin, X. Zhang, M. Wang, G. Jiang, H. Lu, Y. Wu, K. Zhang, Z. Yang, K. Wang, Y. Sui, F. Jia, Z. Tang, Y. Zhao, H. Zhang, T. Yang, W. Chen, Y. Mao, Y. Li, D. Bao, Y. Li, H. Liao, T. Liu, J. Liu, J. Guo, X. Zhao, Y. WEI, H. Qian, Q. Liu, X. Wang, W. Kin, Chan, C. Li, Y. Li, S. Yang, J. Yan, C. Mou, S. Han, W. Jin, G. Zhang, and X. Zeng, "On the opportunities of green computing: A survey," arXiv:2311.00447, 2023. [Online]. Available: https://arxiv.org/abs/2311.00447
C. Clemm, L. Stobbe, K. Wimalawarne, and J. Druschke, "Towards green ai: Current status and future research," in 2024 Electronics Goes Green 2024+(EGG). IEEE, 2024, pp. 1-11. https://doi.org/10.23919/EGG62010.2024.10631247
A. Asperti, D. Evangelista, and E. L. Piccolomini, "A survey on variational autoencoders from a green ai perspective," SN Computer Science, vol. 2, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:232092485 https://doi.org/10.1007/s42979-021-00702-9
J. Božič, D. Tabernik, and D. Skočaj, "Mixed supervision for surface-defect detection: from weakly to fully supervised learning," Computers in Industry, 2021. https://doi.org/10.1016/j.compind.2021.103459
D. Kingma and M. Welling, "An introduction to variational autoencoders," Foundations and Trends® in Machine Learning, vol. 12, pp. 307-392, 11 2019. https://doi.org/10.1561/2200000056
Y. Chen, J. Liu, L. Peng, Y. Wu, Y. Xu, and Z. Zhang, "Auto-encoding variational bayes," Cambridge Explorations in Arts and Sciences, vol. 2, 02 2024. https://doi.org/10.61603/ceas.v2i1.33
G. Zhang, K. Cui, T.-Y. Hung, and S. Lu, "Defect-gan: High-fidelity defect synthesis for automated defect inspection," in 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), 2021, pp. 2523-2533. https://doi.org/10.1109/WACV48630.2021.00257
S. Niu, H. Lin, T. Niu, B. Li, and X. Wang, "Defectgan: Weakly-supervised defect detection using generative adversarial network," in 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), 2019, pp. 127-132. https://doi.org/10.1109/COASE.2019.8843204
J. Song, D. Park, K. Baek, S. Lee, J. Choi, E. Kim, and S. Yoon, "Defectfill: Realistic defect generation with inpainting diffusion model for visual inspection," in 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025, pp. 18 718-18 727. https://doi.org/10.1109/CVPR52734.2025.01744
D. Podell, Z. English, K. Lacey, A. Blattmann, T. Dockhorn, J. Müller, J. Penna, and R. Rombach, "SDXL: Improving latent diffusion models for high-resolution image synthesis," in The Twelfth International Conference on Learning Representations, 2024. [Online]. Available: https://openreview.net/forum?id=di52zR8xgf
W. Peebles and S. Xie, "Scalable diffusion models with transformers," in 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023, pp. 4172-4182. https://doi.org/10.1109/ICCV51070.2023.00387
Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, "UNet++: a nested U-Net architecture for medical image segmentation," in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain, September 20, 2018, Proceedings. Berlin, Heidelberg: Springer-Verlag, 2018, p. 3-11. [Online]. Available: https://doi.org/10.1007/978-3-030-00889-5_1 https://doi.org/10.1007/978-3-030-00889-5_1
L.-C. Chen, Y. Zhu, G. Papandreou, F. Schroff, and H. Adam, "Encoder-decoder with atrous separable convolution for semantic image segmentation," in Computer Vision - ECCV 2018, V. Ferrari, M. Hebert, C. Sminchisescu, and Y. Weiss, Eds. Cham: Springer International Publishing, 2018, pp. 833-851. https://doi.org/10.1007/978-3-030-01234-2_49
B. Cheng, I. Misra, A. G. Schwing, A. Kirillov, and R. Girdhar, "Masked-attention mask transformer for universal image segmentation," in 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 1280-1289. https://doi.org/10.1109/CVPR52688.2022.00135
L. C. C. Filho, J. L. A. Samatelo, and R. F. Vassallo, "Hierarchical vision transformer using shifted windows for skeleton-based action recognition," in 2025 38th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), 2025, pp. 1-6. https://doi.org/10.1109/SIBGRAPI67909.2025.11223379
B. Rolih, M. Fučka, and D. Skočaj, "Supersimplenet: Unifying unsupervised and supervised learning for fast and reliable surface defect detection," in Pattern Recognition, A. Antonacopoulos, S. Chaudhuri, R. Chellappa, C.-L. Liu, S. Bhattacharya, and U. Pal, Eds. Cham: Springer Nature Switzerland, 2025, pp. 47-65. https://doi.org/10.1007/978-3-031-78192-6_4
Z. Liu, Y. Zhou, Y. Xu, and Z. Wang, "Simplenet: A simple network for image anomaly detection and localization," in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 20 402-20 411. https://doi.org/10.1109/CVPR52729.2023.01954
T. Fawcett, "Introduction to roc analysis," Pattern Recognition Letters, vol. 27, pp. 861-874, 06 2006. https://doi.org/10.1016/j.patrec.2005.10.010
P. Bergmann, K. Batzner, M. Fauser, D. Sattlegger, and C. Steger, "The mvtec anomaly detection dataset: A comprehensive real-world dataset for unsupervised anomaly detection," Int. J. Comput. Vision, vol. 129, no. 4, p. 1038-1059, Apr. 2021. [Online]. Available: https://doi.org/10.1007/s11263-020-01400-4 https://doi.org/10.1007/s11263-020-01400-4
M. Everingham, L. Van Gool, C. Williams, J. Winn, and A. Zisserman, "The pascal visual object classes (voc) challenge," International Journal of Computer Vision, vol. 88, pp. 303-338, 06 2010. https://doi.org/10.1007/s11263-009-0275-4
S. Mătase and R. Andonie, "Synthetic data generation for enhanced visual metal defect detection," in 2025 29th International Conference Information Visualisation (IV), vol. 29th International Conference Information Visualisation (IV), 2025, pp. 231-236. https://doi.org/10.1109/IV68685.2025.00050
B. Kovalerchuk, Visual Knowledge Discovery and Machine Learning. Springer, 2018, vol. 144. https://doi.org/10.1007/978-3-319-73040-0
B. Kovalerchuk, K. Nazemi, R. Andonie, N. Datia, and E. Banissi, Integrating Artificial Intelligence and Visualization for Visual Knowledge Discovery. Springer, 2022. https://doi.org/10.1007/978-3-030-93119-3
B. Kovalerchuk, R. Andonie, N. Datia, K. Nazemi, and E. Banissi, "Visual knowledge discovery with artificial intelligence: Challenges and future directions," in Integrating Artificial Intelligence and Visualization for Visual Knowledge Discovery. Springer Charm, 2022, pp. 1-27. https://doi.org/10.1007/978-3-030-93119-3_1
B. Kovalerchuk, K. Nazemi, R. Andonie, N. Datia, and E. Bannissi, Artificial Intelligence and Visualization: Advancing Visual Knowledge Discovery. Springer, 2024. https://doi.org/10.1007/978-3-031-46549-9
Additional Files
Published
Issue
Section
License
Copyright (c) 2026 Stelian Matase, Razvan ANDONIE
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.
You are free to:
-Share: copy and redistribute the material in any medium or format;
-Adapt: remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.
