Defect Data Augmentation Method for Robust Image-based Product Inspection

##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Jun 27, 2024
Youngwoon Choi Hyunseok Lee Sang Won Lee

Abstract

In this paper, we develop a model for detecting defects in fabric products based on an object segmentation algorithm, including a novel image data augmentation method to enhance the robustness. First, a vision-based inspection system is established to collect image data of the fabric products. The three types of fabric defects, such as a hole, a stain, and a dyeing defect, are considered. To enhance defect detection accuracy and robustness, a novel image data augmentation method, referred to as the defect-area cut-mix, is proposed. In this method, the shapes that are the same as each defect are extracted using the masks, and then they are added to non-defective fabric images. Second, an ensemble process is implemented by combining the results of two models, one with high sensitivity in defect diagnosis and the other with lower sensitivity. The results demonstrated that the model trained on the augmented dataset exhibits improved metrics such as intersection over union and classification accuracy in defect detection on the test dataset.

How to Cite

Choi, Y., Lee, H., & Lee, S. W. (2024). Defect Data Augmentation Method for Robust Image-based Product Inspection. PHM Society European Conference, 8(1), 8. https://doi.org/10.36001/phme.2024.v8i1.4068
Abstract 177 | PDF Downloads 175

##plugins.themes.bootstrap3.article.details##

Keywords

Data augmentation, Image segmentation, Product inspection

References
Jung, W. K., Kim, D. R., Lee, H., Lee, T. H., Yang, I., Youn, B. D., ... & Ahn, S. H. (2021). Appropriate smart factory for SMEs: concept, application and perspective. International Journal of Precision Engineering and Manufacturing, 22, 201-215. DOI 10.1007/s12541-020-00445-2 Hanbay, K., Talu, M. F., & Özgüven, Ö. F. (2016). Fabric defect detection systems and methods—A systematic literature review. Optik, 127(24), 11960-11973. DOI 10.1016/j.ijleo.2016.09.110 Bhatt, P. M., Malhan, R. K., Rajendran, P., Shah, B. C., Thakar, S., Yoon, Y. J., & Gupta, S. K. (2021). Imagebased surface defect detection using deep learning: A review. Journal of Computing and Information Science in Engineering, 21(4), 040801. DOI 10.1115/1.4049535 Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., ... & Fei-Fei, L. (2015). ImageNet large scale visual recognition challenge. International journal of computer vision, 115, 211-252. DOI 10.1007/s11263-015-0816-y Tong, L., Wong, W. K., & Kwong, C. K. (2016). Differential evolution-based optimal Gabor filter model for fabric inspection. Neurocomputing, 173, 1386-1401. DOI 10.1016/j.neucom.2015.09.011 Zhou, Y. (2019). Research on image-based automatic wafer surface defect detection algorithm. Journal of Image and Graphics, 7(1), 26-31. DOI 10.18178/joig.7.1.26-31 Tabernik, D., Šela, S., Skvarč, J., & Skočaj, D. (2020). Segmentation-based deep-learning approach for surfacedefect detection. Journal of Intelligent Manufacturing, 31(3), 759-776. DOI 10.1007/s10845-019-01476-x Ho, C. C., Chou, W. C., & Su, E. (2021). Deep convolutional neural network optimization for defect detection in fabric inspection. Sensors, 21(21), 7074. DOI 10.3390/s21217074 OpenCV. (n.d.). CVAT. Retrieved [2024.05.10], from https://www.cvat.ai/. Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., & Liang, J. (2019). Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE transactions on medical imaging, 39(6), 1856-1867. DOI 10.1109/TMI.2019.2959609 Luo, C., Li, X., Wang, L., He, J., Li, D., & Zhou, J. (2018, November). How does the data set affect cnn-based image classification performance?. In 2018 5th international conference on systems and informatics (ICSAI) (pp. 361-366). IEEE. DOI 10.1109/ICSAI.2018.8599448
Israel, I. M., Israel, S. A., & Irvine, J. M. (2021, October). Factors influencing CNN performance. In 2021 IEEE Applied Imagery Pattern Recognition Workshop (AIPR) (pp. 1-4). IEEE. DOI 10.1109/AIPR52630.2021.9762112 Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 779-788). Cho, J., Lee, K., Shin, E., Choy, G., & Do, S. (2015). How much data is needed to train a medical image deep learning system to achieve necessary high accuracy? arXiv preprint arXiv:1511.06348. https://arxiv.org/abs/1511.06348 DOI 10.48550/arXiv.1511.06348 Yun, S., Han, D., Oh, S. J., Chun, S., Choe, J., & Yoo, Y. (2019). Cutmix: Regularization strategy to train strong classifiers with localizable features. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 6023-6032).
Section
Technical Papers