A Comparative Study of Deep Learning Model Based Equipment Fault Diagnosis and Prognosis
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
Bearing fault diagnosis and prognosis are crucial for the effective management of industrial equipment. Due to the automatic feature extraction of Deep Learning (DL) models, many recent studies have focused on using DL for these tasks. However, most studies address only one of these tasks. This study aims to present DL models and their powerful ML tools capable of both fault diagnosis and prognosis on industrial equipment. To identify the best DL model for both tasks, a comparative study is conducted on various DL models and ML tools, including Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), CNN in parallel with LSTM (CNN-LSTM), Bidirectional LSTM (Bi-LSTM), and transformer models. The ML tools investigated include Recurrent Dropout, Residual Network (ResNet), and Monte Carlo Dropout (MC Dropout). These models are validated using online datasets from Case Western Reserve University (CWRU) and Xi’an Jiao Tong University (XJTU-SY) for the task of fault diagnosis. For fault prognosis, datasets from XJTU-SY and IEEE PHM are used. The results demonstrate the superiority of the ResCNN-LSTM model in both fault diagnosis and prognosis tasks. It achieves prediction accuracy of 99.87% and 96.39% and F1-scores of 0.998 and 0.964 for fault diagnosis on the CWRU and XJTU-SY datasets, respectively. Additionally, it shows a Root Mean Square Error (RMSE) of 8.56 and Mean Absolute Error (MAE) of 12.16 for fault prognosis on the XJTU dataset, and an RMSE of 12.18 using the IEEE PHM bearing dataset. These high performance metrics indicate the model's effectiveness in accurately diagnosing faults and predicting failures.
##plugins.themes.bootstrap3.article.details##
fault diagnosis, fault prognosis, deep learning, CNN-LSTM, residual network
X. Qiao, V.L. Jauw, L. Chin Seong, T. Banda, Advances and limitations in machine learning approaches
applied to remaining useful life predictions: a critical review, Int. J. Adv. Manuf. Technol. (2024).
https://doi.org/10.1007/s00170-024-14000-0.
T. Berghout, M. Benbouzid, A Systematic Guide for Predicting Remaining Useful Life with Machine
Learning, Electronics 11 (2022) 1125. https://doi.org/10.3390/electronics11071125.
J. Naranjo-Torres, M. Mora, R. Hernández-García, R.J. Barrientos, C. Fredes, A. Valenzuela, A Review of
Convolutional Neural Network Applied to Fruit Image Processing, Appl. Sci. 10 (2020) 3443.
https://doi.org/10.3390/app10103443.
D.-T. Hoang, H.-J. Kang, Rolling element bearing fault diagnosis using convolutional neural network and
vibration image, Cogn. Syst. Res. 53 (2019) 42–50. https://doi.org/10.1016/j.cogsys.2018.03.002.
K. He, X. Zhang, S. Ren, J. Sun, Deep Residual Learning for Image Recognition, in: 2016 IEEE Conf.
Comput. Vis. Pattern Recognit. CVPR, IEEE, Las Vegas, NV, USA, 2016: pp. 770–778.
https://doi.org/10.1109/CVPR.2016.90.
L. Wen, X. Li, L. Gao, A transfer convolutional neural network for fault diagnosis based on ResNet-50,
Neural Comput. Appl. 32 (2020) 6111–6124. https://doi.org/10.1007/s00521-019-04097-w.
X. Chen, B. Zhang, D. Gao, Bearing fault diagnosis base on multi-scale CNN and LSTM model, J. Intell.
Manuf. 32 (2021) 971–987. https://doi.org/10.1007/s10845-020-01600-2.
D. You, L. Chen, F. Liu, Y. Zhang, W. Shang, Y. Hu, W. Liu, Intelligent Fault Diagnosis of Bearing Based
on Convolutional Neural Network and Bidirectional Long Short‐Term Memory, Shock Vib. 2021 (2021)
7346352. https://doi.org/10.1155/2021/7346352.
B. Zhao, Q. Yuan, A novel deep learning scheme for multi-condition remaining useful life prediction of
rolling element bearings, J. Manuf. Syst. 61 (2021) 450–460. https://doi.org/10.1016/j.jmsy.2021.10.004.
B. Walker, RUL Prediction for Bearings Using MSCNN and LSTM Networks, (n.d.).
J. Yang, Y. Peng, J. Xie, P. Wang, Remaining Useful Life Prediction Method for Bearings Based on LSTM
with Uncertainty Quantification, Sensors 22 (2022) 4549. https://doi.org/10.3390/s22124549.
C.-X. Jack Feng, Z.-G.S. Yu, U. Kingi, M. Pervaiz Baig, Threefold vs. fivefold cross validation in onehidden-layer and two-hidden-layer predictive neural network modeling of machining surface roughness data,
J. Manuf. Syst. 24 (2005) 93–107. https://doi.org/10.1016/S0278-6125(05)80010-X.
Z. Li, F. Liu, W. Yang, S. Peng, J. Zhou, A Survey of Convolutional Neural Networks: Analysis, Applications,
and Prospects, IEEE Trans. Neural Netw. Learn. Syst. 33 (2022) 6999–7019.
https://doi.org/10.1109/TNNLS.2021.3084827.
C. Zhao, X. Huang, Y. Li, M. Yousaf Iqbal, A Double-Channel Hybrid Deep Neural Network Based on CNN
and BiLSTM for Remaining Useful Life Prediction, Sensors 20 (2020) 7109.
https://doi.org/10.3390/s20247109.
M. Li, Q. Wei, H. Wang, X. Zhang, Research on fault diagnosis of time-domain vibration signal based on
convolutional neural networks, Syst. Sci. Control Eng. 7 (2019) 73–81.
https://doi.org/10.1080/21642583.2019.1661311.
Y. Gal, Z. Ghahramani, Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep
Learning, (2016). http://arxiv.org/abs/1506.02142 (accessed December 14, 2022).
L. Wang, H. Cao, Z. Ye, H. Xu, Bayesian large-kernel attention network for bearing remaining useful life
prediction and uncertainty quantification, Reliab. Eng. Syst. Saf. 238 (2023) 109421.
https://doi.org/10.1016/j.ress.2023.109421.
W.A. Smith, R.B. Randall, Rolling element bearing diagnostics using the Case Western Reserve University
data: A benchmark study, Mech. Syst. Signal Process. 64–65 (2015) 100–131.
https://doi.org/10.1016/j.ymssp.2015.04.021.
Yaguo L., Tianyu H., Biao W., Naipeng L., Tao Y., Jun Y., XJTU-SY Rolling Element Bearing Accelerated
Life Test Datasets: A Tutorial, J. Mech. Eng. 55 (2019) 1. https://doi.org/10.3901/JME.2019.16.001