Constraint-Guided Learning of Data-driven Health Indicator Models An Application on Bearings

##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Aug 14, 2025
Yonas Tefera
Quinten Van Baelen Maarten Meire Stijn Luca Peter Karsmakers

Abstract

This paper presents a constraint-guided deep learning (DL) framework to develop physically consistent health indicators (HIs) in bearing prognostics and health management. Conventional data-driven approaches often lack physical plausibility, while physics-based models are limited by incomplete knowledge of complex systems. To address this, we integrate domain knowledge into DL models via constraints, ensuring monotonicity, bounding output ranges between 1 and 0 (representing healthy to failed states, respectively), and maintaining consistency between signal energy trends and HI estimates. Using constraints eliminates the need for complex loss term balancing to incorporate domain knowledge. The constraint-guided gradient descent algorithm (CGGD) is used to train a DL model that satisfies specific constraints. Using time-frequency representations of accelerometer signals from the pronostia and XJTU-SY bearing datasets, the model learned using constraints generates more accurate and reliable representations of bearing health compared to conventional methods. It produces smoother degradation profiles that align with the expected physical behavior. Model performance is assessed using three metrics: trendability, robustness, and consistency. When compared to a conventional baseline model, the model learned using constraints shows a significant improvement in all three metrics. Another baseline incorporated the monotonicity behavior directly into the loss function using a soft-ranking approach. While this approach outperforms the model learned using constraints in trendability, due to its explicit monotonicity enforcement, the model learned with constraints performed better in robustness and consistency, providing stable and interpretable HI estimates over time. The ablation study confirms the importance of each constraint: the monotonicity constraint improves trendability, the boundary constraint ensures consistency, and the energy–HI consistency constraint enhances robustness. These findings demonstrate the effectiveness of CGGD in producing reliable and physically meaningful HIs for bearing prognostics and health management, offering a promising direction for future prognostic applications.

Abstract 11 | PDF Downloads 3

##plugins.themes.bootstrap3.article.details##

Keywords

Constraint Guided Learning, Bearing Degradation, Health Indicators, Auto Encoders

References
Biggio, L., & Kastanis, I. (2020). Prognostics and health management of industrial assets: Current progress and road ahead. Frontiers in Artificial Intelligence, 3, 578613.
Blondel, M., Teboul, O., Berthet, Q., & Djolonga, J. (2020). Fast differentiable sorting and ranking. 37th International Conference on Machine Learning, ICML 2020, PartF16814, 927–936.
Carino, J. A., Zurita, D., Delgado, M., Ortega, J. A., & Romero-Troncoso, R. J. (2015). Remaining useful life estimation of ball bearings by means of monotonic score calibration. Proceedings of the IEEE International Conference on Industrial Technology, 2015- June, 1752–1758.
Chen, J., & Liu, Y. (2021). Probabilistic physics-guided machine learning for fatigue data analysis. Expert Systems with Applications, 168, 114316.
leveland, W. S., & Devlin, S. J. (1988). Locally weighted regression: An approach to regression analysis by local fitting. Journal of the American Statistical Association, 83(403), 596–610.
Cubillo, A., Perinpanayagam, S., & Esperon-Miguez, M. (2016). A review of physics-based models in prognostics: Application to gears and bearings of rotating machinery. Advances in Mechanical Engineering, 8(8), 1687814016664660.
Duong, B. P., Khan, S. A., Shon, D., Im, K., Park, J., Lim, D. S., . . . Kim, J. M. (2018). A reliable health indicator for fault prognosis of bearings. Sensors (Switzerland), 18(11).
Hoffmann Souza, M. L., da Costa, C. A., & de Oliveira Ramos, G. (2023). A machine-learning based data-oriented pipeline for Prognosis and Health Management Systems. Computers in Industry, 148(January), 103903.
Jieyang, P., Kimmig, A., Dongkun, W., Niu, Z., Zhi, F., Jiahai, W., . . . Ovtcharova, J. (2023). A systematic review of data-driven approaches to fault diagnosis and early warning. Journal of Intelligent Manufacturing, 34(8), 3277–3304.
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021). Physics-informed machine learning. Nature Reviews Physics, 3(6), 422–440.
Lei, Y., Li, N., Gontarz, S., Lin, J., Radkowski, S., & Dybala, J. (2016). A model-based method for remaining useful life prediction of machinery. IEEE Transactions on reliability, 65(3), 1314–1326.
Lei, Y., Li, N., Guo, L., Li, N., Yan, T., & Lin, J. (2018). Machinery health prognostics: A systematic review from data acquisition to RUL prediction. Mechanical Systems and Signal Processing, 104, 799–834.
Li, H., Zhang, Z., Li, T., & Si, X. (2024). A review on physics-informed data-driven remaining useful life prediction: Challenges and opportunities. Mechanical Systems and Signal Processing, 209(December 2023), 111-120.
Liao, L., & K¨ ottig, F. (2014). Review of hybrid prognostics approaches for remaining useful life prediction of engineered systems, and an application to battery life prediction. IEEE Transactions on Reliability, 63(1), 191–207.
Lu, W., Wang, Y., Zhang, M., & Gu, J. (2024). Physics guided neural network: Remaining useful life prediction of rolling bearings using long short-term memory network through dynamic weighting of degradation process. Engineering Applications of Artificial Intelligence, 127(PB), 107350.
Meire, M., Brijder, R., Dekkers, G., & Karsmakers, P. (2022). Accelerometer-Based Bearing Condition Indicator Estimation Using Supervised Adaptive DSVDD. Proceedings of the Annual Conference of the Prognostics and Health Management Society, PHM, 14(1), 1–10.
Meng, C., Seo, S., Cao, D., Griesemer, S., & Liu, Y. (2022). When physics meets machine learning: A survey of physics-informed machine learning. arXiv preprint arXiv:2203.16797.
Mosallam, A., Medjaher, K., & Zerhouni, N. (2016). Data-driven prognostic method based on bayesian approaches for direct remaining useful life prediction. Journal of Intelligent Manufacturing, 27, 1037–1048.
Muralidhar, N., Islam, M. R., Marwah, M., Karpatne, A., & Ramakrishnan, N. (2018). Incorporating Prior Domain Knowledge into Deep Neural Networks. Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018, 36–45.
Nascimento, R. G., & Viana, F. A. (2019). Fleet prognosis with physics-informed recurrent neural networks. Structural Health Monitoring 2019: Enabling Intelligent Life-Cycle Health Management for Industry Internet of Things (IIOT) - Proceedings of the 12th International Workshop on Structural Health Monitoring, 2, 1740–1747.
Patrick Nectoux, K. M., Rafael Gouriveau, Ramasso, E., & Brigitte Chebel-Morello, e. a. (2012). PRONOSTIA: An Experimental Platform for Bearings Accelerated Degradation Tests. IEEE International Conference on Prognostics and Health Management, PHM’12., Jun 2012, Denver, Colorado, United States., 1-8.
Raissi, M., Perdikaris, P., & Karniadakis, G. E. (2019). Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378, 686–707.
Rezaeianjouybari, B., & Shang, Y. (2020). Deep learning for prognostics and health management: State of the art, challenges, and opportunities. Measurement: Journal of the International Measurement Confederation, 163, 107929.
Su, H., & Lee, J. (2023). Machine learning approaches for diagnostics and prognostics of industrial systems using open source data from phm data challenges: a review. arXiv preprint arXiv:2312.16810.
Van Baelen, Q., & Karsmakers, P. (2023). Constraint guided gradient descent: Training with inequality constraints with applications in regression and semantic segmentation. Neurocomputing, 556, 126636.
Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P.-A., & Bottou, L. (2010). Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of machine learning research, 11(12).
Vishwakarma, M., Purohit, R., Harshlata, V., & Rajput, P. (2017). Vibration Analysis & Condition Monitoring for Rotating Machines: A Review. Materials Today: Proceedings, 4(2), 2659–2664.
Von Rueden, L., Mayer, S., Beckh, K., Georgiev, B., Giesselbach, S., Heese, R., . . . Schuecker, J. (2023). Informed Machine Learning - A Taxonomy and Survey of Integrating Prior Knowledge into Learning Systems. IEEE Transactions on Knowledge and Data Engineering, 35(1), 614–633.
Wang, B., Lei, Y., Li, N., & Li, N. (2018). A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Transactions on Reliability, 69(1), 401–412.
Wang, J., Li, Y., Zhao, R., & Gao, R. X. (2020). Physics guided neural network for machining tool wear prediction. Journal of Manufacturing Systems, 57(October), 298–310.
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2022). Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems. ACM Computing Surveys, 55(4), 1–34.
Xiong, J., Fink, O., Zhou, J., & Ma, Y. (2023). Controlled physics-informed data generation for deep learning-based remaining useful life prediction under unseen operation conditions. Mechanical Systems and Signal Processing, 197.
Xu, Y., Kohtz, S., Boakye, J., Gardoni, P., & Wang, P. (2023). Physics-informed machine learning for reliability and systems safety applications: State of the art and challenges. Reliability Engineering & System Safety, 230, 108900.
Zhang, B., Zhang, L., & Xu, J. (2016). Degradation Feature Selection for Remaining Useful Life Prediction of Rolling Element Bearings. Quality and Reliability Engineering International, 32(2), 547–554.
Zhou, H., Huang, X., Wen, G., Lei, Z., Dong, S., Zhang, P., & Chen, X. (2022). Construction of health indicators for condition monitoring of rotating machinery: A review of the research. Expert Systems with Applications, 203(March), 117297.
Section
Technical Papers