From Prediction to Decision Uncertainty-Aware Maintenance Scheduling for Commercial Turbofan Engines
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
Accurate prediction of remaining flight cycles is the goal of most turbofan prognostics, but low aggregate error does not by itself guarantee low realized maintenance cost. On the PHM North America 2025 Data Challenge (three maintenance targets of very different event frequencies, scored under an asymmetric, time-weighted cost) we build a conventional prediction pipeline and then ask how reliable its accuracy is. We take a strictly nested temporal analysis, in which calibration data are untouched by fitting or tuning, as the primary result. Across two allocations of the limited pre-deployment history, a nominal 90% split-conformal interval achieves 90–93% coverage on the late-life deployment window for the frequent water-wash, but only 25–29% for the high-pressure-turbine (HPT) shop visit and 19–28% for the high-pressure-compressor (HPC) shop visit. Complementary interval and base-model checks, and all four subsets of the public NASA C-MAPSS benchmark, reproduce the separation between water-wash and the two shop-visit targets.
Converting predictions into scheduling decisions, a policy whose safety buffer is the conformal half-width reduces realized cost by 23–41% against trusting the point prediction under the two nested protocols, cutting unplanned failures from 31 to 9–13. Its comparison with a tuned constant buffer changes from a 13% advantage to a 3% disadvantage as the scarce pre-deployment data are apportioned, so four engines do not order the two buffer policies. A cost sweep places their crossover at a failure penalty of roughly 250 forfeited cycles of useful life. On HPC, constant-buffer policies are not robust: the original and Nested Variant I buffers leave all six failures, while the much wider Variant II buffer cuts failures to three at substantial early-service cost. A prediction-free age-based fallback and, under the secondary non-nested calibration, two instance-dependent triggers also reduce failures. Per-component reliability must therefore gate the maintenance decision rather than follow it.
##plugins.themes.bootstrap3.article.details##
remaining useful life, conformal prediction, distribution shift, uncertainty quantification, maintenance scheduling, turbofan engines, decision making, prognostics and health management
Angelopoulos, A. N., & Bates, S. (2023). Conformal prediction: A gentle introduction. Foundations and Trends in Machine Learning, 16(4), 494–591. doi: 10.1561/2200000101
Babu, G. S., Zhao, P., & Li, X.-L. (2016). Deep convolutional neural network-based regression approach for estimation of remaining useful life. In International conference on database systems for advanced applications (pp. 214–228). doi: 10.1007/978-3-319-32025-014
Barber, R. F., Candes, E. J., Ramdas, A., & Tibshirani, R. J. (2023). Conformal prediction beyond exchangeability. The Annals of Statistics, 51(2), 816–845. doi: 10.1214/23-AOS2276
Chen, Z., Wu, M., Zhao, R., Guretno, F., Yan, R., & Li, X. (2021). Machine remaining useful life prediction via an attention-based deep learning approach. IEEE Transactions on Industrial Electronics, 68(3), 2521–2531. doi: 10.1109/TIE.2020.2972443
Christ, M., Braun, N., Neuffer, J., & Kempa-Liehr, A. W. (2018). Time series feature extraction on basis of scalable hypothesis tests (tsfresh). Neurocomputing, 307, 72–77. doi: 10.1016/j.neucom.2018.03.067
Compare, M., Bellani, L., & Zio, E. (2017). Reliability model of a component equipped with phm capabilities. Reliability Engineering and System Safety, 168, 4–11. doi: 10.1016/j.ress.2017.05.024
DeGroot, M. H., & Fienberg, S. E. (1983). The comparison and evaluation of forecasters. Journal of the Royal Statistical Society: Series D, 32(1-2), 12–22. doi: 10.2307/2987588
de Jonge, B., & Scarf, P. A. (2020). A review on maintenance optimization. European Journal of Operational Research, 285(3), 805–824. doi: 10.1016/j.ejor.2019.09.047
de Oliveira da Costa, P. R., Akcay, A., Zhang, Y., & Kaymak, U. (2020). Remaining useful lifetime prediction via deep domain adaptation. Reliability Engineering and System Safety, 195, 106682. doi: 10.1016/j.ress.2019.106682
Ellefsen, A. L., Bjørlykhaug, E., Asøy, V., Ushakov, S., & Zhang, H. (2019). Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture. Reliability Engineering and System Safety, 183, 240–251. doi: 10.1016/j .ress .2018 .11.027
Fink, O., Wang, Q., Svens´en, M., Dersin, P., Lee, W.-J., & Ducoffe, M. (2020). Potential, challenges and future directions for deep learning in prognostics and health management applications. Engineering Applications of Artificial Intelligence, 92, 103678. doi: 10.1016/j.engappai.2020.103678
Fink, W., & Al Hajhog, K. (2024). Post-clustering prioritization framework for autonomous decision making in the absence of ground truth via hypothetical probing. International Journal of Prognostics and Health Management, 15(1). doi: 10.36001/ijphm.2024.v15i1.3206
Gibbs, I., & Candes, E. (2021). Adaptive conformal inference under distribution shift. Advances in Neural Information Processing Systems, 34, 1660–1672.
Han, P., & Liang, Q. (2025). Estimating cycles to maintenance events for jet engines using engine-specific measurement residual. In Annual conference of the phm society (Vol. 17). doi: 10.36001/phmconf.2025.v17i1.4667
Ifeanyi, A. O., Zanotelli, M., & Coble, J. B. (2024). Data-driven remaining useful life estimation: Inference-based versus direct prediction. Annual Conference of the PHM Society. doi: 10.36001/phmconf.2024.v16i1.4071
Inoue, K., Wakimoto, K., Ozeki, K., Kuriyama, T., & Masuzaki, T. (2025). Extended abstract: Remaining cycle estimation based on a maintenance cycle model. In Annual conference of the phm society (Vol. 17). doi: 10.36001/phmconf.2025.v17i1.4669
Javanmardi, A., & H¨ullermeier, E. (2023). Conformal prediction intervals for remaining useful lifetime estimation. International Journal of Prognostics and Health Management, 14(2). doi: 10.36001/ijphm.2023.v14i2.3417
Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., . . . Liu, T.-Y. (2017). LightGBM: A highly efficient gradient boosting decision tree. Advances in Neural Information Processing Systems, 30.
Khojandi, A., Maillart, L. M., & Prokopyev, O. A. (2014). Optimal planning of life-depleting maintenance activities. IIE Transactions, 46(7), 636–652. doi: 10.1080/0740817X.2013.849835
Kong, H. B., Jo, S.-H., Jung, J. H., Ha, J. M., Shin, Y. C., & Yoon, H. (2023). A hybrid approach of data-driven and physics-based methods for estimating remaining useful life. International Journal of Prognostics and Health Management, 11(1). doi: 10.36001/ijphm.2020.v11i1.2605
Lee, J.,Wu, F., Zhao,W., Ghaffari, M., Liao, L., & Siegel, D. (2014). Prognostics and health management design for rotary machinery systems – reviews, methodology and applications. Mechanical Systems and Signal Processing, 42(1-2), 314–334. doi: 10.1016/j.ymssp.2013.06.004
Lei, Y., Li, N., Guo, L., Li, N., Yan, T., & Lin, J. (2018). Machinery health prognostics: A systematic review from data acquisition to RUL prediction. Mechanical Systems and Signal Processing, 104, 799–834. doi: 10.1016/j.ymssp.2017.11.016
Li, X., Ding, Q., & Sun, J.-Q. (2018). Remaining useful life estimation in prognostics using deep convolution neural networks. Reliability Engineering and System Safety, 172, 1–11. doi: 10.1016/j.ress.2017.11.021
Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, 30.
Olde Keizer, M. C. A., Flapper, S. D. P., & Teunter, R. H. (2017). Condition-based maintenance policies for systems with multiple dependent components: A review. European Journal of Operational Research, 261(2), 405–420. doi: 10.1016/j.ejor.2017.02.044
Ong, K. S. H., Niyato, D., & Yuen, C. (2020). Predictive maintenance for edge-based sensor networks: A deep reinforcement learning approach. In Ieee world forum on internet of things (pp. 1–6). doi: 10.1109/WF-IoT48130.2020.9221098
Pankaj, P., Joshi, S., Peng, X., Teramoto, R., & Hearn, T. (2025). Maintenance service events prediction modeling of aircraft gas turbine engines. In Annual conference of the phm society (Vol. 17). doi: 10.36001/phmconf.2025.v17i1.4668
PHM Society. (2025). PHM north america 2025 conference data challenge. https://data.phmsociety .org / phm -north -america-2025-conference-data-challenge/.
Puterman, M. L. (1994). Markov decision processes: Discrete stochastic dynamic programming. John Wiley & Sons. doi: 10.1002/9780470316887
Quiñonero-Candela, J., Sugiyama, M., Schwaighofer, A., & Lawrence, N. D. (2009). Dataset shift in machine learning. MIT Press. doi: 10.7551/mitpress/9780262170055.001.0001
Ramasso, E., & Saxena, A. (2014). Performance benchmarking and analysis of prognostic methods for CMAPSS datasets. International Journal of Prognostics and Health Management, 5(2), 1–15. doi: 10.36001/ijphm.2014.v5i2.2236
Romano, Y., Patterson, E., & Cand`es, E. (2019). Conformalized quantile regression. Advances in Neural Information Processing Systems, 32.
Saxena, A., Goebel, K., Simon, D., & Eklund, N. (2008). Damage propagation modeling for aircraft engine run-to-failure simulation. In International conference on prognostics and health management (pp. 1–9). doi: 10.1109/PHM.2008.4711414
Si, X.-S., Wang, W., Hu, C.-H., & Zhou, D.-H. (2011). Remaining useful life estimation – a review on the statistical data driven approaches. European Journal of Operational Research, 213(1), 1–14. doi: 10.1016/j.ejor.2010.11.018
Tibshirani, R. J., Foygel Barber, R., Cand`es, E., & Ramdas, A. (2019). Conformal prediction under covariate shift. Advances in Neural Information Processing Systems, 32.
Vovk, V., Gammerman, A., & Shafer, G. (2005). Algorithmic learning in a random world. Springer. doi: 10.1007/b106715
Wang, B., Lei, Y., Li, N., & Li, N. (2020). A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Transactions on Reliability, 69(1), 401–412. doi: 10.1109/TR.2018.2882682
Wehrspohn, J., Pohya, A. A., & Wicke, K. (2021). An assessment of the economic viability of engine wash procedures on the lifecycle costs of an aircraft fleet. PHM Society European Conference, 6(1), 14. doi: 10.36001/phme.2021.v6i1.2892
Wolpert, D. H. (1992). Stacked generalization. Neural Networks, 5(2), 241–259. doi: 10.1016/S0893-6080(05) 80023-1
Zheng, S., Ristovski, K., Farahat, A., & Gupta, C. (2017). Long short-term memory network for remaining useful life estimation. In Ieee international conference on prognostics and health management (icphm) (pp. 88–95). doi: 10.1109/ICPHM.2017.7998311