Joint production and maintenance optimization for a single-machine deteriorating system in a finite planning horizon

Document Type : Original Article

Authors

1 Department of Industrial Engineering, Faculty of Engineering, University of Kurdistan, Sanandaj, Iran.

2 Industrial Engineering Department, Faculty of Engineering Management, Kermanshah University of Technology, Kermanshah, Iran.

Abstract
This paper examines the joint optimization of production and maintenance planning for a single-machine deteriorating system. To achieve optimal performance and meet customer demand at the lowest cost, manufacturing companies need to carefully plan production and maintenance, considering various factors such as time, cost, output levels in any period and its impact on machine deterioration. In this research, we attempt to plan the production and maintenance process for a single-machine single-product system over multi-period. The machine has two operational states during production and gradually deteriorates as it ages. Maintenance operations restore the machine to healthy state and reduce the probability of producing defective products. We model the problem using the Markov decision process and employ the value iteration algorithm to determine the optimal policy, i.e., the best actions to take at each decision epoch. We evaluate the model's effectiveness by solving a numerical example and analyzing how changes in different parameters affect the results. The findings reveal the relationship between various parameters and the average cost rate. Changes in the mentioned rate due to changes in setup cost and the probability of producing conforming products are almost uniform without any drastic fluctuations. If the production cost of each item exceeds a certain threshold, the company's obligations are not enforceable.

Keywords


Farahani, Ameneh, and Hamid Tohidi. "Integrated optimization of quality and maintenance: A literature review." Computers & Industrial Engineering 151, (2020): 106924.
Sule, Dileep R. Production planning and industrial scheduling. Taylor & Francis Group, 2008.
Jiang, Junwei, Youjun An, Yuanfa Dong, Jiawen Hu, Yinghe Li, and Ziye Zhao. "Integrated optimization of non-permutation flow shop scheduling and maintenance planning with variable processing speed." Reliability Engineering & System Safety 234, (2023): 109143.
Rivera-Gomez, Hector, Ali Gharbi, Jean-Pierre Kenne, Ruth Ortiz-Zarco, and Jose Ramon Corona-Armenta. "Joint production, inspection and maintenance control policies for a deteriorating system under quality constraint." Journal of Manufacturing Systems 60, (2021): 585-607.
Li, Congbo, Fei Liu, Huajun Cao, and Qiulian Wang. "A stochastic dynamic programming based model for uncertain production planning of re-manufacturing system". International Journal of Production Research 47, no. 13 (2009): 3657-3668.
Moreno, Marta Susana, and Jorge Marcelo Montagna. "A multiperiod model for production planning and design in a multiproduct batch environment". Mathematical and Computer Modelling 49, (2009): 1372-1385.
Khaledi, Hamed, and Mohammad Reisi-Nafchi. "Dynamic production planning model: a dynamic programming approach". International journal of manufacturing technology 67, (2013): 1675-1681.
Cheng, Shih-Fen, Blake E. Nicholson, Marina A. Epelman, Daniel J. Reaume, and Robert L. Smith. " A Dynamic Programming Approach to Achieving an Optimal End-State Along a Serial Production Line". IIE Transactions 45, no. 12 (2013): 1278-1292.
Hilger, Timo, Florian Sahling, and Horst Tempelmeier. "Capacitated dynamic production and remanufacturing planning under demand and return uncertainty." OR Spectrum 38, (2016): 849-876.
Teksan, Z. Melis, and Joseph Geunes. "Production Planning with Price-Dependent Supply Capacity." IIE Transactions 48, no. 10 (2016).
El Ashhab, Mohamed. "An Optimization Model for Multi-period Multi- Product Multi-Objective Production Planning." International Journal of Engineering & Technology 16, no. 01 (2016).
Polotski, Vladimir, Jean-Pierre Kenne, and Ali Gharbi. "Set-up and production planning in hybrid manufacturing–remanufacturing systems with large returns." International Journal of Production Research 55, no. 13 (2017):3766-3787.
Awasthi, Utsav, Remy Marmier, and Ignacio E. Grossmann. "Multiperiod optimization model for oilfield production planning: bicriterion optimization and two‑stage stochastic programming model." Optimization and Engineering 20, (2019):1227-1248.
Liu, Hengyu, Juliang Zhang, T. C. E. Cheng, and Yihong Ru. "Optimal production-inventory policy for the multi-period fixed proportions co-production system." European Journal of Operational Research 280, no. 2 (2020):469-487.
Maafa, A. Djama, L. Triqui Sari, and F. Belkaid. "Multi-Periods Production Planning for an Industrial Company." 13th International Colloquium of Logistics and Supply Chain Management (LOGISTIQUA). Fez, Morocco.
Guillaume, Romain, Adam Kasperski, and Pawel  Zielinski. "Robust production planning with budgeted cumulative demand Uncertainty." (2020).
Gomez-Rocha, Jose Emmanuel, Eva Selene Hernandez-Gress, and Hector Rivera-Gomez. "Production planning of a furniture manufacturing company with random demand and production capacity using stochastic programming." (2021).
Luo, Dan, Simon Thevenin, Alexandre Dolgui. "A state-of-the-art on production planning in Industry 4.0." International Journal of Production Research 61, no. 19, (2023):6602-6632.
Elyasi, Milad, Basak Altan, Ali Ekici, Okan Orsan Ozener, Ihsan Yanıkoglu, and Alexandre Dolgui. "Production planning with flexible manufacturing systems under demand uncertainty." International Journal of Production Research 62, no. 1-2 (2024):157-170.
Fornier, Zoe, Dorian Grosso, and Vincent Leclere. "Joint production and energy supply planning of an industrial microgrid." Energy Systems, (2024).
Rahimi Kakehjoob, Parviz, Hiwa Farughi, and Hasan Rasay. "A stochastic dynamic programming model for production systems planning with the possibility of producing defective products in a finite planning horizon." Journal of Industrial Engineering Research in Production Systems 11, no. 23 (2023):121-137.
Bohlin, Markus, and Mathias Warja. "Maintenance optimization with duration-dependent costs." Annals of Operations Research 224, (2015):1-23.
Shafiee, Mahmood, Maxim Finkelstein. "An optimal age-based group maintenance policy for multi-unit Degrading systems." Reliability Engineering and System Safety 134, (2015):230-238.
Verbert, K., B. De Schutter,  and R. Babuska. "Timely Condition-Based Maintenance Planning for Multi-Component Systems." Reliability Engineering and System Safety 159, (2016):310-321.
Matyas, Kurt, Tanja Nemeth, Klaudia Kovacs, and Robert Glawar. "A procedural approach for realizing prescriptive maintenance planning in manufacturing industries." CIRP Annals - Manufacturing Technology 66, no. 1 (2017):461-464.
Hu, Jiawen, Zuhua Jiang, and Haitao Liao. "Preventive maintenance of a single machine system working under piecewise constant operating condition." Reliability Engineering and System Safety 168, (2017):105-115.
Aizpurua, J.I., V.M. Catterson, Y. Papadopoulos, F. Chiacchio, D. D'Urso. "Supporting group maintenance through prognostics-enhanced dynamic dependability prediction." Reliability Engineering and System Safety 168, (2017):171-188.
Poppe, Joeri, Robert N. Boute, and Marc R. Lambrecht. "A hybrid condition-based maintenance policy for continuously monitored components with two degradation thresholds." European Journal of Operational Research 268, no. 2 (2018):515-532.
Guiras, Zouhour, Sadok Turki, Nidhal Rezg, and Alexandre Dolgui. "Optimal maintenance plan for two-level assembly system and risk study of machine failure." International Journal of Production Research 57, no. 8 (2018): 2446-2463.
Yahyatabar, Ali, and Amir Abbas Najafi. "Condition based maintenance policy for series-parallel systems through Proportional Hazards Model: A multi-stage stochastic programming approach." Computers & Industrial Engineering 126, (2018): 30-46.
Rasay, Hasan, Mohammad Saber Fallahnezhad, and Yahia Zaremehrjerdiande. "Integration of the Decisions Associated with Maintenance Management and Process Control for a Series Production System." Iranian Journal of Management Studies (IJMS) 11, no. 2 (2018): 379-405.
Srivastava, Priyank, Dinesh Khanduja, and V. P. Agrawal. "Agile maintenance attribute coding and evaluation-based decision making in sugar manufacturing plant." Operational Research 57, no. 4 (2019): 553-583.
Wenbin, Zeng, Ilia Frenkel, Shen Guixiang, Igor Bolvashenkov, Jorg Kammermann, Hans-Georg Herzog, and Lev Khvatskin. "Markov Reward Approach and Reliability Associated Cost Model for Machine Tools Maintenance-Planning Optimization." International Journal of Mathematical, Engineering and Management Sciences 4, no. 4 (2019): 824-840.
Dinh, Duc-Hanh, Phuc Do, and Benoit Iung. "Maintenance optimization for multi-component system with structural dependence: Application to machine tool sub-system." CIRP Annals - Manufacturing Technology 69, (2020): 417-420.
Liu, Bin, Mahesh D. Pandey, Xiaolin Wang, and Xiujie Zhao. "A finite-horizon condition-based maintenance policy for a two-unit system with dependent degradation processes." European Journal of Operational Research  265, no. 2 (2021): 705-717.
Zhang, Ping, Xiaoyan Zhu, and Min Xie. "A model-based reinforcement learning approach for maintenance optimization of degrading systems in a large state space." Computers & Industrial Engineering 161, no. 7 (2021): 107622.
Taji, Jalal, Hiwa Farughi, and Hasan Rasay. "A new approach to preventive maintenance planning considering non-failure stops and failure interdependence between components." Advances in Industrial Engineering 56, no. 2 (2022): 231-249.
Yeardley, Aaron S., Jude O. Ejeh, Louis Allen, Solomon F. Brown, and joan Cordiner. "Integrating machine learning techniques into optimal maintenance scheduling." Computers and Chemical Engineering 166, (2022): 107958.
Rasay, Hasan, Farnoosh Naderkhani, and Amir Mohammad Golmohammadi. "Reinforcement Learning based on Stochastic Dynamic Programming for Condition-based Maintenance of Deteriorating Production Processes." IEEE International Conference on Prognostics and Health Management (ICPHM), Detroit (Romulus), MI, USA (2018).
Yilmaz, Ibrahim, Babek Erdebilli, Mehdi Amine Naji, and Ahmed Mousrij. "A Fuzzy DEMATEL framework for maintenance performance improvement: A case of Moroccan Chemical Industry." Journal of Engineering Research 11, (2023): 100019.
Zhao, Xiujie, Bin Liu, Jianyu Xu, and Xiao-Lin Wang. "Imperfect Maintenance Policies for Warranted Products Under Stochastic Performance Degradation." European Journal of Operational Research 308, no. 1 (2023): 150:165.
Duffuaa, Salih, Mohamed Idris, Ahmet Kolus, and Umar Al-Turki. "A mathematical model for optimal turnaround maintenance planning and scheduling for a network of plants in process industry supply chain." Computers & Chemical Engineering 180, (2024): 108477.
Santos, Cleiton Ferreira dos, Eduardo de Freitas Rocha Loures, and  Eduardo Alves Portela Santos. "A smart framework to perform a criticality analysis in industrial maintenance using combined MCDM methods and process mining techniques." The International Journal of Advanced Manufacturing Technology 132, (2024).
Yildirim, Mehmet Bayram, and Farnaz Ghazi Nezami. "Integrated maintenance and production planning with energy consumption and minimal repair." The International Journal of Advanced Manufacturing Technology 74, (2014): 1419-1430.
Bajestani, Maliheh Aramon, Dragan Banjevic, and J. Christopher Beck. "Integrated maintenance planning and production scheduling with Markovian deteriorating machine conditions." International Journal of Production Research 52, no. 24 (2014): 7377-7400.
Aghezzaf, El-Houssaine, Phuoc Le Tam, and Abdelhakim Khatab. "Optimizing Production and Imperfect Preventive Maintenance Planning's Integration in Failure-Prone Manufacturing Systems." Reliability Engineering and System Safety 145, (2015): 190-198.
Desforges, Xavier, Mickael Dievart, and Bernard Archimede. "A prognostic function for complex systems to support production and maintenance co-operative planning based on an extension of object-oriented Bayesian networks." Computers in Industry 86, (2017): 34-51.
Hajej, Zied, Nidhal Rezg, and Tarek Askri. "Joint optimization of capacity, production and maintenance planning of leased machines." Journal of Intelligent Manufacturing 31, (2018): 351-374.
Alimian, Mahyar, Mohammad Saidi-Mehrabad, and Armin Jabbarzadeh. "A robust integrated production and preventive maintenance planning model for multi-state systems with uncertain demand and common cause failures." Journal of Manufacturing Systems 50, (2019): 263-277.
Xu, Shengliang, Wenquan Dong, Mingzhou Jin, and Liya Wang. "Single-Machine Scheduling with Fixed or Flexible Maintenance." Computers & Industrial Engineering 139, (2019): 106203.
Qinming, Liu, Dong Ming, Chen F.F., Lv Wenyuan, and Ye Chunming. "Single-machine-based joint optimization of predictive maintenance planning and production scheduling." Robotics and Computer Integrated Manufacturing 51, (2018): 238-247.
Liu, Bin, Kangzhe He, and Min Xie. "Integrated production and maintenance planning for a deteriorating system under uncertain demands." IFAC-Papers OnLine 53, no. 3 (2020): 222-226.
Uit het Broek, Michiel A.J., Ruud H. Teunter, Bram de Jonge, and Jasper Veldman. "Joint condition-based maintenance and condition-based production optimization." Reliability Engineering and System Safety 214, (2021): 107743.
Sharifi, Mani, and Sharareh Taghipour. "Optimal production and maintenance scheduling for a degrading multi-failure modes single-machine production environment." Applied Soft Computing 106, (2021): 107312.
Leo, Egidio, and Sebastian Engell. "Handling Type-I and Type-II endogenous uncertainties in simultaneous production planning and condition-based maintenance optimization in continuous production." Computers and Chemical Engineering 174, (2023): 108227.
Bahou, Ziyad, Mohamed Reda Lemnaouar, and Issam Krimi. "Integrated non-cyclical preventive maintenance scheduling and production planning for multi-parallel component production systems with interdependencies-induced degradation." The International Journal of Advanced Manufacturing Technology 130 (2024): 4723-4749.
Zhang, Nan, Kaiquan Cia, Yingjun Deng, and Jun Zhang. "Joint optimization of condition-based maintenance and condition-based production of a single equipment considering random yield and maintenance delay." Reliability Engineering & System Safety 241, (2024): 109694.
Koopmans, Marco, and Bram de Jonge. "Condition-based maintenance and production speed optimization under limited maintenance capacity." Computers & Industrial Engineering 179, (2023): 109155.
Rechard S. Sutton, and Andrew G. Barto. Reinforcement learning: an introduction. The MIT Press, 2018.