A two-stage robust rescheduling for flexible job shop based on release time prediction using a Q-learning-based hyper-heuristic evolutionary algorithm

Wenyu Zhang; Sihan Yang; Wanru Wang; Xinyi Ding; Yushu Yang

doi:10.1016/j.engappai.2026.114766

journal article Jul 01, 2026

A two-stage robust rescheduling for flexible job shop based on release time prediction using a Q-learning-based hyper-heuristic evolutionary algorithm

Wenyu Zhang

Sihan Yang Wanru Wang

Xinyi Ding Yushu Yang

Engineering Applications of Artificial Intelligence Vol. 176 pp. 114766 · Elsevier BV

View at Publisher Save 10.1016/j.engappai.2026.114766

Topics

No keywords indexed for this article. Browse by subject →

References

33

[1]

Abd Elaziz "A hyper-heuristic for improving the initial population of whale optimization algorithm" Knowl. Base Syst. (2019) 10.1016/j.knosys.2019.02.010

[2]

Ahmadi "A multi objective optimization approach for flexible job shop scheduling problem under random machine breakdown by evolutionary algorithms" Comput. Oper. Res. (2016) 10.1016/j.cor.2016.03.009

[3]

An "Multiobjective flexible job-shop rescheduling with new job insertion and machine preventive maintenance" IEEE Trans. Cybern. (2022) 10.1109/tcyb.2022.3151855

[4]

Baykasoğlu "Greedy randomized adaptive search for dynamic flexible job-shop scheduling" J. Manuf. Syst. (2020) 10.1016/j.jmsy.2020.06.005

[5]

Caldeira "An effective backtracking search algorithm for multi-objective flexible job shop scheduling considering new job arrivals and energy consumption" Comput. Ind. Eng. (2020) 10.1016/j.cie.2020.106863

[6]

Cevikcan "An integrated job release and scheduling approach on parallel machines: an application in electric wire-harness industry" Comput. Ind. Eng. (2014) 10.1016/j.cie.2014.08.012

[7]

Chen "A Q-Learning based NSGA-II for dynamic flexible job shop scheduling with limited transportation resources" Swarm Evol. Comput. (2024) 10.1016/j.swevo.2024.101658

[8]

Chen "A genetic programming based cooperative evolutionary algorithm for flexible job shop with crane transportation and setup times" Appl. Soft Comput. (2024)

[9]

Cheng "Multi-objective Q-learning-based hyper-heuristic with Bi-criteria selection for energy-aware mixed shop scheduling" Swarm Evol. Comput. (2022) 10.1016/j.swevo.2021.100985

[10]

Flexible job shop scheduling problem under Industry 5.0: A survey on human reintegration, environmental consideration and resilience improvement

Candice Destouet, Houda Tlahig, Belgacem Bettayeb et al.

Journal of Manufacturing Systems 2023 10.1016/j.jmsy.2023.01.004

[11]

Echeverria "Diverse policy generation for the flexible job-shop scheduling problem via deep reinforcement learning with a novel graph representation" Eng. Appl. Artif. Intell. (2025) 10.1016/j.engappai.2024.109488

[12]

Fan "Flexible job shop scheduling with stochastic machine breakdowns by an improved tuna swarm optimization algorithm" J. Manuf. Syst. (2024) 10.1016/j.jmsy.2024.03.002

[13]

Fontes "Energy-efficient job shop scheduling problem with transport resources considering speed adjustable resources" Int. J. Prod. Res. (2023) 10.1080/00207543.2023.2175172

[14]

Gölcük "Q-learning and hyper-heuristic based algorithm recommendation for changing environments" Eng. Appl. Artif. Intell. (2021) 10.1016/j.engappai.2021.104284

[15]

Han "Evolutionary multiobjective blocking lot-streaming flow shop scheduling with machine breakdowns" IEEE Trans. Cybern. (2017) 10.1109/tcyb.2017.2771213

[16]

Hasan "Genetic algorithm for job-shop scheduling with machine unavailability and breakdowns" Int. J. Prod. Res. (2011) 10.1080/00207543.2010.495088

[17]

Ji "Q-learning-based hyperheuristic evolutionary algorithm for dynamic task allocation of crowdsensing" IEEE Trans. Cybern. (2021) 10.1109/tcyb.2021.3112675

[18]

Li "Joint scheduling optimisation method for the machining and heat-treatment of hydraulic cylinders based on improved multi-objective migrating birds optimisation" J. Manuf. Syst. (2024) 10.1016/j.jmsy.2024.01.011

[19]

Liu "Deep reinforcement learning for dynamic scheduling of a flexible job shop" Int. J. Prod. Res. (2022) 10.1080/00207543.2022.2058432

[20]

Lu "A double deep q-network framework for a flexible job shop scheduling problem with dynamic job arrivals and urgent job insertions" Eng. Appl. Artif. Intell. (2024) 10.1016/j.engappai.2024.108487

[21]

Luo "Dynamic scheduling for flexible job shop with new job insertions by deep reinforcement learning" Appl. Soft Comput. (2020) 10.1016/j.asoc.2020.106208

[22]

Mihoubi "Reactive scheduling approach for solving a realistic flexible job shop scheduling problem" Int. J. Prod. Res. (2021) 10.1080/00207543.2020.1790686

[23]

Nie "A GEP-based reactive scheduling policies constructing approach for dynamic flexible job shop scheduling problem with job release dates" J. Intell. Manuf. (2013) 10.1007/s10845-012-0626-9

[24]

Tliba "Digital twin-driven dynamic scheduling of a hybrid flow shop" J. Intell. Manuf. (2023) 10.1007/s10845-022-01922-3

[25]

Wang "Edge computing-based real-time scheduling for digital twin flexible job shop with variable time window" Robot. Comput. Integrated Manuf. (2023) 10.1016/j.rcim.2022.102435

[26]

Xiong "Comparison study of dispatching rules and heuristics for online scheduling of single machine scheduling problem with predicted release time jobs" Expert Syst. Appl. (2024) 10.1016/j.eswa.2023.122752

[27]

Xiong "Robust scheduling for multi-objective flexible job-shop problems with random machine breakdowns" Int. J. Prod. Econ. (2013) 10.1016/j.ijpe.2012.04.015

[28]

Yan "Solving the multi-robot task allocation with functional tasks based on a hyper-heuristic algorithm" Appl. Soft Comput. (2023) 10.1016/j.asoc.2023.110628

[29]

Zhang "A review of robust machine scheduling" IEEE Trans. Autom. Sci. Eng. (2023) 10.1109/tase.2023.3246223

[30]

Zhang "A hybrid multi-objective approach for real-time flexible production scheduling and rescheduling under dynamic environment in Industry 4.0 context" Comput. Oper. Res. (2021) 10.1016/j.cor.2021.105267

[31]

Scenario-Based Robust Remanufacturing Scheduling Problem Using Improved Biogeography-Based Optimization Algorithm

Wenyu Zhang, Jiaxuan Shi, Mengjiao Chen

IEEE Transactions on Systems, Man, and Cybernetics... 2022 10.1109/tsmc.2022.3225443

[32]

Zhang "Q-learning-based hyper-heuristic evolutionary algorithm for the distributed assembly blocking flowshop scheduling problem" Appl. Soft Comput. (2023) 10.1016/j.asoc.2023.110695

[33]

Zhao "A hyperheuristic with Q-learning for the multiobjective energy-efficient distributed blocking flow shop scheduling problem" IEEE Trans. Cybern. (2022) 10.1109/tcyb.2022.3192112

Metrics

0

Citations

33

References

Details

Published: Jul 01, 2026
Vol/Issue: 176
Pages: 114766
License: View

Authors

W

Wenyu Zhang

School of Information, Zhejiang University of Finance and Economics, Hangzhou 310018, China

Cite This Article

Wenyu Zhang, Sihan Yang, Wanru Wang, et al. (2026). A two-stage robust rescheduling for flexible job shop based on release time prediction using a Q-learning-based hyper-heuristic evolutionary algorithm. Engineering Applications of Artificial Intelligence, 176, 114766. https://doi.org/10.1016/j.engappai.2026.114766

A two-stage robust rescheduling for flexible job shop based on release time prediction using a Q-learning-based hyper-heuristic evolutionary algorithm

You May Also Like