The purpose of this study is to enhance the maintenance performance of Automated Guided Vehicles (AGVs) in Industry 4.0 settings by developing an intelligent decision-making model. This model seeks to reduce corrective maintenance time and improve the reliability and productivity of AGVs through the implementation of optimized preventive and predictive maintenance strategies.
This research utilizes reinforcement learning to train a policy agent for optimizing maintenance decision-making for AGVs. The agent determines the optimal timing and type of maintenance actions, including preventive and predictive maintenance, with the aim of reducing corrective maintenance time and improving system reliability. In this study, the locations of the maintenance site and AGV charging station are predefined and examined through three alternative spatial scenarios to evaluate their effects on AGV performance. The model also incorporates buffer capacity constraints and combines simulation-based modeling with learning-based optimization to reflect real-world operational conditions in smart manufacturing environments.
The results demonstrate that the reinforcement learning agent can significantly reduce downtime and enhance AGV operational performance. Furthermore, the spatial configuration of maintenance site and AGV charging station has a measurable impact on system reliability and cost-efficiency. The integration of predictive maintenance strategies into the agent's learning process further stabilizes system operation and improves long-term equipment health.
This study is limited to simulation-based validation and does not account for real-time uncertainties such as unexpected human intervention or sensor failures. Future research should focus on real-world implementation and consider multi-agent collaboration for fleet-level optimization.
The proposed framework can assist manufacturing firms in reducing maintenance costs and unplanned downtime while improving scheduling accuracy. It provides a decision-support tool for operations managers looking to implement intelligent maintenance within Industry 4.0 infrastructures.
This paper introduces a novel application of reinforcement learning to maintenance policy planning for AGVs, considering spatial and operational constraints. It offers value to both researchers and practitioners in the field of smart manufacturing, maintenance optimization, and AI-based industrial systems.
- -
Consideration of the manufacturing in Industry 4.0 area and implementation of predictive maintenance policies for AGVs.
- -
Attention to workload in planning preventive and predictive maintenance strategies.
- -
Simultaneous implementation of the PPO reinforcement learning algorithm for both preventive and predictive maintenance policies for AGVs.
- -
Determining the application of the PPO algorithm in the implementation of maintenance policies and optimizing the location of the maintenance site and AGV charging station of automated guided vehicles.
- -
Analyzing and investigation of multi-AGV systems in order to determine the most efficient mode that has the most functionality and the least time for maintenance.
