Welcome to nature.com. Your current browser version has limited support for CSS, which may restrict your browsing experience. We recommend using an updated browser for the best experience or disabling compatibility mode in Internet Explorer. While we are currently displaying the site without styles and JavaScript, we strive for continued support.
Scientific Reports has published an article on an innovative framework designed to address challenges faced by intelligent robots in perceiving high-dimensional environmental states and making adaptive trajectory planning decisions in complex topological environments. This framework integrates Graph Neural Network–Reinforcement Learning (GNN-RL) based on the Soft Actor-Critic (SAC) algorithm for continuous control tasks.
The paper abstracts environmental entities into graph nodes, encoding their spatial constraints and semantic associations as edge features through multi-layer graph convolution and adaptive edge weighting. This compression of high-dimensional environmental information into low-dimensional embeddings enhances structured environmental cognition, aiding efficient action selection and alleviating dimensionality challenges.
A dynamic collaborative mechanism between the GNN encoder and SAC-based RL agent is established, where topological features extracted by the GNN influence the twin Q-networks, policy network, and value network of the RL agent. A multi-objective reward function guides the agent’s exploration, incorporating safety, progress, and motion smoothness objectives.
The GNN-RL approach undergoes comprehensive comparative experiments in simulated complex topological environments, demonstrating superior perception accuracy and decision-making efficiency compared to DQN, PPO, and A* algorithms. This method offers a reliable and adaptive solution for robot navigation and trajectory planning in dynamic environments.
The study received funding from various organizations and was conducted at the School of Intelligent Manufacturing and Mechanical Engineering, Hunan Institute of Technology, China. The authors declare no competing interests. The article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, permitting non-commercial sharing, distribution, and reproduction with appropriate credit given to the original author and source.
For further details, you can find the article titled “GNN enhanced reinforcement learning for robot navigation in complex topological networks” by Zhang and Du in Scientific Reports. DOI: https://doi.org/10.1038/s41598-026-51938-5.
Stay informed about AI and robotics research by signing up for the Nature Briefing newsletter. Thank you for engaging with our content.
About the Author
