Skip to content
www.H-U-M-A-N-O-I-D.com

The most valuable Humanoid domain name in the world

THIS DOMAIN IS FOR SALE

WORLDWIDE THIS IS THE MOST SOUGHT AFTER DOMAIN IN THE INDUSTRY

Primary Menu
  • About us
  • Privacy Policy
Humanoid Shop coming soon
  • Home
  • 2026
  • October
  • 2
  • Noise Scheduling and Out-of-Distribution Generalisation in Deep Reinforcement Learning for 6-DOF Robotic Grasping
  • Humanoids and AI

Noise Scheduling and Out-of-Distribution Generalisation in Deep Reinforcement Learning for 6-DOF Robotic Grasping

The humans behind H-u-m-a-n-o-i-d.com October 2, 2026 2 min read
Noise Scheduling and Out-of-Distribution Generalisation in Deep Reinforcement Learning for 6-DOF Robotic Grasping

Welcome to nature.com. We appreciate your visit. If you are experiencing limitations in viewing due to your current browser version with limited CSS support, we recommend using a more updated browser for the best experience. Alternatively, switching off compatibility mode in Internet Explorer may also help. While we work to ensure continued support, please note that the site is displayed without styles and JavaScript.

This article from Scientific Reports (2026) is being shared in advance to offer expedited access to peer-reviewed research. It is citable and includes a permanent DOI. Please be aware that this version is subject to further revisions and will eventually be replaced by the final Version of Record. All standard legal disclaimers apply.

This study focuses on the exploration strategy in deep reinforcement learning for robotic manipulation. The research compares three off-policy configurations for a 6-degree-of-freedom robotic grasping task using a Universal Robots UR5e in the RoboSuite simulation environment. The configurations studied are Soft Actor-Critic (SAC) with automatic entropy tuning, Twin Delayed Deep Deterministic Policy Gradient (TD3) with piecewise linear noise decay, and TD3 with constant Gaussian noise. They all have identical network architectures, reward functions, and training budgets.

Throughout 10,000 episodes across five independent runs, each configuration was trained and evaluated over 1,000 deterministic episodes within and beyond the training distribution. SAC demonstrated the highest success rate (89.6%) within the training distribution, along with superior training efficiency compared to both TD3 variants, which were statistically similar within the training distribution. However, under out-of-distribution evaluation, the noise-decay variant outperformed the constant noise variant significantly.

The study emphasizes that the design of noise schedules has a notable impact on both in-distribution performance and spatial out-of-distribution generalization. The research suggests that standard evaluation protocols may not effectively capture the differences between exploration strategies. The authors acknowledge Prof. Dushko Stavrov for his contributions and are affiliated with the Faculty of Electrical Engineering and Information Technologies, Ss. Cyril and Methodius University in Skopje, North Macedonia.

This article is licensed under a Creative Commons Attribution 4.0 International License, allowing for sharing, adaptation, and distribution with appropriate credit. For further details on usage permissions, please refer to the full license available at http://creativecommons.org/licenses/by/4.0/. For citation and additional information, please access the article through the provided DOI link.

For more insights on AI and Robotics research, consider signing up for the Nature Briefing: AI and Robotics newsletter, delivering the latest updates weekly to your inbox.

About the Author

The humans behind H-u-m-a-n-o-i-d.com

Author

Visit Website View All Posts

Post navigation

Previous: Nvidia Alumni Driving a New Era of Robotics and AI Startups
Next: Tesla Struggles to Achieve Production Goal for Optimus Robots

Related News

Neuron AI: The Brain of the Physical World
2 min read
  • Humanoids and AI

Neuron AI: The Brain of the Physical World

The humans behind H-u-m-a-n-o-i-d.com October 19, 2026 0
Amap Launches Upgraded ABot System for AI Robots
2 min read
  • Humanoids and AI

Amap Launches Upgraded ABot System for AI Robots

The humans behind H-u-m-a-n-o-i-d.com October 8, 2026 0
Blockly Pro Enhances Coding Experience with Python Integration
2 min read
  • Humanoids and AI

Blockly Pro Enhances Coding Experience with Python Integration

The humans behind H-u-m-a-n-o-i-d.com October 7, 2026 0

Recent Posts

  • Optimizing Design for Social Robots: Enhancing Emotional Appeal through Face and Voice Considerations
  • Neuron AI: The Brain of the Physical World
  • WeTouch Technology Expands into Robot Human-Machine Interaction Sector with Anhui Moke Robot Partnership
  • Advancing Robotics, AI, and Computer Vision to Elevate Customer Experience (CX)
  • UBTECH Unveils New Factory for Producing 10,000 Humanoid Robots Annually

Recent Comments

No comments to show.

Archives

  • October 2026
  • September 2026
  • August 2026
  • July 2026
  • June 2026
  • May 2026
  • April 2026
  • March 2026
  • February 2026
  • January 2026
  • December 2025

Categories

  • General
  • Humanoid Robots
  • Humanoids and AI
  • Humanoids and Humans
  • Humanoids Development
  • Humanoids for Sale
  • Uncategorized

You may have missed

Optimizing Design for Social Robots: Enhancing Emotional Appeal through Face and Voice Considerations
3 min read
  • Humanoids and Humans

Optimizing Design for Social Robots: Enhancing Emotional Appeal through Face and Voice Considerations

The humans behind H-u-m-a-n-o-i-d.com October 20, 2026 0
Neuron AI: The Brain of the Physical World
2 min read
  • Humanoids and AI

Neuron AI: The Brain of the Physical World

The humans behind H-u-m-a-n-o-i-d.com October 19, 2026 0
WeTouch Technology Expands into Robot Human-Machine Interaction Sector with Anhui Moke Robot Partnership
2 min read
  • Humanoids and Humans

WeTouch Technology Expands into Robot Human-Machine Interaction Sector with Anhui Moke Robot Partnership

The humans behind H-u-m-a-n-o-i-d.com October 16, 2026 0
Advancing Robotics, AI, and Computer Vision to Elevate Customer Experience (CX)
2 min read
  • General

Advancing Robotics, AI, and Computer Vision to Elevate Customer Experience (CX)

The humans behind H-u-m-a-n-o-i-d.com October 16, 2026 0