Skip to content
www.H-U-M-A-N-O-I-D.com

The most valuable Humanoid domain name in the world

THIS DOMAIN IS FOR SALE

WORLDWIDE THIS IS THE MOST SOUGHT AFTER DOMAIN IN THE INDUSTRY

Primary Menu
  • About us
  • Privacy Policy
Humanoid Shop coming soon
  • Home
  • 2026
  • September
  • 23
  • Modeling and Control of Bio-Inspired Aerial Robots using Reinforcement Learning
  • Humanoids and AI

Modeling and Control of Bio-Inspired Aerial Robots using Reinforcement Learning

The humans behind H-u-m-a-n-o-i-d.com September 23, 2026 2 min read
Modeling and Control of Bio-Inspired Aerial Robots using Reinforcement Learning

Bio-inspired aerial robots, which mimic flight techniques observed in birds and insects, offer distinct advantages over traditional UAVs in challenging maneuvers like perching. During perching, the vehicle is required to approach a target and reduce most of its kinetic energy within a short distance. The control of these systems is intricate due to their nonlinear dynamics, strong connection between translation and rotation, and aerodynamic variations caused by their variable wing and tail structures.

Conventional control methods based on linear models have limitations in such scenarios, prompting the exploration of alternative strategies based on reinforcement learning. The primary objective of this Master’s Thesis is to create and assess a modeling and control system for a bio-inspired aerial robot utilizing deep reinforcement learning to analyze its capability in executing approach and perching maneuvers. The study is built upon the foundational research by Wüest et al., employing a simplified two-dimensional longitudinal model to focus on key variables: position, velocity, pitch attitude, and angle of attack.

A simulation environment compatible with Gymnasium and Stable-Baselines3 was established to define the observation space, action space, reward function, and episode termination criteria. Two reinforcement learning algorithms, Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC), were trained and compared within this framework. Additionally, different success margins’ impacts on the learned control behavior were examined.

The outcomes reveal that both algorithms successfully learn control policies for perching, demonstrating coherent behaviors like decreased forward velocity, increased pitch angle and angle of attack in the final phase, and coordinated actions between thrust, elevator deflection, and variable wing and tail morphology. PPO exhibits consistent performance for various success margins, while SAC displays enhanced robustness, generating smoother trajectories under stricter conditions. However, a limitation is recognized where the final vehicle velocity remains around 4 m/s in most scenarios, depicting a controlled approach rather than a complete stop during perching.

In conclusion, this study showcases that deep reinforcement learning serves as a flexible and viable framework for investigating approach and perching strategies in bio-inspired aerial robots. Furthermore, it sets the groundwork for future advancements towards three-dimensional models, improved reward systems, and potential implementation on real robotic platforms.

About the Author

The humans behind H-u-m-a-n-o-i-d.com

Author

Visit Website View All Posts

Post navigation

Previous: Global Sales of Humanoid Robots Hit Record 7,000 Last Year
Next: Exploring the Potential Roles of Humanoid Robots in Warfare

Related News

Neuron AI: The Brain of the Physical World
2 min read
  • Humanoids and AI

Neuron AI: The Brain of the Physical World

The humans behind H-u-m-a-n-o-i-d.com October 19, 2026 0
Amap Launches Upgraded ABot System for AI Robots
2 min read
  • Humanoids and AI

Amap Launches Upgraded ABot System for AI Robots

The humans behind H-u-m-a-n-o-i-d.com October 8, 2026 0
Blockly Pro Enhances Coding Experience with Python Integration
2 min read
  • Humanoids and AI

Blockly Pro Enhances Coding Experience with Python Integration

The humans behind H-u-m-a-n-o-i-d.com October 7, 2026 0

Recent Posts

  • Optimizing Design for Social Robots: Enhancing Emotional Appeal through Face and Voice Considerations
  • Neuron AI: The Brain of the Physical World
  • WeTouch Technology Expands into Robot Human-Machine Interaction Sector with Anhui Moke Robot Partnership
  • Advancing Robotics, AI, and Computer Vision to Elevate Customer Experience (CX)
  • UBTECH Unveils New Factory for Producing 10,000 Humanoid Robots Annually

Recent Comments

No comments to show.

Archives

  • October 2026
  • September 2026
  • August 2026
  • July 2026
  • June 2026
  • May 2026
  • April 2026
  • March 2026
  • February 2026
  • January 2026
  • December 2025

Categories

  • General
  • Humanoid Robots
  • Humanoids and AI
  • Humanoids and Humans
  • Humanoids Development
  • Humanoids for Sale
  • Uncategorized

You may have missed

Optimizing Design for Social Robots: Enhancing Emotional Appeal through Face and Voice Considerations
3 min read
  • Humanoids and Humans

Optimizing Design for Social Robots: Enhancing Emotional Appeal through Face and Voice Considerations

The humans behind H-u-m-a-n-o-i-d.com October 20, 2026 0
Neuron AI: The Brain of the Physical World
2 min read
  • Humanoids and AI

Neuron AI: The Brain of the Physical World

The humans behind H-u-m-a-n-o-i-d.com October 19, 2026 0
WeTouch Technology Expands into Robot Human-Machine Interaction Sector with Anhui Moke Robot Partnership
2 min read
  • Humanoids and Humans

WeTouch Technology Expands into Robot Human-Machine Interaction Sector with Anhui Moke Robot Partnership

The humans behind H-u-m-a-n-o-i-d.com October 16, 2026 0
Advancing Robotics, AI, and Computer Vision to Elevate Customer Experience (CX)
2 min read
  • General

Advancing Robotics, AI, and Computer Vision to Elevate Customer Experience (CX)

The humans behind H-u-m-a-n-o-i-d.com October 16, 2026 0