MyJournals Home  

RSS FeedsRemote Sensing, Vol. 12, Pages 640: Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning (Remote Sensing)

 
 

14 february 2020 19:03:26

 
Remote Sensing, Vol. 12, Pages 640: Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning (Remote Sensing)
 




In this paper, a novel deep reinforcement learning (DRL) method, and robust deep deterministic policy gradient (Robust-DDPG), is proposed for developing a controller that allows robust flying of an unmanned aerial vehicle (UAV) in dynamic uncertain environments. This technique is applicable in many fields, such as penetration and remote surveillance. The learning-based controller is constructed with an actor-critic framework, and can perform a dual-channel continuous control (roll and speed) of the UAV. To overcome the fragility and volatility of original DDPG, three critical learning tricks are introduced in Robust-DDPG: (1) Delayed-learning trick, providing stable learnings, while facing dynamic environments; (2) adversarial attack trick, improving policy’s adaptability to uncertain environments; (3) mixed exploration trick, enabling faster convergence of the model. The training experiments show great improvement in its convergence speed, convergence effect, and stability. The exploiting experiments demonstrate high efficiency in providing the UAV a shorter and smoother path. While, the generalization experiments verify its better adaptability to complicated, dynamic and uncertain environments, comparing to Deep Q Network (DQN) and DDPG algorithms.


Del.icio.us Digg Facebook Google StumbleUpon Twitter
 
20 viewsCategory: Geology, Physics
 
Remote Sensing, Vol. 12, Pages 641: Characterizing and Mitigating Sensor Generated Spatial Correlations in Airborne Hyperspectral Imaging Data (Remote Sensing)
Remote Sensing, Vol. 12, Pages 639: Phenological Dynamics Characterization of Alignment Trees with Sentinel-2 Imagery: A Vegetation Indices Time Series Reconstruction Methodology Adapted to Urban Areas (Remote Sensing)
 
 
blog comments powered by Disqus


MyJournals.org
The latest issues of all your favorite science journals on one page

Username:
Password:

Register | Retrieve

Search:

Physics

Use these buttons to bookmark us:
Del.icio.us Digg Facebook Google StumbleUpon Twitter


Valid HTML 4.01 Transitional
Copyright © 2008 - 2020 Indigonet Services B.V.. Contact: Tim Hulsen. Read here our privacy notice.
Other websites of Indigonet Services B.V.: Nieuws Vacatures News Tweets Travel Photos Nachrichten Indigonet Finances Leer Mandarijn