Lightweight Safe Reinforcement Learning for End-to-End UAV Navigation - arXiv 2607.01794v1 - Abstract

Sep 21, 2026

Rapid autonomous aerial systems increasingly rely on UAVs for inspection, environmental monitoring, and rescue, yet dense-environment navigation remains difficult when perception is sparse and dynamic constraints are present. Most reinforcement learning methods do not include explicit safety, causing unsafe exploration and unstable training, especially at high speed. Even safe RL often relies on projection to a safe action set, which can destabilize policy learning. The work proposes a safety-constrained perception-control framework using a lightweight sparse-observation encoder, hierarchical constrained MDP formulation, and Lagrangian-based safe PPO with curriculum learning.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages8

Reading Time20 min

AccessFree to download

I. INTRODUCTION

UAV autonomous navigation overview

Key challenges and research gap

II. RELATED WORK

Deep reinforcement learning for UAV navigation

PPO, hybrid frameworks, and end-to-end RL

Lightweight Safe Reinforcement Learning for End-to-End UAV Navigation Shenghui Zhang, YuXuan Gao, Songwei Zhao, Jifeng Hu, Zijing Zhang, and Hechang Chen arXiv :2607 .0 1794v 1 [ cs .RO] 2 Jul 2026 Abstract—With the rapid development of autonomous aerial systems, Unmanned Aerial Vehicles (UAVs) are increasingly deployed in applications such as inspection, environmental monitoring, and rescue, creating growing demand for reliable autonomous navigation. However, autonomous UAV navigation in dense environments remains challenging under sparse perception and dynamic constraints. Most reinforcement learning (RL) methods lack explicit safety mechanisms, leading to unsafe exploration, unstable training, and risky behaviors, especially during high-speed flight. Even in safe RL approaches, safety is often enforced by projecting policy outputs onto a safe action set, which may introduce instability. Meanwhile, many learning-based methods rely on dense inputs or large networks, increasing computational burden and limiting lightweight onboard deployment. Facing the above challenges, we propose a safety-constrained perception-control integrated framework for UAV navigation. A lightweight network encodes sparse observations into collision-risk-aware features using asymmetric and depthwise separable convolutions. We formulate the task as a constrained Markov decision process within a hierarchical control architecture and solve it using a Lagrangian-based safe PPO algorithm. Curriculum learning further improves training stability. Experiments with varying obstacle densities and flight speeds demonstrate higher success rates, improved safety, and better efficiency than existing reinforcement learning baselines. I. INTRODUCTION With the rapid development of avionics, sensing technologies, and intelligent control, Unmanned Aerial Vehicles (UAVs) have been widely deployed in applications, such as aerial inspection, logistics delivery, and emergency response [1], [2] . In recent years, the rapid growth of the low-altitude economy has further expanded UAV application scenarios, which also places higher requirements on autonomous flight and safe navigation capabilities in complex environments. Recent studies on UAV autonomous navigation can be broadly categorized into model-based planning methods and learning-based approaches. Classical planning algorithms, such as A*, RRT, and their variants, generate collisionfree trajectories using known or reconstructed environment maps and have demonstrated strong performance in structured environments [1], [3], [4] . However, in complex and unstructured scenarios with dense obstacles and incomplete perception, these methods often suffer from limited robustness and high computational cost due to frequent replanning. Reactive control and learning-based approaches have been introduced to address these limitations.In particular, reinforcement learning (RL) enables UAV to learn navigation policies directly through environment interaction and has shown promising results using algorithms such as DQN [2], DDPG [5], TD3 [6], SAC [7], and PPO [8] . Meanwhile, LiDAR-based perception has been widely adopted due to its robustness to illumination changes and accurate geometric sensing [3], [9] . Several studies leverage raw range measurements or transformed representations (e.g., polar maps or depth images) as inputs to policy networks, enabling endto-end obstacle avoidance [7], [8] . Despite these advances, several challenges remain unsolved, especially under sparse perception and high-speed navigation conditions. First, existing approaches rely on dense sensory inputs or high-capacity neural networks, which limits their deployment on resource-constrained onboard platforms and increases training complexity. Second, sparse LiDAR observations often fail to explicitly highlight highrisk regions in cluttered environments, making policy training unstable and reducing generalization ability. Finally, most RL fr

FAQs

What main problem does the document address for UAV navigation?

It addresses unsafe exploration and unstable training in dense environments where UAV perception is sparse and flight is high-speed.

How does the proposed method improve safety compared with typical RL approaches?

It formulates navigation as a safety-constrained, hierarchical constrained Markov decision process and solves it with a Lagrangian-based safe PPO algorithm rather than relying only on implicit or projected safety.

What makes the approach suitable for lightweight onboard deployment?

A lightweight perception network encodes sparse observations into collision-risk-aware features using asymmetric and depthwise separable convolutions, reducing computational burden.

Sep 21, 2026

Uploaded by Emma Wilson