Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

Citations Over TimeTop 13% of 2019 papers

Abstract

Autonomous driving promises to be the main trend in the future intelligent transportation systems due to its potentiality for energy saving, and traffic and safety improvements. However, traditional autonomous vehicles’ behavioral decisions face consistency issues between behavioral decision and trajectory planning and shows a strong dependence on the human experience. In this paper, we present a planning-feature-based deep behavior decision method (PFBD) for autonomous driving in complex, dynamic traffic. We used a deep reinforcement learning (DRL) learning framework with the twin delayed deep deterministic policy gradient algorithm (TD3) to exploit the optimal policy. We took into account the features of topological routes in the decision making of autonomous vehicles, through which consistency between decision making and path planning layers can be guaranteed. Specifically, the features of a route extracted from path planning space are shared as the input states for the behavioral decision. The actor-network learns a near-optimal policy from the feasible and safe candidate emulated routes. Simulation tests on three typical scenarios have been performed to demonstrate the performance of the learning policy, including the comparison with a traditional rule-based expert algorithm and the comparison with the policy considering partial information of a contour. The results show that the proposed approach can achieve better decisions. Real-time test on an HQ3 (HongQi the third ) autonomous vehicle also validated the effectiveness of PFBD.

Related Papers

• → AEG: Automatic Exploit Generation(2018)209 cited
• → PExy: The Other Side of Exploit Kits(2014)24 cited
• → Automated Crash Analysis and Exploit Generation with Extendable Exploit Model(2022)4 cited
• → AEMB: An Automated Exploit Mitigation Bypassing Solution(2021)5 cited
• Evaluation of Two Host-Based Intrusion Prevention Systems(2005)