Self-organized routing for autonomous vehicles via deep reinforcement learning

Abstract

Routing for autonomous vehicles with global traffic information and sufficient direct cooperation among vehicles has been widely studied to relieve traffic congestion in recent years. However, the assembly rate of Vehicle-to-Everything (V2X) equipment in practical traffic systems is currently and could be at a low level in near future. Accordingly, autonomous vehicles can only access localized traffic information, and direct cooperation among them cannot always be guaranteed. Thus, how to optimize the routing choices in such scenarios is worthy of particular attention. In this paper, we propose a self-organized routing strategy based on deep reinforcement learning (DRL). Under the condition of limited traffic information, the proposed self-organized mechanism well organizes localized traffic conditions through vehicle-level routing decisions, which are able to achieve network-wide benefits gains. In the specified DRL, we propose a novel reward mechanism to harmonize indirect interactions among vehicles by jointly learning individual and overall efficiency, even if each vehicle is modified to make individual decisions independently, rather than only focusing on individual interests as in the greedy strategy. Numerical experiments demonstrate that the proposed self-organized strategy is promising to resolve the routing problem from the perspective of individual decision-making with limited traffic information.

Publication
IEEE Transactions on Vehicular Technology
(中科院2区; JCR Q1区; 影响因子=6.800)

详细内容请参阅论文原文

Citation

If you find our work is useful in your research, please consider citing:

@ARTICLE{10244078,
  author={Pei, Huaxin and Zhang, Jiawei and Zhang, Yi and Xu, Huile and Li, Li},
  journal={IEEE Transactions on Vehicular Technology}, 
  title={Self-Organized Routing for Autonomous Vehicles via Deep Reinforcement Learning}, 
  year={2023},
  volume={},
  number={},
  pages={1-12},
  doi={10.1109/TVT.2023.3311198}}
张嘉玮
张嘉玮
清华大学博士研究生

我的研究兴趣包括自动驾驶,智能汽车,智能交通系统,深度强化学习.