• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

QLGR: A Q-learning-based Geographic FANET Routing Algorithm Based on Multi-agent Reinforcement Learning

Vol. 15, No. 11, November 30, 2021
10.3837/tiis.2021.11.020, Download Paper (Free):

Abstract

The utilization of UAVs in various fields has led to the development of flying ad hoc network (FANET) technology. In a network environment with highly dynamic topology and frequent link changes, the traditional routing technology of FANET cannot satisfy the new communication demands. Traditional routing algorithm, based on geographic location, can “fall” into a routing hole. In view of this problem, we propose a geolocation routing protocol based on multi-agent reinforcement learning, which decreases the packet loss rate and routing cost of the routing protocol. The protocol views each node as an intelligent agent and evaluates the value of its neighbor nodes through the local information. In the value function, nodes consider information such as link quality, residual energy and queue length, which reduces the possibility of a routing hole. The protocol uses global rewards to enable individual nodes to collaborate in transmitting data. The performance of the protocol is experimentally analyzed for UAVs under extreme conditions such as topology changes and energy constraints. Simulation results show that our proposed QLGR-S protocol has advantages in performance parameters such as throughput, end-to-end delay, and energy consumption compared with the traditional GPSR protocol. QLGR-S provides more reliable connectivity for UAV networking technology, safeguards the communication requirements between UAVs, and further promotes the development of UAV technology.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
X. Qiu, Y. Xie, Y. Wang, L. Ye and Y. Yang, "QLGR: A Q-learning-based Geographic FANET Routing Algorithm Based on Multi-agent Reinforcement Learning," KSII Transactions on Internet and Information Systems, vol. 15, no. 11, pp. 4244-4274, 2021. DOI: 10.3837/tiis.2021.11.020.

[ACM Style]
Xiulin Qiu, Yongsheng Xie, Yinyin Wang, Lei Ye, and Yuwang Yang. 2021. QLGR: A Q-learning-based Geographic FANET Routing Algorithm Based on Multi-agent Reinforcement Learning. KSII Transactions on Internet and Information Systems, 15, 11, (2021), 4244-4274. DOI: 10.3837/tiis.2021.11.020.

[BibTeX Style]
@article{tiis:25112, title="QLGR: A Q-learning-based Geographic FANET Routing Algorithm Based on Multi-agent Reinforcement Learning", author="Xiulin Qiu and Yongsheng Xie and Yinyin Wang and Lei Ye and Yuwang Yang and ", journal="KSII Transactions on Internet and Information Systems", DOI={10.3837/tiis.2021.11.020}, volume={15}, number={11}, year="2021", month={November}, pages={4244-4274}}