• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

Multi-agent Q-learning based Admission Control Mechanism in Heterogeneous Wireless Networks for Multiple Services


Abstract

In order to ensure both of the whole system capacity and users QoS requirements in heterogeneous wireless networks, admission control mechanism should be well designed. In this paper, Multi-agent Q-learning based Admission Control Mechanism (MQACM) is proposed to handle new and handoff call access problems appropriately. MQACM obtains the optimal decision policy by using an improved form of single-agent Q-learning method, Multi-agent Q-learning (MQ) method. MQ method is creatively introduced to solve the admission control problem in heterogeneous wireless networks in this paper. In addition, different priorities are allocated to multiple services aiming to make MQACM perform even well in congested network scenarios. It can be observed from both analysis and simulation results that our proposed method not only outperforms existing schemes with enhanced call blocking probability and handoff dropping probability performance, but also has better network universality and stability than other schemes.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
Jiamei Chen, Yubin Xu, Lin Ma and Yao Wang, "Multi-agent Q-learning based Admission Control Mechanism in Heterogeneous Wireless Networks for Multiple Services," KSII Transactions on Internet and Information Systems, vol. 7, no. 10, pp. 2376-2394, 2013. DOI: 10.3837/tiis.2013.10.003

[ACM Style]
Chen, J., Xu, Y., Ma, L., and Wang, Y. 2013. Multi-agent Q-learning based Admission Control Mechanism in Heterogeneous Wireless Networks for Multiple Services. KSII Transactions on Internet and Information Systems, 7, 10, (2013), 2376-2394. DOI: 10.3837/tiis.2013.10.003