• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

A Semi-Markov Decision Process (SMDP) for Active State Control of A Heterogeneous Network

Vol. 10, No. 7, July 30, 2016
10.3837/tiis.2016.07.017, Download Paper (Free):

Abstract

Due to growing demand on wireless data traffic, a large number of different types of base stations (BSs) have been installed. However, space-time dependent wireless data traffic densities can result in a significant number of idle BSs, which implies the waste of power resources. To deal with this problem, we propose an active state control algorithm based on semi-Markov decision process (SMDP) for a heterogeneous network. A MDP in discrete time domain is formulated from continuous domain with some approximation. Suboptimal on-line learning algorithm with a random policy is proposed to solve the problem. We explicitly include coverage constraint so that active cells can provide the same signal to noise ratio (SNR) coverage with a targeted outage rate. Simulation results verify that the proposed algorithm properly controls the active state depending on traffic densities without increasing the number of handovers excessively while providing average user perceived rate (UPR) in a more power efficient way than a conventional algorithm.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
J. Yang, "A Semi-Markov Decision Process (SMDP) for Active State Control of A Heterogeneous Network," KSII Transactions on Internet and Information Systems, vol. 10, no. 7, pp. 3171-3191, 2016. DOI: 10.3837/tiis.2016.07.017.

[ACM Style]
Janghoon Yang. 2016. A Semi-Markov Decision Process (SMDP) for Active State Control of A Heterogeneous Network. KSII Transactions on Internet and Information Systems, 10, 7, (2016), 3171-3191. DOI: 10.3837/tiis.2016.07.017.