Intelligent User-Centric Network Selection: A Model-Driven Reinforcement Learning Framework

dc.contributor.authorWang, Xinwei
dc.contributor.authorLi, Jiandong
dc.contributor.authorWang, Lingxia
dc.contributor.authorYang, Chungang
dc.contributor.authorHan, Zhu
dc.date.accessioned2020-05-11T16:16:31Z
dc.date.available2020-05-11T16:16:31Z
dc.date.issued2/27/2019
dc.description.abstractUltra-dense heterogeneous networks, as a novel network architecture in the fifth-generation mobile communication system (5G), promise ubiquitous connectivity and smooth experience, which take advantage of multiple radio access technologies (RATs), such as WiFi, UMTS, LTE, and WiMAX. However, the dense environment of multi-RATs challenges the network selection because of the more frequent and complex decision process along with increased complexity. Introducing artificial intelligence to ultra-dense heterogeneous networks can improve the way we address network selection today, and can execute efficient and intelligent network selection. Whereas, there still exist difficulties to be noted. On one hand, the contradiction between real-time communications and time-consuming learning is exacerbated, which can result in slow convergence. On the other hand, the black-box learning mode suffers from oscillation due to the diversity of multi-RATs, which can result in arbitrary convergence. In this paper, we propose a model-driven framework with a joint off-line and on-line way, which is able to achieve fast and optimal network selection through an alliance of machine learning and game theory. Further, we implement a distributed algorithm at the user side based on the proposed framework, which can reduce the number of frequent switching, increase the possibility of gainful switching, and provide the individual service. The simulation results confirm the performance of the algorithm in accelerating convergence rate, boosting user experience, and improving resource utilization.
dc.identifier.citationCopyright 2019 IEEE Access. Recommended citation: Wang, Xinwei, Jiandong Li, Lingxia Wang, Chungang Yang, and Zhu Han. "Intelligent User-Centric Network Selection: A Model-Driven Reinforcement Learning Framework." IEEE Access 7 (2019): 21645-21661. DOI: 10.1109/ACCESS.2019.2898205. URL: https://ieeexplore.ieee.org/abstract/document/8653879. Reproduced in accordance with the original publisher's licensing terms and with permission from the author(s).
dc.identifier.urihttps://hdl.handle.net/10657/6484
dc.publisherIEEE Access
dc.subjectGame theory
dc.subjectheterogeneous networks
dc.subjectmachine learning
dc.subjectmodel-driven
dc.subjectnetwork selection
dc.titleIntelligent User-Centric Network Selection: A Model-Driven Reinforcement Learning Framework
dc.typeArticle

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Han_2019_IntelligentUserCentricNetwork.pdf
Size:
10.88 MB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.69 KB
Format:
Plain Text
Description: