Login (DCU Staff Only)
Login (DCU Staff Only)

DORAS | DCU Research Repository

Explore open access research and scholarly works from DCU

Advanced Search

Reinforcement learning on computational resource allocation of cloud-based wireless networks

Chen, Beiran, Zhang, Yi, Iosifidis, George orcid logoORCID: 0000-0003-1001-2323 and Liu, Mingming orcid logoORCID: 0000-0002-8988-2104 (2020) Reinforcement learning on computational resource allocation of cloud-based wireless networks. In: 6th World Forum on The Internet of Things (2020 IEEE), 2-16 June 2020, New Orleans, USA (Onine).

Abstract
Wireless networks used for Internet of Things (IoT) are expected to largely involve cloud-based computing and processing. Softwarised and centralised signal processing and network switching in the cloud enables flexible network control and management. In a cloud environment, dynamic computational resource allocation is essential to save energy while maintaining the performance of the processes. The stochastic features of the Central Processing Unit (CPU) load variation as well as the possible complex parallelisation situations of the cloud processes makes the dynamic resource allocation an interesting research challenge. This paper models this dynamic computational resource allocation problem into a Markov Decision Process (MDP) and designs a model-based reinforcement learning agent to optimise the dynamic resource allocation of the CPU usage. Value iteration method is used for the reinforcement learning agent to pick up the optimal policy during the MDP. To evaluate our performance we analyse two types of processes that can be used in the cloud-based IoT networks with different levels of parallelisation capabilities, i.e., Software-Defined Radio (SDR) and Software-Defined Networking (SDN). The results show that our agent rapidly converges to the optimal policy, stably performs in different parameter settings, outperforms or at least equally performs compared to a baseline algorithm in energy savings for different scenarios.
Metadata
Item Type:Conference or Workshop Item (Paper)
Event Type:Conference
Refereed:Yes
Subjects:Computer Science > Algorithms
Computer Science > Artificial intelligence
Computer Science > Machine learning
Engineering > Systems engineering
DCU Faculties and Centres:DCU Faculties and Schools > Faculty of Engineering and Computing > School of Electronic Engineering
Research Initiatives and Centres > INSIGHT Centre for Data Analytics
Published in: 2020 IEEE 6th World Forum on Internet of Things (WF-IoT). .
Official URL:http://dx.doi.org/10.1109/WF-IoT48130.2020.9221234
Copyright Information:© 2020 The Authors
Use License:This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License
Funders:European Commission Horizon 2020 grant no. H2020 732174 (ORCA), European Regional Development Fund from Science Foundation Ireland Grant No. 13/RC/2077 (CONNECT), Science Foundation Ireland under Grant No./12/RC/2289_P2
ID Code:24216
Deposited On:09 Feb 2021 14:15 by Mingming Liu . Last Modified 09 Feb 2021 14:15
Documents

Full text available as:

[thumbnail of PID6362677.pdf]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
410kB
Downloads

Downloads

Downloads per month over past year

Archive Staff Only: edit this record