Publication: R-Learning-based admission control for service federation in multi-domain 5G networks
Loading...
Identifiers
ISBN: 978-1-7281-8104-2 (Electronic)
ISBN: 978-1-7281-8105-9 (Print on Demand(PoD))
Publication date
2021-12-07
Defense date
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
IEEE
Impact
Export
Abstract
Network service federation in 5G/B5G networks enables service providers to extend service offering by collaborating with peering providers. Realizing this vision requires interoperability among providers towards end-to-end service orchestration across multiple administrative domains. Smart admission control is fundamental to make such extended offering profitable. Without prior knowledge of service requests, the admission controller (AC) either determines the domain to deploy each demand or rejects it to maximize the long-term average profit. In this paper, we first obtain the optimal AC policy by formulating the problem as a Markov decision process, which is solved through the policy iteration method. This provides the theoretical performance bound under the assumption of known arrival and departure rates of demands. Then, for practical solutions to be deployed in real systems, where the rates are not known, we apply the Q-Learning and R-Learning algorithms to approximate the optimal policy. The extensive simulation results show that learning approaches outperform the greedy policy and are capable of getting close to optimal performance. More specifically, R-learning always outperformed the rest of practical solutions and achieved an optimality gap of 3-5% independent of the system configuration, while Q-Learning showed lower performance and depended on discount factor tuning.
Description
Proceedings of: IEEE Global Communications Conference (GLOBECOM), 7-11 Dec. 2021, Madrid, Spain.
Keywords
Multi-domain 5G/B5G networks, Admission control, Service federation, MDP, Q-Learning, R-Learning
Bibliographic citation
Bakhshi, B., Mangues-Bafalluy, J. & Baranda, J. (7-11 Dec. 2021). R-Learning-based admission control for service federation in multi-domain 5G networks [proceedings]. 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain.