Multi-Tenant Cross-Slice Resource Orchestration: A Deep Reinforcement Learning Approach

Xianfu Chen, Zhifeng Zhao, Celimuge Wu, Mehdi Bennis, Hang Liu, Yusheng Ji, Honggang Zhang

    Research output: Contribution to journalArticleScientificpeer-review

    9 Citations (Scopus)

    Abstract

    With the cellular networks becoming increasingly agile, a major challenge lies in how to support diverse services for mobile users (MUs) over a common physical network infrastructure. Network slicing is a promising solution to tailor the network to match such service requests. This paper considers a system with radio access network (RAN)-only slicing, where the physical infrastructure is split into slices providing computation and communication functionalities. A limited number of channels are auctioned across scheduling slots to MUs of multiple service providers (SPs) (i.e., the tenants). Each SP behaves selfishly to maximize the expected long-term payoff from the competition with other SPs for the orchestration of channels, which provides its MUs with the opportunities to access the computation and communication slices. This problem is modelled as a stochastic game, in which the decision makings of a SP depend on the global network dynamics as well as the joint control policy of all SPs. To approximate the Nash equilibrium solutions, we first construct an abstract stochastic game with the local conjectures of channel auction among the SPs. We then linearly decompose the per-SP Markov decision process to simplify the decision makings at a SP and derive an online scheme based on deep reinforcement learning to approach the optimal abstract control policies. Numerical experiments show significant performance gains from our scheme.

    Original languageEnglish
    Pages (from-to)2377-2392
    Number of pages16
    JournalIEEE Journal on Selected Areas in Communications
    Volume37
    Issue number10
    DOIs
    Publication statusPublished - 2019
    MoE publication typeA1 Journal article-refereed

    Keywords

    • deep reinforcement learning
    • Markov decision process
    • mobile-edge computing
    • Network slicing
    • packet scheduling
    • radio access networks

    Fingerprint Dive into the research topics of 'Multi-Tenant Cross-Slice Resource Orchestration: A Deep Reinforcement Learning Approach'. Together they form a unique fingerprint.

  • Cite this