Learning to Entangle Radio Resources in Vehicular Communications: An Oblivious Game-Theoretic Perspective

Xianfu Chen, Celimuge Wu, Mehdi Bennis, Zhifeng Zhao, Zhu Han

    Research output: Contribution to journalArticleScientificpeer-review

    10 Citations (Scopus)


    In this paper, we investigate non-cooperative radio resource management in a vehicle-to-vehicle communication network. The technical challenges lie in high-vehicle mobility and data traffic variations. Over the discrete scheduling slots, each vehicle user equipment (VUE)-pair competes with other VUE-pairs in the coverage of a road side unit (RSU) for the limited frequency to transmit queued data packets, aiming to optimize the expected long-term performance. The frequency allocation at the beginning of each slot at the RSU is regulated by a sealed second-price auction. Such interactions among VUE-pairs are modeled as a stochastic game with a semi-continuous global network state space. By defining a partitioned control policy, we transform the original game into an equivalent stochastic game with a global queue state space of finite size. We adopt an oblivious equilibrium (OE) to approximate the Markov perfect equilibrium, which characterizes the optimal solution to the equivalent game. The OE solution is theoretically proven to be with an asymptotic Markov equilibrium property. Due to the lack of a priori knowledge of network dynamics, we derive an online algorithm to learn the OE solution. Numerical simulations validate the theoretical analysis and show the effectiveness of the proposed online learning algorithm.

    Original languageEnglish
    Article number8674536
    Pages (from-to)4262-4274
    Number of pages13
    JournalIEEE Transactions on Vehicular Technology
    Issue number5
    Publication statusPublished - 1 May 2019
    MoE publication typeA1 Journal article-refereed


    • Markov decision process
    • Markov perfect equilibrium
    • oblivious equilibrium
    • reinforcement learning
    • stochastic games
    • Vehicle-to-vehicle communications


    Dive into the research topics of 'Learning to Entangle Radio Resources in Vehicular Communications: An Oblivious Game-Theoretic Perspective'. Together they form a unique fingerprint.

    Cite this