Reinforcement learning method for QoE-aware optimization of content delivery

Faqir Zarrar Yousaf, Olli Mämmelä, Petteri Mannersalo

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    5 Citations (Scopus)


    The delivery of video services in a controllable and resource efficient manner while meeting the various QoE/QoS requirements in mobile networks is a challenging task, especially in a multiclass wireless environment. This paper proposes an intelligent and context-aware application level fair scheduler based on reinforcement-learning, which can dynamically adjust relevant scheduling parameters in reaction to specific events or context information. The implemented Q-learning method is analyzed with reference to the delivery of progressive video streaming services. We first highlight the performance issues during progressive video streaming over TCP to multiple users under resource constrained environment. We then demonstrate the utilization of employing Q-learning method in our scheduler for intelligent orchestration between multiple concurrent flows to ensure against buffer starvation and thus enable smooth playback. We also demonstrate the effectiveness of our context-aware dynamic scheduler to provide service separation between the user classes and fairness within a user class.
    Original languageEnglish
    Title of host publication2014 IEEE Wireless Communications and Networking Conference (WCNC)
    PublisherIEEE Institute of Electrical and Electronic Engineers
    ISBN (Electronic)978-1-4799-3083-8
    Publication statusPublished - 2014
    MoE publication typeA4 Article in a conference publication
    EventWireless Communications and Networking Conference, WCNC 2014 - Istanbul, Turkey
    Duration: 6 Apr 20149 Apr 2014

    Publication series

    SeriesIEEE Wireless Communications and Networking Conference


    ConferenceWireless Communications and Networking Conference, WCNC 2014
    Abbreviated titleWCNC 2014


    • dynamic scheduling
    • mobile computing
    • quality of experience
    • video streaming
    • Q-learning method
    • QoE-aware optimization
    • reinforcement learning method


    Dive into the research topics of 'Reinforcement learning method for QoE-aware optimization of content delivery'. Together they form a unique fingerprint.

    Cite this