Reinforcement learning method for QoE-aware optimization of content delivery

Faqir Zarrar Yousaf, Olli Mämmelä, Petteri Mannersalo

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

5 Citations (Scopus)

Abstract

The delivery of video services in a controllable and resource efficient manner while meeting the various QoE/QoS requirements in mobile networks is a challenging task, especially in a multiclass wireless environment. This paper proposes an intelligent and context-aware application level fair scheduler based on reinforcement-learning, which can dynamically adjust relevant scheduling parameters in reaction to specific events or context information. The implemented Q-learning method is analyzed with reference to the delivery of progressive video streaming services. We first highlight the performance issues during progressive video streaming over TCP to multiple users under resource constrained environment. We then demonstrate the utilization of employing Q-learning method in our scheduler for intelligent orchestration between multiple concurrent flows to ensure against buffer starvation and thus enable smooth playback. We also demonstrate the effectiveness of our context-aware dynamic scheduler to provide service separation between the user classes and fairness within a user class.
Original languageEnglish
Title of host publication2014 IEEE Wireless Communications and Networking Conference (WCNC)
PublisherIEEE Institute of Electrical and Electronic Engineers
Pages3390-3395
ISBN (Electronic)978-1-4799-3083-8
DOIs
Publication statusPublished - 2014
MoE publication typeA4 Article in a conference publication
EventWireless Communications and Networking Conference, WCNC 2014 - Istanbul, Turkey
Duration: 6 Apr 20149 Apr 2014

Publication series

Series IEEE Wireless Communications and Networking Conference
ISSN1525-3511

Conference

ConferenceWireless Communications and Networking Conference, WCNC 2014
Abbreviated titleWCNC 2014
CountryTurkey
CityIstanbul
Period6/04/149/04/14

    Fingerprint

Keywords

  • dynamic scheduling
  • mobile computing
  • quality of experience
  • video streaming
  • Q-learning method
  • QoE-aware optimization
  • reinforcement learning method

Cite this

Yousaf, F. Z., Mämmelä, O., & Mannersalo, P. (2014). Reinforcement learning method for QoE-aware optimization of content delivery. In 2014 IEEE Wireless Communications and Networking Conference (WCNC) (pp. 3390-3395). IEEE Institute of Electrical and Electronic Engineers . IEEE Wireless Communications and Networking Conference https://doi.org/10.1109/WCNC.2014.6953124