DeepMigration: Flow Migration for NFV with Graph-based Deep Reinforcement Learning

Penghao Sun, Julong Lan, Zehua Guo, Di Zhang, Xianfu Chen, Yuxiang Hu, Zhi Liu

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

1 Citation (Scopus)

Abstract

Network Function Virtualization (NFV) enables flexible deployment of network services as applications. Network operators expect to use a limited number of Network Function (NF) instances to handle the fluctuating traffic load and provide network services. However, it is a big challenge to guarantee the Quality of Service (QoS) under the unpredictable network traffic while minimizing the processing resources. One typical solution is to realize NF scale-out, scale-in and load balancing by elastically migrating the related traffic flows with SoftwareDefined Networking (SDN). However, it is difficult to optimally migrate flows since many real-time statuses of NF instances should be considered to make accurate decisions. In this paper, we propose DeepMigration to solve the problem by efficiently and dynamically migrating traffic flows among different NF instances. DeepMigration is a Deep Reinforcement Learning (DRL)-based solution coupled with Graph Neural Network (GNN). By taking advantages of the graph-based relationship deduction ability from our customized GNN and the self-evolution ability from the experience training of DRL, DeepMigration can accurately model the cost (e.g., migration latency) and the benefit (e.g., reducing the number of NF instances) of flow migration among different NF instances and generate dynamic and effective flow migration policies to improve the QoS. Experiment results show that DeepMigration requires less migration cost and saves up to 71.6{%} of the computation time than existing solutions.

Original languageEnglish
Title of host publication2020 IEEE International Conference on Communications, ICC 2020 - Proceedings
PublisherIEEE Institute of Electrical and Electronic Engineers
ISBN (Electronic)978-1-7281-5089-5
DOIs
Publication statusPublished - Jun 2020
MoE publication typeA4 Article in a conference publication
Event2020 IEEE International Conference on Communications, ICC 2020 - Dublin, Ireland
Duration: 7 Jun 202011 Jun 2020

Publication series

SeriesIEEE International Conference on Communications
Volume2020-June
ISSN1550-3607

Conference

Conference2020 IEEE International Conference on Communications, ICC 2020
CountryIreland
CityDublin
Period7/06/2011/06/20

Keywords

  • Deep Reinforcement Learning
  • Flow Migration
  • Graph Neural Network
  • Network Function Virtualization

Fingerprint Dive into the research topics of 'DeepMigration: Flow Migration for NFV with Graph-based Deep Reinforcement Learning'. Together they form a unique fingerprint.

  • Cite this

    Sun, P., Lan, J., Guo, Z., Zhang, D., Chen, X., Hu, Y., & Liu, Z. (2020). DeepMigration: Flow Migration for NFV with Graph-based Deep Reinforcement Learning. In 2020 IEEE International Conference on Communications, ICC 2020 - Proceedings IEEE Institute of Electrical and Electronic Engineers. IEEE International Conference on Communications, Vol.. 2020-June https://doi.org/10.1109/ICC40277.2020.9148696