Abstract
Mutual learning (ML) is a promising technique for sharing knowledge in data while keeping the data privacy and preserving the individual characteristics of the local model. In this article, we design a novel decentralized mutual learning (DML) system, where bidirectional device-to-device (D2D) communications are employed to facilitate the knowledge sharing. To accelerate the learning process and reduce the energy consumption at mobile devices, a non-convex optimization problem is formulated to minimize the average communication energy consumption for sharing knowledge among mobile devices. On this basis, a two-layer iterative algorithm is proposed, which consists of an outer layer algorithm based on the particle swarm optimization (PSO) method for searching a suitable user selection strategy and an inner layer algorithm based on sum-of-ratios optimization method to achieve a globally optimal allocation of communication resource for accelerating the learning process. Numerical results validate the fast convergence property and the effectiveness of the proposed algorithm, and the asynchronous nature of the designed system in terms of knowledge sharing and energy saving.
Original language | English |
---|---|
Pages (from-to) | 16711-16724 |
Journal | IEEE Transactions on Vehicular Technology |
Volume | 72 |
Issue number | 12 |
DOIs | |
Publication status | Published - Dec 2023 |
MoE publication type | A1 Journal article-refereed |
Funding
This work was supported in part by the National Natural Science Foundation of China under Grants 62271438 and 62111540270, in part by the Zhejiang Provincial Natural Science Foundation of China under Grants LGG22F010008, LZ23F010003 and LQ23F010009, in part by the Fundamental Research Funds for the Provincial Universities of Zhejiang under Grant XRK22005, in part by the Zhejiang Provincial Key Laboratory of New Network Standards and Technologies under Grant 2013E10012, in part by the ROIS NII Open Collaborative Research under Grant 23S0601, and in part by JSPS KAKENHI under Grants 20H00592, and 21H03424
Keywords
- asynchronous nature
- D2D communications
- decentralized system
- energy saving
- Mutual learning