Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins

Jingtao Wu; Dahai Han; Min Zhang; Zabih Ghassemlooy

doi:10.1109/ISWCS49558.2021.9562210

Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins

Jingtao Wu, Dahai Han, Min Zhang, Zabih Ghassemlooy

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

We propose an adaptive seamless vertical handover scheme for hybrid visible light communication-infrared (VLC-IR) networks in ship cabins based on Sarsa-lambda reinforcement learning algorithm. Compared with the Q-learning and Sarsa, the proposed algorithm surpasses the average downlink data rate by 13% and 14%, respectively. Moreover, the proposed algorithm outperforms the average downlink data rate of immediate handover and dwell handover schemes by 57% and 22%, respectively when the user device movement speed is 1 m/s.

Original language	English
Title of host publication	2021 17th International Symposium on Wireless Communication Systems, ISWCS 2021
Publisher	VDE Verlag GmbH
ISBN (Electronic)	9781728174327
DOIs	https://doi.org/10.1109/ISWCS49558.2021.9562210
Publication status	Published - 6 Sept 2021
Event	17th International Symposium on Wireless Communication Systems, ISWCS 2021 - Berlin, Germany Duration: 6 Sept 2021 → 9 Sept 2021

Publication series

Name	Proceedings of the International Symposium on Wireless Communication Systems
Volume	2021-September
ISSN (Print)	2154-0217
ISSN (Electronic)	2154-0225

Conference

Conference	17th International Symposium on Wireless Communication Systems, ISWCS 2021
Country/Territory	Germany
City	Berlin
Period	6/09/21 → 9/09/21

Keywords

Average downlink data rate
Sarsa-lambda algorithm
Ship cabins
Vertical handover
VLC-IR

Access to Document

10.1109/ISWCS49558.2021.9562210

Cite this

Wu, J., Han, D., Zhang, M., & Ghassemlooy, Z. (2021). Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins. In 2021 17th International Symposium on Wireless Communication Systems, ISWCS 2021 (Proceedings of the International Symposium on Wireless Communication Systems; Vol. 2021-September). VDE Verlag GmbH. https://doi.org/10.1109/ISWCS49558.2021.9562210

@inproceedings{972895135ca34899b867a43b142cd4db,

title = "Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins",

abstract = "We propose an adaptive seamless vertical handover scheme for hybrid visible light communication-infrared (VLC-IR) networks in ship cabins based on Sarsa-lambda reinforcement learning algorithm. Compared with the Q-learning and Sarsa, the proposed algorithm surpasses the average downlink data rate by 13\% and 14\%, respectively. Moreover, the proposed algorithm outperforms the average downlink data rate of immediate handover and dwell handover schemes by 57\% and 22\%, respectively when the user device movement speed is 1 m/s.",

keywords = "Average downlink data rate, Sarsa-lambda algorithm, Ship cabins, Vertical handover, VLC-IR",

author = "Jingtao Wu and Dahai Han and Min Zhang and Zabih Ghassemlooy",

note = "Funding Information: This study was supported by the National Science Foundation of China (NSFC) (Grant No.619750200) and the EU COST Action NEWFOC CA19111. Publisher Copyright: {\textcopyright} 2021 IEEE; 17th International Symposium on Wireless Communication Systems, ISWCS 2021 ; Conference date: 06-09-2021 Through 09-09-2021",

year = "2021",

month = sep,

day = "6",

doi = "10.1109/ISWCS49558.2021.9562210",

language = "English",

series = "Proceedings of the International Symposium on Wireless Communication Systems",

publisher = "VDE Verlag GmbH",

booktitle = "2021 17th International Symposium on Wireless Communication Systems, ISWCS 2021",

address = "Germany",

}

Wu, J, Han, D, Zhang, M & Ghassemlooy, Z 2021, Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins. in 2021 17th International Symposium on Wireless Communication Systems, ISWCS 2021. Proceedings of the International Symposium on Wireless Communication Systems, vol. 2021-September, VDE Verlag GmbH, 17th International Symposium on Wireless Communication Systems, ISWCS 2021, Berlin, Germany, 6/09/21. https://doi.org/10.1109/ISWCS49558.2021.9562210

Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins. / Wu, Jingtao; Han, Dahai; Zhang, Min et al.
2021 17th International Symposium on Wireless Communication Systems, ISWCS 2021. VDE Verlag GmbH, 2021. (Proceedings of the International Symposium on Wireless Communication Systems; Vol. 2021-September).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins

AU - Wu, Jingtao

AU - Han, Dahai

AU - Zhang, Min

AU - Ghassemlooy, Zabih

PY - 2021/9/6

Y1 - 2021/9/6

N2 - We propose an adaptive seamless vertical handover scheme for hybrid visible light communication-infrared (VLC-IR) networks in ship cabins based on Sarsa-lambda reinforcement learning algorithm. Compared with the Q-learning and Sarsa, the proposed algorithm surpasses the average downlink data rate by 13% and 14%, respectively. Moreover, the proposed algorithm outperforms the average downlink data rate of immediate handover and dwell handover schemes by 57% and 22%, respectively when the user device movement speed is 1 m/s.

AB - We propose an adaptive seamless vertical handover scheme for hybrid visible light communication-infrared (VLC-IR) networks in ship cabins based on Sarsa-lambda reinforcement learning algorithm. Compared with the Q-learning and Sarsa, the proposed algorithm surpasses the average downlink data rate by 13% and 14%, respectively. Moreover, the proposed algorithm outperforms the average downlink data rate of immediate handover and dwell handover schemes by 57% and 22%, respectively when the user device movement speed is 1 m/s.

KW - Average downlink data rate

KW - Sarsa-lambda algorithm

KW - Ship cabins

KW - Vertical handover

KW - VLC-IR

UR - https://www.scopus.com/pages/publications/85118153230

U2 - 10.1109/ISWCS49558.2021.9562210

DO - 10.1109/ISWCS49558.2021.9562210

M3 - Conference contribution

AN - SCOPUS:85118153230

T3 - Proceedings of the International Symposium on Wireless Communication Systems

BT - 2021 17th International Symposium on Wireless Communication Systems, ISWCS 2021

PB - VDE Verlag GmbH

T2 - 17th International Symposium on Wireless Communication Systems, ISWCS 2021

Y2 - 6 September 2021 through 9 September 2021

ER -

Reinforcement learning adaptive vertical handover scheme for hybrid VLC-IR networks in ship cabins

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this