Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding

Ying Chen; Qing Li; Aoyang Zhang; Longhao Zou; Yong Jiang; Junlin Li; Zhenhui Yuan

doi:10.1145/3458306.3458874

Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding

Ying Chen, Qing Li, Aoyang Zhang, Longhao Zou, Yong Jiang^*, Junlin Li, Zhenhui Yuan

^*Corresponding author for this work

Computer and Information Sciences Department

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

17 Citations (Scopus)

Abstract

With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.

Original language	English
Title of host publication	NOSSDAV '21
Subtitle of host publication	Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video
Editors	Andra Lutu, Gwendal Simon, Mylene C. Q. Farias
Place of Publication	New York
Publisher	ACM
Pages	74-81
Number of pages	8
ISBN (Electronic)	9781450384353
ISBN (Print)	9781450384353
DOIs	https://doi.org/10.1145/3458306.3458874
Publication status	Published - 28 Sept 2021
Event	MMSys '21: ACM Multimedia Systems Conference: Bridging Deep Media and Communications - Istanbul, Turkey Duration: 28 Sept 2021 → 1 Oct 2021 https://2021.acmmmsys.org/

Publication series

Name	Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video
Publisher	ACM

Conference

Conference	MMSys '21: ACM Multimedia Systems Conference
Country/Territory	Turkey
City	Istanbul
Period	28/09/21 → 1/10/21
Internet address	https://2021.acmmmsys.org/

Keywords

live streaming
super-resolution
video coding
video delivery

Access to Document

10.1145/3458306.3458874

Cite this

Chen, Y., Li, Q., Zhang, A., Zou, L., Jiang, Y., Li, J., & Yuan, Z. (2021). Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding. In A. Lutu, G. Simon, & M. C. Q. Farias (Eds.), NOSSDAV '21: Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (pp. 74-81). (Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video). ACM. https://doi.org/10.1145/3458306.3458874

Chen, Ying ; Li, Qing ; Zhang, Aoyang et al. / Higher quality live streaming under lower uplink bandwidth : An approach of super-resolution based video coding. NOSSDAV '21: Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. editor / Andra Lutu ; Gwendal Simon ; Mylene C. Q. Farias. New York : ACM, 2021. pp. 74-81 (Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video).

@inproceedings{74bc9ac646a8448ba9ea83fc6b60f548,

title = "Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding",

abstract = "With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.",

keywords = "live streaming, super-resolution, video coding, video delivery",

author = "Ying Chen and Qing Li and Aoyang Zhang and Longhao Zou and Yong Jiang and Junlin Li and Zhenhui Yuan",

note = "Research funded by National Natural Science Foundation of China (No. 61972189).; MMSys '21: ACM Multimedia Systems Conference : Bridging Deep Media and Communications ; Conference date: 28-09-2021 Through 01-10-2021",

year = "2021",

month = sep,

day = "28",

doi = "10.1145/3458306.3458874",

language = "English",

isbn = "9781450384353",

series = "Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video",

publisher = "ACM",

pages = "74--81",

editor = "Andra Lutu and Gwendal Simon and Farias, {Mylene C. Q.}",

booktitle = "NOSSDAV '21",

address = "United States",

url = "https://2021.acmmmsys.org/",

}

Chen, Y, Li, Q, Zhang, A, Zou, L, Jiang, Y, Li, J & Yuan, Z 2021, Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding. in A Lutu, G Simon & MCQ Farias (eds), NOSSDAV '21: Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, ACM, New York, pp. 74-81, MMSys '21: ACM Multimedia Systems Conference, Istanbul, Turkey, 28/09/21. https://doi.org/10.1145/3458306.3458874

Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding. / Chen, Ying; Li, Qing; Zhang, Aoyang et al.
NOSSDAV '21: Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. ed. / Andra Lutu; Gwendal Simon; Mylene C. Q. Farias. New York: ACM, 2021. p. 74-81 (Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Higher quality live streaming under lower uplink bandwidth

T2 - MMSys '21: ACM Multimedia Systems Conference

AU - Chen, Ying

AU - Li, Qing

AU - Zhang, Aoyang

AU - Zou, Longhao

AU - Jiang, Yong

AU - Li, Junlin

AU - Yuan, Zhenhui

N1 - Research funded by National Natural Science Foundation of China (No. 61972189).

PY - 2021/9/28

Y1 - 2021/9/28

N2 - With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.

AB - With the growing popularity of live streaming, high video quality and low latency with limited uplink bandwidth have become a significant challenge. In this study, we propose Live Super-Resolution Based Video Coding (LiveSRVC), a novel video uploading framework that improves the quality of live streaming with low latency under limited uplink bandwidth. We design a new super-resolution-based key frame coding module to improve the coding compression efficiency. LiveSRVC dynamically selects the bitrate and the compression ratio of key frames, mitigating the influence of uplink bandwidth capacity on live streaming quality. Trace-driven emulations verify that LiveSRVC can provide the same quality while reducing up to 50% of the required bandwidth compared to the original encoding method (H.264). LiveSRVC consumes at least 10X less GPU occupation time compared to the method of reconstructing all frames with super-resolution.

KW - live streaming

KW - super-resolution

KW - video coding

KW - video delivery

UR - http://www.scopus.com/inward/record.url?scp=85111417109&partnerID=8YFLogxK

U2 - 10.1145/3458306.3458874

DO - 10.1145/3458306.3458874

M3 - Conference contribution

SN - 9781450384353

T3 - Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

SP - 74

EP - 81

BT - NOSSDAV '21

A2 - Lutu, Andra

A2 - Simon, Gwendal

A2 - Farias, Mylene C. Q.

PB - ACM

CY - New York

Y2 - 28 September 2021 through 1 October 2021

ER -

Chen Y, Li Q, Zhang A, Zou L, Jiang Y, Li J et al. Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding. In Lutu A, Simon G, Farias MCQ, editors, NOSSDAV '21: Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. New York: ACM. 2021. p. 74-81. (Proceedings of the 31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video). Epub 2021 Sept 28. doi: 10.1145/3458306.3458874

Higher quality live streaming under lower uplink bandwidth: An approach of super-resolution based video coding

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this