Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints

Constantino Álvarez Casado; Le Nguyen; Olli Silvén; Miguel Bordallo López

doi:10.1007/978-3-031-31438-4_38

Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints

Constantino Álvarez Casado^*
, Le Nguyen
, Olli Silvén
, Miguel Bordallo López

^*Corresponding author for this work

BA5610 Human-centric AI

University of Oulu

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

7 Citations (Scopus)

Abstract

Remote photoplethysmography (rPPG) is a promising non-invasive technique for measuring vital signs remotely, such as through videocalls. However, network and computing constraints can significantly compromise its accuracy. In this study, we evaluated the effects of these constraints on rPPG methods using four reference datasets and a standard unsupervised rPPG signal extraction pipeline. Our experiments simulated the impact of frame dropping, streaming video at different resolutions and frame rates, and other resource limitations. We found that these constraints can significantly degrade rPPG accuracy, but implementing specific strategies (such as reconstructing the signal in the receiver) can mitigate these effects. For example, with a 20% of frame loss, our proposed strategies reduced the MAE increase from 539% to 29%. These findings highlight the importance of considering network and computing constraints in rPPG applications.

Original language	English
Title of host publication	Image Analysis - 22nd Scandinavian Conference, SCIA 2023
Subtitle of host publication	Proceedings
Editors	Rikke Gade, Michael Felsberg, Joni-Kristian Kämäräinen
Publisher	Springer
Pages	586-598
ISBN (Electronic)	978-3-031-31438-4
ISBN (Print)	978-3-031-31437-7
DOIs	https://doi.org/10.1007/978-3-031-31438-4_38
Publication status	Published - 2023
MoE publication type	A4 Article in a conference publication
Event	23nd Scandinavian Conference on Image Analysis, SCIA 2023 - Lapland, Finland Duration: 18 Apr 2023 → 21 Apr 2023

Publication series

Series	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	13886 LNCS
ISSN	0302-9743

Conference

Conference	23nd Scandinavian Conference on Image Analysis, SCIA 2023
Country/Territory	Finland
City	Lapland
Period	18/04/23 → 21/04/23

Funding

This research has been supported by the Academy of Finland 6G Flagship program under Grant 346208 and PROFI5 HiDyn under Grant 326291.

Keywords

Biosignals
Face Analysis
Remote Monitoring
Remote Photoplethysmography
rPPG
Telemedicine
Video streaming

Access to Document

10.1007/978-3-031-31438-4_38

Cite this

Álvarez Casado, C., Nguyen, L., Silvén, O., & Bordallo López, M. (2023). Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints. In R. Gade, M. Felsberg, & J.-K. Kämäräinen (Eds.), Image Analysis - 22nd Scandinavian Conference, SCIA 2023: Proceedings (pp. 586-598). Springer. https://doi.org/10.1007/978-3-031-31438-4_38

Álvarez Casado, Constantino ; Nguyen, Le ; Silvén, Olli et al. / Assessing the Feasibility of Remote Photoplethysmography Through Videocalls : A Study of Network and Computing Constraints. Image Analysis - 22nd Scandinavian Conference, SCIA 2023: Proceedings. editor / Rikke Gade ; Michael Felsberg ; Joni-Kristian Kämäräinen. Springer, 2023. pp. 586-598 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13886 LNCS).

@inproceedings{77ea26d848fb43f4949f31cfde59b957,

title = "Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints",

abstract = "Remote photoplethysmography (rPPG) is a promising non-invasive technique for measuring vital signs remotely, such as through videocalls. However, network and computing constraints can significantly compromise its accuracy. In this study, we evaluated the effects of these constraints on rPPG methods using four reference datasets and a standard unsupervised rPPG signal extraction pipeline. Our experiments simulated the impact of frame dropping, streaming video at different resolutions and frame rates, and other resource limitations. We found that these constraints can significantly degrade rPPG accuracy, but implementing specific strategies (such as reconstructing the signal in the receiver) can mitigate these effects. For example, with a 20\% of frame loss, our proposed strategies reduced the MAE increase from 539\% to 29\%. These findings highlight the importance of considering network and computing constraints in rPPG applications.",

keywords = "Biosignals, Face Analysis, Remote Monitoring, Remote Photoplethysmography, rPPG, Telemedicine, Video streaming",

author = "\{{\'A}lvarez Casado\}, Constantino and Le Nguyen and Olli Silv{\'e}n and \{Bordallo L{\'o}pez\}, Miguel",

note = "Funding Information: Acknowledgments. This research has been supported by the Academy of Finland 6G Flagship program under Grant 346208 and PROFI5 HiDyn under Grant 326291. Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 23nd Scandinavian Conference on Image Analysis, SCIA 2023 ; Conference date: 18-04-2023 Through 21-04-2023",

year = "2023",

doi = "10.1007/978-3-031-31438-4\_38",

language = "English",

isbn = "978-3-031-31437-7",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "586--598",

editor = "Rikke Gade and Michael Felsberg and Joni-Kristian K{\"a}m{\"a}r{\"a}inen",

booktitle = "Image Analysis - 22nd Scandinavian Conference, SCIA 2023",

address = "Germany",

}

Álvarez Casado, C, Nguyen, L, Silvén, O & Bordallo López, M 2023, Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints. in R Gade, M Felsberg & J-K Kämäräinen (eds), Image Analysis - 22nd Scandinavian Conference, SCIA 2023: Proceedings. Springer, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13886 LNCS, pp. 586-598, 23nd Scandinavian Conference on Image Analysis, SCIA 2023, Lapland, Finland, 18/04/23. https://doi.org/10.1007/978-3-031-31438-4_38

Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints. / Álvarez Casado, Constantino; Nguyen, Le; Silvén, Olli et al.
Image Analysis - 22nd Scandinavian Conference, SCIA 2023: Proceedings. ed. / Rikke Gade; Michael Felsberg; Joni-Kristian Kämäräinen. Springer, 2023. p. 586-598 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13886 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceedings › Scientific › peer-review

TY - GEN

T1 - Assessing the Feasibility of Remote Photoplethysmography Through Videocalls

T2 - 23nd Scandinavian Conference on Image Analysis, SCIA 2023

AU - Álvarez Casado, Constantino

AU - Nguyen, Le

AU - Silvén, Olli

AU - Bordallo López, Miguel

N1 - Funding Information: Acknowledgments. This research has been supported by the Academy of Finland 6G Flagship program under Grant 346208 and PROFI5 HiDyn under Grant 326291. Publisher Copyright: © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

PY - 2023

Y1 - 2023

N2 - Remote photoplethysmography (rPPG) is a promising non-invasive technique for measuring vital signs remotely, such as through videocalls. However, network and computing constraints can significantly compromise its accuracy. In this study, we evaluated the effects of these constraints on rPPG methods using four reference datasets and a standard unsupervised rPPG signal extraction pipeline. Our experiments simulated the impact of frame dropping, streaming video at different resolutions and frame rates, and other resource limitations. We found that these constraints can significantly degrade rPPG accuracy, but implementing specific strategies (such as reconstructing the signal in the receiver) can mitigate these effects. For example, with a 20% of frame loss, our proposed strategies reduced the MAE increase from 539% to 29%. These findings highlight the importance of considering network and computing constraints in rPPG applications.

AB - Remote photoplethysmography (rPPG) is a promising non-invasive technique for measuring vital signs remotely, such as through videocalls. However, network and computing constraints can significantly compromise its accuracy. In this study, we evaluated the effects of these constraints on rPPG methods using four reference datasets and a standard unsupervised rPPG signal extraction pipeline. Our experiments simulated the impact of frame dropping, streaming video at different resolutions and frame rates, and other resource limitations. We found that these constraints can significantly degrade rPPG accuracy, but implementing specific strategies (such as reconstructing the signal in the receiver) can mitigate these effects. For example, with a 20% of frame loss, our proposed strategies reduced the MAE increase from 539% to 29%. These findings highlight the importance of considering network and computing constraints in rPPG applications.

KW - Biosignals

KW - Face Analysis

KW - Remote Monitoring

KW - Remote Photoplethysmography

KW - rPPG

KW - Telemedicine

KW - Video streaming

UR - https://www.scopus.com/pages/publications/85161377807

U2 - 10.1007/978-3-031-31438-4_38

DO - 10.1007/978-3-031-31438-4_38

M3 - Conference article in proceedings

AN - SCOPUS:85161377807

SN - 978-3-031-31437-7

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 586

EP - 598

BT - Image Analysis - 22nd Scandinavian Conference, SCIA 2023

A2 - Gade, Rikke

A2 - Felsberg, Michael

A2 - Kämäräinen, Joni-Kristian

PB - Springer

Y2 - 18 April 2023 through 21 April 2023

ER -

Álvarez Casado C, Nguyen L, Silvén O, Bordallo López M. Assessing the Feasibility of Remote Photoplethysmography Through Videocalls: A Study of Network and Computing Constraints. In Gade R, Felsberg M, Kämäräinen JK, editors, Image Analysis - 22nd Scandinavian Conference, SCIA 2023: Proceedings. Springer. 2023. p. 586-598. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 13886 LNCS). doi: 10.1007/978-3-031-31438-4_38