QoE beyond the MOS

Added value using quantiles and distributions

Tobias Hoßfeld, Poul E. Heegaard, Martin Varela

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

9 Citations (Scopus)

Abstract

Traditionally, Quality of Experience (QoE) assessment results (or objective estimations thereof) are presented as a single scalar value, typically a Mean Opinion Score (MOS). While useful, the limitations of MOS are evident even in its name; for many applications, just having a mean value is simply not enough. For service providers in particular, it would be more interesting to have an idea of how the scores are distributed, so as to ensure that a certain portion of the user population is experiencing satisfactory levels of quality, thus reducing churn. In this paper we propose different statistical measures to express important aspects of QoE beyond MOS like user diversity, uncertainty of user rating distributions, ratio of dissatisfied users. Further, we propose a way to use MOS values and the standard deviation of opinion scores (SOS) hypothesis, which postulates a quadratic relation between subjective scores and their standard deviation, in order to derive quantiles for subjective ratings.
Original languageEnglish
Title of host publicationQuality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on
PublisherInstitute of Electrical and Electronic Engineers IEEE
Pages1-6
ISBN (Electronic)978-1-4799-8958-4
DOIs
Publication statusPublished - 6 Jul 2015
MoE publication typeA4 Article in a conference publication
Event7th International Workshop on Quality of Multimedia Experience, QoMEX 2015 - Costa Navarino, Greece
Duration: 26 May 201529 May 2015
Conference number: 7

Workshop

Workshop7th International Workshop on Quality of Multimedia Experience, QoMEX 2015
Abbreviated titleQoMEX 2015
CountryGreece
CityCosta Navarino
Period26/05/1529/05/15

Fingerprint

Uncertainty

Keywords

  • electronic mail
  • entropy
  • measurement uncertainty
  • quality assessment
  • standards
  • uncertainty
  • web pages

Cite this

Hoßfeld, T., Heegaard, P. E., & Varela, M. (2015). QoE beyond the MOS: Added value using quantiles and distributions. In Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on (pp. 1-6). Institute of Electrical and Electronic Engineers IEEE. https://doi.org/10.1109/QoMEX.2015.7148142
Hoßfeld, Tobias ; Heegaard, Poul E. ; Varela, Martin. / QoE beyond the MOS : Added value using quantiles and distributions. Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on. Institute of Electrical and Electronic Engineers IEEE, 2015. pp. 1-6
@inproceedings{1e32e266ff1f4c77837e82ab04b4e4d6,
title = "QoE beyond the MOS: Added value using quantiles and distributions",
abstract = "Traditionally, Quality of Experience (QoE) assessment results (or objective estimations thereof) are presented as a single scalar value, typically a Mean Opinion Score (MOS). While useful, the limitations of MOS are evident even in its name; for many applications, just having a mean value is simply not enough. For service providers in particular, it would be more interesting to have an idea of how the scores are distributed, so as to ensure that a certain portion of the user population is experiencing satisfactory levels of quality, thus reducing churn. In this paper we propose different statistical measures to express important aspects of QoE beyond MOS like user diversity, uncertainty of user rating distributions, ratio of dissatisfied users. Further, we propose a way to use MOS values and the standard deviation of opinion scores (SOS) hypothesis, which postulates a quadratic relation between subjective scores and their standard deviation, in order to derive quantiles for subjective ratings.",
keywords = "electronic mail, entropy, measurement uncertainty, quality assessment, standards, uncertainty, web pages",
author = "Tobias Ho{\ss}feld and Heegaard, {Poul E.} and Martin Varela",
year = "2015",
month = "7",
day = "6",
doi = "10.1109/QoMEX.2015.7148142",
language = "English",
pages = "1--6",
booktitle = "Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on",
publisher = "Institute of Electrical and Electronic Engineers IEEE",
address = "United States",

}

Hoßfeld, T, Heegaard, PE & Varela, M 2015, QoE beyond the MOS: Added value using quantiles and distributions. in Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on. Institute of Electrical and Electronic Engineers IEEE, pp. 1-6, 7th International Workshop on Quality of Multimedia Experience, QoMEX 2015, Costa Navarino, Greece, 26/05/15. https://doi.org/10.1109/QoMEX.2015.7148142

QoE beyond the MOS : Added value using quantiles and distributions. / Hoßfeld, Tobias; Heegaard, Poul E.; Varela, Martin.

Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on. Institute of Electrical and Electronic Engineers IEEE, 2015. p. 1-6.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - QoE beyond the MOS

T2 - Added value using quantiles and distributions

AU - Hoßfeld, Tobias

AU - Heegaard, Poul E.

AU - Varela, Martin

PY - 2015/7/6

Y1 - 2015/7/6

N2 - Traditionally, Quality of Experience (QoE) assessment results (or objective estimations thereof) are presented as a single scalar value, typically a Mean Opinion Score (MOS). While useful, the limitations of MOS are evident even in its name; for many applications, just having a mean value is simply not enough. For service providers in particular, it would be more interesting to have an idea of how the scores are distributed, so as to ensure that a certain portion of the user population is experiencing satisfactory levels of quality, thus reducing churn. In this paper we propose different statistical measures to express important aspects of QoE beyond MOS like user diversity, uncertainty of user rating distributions, ratio of dissatisfied users. Further, we propose a way to use MOS values and the standard deviation of opinion scores (SOS) hypothesis, which postulates a quadratic relation between subjective scores and their standard deviation, in order to derive quantiles for subjective ratings.

AB - Traditionally, Quality of Experience (QoE) assessment results (or objective estimations thereof) are presented as a single scalar value, typically a Mean Opinion Score (MOS). While useful, the limitations of MOS are evident even in its name; for many applications, just having a mean value is simply not enough. For service providers in particular, it would be more interesting to have an idea of how the scores are distributed, so as to ensure that a certain portion of the user population is experiencing satisfactory levels of quality, thus reducing churn. In this paper we propose different statistical measures to express important aspects of QoE beyond MOS like user diversity, uncertainty of user rating distributions, ratio of dissatisfied users. Further, we propose a way to use MOS values and the standard deviation of opinion scores (SOS) hypothesis, which postulates a quadratic relation between subjective scores and their standard deviation, in order to derive quantiles for subjective ratings.

KW - electronic mail

KW - entropy

KW - measurement uncertainty

KW - quality assessment

KW - standards

KW - uncertainty

KW - web pages

U2 - 10.1109/QoMEX.2015.7148142

DO - 10.1109/QoMEX.2015.7148142

M3 - Conference article in proceedings

SP - 1

EP - 6

BT - Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on

PB - Institute of Electrical and Electronic Engineers IEEE

ER -

Hoßfeld T, Heegaard PE, Varela M. QoE beyond the MOS: Added value using quantiles and distributions. In Quality of Multimedia Experience (QoMEX), 2015 Seventh International Workshop on. Institute of Electrical and Electronic Engineers IEEE. 2015. p. 1-6 https://doi.org/10.1109/QoMEX.2015.7148142