Testing methods for mobile game development

A case study on user feedback in different development phases

Elina Annanperä, Jani Yli-Kantola, Tanja Sauvola, Samuli Heinonen, Erkki Siira

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

Mobile games are relatively new industry, and their relevance on the game markets are rising. At the same time, it is very competitive market, as new games are coming out by hundreds every day. The challenges for the new game development come from the creative process and the human factors on how to make the game appealing. In this research, we study the use of test groups as part of new mobile game and concept development process in the early phases. They were used to complement the testing automation at the development phases when use of analytics was not yet possible. Six separate feedback collection sessions were arranged using different methods. The paper presents the main learnings of each used method, the perceived usefulness of the methods for the entire development process. We also contribute to the growing knowledge for mobile game development, focusing on methods for the testing with test user approaches. We conclude that testing with user groups can help clarify the mobile game design to create a more appealing game, but choosing the right groups and right moments in the game development phase can be difficult, as can be the interpretation of the feedback for decision making.

Original languageEnglish
Title of host publication2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018
PublisherInstitute of Electrical and Electronic Engineers IEEE
Pages1-8
Number of pages8
ISBN (Electronic)978-1-5386-6298-4, 978-1-5386-6297-7
ISBN (Print)978-1-5386-6299-1
DOIs
Publication statusPublished - 29 Jun 2018
MoE publication typeNot Eligible
Event6th IEEE International Conference on Serious Games and Applications for Health, SeGAH 2018 - Vienna, Austria
Duration: 16 May 201818 May 2018

Conference

Conference6th IEEE International Conference on Serious Games and Applications for Health, SeGAH 2018
CountryAustria
CityVienna
Period16/05/1818/05/18

Fingerprint

Feedback
Testing
Human engineering
Automation
Decision making
Decision Making
Industry
Group
market
Learning
automation
Research
decision making
interpretation
industry
learning

Keywords

  • development process
  • game testing
  • methods
  • mobile games
  • users

Cite this

Annanperä, E., Yli-Kantola, J., Sauvola, T., Heinonen, S., & Siira, E. (2018). Testing methods for mobile game development: A case study on user feedback in different development phases. In 2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018 (pp. 1-8). Institute of Electrical and Electronic Engineers IEEE. https://doi.org/10.1109/SeGAH.2018.8401372
Annanperä, Elina ; Yli-Kantola, Jani ; Sauvola, Tanja ; Heinonen, Samuli ; Siira, Erkki. / Testing methods for mobile game development : A case study on user feedback in different development phases. 2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018. Institute of Electrical and Electronic Engineers IEEE, 2018. pp. 1-8
@inproceedings{e320969d20fb4c7288c36876deb6e429,
title = "Testing methods for mobile game development: A case study on user feedback in different development phases",
abstract = "Mobile games are relatively new industry, and their relevance on the game markets are rising. At the same time, it is very competitive market, as new games are coming out by hundreds every day. The challenges for the new game development come from the creative process and the human factors on how to make the game appealing. In this research, we study the use of test groups as part of new mobile game and concept development process in the early phases. They were used to complement the testing automation at the development phases when use of analytics was not yet possible. Six separate feedback collection sessions were arranged using different methods. The paper presents the main learnings of each used method, the perceived usefulness of the methods for the entire development process. We also contribute to the growing knowledge for mobile game development, focusing on methods for the testing with test user approaches. We conclude that testing with user groups can help clarify the mobile game design to create a more appealing game, but choosing the right groups and right moments in the game development phase can be difficult, as can be the interpretation of the feedback for decision making.",
keywords = "development process, game testing, methods, mobile games, users",
author = "Elina Annanper{\"a} and Jani Yli-Kantola and Tanja Sauvola and Samuli Heinonen and Erkki Siira",
year = "2018",
month = "6",
day = "29",
doi = "10.1109/SeGAH.2018.8401372",
language = "English",
isbn = "978-1-5386-6299-1",
pages = "1--8",
booktitle = "2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018",
publisher = "Institute of Electrical and Electronic Engineers IEEE",
address = "United States",

}

Annanperä, E, Yli-Kantola, J, Sauvola, T, Heinonen, S & Siira, E 2018, Testing methods for mobile game development: A case study on user feedback in different development phases. in 2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018. Institute of Electrical and Electronic Engineers IEEE, pp. 1-8, 6th IEEE International Conference on Serious Games and Applications for Health, SeGAH 2018, Vienna, Austria, 16/05/18. https://doi.org/10.1109/SeGAH.2018.8401372

Testing methods for mobile game development : A case study on user feedback in different development phases. / Annanperä, Elina; Yli-Kantola, Jani; Sauvola, Tanja; Heinonen, Samuli; Siira, Erkki.

2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018. Institute of Electrical and Electronic Engineers IEEE, 2018. p. 1-8.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Testing methods for mobile game development

T2 - A case study on user feedback in different development phases

AU - Annanperä, Elina

AU - Yli-Kantola, Jani

AU - Sauvola, Tanja

AU - Heinonen, Samuli

AU - Siira, Erkki

PY - 2018/6/29

Y1 - 2018/6/29

N2 - Mobile games are relatively new industry, and their relevance on the game markets are rising. At the same time, it is very competitive market, as new games are coming out by hundreds every day. The challenges for the new game development come from the creative process and the human factors on how to make the game appealing. In this research, we study the use of test groups as part of new mobile game and concept development process in the early phases. They were used to complement the testing automation at the development phases when use of analytics was not yet possible. Six separate feedback collection sessions were arranged using different methods. The paper presents the main learnings of each used method, the perceived usefulness of the methods for the entire development process. We also contribute to the growing knowledge for mobile game development, focusing on methods for the testing with test user approaches. We conclude that testing with user groups can help clarify the mobile game design to create a more appealing game, but choosing the right groups and right moments in the game development phase can be difficult, as can be the interpretation of the feedback for decision making.

AB - Mobile games are relatively new industry, and their relevance on the game markets are rising. At the same time, it is very competitive market, as new games are coming out by hundreds every day. The challenges for the new game development come from the creative process and the human factors on how to make the game appealing. In this research, we study the use of test groups as part of new mobile game and concept development process in the early phases. They were used to complement the testing automation at the development phases when use of analytics was not yet possible. Six separate feedback collection sessions were arranged using different methods. The paper presents the main learnings of each used method, the perceived usefulness of the methods for the entire development process. We also contribute to the growing knowledge for mobile game development, focusing on methods for the testing with test user approaches. We conclude that testing with user groups can help clarify the mobile game design to create a more appealing game, but choosing the right groups and right moments in the game development phase can be difficult, as can be the interpretation of the feedback for decision making.

KW - development process

KW - game testing

KW - methods

KW - mobile games

KW - users

UR - http://www.scopus.com/inward/record.url?scp=85050245661&partnerID=8YFLogxK

U2 - 10.1109/SeGAH.2018.8401372

DO - 10.1109/SeGAH.2018.8401372

M3 - Conference article in proceedings

SN - 978-1-5386-6299-1

SP - 1

EP - 8

BT - 2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018

PB - Institute of Electrical and Electronic Engineers IEEE

ER -

Annanperä E, Yli-Kantola J, Sauvola T, Heinonen S, Siira E. Testing methods for mobile game development: A case study on user feedback in different development phases. In 2018 IEEE 6th International Conference on Serious Games and Applications for Health, SeGAH 2018. Institute of Electrical and Electronic Engineers IEEE. 2018. p. 1-8 https://doi.org/10.1109/SeGAH.2018.8401372