Providing test quality feedback using static source code and automatic test suite metrics

N. Nagappan, L. Williams, J. Osborne, M. Vouk, Pekka Abrahamsson

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

17 Citations (Scopus)

Abstract

A classic question in software development is "How much testing is enough?" Aside from dynamic coverage-based metrics, there are few measures that can be used to provide guidance on the quality of an automatic test suite as development proceeds. This paper utilizes the software testing and reliability early warning (STREW) static metric suite to provide a developer with indications of changes and additions to their automated unit test suite and code for added confidence that product quality will be high. Retrospective case studies to assess the utility of using the STREW metrics as a feedback mechanism were performed in academic, open source and industrial environments. The results indicate at statistically significant levels the ability of the STREW metrics to provide feedback on important attributes of an automatic test suite and corresponding code.
Original languageEnglish
Title of host publicationThe 16th IEEE International Symposium on Software Reliability Engineering (ISSRE 2005)
PublisherIEEE Institute of Electrical and Electronic Engineers
Pages85-94
ISBN (Print)0-7695-2482-6
DOIs
Publication statusPublished - 2005
MoE publication typeA4 Article in a conference publication
Event16th IEEE International Symposium on Software Reliability Engineering (ISSRE 2005) - Chicago, United States
Duration: 8 Nov 200511 Nov 2005

Conference

Conference16th IEEE International Symposium on Software Reliability Engineering (ISSRE 2005)
Country/TerritoryUnited States
CityChicago
Period8/11/0511/11/05

Keywords

  • feedback
  • program testing
  • software metrics
  • software quality
  • software reliability
  • automatic test suite metrics
  • product quality
  • reliability early warning static metric suite
  • software development
  • software testing
  • static source code
  • test quality feedback

Fingerprint

Dive into the research topics of 'Providing test quality feedback using static source code and automatic test suite metrics'. Together they form a unique fingerprint.

Cite this