A validation approach for product-focused process improvement

Andreas Birk, Janne Järvinen, Rini van Solingen

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

As the number of software engineering improvement methodologies and their adoption rate in industry increase, the validation of improvement methodologies becomes more and more important. Past validation studies show the effectiveness of improvement methodologies. However, they also reveal many technical difficulties for scientifically sound and detailed validation studies. This paper surveys the state of the art in improvement methodology validation and derives recommendations for systematic validation studies, which are substantiated by experiences from the European PROFES project. PROFES has developed a product-focused software process improvement methodology and started its empirical validation already early in the project. In brief, the main results of our validation work are: (1) Explicit product quality goals increase the effectiveness of process improvement and allow for causal analysis of observed improvements. (2) Validation should be based on explicit, a-priori set hypotheses involving multi-facetted validation criteria. (3) Improvement methodologies of different types, such as process assessment and goal-oriented measurement, are rather complementary than competing approaches.
Original languageEnglish
Title of host publicationInternational Conference on Product Focused Software Process Improvement, PROFES '99
Place of PublicationEspoo
PublisherVTT Technical Research Centre of Finland
Pages29-48
ISBN (Electronic)951-38-5271-7
ISBN (Print)951-38-5270-9
Publication statusPublished - 1999
MoE publication typeA4 Article in a conference publication
EventInternational Conference on Product Focused Software Process Improvement: PROFES ‘99 - Oulu, Finland
Duration: 22 Jun 199924 Jun 1999

Publication series

SeriesVTT Symposium
Number195
ISSN0357-9387

Conference

ConferenceInternational Conference on Product Focused Software Process Improvement
Abbreviated titlePROFES ‘99
CountryFinland
CityOulu
Period22/06/9924/06/99

Fingerprint

Software engineering
Acoustic waves
Industry

Cite this

Birk, A., Järvinen, J., & Solingen, R. V. (1999). A validation approach for product-focused process improvement. In International Conference on Product Focused Software Process Improvement, PROFES '99 (pp. 29-48). Espoo: VTT Technical Research Centre of Finland. VTT Symposium, No. 195
Birk, Andreas ; Järvinen, Janne ; Solingen, Rini van. / A validation approach for product-focused process improvement. International Conference on Product Focused Software Process Improvement, PROFES '99. Espoo : VTT Technical Research Centre of Finland, 1999. pp. 29-48 (VTT Symposium; No. 195).
@inproceedings{94c844d98d9d4286b113ef08929a1842,
title = "A validation approach for product-focused process improvement",
abstract = "As the number of software engineering improvement methodologies and their adoption rate in industry increase, the validation of improvement methodologies becomes more and more important. Past validation studies show the effectiveness of improvement methodologies. However, they also reveal many technical difficulties for scientifically sound and detailed validation studies. This paper surveys the state of the art in improvement methodology validation and derives recommendations for systematic validation studies, which are substantiated by experiences from the European PROFES project. PROFES has developed a product-focused software process improvement methodology and started its empirical validation already early in the project. In brief, the main results of our validation work are: (1) Explicit product quality goals increase the effectiveness of process improvement and allow for causal analysis of observed improvements. (2) Validation should be based on explicit, a-priori set hypotheses involving multi-facetted validation criteria. (3) Improvement methodologies of different types, such as process assessment and goal-oriented measurement, are rather complementary than competing approaches.",
author = "Andreas Birk and Janne J{\"a}rvinen and Solingen, {Rini van}",
year = "1999",
language = "English",
isbn = "951-38-5270-9",
series = "VTT Symposium",
publisher = "VTT Technical Research Centre of Finland",
number = "195",
pages = "29--48",
booktitle = "International Conference on Product Focused Software Process Improvement, PROFES '99",
address = "Finland",

}

Birk, A, Järvinen, J & Solingen, RV 1999, A validation approach for product-focused process improvement. in International Conference on Product Focused Software Process Improvement, PROFES '99. VTT Technical Research Centre of Finland, Espoo, VTT Symposium, no. 195, pp. 29-48, International Conference on Product Focused Software Process Improvement, Oulu, Finland, 22/06/99.

A validation approach for product-focused process improvement. / Birk, Andreas; Järvinen, Janne; Solingen, Rini van.

International Conference on Product Focused Software Process Improvement, PROFES '99. Espoo : VTT Technical Research Centre of Finland, 1999. p. 29-48 (VTT Symposium; No. 195).

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - A validation approach for product-focused process improvement

AU - Birk, Andreas

AU - Järvinen, Janne

AU - Solingen, Rini van

PY - 1999

Y1 - 1999

N2 - As the number of software engineering improvement methodologies and their adoption rate in industry increase, the validation of improvement methodologies becomes more and more important. Past validation studies show the effectiveness of improvement methodologies. However, they also reveal many technical difficulties for scientifically sound and detailed validation studies. This paper surveys the state of the art in improvement methodology validation and derives recommendations for systematic validation studies, which are substantiated by experiences from the European PROFES project. PROFES has developed a product-focused software process improvement methodology and started its empirical validation already early in the project. In brief, the main results of our validation work are: (1) Explicit product quality goals increase the effectiveness of process improvement and allow for causal analysis of observed improvements. (2) Validation should be based on explicit, a-priori set hypotheses involving multi-facetted validation criteria. (3) Improvement methodologies of different types, such as process assessment and goal-oriented measurement, are rather complementary than competing approaches.

AB - As the number of software engineering improvement methodologies and their adoption rate in industry increase, the validation of improvement methodologies becomes more and more important. Past validation studies show the effectiveness of improvement methodologies. However, they also reveal many technical difficulties for scientifically sound and detailed validation studies. This paper surveys the state of the art in improvement methodology validation and derives recommendations for systematic validation studies, which are substantiated by experiences from the European PROFES project. PROFES has developed a product-focused software process improvement methodology and started its empirical validation already early in the project. In brief, the main results of our validation work are: (1) Explicit product quality goals increase the effectiveness of process improvement and allow for causal analysis of observed improvements. (2) Validation should be based on explicit, a-priori set hypotheses involving multi-facetted validation criteria. (3) Improvement methodologies of different types, such as process assessment and goal-oriented measurement, are rather complementary than competing approaches.

M3 - Conference article in proceedings

SN - 951-38-5270-9

T3 - VTT Symposium

SP - 29

EP - 48

BT - International Conference on Product Focused Software Process Improvement, PROFES '99

PB - VTT Technical Research Centre of Finland

CY - Espoo

ER -

Birk A, Järvinen J, Solingen RV. A validation approach for product-focused process improvement. In International Conference on Product Focused Software Process Improvement, PROFES '99. Espoo: VTT Technical Research Centre of Finland. 1999. p. 29-48. (VTT Symposium; No. 195).