Analysing and supporting R & D project evaluation

An applied systems analytic approach: Dissertation

Erkki Ormala

Research output: ThesisDissertationMonograph

Abstract

In order to improve R & D project evaluation it is not sufficient merely to develop better evaluation methods.It is also necessary to develop the principles governing the use of the methods.R & D project evaluation should be supported by an explicit evalu ation support system.In this study an applied systems analytic framework, in which mathematical decision models are used for modeling the evaluation process, was developed for the design of such a system.The modeling is aimed at examining the process and choosing and adjusting an appropriate evaluation method.A new decision model - the approximate reasoning model was developed on the basis of the theory of fuzzy decision making.The new model is in some respects more appropriate for the modeling of evaluation processes than previous decision models.The approximate reasoning model can also be used as an R & D project evaluation method.The analysing framework and the approximate reasoning model were applied to the evaluation of completed projects at the Technical Research Centre of Finland. The evaluation processes of three laboratory directors were examined.The approximate reasoning model turned out to represent adequately the ideal evaluation processes of the laboratory directors.However, the basic problem of the evaluation was not associ ated with the intuitive aggregation of the multiple attributes but rather with the high interdependencies among the attributes.Consequently, no major improvements could be attained by using any method supporting the aggregation.It was therefore con cluded that the best way to develop the evaluation would be an arrangement in which the laboratory directors evaluate the projects together with the members of the steering committees, who evaluate the projects differently.
Original languageEnglish
QualificationDoctor Degree
Awarding Institution
  • Helsinki University of Technology
Supervisors/Advisors
  • Vasko, Tibor, Supervisor, External person
Place of PublicationEspoo
Publisher
Print ISBNs951-38-2611-2
Publication statusPublished - 1986
MoE publication typeG4 Doctoral dissertation (monograph)

Fingerprint

Evaluation
Evaluation method
Modeling
Decision model
Finland
Research center
Decision making
Interdependencies

Keywords

  • research projects
  • evaluation
  • fuzzy systems

Cite this

Ormala, E. (1986). Analysing and supporting R & D project evaluation: An applied systems analytic approach: Dissertation. Espoo: VTT Technical Research Centre of Finland.
Ormala, Erkki. / Analysing and supporting R & D project evaluation : An applied systems analytic approach: Dissertation. Espoo : VTT Technical Research Centre of Finland, 1986. 129 p.
@phdthesis{04f59fd9d38e4cfe91d7249b5167b231,
title = "Analysing and supporting R & D project evaluation: An applied systems analytic approach: Dissertation",
abstract = "In order to improve R & D project evaluation it is not sufficient merely to develop better evaluation methods.It is also necessary to develop the principles governing the use of the methods.R & D project evaluation should be supported by an explicit evalu ation support system.In this study an applied systems analytic framework, in which mathematical decision models are used for modeling the evaluation process, was developed for the design of such a system.The modeling is aimed at examining the process and choosing and adjusting an appropriate evaluation method.A new decision model - the approximate reasoning model was developed on the basis of the theory of fuzzy decision making.The new model is in some respects more appropriate for the modeling of evaluation processes than previous decision models.The approximate reasoning model can also be used as an R & D project evaluation method.The analysing framework and the approximate reasoning model were applied to the evaluation of completed projects at the Technical Research Centre of Finland. The evaluation processes of three laboratory directors were examined.The approximate reasoning model turned out to represent adequately the ideal evaluation processes of the laboratory directors.However, the basic problem of the evaluation was not associ ated with the intuitive aggregation of the multiple attributes but rather with the high interdependencies among the attributes.Consequently, no major improvements could be attained by using any method supporting the aggregation.It was therefore con cluded that the best way to develop the evaluation would be an arrangement in which the laboratory directors evaluate the projects together with the members of the steering committees, who evaluate the projects differently.",
keywords = "research projects, evaluation, fuzzy systems",
author = "Erkki Ormala",
year = "1986",
language = "English",
isbn = "951-38-2611-2",
series = "Publications / Technical Research Centre of Finland",
publisher = "VTT Technical Research Centre of Finland",
number = "31",
address = "Finland",
school = "Helsinki University of Technology",

}

Ormala, E 1986, 'Analysing and supporting R & D project evaluation: An applied systems analytic approach: Dissertation', Doctor Degree, Helsinki University of Technology, Espoo.

Analysing and supporting R & D project evaluation : An applied systems analytic approach: Dissertation. / Ormala, Erkki.

Espoo : VTT Technical Research Centre of Finland, 1986. 129 p.

Research output: ThesisDissertationMonograph

TY - THES

T1 - Analysing and supporting R & D project evaluation

T2 - An applied systems analytic approach: Dissertation

AU - Ormala, Erkki

PY - 1986

Y1 - 1986

N2 - In order to improve R & D project evaluation it is not sufficient merely to develop better evaluation methods.It is also necessary to develop the principles governing the use of the methods.R & D project evaluation should be supported by an explicit evalu ation support system.In this study an applied systems analytic framework, in which mathematical decision models are used for modeling the evaluation process, was developed for the design of such a system.The modeling is aimed at examining the process and choosing and adjusting an appropriate evaluation method.A new decision model - the approximate reasoning model was developed on the basis of the theory of fuzzy decision making.The new model is in some respects more appropriate for the modeling of evaluation processes than previous decision models.The approximate reasoning model can also be used as an R & D project evaluation method.The analysing framework and the approximate reasoning model were applied to the evaluation of completed projects at the Technical Research Centre of Finland. The evaluation processes of three laboratory directors were examined.The approximate reasoning model turned out to represent adequately the ideal evaluation processes of the laboratory directors.However, the basic problem of the evaluation was not associ ated with the intuitive aggregation of the multiple attributes but rather with the high interdependencies among the attributes.Consequently, no major improvements could be attained by using any method supporting the aggregation.It was therefore con cluded that the best way to develop the evaluation would be an arrangement in which the laboratory directors evaluate the projects together with the members of the steering committees, who evaluate the projects differently.

AB - In order to improve R & D project evaluation it is not sufficient merely to develop better evaluation methods.It is also necessary to develop the principles governing the use of the methods.R & D project evaluation should be supported by an explicit evalu ation support system.In this study an applied systems analytic framework, in which mathematical decision models are used for modeling the evaluation process, was developed for the design of such a system.The modeling is aimed at examining the process and choosing and adjusting an appropriate evaluation method.A new decision model - the approximate reasoning model was developed on the basis of the theory of fuzzy decision making.The new model is in some respects more appropriate for the modeling of evaluation processes than previous decision models.The approximate reasoning model can also be used as an R & D project evaluation method.The analysing framework and the approximate reasoning model were applied to the evaluation of completed projects at the Technical Research Centre of Finland. The evaluation processes of three laboratory directors were examined.The approximate reasoning model turned out to represent adequately the ideal evaluation processes of the laboratory directors.However, the basic problem of the evaluation was not associ ated with the intuitive aggregation of the multiple attributes but rather with the high interdependencies among the attributes.Consequently, no major improvements could be attained by using any method supporting the aggregation.It was therefore con cluded that the best way to develop the evaluation would be an arrangement in which the laboratory directors evaluate the projects together with the members of the steering committees, who evaluate the projects differently.

KW - research projects

KW - evaluation

KW - fuzzy systems

M3 - Dissertation

SN - 951-38-2611-2

T3 - Publications / Technical Research Centre of Finland

PB - VTT Technical Research Centre of Finland

CY - Espoo

ER -

Ormala E. Analysing and supporting R & D project evaluation: An applied systems analytic approach: Dissertation. Espoo: VTT Technical Research Centre of Finland, 1986. 129 p.