Framework for tool evaluation for a maintenance environment

Matias Vierimaa, Jorma Taramaa (Corresponding Author), Heli Puustinen, Kati Suominen, Tommi Ketola

Research output: Contribution to journalArticleScientific

1 Citation (Scopus)

Abstract

Tool evaluation forms an essential part of tool development. Unfortunately, there are only a few solutions for this activity. As part of the AMES project, tool evaluation was implemented as part of a more comprehensive framework, used with the development and application of several AMES tools for application maintenance.
These included an application understanding tool‐set, a disabbreviation tool, a reverse‐engineering tool and an impact analysis tool‐set. In addition, the requirement for applicability both to on‐board space software and to tool software has directed our approach in setting requirements for tools evaluation.

The central element of the evaluation process was an AMES‐developed framework including evaluation criteria and the use of a goal/question/metrics (GQM) based approach. The criteria have produced detailed information about each tool.
The final result can be regarded as a combination of the score for each criterion and explicit metrics data. In addition, descriptive information about applications was used in tool evaluation.
Original languageEnglish
Pages (from-to)203-224
JournalJournal of Software Maintenance
Volume10
Issue number3
DOIs
Publication statusPublished - 1998
MoE publication typeB1 Article in a scientific magazine

Keywords

  • software tool evaluation
  • application management
  • software maintenance
  • space applications
  • GQM
  • tool evaluation criteria

Cite this

Vierimaa, Matias ; Taramaa, Jorma ; Puustinen, Heli ; Suominen, Kati ; Ketola, Tommi. / Framework for tool evaluation for a maintenance environment. In: Journal of Software Maintenance. 1998 ; Vol. 10, No. 3. pp. 203-224.
@article{ff9611a22b1f4fb291dcd48305521cbf,
title = "Framework for tool evaluation for a maintenance environment",
abstract = "Tool evaluation forms an essential part of tool development. Unfortunately, there are only a few solutions for this activity. As part of the AMES project, tool evaluation was implemented as part of a more comprehensive framework, used with the development and application of several AMES tools for application maintenance. These included an application understanding tool‐set, a disabbreviation tool, a reverse‐engineering tool and an impact analysis tool‐set. In addition, the requirement for applicability both to on‐board space software and to tool software has directed our approach in setting requirements for tools evaluation.The central element of the evaluation process was an AMES‐developed framework including evaluation criteria and the use of a goal/question/metrics (GQM) based approach. The criteria have produced detailed information about each tool. The final result can be regarded as a combination of the score for each criterion and explicit metrics data. In addition, descriptive information about applications was used in tool evaluation.",
keywords = "software tool evaluation, application management, software maintenance, space applications, GQM, tool evaluation criteria",
author = "Matias Vierimaa and Jorma Taramaa and Heli Puustinen and Kati Suominen and Tommi Ketola",
year = "1998",
doi = "10.1002/(SICI)1096-908X(199805/06)10:3<203::AID-SMR173>3.0.CO;2-0",
language = "English",
volume = "10",
pages = "203--224",
journal = "Journal of Software",
issn = "2047-7473",
publisher = "Wiley",
number = "3",

}

Framework for tool evaluation for a maintenance environment. / Vierimaa, Matias; Taramaa, Jorma (Corresponding Author); Puustinen, Heli; Suominen, Kati; Ketola, Tommi.

In: Journal of Software Maintenance, Vol. 10, No. 3, 1998, p. 203-224.

Research output: Contribution to journalArticleScientific

TY - JOUR

T1 - Framework for tool evaluation for a maintenance environment

AU - Vierimaa, Matias

AU - Taramaa, Jorma

AU - Puustinen, Heli

AU - Suominen, Kati

AU - Ketola, Tommi

PY - 1998

Y1 - 1998

N2 - Tool evaluation forms an essential part of tool development. Unfortunately, there are only a few solutions for this activity. As part of the AMES project, tool evaluation was implemented as part of a more comprehensive framework, used with the development and application of several AMES tools for application maintenance. These included an application understanding tool‐set, a disabbreviation tool, a reverse‐engineering tool and an impact analysis tool‐set. In addition, the requirement for applicability both to on‐board space software and to tool software has directed our approach in setting requirements for tools evaluation.The central element of the evaluation process was an AMES‐developed framework including evaluation criteria and the use of a goal/question/metrics (GQM) based approach. The criteria have produced detailed information about each tool. The final result can be regarded as a combination of the score for each criterion and explicit metrics data. In addition, descriptive information about applications was used in tool evaluation.

AB - Tool evaluation forms an essential part of tool development. Unfortunately, there are only a few solutions for this activity. As part of the AMES project, tool evaluation was implemented as part of a more comprehensive framework, used with the development and application of several AMES tools for application maintenance. These included an application understanding tool‐set, a disabbreviation tool, a reverse‐engineering tool and an impact analysis tool‐set. In addition, the requirement for applicability both to on‐board space software and to tool software has directed our approach in setting requirements for tools evaluation.The central element of the evaluation process was an AMES‐developed framework including evaluation criteria and the use of a goal/question/metrics (GQM) based approach. The criteria have produced detailed information about each tool. The final result can be regarded as a combination of the score for each criterion and explicit metrics data. In addition, descriptive information about applications was used in tool evaluation.

KW - software tool evaluation

KW - application management

KW - software maintenance

KW - space applications

KW - GQM

KW - tool evaluation criteria

U2 - 10.1002/(SICI)1096-908X(199805/06)10:3<203::AID-SMR173>3.0.CO;2-0

DO - 10.1002/(SICI)1096-908X(199805/06)10:3<203::AID-SMR173>3.0.CO;2-0

M3 - Article

VL - 10

SP - 203

EP - 224

JO - Journal of Software

JF - Journal of Software

SN - 2047-7473

IS - 3

ER -