Integration test automation of embedded communication software: Licentiate thesis

Research output: ThesisLicenciateTheses

2 Citations (Scopus)

Abstract

The complexity of embedded systems has been growing in recent years. Competition in the international markets has increased the quality requirements of products which contain embedded systems. It has also required shorter development times and several customer specific versions of a product to be developed. As a result, the cost of testing has increased up to 50 % of the total manpower in a development project. Therefore, automation of the routine work included in testing of embedded systems and their software has been estimated to be significant in lowering the costs and increasing the quality of products. The focus of this thesis is on simulation based integration test automation of embedded communication software. The objective is to raise the automation level in host based integration testing and to make testing and debugging easier for a human tester. A set of basic principles for integration test automation of embedded communication software is developed and studied. The principles are based on the global controllability and observability of testing and for time simulation, which is used to reduce non-determinism appropriately to enable repeatable test sessions and to make testing easier for a human tester. The constructed integration testing platform enables test automation in test execution and test result analysis in a practical way. The platform is generic in the sense that it allows use of different implementation technologies for protocol simulations and test cases, and can thus form a backbone for the different kinds of protocol test systems. The integration testing platform has been exploited in several industrial development projects. Two different protocol software test systems are discussed to demonstrate the results. The evaluation indicates that the host environment is very applicable to testing of the logical correctness of embedded software and for integration test automation. The software under test and its operational environment can be controlled and observed in a flexible and efficient way. Test execution can be carried out in a repeatable manner and test results can be derived automatically. In addition, an unlimited tracing capability and automated regression testing are facilitated along with synchronous debugging of the distributed test system.
Original languageEnglish
QualificationLicentiate Degree
Awarding Institution
  • University of Oulu
Supervisors/Advisors
  • Pulli, Petri, Advisor, External person
  • Röning, Juha, Supervisor, External person
Place of PublicationEspoo
Publisher
Print ISBNs951-38-5070-6
Publication statusPublished - 1997
MoE publication typeG3 Licentiate thesis

Fingerprint

Automation
Integration testing
Communication
Testing
Embedded systems
Network protocols
Embedded software
Observability
Controllability
Costs
Computer systems

Cite this

Latvakoski, Juhani. / Integration test automation of embedded communication software : Licentiate thesis. Espoo : VTT Technical Research Centre of Finland, 1997. 130 p.
@phdthesis{93383385def94935bcd92ff7b1ec1358,
title = "Integration test automation of embedded communication software: Licentiate thesis",
abstract = "The complexity of embedded systems has been growing in recent years. Competition in the international markets has increased the quality requirements of products which contain embedded systems. It has also required shorter development times and several customer specific versions of a product to be developed. As a result, the cost of testing has increased up to 50 {\%} of the total manpower in a development project. Therefore, automation of the routine work included in testing of embedded systems and their software has been estimated to be significant in lowering the costs and increasing the quality of products. The focus of this thesis is on simulation based integration test automation of embedded communication software. The objective is to raise the automation level in host based integration testing and to make testing and debugging easier for a human tester. A set of basic principles for integration test automation of embedded communication software is developed and studied. The principles are based on the global controllability and observability of testing and for time simulation, which is used to reduce non-determinism appropriately to enable repeatable test sessions and to make testing easier for a human tester. The constructed integration testing platform enables test automation in test execution and test result analysis in a practical way. The platform is generic in the sense that it allows use of different implementation technologies for protocol simulations and test cases, and can thus form a backbone for the different kinds of protocol test systems. The integration testing platform has been exploited in several industrial development projects. Two different protocol software test systems are discussed to demonstrate the results. The evaluation indicates that the host environment is very applicable to testing of the logical correctness of embedded software and for integration test automation. The software under test and its operational environment can be controlled and observed in a flexible and efficient way. Test execution can be carried out in a repeatable manner and test results can be derived automatically. In addition, an unlimited tracing capability and automated regression testing are facilitated along with synchronous debugging of the distributed test system.",
author = "Juhani Latvakoski",
year = "1997",
language = "English",
isbn = "951-38-5070-6",
series = "VTT Publications",
publisher = "VTT Technical Research Centre of Finland",
number = "318",
address = "Finland",
school = "University of Oulu",

}

Integration test automation of embedded communication software : Licentiate thesis. / Latvakoski, Juhani.

Espoo : VTT Technical Research Centre of Finland, 1997. 130 p.

Research output: ThesisLicenciateTheses

TY - THES

T1 - Integration test automation of embedded communication software

T2 - Licentiate thesis

AU - Latvakoski, Juhani

PY - 1997

Y1 - 1997

N2 - The complexity of embedded systems has been growing in recent years. Competition in the international markets has increased the quality requirements of products which contain embedded systems. It has also required shorter development times and several customer specific versions of a product to be developed. As a result, the cost of testing has increased up to 50 % of the total manpower in a development project. Therefore, automation of the routine work included in testing of embedded systems and their software has been estimated to be significant in lowering the costs and increasing the quality of products. The focus of this thesis is on simulation based integration test automation of embedded communication software. The objective is to raise the automation level in host based integration testing and to make testing and debugging easier for a human tester. A set of basic principles for integration test automation of embedded communication software is developed and studied. The principles are based on the global controllability and observability of testing and for time simulation, which is used to reduce non-determinism appropriately to enable repeatable test sessions and to make testing easier for a human tester. The constructed integration testing platform enables test automation in test execution and test result analysis in a practical way. The platform is generic in the sense that it allows use of different implementation technologies for protocol simulations and test cases, and can thus form a backbone for the different kinds of protocol test systems. The integration testing platform has been exploited in several industrial development projects. Two different protocol software test systems are discussed to demonstrate the results. The evaluation indicates that the host environment is very applicable to testing of the logical correctness of embedded software and for integration test automation. The software under test and its operational environment can be controlled and observed in a flexible and efficient way. Test execution can be carried out in a repeatable manner and test results can be derived automatically. In addition, an unlimited tracing capability and automated regression testing are facilitated along with synchronous debugging of the distributed test system.

AB - The complexity of embedded systems has been growing in recent years. Competition in the international markets has increased the quality requirements of products which contain embedded systems. It has also required shorter development times and several customer specific versions of a product to be developed. As a result, the cost of testing has increased up to 50 % of the total manpower in a development project. Therefore, automation of the routine work included in testing of embedded systems and their software has been estimated to be significant in lowering the costs and increasing the quality of products. The focus of this thesis is on simulation based integration test automation of embedded communication software. The objective is to raise the automation level in host based integration testing and to make testing and debugging easier for a human tester. A set of basic principles for integration test automation of embedded communication software is developed and studied. The principles are based on the global controllability and observability of testing and for time simulation, which is used to reduce non-determinism appropriately to enable repeatable test sessions and to make testing easier for a human tester. The constructed integration testing platform enables test automation in test execution and test result analysis in a practical way. The platform is generic in the sense that it allows use of different implementation technologies for protocol simulations and test cases, and can thus form a backbone for the different kinds of protocol test systems. The integration testing platform has been exploited in several industrial development projects. Two different protocol software test systems are discussed to demonstrate the results. The evaluation indicates that the host environment is very applicable to testing of the logical correctness of embedded software and for integration test automation. The software under test and its operational environment can be controlled and observed in a flexible and efficient way. Test execution can be carried out in a repeatable manner and test results can be derived automatically. In addition, an unlimited tracing capability and automated regression testing are facilitated along with synchronous debugging of the distributed test system.

M3 - Licenciate

SN - 951-38-5070-6

T3 - VTT Publications

PB - VTT Technical Research Centre of Finland

CY - Espoo

ER -

Latvakoski J. Integration test automation of embedded communication software: Licentiate thesis. Espoo: VTT Technical Research Centre of Finland, 1997. 130 p.