The difficulties in assessing the impact of EU framework programmes

Terttu Luukkonen (Corresponding Author)

Research output: Contribution to journalArticleScientificpeer-review

77 Citations (Scopus)

Abstract

Evaluations concerning the EU framework programmes have not been able to get to grips with competitiveness, which is a major objective for these research programmes. The reasons include the general nature of the objective and the ensuing difficulty in measuring its attainment. There are also conceptual and methodological problems in evaluation studies, which arise from the fact that they are part of the political processes for formulating the programmes. The paper points out that the concept of additionality, used in these studies, has serious conceptual and measurement problems and asserts that in the evaluation of the impact of EU research programmes, too little attention has been paid to the interactions between firms' R&D strategies and their EU collaboration activities. The paper summarises findings of impact studies carried out in several countries and shows that intangible, infrastructural effects, such as learning new skills and catalysing new network relations, are the impact most often mentioned by all partners concerned. The programmes have other important effects related to the promotion of common standards, which are a prerequisite for the creation of a common market. In order to assess the longer-term importance and evolution of the networks created, more qualitative and longitudinal studies ought to be carried out.
Original languageEnglish
Pages (from-to)599-610
JournalResearch Policy
Volume27
Issue number6
DOIs
Publication statusPublished - 1998
MoE publication typeA1 Journal article-refereed

Fingerprint

EU Framework Programmes
Evaluation
Research program
European Union
Longitudinal study
Additionality
Competitiveness
Qualitative study
Intangibles
Impact studies
Interaction
Political process

Cite this

Luukkonen, Terttu. / The difficulties in assessing the impact of EU framework programmes. In: Research Policy. 1998 ; Vol. 27, No. 6. pp. 599-610.
@article{ff9df30ea49940c4b8d9a525177d6cba,
title = "The difficulties in assessing the impact of EU framework programmes",
abstract = "Evaluations concerning the EU framework programmes have not been able to get to grips with competitiveness, which is a major objective for these research programmes. The reasons include the general nature of the objective and the ensuing difficulty in measuring its attainment. There are also conceptual and methodological problems in evaluation studies, which arise from the fact that they are part of the political processes for formulating the programmes. The paper points out that the concept of additionality, used in these studies, has serious conceptual and measurement problems and asserts that in the evaluation of the impact of EU research programmes, too little attention has been paid to the interactions between firms' R&D strategies and their EU collaboration activities. The paper summarises findings of impact studies carried out in several countries and shows that intangible, infrastructural effects, such as learning new skills and catalysing new network relations, are the impact most often mentioned by all partners concerned. The programmes have other important effects related to the promotion of common standards, which are a prerequisite for the creation of a common market. In order to assess the longer-term importance and evolution of the networks created, more qualitative and longitudinal studies ought to be carried out.",
author = "Terttu Luukkonen",
note = "Project code: J7SU00006",
year = "1998",
doi = "10.1016/S0048-7333(98)00058-4",
language = "English",
volume = "27",
pages = "599--610",
journal = "Research Policy",
issn = "0048-7333",
publisher = "Elsevier",
number = "6",

}

The difficulties in assessing the impact of EU framework programmes. / Luukkonen, Terttu (Corresponding Author).

In: Research Policy, Vol. 27, No. 6, 1998, p. 599-610.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - The difficulties in assessing the impact of EU framework programmes

AU - Luukkonen, Terttu

N1 - Project code: J7SU00006

PY - 1998

Y1 - 1998

N2 - Evaluations concerning the EU framework programmes have not been able to get to grips with competitiveness, which is a major objective for these research programmes. The reasons include the general nature of the objective and the ensuing difficulty in measuring its attainment. There are also conceptual and methodological problems in evaluation studies, which arise from the fact that they are part of the political processes for formulating the programmes. The paper points out that the concept of additionality, used in these studies, has serious conceptual and measurement problems and asserts that in the evaluation of the impact of EU research programmes, too little attention has been paid to the interactions between firms' R&D strategies and their EU collaboration activities. The paper summarises findings of impact studies carried out in several countries and shows that intangible, infrastructural effects, such as learning new skills and catalysing new network relations, are the impact most often mentioned by all partners concerned. The programmes have other important effects related to the promotion of common standards, which are a prerequisite for the creation of a common market. In order to assess the longer-term importance and evolution of the networks created, more qualitative and longitudinal studies ought to be carried out.

AB - Evaluations concerning the EU framework programmes have not been able to get to grips with competitiveness, which is a major objective for these research programmes. The reasons include the general nature of the objective and the ensuing difficulty in measuring its attainment. There are also conceptual and methodological problems in evaluation studies, which arise from the fact that they are part of the political processes for formulating the programmes. The paper points out that the concept of additionality, used in these studies, has serious conceptual and measurement problems and asserts that in the evaluation of the impact of EU research programmes, too little attention has been paid to the interactions between firms' R&D strategies and their EU collaboration activities. The paper summarises findings of impact studies carried out in several countries and shows that intangible, infrastructural effects, such as learning new skills and catalysing new network relations, are the impact most often mentioned by all partners concerned. The programmes have other important effects related to the promotion of common standards, which are a prerequisite for the creation of a common market. In order to assess the longer-term importance and evolution of the networks created, more qualitative and longitudinal studies ought to be carried out.

U2 - 10.1016/S0048-7333(98)00058-4

DO - 10.1016/S0048-7333(98)00058-4

M3 - Article

VL - 27

SP - 599

EP - 610

JO - Research Policy

JF - Research Policy

SN - 0048-7333

IS - 6

ER -