Research collaboration and production of excellence: Finland 1995-2009

Hannes Toivanen, Arho Suominen

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

Abstract

This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish "hot papers" or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of "high quality research", being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the "other cited papers", which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how "scientific excellence" should be defined and measured in national contexts.
Original languageEnglish
Title of host publicationProceedings of ISSI 2013 Vienna, Volume II
EditorsJuan Gorraiz, Edgar Schiebel, Christian Gumpenberger, Marianne Hörlesberger, Henk Moed
Pages1506-1527
Volume2
Publication statusPublished - 2013
MoE publication typeNot Eligible
Event14th International Society of Scientometrics and Informetrics Conference, ISSI 2013 - Wien, Austria
Duration: 15 Jul 201319 Jul 2013

Conference

Conference14th International Society of Scientometrics and Informetrics Conference, ISSI 2013
Abbreviated titleISSI 2013
CountryAustria
CityWien
Period15/07/1319/07/13

Fingerprint

Finland
development policy
credit

Keywords

  • research collaboration
  • research front
  • Finland
  • research evaluation
  • citation analysis
  • research excellence

Cite this

Toivanen, H., & Suominen, A. (2013). Research collaboration and production of excellence: Finland 1995-2009. In J. Gorraiz, E. Schiebel, C. Gumpenberger, M. Hörlesberger, & H. Moed (Eds.), Proceedings of ISSI 2013 Vienna, Volume II (Vol. 2, pp. 1506-1527)
Toivanen, Hannes ; Suominen, Arho. / Research collaboration and production of excellence : Finland 1995-2009. Proceedings of ISSI 2013 Vienna, Volume II. editor / Juan Gorraiz ; Edgar Schiebel ; Christian Gumpenberger ; Marianne Hörlesberger ; Henk Moed. Vol. 2 2013. pp. 1506-1527
@inproceedings{bd4664581c36499791da29348030ee3e,
title = "Research collaboration and production of excellence: Finland 1995-2009",
abstract = "This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish {"}hot papers{"} or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of {"}high quality research{"}, being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the {"}other cited papers{"}, which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how {"}scientific excellence{"} should be defined and measured in national contexts.",
keywords = "research collaboration, research front, Finland, research evaluation, citation analysis, research excellence",
author = "Hannes Toivanen and Arho Suominen",
year = "2013",
language = "English",
isbn = "978-3-200-03135-7",
volume = "2",
pages = "1506--1527",
editor = "Juan Gorraiz and Edgar Schiebel and Christian Gumpenberger and { H{\"o}rlesberger}, Marianne and Henk Moed",
booktitle = "Proceedings of ISSI 2013 Vienna, Volume II",

}

Toivanen, H & Suominen, A 2013, Research collaboration and production of excellence: Finland 1995-2009. in J Gorraiz, E Schiebel, C Gumpenberger, M Hörlesberger & H Moed (eds), Proceedings of ISSI 2013 Vienna, Volume II. vol. 2, pp. 1506-1527, 14th International Society of Scientometrics and Informetrics Conference, ISSI 2013, Wien, Austria, 15/07/13.

Research collaboration and production of excellence : Finland 1995-2009. / Toivanen, Hannes; Suominen, Arho.

Proceedings of ISSI 2013 Vienna, Volume II. ed. / Juan Gorraiz; Edgar Schiebel; Christian Gumpenberger; Marianne Hörlesberger; Henk Moed. Vol. 2 2013. p. 1506-1527.

Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

TY - GEN

T1 - Research collaboration and production of excellence

T2 - Finland 1995-2009

AU - Toivanen, Hannes

AU - Suominen, Arho

PY - 2013

Y1 - 2013

N2 - This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish "hot papers" or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of "high quality research", being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the "other cited papers", which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how "scientific excellence" should be defined and measured in national contexts.

AB - This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish "hot papers" or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of "high quality research", being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the "other cited papers", which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how "scientific excellence" should be defined and measured in national contexts.

KW - research collaboration

KW - research front

KW - Finland

KW - research evaluation

KW - citation analysis

KW - research excellence

M3 - Conference article in proceedings

SN - 978-3-200-03135-7

VL - 2

SP - 1506

EP - 1527

BT - Proceedings of ISSI 2013 Vienna, Volume II

A2 - Gorraiz, Juan

A2 - Schiebel, Edgar

A2 - Gumpenberger, Christian

A2 - Hörlesberger, Marianne

A2 - Moed, Henk

ER -

Toivanen H, Suominen A. Research collaboration and production of excellence: Finland 1995-2009. In Gorraiz J, Schiebel E, Gumpenberger C, Hörlesberger M, Moed H, editors, Proceedings of ISSI 2013 Vienna, Volume II. Vol. 2. 2013. p. 1506-1527