Research collaboration and production of excellence: Finland 1995-2009

Hannes Toivanen, Arho Suominen

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    Abstract

    This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish "hot papers" or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of "high quality research", being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the "other cited papers", which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how "scientific excellence" should be defined and measured in national contexts.
    Original languageEnglish
    Title of host publicationProceedings of ISSI 2013 Vienna, Volume II
    EditorsJuan Gorraiz, Edgar Schiebel, Christian Gumpenberger, Marianne Hörlesberger, Henk Moed
    Pages1506-1527
    Volume2
    Publication statusPublished - 2013
    MoE publication typeNot Eligible
    Event14th International Society of Scientometrics and Informetrics Conference, ISSI 2013 - Wien, Austria
    Duration: 15 Jul 201319 Jul 2013

    Conference

    Conference14th International Society of Scientometrics and Informetrics Conference, ISSI 2013
    Abbreviated titleISSI 2013
    CountryAustria
    CityWien
    Period15/07/1319/07/13

    Fingerprint

    Finland
    development policy
    credit

    Keywords

    • research collaboration
    • research front
    • Finland
    • research evaluation
    • citation analysis
    • research excellence

    Cite this

    Toivanen, H., & Suominen, A. (2013). Research collaboration and production of excellence: Finland 1995-2009. In J. Gorraiz, E. Schiebel, C. Gumpenberger, M. Hörlesberger, & H. Moed (Eds.), Proceedings of ISSI 2013 Vienna, Volume II (Vol. 2, pp. 1506-1527)
    Toivanen, Hannes ; Suominen, Arho. / Research collaboration and production of excellence : Finland 1995-2009. Proceedings of ISSI 2013 Vienna, Volume II. editor / Juan Gorraiz ; Edgar Schiebel ; Christian Gumpenberger ; Marianne Hörlesberger ; Henk Moed. Vol. 2 2013. pp. 1506-1527
    @inproceedings{bd4664581c36499791da29348030ee3e,
    title = "Research collaboration and production of excellence: Finland 1995-2009",
    abstract = "This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish {"}hot papers{"} or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of {"}high quality research{"}, being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the {"}other cited papers{"}, which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how {"}scientific excellence{"} should be defined and measured in national contexts.",
    keywords = "research collaboration, research front, Finland, research evaluation, citation analysis, research excellence",
    author = "Hannes Toivanen and Arho Suominen",
    year = "2013",
    language = "English",
    isbn = "978-3-200-03135-7",
    volume = "2",
    pages = "1506--1527",
    editor = "Juan Gorraiz and Edgar Schiebel and Christian Gumpenberger and { H{\"o}rlesberger}, Marianne and Henk Moed",
    booktitle = "Proceedings of ISSI 2013 Vienna, Volume II",

    }

    Toivanen, H & Suominen, A 2013, Research collaboration and production of excellence: Finland 1995-2009. in J Gorraiz, E Schiebel, C Gumpenberger, M Hörlesberger & H Moed (eds), Proceedings of ISSI 2013 Vienna, Volume II. vol. 2, pp. 1506-1527, 14th International Society of Scientometrics and Informetrics Conference, ISSI 2013, Wien, Austria, 15/07/13.

    Research collaboration and production of excellence : Finland 1995-2009. / Toivanen, Hannes; Suominen, Arho.

    Proceedings of ISSI 2013 Vienna, Volume II. ed. / Juan Gorraiz; Edgar Schiebel; Christian Gumpenberger; Marianne Hörlesberger; Henk Moed. Vol. 2 2013. p. 1506-1527.

    Research output: Chapter in Book/Report/Conference proceedingConference article in proceedingsScientificpeer-review

    TY - GEN

    T1 - Research collaboration and production of excellence

    T2 - Finland 1995-2009

    AU - Toivanen, Hannes

    AU - Suominen, Arho

    PY - 2013

    Y1 - 2013

    N2 - This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish "hot papers" or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of "high quality research", being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the "other cited papers", which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how "scientific excellence" should be defined and measured in national contexts.

    AB - This study describes a novel method of assessing credit for authorship and citations received, and argues that conventional bibliometric assessments used for policy development lead to misguided conclusions about how best research is created, and what type policies may promote research excellence. Exploring Finnish research 1995-2009 based on ISI data, we demonstrate that the nature of the Finnish "hot papers" or research frontiers (papers that receive most citations within two years after publication) doesn't correspond with the idealized vision of "high quality research", being highly national and created by relatively small author teams. As such, it also resembles closely research with no impact, i.e. the non-cited papers. These two differ from the "other cited papers", which are authored by larger and highly international teams. While we describe the author team structure and national nature for different cohorts of scientific excellence, our central result is the observation that in terms production of excellence, whole citations created per author, small Finnish author teams are slightly more productive than large international author teams. We discuss at some length the methodological and policy implications of our results, especially as far as they give rise to the suspicion that conventional (Finnish) policy efforts to foster research excellence target the middle-tier papers and target poorly the best papers that resemble closely the worst ones. We also demonstrate how results and conclusions are highly dependent whether research excellence assessment focuses on papers or alternatively researchers. Finally, we consider how "scientific excellence" should be defined and measured in national contexts.

    KW - research collaboration

    KW - research front

    KW - Finland

    KW - research evaluation

    KW - citation analysis

    KW - research excellence

    M3 - Conference article in proceedings

    SN - 978-3-200-03135-7

    VL - 2

    SP - 1506

    EP - 1527

    BT - Proceedings of ISSI 2013 Vienna, Volume II

    A2 - Gorraiz, Juan

    A2 - Schiebel, Edgar

    A2 - Gumpenberger, Christian

    A2 - Hörlesberger, Marianne

    A2 - Moed, Henk

    ER -

    Toivanen H, Suominen A. Research collaboration and production of excellence: Finland 1995-2009. In Gorraiz J, Schiebel E, Gumpenberger C, Hörlesberger M, Moed H, editors, Proceedings of ISSI 2013 Vienna, Volume II. Vol. 2. 2013. p. 1506-1527