Towards Green Big Data at CERN

Tapio Niemi, Jukka K. Nurminen, Juha Matti Liukkonen, Ari Pekka Hameri

Research output: Contribution to journalArticleScientificpeer-review

1 Citation (Scopus)

Abstract

High-energy physics studies collisions of particles traveling near the speed of light. For statistically significant results, physicists need to analyze a huge number of such events. One analysis job can take days and process tens of millions of collisions. Today the experiments of the large hadron collider (LHC) create 10 GB of data per second and a future upgrade will cause a ten-fold increase in data. The data analysis requires not only massive hardware but also a lot of electricity. In this article, we discuss energy efficiency in scientific computing and review a set of intermixed approaches we have developed in our Green Big Data project to improve energy efficiency of CERN computing. These approaches include making energy consumption visible to developers and users, architectural improvements, smarter management of computing jobs, and benefits of cloud technologies. The open and innovative environment at CERN is an excellent playground for different energy efficiency ideas which can later find use in mainstream computing.

Original languageEnglish
Pages (from-to)103-113
Number of pages11
JournalFuture Generation Computer Systems
Volume81
Early online date2017
DOIs
Publication statusPublished - 1 Apr 2018
MoE publication typeA1 Journal article-refereed

Fingerprint

Energy efficiency
Job analysis
Light velocity
Natural sciences computing
High energy physics
Colliding beam accelerators
Energy utilization
Electricity
Hardware
Big data
Experiments

Keywords

  • CERN
  • Energy efficiency
  • Green computing
  • Scientific computing

Cite this

Niemi, T., Nurminen, J. K., Liukkonen, J. M., & Hameri, A. P. (2018). Towards Green Big Data at CERN. Future Generation Computer Systems, 81, 103-113. https://doi.org/10.1016/j.future.2017.11.001
Niemi, Tapio ; Nurminen, Jukka K. ; Liukkonen, Juha Matti ; Hameri, Ari Pekka. / Towards Green Big Data at CERN. In: Future Generation Computer Systems. 2018 ; Vol. 81. pp. 103-113.
@article{8c62d0d134f34e1094ec4b22e78d2e67,
title = "Towards Green Big Data at CERN",
abstract = "High-energy physics studies collisions of particles traveling near the speed of light. For statistically significant results, physicists need to analyze a huge number of such events. One analysis job can take days and process tens of millions of collisions. Today the experiments of the large hadron collider (LHC) create 10 GB of data per second and a future upgrade will cause a ten-fold increase in data. The data analysis requires not only massive hardware but also a lot of electricity. In this article, we discuss energy efficiency in scientific computing and review a set of intermixed approaches we have developed in our Green Big Data project to improve energy efficiency of CERN computing. These approaches include making energy consumption visible to developers and users, architectural improvements, smarter management of computing jobs, and benefits of cloud technologies. The open and innovative environment at CERN is an excellent playground for different energy efficiency ideas which can later find use in mainstream computing.",
keywords = "CERN, Energy efficiency, Green computing, Scientific computing",
author = "Tapio Niemi and Nurminen, {Jukka K.} and Liukkonen, {Juha Matti} and Hameri, {Ari Pekka}",
year = "2018",
month = "4",
day = "1",
doi = "10.1016/j.future.2017.11.001",
language = "English",
volume = "81",
pages = "103--113",
journal = "Future Generation Computer Systems",
issn = "0167-739X",
publisher = "Elsevier",

}

Niemi, T, Nurminen, JK, Liukkonen, JM & Hameri, AP 2018, 'Towards Green Big Data at CERN', Future Generation Computer Systems, vol. 81, pp. 103-113. https://doi.org/10.1016/j.future.2017.11.001

Towards Green Big Data at CERN. / Niemi, Tapio; Nurminen, Jukka K.; Liukkonen, Juha Matti; Hameri, Ari Pekka.

In: Future Generation Computer Systems, Vol. 81, 01.04.2018, p. 103-113.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - Towards Green Big Data at CERN

AU - Niemi, Tapio

AU - Nurminen, Jukka K.

AU - Liukkonen, Juha Matti

AU - Hameri, Ari Pekka

PY - 2018/4/1

Y1 - 2018/4/1

N2 - High-energy physics studies collisions of particles traveling near the speed of light. For statistically significant results, physicists need to analyze a huge number of such events. One analysis job can take days and process tens of millions of collisions. Today the experiments of the large hadron collider (LHC) create 10 GB of data per second and a future upgrade will cause a ten-fold increase in data. The data analysis requires not only massive hardware but also a lot of electricity. In this article, we discuss energy efficiency in scientific computing and review a set of intermixed approaches we have developed in our Green Big Data project to improve energy efficiency of CERN computing. These approaches include making energy consumption visible to developers and users, architectural improvements, smarter management of computing jobs, and benefits of cloud technologies. The open and innovative environment at CERN is an excellent playground for different energy efficiency ideas which can later find use in mainstream computing.

AB - High-energy physics studies collisions of particles traveling near the speed of light. For statistically significant results, physicists need to analyze a huge number of such events. One analysis job can take days and process tens of millions of collisions. Today the experiments of the large hadron collider (LHC) create 10 GB of data per second and a future upgrade will cause a ten-fold increase in data. The data analysis requires not only massive hardware but also a lot of electricity. In this article, we discuss energy efficiency in scientific computing and review a set of intermixed approaches we have developed in our Green Big Data project to improve energy efficiency of CERN computing. These approaches include making energy consumption visible to developers and users, architectural improvements, smarter management of computing jobs, and benefits of cloud technologies. The open and innovative environment at CERN is an excellent playground for different energy efficiency ideas which can later find use in mainstream computing.

KW - CERN

KW - Energy efficiency

KW - Green computing

KW - Scientific computing

U2 - 10.1016/j.future.2017.11.001

DO - 10.1016/j.future.2017.11.001

M3 - Article

VL - 81

SP - 103

EP - 113

JO - Future Generation Computer Systems

JF - Future Generation Computer Systems

SN - 0167-739X

ER -

Niemi T, Nurminen JK, Liukkonen JM, Hameri AP. Towards Green Big Data at CERN. Future Generation Computer Systems. 2018 Apr 1;81:103-113. https://doi.org/10.1016/j.future.2017.11.001