A prospect for computing in porous materials research

Very large fluid flow simulations

Keijo Mattila, Tuomas Puurtinen, Jari Hyväluoma, Rodrigo Surmas, Markko Myllys, Tuomas Turpeinen, Fredrik Robertsén, Jan Westerholm, Jussi Timonen

Research output: Contribution to journalArticleScientificpeer-review

16 Citations (Scopus)

Abstract

Properties of porous materials, abundant both in nature and industry, have broad influences on societies via, e.g. oil recovery, erosion, and propagation of pollutants. The internal structure of many porous materials involves multiple scales which hinders research on the relation between structure and transport properties: typically laboratory experiments cannot distinguish contributions from individual scales while computer simulations cannot capture multiple scales due to limited capabilities. Thus the question arises how large domain sizes can in fact be simulated with modern computers. This question is here addressed using a realistic test case; it is demonstrated that current computing capabilities allow the direct pore-scale simulation of fluid flow in porous materials using system sizes far beyond what has been previously reported. The achieved system sizes allow the closing of some particular scale gaps in, e.g. soil and petroleum rock research. Specifically, a full steady-state fluid flow simulation in a porous material, represented with an unprecedented resolution for the given sample size, is reported: the simulation is executed on a CPU-based supercomputer and the 3D geometry involves 16,3843lattice cells (around 590 billion of them are pore sites). Using half of this sample in a benchmark simulation on a GPU-based system, a sustained computational performance of 1.77 PFLOPS is observed. These advances expose new opportunities in porous materials research. The implementation techniques here utilized are standard except for the tailored high-performance data layouts as well as the indirect addressing scheme with a low memory overhead and the truly asynchronous data communication scheme in the case of CPU and GPU code versions, respectively.
Original languageEnglish
Pages (from-to)62-76
Number of pages15
JournalJournal of Computational Science
Volume12
DOIs
Publication statusPublished - Jan 2016
MoE publication typeNot Eligible

Fingerprint

Porous Materials
Flow simulation
Flow Simulation
Fluid Flow
Porous materials
Flow of fluids
Computing
Multiple Scales
Program processors
Asynchronous Communication
Simulation
Supercomputers
Data Communication
Petroleum
Supercomputer
Transport Properties
Erosion
Pollutants
Transport properties
Soil

Keywords

  • Fluid flow simulation
  • GPU
  • Lattice Boltzmann method
  • Permeability
  • Petascale computing
  • Porous material

Cite this

Mattila, Keijo ; Puurtinen, Tuomas ; Hyväluoma, Jari ; Surmas, Rodrigo ; Myllys, Markko ; Turpeinen, Tuomas ; Robertsén, Fredrik ; Westerholm, Jan ; Timonen, Jussi. / A prospect for computing in porous materials research : Very large fluid flow simulations. In: Journal of Computational Science. 2016 ; Vol. 12. pp. 62-76.
@article{2a7e0644c01947839ed36fe47b23cf3f,
title = "A prospect for computing in porous materials research: Very large fluid flow simulations",
abstract = "Properties of porous materials, abundant both in nature and industry, have broad influences on societies via, e.g. oil recovery, erosion, and propagation of pollutants. The internal structure of many porous materials involves multiple scales which hinders research on the relation between structure and transport properties: typically laboratory experiments cannot distinguish contributions from individual scales while computer simulations cannot capture multiple scales due to limited capabilities. Thus the question arises how large domain sizes can in fact be simulated with modern computers. This question is here addressed using a realistic test case; it is demonstrated that current computing capabilities allow the direct pore-scale simulation of fluid flow in porous materials using system sizes far beyond what has been previously reported. The achieved system sizes allow the closing of some particular scale gaps in, e.g. soil and petroleum rock research. Specifically, a full steady-state fluid flow simulation in a porous material, represented with an unprecedented resolution for the given sample size, is reported: the simulation is executed on a CPU-based supercomputer and the 3D geometry involves 16,3843lattice cells (around 590 billion of them are pore sites). Using half of this sample in a benchmark simulation on a GPU-based system, a sustained computational performance of 1.77 PFLOPS is observed. These advances expose new opportunities in porous materials research. The implementation techniques here utilized are standard except for the tailored high-performance data layouts as well as the indirect addressing scheme with a low memory overhead and the truly asynchronous data communication scheme in the case of CPU and GPU code versions, respectively.",
keywords = "Fluid flow simulation, GPU, Lattice Boltzmann method, Permeability, Petascale computing, Porous material",
author = "Keijo Mattila and Tuomas Puurtinen and Jari Hyv{\"a}luoma and Rodrigo Surmas and Markko Myllys and Tuomas Turpeinen and Fredrik Roberts{\'e}n and Jan Westerholm and Jussi Timonen",
year = "2016",
month = "1",
doi = "10.1016/j.jocs.2015.11.013",
language = "English",
volume = "12",
pages = "62--76",
journal = "Journal of Computational Science",
issn = "1877-7503",
publisher = "Elsevier",

}

Mattila, K, Puurtinen, T, Hyväluoma, J, Surmas, R, Myllys, M, Turpeinen, T, Robertsén, F, Westerholm, J & Timonen, J 2016, 'A prospect for computing in porous materials research: Very large fluid flow simulations', Journal of Computational Science, vol. 12, pp. 62-76. https://doi.org/10.1016/j.jocs.2015.11.013

A prospect for computing in porous materials research : Very large fluid flow simulations. / Mattila, Keijo; Puurtinen, Tuomas; Hyväluoma, Jari; Surmas, Rodrigo; Myllys, Markko; Turpeinen, Tuomas; Robertsén, Fredrik; Westerholm, Jan; Timonen, Jussi.

In: Journal of Computational Science, Vol. 12, 01.2016, p. 62-76.

Research output: Contribution to journalArticleScientificpeer-review

TY - JOUR

T1 - A prospect for computing in porous materials research

T2 - Very large fluid flow simulations

AU - Mattila, Keijo

AU - Puurtinen, Tuomas

AU - Hyväluoma, Jari

AU - Surmas, Rodrigo

AU - Myllys, Markko

AU - Turpeinen, Tuomas

AU - Robertsén, Fredrik

AU - Westerholm, Jan

AU - Timonen, Jussi

PY - 2016/1

Y1 - 2016/1

N2 - Properties of porous materials, abundant both in nature and industry, have broad influences on societies via, e.g. oil recovery, erosion, and propagation of pollutants. The internal structure of many porous materials involves multiple scales which hinders research on the relation between structure and transport properties: typically laboratory experiments cannot distinguish contributions from individual scales while computer simulations cannot capture multiple scales due to limited capabilities. Thus the question arises how large domain sizes can in fact be simulated with modern computers. This question is here addressed using a realistic test case; it is demonstrated that current computing capabilities allow the direct pore-scale simulation of fluid flow in porous materials using system sizes far beyond what has been previously reported. The achieved system sizes allow the closing of some particular scale gaps in, e.g. soil and petroleum rock research. Specifically, a full steady-state fluid flow simulation in a porous material, represented with an unprecedented resolution for the given sample size, is reported: the simulation is executed on a CPU-based supercomputer and the 3D geometry involves 16,3843lattice cells (around 590 billion of them are pore sites). Using half of this sample in a benchmark simulation on a GPU-based system, a sustained computational performance of 1.77 PFLOPS is observed. These advances expose new opportunities in porous materials research. The implementation techniques here utilized are standard except for the tailored high-performance data layouts as well as the indirect addressing scheme with a low memory overhead and the truly asynchronous data communication scheme in the case of CPU and GPU code versions, respectively.

AB - Properties of porous materials, abundant both in nature and industry, have broad influences on societies via, e.g. oil recovery, erosion, and propagation of pollutants. The internal structure of many porous materials involves multiple scales which hinders research on the relation between structure and transport properties: typically laboratory experiments cannot distinguish contributions from individual scales while computer simulations cannot capture multiple scales due to limited capabilities. Thus the question arises how large domain sizes can in fact be simulated with modern computers. This question is here addressed using a realistic test case; it is demonstrated that current computing capabilities allow the direct pore-scale simulation of fluid flow in porous materials using system sizes far beyond what has been previously reported. The achieved system sizes allow the closing of some particular scale gaps in, e.g. soil and petroleum rock research. Specifically, a full steady-state fluid flow simulation in a porous material, represented with an unprecedented resolution for the given sample size, is reported: the simulation is executed on a CPU-based supercomputer and the 3D geometry involves 16,3843lattice cells (around 590 billion of them are pore sites). Using half of this sample in a benchmark simulation on a GPU-based system, a sustained computational performance of 1.77 PFLOPS is observed. These advances expose new opportunities in porous materials research. The implementation techniques here utilized are standard except for the tailored high-performance data layouts as well as the indirect addressing scheme with a low memory overhead and the truly asynchronous data communication scheme in the case of CPU and GPU code versions, respectively.

KW - Fluid flow simulation

KW - GPU

KW - Lattice Boltzmann method

KW - Permeability

KW - Petascale computing

KW - Porous material

U2 - 10.1016/j.jocs.2015.11.013

DO - 10.1016/j.jocs.2015.11.013

M3 - Article

VL - 12

SP - 62

EP - 76

JO - Journal of Computational Science

JF - Journal of Computational Science

SN - 1877-7503

ER -