Optimising the Termofluids CFD code for petascale simulations

ABSTRACT

This paper presents some recent efforts carried out on the expansion of the scalability of TermoFluids multi-physics Computational Fluid Dynamics (CFD) code, aiming to achieve petascale capacity for a single simulation. We describe different aspects that we have improved in our code in order to efficiently run it on 131,072 CPU-cores. This work has been developed using the BlueGene/Q Mira supercomputer of the Argonne Leadership Computing Facility, where we have obtained feedback at the targeted scale. In summary, this is a practical paper showing our experience at reaching the petascale paradigm for a single simulation with TermoFluids.     

A Versatile Compact Parahydrogen Membrane Reactor

We introduce a Spin Transfer Automated Reactor (STAR) that produces continuous parahydrogen induced polarization (PHIP), which is stable for hours to days. We use the PHIP variant called signal amplification by reversible exchange (SABRE), which is particularly well suited to produce continuous hyperpolarization. The STAR is operated in conjunction with benchtop (1.1 T) and high field (9.4 T) NMR magnets, highlighting the versatility of this system to operate with any NMR or MRI system. The STAR uses semipermeable membranes to efficiently deliver parahydrogen into solutions at nano to milli Tesla fields, which enables ¹H, ¹³C, and ¹⁵N hyperpolarization on a large range of substrates including drugs and metabolites. The unique features of the STAR are leveraged for important applications, including continuous hyperpolarization of metabolites, desirable for examining steady-state metabolism in vivo, as well as for continuous RASER signals suitable for the investigation of new physics.     

Parahydrogen‐Induced Radio Amplification by Stimulated Emission of Radiation

Radio amplification by stimulated emission of radiation (RASER) was recently discovered in a low‐field NMR spectrometer incorporating a highly specialized radio‐frequency resonator, where a high degree of proton‐spin polarization was achieved by reversible parahydrogen exchange. RASER activity, which results from the coherent coupling between the nuclear spins and the inductive detector, can overcome the limits of frequency resolution in NMR. Here we show that this phenomenon is not limited to low magnetic fields or the use of resonators with high‐quality factors. We use a commercial bench‐top 1.4 T NMR spectrometer in conjunction with pairwise parahydrogen addition producing proton‐hyperpolarized molecules in the Earth's magnetic field (ALTADENA condition) or in a high magnetic field (PASADENA condition) to induce RASER without any radio‐frequency excitation pulses. The results demonstrate that RASER activity can be observed on virtually any NMR spectrometer and measures most of the important NMR parameters with high precision.     

Numerical analysis of conservative unstructured discretisations for low Mach flows

Unstructured meshes allow easily representing complex geometries and to refine in regions of interest without adding control volumes in unnecessary regions. However, numerical schemes used on unstructured grids have to be properly defined in order to minimise numerical errors. An assessment of a low Mach algorithm for laminar and turbulent flows on unstructured meshes using collocated and staggered formulations is presented. For staggered formulations using cell‐centred velocity reconstructions, the standard first‐order method is shown to be inaccurate in low Mach flows on unstructured grids. A recently proposed least squares procedure for incompressible flows is extended to the low Mach regime and shown to significantly improve the behaviour of the algorithm. Regarding collocated discretisations, the odd–even pressure decoupling is handled through a kinetic energy conserving flux interpolation scheme. This approach is shown to efficiently handle variable‐density flows. Besides, different face interpolations schemes for unstructured meshes are analysed. A kinetic energy‐preserving scheme is applied to the momentum equations, namely, the symmetry‐preserving scheme. Furthermore, a new approach to define the far‐neighbouring nodes of the quadratic upstream interpolation for convective kinematics scheme is presented and analysed. The method is suitable for both structured and unstructured grids, either uniform or not. The proposed algorithm and the spatial schemes are assessed against a function reconstruction, a differentially heated cavity and a turbulent self‐igniting diffusion flame. It is shown that the proposed algorithm accurately represents unsteady variable‐density flows. Furthermore, the quadratic upstream interpolation for convective kinematics scheme shows close to second‐order behaviour on unstructured meshes, and the symmetry‐preserving is reliably used in all computations. Copyright © 2016 John Wiley & Sons, Ltd.     

LES-based Study of the Roughness Effects on the Wake of a Circular Cylinder from Subcritical to Transcritical Reynolds Numbers

This paper investigates the effects of surface roughness on the flow past a circular cylinder at subcritical to transcritical Reynolds numbers. Large eddy simulations of the flow for sand grain roughness of size k/D = 0.02 are performed (D is the cylinder diameter). Results show that surface roughness triggers the transition to turbulence in the boundary layer at all Reynolds numbers, thus leading to an early separation caused by the increased momentum deficit, especially at transcritical Reynolds numbers. Even at subcritical Reynolds numbers, boundary layer instabilities are triggered in the roughness sublayer and eventually lead to the transition to turbulence. The early separation at transcritical Reynolds numbers leads to a wake topology similar to that of the subcritical regime, resulting in an increased drag coefficient and lower Strouhal number. Turbulent statistics in the wake are also affected by roughness; the Reynolds stresses are larger due to the increased turbulent kinetic energy production in the boundary layer and separated shear layers close to the cylinder shoulders.     

Parahydrogen-Induced Radio Amplification by Stimulated Emission of Radiation

Radio amplification by stimulated emission of radiation (RASER) was recently discovered in a low-field NMR spectrometer incorporating a highly specialized radio-frequency resonator, where a high degree of proton-spin polarization was achieved by reversible parahydrogen exchange. RASER activity, which results from the coherent coupling between the nuclear spins and the inductive detector, can overcome the limits of frequency resolution in NMR. Here we show that this phenomenon is not limited to low magnetic fields or the use of resonators with high-quality factors. We use a commercial bench-top 1.4 T NMR spectrometer in conjunction with pairwise parahydrogen addition producing proton-hyperpolarized molecules in the Earth's magnetic field (ALTADENA condition) or in a high magnetic field (PASADENA condition) to induce RASER without any radio-frequency excitation pulses. The results demonstrate that RASER activity can be observed on virtually any NMR spectrometer and measures most of the important NMR parameters with high precision.     

Bis(alk-4-enyl)zink-verbindungen durch addition von alk-2-enylzink an olefine

The dialk-2-enylzinc compounds I–IV add to ethylene, oct-1-ene and 3,3-dimethylcyclopropene to give the corresponding di-alk-4-enylzinc compounds VI–IX (88–98% yield), XV and XVI (90–94% yield), XVII (7%) and XXIIIa–XXVIa (91–98% yield). Additions to XIII are regioselective with Zn → C(1) while stereoselective cis-addition to XXII is observed.     

Elektrochemische synthesen metallorganischer verbindungen III. Darstellung und umwandlung von π-cyclooctenyl-1,5-cyclooctadiencobalt

By electrolysis of cobalt(II)-acetylacetonate in the presence of 1,5-cyclooctadiene there is obtained π-cyclooctenyl-1,5-cyclooctadienecobalt (I). By heating of I to 60° in 1,5-cyclooctadiene, π-bicyclo[3.3.0]octadienyl-(1,5-cyclooctadiene)cobalt (II) and cyclooctene are formed.