This title appears in the Scientific Report :
2019
Please use the identifier:
http://hdl.handle.net/2128/24005 in citations.
In Transit Coupling of Neuroscientific Simulation and Analysis on High Performance Computing Systems
In Transit Coupling of Neuroscientific Simulation and Analysis on High Performance Computing Systems
High performance computing (HPC) is experiencing an increasing imbalance be-tween processing power and I/O capabilities. This imbalance has led to the challengeof managing the large amounts of data produced by extreme-scale simulations. Ithas become prohibitive expensive to store this data on disk f...
Saved in:
Personal Name(s): | Sontheimer, Kim (Corresponding author) |
---|---|
Contributing Institute: |
Jülich Supercomputing Center; JSC |
Imprint: |
2019
|
Physical Description: |
61 p. |
Dissertation Note: |
Masterarbeit, FH Aachen, 2019 |
Document Type: |
Master Thesis |
Research Program: |
SimLab Neuroscience Computational Science and Mathematical Methods |
Link: |
OpenAccess OpenAccess |
Publikationsportal JuSER |
High performance computing (HPC) is experiencing an increasing imbalance be-tween processing power and I/O capabilities. This imbalance has led to the challengeof managing the large amounts of data produced by extreme-scale simulations. Ithas become prohibitive expensive to store this data on disk for subsequent offlineanalysis. In transit processing could perform this analysis on memory-resident data.In this thesis, based on requirements of neuroscientific use cases, a frameworkhas been designed, implemented and tested on the JURECA supercomputer locatedat the Forschungszentrum Jülich. In the framework, simulation and analysis areconnected in transit across compute nodes using a client-server model. Data istransferred in a streaming manner, without disk I/O in between. The frameworkfulfills the presented use case requirements. Dedicated experiments on algorithmicsolutions of the data transfer show, that no data is lost during transfer.The design of the framework enables future integration of other software and thuscould serve as a basis for in transit coupling in neuroscientific workflows on HPCsystems. |