This title appears in the Scientific Report :
2017
Please use the identifier:
http://hdl.handle.net/2128/16564 in citations.
The NESTio project – replacement data recording backend for NEST
The NESTio project – replacement data recording backend for NEST
Simulation data is recorded in NEST by virtual spike detectors and multimeters. In regular intervals during NEST simulations, the recorded data is written to the file system. The current implementation of this writing process does not scale well to large simulations which run on large clusters or su...
Saved in:
Personal Name(s): | Eppler, Jochen Martin (Corresponding author) |
---|---|
Peyser, Alexander / Schenck, Wolfram | |
Contributing Institute: |
Jülich Supercomputing Center; JSC |
Imprint: |
2017
|
Conference: | NEST Conference 2017, Jülich (Germany), 2017-12-19 - 2017-12-20 |
Document Type: |
Conference Presentation |
Research Program: |
SimLab Neuroscience Supercomputing and Modelling for the Human Brain Computational Science and Mathematical Methods |
Link: |
OpenAccess OpenAccess |
Publikationsportal JuSER |
Simulation data is recorded in NEST by virtual spike detectors and multimeters. In regular intervals during NEST simulations, the recorded data is written to the file system. The current implementation of this writing process does not scale well to large simulations which run on large clusters or supercomputers with several hundreds to tens of thousands of compute nodes. For this reason, a completely new software architecture for the recording backends of NEST was developed as the nestio project. This architecture allows the user to direct recording device output to various different file formats and interfaces. Particularly appropriate for large-scale simulations on supercomputers is the implementation of a backend writing to sionlib container files. Benchmarking results show that the sionlib recording backend reduces simulation times by a considerable factor compared to the current NEST recording backend whenever large amounts of data are written to the file system during simulations. |