This title appears in the Scientific Report :
2018
Please use the identifier:
http://hdl.handle.net/2128/21155 in citations.
Parallel I/O: Benchmarking and common pitfalls
Parallel I/O: Benchmarking and common pitfalls
Beside the computational scalability of an HPC application, its I/O behaviour can significantly influence the overall performance. This behaviour is influenced by many factors, e.g. by the implementation inside the application, the file system, the network and data hardware and software, as well as,...
Saved in:
Personal Name(s): | Lührs, Sebastian (Corresponding author) |
---|---|
Ambrosino, F. (Contributor) / Brzezniak, M. (Contributor) / Frings, Wolfgang (Contributor) / Funel, A. (Contributor) / Guarnieri, G. (Contributor) / Haefele, M. (Contributor) / Iannone, F. (Contributor) / Paluszkiewicz, T. (Contributor) / Sierocinski, K. (Contributor) | |
Contributing Institute: |
Jülich Supercomputing Center; JSC |
Imprint: |
2018
|
Conference: | Renewable Energy meets High Performance Computing: Final Conference of the Energy-Oriented Centre of Excellence, Nicosia (Cyprus), 2018-09-17 - 2018-09-18 |
Document Type: |
Conference Presentation |
Research Program: |
Energy oriented Centre of Excellence for computer applications Computational Science and Mathematical Methods |
Link: |
OpenAccess OpenAccess |
Publikationsportal JuSER |
Beside the computational scalability of an HPC application, its I/O behaviour can significantly influence the overall performance. This behaviour is influenced by many factors, e.g. by the implementation inside the application, the file system, the network and data hardware and software, as well as, since storage is usually a shared resource, other jobs running on the same cluster. Within EoCoE an I/O benchmarking activity was established to investigate how certain I/O patterns can influence the overall performance and how this behaviour can be reflected within the real world HPC applications to optimize the general I/O bandwidth. The talk will present the benchmarking methodology, common parallel I/O pitfalls, and it should guide HPC application developers in the context of parallel I/O problems. |