This title appears in the Scientific Report :
2012
File Transfer in UNICORE: State of the Art
File Transfer in UNICORE: State of the Art
The UNICORE middleware is increasingly used for data-intensive applications where large data volumes need to be transferred reliably at adequate data rates. This paper presents the state of the art in UNICORE with respect to file transfer, and takes an in-depth look at the existing functionalities,...
Saved in:
Personal Name(s): | Schuller, Bernd (Corresponding author) |
---|---|
Rambadt, Michael / Hagemeier, Björn | |
Contributing Institute: |
Jülich Supercomputing Center; JSC |
Published in: | S. 89-94 |
Published in: |
UNICORE Summit 2012, Proceedings, 30 - 31 May 2012 | Dresden, Germany |
Imprint: |
Jülich
Forschungszentrum Jülich GmbH Zentralbibliothek, Verlag
2012
|
Physical Description: |
6 p. |
ISBN: |
978-3-89336-829-7 |
Conference: | UNICORE Summit 2012, Dresden (Germany), 2012-05-30 - 2012-05-31 |
Document Type: |
Contribution to a book Contribution to a conference proceedings |
Research Program: |
Grid Technologies and Infrastructures |
Series Title: |
Schriften des Forschungszentrums Jülich, IAS Series
15 |
Publikationsportal JuSER |
The UNICORE middleware is increasingly used for data-intensive applications where large data volumes need to be transferred reliably at adequate data rates. This paper presents the state of the art in UNICORE with respect to file transfer, and takes an in-depth look at the existing functionalities, the performance (transfer rates, reliability) and last-not-least the current limitations of the existing interfaces and available implementations. The recently introduced UFTP file transfer has been deployed and thoroughly tested in realistic environments. Here, we look at the performance of UFTP in two settings: a test installation within the PRACE infrastructure, and a 100GBit/s testbed operated by the TU Dresden and TU Freiberg. The latter study shows the potential of UFTP in a network of the highest performance. Furthermore, we present work that has been done to integrate the widely used GridFTP transfer into UNICORE, motivated by interoperability requirements in the U.S. XSEDE infrastructure as well as other European software such as dCache. Finally, we review the reliability aspects of the UNICORE server-to-server file transfer and present some possible improvements. |