This title appears in the Scientific Report :
2013
Data-oriented Processing in UNICORE
Data-oriented Processing in UNICORE
In order to support the ongoing shift from traditional batch-job oriented computing towards a stronger focus on efficient processing of "big" scientific data sets, we plan to extend the UNICORE middleware with a new data-oriented processing feature. This feature allows to associate process...
Saved in:
Personal Name(s): | Schuller, Bernd (Corresponding author) |
---|---|
Grunzke, Richard / Giesler, André | |
Contributing Institute: |
Jülich Supercomputing Center; JSC |
Published in: |
UNICORE Summit 2013 |
Imprint: |
Jülich
Forschungszentrum Jülich GmbH, Zentralbibliothek, Verlag
2013
|
Physical Description: |
1-6 |
Conference: | UNICORE Summit 2013, Leipzig (Germany), 2013-06-18 - 2013-06-18 |
Document Type: |
Contribution to a book Contribution to a conference proceedings |
Research Program: |
Grid Technologies and Infrastructures |
Series Title: |
IAS Series
19 |
Publikationsportal JuSER |
In order to support the ongoing shift from traditional batch-job oriented computing towards a stronger focus on efficient processing of "big" scientific data sets, we plan to extend the UNICORE
middleware with a new data-oriented processing feature. This feature allows to associate processing rules with a storage, where data processing is triggered automatically without explicit
user activity. Compared to the similarly rule-driven data management system iRods, the rules are completely controlled by the end user, and all computations are done on account of the
user by virtue of UNICORE’s security system. Furthermore, the system seamlessly integrates with the existing backend storage. This paper describes the initial design, current implementation
status and some first results. The implementation is still in progress, with the first release scheduled for late Autumn 2013 as part of the UNICORE 7 major release. |