This title appears in the Scientific Report : 2013 

Data-oriented Processing in UNICORE
Schuller, Bernd (Corresponding author)
Grunzke, Richard / Giesler, André
Jülich Supercomputing Center; JSC
UNICORE Summit 2013
Jülich Forschungszentrum Jülich GmbH, Zentralbibliothek, Verlag 2013
UNICORE Summit 2013, Leipzig (Germany), 2013-06-18 - 2013-06-18
Contribution to a book
Contribution to a conference proceedings
Grid Technologies and Infrastructures
IAS Series 19
In order to support the ongoing shift from traditional batch-job oriented computing towards a stronger focus on efficient processing of "big" scientific data sets, we plan to extend the UNICORE middleware with a new data-oriented processing feature. This feature allows to associate processing rules with a storage, where data processing is triggered automatically without explicit user activity. Compared to the similarly rule-driven data management system iRods, the rules are completely controlled by the end user, and all computations are done on account of the user by virtue of UNICORE’s security system. Furthermore, the system seamlessly integrates with the existing backend storage. This paper describes the initial design, current implementation status and some first results. The implementation is still in progress, with the first release scheduled for late Autumn 2013 as part of the UNICORE 7 major release.