This title appears in the Scientific Report :
2022
Please use the identifier:
http://dx.doi.org/10.1109/LGRS.2022.3173052 in citations.
Please use the identifier: http://hdl.handle.net/2128/31655 in citations.
Remote Sensing Image Classification Using CNNs With Balanced Gradient for Distributed Heterogeneous Computing
Remote Sensing Image Classification Using CNNs With Balanced Gradient for Distributed Heterogeneous Computing
Land-cover classification methods are based on the processing of large image volumes to accurately extract representative features. Particularly, convolutional models provide notable characterization properties for image classification tasks. Distributed learning mechanisms on high-performance compu...
Saved in:
Personal Name(s): | Moreno-Alvarez, Sergio |
---|---|
Paoletti, Mercedes E. / Cavallaro, Gabriele / Rico, Juan A. / Haut, Juan M. | |
Contributing Institute: |
Jülich Supercomputing Center; JSC |
Published in: | IEEE geoscience and remote sensing letters, 19 (2022) S. 1 - 5 |
Imprint: |
New York, NY
IEEE
2022
|
DOI: |
10.1109/LGRS.2022.3173052 |
Document Type: |
Journal Article |
Research Program: |
DEEP - Extreme Scale Technologies Transnational Access Programme for a Pan-European Network of HPC Research Infrastructures and Laboratories for scientific computing Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups Cross-Domain Algorithms, Tools, Methods Labs (ATMLs) and Research Groups |
Link: |
OpenAccess |
Publikationsportal JuSER |
Please use the identifier: http://hdl.handle.net/2128/31655 in citations.
Land-cover classification methods are based on the processing of large image volumes to accurately extract representative features. Particularly, convolutional models provide notable characterization properties for image classification tasks. Distributed learning mechanisms on high-performance computing platforms have been proposed to speed up the processing, while achieving an efficient feature extraction. High-performance computing platforms are commonly composed of a combination of central processing units (CPUs) and graphics processing units (GPUs) with different computational capabilities. As a result, current homogeneous workload distribution techniques for deep learning (DL) become obsolete due to their inefficient use of computational resources. To address this, new computational balancing proposals, such as heterogeneous data parallelism, have been implemented. Nevertheless, these techniques should be improved to handle the peculiarities of working with heterogeneous data workloads in the training of distributed DL models. The objective of handling heterogeneous workloads for current platforms motivates the development of this work. This letter proposes an innovative heterogeneous gradient calculation applied to land-cover classification tasks through convolutional models, considering the data amount assigned to each device in the platform while maintaining the acceleration. Extensive experimentation has been conducted on multiple datasets, considering different deep models on heterogeneous platforms to demonstrate the performance of the proposed methodology. |