 |
The open archive HAL of Paris 1 Panthéon-Sorbonne university |
Conference papers
Context-Aware Scheduling for Apache Hadoop over Pervasive Environments
Abstract : This article proposes to improve Apache Hadoop scheduling through the usage of context-awareness. Apache Hadoop is the most popular implementation of the MapReduce paradigm for distributed computing, but its design doesn't adapt automatically to computing nodes' context and capabilities. By introducing context-awareness into Hadoop, we intent to dynamically adapt its scheduling to the execution environment. This is a necessary feature in the context of pervasive grids, which are heterogeneous, dynamic and shared environments. The solution has been incorporated into Hadoop and evaluated through controlled experiments. The experiments demonstrate that context-awareness provides comparative performance gains, especially when part of the resources disappear during execution.
Cited literature [18 references]
https://hal-paris1.archives-ouvertes.fr/hal-01196986
Contributor : Manuele Kirsch Pinheiro Connect in order to contact the contributor
Submitted on : Tuesday, September 15, 2015 - 12:28:37 PM
Last modification on : Wednesday, January 26, 2022 - 3:10:32 PM
Long-term archiving on: : Tuesday, December 29, 2015 - 12:12:15 AM
Contributor : Manuele Kirsch Pinheiro Connect in order to contact the contributor
Submitted on : Tuesday, September 15, 2015 - 12:28:37 PM
Last modification on : Wednesday, January 26, 2022 - 3:10:32 PM
Long-term archiving on: : Tuesday, December 29, 2015 - 12:12:15 AM
File
1-s2.0-S1877050915008583-main....
Publication funded by an institution