Context-Aware Scheduling for Apache Hadoop over Pervasive Environments - Archive ouverte HAL Access content directly
Conference Papers Year : 2015

Context-Aware Scheduling for Apache Hadoop over Pervasive Environments

(1) , (1) , (2) , (2) , (3)
1
2
3

Abstract

This article proposes to improve Apache Hadoop scheduling through the usage of context-awareness. Apache Hadoop is the most popular implementation of the MapReduce paradigm for distributed computing, but its design doesn't adapt automatically to computing nodes' context and capabilities. By introducing context-awareness into Hadoop, we intent to dynamically adapt its scheduling to the execution environment. This is a necessary feature in the context of pervasive grids, which are heterogeneous, dynamic and shared environments. The solution has been incorporated into Hadoop and evaluated through controlled experiments. The experiments demonstrate that context-awareness provides comparative performance gains, especially when part of the resources disappear during execution.
Fichier principal
Vignette du fichier
1-s2.0-S1877050915008583-main.pdf (292.73 Ko) Télécharger le fichier
Origin : Publication funded by an institution
Loading...

Dates and versions

hal-01196986 , version 1 (15-09-2015)

Identifiers

Cite

Guilherme Weigert Cassales, Andrea Schwertner Charão, Manuele Kirsch Pinheiro, Carine Souveyet, Luiz Angelo Steffenel. Context-Aware Scheduling for Apache Hadoop over Pervasive Environments. 6th International Conference on Ambient Systems, Networks and Technologies (ANT 2015), Jun 2015, Londres, United Kingdom. pp.202-209, ⟨10.1016/j.procs.2015.05.058⟩. ⟨hal-01196986⟩
97 View
211 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More