Context-Aware Scheduling for Apache Hadoop over Pervasive Environments

Guilherme Cassales 1 Andrea Schwertner Charão 1 Manuele Kirsch Pinheiro 2 Carine Souveyet 2 Luiz Angelo Steffenel 3
1 LSC - Laboratório de Sistemas de Computação
2 CRI - Centre de Recherche en Informatique de Paris 1
3 CRESTIC - Centre de Recherche en Sciences et Technologies de l'Information et de la Communication - EA 3804
Abstract : This article proposes to improve Apache Hadoop scheduling through the usage of context-awareness. Apache Hadoop is the most popular implementation of the MapReduce paradigm for distributed computing, but its design doesn't adapt automatically to computing nodes' context and capabilities. By introducing context-awareness into Hadoop, we intent to dynamically adapt its scheduling to the execution environment. This is a necessary feature in the context of pervasive grids, which are heterogeneous, dynamic and shared environments. The solution has been incorporated into Hadoop and evaluated through controlled experiments. The experiments demonstrate that context-awareness provides comparative performance gains, especially when part of the resources disappear during execution.
Keywords : Context-Awareness Map Reduce Apache Hadoop Task Scheduling Pervasive Grid Big Data
Type de document :
Communication dans un congrès
Elhadi Shakshuki. 6th International Conference on Ambient Systems, Networks and Technologies (ANT 2015), Jun 2015, Londres, United Kingdom. Elsevier, Procedia Computer Science, 52, pp.202-209, 2015, The 6th International Conference on Ambient Systems, Networks and Technologies (ANT-2015), the 5th International Conference on Sustainable Energy Information Technology (SEIT-2015). 〈10.1016/j.procs.2015.05.058〉
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger
https://hal-paris1.archives-ouvertes.fr/hal-01196986
Contributeur : Manuele Kirsch Pinheiro <>
Soumis le : mardi 15 septembre 2015 - 12:28:37
Dernière modification le : mercredi 14 février 2018 - 16:54:01
Document(s) archivé(s) le : mardi 29 décembre 2015 - 00:12:15

Fichier

1-s2.0-S1877050915008583-main....
Publication financée par une institution

Identifiants

Collections

UNIV-PARIS1 | CRI | URCA | CRESTIC | GRID5000

Citation

Guilherme Cassales, Andrea Schwertner Charão, Manuele Kirsch Pinheiro, Carine Souveyet, Luiz Angelo Steffenel. Context-Aware Scheduling for Apache Hadoop over Pervasive Environments. Elhadi Shakshuki. 6th International Conference on Ambient Systems, Networks and Technologies (ANT 2015), Jun 2015, Londres, United Kingdom. Elsevier, Procedia Computer Science, 52, pp.202-209, 2015, The 6th International Conference on Ambient Systems, Networks and Technologies (ANT-2015), the 5th International Conference on Sustainable Energy Information Technology (SEIT-2015). 〈10.1016/j.procs.2015.05.058〉. 〈hal-01196986〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

89

Téléchargements de fichiers

144

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD