HuML04pdp

E. Huedo, R.S. Montero, I.M. Llorente. Experiences on adaptive grid scheduling of parameter sweep applications. In 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2004), Pages 28-33, 2004.

Abstract

Grids offer a dramatic increase in the number of available compute and storage resources that can be delivered to applications. This new computational infrastructure provides a promising platform to execute loosely coupled, high-throughput parameter sweep applications. This kind of applications arises naturally in many scientific and engineering fields like bioinformatics, computational fluid dynamics (CFD), particle physics, etc. The efficient execution and scheduling of parameter sweep applications is challenging because of the dynamic and heterogeneous nature of grids. We present a scheduling algorithm built on top of the GridWay framework that combines: (i) adaptive scheduling to reflect the dynamic grid characteristics; (ii) adaptive execution to migrate running jobs to better resources and provide fault tolerance; (iii) re-use of common files between tasks to reduce the file transfer overhead. The efficiency of the approach is demonstrated in the execution of a CFD application on a highly heterogeneous research testbed

Keywords

[ Grid ] [ Gridway ] [ Tic2002-00334 ] [ Inta ]

Contact

Eduardo Huedo
Ruben S. Montero
Ignacio M. Llorente

BibTex Reference

@InProceedings{HuML04pdp,
   Author = {Huedo, E. and Montero, R.S. and Llorente, I.M.},
   Title = {Experiences on adaptive grid scheduling of parameter sweep applications},
   BookTitle = {12th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2004)},
   Pages = {28--33},
   Year = {2004}
}