Change search
ReferencesLink to record
Permanent link

Direct link
An Interoperable Standards-based Grid Resource Broker and Job Submission Service
Umeå University, Faculty of Science and Technology, Department of Computing Science.
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2005 (English)In: e-Science 2005: First IEEE Conference on e-Science and Grid Computing, IEEE Computer Society Press , 2005, 212-220 p.Chapter in book (Other academic)
Abstract [en]

We present the architecture and implementation of a grid resource broker and job submission service, designed to be as independent as possible of the grid middleware used on the resources. The overall architecture comprises seven general components and a few conversion and integration points where all middleware-specific issues are handled. The implementation is based on state-of-the-art grid and Web services technology as well as existing and emerging standards (WSRF, JSDL, GLUE, WS-Agreement). Features provided by the service include advance reservations and a resource selection process based on a priori estimations of the total time to delivery for the application, including a benchmark-based prediction of the execution time. The general service implementation is based on the Globus Toolkit 4. For test and evaluation, plugins and format converters are provided for use with the NorduGrid ARC middleware

Place, publisher, year, edition, pages
IEEE Computer Society Press , 2005. 212-220 p.
URN: urn:nbn:se:umu:diva-5638DOI: 10.1109/E-SCIENCE.2005.17OAI: diva2:145220
Available from: 2007-01-04 Created: 2007-01-04 Last updated: 2011-02-22Bibliographically approved
In thesis
1. Decentralized resource brokering for heterogeneous grid environments
Open this publication in new window or tab >>Decentralized resource brokering for heterogeneous grid environments
2006 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

The emergence of Grid computing infrastructures enables researchers to share resources and collaborate in more efficient ways than before, despite belonging to different organizations and being distanced geographically. While the Grid computing paradigm offers new opportunities, it also gives rise to new difficulties. One such problem is the selection of resources for user applications. Given the large and disparate set of Grid resources, manual resource selection becomes impractical, even for experienced users. This thesis investigates methods, algorithms and software for a Grid resource broker, i.e., a scheduling agent that automates the resource selection process for the user. The development of such a component is a non-trivial task as Grid resources are heterogeneous in hardware, software, availability, ownership and usage policies. A wide range of algorithmically difficult issues must also be solved, including characterization of jobs, prediction of resource performance, data placement considerations, and, how to provide Quality of Service guarantees. One contribution of this thesis is the development of resource brokering algorithms that enable resource selection based on Grid job performance predictions and use advance reservations to provide Quality of Service guarantees. The thesis also includes an algorithm for coallocation of sets of jobs. This algorithm guarantees a simultaneous start of each subjob, as required e.g., when running larger-than-supercomputer simulations that involve multiple resources.

We today have the somewhat paradoxal situation where Grids, originally aimed to overcome interoperability problems between different computing platforms, themselves struggle with interoperability problems caused by the wide range of interfaces, protocols and data formats that are used in different environments. The reasons for this situation are obvious, expected and almost impossible to avoid, as the task of defining appropriate standards, models and best-practices must be preceded by basic research, proof-of-concept implementations and real-world testing. We address the interoperability problem with a generic Grid resource brokering architecture and job submission service.

By using (proposed) standard formats and protocols, the service acts as an interoperability-bridge that translates job requests between clients and resources running different Grid middlewares. This concept is demonstrated by the integration of the service with three different Grid middlewares. The service also enables users to both fine-tune the existing resource selection algorithms and plug in custom brokering algorithms tailored to their requirements.

Place, publisher, year, edition, pages
Umeå: Datavetenskap, 2006. 112 p.
Report / UMINF, ISSN 0348-0542 ; 06.39
Grid computing, Resource brokering, interoperability, advance reservations, coallocation, Web services
National Category
Computer Science
urn:nbn:se:umu:diva-966 (URN)91-7264-225-4 (ISBN)
Available from: 2007-01-04 Created: 2007-01-04Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full text

Search in DiVA

By author/editor
Elmroth, ErikTordsson, Johan
By organisation
Department of Computing Science

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 38 hits
ReferencesLink to record
Permanent link

Direct link