Umeå universitets logga

umu.sePublikationer
Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
A standards-based Grid resource brokering service supporting advance reservations, coallocation and cross-Grid interoperability
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för datavetenskap.ORCID-id: 0000-0002-2633-6798
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för datavetenskap.
2009 (Engelska)Ingår i: Concurrency and Computation, ISSN 1532-0626, E-ISSN 1532-0634, Vol. 21, nr 18, s. 2298-2335Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The problem of Grid-middleware interoperability is addressed by the design and analysis of a feature-rich, standards-based framework for all-to-all cross-middleware job submission.The architecture is designed with focus on generality and flexibility and builds on extensive use, internally and externally, of (proposed) Web and Grid services standards such asWSRF, JSDL, GLUE, and WS-Agreement. The external use providesthe foundation for easy integration into specific middlewares,which is performed by the design of a small set of plugins for each middleware. Currently, plugins are provided for integrationinto Globus Toolkit 4 and NorduGrid/ARC. The internal use of standard formats facilitates customizationof the job submission service by replacement of custom components for performing specific well-defined tasks.Most importantly, this enables the easy replacement of resource selection algorithms by algorithms that addresses the specific needs of a particular Grid environment and job submission scenario.By default, the service implements a decentralized brokering policy, strivingto optimize the performance for the individual user by minimizing the response time for each job submitted. The algorithms in our implementation perform resource selectionbased on performance predictions, and provide support for advance reservations as well as coallocation of multiple resources for coordinated use.The performance of the system is analyzed with focuson overall service throughput (up to over 250 jobs per minute)and individual job submission response time (down to under one second).

Ort, förlag, år, upplaga, sidor
2009. Vol. 21, nr 18, s. 2298-2335
Nyckelord [en]
Grid resource broker; standards-based infrastructure; interoperability; advance reservations; coallocation; service-oriented architecture (SOA); Globus Toolkit
Nationell ämneskategori
Datavetenskap (datalogi)
Forskningsämne
administrativ databehandling
Identifikatorer
URN: urn:nbn:se:umu:diva-5639DOI: 10.1002/cpe.1441Scopus ID: 2-s2.0-70349920388OAI: oai:DiVA.org:umu-5639DiVA, id: diva2:145221
Tillgänglig från: 2007-01-04 Skapad: 2007-01-04 Senast uppdaterad: 2023-03-24Bibliografiskt granskad
Ingår i avhandling
1. Decentralized resource brokering for heterogeneous grid environments
Öppna denna publikation i ny flik eller fönster >>Decentralized resource brokering for heterogeneous grid environments
2006 (Engelska)Licentiatavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

The emergence of Grid computing infrastructures enables researchers to share resources and collaborate in more efficient ways than before, despite belonging to different organizations and being distanced geographically. While the Grid computing paradigm offers new opportunities, it also gives rise to new difficulties. One such problem is the selection of resources for user applications. Given the large and disparate set of Grid resources, manual resource selection becomes impractical, even for experienced users. This thesis investigates methods, algorithms and software for a Grid resource broker, i.e., a scheduling agent that automates the resource selection process for the user. The development of such a component is a non-trivial task as Grid resources are heterogeneous in hardware, software, availability, ownership and usage policies. A wide range of algorithmically difficult issues must also be solved, including characterization of jobs, prediction of resource performance, data placement considerations, and, how to provide Quality of Service guarantees. One contribution of this thesis is the development of resource brokering algorithms that enable resource selection based on Grid job performance predictions and use advance reservations to provide Quality of Service guarantees. The thesis also includes an algorithm for coallocation of sets of jobs. This algorithm guarantees a simultaneous start of each subjob, as required e.g., when running larger-than-supercomputer simulations that involve multiple resources.

We today have the somewhat paradoxal situation where Grids, originally aimed to overcome interoperability problems between different computing platforms, themselves struggle with interoperability problems caused by the wide range of interfaces, protocols and data formats that are used in different environments. The reasons for this situation are obvious, expected and almost impossible to avoid, as the task of defining appropriate standards, models and best-practices must be preceded by basic research, proof-of-concept implementations and real-world testing. We address the interoperability problem with a generic Grid resource brokering architecture and job submission service.

By using (proposed) standard formats and protocols, the service acts as an interoperability-bridge that translates job requests between clients and resources running different Grid middlewares. This concept is demonstrated by the integration of the service with three different Grid middlewares. The service also enables users to both fine-tune the existing resource selection algorithms and plug in custom brokering algorithms tailored to their requirements.

Ort, förlag, år, upplaga, sidor
Umeå: Datavetenskap, 2006. s. 112
Serie
Report / UMINF, ISSN 0348-0542 ; 06.39
Nyckelord
Grid computing, Resource brokering, interoperability, advance reservations, coallocation, Web services
Nationell ämneskategori
Datavetenskap (datalogi)
Identifikatorer
urn:nbn:se:umu:diva-966 (URN)91-7264-225-4 (ISBN)
Handledare
Tillgänglig från: 2007-01-04 Skapad: 2007-01-04 Senast uppdaterad: 2018-01-13Bibliografiskt granskad
2. Portable Tools for Interoperable Grids: Modular Architectures and Software for Job and Workflow Management
Öppna denna publikation i ny flik eller fönster >>Portable Tools for Interoperable Grids: Modular Architectures and Software for Job and Workflow Management
2009 (Engelska)Doktorsavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

The emergence of Grid computing infrastructures enables researchers to shareresources and collaborate in more efficient ways than before, despite belongingto different organizations and being geographically distributed. While the Gridcomputing paradigm offers new opportunities, it also gives rise to newdifficulties. This thesis investigates methods, architectures, and algorithmsfor a range of topics in the area of Grid resource management. One studiedtopic is how to automate and improve resource selection, despite heterogeneityin Grid hardware, software, availability, ownership, and usage policies.Algorithmical difficulties for this are, e.g., characterization of jobs andresources, prediction of resource performance, and data placementconsiderations. Investigated Quality of Service aspects of resource selectioninclude how to guarantee job start and/or completion times as well as how tosynchronize multiple resources for coordinated use through coallocation.Another explored research topic is architectural considerations for frameworksthat simplify and automate submission, monitoring, and fault handling for largeamounts of jobs. This thesis also investigates suitable Grid interactionpatterns for scientific workflows, studies programming models that enable dataparallelism for such workflows, as well as analyzes how workflow compositiontools should be designed to increase flexibility and expressiveness. We today have the somewhat paradoxical situation where Grids, originally aimed tofederate resources and overcome interoperability problems between differentcomputing platforms, themselves struggle with interoperability problems causedby the wide range of interfaces, protocols, and data formats that are used indifferent environments. This thesis demonstrates how proof-of-concept softwaretools for Grid resource management can, by using (proposed) standard formatsand protocols as well as leveraging state-of-the-art principles fromservice-oriented architectures, be made independent of current Gridinfrastructures. Further interoperability contributions include an in-depthstudy that surveys issues related to the use of Grid resources in scientificworkflows. This study improves our understanding of interoperability amongscientific workflow systems by viewing this topic from three differentperspectives: model of computation, workflow language, and executionenvironment. A final contribution in this thesis is the investigation of how the design ofGrid middleware tools can adopt principles and concepts from softwareengineering in order to improve, e.g., adaptability and interoperability.

Ort, förlag, år, upplaga, sidor
Umeå: Umeå Universitet, Institutionen för Datavetenskap, 2009. s. 254
Serie
Report / UMINF, ISSN 0348-0542 ; 09.08
Nyckelord
Grid computing, scheduling, resource brokering, performance predictions, advance reservations, coallocation, standards-based infrastructure, interoperability, service-oriented architecture, job management, workflows, data flow
Nationell ämneskategori
Datavetenskap (datalogi)
Identifikatorer
urn:nbn:se:umu:diva-19630 (URN)978-91-7264-754-1 (ISBN)
Disputation
2009-04-03, MA121, MIT-huset, SE 901 87, Umeå, 13:15 (Engelska)
Opponent
Handledare
Tillgänglig från: 2009-03-13 Skapad: 2009-03-09 Senast uppdaterad: 2021-03-18Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas i DiVA

Övriga länkar

Förlagets fulltextScopushttp://www.cs.umu.se/~tordsson/phd-thesis/elmroth_tordsson_ccpe.pdf

Person

Elmroth, ErikTordsson, Johan

Sök vidare i DiVA

Av författaren/redaktören
Elmroth, ErikTordsson, Johan
Av organisationen
Institutionen för datavetenskap
I samma tidskrift
Concurrency and Computation
Datavetenskap (datalogi)

Sök vidare utanför DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetricpoäng

doi
urn-nbn
Totalt: 462 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf