umu.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Distributed usage logging for federated grids
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för datavetenskap. (UMIT)
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för datavetenskap.
2010 (engelsk)Inngår i: Future generations computer systems, ISSN 0167-739X, E-ISSN 1872-7115, Vol. 26, nr 8, s. 1215-1225Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

We present a non-intrusive solution to the increasingly important problem of shared logging for overlapping and federated Grid environments. The solution addresses three usage scenarios of hierarchical Grids, mutual cross-Grid resource utilization, and federated Cloud computing infrastructures. The approach is evaluated by extending the existing SweGrid Accounting System (SGAS) with a light-weight component that makes the system applicable to a wide range of usage scenarios. The proposed architecture is characterized by its simplicity, flexibility, and generality, and the new key component by its non-intrusiveness, flexibility, and ability to manage high load. We present requirements derived from three usage scenarios, and also include an in-depth description of the architecture and design, as well as the implementation and performance evaluation of a new component written for use with SGAS. We conclude from a performance evaluation that the sharing of usage data is not likely to be a limiting performance factor even in large-scale Grid scenarios.

sted, utgiver, år, opplag, sider
Elsevier , 2010. Vol. 26, nr 8, s. 1215-1225
Emneord [en]
Accounting; Shared logging; Grid computing; SGAS; Federated Grids; Federated Clouds
HSV kategori
Forskningsprogram
administrativ databehandling
Identifikatorer
URN: urn:nbn:se:umu:diva-29915DOI: 10.1016/j.future.2010.02.001ISI: 000281508700016OAI: oai:DiVA.org:umu-29915DiVA, id: diva2:278586
Merknad

Daniel Henriksson Se även Daniel Espling

Tilgjengelig fra: 2009-11-27 Laget: 2009-11-27 Sist oppdatert: 2018-06-08bibliografisk kontrollert
Inngår i avhandling
1. Metadata Management in Multi-Grids and Multi-Clouds
Åpne denne publikasjonen i ny fane eller vindu >>Metadata Management in Multi-Grids and Multi-Clouds
2011 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Grid computing and cloud computing are two related paradigms used to access and use vast amounts of computational resources. The resources are often owned and managed by a third party, relieving the users from the costs and burdens of acquiring and managing a considerably large infrastructure themselves. Commonly, the resources are either contributed by different stakeholders participating in shared projects (grids), or owned and managed by a single entity and made available to its users with charging based on actual resource consumption (clouds). Individual grid or cloud sites can form collaborations with other sites, giving each site access to more resources that can be used to execute tasks submitted by users. There are several different models of collaborations between sites, each suitable for different scenarios and each posing additional requirements on the underlying technologies.

Metadata concerning the status and resource consumption of tasks are created during the execution of the task on the infrastructure. This metadata is used as the primary input in many core management processes, e.g., as a base for accounting and billing, as input when prioritizing and placing incoming task, and as a base for managing the amount of resources allocated to different tasks.

Focusing on management and utilization of metadata, this thesis contributes to a better understanding of the requirements and challenges imposed by different collaboration models in both grids and clouds. The underlying design criteria and resulting architectures of several software systems are presented in detail. Each system addresses different challenges imposed by cross-site grid and cloud architectures:

  • The LUTSfed approach provides a lean and optional mechanism for filtering and management of usage data between grid or cloud sites.

  • An accounting and billing system natively designed to support cross-site clouds demonstrates usage data management despite unknown placement and dynamic task resource allocation.

  • The FSGrid system enables fairshare job prioritization across different grid sites, mitigating the problems of heterogeneous scheduling software and local management policies.

The results and experiences from these systems are both theoretical and practical, as full scale implementations of each system has been developed and analyzed as a part of this work. Early theoretical work on structure-based service management forms a foundation for future work on structured-aware service placement in cross- site clouds. 

sted, utgiver, år, opplag, sider
Umeå: Umeå University, Department of Computing Science, 2011. s. 120
Serie
Report / UMINF, ISSN 0348-0542 ; 11.08
Emneord
grid computing, cloud computing, accounting, billing, metadata, monitoring, structure, fairshare, scheduling, federated
HSV kategori
Forskningsprogram
datalogi
Identifikatorer
urn:nbn:se:umu:diva-51159 (URN)978-91-7459-281-8 (ISBN)
Presentation
2011-10-06, Naturvetarhuset, N320, Umeå universitet, Umeå, 13:00 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2012-01-25 Laget: 2012-01-11 Sist oppdatert: 2018-06-08bibliografisk kontrollert
2. Enabling Technologies for Management of Distributed Computing Infrastructures
Åpne denne publikasjonen i ny fane eller vindu >>Enabling Technologies for Management of Distributed Computing Infrastructures
2013 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Computing infrastructures offer remote access to computing power that can be employed, e.g., to solve complex mathematical problems or to host computational services that need to be online and accessible at all times. From the perspective of the infrastructure provider, large amounts of distributed and often heterogeneous computer resources need to be united into a coherent platform that is then made accessible to and usable by potential users. Grid computing and cloud computing are two paradigms that can be used to form such unified computational infrastructures.

Resources from several independent infrastructure providers can be joined to form large-scale decentralized infrastructures. The primary advantage of doing this is that it increases the scale of the available resources, making it possible to address more complex problems or to run a greater number of services on the infrastructures. In addition, there are advantages in terms of factors such as fault-tolerance and geographical dispersion. Such multi-domain infrastructures require sophisticated management processes to mitigate the complications of executing computations and services across resources from different administrative domains.

This thesis contributes to the development of management processes for distributed infrastructures that are designed to support multi-domain environments. It describes investigations into how fundamental management processes such as scheduling and accounting are affected by the barriers imposed by multi-domain deployments, which include technical heterogeneity, decentralized and (domain-wise) self-centric decision making, and a lack of information on the state and availability of remote resources.

Four enabling technologies or approaches are explored and developed within this work: (I) The use of explicit definitions of cloud service structure as inputs for placement and management processes to ensure that the resulting placements respect the internal relationships between different service components and any relevant constraints. (II) Technology for the runtime adaptation of Virtual Machines to enable the automatic adaptation of cloud service contexts in response to changes in their environment caused by, e.g., service migration across domains. (III) Systems for managing meta-data relating to resource usage in multi-domain grid computing and cloud computing infrastructures. (IV) A global fairshare prioritization mechanism that enables computational jobs to be consistently prioritized across a federation of several decentralized grid installations.

Each of these technologies will facilitate the emergence of decentralized computational infrastructures capable of utilizing resources from diverse infrastructure providers in an automatic and seamless manner.

sted, utgiver, år, opplag, sider
Umeå: Umeå Universitet, 2013. s. 64
Serie
Report / UMINF, ISSN 0348-0542 ; 13.19
Emneord
grid computing, cloud computing, accounting, billing, contextualization, monitoring, structure, fairshare, scheduling, federated
HSV kategori
Forskningsprogram
datalogi
Identifikatorer
urn:nbn:se:umu:diva-80129 (URN)978-91-7459-704-2 (ISBN)
Disputas
2013-10-17, KBC-huset, Stora hörsalen KBC, KB3B1, Umeå Universitet, Umeå, 13:15 (engelsk)
Opponent
Veileder
Forskningsfinansiär
EU, FP7, Seventh Framework Programme, 215605EU, FP7, Seventh Framework Programme, 257115Swedish Research Council, 621-2005-3667eSSENCE - An eScience Collaboration
Merknad

Note that the author changed surname from Henriksson to Espling in 2011

Tilgjengelig fra: 2013-09-23 Laget: 2013-09-10 Sist oppdatert: 2018-06-08bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekst

Personposter BETA

Elmroth, ErikHenriksson, Daniel

Søk i DiVA

Av forfatter/redaktør
Elmroth, ErikHenriksson, Daniel
Av organisasjonen
I samme tidsskrift
Future generations computer systems

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 350 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf