Journal article
Utility functions for adaptively executing concurrent workflows
Concurrency and Computation: Practice and Experience, Vol.23(6), pp.646-666
2011
Abstract
Workflows are widely used in applications that require coordinated use of computational resources. Workflow definition languages typically abstract over some aspects of the way in which a workflow is to be executed, such as the level of parallelism to be used or the physical resources to be deployed. As a result, a workflow management system has the responsibility of establishing how best to map tasks within a workflow to the available resources. As workflows are typically run over shared resources, and thus face unpredictable and changing resource capabilities, there may be benefit to be derived from adapting the task-to-resource mapping while a workflow is executing. This paper describes the use of utility functions to express the relative merits of alternative mappings; in essence, a utility function can be used to give a score to a candidate mapping, and the exploration of alternative mappings can be cast as an optimization problem. In this approach, changing the utility function allows adaptations to be carried out with a view to meeting different objectives. The contributions of this paper include: (i) a description of how adaptive workflow execution can be expressed as an optimization problem where the objective of the adaptation is to maximize a utility function; (ii) a description of how the approach has been applied to support adaptive workflow execution in execution environments consisting of multiple resources, such as grids or clouds, in which adaptations are coordinated across multiple workflows; and (iii) an experimental evaluation of the approach with utility measures based on response time and profit using the Pegasus workflow system.
Details
- Title
- Utility functions for adaptively executing concurrent workflows
- Authors/Creators
- K. Lee (Author/Creator) - University of ManchesterN.W. Paton (Author/Creator) - University of ManchesterR. Sakellariou (Author/Creator) - University of ManchesterA.A.A. Fernandes (Author/Creator) - University of Manchester
- Publication Details
- Concurrency and Computation: Practice and Experience, Vol.23(6), pp.646-666
- Publisher
- John Wiley & Sons Ltd
- Identifiers
- 991005542056707891
- Copyright
- © 2010 John Wiley & Sons, Ltd.
- Murdoch Affiliation
- Murdoch University
- Language
- English
- Resource Type
- Journal article
UN Sustainable Development Goals (SDGs)
This output has contributed to the advancement of the following goals:
Source: InCites
Metrics
241 File views/ downloads
78 Record Views
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Citation topics
- 4 Electrical Engineering, Electronics & Computer Science
- 4.46 Distributed & Real Time Computing
- 4.46.85 Cloud Resource Scheduling
- Web Of Science research areas
- Computer Science, Software Engineering
- Computer Science, Theory & Methods
- ESI research areas
- Computer Science