A Scalable Method for Partitioning Workflows with Security Requirements over Federated Clouds

Zhenyu Wen, J. Cala, P. Watson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The significant increase in the use of cloud computing, has led to an interest in partitioning applications over a set of public and private clouds in order to meet a range of non-functional requirements including performance (for example where private cloud resources alone are insufficient), dependability (e.g. To allow the application to continue to operate even if one cloud fails) and security (for example to ensure that sensitive data is restricted to sufficiently secure clouds and networks). This paper describes a novel deployment planning algorithm to partition complex workflow-based applications over federated clouds, while meeting security requirements. The security issues are based on our previous work which extends the Bell-La Padula model to encompass cloud computing. Selecting the cheapest option for partitioning a workflow over a set of resources has been shown to be an NP-hard problem, which can take impractically long for partitioning large workflows over multiple clouds. We therefore introduce a novel adaptive partitioning algorithm to handle these large workflow applications, which significantly reduces the time required to choose a sufficiently good partitioning option. This is based on generating an initial partitioning, and then adapting it to see if a better solution can be found by bringing together on the same node services with significant communication costs. The algorithm has been implemented and evaluated by using both randomly generated and real world scientific workflows. The experiment results show that our algorithm is thousand times quicker than the exhaustive algorithm presented in our previous work. Yet, on average it generates only 25% more costly solutions. We also compared this algorithm with two other methods commonly used to partition workflows over a set of clouds.
Original languageEnglish
Title of host publicationCloud Computing Technology and Science (CloudCom), 2014 IEEE 6th International Conference on
PublisherInstitute of Electrical and Electronics Engineers
Pages122-129
Number of pages8
DOIs
Publication statusPublished - 1 Dec 2014

Keywords / Materials (for Non-textual outputs)

  • cloud computing
  • computational complexity
  • resource allocation
  • security of data
  • workflow management software
  • Bell-LaPadula model
  • NP-hard problem
  • adaptive partitioning algorithm
  • complex workflow-based applications
  • deployment planning algorithm
  • federated clouds
  • nonfunctional requirements
  • private cloud resources
  • public clouds
  • scalable workflow partitioning method
  • scientific workflows
  • security requirements
  • Algorithm design and analysis
  • Cloud computing
  • Computational modeling
  • Educational institutions
  • Partitioning algorithms
  • Security
  • Vectors
  • partitioning
  • scheduling
  • security
  • workflow deployment

Fingerprint

Dive into the research topics of 'A Scalable Method for Partitioning Workflows with Security Requirements over Federated Clouds'. Together they form a unique fingerprint.

Cite this