Dynamically Partitioning Workflow over Federated Clouds For Optimising the Monetary Cost and Handling Run-Time Failures

Zhenyu Wen, Rawaa Qasha, Zequn Li, Rajiv Ranjan, Paul Watson, Alexander Romanovsky

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)
2 Downloads (Pure)

Abstract

Several real-world problems in domain of healthcare, large scale scientific simulations, and manufacturing are organised as workflow applications. Efficiently managing workflow applications on the Cloud computing data-centres is challenging due to the following problems: (i) they need to perform computation over sensitive data (e.g. Healthcare workflows) hence leading to additional security and legal risks especially considering public cloud environments and (ii) the dynamism of the cloud environment can lead to several run-time problems such as data loss and abnormal termination of workflow task due to failures of computing, storage, and network services. To tackle above challenges, this paper proposes a novel workflow management framework call DoFCF (Deploy on Federated Cloud Framework) that can dynamically partition scientific workflows across federated cloud (public/private) data-centres for minimising the financial cost, adhering to security requirements, while gracefully handling run-time failures. The framework is validated in cloud simulation tool (CloudSim) as well as in a realistic workflow-based cloud platform (e-Science Central). The results showed that our approach is practical and is successful in meeting users security requirements and reduces overall cost, and dynamically adapts to the run-time failures.
Original languageEnglish
Pages (from-to)1093-1107
Number of pages15
JournalIEEE Transactions on Cloud Computing
Volume8
Issue number4
Early online date26 Aug 2016
DOIs
Publication statusPublished - 1 Oct 2020
Externally publishedYes

Fingerprint Dive into the research topics of 'Dynamically Partitioning Workflow over Federated Clouds For Optimising the Monetary Cost and Handling Run-Time Failures'. Together they form a unique fingerprint.

Cite this