Javascript must be enabled to continue!
Provenance for distributed biomedical workflow execution
View through CrossRef
Scientific research has become very data and compute intensive because of the progress in data acquisition and measurement devices, which is particularly true in Life Sciences. To cope with this deluge of data, scientists use distributed computing and storage infrastructures. The use of such infrastructures introduces by itself new challenges to the scientists in terms of proper and efficient use. Scientific workflow management systems play an important role in facilitating the use of the infrastructure by hiding some of its complexity. Althought most scientific workflow management systems are provenance-aware, not all of them come with provenance functionality out of the box. In this paper we describe the improvement and integration of a provenance system into an e-infrastructure for biomedical research based on the MOTEUR workflow management system. The main contributions of the paper are: presenting an OPM implementation using relational database backend for the provenance store, providing an e-infrastructure with a comprehensive provenance system, defining a generic approach to provenance implementation, potentially suitable for other workflow systems and application domains and demonstrating the value of this system based on use cases presenting the provenance data through a user-friendly web interface.
Title: Provenance for distributed biomedical workflow execution
Description:
Scientific research has become very data and compute intensive because of the progress in data acquisition and measurement devices, which is particularly true in Life Sciences.
To cope with this deluge of data, scientists use distributed computing and storage infrastructures.
The use of such infrastructures introduces by itself new challenges to the scientists in terms of proper and efficient use.
Scientific workflow management systems play an important role in facilitating the use of the infrastructure by hiding some of its complexity.
Althought most scientific workflow management systems are provenance-aware, not all of them come with provenance functionality out of the box.
In this paper we describe the improvement and integration of a provenance system into an e-infrastructure for biomedical research based on the MOTEUR workflow management system.
The main contributions of the paper are: presenting an OPM implementation using relational database backend for the provenance store, providing an e-infrastructure with a comprehensive provenance system, defining a generic approach to provenance implementation, potentially suitable for other workflow systems and application domains and demonstrating the value of this system based on use cases presenting the provenance data through a user-friendly web interface.
Related Results
TABular Semantic Enhancement Blueprint (TAB-SEB) v1
TABular Semantic Enhancement Blueprint (TAB-SEB) v1
Project website link: https://ariannamorettj.github.io/tab_seb/ Overview Purpose. The workflow blueprint supports semantic enhancement of Cultural Heritage and GLAM metadata by c...
BioWorkbench: a high-performance framework for managing and analyzing bioinformatics experiments
BioWorkbench: a high-performance framework for managing and analyzing bioinformatics experiments
Advances in sequencing techniques have led to exponential growth in biological data, demanding the development of large-scale bioinformatics experiments. Because these experiments ...
Evaluation of Hospital Laboratory Workflow Design in Ethiopia: Blood Specimen Collection and Chemistry Laboratory Testing
Evaluation of Hospital Laboratory Workflow Design in Ethiopia: Blood Specimen Collection and Chemistry Laboratory Testing
Background: Laboratories have recognized their internal business and operate as a set of business processes or workflows. Modern Laboratories are highly suitable to this workflow d...
Towards Next Generation Provenance Systems for E-Science
Towards Next Generation Provenance Systems for E-Science
e-Science helps scientists to automate scientific discovery processes and experiments, and promote collaboration across organizational boundaries and disciplines. These experiments...
A Scheme for Generating Provenance-aware Applications through UML
A Scheme for Generating Provenance-aware Applications through UML
The metadata that captures information about the origin of data is referred to as data provenance or data lineage. The provenance of a data item captures information about the proc...
End-to-End Data Provenance
End-to-End Data Provenance
Abstract
Data provenance is the chronology of an object, i.e., all the transformations and actions that modified the state of the object from the time of creation to...
Scheduling Dynamic Parallel Loop Workflow in Cloud Environment
Scheduling Dynamic Parallel Loop Workflow in Cloud Environment
Scientific workflows have been employed to automate large scale scientific experiments by leveraging computational power provided on-demand by cloud computing platforms. Among thes...
WfExS-backend in the WRROC world?
WfExS-backend in the WRROC world?
Workflow Execution Service Backend (WfExS-backend) is a high-level orchestrator to run scientific workflows reproducibly. It acquires workflows, containers and inputs from a distr...

