To facilitate evaluation of workflow algorithms and systems on a range of workflow sizes, we have developed a workflow generator. This generator uses the information gathered from actual executions of scientific workflows on the Grid as well as our understanding of the processes behind these workflows to generate synthetic workflows resembling those used by real world scientific applications.
Pegasus Workflows
These workflows come from a paper by Bharathi, et. al. [1].
Workflow Type | Example | DAX |
---|---|---|
Montage | ||
CyberShake | ||
Epigenomics | ||
LIGO Inspiral Analysis | ||
SIPHT |
A large collection of DAXes similar to the ones listed above is available here. Note that is is about 290MB.
Ramakrishnan and Gannon Workflows
These workflows come from a report by Ramakrishnan and Gannon [2].
Workflow Type | Figure in Report | Example | DAX |
---|---|---|---|
LEAD Mesoscale Meteorology | Figure 1 | leadmm.xml | |
LEAD ARPS Data Analysis System | Figure 2 | ||
LEAD Data Mining Workflow | Figure 3 | leaddm.xml | |
Storm Surge SCOOP Workflow | Figure 4 | ||
Floodplain Mapping | Figure 5 | floodplain.xml | |
Glimmer | Figure 6 | glimmer.xml | |
Gene2Life | Figure 7 | gene2life.xml | |
Motif Network | Figure 8 | ||
MEME-MAST | Figure 9 | mememast.xml | |
Molecular Sciences | Figure 10 | molsci.xml | |
Avian Flu | Figure 11 | ||
caDSR | Figure 12 | cadsr.xml | |
Pan-STARRS Load | Figure 13 | ||
Pan-STARRS Merge | Figure 14 | ||
McStas | Figure 15 | mcstas.xml |
The code used to generate the above DAX files was written in Python and can be downloaded here.
[1] S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M.-H. Su, and K. Vahi, “Characterization of Scientific Workflows”, 3rd Workshop on Workflows in Support of Large Scale Science (WORKS 08), 2008.
[2] L. Ramakrishnan and D. Gannon, "A Survey of Distributed Workflow Characteristics and Resource Requirements", Indiana University Technical Report TR671, 2008.