<?xml version="1.0" encoding="utf-8"?>
<html>
Montage Workflow Benchmark Runs on TG SDSC
Environment Setup
Condor GlideIn Setup
- 8 IA 64 nodes were glided in using Condor Glideins from SDSC Teragrid Site
- The Condor collector was running at the submit host corbusier.isi.edu
- Condor Version at Submit host ( Corbusier )
- $CondorVersion: 7.1.0 Apr 1 2008 BuildID: 80895 $
- $CondorPlatform: I386-OSX_10_4 $
- Condor Version for glidein's at SDSC
- 7.1.0-ia64-Linux-2.4-glibc2.2.
- Condor Negotiation Cycle
- Negotiation in condor means the process of matching jobs in the queue to available resources
- By default condor does negotation every 300 seconds. For the benchmark run, the default configuration for condor was used.
- NEGOTIATOR_INTERVAL
- Sets how often the negotiator starts a negotiation cycle. It is defined in seconds and defaults to 300 (5 minutes).
- More details on condor negotiation
Input and Output Data
- The input data for the workflow was staged in from sultan.isi.edu
- Size of data 92Mb
- Sultan runs GridFTP Server 2.7 (gcc32, 1204845443-63) Globus Toolkit 4.0.7 ready.
- The output data generated was staged back to ISI machine ( corbusier.isi.edu )
- Size of data 945 MB
- Corbusier runs GridFTP Server 3.11 (gcc32, 1213742010-78) Globus Toolkit 4.2.0 ready.
Workflow Information
DAX/Abstract Workflow
- Montage 1 degree workflow
<!-- - Montage 1 degree dot file
- Montage 1 degree graffle file
--> - Image of the workflow
Astronomy Metadata of Workflow |
|
|---|---|
Key |
Value |
Band |
j |
Survey |
M17 |
Width |
1 |
Height |
1 |
Number of Jobs by Type |
|
|---|---|
Type of Job |
Number |
mProject |
45 |
mDiffFit |
107 |
mConcatFit |
1 |
mBgModel |
1 |
mBackground |
45 |
mImgTable |
1 |
mAdd |
1 |
mShrink |
1 |
mJPEG |
1 |
Total number |
203 |
Executable Workflow ( Generated By Pegasus )
Pegasus clustered the jobs at each level of workflow into max 8 clusters perl level
- Image of the workflow
- Compute Jobs ( Montage Jobs) 30
Number of Compute/Montage Jobs by Type
Type of Job
Number
mProject
8
mDiffFit
8
mConcatFit
1
mBgModel
1
mBackground
8
mImgTable
1
mAdd
1
mShrink
1
mJPEG
1
Total number
30
Number of Jobs by Type |
|
|---|---|
Type of Job |
Number |
Compute/Montage Jobs |
30 |
Data Stagein |
1 |
Data Stageout |
9 |
Data Registration |
9 |
Directory Creation and Sync Jobs |
2 |
Total number |
51 |
Workflow Runtimes
- Number of workflows executed 10
- Pegasus Workflow Benchmark tar file http://sukhna.isi.edu/wf_benchmark/pegasus_wf_benchmark.tgz
- Montage Benchmark Workflow runtimes http://www.isi.edu/~vahi/Montage_Benchmark_Results.xls
</html>