<?xml version="1.0" encoding="utf-8"?>
<html>
Montage Workflow Benchmark Runs on TG SDSC

Environment Setup

Condor GlideIn Setup

  • 8 IA 64 nodes were glided in using Condor Glideins from SDSC Teragrid Site
  • The Condor collector was running at the submit host corbusier.isi.edu
  • Condor Version at Submit host ( Corbusier )
    • $CondorVersion: 7.1.0 Apr 1 2008 BuildID: 80895 $
    • $CondorPlatform: I386-OSX_10_4 $
  • Condor Version for glidein's at SDSC
    • 7.1.0-ia64-Linux-2.4-glibc2.2.
  • Condor Negotiation Cycle
    • Negotiation in condor means the process of matching jobs in the queue to available resources
    • By default condor does negotation every 300 seconds. For the benchmark run, the default configuration for condor was used.
    • NEGOTIATOR_INTERVAL
      • Sets how often the negotiator starts a negotiation cycle. It is defined in seconds and defaults to 300 (5 minutes).
    • More details on condor negotiation

Input and Output Data

  • The input data for the workflow was staged in from sultan.isi.edu
    • Size of data 92Mb
    • Sultan runs GridFTP Server 2.7 (gcc32, 1204845443-63) Globus Toolkit 4.0.7 ready.
  • The output data generated was staged back to ISI machine ( corbusier.isi.edu )
    • Size of data 945 MB
    • Corbusier runs GridFTP Server 3.11 (gcc32, 1213742010-78) Globus Toolkit 4.2.0 ready.

Workflow Information

DAX/Abstract Workflow

Astronomy Metadata of Workflow

Key

Value

Band

j

Survey

M17

Width

1

Height

1

Number of Jobs by Type

Type of Job

Number

mProject

45

mDiffFit

107

mConcatFit

1

mBgModel

1

mBackground

45

mImgTable

1

mAdd

1

mShrink

1

mJPEG

1

Total number

203

Executable Workflow ( Generated By Pegasus )

Pegasus clustered the jobs at each level of workflow into max 8 clusters perl level

  • Image of the workflow
  • Compute Jobs ( Montage Jobs) 30

    Number of Compute/Montage Jobs by Type

    Type of Job

    Number

    mProject

    8

    mDiffFit

    8

    mConcatFit

    1

    mBgModel

    1

    mBackground

    8

    mImgTable

    1

    mAdd

    1

    mShrink

    1

    mJPEG

    1

    Total number

    30

Number of Jobs by Type

Type of Job

Number

Compute/Montage Jobs

30

Data Stagein

1

Data Stageout

9

Data Registration

9

Directory Creation and Sync Jobs

2

Total number

51

Workflow Runtimes

</html>

  • No labels