Versions Compared


  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table Of Contents:

Table of Contents

Last Updated Feb 28th , 2011

Main Focus

  • Improving how we get data to worker nodes. Being able to retrieve data on the worker nodes from various sources.
    • Refactor how clustered jobs are handled
    • Addition of staging-sites option to pegasus-plan
    • New Shell Job Wrapper for jobs when running on worker nodes
    • Changes to pegasus-cleanup
    • Changes to pegasus-createdir
    • Special S3 support into pegasus-transfer, pegasus-cleanup and pegasus create dir
    • Bypassing of staging-site while staging in input data
    • Bypassing of staging-site while staging out output data
    • Transfer of braindump file to remote workflow execution directories
  • Add notification support to Pegasus
    • Monitord needs to support notifications
    • Requires changes to Pegasus to generate input file for monitord
    • Come up with default notify scripts in the toolkit that notify the user and generate some status reports?.
  • Moving auxillary tools to stampede db
    • pegasus-statistics
    • pegasus-plots
    • pegasus-analyzer
  • Other Stampede Related Changes
    • Improve Rescue DAG semantics
    • Additional DB schema changes to be able to connect jobs/tasks in the DAX with corresponding kickstart records
  • User Guide Reorganization ? Dependant on Bill.