Page History

...

• Improving how we get data to worker nodes. Being able to retrieve data on the worker nodes from various sources.
• Add notification support to Pegasus
• Moving auxillary tools to stampede db
• Other Stampede Related Changes
• User Guide Reorganization 
• Testing Framework and Testing.

Data to Worker Nodes

Wiki MarkupThe main change for 3.1. The developers document has complete details [
Download Developers Document|^Data_To_Worker_Nodes-v3.pdf] *People Involved \[Mats,Karan,Gaurang\]*

• Wiki Markup
  Refactor how clustered jobs are handled *\[Karan\]*

• Wiki Markup
  Addition of staging-sites option to pegasus-plan *\[Karan\]*

• Wiki Markup
  New Shell Job Wrapper for jobs when running on worker nodes *\[Karan,Mats\]*

• Changes to pegasus-cleanup

  • Wiki Markup
    Creation of pegasus-cleanup jobs *\[Karan\]*

  • Wiki Markup
    new pegasus-cleanup client that runs locally *\[Mats\]*

• Changes to pegasus-createdir

  • Wiki Markup
    New pegasus-createdir client *\[Mats\]*

  • Wiki Markup
    New java createdir client *\[Gaurang\]*

• Wiki Markup
  Special S3 support into pegasus-transfer, pegasus-cleanup and pegasus create dir *\[Mats\]*

• Wiki Markup
  Bypassing of staging-site while staging in input data *\[Karan\]*

• Wiki Markup
  Bypassing of staging-site while staging out output data *\[Karan\]*

• Wiki Markup
  Transfer of braindump file to remote workflow execution directories *\[Karan\]*

...

Testing Framework and Testing

*People Involved \[Jens,Gaurang\]*

Porting the VM to 3.1.0

*People Involved \[Karan,Rajiv\]*

• Addition of new exercises