Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Improving how we get data to worker nodes. Being able to retrieve data on the worker nodes from various sources.
  • Add notification support to Pegasus
  • Moving auxillary tools to stampede db
  • Other Stampede Related Changes
  • User Guide Reorganization 
  • Testing Framework and Testing.

Data to Worker Nodes

Wiki MarkupThe main change for 3.1. The developers document has complete details [
Download Developers Document|^Data_To_Worker_Nodes-v3.pdf] *People Involved \[Mats,Karan,Gaurang\]*

  • Wiki Markup
    Refactor how clustered jobs are handled *\[Karan\]*
  • Wiki Markup
    Addition of staging-sites option to pegasus-plan *\[Karan\]*
  • Wiki Markup
    New Shell Job Wrapper for jobs when running on worker nodes *\[Karan,Mats\]*
  • Changes to pegasus-cleanup
    • Wiki Markup
      Creation of pegasus-cleanup jobs *\[Karan\]*
    • Wiki Markup
      new pegasus-cleanup client that runs locally *\[Mats\]*
  • Changes to pegasus-createdir
    • Wiki Markup
      New pegasus-createdir client *\[Mats\]*
    • Wiki Markup
      New java createdir client *\[Gaurang\]*
  • Wiki Markup
    Special S3 support into pegasus-transfer, pegasus-cleanup and pegasus create dir *\[Mats\]*
  • Wiki Markup
    Bypassing of staging-site while staging in input data *\[Karan\]*
  • Wiki Markup
    Bypassing of staging-site while staging out output data *\[Karan\]*
  • Wiki Markup
    Transfer of braindump file to remote workflow execution directories *\[Karan\]*

...

Testing Framework and Testing

Wiki Markup
*People Involved \[Jens,Gaurang\]*

Porting the VM to 3.1.0

Wiki Markup
*People Involved \[Karan,Rajiv\]*

  • Addition of new exercises