Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Add notification support to Pegasus
  • Moving auxillary tools to stampede db
  • Other Stampede Related Changes
  • Usability Changes
  • User Guide Reorganization 
  • Testing Framework and Testing.

JIRA Task Board

https://jira.isi.edu/secure/TaskBoard.jspa?selectedBoardId=10054&start=0&pageType=TaskBoard&type=TB&selectedProjectId=10002TaskBoard for 3.1

Stampede Related Changes

  • Main JIRA Issue
  • Updated Database Schema
  • Wiki Markup
    Additional DB schema changes to be able to connect jobs/tasks in the DAX with corresponding kickstart records *\[Karan,Fabio,Monte\]*
  • Wiki Markup
    Identify the new events for the updated schema *\[Karan,Fabio\]*
    • Wiki Markup
      Pegasus to generate netlogger events to a file in the submit directory *\[Karan\]*
    • Wiki Markup
      Changes to monitord to conform to new schema, populate netlogger stream from Pegasus. *\[Fabio\]*
  • Wiki Markup
    Addition of workflow metrics file containing distribution of jobs into the DB *\[Fabio,Karan\]*
    • Wiki Markup
      Revive the metrics file created by Pegasus . Should be populated in the submit directory. *\[Karan\]*

Notification Support in Pegasus via monitord

  • Main JIRA Issue
  • Wiki Markup
    Monitord needs to be managed by Condor. What happens if monitord crashes or condor/system crashes? We want monitord to come up automatically as Condor recovers after a restart. *\[Fabio,Gaurang\]*
  • Wiki Markup
    Monitord needs to support notifications *\[Fabio\]*
  • Wiki Markup
    Requires changes to Pegasus to generate input file for monitord *\[Rajiv,Karan\]*
  • Wiki Markup
    Come up with default notify scripts in the toolkit that notify the user and generate some status reports. *\[Gaurang\]*
  • Changes to DAX Schema
    • Main JIRA Item PM-350
    • Addition of invoke element at the workflow level
    • Wiki Markup
      Changes to python API *\[Gideon\]*
    • Wiki Markup
      Changes to Perl  API *\[Jens\]*
    • Wiki Markup
      Changes to JAVA API *\[Gaurang\]*
    • Wiki Markup
      Change to JAVA Parser *\[Karan\]*
    • Wiki Markup
      Fabio needs to make sure exitcodes are thrown correctly and restarts are handled correctly. *\[Fabio\]*

...