...
- Pegasus development
- waiting for LIGO to check the support for changes for OSG, where pegasuslite URLs are converted to file URL if the staging site and compute site are same
- Karan has a call with Duncan next week planned.
- staging sites deep directory structure
- mats has it working for one of the workflow.
- https://jira.isi.edu/browse/PM-1049
- automatic delayed job retries
- the real fix should be in DAGMan. Karan will follow up with Kent. Will address for 4.8
- postscript output redirects
- one file per job is what we had considered earlier
- maybe we should do it per workflow log file.
- waiting for LIGO to check the support for changes for OSG, where pegasuslite URLs are converted to file URL if the staging site and compute site are same
- DIPA workflow development
- good progress there.
- Titan Setup
- we should consider setting up it the same way as bluewaters
- Next Pegasus proposal
- next week meeting we should iterate on items.
- Samrat issue
- get pegasus-exitcode to look for final output files
- checked in workflows to the pegasus repository
- bioconductor repository
- would be good to setup PAGE cloud VM with the workflow.
- Deter Krans Mueller
- director of supercomputing in germany
- supermute supercomputing cluster
- will send a student for 3 months to ISI end of the month.
- Rafael plans to practical comparison paper
- Gui's docker stuff.
- do a blogpost of montage with above docker stuff.
July 2016
July 15th, 2016
- Pegasus development
- waiting for LIGO to check the support for changes for OSG, where pegasuslite URLs are converted to file URL if the staging site and compute site are same
- staging sites deep directory structure
- dashboard changes for nested submit directory structure
- fixed the on demand loading for the dashboard.
- identify workflows that will benefit
- LIGO
- Splinter
- OSG - Kink
- put in the test cases for testing it out.
- use the new montage dax generator
- pull the montage dax generator via squid cache.
- Release schedule
- Get 4.6.2 out first.
- 4.7 probably early august.
- ALCF Mira running.
- cobalt workflow
- ACME workflow compilation. Waiting on Ben for the source code.
- Panorama use case
- SNS is not enough in terms of data sizes.
- anirban will start working on it next week.
- R Examples
- samrat working on a bioconductor example
- has an example workflow
- code should be checked into github
- samrat is working on a more advanced workflow that will be put in the examples directory also
- samrat working on a bioconductor example
- Gui docker nodes work on amazon ec2
- uses docker swarm and docker machine to do setup etc
- workflows run in condor IO mode.
- DIPA Workflows
- waisman folks will start working on it.
- free surfer workflow
- mats does not think there is enough uptake.
- suchandra is working on a second version that will add more capabilities
- seismology workflow
- rafael will check in to the repo.
...