April  2019

April 12th 2019

March  2019

March 29th 2019

March 1st 2019

February  2019

February 22nd 2019

February 1st 2019

January  2019

January 25th 2019

January  18th 2019

December  2018

December 13rd, 2018

November  2018

Nov 29th, 2018

Nov 1st, 2018

October  2018

Oct 12th, 2018

Oct 5th, 2018

September 2018

September 28th, 2018

September 21st, 2018

August 2018

August 24th, 2018

August 17th, 2018

August 3, 2018

July 2018

July 27th, 2018

June 2018

June 29th, 2018

June 22nd, 2018

June 8th, 2018

May 2018

May 4th, 2018

April 2018

April 6th, 2018

March 2018

March 30th, 2018

March 16th, 2018

February 2018

February 23th, 2018

Eliminate support for Py2.6?

Python Dependencies

All - future

pegasus-service - Flask, SQLAlchemy, Flask-SQLAlchemy, Flask-Cache, pam, plex, pyOpenSSL, ordereddict

pegasus-monitord - SQLAlchemy

pegasus-analyzer - SQLAlchemy

pegasus-s3 - boto

pegasus-globus-* - globus-sdk

pegasus-init - jinja2

pegasus-metadata - argparse

pegasus-em - requests

PostgreSQL - psycopg2

MySQL - MySQL-Python OR mysqlclient


Note: Packages in green are available from yum.

February 9th, 2018

January 2018

January 12nd, 2018

December 2017

December 1st, 2017

November 2017

November 10th, 2017

November 3rd, 2017

September 2017

September 15th, 2017

September 8th, 2017

August 2017

August 25th, 2017

August 18th, 2017

August 11th, 2017

July 2017

July 21st, 2017

June 2017

June 23rd, 2017

June 9th, 2017

June 2nd, 2017

May 2017

May 12th, 2017

March 2017

March 17th, 2016

March 10th, 2016

March 3rd, 2016

February 2017

February 24th, 2016

February 17th, 2016

February 10th, 2016

February 3rd, 2016

January 2017

January 27th, 2016

January 13th, 2016

October 2016

October 7th, 2016

September 2016

September 16th, 2016

September 9th, 2016

September 2nd, 2016

August 2016

August 12th, 2016

August 5th, 2016

July 2016

July 15th, 2016

July 8th, 2016

July 1st, 2016

May 2016

May 13th, 2016

May 6th, 2016

April 2016

April 22nd, 2016

April 15th, 2016

April 1st, 2016

March 2016

March 25th, 2016

 

March 18th, 2016

 

March 11th, 2016

 

March 4th, 2016

 

February 2016

February 19th, 2016

Pegasus development

February 12th, 2016

Pegasus development

Annual Report

February 5th, 2016

Pegasus development

January 2016

January 28th, 2016

Pegasus development

January 22nd, 2016

 

Pegasus development

January 15th, 2016

Pegasus development

January 8th, 2016

Pegasus development

December 2015

December 18th, 2015

Pegasus development

December 11th, 2015

Pegasus development

December 4th, 2015

Pegasus development

October 2015

October 23rd, 2015

Pegasus development

October 16th, 2015

Pegasus development

October 9th, 2015

Pegasus development

October 2nd, 2015

Pegasus development

September 2015

September 25th, 2015

September 18th, 2015

September 11th, 2015

September 4th, 2015

August 2015

August 28th, 2015

August 21st, 2015

August 14th, 2015

August 7th, 2015

July 2015

July 31st, 2015

July 24th, 2015

July 17th, 2015

July 10th, 2015

June 2015

June 12th, 2015

June 5th, 2015

May 2015

May 29th, 2015

May 8th, 2015

Bamboo test failures

pegasus-transfer new format

Metatdata

LIGO on XSEDE

Python builds

Bamboo build machine

Getting new SSL certificates

Metrics Server fixes

May 1st 2015

 

April 2015

April 24th 2015

 

April 17th 2015

April 10th 2015

pegasus cleanup

pegasus RC1

pegasus 4.5.0 release

pegasus-db-admin

HPCC tutorial

XSEDE paper

REST API

April 3rd, 2015

 

March 2015

March 27th, 2014

March 20th, 2015

pegasus 4.4.2 release done

tagged release for SCEC production runs .. we will do a pre-release candidate

metrics server

pegasus-db-admin

pegasus-submit-dir

pegasus-dashboard archive option

transfer grouping in Pegasus

PM-851 kickstart invoke option for auxiliary jobs

pegasus dashboard updates

job submission survey short paper

Panorama Updates

User Questionnaire

March 13th, 2015

March 6th, 2015

February 2015

Feb 20th, 2015

January 2015

Jan 14th, 2015

Jan 7th, 2015

December 2014

Dec 8th, 2014

December 3rd, 2014

November 2014

November 12th, 2014

November 5th, 2014

October 2014

October 29th, 2014

September 2014

September 17th, 2014

August 2014

August 25th, 2014

August 18th, 2014

August 11, 2014

August 4th, 2014

June 2014

June 30th, 2014

June 9th, 2014

May 2014

May 12th, 2014

May 5th, 2014

Condor week

Bamboo Test Cases

User Survey

April 2014

April 21st, 2014

April 14th, 2014

March 2014

March 31st, 2014

March 24th, 2014

March 17th, 2014

Agenda

March 10th, 2014

Agenda

March 3rd, 2014

Workflow reproducability ( idafen )

Pegasus Submit Node on HPCC

Feb 2014

February 24th, 2014

SCEC Transfer Issues

Transfer Configuration for 4.4

February 10th, 2014

Postscript handling

————————————————————————————————

 

- We have implemented a solution in PM-737 to get around condor quoting rules.

 

- MPI code are not kickstart wrapped

 - Pegasus should indicate whether a clustered job or a kickstart job.

 

- DAGMan exitcode 

 

 

checkpoint jobs

 - 10% of runtimes

 - pegasus-transfer will have to be changed

 - link is set to type checkpoint

 - transaction support for checkpoint

 - timeout  is job runtime - process

 - pegasus-kickstart timeout method

 - also has dv/dt implications for monitoring. 

 

pegasus-exitcode assumes success and checks for failure

 - refactored the script for unit tests as a library

 - pegasus-statistics

 - pegasus-analyzer  ( maybe some commonality)

 - pegasus python library has to be included in worker package

 

 

 

pegasus-transfer 

 - threads are handled similar to pegasus-s3

 - default threading

 

 - expose options end to end

 - initial threads to irods

 - what options to set

 

pegasus-config will now work with a source checkout

December 2013

December 16th, 2013

December 3rd, 2013

November 2013

 November 11th, 2013

November 4th, 2013

October 2013

October 1st, 2013

Pegasus 4.3 release

September 2013

September 23rd, 2013

Software Carpentry followup

ISI Pegasus Workshop

Tutorial VM

Pegasus Release

September 9th, 2013

Software Carpentry

Pegasus Release

Pegasus Lite Paper

Precip

Condo of Condos Workshop

 

August 26th, 2013

Pegasus 4.3 release

Precip Logging

Pegasus Hold

JDBC RC

Ensemble Manager Paper

DAGMan replacement??

August 19th, 2013

August 12th, 2013

July 2013

July 29th, 2013

Software Carpentry

July 8th, 2013

July 1st, 2013

June 2013

June 24th, 2013

June 17th, 2013

June 10th, 2013

- Pegasus Development

- change to dax handling

- fix of stdout 

- regex based replica catalog. 

- changes to pegasus-statistics for aggregate statistics

 

Pegasus  Lite Paper

- compute data between s3 and local disk.

- compute costs for the runs ? 

- have data outside 

- local cache for the S3 client ??  could affect the rosette cache. 

 - change the rosetta workflow.

 - if there are a lot of small files.

 - reading parts of files.

- Ewa will send her version of the changes.

 

Sudharshan Algorithm for Cleanup


June 3rd, 2013

Pegasus Lite Paper

Pegasus Development

Precip Paper

Stampede and Corral Annual Reports

Sudarshan's Project

PMC Paper

Shirts

dV/dT

May 2013

May 20th, 2013

Confluence is going slow. Mats is going to look.

Analytics are set up on Confluence now.

Pegasus Transfer

Pegasus S3 Client

Pegasus Lite Paper

PMC Paper

Pegasus Service

Summer Student

Contacting users

Examples

April 2013

April 22nd, 2013

Pegasus 4.2.1 Release

Pegasus statistics across workflows - Rajiv

Pegasus Lite Paper

pegasus-hold and pegasus-release

BOSCO

April 8th, 2013

Pegasus 4.2.1 Release
Pegasus 4.3

Pegasus Posters

Pegasus Lite Paper

New Programmer Hire

April 1st, 2013

Pegasus Lite Paper

XSEDE Poster

Pegasus Development



 

March 2013

March 25th, 2013

March 18th, 2013

March 4th, 2013

February 2013

February 11th, 2013

Direct submission of workflows to PBS

 - jobstate.log refactoring. 

 - data transfer ( support for globus online) 

- lightweight tracing

 -  task stats. net link socket pegasus-kickstart . how much memory the task used and io used. 

 - add task stats to kickstart

 - ptrace

 - trace  linux equivalent is system tap

 

- dashboard improvements

 - single api for clients

 - last week drop down

 - performance run on large workflows.

 

February 4th, 2013