Introduction

pegasus-statistics is a command line tool for generating workflow execution statistics.

Pegasus Statistics Output

pegasus-statistics generates the following statistics. Workflow summary is shown on the command line output. It generates three files for showing workflow statistics , job statistics and transformation statistics.

Workflow Summary :- Summary of the workflow run. If the given workflow has sub workflows it iteratively parses the sub workflow  to generate the summary statistics. It is shown on the command line console. 

Workflow statistics file :-  A file containing statistics of individual workflows in a tabular format with the sum across workflow as the last row.  If a given workflow has sub workflows it is considered as a single job, it won't iteratively parse the sub workflow. The file  is named 'workflow.txt'

Job statistics file  :-   A file containing job statistics of individual workflows separated by their respective workflow uuid. The file is named 'jobs.txt'

Transformation statistics file  :-  A  file containing transformation statistics of individual workflows separated by their respective workflow uuid. The file is named 'breakdown.txt'

Each section is described in the sub section pages.

Python Statistics Retrieval Api

Please find the link to the python statistics retrieval api here.