Introduction

Transformation statistics file contains information about the invocations in workflow executing grouped by the logical transformation name.

Transformation Statistics File

The transformation statistics file contains the following information about invocations grouped by the logical transformation name in individual workflow. In case of hierarchal workflow it shows all the sub workflows including top level workflow separated by its wf_uuid. 

    Transformation - name of the logical transformation.

    Count - the number of times the invocations with a  given logical transformation name was executed.

    Succeeded - the count of  succeeded invocations with a  given logical transformation name .

    Failed - the count of failed invocations with a  given logical transformation name .

    Mean(sec.) - the mean of the invocation runtimes  with a given logical transformation name times the multiplier_factor.

    Min(sec.) - the minimum runtime value  of invocations with a given logical transformation name times the multiplier_factor.

    Max(sec.) - the maximum runtime value of invocations with a given logical transformation name times the multiplier_factor.

    Total(sec.) - the cumulative of runtime value of invocations with a given logical transformation name times the multiplier_factor.

The runtime value is obtained from the remote_runtime in the invocation table

Queries

Transformation Statistics (using the multiplier_factor)

// API method name : get_transformation_statistics()

SELECT transformation,
       count(invocation_id) as count,
       min(remote_duration * multiplier_factor) as min,
       count(CASE WHEN (invoc.exitcode is NOT NULL and invoc.exitcode = 0) THEN invoc.exitcode END) AS success,
       count(CASE WHEN (invoc.exitcode is NOT NULL and invoc.exitcode != 0) THEN invoc.exitcode END) AS failure,
       max(remote_duration * multiplier_factor) as max,
       avg(remote_duration * multiplier_factor) as avg,
       sum(remote_duration * multiplier_factor) as sum FROM
invocation as invoc, job_instance as ji WHERE
invoc.job_instance_id = ji.job_instance_id and
invoc.wf_id IN (1,2,3) GROUP BY transformation
  • No labels