Introduction

Transformation statistics file contains information about the invocations in workflow executing grouped by the logical transformation name.

Transformation Statistics File

The transformation statistics file contains the following information about invocations grouped by the logical transformation name in individual workflow. In case of hierarchal workflow it shows all the sub workflows including top level workflow separated by its wf_uuid. 

    Transformation - name of the logical transformation.

    Count - the number of times the invocations with a  given logical transformation name was executed.

    Succeeded - the count of  succeeded invocations with a  given logical transformation name .

    Failed - the count of failed invocations with a  given logical transformation name .

    Mean(sec.) - the mean of the invocation runtimes  with a given logical transformation name. 

    Min(sec.) - the minimum runtime value  of invocations with a given logical transformation name.

    Max(sec.) - the maximum runtime value of invocations with a given logical transformation name.

    Total(sec.) - the cumulative of runtime value of invocations with a given logical transformation name.

The runtime value is obtained from the remote_runtime in the invocation table

Queries

Transformation Statistics

// API method name : get_transformation_statistics()

SELECT invocation.transformation AS invocation_transformation,
count(invocation.invocation_id) AS count,
min(invocation.remote_duration) AS min,
count(CASE WHEN (invocation.exitcode = 0) THEN invocation.exitcode END) AS success,
count(CASE WHEN (invocation.exitcode != 0) THEN invocation.exitcode END) AS failure,
max(invocation.remote_duration) AS max,
avg(invocation.remote_duration) AS avg,
sum(invocation.remote_duration) AS sum
FROM invocation
WHERE invocation.wf_id IN (1,2,3) GROUP BY invocation.transformation
  • No labels