Total time of files integration


#1

How can I get the total time of all files integration ? (the total time token by C3 to integrate all files and create all objects )
In dataLoadProcessLog.stats what is the different between totalTimeInSecs and totalTransformationTimeInsecs ?


#2

My understanding and after looking to the documentation of DataLoadProcessStats

  • totalTransformationTimeInsecs: is the total time taken to run all transformation of your canonical
  • totalTimeInSecs: is the total time taken to process your canonicals, I believe it includes queueing time.

I think you cannot just sum up the totalTimeInSecs of your process logs as the data integration process is not sequentially, many workers can be involved.