crp-order-quantity-kpi-service - Details for Query 440

Submitted Time: 2026/08/10 09:24:53
Duration: 2 s
Succeeded Jobs: 859 860 861 862 863

Plan Visualization

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [id="node0" labelType="html" label=" AdaptiveSparkPlan " tooltip="AdaptiveSparkPlan isFinalPlan=true"]; 1 [id="node1" labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 201 ms number of written files: 1 job commit time: 354 ms number of output rows: 137 number of dynamic part: 1 written output: 49.7 KiB" tooltip="Execute InsertIntoHadoopFsRelationCommand hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000002107, false, [activityType#90707], Parquet, [__partition_columns=[\"activityType\"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000002107], Append, [jobId, stageCount, totalTaskCount, minTaskCountPerStage, maxTaskCountPerStage, medianTaskCountPerStage, bytesSpilledToDiskSerializedTotal, bytesSpilledToDiskSerializedMin, bytesSpilledToDiskSerializedMax, bytesSpilledToDiskSerializedMedian, taskCpuTimeTotal, taskCpuTimeMin, taskCpuTimeMax, taskCpuTimeMedian, taskDeserializeCpuTimeTotal, taskDeserializeCpuTimeMin, taskDeserializeCpuTimeMax, taskDeserializeCpuTimeMedian, taskDeserializeTimeTotal, taskDeserializeTimeMin, taskDeserializeTimeMax, taskDeserializeTimeMedian, taskRunTimeTotal, taskRunTimeMin, taskRunTimeMax, ... 67 more fields]"]; 2 [id="node2" labelType="html" label=" WriteFiles " tooltip="WriteFiles"]; subgraph cluster3 { isCluster="true"; id="cluster3"; label="WholeStageCodegen (6)\n \nduration: 189 ms"; tooltip="WholeStageCodegen (6)"; 4 [id="node4" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [activityType#90707 ASC NULLS FIRST], false, 0"]; 5 [id="node5" labelType="html" label=" Project " tooltip="Project [coalesce(jobId#90699, jobId#90693) AS jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, ... 67 more fields]"]; 6 [id="node6" labelType="html" label="SortMergeJoin number of output rows: 137 spill size: 0.0 B" tooltip="SortMergeJoin [jobId#90699], [jobId#90693], FullOuter"]; } subgraph cluster7 { isCluster="true"; id="cluster7"; label="WholeStageCodegen (4)\n \nduration: 801 ms"; tooltip="WholeStageCodegen (4)"; 8 [id="node8" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#90699 ASC NULLS FIRST], false, 0"]; } 9 [id="node9" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 20.7 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 10 [id="node10" labelType="html" label="Exchange shuffle records written: 137 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 137 local bytes read: 19.7 KiB merged fetch fallback count: 0 local blocks read: 25 remote merged chunks fetched: 0 remote blocks read: 0 data size: 84.6 KiB local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time: 1 ms remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 0.0 B number of partitions: 25 remote reqs duration: 0 ms remote bytes read to disk: 0.0 B shuffle bytes written: 19.7 KiB" tooltip="Exchange hashpartitioning(jobId#90699, 25), ENSURE_REQUIREMENTS, [plan_id=194732]"]; subgraph cluster11 { isCluster="true"; id="cluster11"; label="WholeStageCodegen (3)\n \nduration: 25 ms"; tooltip="WholeStageCodegen (3)"; 12 [id="node12" labelType="html" label=" Project " tooltip="Project [coalesce(jobId#90616, jobId#90689) AS jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, ... 51 more fields]"]; 13 [id="node13" labelType="html" label="SortMergeJoin number of output rows: 137 spill size: 0.0 B" tooltip="SortMergeJoin [jobId#90616], [jobId#90689], FullOuter"]; } subgraph cluster14 { isCluster="true"; id="cluster14"; label="WholeStageCodegen (1)\n \nduration: 240 ms"; tooltip="WholeStageCodegen (1)"; 15 [id="node15" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#90616 ASC NULLS FIRST], false, 0"]; } 16 [id="node16" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 28.6 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 17 [id="node17" labelType="html" label="Exchange shuffle records written: 137 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 137 local bytes read: 6.6 KiB merged fetch fallback count: 0 local blocks read: 30 remote merged chunks fetched: 0 remote blocks read: 92 data size total (min, med, max (stageId: taskId)) 81.3 KiB (3.0 KiB, 3.0 KiB, 3.6 KiB (stage 2218.0: task 22369)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 15 ms (0 ms, 0 ms, 1 ms (stage 2218.0: task 22421)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 20.6 KiB number of partitions: 25 remote reqs duration: 3 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 27.2 KiB (810.0 B, 1108.0 B, 1480.0 B (stage 2218.0: task 22386))" tooltip="Exchange hashpartitioning(jobId#90616, 25), ENSURE_REQUIREMENTS, [plan_id=194527]"]; 18 [id="node18" labelType="html" label="LocalTableScan number of output rows: 137" tooltip="LocalTableScan [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, ... 48 more fields]"]; subgraph cluster19 { isCluster="true"; id="cluster19"; label="WholeStageCodegen (2)\n \nduration: 108 ms"; tooltip="WholeStageCodegen (2)"; 20 [id="node20" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#90689 ASC NULLS FIRST], false, 0"]; } 21 [id="node21" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 12.8 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 22 [id="node22" labelType="html" label="Exchange shuffle records written: 137 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 137 local bytes read: 9.9 KiB merged fetch fallback count: 0 local blocks read: 100 remote merged chunks fetched: 0 remote blocks read: 22 data size total (min, med, max (stageId: taskId)) 6.4 KiB (240.0 B, 240.0 B, 288.0 B (stage 2216.0: task 22353)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 14 ms (0 ms, 0 ms, 1 ms (stage 2216.0: task 22355)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 2.2 KiB number of partitions: 25 remote reqs duration: 1 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 12.1 KiB (333.0 B, 499.0 B, 607.0 B (stage 2216.0: task 22408))" tooltip="Exchange hashpartitioning(jobId#90689, 25), ENSURE_REQUIREMENTS, [plan_id=194528]"]; 23 [id="node23" labelType="html" label="LocalTableScan number of output rows: 137" tooltip="LocalTableScan [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]"]; subgraph cluster24 { isCluster="true"; id="cluster24"; label="WholeStageCodegen (5)\n \nduration: 316 ms"; tooltip="WholeStageCodegen (5)"; 25 [id="node25" labelType="html" label="Sort sort time: 0 ms peak memory: 2.1 MiB spill size: 0.0 B" tooltip="Sort [jobId#90693 ASC NULLS FIRST], false, 0"]; } 26 [id="node26" labelType="html" label="AQEShuffleRead number of partitions: 1 partition data size: 12.3 KiB number of coalesced partitions: 1" tooltip="AQEShuffleRead coalesced"]; 27 [id="node27" labelType="html" label="Exchange shuffle records written: 137 remote merged reqs duration: 0 ms remote merged blocks fetched: 0 records read: 137 local bytes read: 1054.0 B merged fetch fallback count: 0 local blocks read: 11 remote merged chunks fetched: 0 remote blocks read: 110 data size total (min, med, max (stageId: taskId)) 8.6 KiB (320.0 B, 320.0 B, 384.0 B (stage 2217.0: task 22365)) local merged bytes read: 0.0 B local merged chunks fetched: 0 shuffle write time total (min, med, max (stageId: taskId)) 13 ms (0 ms, 0 ms, 0 ms (stage 2217.0: task 22371)) remote merged bytes read: 0.0 B local merged blocks fetched: 0 corrupt merged block chunks: 0 fetch wait time: 0 ms remote bytes read: 10.9 KiB number of partitions: 25 remote reqs duration: 5 ms remote bytes read to disk: 0.0 B shuffle bytes written total (min, med, max (stageId: taskId)) 11.9 KiB (270.0 B, 490.0 B, 603.0 B (stage 2217.0: task 22371))" tooltip="Exchange hashpartitioning(jobId#90693, 25), ENSURE_REQUIREMENTS, [plan_id=194536]"]; 28 [id="node28" labelType="html" label="LocalTableScan number of output rows: 137" tooltip="LocalTableScan [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]"]; 1->0; 2->1; 4->2; 5->4; 6->5; 8->6; 9->8; 10->9; 12->10; 13->12; 15->13; 16->15; 17->16; 18->17; 20->13; 21->20; 22->21; 23->22; 25->6; 26->25; 27->26; 28->27; }

Details

== Physical Plan ==
AdaptiveSparkPlan (40)
+- == Final Plan ==
   ResultQueryStage (27), Statistics(sizeInBytes=8.0 EiB)
   +- Execute InsertIntoHadoopFsRelationCommand (26)
      +- WriteFiles (25)
         +- * Sort (24)
            +- * Project (23)
               +- * SortMergeJoin FullOuter (22)
                  :- * Sort (16)
                  :  +- AQEShuffleRead (15)
                  :     +- ShuffleQueryStage (14), Statistics(sizeInBytes=84.6 KiB, rowCount=137)
                  :        +- Exchange (13)
                  :           +- * Project (12)
                  :              +- * SortMergeJoin FullOuter (11)
                  :                 :- * Sort (5)
                  :                 :  +- AQEShuffleRead (4)
                  :                 :     +- ShuffleQueryStage (3), Statistics(sizeInBytes=81.3 KiB, rowCount=137)
                  :                 :        +- Exchange (2)
                  :                 :           +- LocalTableScan (1)
                  :                 +- * Sort (10)
                  :                    +- AQEShuffleRead (9)
                  :                       +- ShuffleQueryStage (8), Statistics(sizeInBytes=6.4 KiB, rowCount=137)
                  :                          +- Exchange (7)
                  :                             +- LocalTableScan (6)
                  +- * Sort (21)
                     +- AQEShuffleRead (20)
                        +- ShuffleQueryStage (19), Statistics(sizeInBytes=8.6 KiB, rowCount=137)
                           +- Exchange (18)
                              +- LocalTableScan (17)
+- == Initial Plan ==
   Execute InsertIntoHadoopFsRelationCommand (39)
   +- WriteFiles (38)
      +- Sort (37)
         +- Project (36)
            +- SortMergeJoin FullOuter (35)
               :- Sort (33)
               :  +- Exchange (32)
               :     +- Project (31)
               :        +- SortMergeJoin FullOuter (30)
               :           :- Sort (28)
               :           :  +- Exchange (2)
               :           :     +- LocalTableScan (1)
               :           +- Sort (29)
               :              +- Exchange (7)
               :                 +- LocalTableScan (6)
               +- Sort (34)
                  +- Exchange (18)
                     +- LocalTableScan (17)


(1) LocalTableScan
Output [73]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L]
Arguments: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, ... 48 more fields]

(2) Exchange
Input [73]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L]
Arguments: hashpartitioning(jobId#90616, 25), ENSURE_REQUIREMENTS, [plan_id=194527]

(3) ShuffleQueryStage
Output [73]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L]
Arguments: 0

(4) AQEShuffleRead
Input [73]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L]
Arguments: coalesced

(5) Sort [codegen id : 1]
Input [73]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L]
Arguments: [jobId#90616 ASC NULLS FIRST], false, 0

(6) LocalTableScan
Output [4]: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]

(7) Exchange
Input [4]: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: hashpartitioning(jobId#90689, 25), ENSURE_REQUIREMENTS, [plan_id=194528]

(8) ShuffleQueryStage
Output [4]: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: 1

(9) AQEShuffleRead
Input [4]: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: coalesced

(10) Sort [codegen id : 2]
Input [4]: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: [jobId#90689 ASC NULLS FIRST], false, 0

(11) SortMergeJoin [codegen id : 3]
Left keys [1]: [jobId#90616]
Right keys [1]: [jobId#90689]
Join type: FullOuter
Join condition: None

(12) Project [codegen id : 3]
Output [76]: [coalesce(jobId#90616, jobId#90689) AS jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Input [77]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]

(13) Exchange
Input [76]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: hashpartitioning(jobId#90699, 25), ENSURE_REQUIREMENTS, [plan_id=194732]

(14) ShuffleQueryStage
Output [76]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: 3

(15) AQEShuffleRead
Input [76]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: coalesced

(16) Sort [codegen id : 4]
Input [76]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: [jobId#90699 ASC NULLS FIRST], false, 0

(17) LocalTableScan
Output [6]: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]
Arguments: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]

(18) Exchange
Input [6]: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]
Arguments: hashpartitioning(jobId#90693, 25), ENSURE_REQUIREMENTS, [plan_id=194536]

(19) ShuffleQueryStage
Output [6]: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]
Arguments: 2

(20) AQEShuffleRead
Input [6]: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]
Arguments: coalesced

(21) Sort [codegen id : 5]
Input [6]: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]
Arguments: [jobId#90693 ASC NULLS FIRST], false, 0

(22) SortMergeJoin [codegen id : 6]
Left keys [1]: [jobId#90699]
Right keys [1]: [jobId#90693]
Join type: FullOuter
Join condition: None

(23) Project [codegen id : 6]
Output [92]: [coalesce(jobId#90699, jobId#90693) AS jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698, 10000002107 AS replenishmentRunId#90701L, 6944346648028224943 AS tenantId#90702, 8378 AS cornerstoneTenantId#90703L, Daily_grocery AS marketUnit#90704, STANDARD AS scenario#90705, d35da17e-0e2e-329d-95a5-3ec4da30b036 AS activityId#90706, BufferDataSnapShot AS activityType#90707, KpiPrepareDataSnapshotWorkflow AS workflowType#90708, cc01d037-acca-3e25-a8f8-bfe832f671f6 AS workflowId#90709, 1 AS activityAttempt#90710,  AS gitCommitId#90712]
Input [82]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]

(24) Sort [codegen id : 6]
Input [92]: [jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698, replenishmentRunId#90701L, tenantId#90702, cornerstoneTenantId#90703L, marketUnit#90704, scenario#90705, activityId#90706, activityType#90707, workflowType#90708, workflowId#90709, activityAttempt#90710, gitCommitId#90712]
Arguments: [activityType#90707 ASC NULLS FIRST], false, 0

(25) WriteFiles
Input [92]: [jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698, replenishmentRunId#90701L, tenantId#90702, cornerstoneTenantId#90703L, marketUnit#90704, scenario#90705, activityId#90706, activityType#90707, workflowType#90708, workflowId#90709, activityAttempt#90710, gitCommitId#90712]

(26) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000002107, false, [activityType#90707], Parquet, [__partition_columns=["activityType"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000002107], Append, [jobId, stageCount, totalTaskCount, minTaskCountPerStage, maxTaskCountPerStage, medianTaskCountPerStage, bytesSpilledToDiskSerializedTotal, bytesSpilledToDiskSerializedMin, bytesSpilledToDiskSerializedMax, bytesSpilledToDiskSerializedMedian, taskCpuTimeTotal, taskCpuTimeMin, taskCpuTimeMax, taskCpuTimeMedian, taskDeserializeCpuTimeTotal, taskDeserializeCpuTimeMin, taskDeserializeCpuTimeMax, taskDeserializeCpuTimeMedian, taskDeserializeTimeTotal, taskDeserializeTimeMin, taskDeserializeTimeMax, taskDeserializeTimeMedian, taskRunTimeTotal, taskRunTimeMin, taskRunTimeMax, ... 67 more fields]

(27) ResultQueryStage
Output: []
Arguments: 4

(28) Sort
Input [73]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L]
Arguments: [jobId#90616 ASC NULLS FIRST], false, 0

(29) Sort
Input [4]: [jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: [jobId#90689 ASC NULLS FIRST], false, 0

(30) SortMergeJoin
Left keys [1]: [jobId#90616]
Right keys [1]: [jobId#90689]
Join type: FullOuter
Join condition: None

(31) Project
Output [76]: [coalesce(jobId#90616, jobId#90689) AS jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Input [77]: [jobId#90616, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, jobId#90689, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]

(32) Exchange
Input [76]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: hashpartitioning(jobId#90699, 25), ENSURE_REQUIREMENTS, [plan_id=194535]

(33) Sort
Input [76]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L]
Arguments: [jobId#90699 ASC NULLS FIRST], false, 0

(34) Sort
Input [6]: [jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]
Arguments: [jobId#90693 ASC NULLS FIRST], false, 0

(35) SortMergeJoin
Left keys [1]: [jobId#90699]
Right keys [1]: [jobId#90693]
Join type: FullOuter
Join condition: None

(36) Project
Output [92]: [coalesce(jobId#90699, jobId#90693) AS jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698, 10000002107 AS replenishmentRunId#90701L, 6944346648028224943 AS tenantId#90702, 8378 AS cornerstoneTenantId#90703L, Daily_grocery AS marketUnit#90704, STANDARD AS scenario#90705, d35da17e-0e2e-329d-95a5-3ec4da30b036 AS activityId#90706, BufferDataSnapShot AS activityType#90707, KpiPrepareDataSnapshotWorkflow AS workflowType#90708, cc01d037-acca-3e25-a8f8-bfe832f671f6 AS workflowId#90709, 1 AS activityAttempt#90710,  AS gitCommitId#90712]
Input [82]: [jobId#90699, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, jobId#90693, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698]

(37) Sort
Input [92]: [jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698, replenishmentRunId#90701L, tenantId#90702, cornerstoneTenantId#90703L, marketUnit#90704, scenario#90705, activityId#90706, activityType#90707, workflowType#90708, workflowId#90709, activityAttempt#90710, gitCommitId#90712]
Arguments: [activityType#90707 ASC NULLS FIRST], false, 0

(38) WriteFiles
Input [92]: [jobId#90700, stageCount#90617L, totalTaskCount#90618L, minTaskCountPerStage#90619L, maxTaskCountPerStage#90620L, medianTaskCountPerStage#90621L, bytesSpilledToDiskSerializedTotal#90622L, bytesSpilledToDiskSerializedMin#90623L, bytesSpilledToDiskSerializedMax#90624L, bytesSpilledToDiskSerializedMedian#90625L, taskCpuTimeTotal#90626L, taskCpuTimeMin#90627L, taskCpuTimeMax#90628L, taskCpuTimeMedian#90629L, taskDeserializeCpuTimeTotal#90630L, taskDeserializeCpuTimeMin#90631L, taskDeserializeCpuTimeMax#90632L, taskDeserializeCpuTimeMedian#90633L, taskDeserializeTimeTotal#90634L, taskDeserializeTimeMin#90635L, taskDeserializeTimeMax#90636L, taskDeserializeTimeMedian#90637L, taskRunTimeTotal#90638L, taskRunTimeMin#90639L, taskRunTimeMax#90640L, taskRunTimeMedian#90641L, jvmGcTimeTotal#90642L, jvmGcTimeMin#90643L, jvmGcTimeMax#90644L, jvmGcTimeMedian#90645L, bytesSpilledToDiskRawTotal#90646L, bytesSpilledToDiskRawMin#90647L, bytesSpilledToDiskRawMax#90648L, bytesSpilledToDiskRawMedian#90649L, resultSerializationTimeTotal#90650L, resultSerializationTimeMin#90651L, resultSerializationTimeMax#90652L, resultSerializationTimeMedian#90653L, resultSizeToDriverTotal#90654L, resultSizeToDriverMin#90655L, resultSizeToDriverMax#90656L, resultSizeToDriverMedian#90657L, taskPeakExecutionMemoryMin#90658L, taskPeakExecutionMemoryMax#90659L, taskPeakExecutionMemoryMedian#90660L, persistencyBytesReadTotal#90661L, persistencyBytesReadMin#90662L, persistencyBytesReadMax#90663L, persistencyBytesReadMedian#90664L, persistencyRecordsReadTotal#90665L, persistencyRecordsReadMin#90666L, persistencyRecordsReadMax#90667L, persistencyRecordsReadMedian#90668L, persistencyBytesWrittenTotal#90669L, persistencyBytesWrittenMin#90670L, persistencyBytesWrittenMax#90671L, persistencyBytesWrittenMedian#90672L, persistencyRecordsWrittenTotal#90673L, persistencyRecordsWrittenMin#90674L, persistencyRecordsWrittenMax#90675L, persistencyRecordsWrittenMedian#90676L, shuffleConsumeRecordsReadTotal#90677L, shuffleConsumeRemoteBlocksFetchedTotal#90678L, shuffleConsumeLocalBlocksFetchedTotal#90679L, shuffleConsumeTotalBlocksFetchedTotal#90680L, shuffleConsumeRemoteBytesReadTotal#90681L, shuffleConsumeLocalBytesReadTotal#90682L, shuffleConsumeTotalBytesReadTotal#90683L, shuffleConsumeRemoteBytesReadToDiskTotal#90684L, shuffleConsumeFetchWaitTimeTotal#90685L, shuffleProduceBytesWrittenTotal#90686L, shuffleProduceRecordsWrittenTotal#90687L, shuffleProduceWriteTimeTotal#90688L, peakExecutionMemory#90690L, peakExecutionMemoryCliqueDuration#90691L, peakExecutionMemoryCliqueSize#90692L, rddStorageDiskSizeTotal#90694L, rddStorageMemSizeTotal#90695L, rddNumCachedPartitionsTotal#90696, rddNumPartitionsTotal#90697, numberOfExecutors#90698, replenishmentRunId#90701L, tenantId#90702, cornerstoneTenantId#90703L, marketUnit#90704, scenario#90705, activityId#90706, activityType#90707, workflowType#90708, workflowId#90709, activityAttempt#90710, gitCommitId#90712]

(39) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000002107, false, [activityType#90707], Parquet, [__partition_columns=["activityType"], path=hdlfs://2e93940d-4be8-4f12-830d-f0b8d392c03a.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/performance-metrics/10000002107], Append, [jobId, stageCount, totalTaskCount, minTaskCountPerStage, maxTaskCountPerStage, medianTaskCountPerStage, bytesSpilledToDiskSerializedTotal, bytesSpilledToDiskSerializedMin, bytesSpilledToDiskSerializedMax, bytesSpilledToDiskSerializedMedian, taskCpuTimeTotal, taskCpuTimeMin, taskCpuTimeMax, taskCpuTimeMedian, taskDeserializeCpuTimeTotal, taskDeserializeCpuTimeMin, taskDeserializeCpuTimeMax, taskDeserializeCpuTimeMedian, taskDeserializeTimeTotal, taskDeserializeTimeMin, taskDeserializeTimeMax, taskDeserializeTimeMedian, taskRunTimeTotal, taskRunTimeMin, taskRunTimeMax, ... 67 more fields]

(40) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true

SQL / DataFrame Properties

Name	Value
spark.activity.hdlfsEnabled	true
spark.activity.isolateSession	true
spark.databricks.delta.lastCommitVersionInSession	0
spark.sql.parquet.fieldId.read.enabled	true
spark.sql.parquet.fieldId.write.enabled	true
temporal.activity.id	d35da17e-0e2e-329d-95a5-3ec4da30b036
temporal.activity.type	BufferDataSnapShot