Query (id=a14e5d1e41fe27fd:64e5e49b00000000): Summary: Session ID: 194d769d3ef6e1be:8394dcf65aced399 Session Type: BEESWAX Start Time: 2017-10-23 11:58:53.196678000 End Time: 2017-10-23 11:59:16.189184000 Query Type: QUERY Query State: EXCEPTION Query Status: RPC Error: Client for vb0204.foo:22000 hits an unexpected exception: Unknown: Interrupted system call, type: N6apache6thrift9transport19TTransportExceptionE rpc send completed: true Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE (build af5087edabaa583dcda02ee8a2f07d75e9a215d6) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.193.10:57350 Default Db: tpcds_1000_parquet Sql Statement: select sum(SR_RETURN_AMT) as ctr_total_return from store_returns ,date_dim where sr_returned_date_sk = d_date_sk and d_year =2002 group by sr_customer_sk ,sr_store_sk Coordinator: vb0204.foo:22000 Query Options (set by configuration): Query Options (set by configuration and planner): MT_DOP=0 Plan: ---------------- Max Per-Host Resource Reservation: Memory=69.94MB Per-Host Resource Estimates: Memory=2.19GB F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 07:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=24B cardinality=53604747 | F02:PLAN FRAGMENT [HASH(sr_customer_sk,sr_store_sk)] hosts=14 instances=14 Per-Host Resources: mem-estimate=785.24MB mem-reservation=34.00MB 06:AGGREGATE [FINALIZE] | output: sum:merge(SR_RETURN_AMT) | group by: sr_customer_sk, sr_store_sk | mem-estimate=785.24MB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=2 row-size=24B cardinality=53604747 | 05:EXCHANGE [HASH(sr_customer_sk,sr_store_sk)] | mem-estimate=0B mem-reservation=0B | tuple-ids=2 row-size=24B cardinality=53604747 | F00:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 Per-Host Resources: mem-estimate=1.39GB mem-reservation=35.94MB 03:AGGREGATE [STREAMING] | output: sum(SR_RETURN_AMT) | group by: sr_customer_sk, sr_store_sk | mem-estimate=1.32GB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=2 row-size=24B cardinality=53604747 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: sr_returned_date_sk = d_date_sk | fk/pk conjuncts: sr_returned_date_sk = d_date_sk | runtime filters: RF000 <- d_date_sk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB | tuple-ids=0,1 row-size=24B cardinality=53604747 | |--04:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=8B cardinality=373 | | | F01:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=0B | 01:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.17MB | predicates: d_year = 2002 | stats-rows=73049 extrapolated-rows=73049 | table stats: rows=73049 size=2.17MB | column stats: all | parquet statistics predicates: d_year = 2002 | parquet dictionary predicates: d_year = 2002 | mem-estimate=32.00MB mem-reservation=0B | tuple-ids=1 row-size=8B cardinality=373 | 00:SCAN HDFS [tpcds_1000_parquet.store_returns, RANDOM] partitions=2004/2004 files=2004 size=18.74GB runtime filters: RF000 -> sr_returned_date_sk stats-rows=287999764 extrapolated-rows=unavailable table stats: rows=287999764 size=unavailable column stats: all mem-estimate=72.00MB mem-reservation=0B tuple-ids=0 row-size=16B cardinality=287999764 ---------------- Estimated Per-Host Mem: 2349636320 Per Host Min Reservation: vb0204.foo:22000(69.94 MB) vb0206.foo:22000(69.94 MB) vb0208.foo:22000(69.94 MB) vb0212.foo:22000(69.94 MB) vb0214.foo:22000(69.94 MB) vb0216.foo:22000(69.94 MB) vb0218.foo:22000(69.94 MB) vb0220.foo:22000(69.94 MB) vb0222.foo:22000(69.94 MB) vb0224.foo:22000(69.94 MB) vb0228.foo:22000(69.94 MB) vb0230.foo:22000(69.94 MB) vb0232.foo:22000(69.94 MB) vb0234.foo:22000(69.94 MB) Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------------- 07:EXCHANGE 1 21s995ms 21s995ms 1.02K 53.60M 0 0 UNPARTITIONED 06:AGGREGATE 14 1s300ms 9s303ms 21.50K 53.60M 228.06 MB 785.24 MB FINALIZE 05:EXCHANGE 14 16s134ms 20s621ms 50.21M 53.60M 0 0 HASH(sr_customer_sk,sr_store_sk) 03:AGGREGATE 14 6s939ms 16s406ms 54.57M 53.60M 160.08 MB 1.32 GB STREAMING 02:HASH JOIN 14 235.378ms 435.166ms 55.59M 53.60M 1.99 MB 1.94 MB INNER JOIN, BROADCAST |--04:EXCHANGE 14 138.718us 1.432ms 365 373 0 0 BROADCAST | 01:SCAN HDFS 1 4.490ms 4.490ms 365 373 838.28 KB 32.00 MB tpcds_1000_parquet.date_dim 00:SCAN HDFS 14 484.554ms 969.583ms 55.59M 288.00M 51.60 MB 72.00 MB tpcds_1000_parquet.store_returns Errors: Planner Timeline: 256.970ms - Analysis finished: 32.464ms (32.464ms) - Equivalence classes computed: 32.947ms (483.239us) - Single node plan created: 222.409ms (189.462ms) - Runtime filters computed: 222.805ms (395.639us) - Distributed plan created: 223.644ms (838.990us) - Lineage info computed: 224.048ms (404.505us) - Planning finished: 256.970ms (32.921ms) Query Timeline: 23s072ms - Query submitted: 192.515us (192.515us) - Planning finished: 381.163ms (380.971ms) - Submit for admission: 435.374ms (54.210ms) - Completed admission: 435.594ms (219.758us) - Ready to start on 14 backends: 519.966ms (84.372ms) - All 14 execution backends (30 fragment instances) started: 854.064ms (334.098ms) - Rows available: 22s701ms (21s847ms) - First row fetched: 22s732ms (31.305ms) - Unregister query: 22s992ms (259.852ms) - ComputeScanRangeAssignmentTimer: 5.675ms ImpalaServer: - ClientFetchWaitTimer: 203.011ms - RowMaterializationTimer: 87.774ms Execution Profile a14e5d1e41fe27fd:64e5e49b00000000:(Total: 22s269ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 0 2 0 LOCAL true 0 (14) N/A N/A true Backend startup latencies: Count: 14, min / max: 36ms / 121ms, 25th %-ile: 46ms, 50th %-ile: 47ms, 75th %-ile: 96ms, 90th %-ile: 115ms, 95th %-ile: 115ms, 99.9th %-ile: 121ms Per Node Peak Memory Usage: vb0204.foo:22000(313.16 MB) vb0206.foo:22000(226.33 MB) vb0208.foo:22000(228.69 MB) vb0212.foo:22000(319.70 MB) vb0214.foo:22000(219.45 MB) vb0216.foo:22000(237.69 MB) vb0218.foo:22000(325.65 MB) vb0220.foo:22000(333.57 MB) vb0222.foo:22000(228.17 MB) vb0224.foo:22000(246.60 MB) vb0228.foo:22000(224.08 MB) vb0230.foo:22000(302.83 MB) vb0232.foo:22000(233.88 MB) vb0234.foo:22000(353.74 MB) Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 0 2 0 LOCAL true 0 (14) N/A N/A true - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F03:(Total: 22s074ms, non-child: 1.228ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:22s365ms max:22s365ms mean: 22s365ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.20 MB (3353600) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 313.16 MB (328375418) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 21s995ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 21s995ms - TotalThreadsSysTime: 10.998ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 1.27K (1271) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 82.307us - OpenTime: 21s995ms - ExecTreeOpenTime: 21s995ms - PrepareTime: 78.379ms - ExecTreePrepareTime: 130.461us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 77.486ms, non-child: 77.486ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 76.534ms EXCHANGE_NODE (id=7):(Total: 21s995ms, non-child: 21s995ms, % non-child: 100.00%) - ConvertRowBatchTime: 78.849us - PeakMemoryUsage: 0 - RowsReturned: 1.02K (1024) - RowsReturnedRate: 46.00 /sec DataStreamReceiver: - BytesReceived: 1.65 MB (1728481) - DeserializeRowBatchTimer: 13.589ms - FirstBatchArrivalWaitTime: 21s995ms - PeakMemoryUsage: 3.25 MB (3412992) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Coordinator Fragment F03: Instance a14e5d1e41fe27fd:64e5e49b00000000 (host=vb0204.foo:22000):(Total: 22s074ms, non-child: 1.228ms, % non-child: 0.01%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.20 MB (3353600) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 313.16 MB (328375418) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 21s995ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 21s995ms - TotalThreadsSysTime: 10.998ms - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 1.27K (1271) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 82.307us - OpenTime: 21s995ms - ExecTreeOpenTime: 21s995ms - PrepareTime: 78.379ms - ExecTreePrepareTime: 130.461us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 77.486ms, non-child: 77.486ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 76.534ms EXCHANGE_NODE (id=7):(Total: 21s995ms, non-child: 21s995ms, % non-child: 100.00%) - ConvertRowBatchTime: 78.849us - PeakMemoryUsage: 0 - RowsReturned: 1.02K (1024) - RowsReturnedRate: 46.00 /sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 1.65 MB (1728481) - DeserializeRowBatchTimer: 13.589ms - FirstBatchArrivalWaitTime: 21s995ms - PeakMemoryUsage: 3.25 MB (3412992) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 3s177ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:22s173ms max:22s368ms mean: 22s320ms stddev:57.651ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 14 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 209.23 MB (219392399) - PeakReservation: 209.00 MB (219152384) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 269.81 MB (282915069) - RowsProduced: 1.46K (1462) - TotalNetworkReceiveTime: 15s998ms - TotalNetworkSendTime: 3.743ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 218 (218) - TotalThreadsTotalWallClockTime: 3s140ms - TotalThreadsSysTime: 869.010ms - TotalThreadsUserTime: 181.829ms - TotalThreadsVoluntaryContextSwitches: 353 (353) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 1.054ms - OpenTime: 3s140ms - ExecTreeOpenTime: 3s117ms - PrepareTime: 37.056ms - ExecTreePrepareTime: 200.705us DataStreamSender (dst_id=7):(Total: 702.165us, non-child: 702.165us, % non-child: 100.00%) - BytesSent: 23.86 KB (24435) - NetworkThroughput(*): 35.70 MB/sec - OverallThroughput: 6.90 MB/sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 1.39K (1389) - SerializeBatchTime: 356.849us - TransmitDataRPCTime: 92.496us - UncompressedRowBatchSize: 41.43 KB (42428) CodeGen:(Total: 149.061ms, non-child: 149.061ms, % non-child: 100.00%) - CodegenTime: 6.107ms - CompileTime: 34.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 79.019ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 33.908ms AGGREGATION_NODE (id=6):(Total: 3s117ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 4s243ms - GetResultsTime: 142.624us - HTResizeTime: 346.000ms - HashBuckets: 74.90K (74898) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 209.06 MB (219212178) - RowsRepartitioned: 0 (0) - RowsReturned: 1.54K (1536) - RowsReturnedRate: 70.00 /sec - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 9.479ms - CumulativeAllocationBytes: 303.14 MB (317868324) - CumulativeAllocations: 100 (100) - PeakReservation: 209.00 MB (219152384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 209.00 MB (219152384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 16s134ms, non-child: 16s134ms, % non-child: 100.00%) - ConvertRowBatchTime: 115.885ms - PeakMemoryUsage: 0 - RowsReturned: 3.59M (3586756) - RowsReturnedRate: 234.41 K/sec DataStreamReceiver: - BytesReceived: 58.69 MB (61546104) - DeserializeRowBatchTimer: 521.987ms - FirstBatchArrivalWaitTime: 531.794ms - PeakMemoryUsage: 3.20 MB (3350267) - SendersBlockedTimer: 17.613ms - SendersBlockedTotalTimer(*): 97.505ms Fragment F02: Instance a14e5d1e41fe27fd:64e5e49b0000001b (host=vb0212.foo:22000):(Total: 22s032ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 379.74 KB, 32.76 KB, 38.88 MB, 52.17 MB, 54.06 MB, 67.78 MB, 90.61 MB, 106.92 MB, 118.08 MB, 130.08 MB, 130.07 MB, 130.09 MB, 130.08 MB, 130.13 MB, 130.08 MB, 130.13 MB, 130.09 MB, 130.17 MB, 130.17 MB, 130.10 MB, 130.06 MB, 130.09 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.11 MB, 132.07 MB, 138.06 MB, 142.13 MB, 146.06 MB, 158.17 MB, 174.10 MB, 186.33 MB, 200.06 MB, 212.28 MB, 220.08 MB, 228.10 MB, 228.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.30 MB (239387581) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 319.70 MB (335225782) - RowsProduced: 8.19K (8192) - TotalNetworkReceiveTime: 12s768ms - TotalNetworkSendTime: 25.096ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.45K (1448) - TotalThreadsTotalWallClockTime: 21s988ms - TotalThreadsSysTime: 6s083ms - TotalThreadsUserTime: 1s260ms - TotalThreadsVoluntaryContextSwitches: 2.50K (2504) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 1.289ms - OpenTime: 21s988ms - ExecTreeOpenTime: 21s816ms - PrepareTime: 43.696ms - ExecTreePrepareTime: 112.726us DataStreamSender (dst_id=7):(Total: 3.355ms, non-child: 3.355ms, % non-child: 100.00%) - BytesSent: 133.44 KB (136645) - NetworkThroughput(*): 221.53 MB/sec - OverallThroughput: 38.84 MB/sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 8.19K (8192) - SerializeBatchTime: 2.629ms - TransmitDataRPCTime: 590.844us - UncompressedRowBatchSize: 232.03 KB (237600) CodeGen:(Total: 212.894ms, non-child: 212.894ms, % non-child: 100.00%) - CodegenTime: 4.161ms - CompileTime: 55.718ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 107.226ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 48.834ms AGGREGATION_NODE (id=6):(Total: 21s818ms, non-child: 8s899ms, % non-child: 40.79%) ExecOption: Codegen Enabled - BuildTime: 8s879ms - GetResultsTime: 1.247ms - HTResizeTime: 544.087ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 9.22K (9216) - RowsReturnedRate: 422.00 /sec - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 26.128ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 12s918ms, non-child: 12s918ms, % non-child: 100.00%) - ConvertRowBatchTime: 126.699ms - PeakMemoryUsage: 0 - RowsReturned: 3.90M (3895148) - RowsReturnedRate: 301.51 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 2.56 MB, 7.84 MB, 10.37 MB, 15.64 MB, 21.43 MB, 27.43 MB, 32.30 MB, 35.75 MB, 36.13 MB, 36.16 MB, 36.53 MB, 37.10 MB, 37.94 MB, 38.95 MB, 40.06 MB, 41.08 MB, 41.91 MB, 42.67 MB, 42.89 MB, 43.09 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.34 MB, 43.88 MB, 44.92 MB, 46.08 MB, 47.02 MB, 48.31 MB, 50.77 MB, 53.38 MB, 55.83 MB, 58.10 MB, 60.16 MB, 62.30 MB, 63.39 MB - BytesReceived: 63.73 MB (66823969) - DeserializeRowBatchTimer: 1s170ms - FirstBatchArrivalWaitTime: 435.039ms - PeakMemoryUsage: 3.81 MB (3998775) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000014 (host=vb0230.foo:22000):(Total: 22s028ms, non-child: 1.239ms, % non-child: 0.01%) MemoryUsage(500.000ms): 32.76 KB, 36.38 MB, 46.12 MB, 55.86 MB, 57.39 MB, 79.06 MB, 99.45 MB, 113.22 MB, 121.74 MB, 130.06 MB, 130.06 MB, 130.12 MB, 130.08 MB, 130.08 MB, 130.11 MB, 130.08 MB, 130.08 MB, 130.13 MB, 130.15 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 132.08 MB, 136.06 MB, 140.06 MB, 144.08 MB, 150.06 MB, 170.08 MB, 180.15 MB, 196.08 MB, 208.06 MB, 216.06 MB, 228.24 MB, 228.10 MB, 224.03 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.38 MB (239474041) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 302.83 MB (317537334) - RowsProduced: 12.29K (12288) - TotalNetworkReceiveTime: 12s355ms - TotalNetworkSendTime: 27.319ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 1.61K (1609) - TotalThreadsTotalWallClockTime: 21s977ms - TotalThreadsSysTime: 6s083ms - TotalThreadsUserTime: 1s284ms - TotalThreadsVoluntaryContextSwitches: 2.45K (2451) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 820.298us - OpenTime: 21s977ms - ExecTreeOpenTime: 21s821ms - PrepareTime: 50.633ms - ExecTreePrepareTime: 258.404us DataStreamSender (dst_id=7):(Total: 3.390ms, non-child: 3.390ms, % non-child: 100.00%) - BytesSent: 200.64 KB (205457) - NetworkThroughput(*): 278.28 MB/sec - OverallThroughput: 57.79 MB/sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 11.26K (11264) - SerializeBatchTime: 2.366ms - TransmitDataRPCTime: 704.103us - UncompressedRowBatchSize: 348.05 KB (356400) CodeGen:(Total: 201.308ms, non-child: 201.308ms, % non-child: 100.00%) - CodegenTime: 15.205ms - CompileTime: 54.133ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 97.796ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 48.061ms AGGREGATION_NODE (id=6):(Total: 21s822ms, non-child: 9s303ms, % non-child: 42.63%) ExecOption: Codegen Enabled - BuildTime: 9s281ms - GetResultsTime: 749.627us - HTResizeTime: 573.139ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 12.29K (12288) - RowsReturnedRate: 563.00 /sec - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 9.685ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 12s518ms, non-child: 12s518ms, % non-child: 100.00%) - ConvertRowBatchTime: 120.892ms - PeakMemoryUsage: 0 - RowsReturned: 3.90M (3900087) - RowsReturnedRate: 311.54 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 1019.61 KB, 6.15 MB, 9.64 MB, 13.60 MB, 19.62 MB, 25.74 MB, 30.79 MB, 35.15 MB, 36.16 MB, 36.16 MB, 36.43 MB, 36.92 MB, 37.69 MB, 38.69 MB, 39.74 MB, 40.80 MB, 41.71 MB, 42.55 MB, 42.90 MB, 43.09 MB, 43.29 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.33 MB, 43.73 MB, 44.64 MB, 45.71 MB, 46.76 MB, 47.81 MB, 49.86 MB, 52.48 MB, 55.05 MB, 57.42 MB, 59.53 MB, 61.83 MB, 63.16 MB - BytesReceived: 63.81 MB (66912051) - DeserializeRowBatchTimer: 935.698ms - FirstBatchArrivalWaitTime: 460.600ms - PeakMemoryUsage: 11.39 MB (11947056) - SendersBlockedTimer: 246.583ms - SendersBlockedTotalTimer(*): 1s365ms Instance a14e5d1e41fe27fd:64e5e49b00000013 (host=vb0204.foo:22000):(Total: 87.831ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 34.08 MB, 42.09 MB, 51.60 MB, 63.31 MB, 76.44 MB, 94.85 MB, 110.49 MB, 124.45 MB, 130.06 MB, 130.06 MB, 130.11 MB, 130.08 MB, 130.15 MB, 130.08 MB, 130.09 MB, 130.08 MB, 130.13 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.09 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 134.06 MB, 140.06 MB, 144.06 MB, 148.08 MB, 164.06 MB, 180.17 MB, 192.08 MB, 204.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 208.40 MB (218524136) - PeakReservation: 208.00 MB (218103808) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 313.16 MB (328375418) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 11s641ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 87.706ms - ExecTreePrepareTime: 253.434us DataStreamSender (dst_id=7):(Total: 367.772us, non-child: 367.772us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 242.961ms, non-child: 242.961ms, % non-child: 100.00%) - CodegenTime: 12.119ms - CompileTime: 55.474ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 101.991ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 82.744ms AGGREGATION_NODE (id=6):(Total: 251.984us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 8s020ms - GetResultsTime: 0.000ns - HTResizeTime: 442.425ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 208.06 MB (218163310) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 7.774ms - CumulativeAllocationBytes: 298.00 MB (312475648) - CumulativeAllocations: 100 (100) - PeakReservation: 208.00 MB (218103808) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 208.00 MB (218103808) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 11s800ms, non-child: 11s800ms, % non-child: 100.00%) - ConvertRowBatchTime: 116.213ms - PeakMemoryUsage: 0 - RowsReturned: 3.50M (3500032) - RowsReturnedRate: 296.60 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 460.55 KB, 4.95 MB, 9.17 MB, 12.32 MB, 18.30 MB, 24.20 MB, 29.68 MB, 34.41 MB, 36.11 MB, 36.11 MB, 36.27 MB, 36.74 MB, 37.45 MB, 38.43 MB, 39.41 MB, 40.51 MB, 41.49 MB, 42.31 MB, 42.82 MB, 42.99 MB, 43.20 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.28 MB, 43.56 MB, 44.33 MB, 45.42 MB, 46.46 MB, 47.46 MB, 49.27 MB, 51.85 MB, 54.46 MB, 56.85 MB - BytesReceived: 57.31 MB (60096592) - DeserializeRowBatchTimer: 1s013ms - FirstBatchArrivalWaitTime: 461.207ms - PeakMemoryUsage: 6.12 MB (6419655) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b0000001a (host=vb0218.foo:22000):(Total: 61.993ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 31.24 KB, 32.76 KB, 38.58 MB, 52.09 MB, 52.21 MB, 71.82 MB, 87.60 MB, 108.03 MB, 116.60 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.12 MB, 130.18 MB, 130.11 MB, 130.11 MB, 130.15 MB, 130.15 MB, 130.06 MB, 130.06 MB, 130.09 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.11 MB, 132.19 MB, 138.06 MB, 142.06 MB, 146.08 MB, 158.06 MB, 174.28 MB, 186.10 MB, 200.06 MB, 212.39 MB, 220.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.38 MB (239474041) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 325.65 MB (341471738) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 11s776ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 61.709ms - ExecTreePrepareTime: 470.483us DataStreamSender (dst_id=7):(Total: 428.754us, non-child: 428.754us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 310.297ms, non-child: 310.297ms, % non-child: 100.00%) - CodegenTime: 18.997ms - CompileTime: 72.403ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 189.598ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 46.757ms AGGREGATION_NODE (id=6):(Total: 468.998us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 8s818ms - GetResultsTime: 0.000ns - HTResizeTime: 489.261ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 41.605ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 11s918ms, non-child: 11s918ms, % non-child: 100.00%) - ConvertRowBatchTime: 120.663ms - PeakMemoryUsage: 0 - RowsReturned: 3.79M (3790798) - RowsReturnedRate: 318.07 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 2.64 MB, 7.90 MB, 10.49 MB, 15.96 MB, 21.81 MB, 27.75 MB, 32.49 MB, 35.84 MB, 36.19 MB, 36.23 MB, 36.60 MB, 37.20 MB, 38.07 MB, 39.04 MB, 40.16 MB, 41.19 MB, 42.03 MB, 42.78 MB, 42.98 MB, 43.18 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.35 MB, 43.40 MB, 43.92 MB, 44.97 MB, 46.10 MB, 47.04 MB, 48.27 MB, 50.71 MB, 53.25 MB, 55.75 MB, 58.08 MB, 60.15 MB - BytesReceived: 62.02 MB (65036157) - DeserializeRowBatchTimer: 1s019ms - FirstBatchArrivalWaitTime: 313.258ms - PeakMemoryUsage: 7.79 MB (8170470) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000015 (host=vb0234.foo:22000):(Total: 58.787ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 23.24 KB, 32.76 KB, 39.37 MB, 53.66 MB, 54.08 MB, 76.40 MB, 92.61 MB, 108.39 MB, 122.06 MB, 130.08 MB, 130.06 MB, 130.10 MB, 130.08 MB, 130.06 MB, 130.11 MB, 130.20 MB, 130.11 MB, 130.16 MB, 130.13 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 134.06 MB, 138.08 MB, 142.09 MB, 146.06 MB, 158.44 MB, 174.12 MB, 186.36 MB, 200.10 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 212.36 MB (222675210) - PeakReservation: 212.00 MB (222298112) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 353.74 MB (370923566) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 11s846ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.646ms - ExecTreePrepareTime: 236.478us DataStreamSender (dst_id=7):(Total: 314.840us, non-child: 314.840us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 220.656ms, non-child: 220.656ms, % non-child: 100.00%) - CodegenTime: 5.569ms - CompileTime: 45.493ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 118.386ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 54.005ms AGGREGATION_NODE (id=6):(Total: 235.218us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 7s870ms - GetResultsTime: 0.000ns - HTResizeTime: 473.143ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 212.06 MB (222357614) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 25.596ms - CumulativeAllocationBytes: 306.00 MB (320864256) - CumulativeAllocations: 101 (101) - PeakReservation: 212.00 MB (222298112) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 212.00 MB (222298112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 11s968ms, non-child: 11s968ms, % non-child: 100.00%) - ConvertRowBatchTime: 104.283ms - PeakMemoryUsage: 0 - RowsReturned: 3.55M (3548160) - RowsReturnedRate: 296.45 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 3.35 MB, 8.29 MB, 10.74 MB, 16.39 MB, 22.40 MB, 28.22 MB, 33.06 MB, 35.90 MB, 36.12 MB, 36.20 MB, 36.57 MB, 37.18 MB, 38.12 MB, 39.10 MB, 40.17 MB, 41.19 MB, 42.03 MB, 42.76 MB, 42.94 MB, 43.14 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.38 MB, 44.02 MB, 45.03 MB, 46.16 MB, 47.10 MB, 48.46 MB, 50.87 MB, 53.56 MB, 55.88 MB - BytesReceived: 58.13 MB (60950170) - DeserializeRowBatchTimer: 754.023ms - FirstBatchArrivalWaitTime: 318.147ms - PeakMemoryUsage: 3.85 MB (4042005) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000019 (host=vb0220.foo:22000):(Total: 52.279ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 36.16 MB, 45.37 MB, 54.19 MB, 61.10 MB, 82.24 MB, 98.59 MB, 114.66 MB, 125.09 MB, 130.07 MB, 130.07 MB, 130.11 MB, 130.06 MB, 130.11 MB, 130.17 MB, 130.22 MB, 130.12 MB, 130.12 MB, 130.13 MB, 130.09 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 132.06 MB, 136.08 MB, 140.06 MB, 144.06 MB, 150.17 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 150.22 MB (157512193) - PeakReservation: 150.00 MB (157286400) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 317.36 MB (332780666) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 10s606ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.132ms - ExecTreePrepareTime: 133.633us DataStreamSender (dst_id=7):(Total: 204.396us, non-child: 204.396us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 233.470ms, non-child: 233.470ms, % non-child: 100.00%) - CodegenTime: 7.256ms - CompileTime: 57.154ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 126.747ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 48.273ms AGGREGATION_NODE (id=6):(Total: 132.988us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 7s082ms - GetResultsTime: 0.000ns - HTResizeTime: 250.915ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 150.06 MB (157345902) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 4.779ms - CumulativeAllocationBytes: 200.00 MB (209715200) - CumulativeAllocations: 84 (84) - PeakReservation: 150.00 MB (157286400) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 150.00 MB (157286400) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 10s741ms, non-child: 10s741ms, % non-child: 100.00%) - ConvertRowBatchTime: 94.366ms - PeakMemoryUsage: 0 - RowsReturned: 2.92M (2922496) - RowsReturnedRate: 272.08 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 1.21 MB, 6.60 MB, 9.85 MB, 14.16 MB, 20.26 MB, 26.28 MB, 31.16 MB, 35.30 MB, 36.11 MB, 36.11 MB, 36.40 MB, 36.91 MB, 37.68 MB, 38.66 MB, 39.75 MB, 40.79 MB, 41.69 MB, 42.50 MB, 42.84 MB, 43.04 MB, 43.22 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.26 MB, 43.68 MB, 44.61 MB, 45.70 MB, 46.73 MB, 47.82 MB - BytesReceived: 47.86 MB (50182751) - DeserializeRowBatchTimer: 735.566ms - FirstBatchArrivalWaitTime: 442.691ms - PeakMemoryUsage: 9.50 MB (9964515) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b0000001d (host=vb0206.foo:22000):(Total: 24.744ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 34.06 MB, 42.08 MB, 50.06 MB, 58.06 MB, 76.06 MB, 92.08 MB, 110.06 MB, 122.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.06 MB, 134.08 MB, 138.06 MB, 142.06 MB, 146.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 148.11 MB (155306966) - PeakReservation: 148.00 MB (155189248) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 226.33 MB (237320603) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17s186ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 24.713ms - ExecTreePrepareTime: 189.102us DataStreamSender (dst_id=7):(Total: 217.748us, non-child: 217.748us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 86.989ms, non-child: 86.989ms, % non-child: 100.00%) - CodegenTime: 2.879ms - CompileTime: 19.400ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 44.606ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 22.090ms AGGREGATION_NODE (id=6):(Total: 187.949us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 680.653ms - GetResultsTime: 0.000ns - HTResizeTime: 105.296ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 148.06 MB (155248750) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 1.321ms - CumulativeAllocationBytes: 198.00 MB (207618048) - CumulativeAllocations: 83 (83) - PeakReservation: 148.00 MB (155189248) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 148.00 MB (155189248) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 17s257ms, non-child: 17s257ms, % non-child: 100.00%) - ConvertRowBatchTime: 63.127ms - PeakMemoryUsage: 0 - RowsReturned: 2.91M (2908241) - RowsReturnedRate: 168.52 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 87.96 KB, 3.87 MB, 8.62 MB, 11.14 MB, 17.04 MB, 22.81 MB, 28.60 MB, 33.50 MB, 35.96 MB, 36.13 MB, 36.20 MB, 36.61 MB, 37.24 MB, 38.19 MB, 39.14 MB, 40.23 MB, 41.23 MB, 42.05 MB, 42.76 MB, 42.93 MB, 43.12 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.36 MB, 43.93 MB, 44.96 MB, 46.08 MB, 47.02 MB - BytesReceived: 47.58 MB (49893080) - DeserializeRowBatchTimer: 187.223ms - FirstBatchArrivalWaitTime: 641.994ms - PeakMemoryUsage: 253.30 KB (259380) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000018 (host=vb0222.foo:22000):(Total: 22.817ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 379.74 KB, 32.76 KB, 38.06 MB, 50.06 MB, 52.06 MB, 70.06 MB, 90.09 MB, 106.08 MB, 118.08 MB, 130.06 MB, 130.05 MB, 130.05 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.09 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 132.06 MB, 136.09 MB, 140.06 MB, 144.08 MB, 150.08 MB, 164.08 MB, 180.08 MB, 196.06 MB, 208.06 MB, 216.06 MB, 228.06 MB, 228.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.17 MB (239257891) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 228.17 MB (239257891) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20s464ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 22.785ms - ExecTreePrepareTime: 195.797us DataStreamSender (dst_id=7):(Total: 217.544us, non-child: 217.544us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 98.601ms, non-child: 98.601ms, % non-child: 100.00%) - CodegenTime: 2.756ms - CompileTime: 19.205ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 58.311ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 20.463ms AGGREGATION_NODE (id=6):(Total: 194.386us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s313ms - GetResultsTime: 0.000ns - HTResizeTime: 308.536ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239138926) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 2.106ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 20s606ms, non-child: 20s606ms, % non-child: 100.00%) - ConvertRowBatchTime: 130.392ms - PeakMemoryUsage: 0 - RowsReturned: 3.90M (3896575) - RowsReturnedRate: 189.09 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 1.58 MB, 7.04 MB, 9.95 MB, 14.44 MB, 20.63 MB, 26.65 MB, 31.47 MB, 35.46 MB, 36.17 MB, 36.17 MB, 36.48 MB, 37.00 MB, 37.79 MB, 38.77 MB, 39.80 MB, 40.86 MB, 41.74 MB, 42.57 MB, 42.89 MB, 43.08 MB, 43.28 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.69 MB, 44.58 MB, 45.62 MB, 46.65 MB, 47.68 MB, 49.60 MB, 52.20 MB, 54.77 MB, 57.16 MB, 59.29 MB, 61.52 MB, 62.98 MB - BytesReceived: 63.75 MB (66842137) - DeserializeRowBatchTimer: 228.579ms - FirstBatchArrivalWaitTime: 630.201ms - PeakMemoryUsage: 258.42 KB (264620) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000012 (host=vb0228.foo:22000):(Total: 20.812ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 379.74 KB, 32.76 KB, 38.13 MB, 50.08 MB, 52.08 MB, 66.06 MB, 86.08 MB, 106.10 MB, 118.10 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 132.08 MB, 136.08 MB, 140.06 MB, 144.06 MB, 148.06 MB, 164.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 180.18 MB (188931483) - PeakReservation: 180.00 MB (188743680) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 224.08 MB (234961350) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17s765ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 20.727ms - ExecTreePrepareTime: 195.751us DataStreamSender (dst_id=7):(Total: 222.325us, non-child: 222.325us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 82.191ms, non-child: 82.191ms, % non-child: 100.00%) - CodegenTime: 2.796ms - CompileTime: 19.433ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 43.685ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 18.192ms AGGREGATION_NODE (id=6):(Total: 194.455us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s048ms - GetResultsTime: 0.000ns - HTResizeTime: 200.584ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 180.06 MB (188803182) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 1.652ms - CumulativeAllocationBytes: 248.00 MB (260046848) - CumulativeAllocations: 93 (93) - PeakReservation: 180.00 MB (188743680) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 180.00 MB (188743680) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 17s882ms, non-child: 17s882ms, % non-child: 100.00%) - ConvertRowBatchTime: 107.351ms - PeakMemoryUsage: 0 - RowsReturned: 3.18M (3183793) - RowsReturnedRate: 178.04 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 1.44 MB, 6.78 MB, 9.88 MB, 14.27 MB, 20.31 MB, 26.38 MB, 31.31 MB, 35.39 MB, 36.17 MB, 36.17 MB, 36.46 MB, 36.96 MB, 37.74 MB, 38.73 MB, 39.73 MB, 40.80 MB, 41.73 MB, 42.53 MB, 42.88 MB, 43.08 MB, 43.27 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.65 MB, 44.51 MB, 45.59 MB, 46.63 MB, 47.63 MB, 49.50 MB - BytesReceived: 52.09 MB (54615958) - DeserializeRowBatchTimer: 186.590ms - FirstBatchArrivalWaitTime: 639.163ms - PeakMemoryUsage: 316.63 KB (324225) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000017 (host=vb0232.foo:22000):(Total: 20.763ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 36.11 MB, 50.06 MB, 52.06 MB, 64.06 MB, 84.09 MB, 100.08 MB, 114.06 MB, 130.06 MB, 130.07 MB, 130.07 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 136.06 MB, 140.06 MB, 144.06 MB, 148.06 MB, 164.06 MB, 180.06 MB, 196.06 MB, 204.08 MB, 216.06 MB, 224.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.18 MB (239263131) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 233.88 MB (245236892) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19s517ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 20.692ms - ExecTreePrepareTime: 238.117us DataStreamSender (dst_id=7):(Total: 224.346us, non-child: 224.346us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 81.922ms, non-child: 81.922ms, % non-child: 100.00%) - CodegenTime: 2.762ms - CompileTime: 19.562ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 43.415ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 18.347ms AGGREGATION_NODE (id=6):(Total: 236.931us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s280ms - GetResultsTime: 0.000ns - HTResizeTime: 303.024ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 3.357ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 19s659ms, non-child: 19s659ms, % non-child: 100.00%) - ConvertRowBatchTime: 130.288ms - PeakMemoryUsage: 0 - RowsReturned: 3.79M (3789020) - RowsReturnedRate: 192.73 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 1.28 MB, 6.64 MB, 9.81 MB, 14.09 MB, 20.21 MB, 26.14 MB, 31.18 MB, 35.31 MB, 36.16 MB, 36.16 MB, 36.45 MB, 36.96 MB, 37.74 MB, 38.70 MB, 39.72 MB, 40.81 MB, 41.71 MB, 42.52 MB, 42.88 MB, 43.06 MB, 43.26 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.31 MB, 43.63 MB, 44.50 MB, 45.57 MB, 46.60 MB, 47.58 MB, 49.43 MB, 52.07 MB, 54.66 MB, 56.99 MB, 59.15 MB, 61.41 MB - BytesReceived: 61.99 MB (65000418) - DeserializeRowBatchTimer: 215.628ms - FirstBatchArrivalWaitTime: 507.728ms - PeakMemoryUsage: 295.52 KB (302610) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b0000001c (host=vb0208.foo:22000):(Total: 20.741ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 32.76 KB, 38.06 MB, 50.06 MB, 52.08 MB, 74.12 MB, 90.08 MB, 106.08 MB, 118.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 132.06 MB, 136.10 MB, 140.06 MB, 146.06 MB, 150.08 MB, 170.06 MB, 180.06 MB, 196.06 MB, 208.08 MB, 216.08 MB, 228.06 MB, 228.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.16 MB (239241516) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 228.69 MB (239796763) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20s474ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 20.686ms - ExecTreePrepareTime: 117.806us DataStreamSender (dst_id=7):(Total: 245.043us, non-child: 245.043us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 79.789ms, non-child: 79.789ms, % non-child: 100.00%) - CodegenTime: 2.764ms - CompileTime: 17.225ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 43.259ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 18.684ms AGGREGATION_NODE (id=6):(Total: 116.843us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s311ms - GetResultsTime: 0.000ns - HTResizeTime: 299.594ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 1.991ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 20s621ms, non-child: 20s621ms, % non-child: 100.00%) - ConvertRowBatchTime: 133.871ms - PeakMemoryUsage: 0 - RowsReturned: 3.89M (3891616) - RowsReturnedRate: 188.72 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 2.01 MB, 7.34 MB, 10.15 MB, 14.92 MB, 21.00 MB, 26.95 MB, 31.76 MB, 35.54 MB, 36.13 MB, 36.13 MB, 36.46 MB, 37.02 MB, 37.83 MB, 38.82 MB, 39.87 MB, 40.89 MB, 41.76 MB, 42.58 MB, 42.87 MB, 43.06 MB, 43.25 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.28 MB, 43.69 MB, 44.63 MB, 45.69 MB, 46.71 MB, 47.78 MB, 49.75 MB, 52.37 MB, 54.96 MB, 57.31 MB, 59.41 MB, 61.66 MB, 63.03 MB - BytesReceived: 63.67 MB (66762615) - DeserializeRowBatchTimer: 222.212ms - FirstBatchArrivalWaitTime: 653.844ms - PeakMemoryUsage: 295.52 KB (302610) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000011 (host=vb0216.foo:22000):(Total: 19.239ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 23.24 KB, 32.76 KB, 36.06 MB, 50.06 MB, 52.08 MB, 68.13 MB, 86.06 MB, 102.06 MB, 114.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 136.06 MB, 140.06 MB, 144.06 MB, 148.06 MB, 164.08 MB, 180.06 MB, 196.14 MB, 204.08 MB, 216.08 MB, 224.06 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.11 MB (239193046) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 237.69 MB (249238795) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19s481ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 19.178ms - ExecTreePrepareTime: 98.304us DataStreamSender (dst_id=7):(Total: 262.211us, non-child: 262.211us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 77.595ms, non-child: 77.595ms, % non-child: 100.00%) - CodegenTime: 2.757ms - CompileTime: 16.370ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 43.520ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 17.036ms AGGREGATION_NODE (id=6):(Total: 97.605us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s310ms - GetResultsTime: 0.000ns - HTResizeTime: 298.207ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 2.763ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 19s623ms, non-child: 19s623ms, % non-child: 100.00%) - ConvertRowBatchTime: 130.401ms - PeakMemoryUsage: 0 - RowsReturned: 3.75M (3751936) - RowsReturnedRate: 191.19 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 1.09 MB, 6.41 MB, 9.76 MB, 13.87 MB, 19.86 MB, 25.92 MB, 30.92 MB, 35.20 MB, 36.16 MB, 36.16 MB, 36.40 MB, 36.93 MB, 37.68 MB, 38.67 MB, 39.66 MB, 40.74 MB, 41.66 MB, 42.49 MB, 42.86 MB, 43.05 MB, 43.24 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.60 MB, 44.42 MB, 45.51 MB, 46.53 MB, 47.52 MB, 49.39 MB, 51.99 MB, 54.57 MB, 56.93 MB, 59.07 MB, 61.32 MB - BytesReceived: 61.40 MB (64386998) - DeserializeRowBatchTimer: 216.303ms - FirstBatchArrivalWaitTime: 650.255ms - PeakMemoryUsage: 295.52 KB (302610) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000010 (host=vb0214.foo:22000):(Total: 18.262ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 36.08 MB, 42.11 MB, 50.08 MB, 66.08 MB, 84.06 MB, 100.09 MB, 114.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.09 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 134.06 MB, 140.08 MB, 144.08 MB, 148.06 MB, 164.06 MB, 180.06 MB, 192.08 MB, 204.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 204.12 MB (214032462) - PeakReservation: 204.00 MB (213909504) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 219.45 MB (230108520) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 18s587ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 18.196ms - ExecTreePrepareTime: 190.145us DataStreamSender (dst_id=7):(Total: 220.738us, non-child: 220.738us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 78.888ms, non-child: 78.888ms, % non-child: 100.00%) - CodegenTime: 2.700ms - CompileTime: 18.559ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 43.825ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 15.940ms AGGREGATION_NODE (id=6):(Total: 188.819us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s218ms - GetResultsTime: 0.000ns - HTResizeTime: 252.937ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 204.06 MB (213969006) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 1.701ms - CumulativeAllocationBytes: 290.00 MB (304087040) - CumulativeAllocations: 99 (99) - PeakReservation: 204.00 MB (213909504) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 204.00 MB (213909504) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 18s715ms, non-child: 18s715ms, % non-child: 100.00%) - ConvertRowBatchTime: 117.550ms - PeakMemoryUsage: 0 - RowsReturned: 3.48M (3483106) - RowsReturnedRate: 186.10 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 789.80 KB, 5.71 MB, 9.43 MB, 13.00 MB, 19.08 MB, 25.12 MB, 30.27 MB, 34.87 MB, 36.14 MB, 36.14 MB, 36.34 MB, 36.81 MB, 37.54 MB, 38.51 MB, 39.51 MB, 40.59 MB, 41.53 MB, 42.34 MB, 42.81 MB, 43.00 MB, 43.19 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.27 MB, 43.53 MB, 44.29 MB, 45.36 MB, 46.41 MB, 47.38 MB, 49.12 MB, 51.60 MB, 54.27 MB, 56.62 MB - BytesReceived: 56.98 MB (59749979) - DeserializeRowBatchTimer: 202.283ms - FirstBatchArrivalWaitTime: 647.496ms - PeakMemoryUsage: 316.63 KB (324225) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance a14e5d1e41fe27fd:64e5e49b00000016 (host=vb0224.foo:22000):(Total: 17.327ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 32.76 KB, 36.06 MB, 42.06 MB, 50.06 MB, 66.24 MB, 80.08 MB, 100.11 MB, 114.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.06 MB, 130.06 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.08 MB, 130.06 MB, 134.08 MB, 140.06 MB, 144.06 MB, 148.08 MB, 164.08 MB, 180.06 MB, 192.08 MB, 204.06 MB, 216.06 MB, 224.08 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 228.14 MB (239219901) - PeakReservation: 228.00 MB (239075328) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 246.60 MB (258575652) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19s508ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 17.285ms - ExecTreePrepareTime: 119.695us DataStreamSender (dst_id=7):(Total: 158.613us, non-child: 158.613us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 5.12 KB (5240) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 79.301ms, non-child: 79.301ms, % non-child: 100.00%) - CodegenTime: 2.770ms - CompileTime: 19.515ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 37 (37) - NumInstructions: 697 (697) - OptimizationTime: 43.905ms - PeakMemoryUsage: 348.50 KB (356864) - PrepareTime: 15.289ms AGGREGATION_NODE (id=6):(Total: 119.053us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 1s284ms - GetResultsTime: 0.000ns - HTResizeTime: 302.851ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.06 MB (239134830) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) Buffer pool: - AllocTime: 2.240ms - CumulativeAllocationBytes: 338.00 MB (354418688) - CumulativeAllocations: 105 (105) - PeakReservation: 228.00 MB (239075328) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 228.00 MB (239075328) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=5):(Total: 19s647ms, non-child: 19s647ms, % non-child: 100.00%) - ConvertRowBatchTime: 126.292ms - PeakMemoryUsage: 0 - RowsReturned: 3.75M (3753576) - RowsReturnedRate: 191.04 K/sec DataStreamReceiver: BytesReceived(500.000ms): 0, 724.74 KB, 5.64 MB, 9.41 MB, 13.00 MB, 19.07 MB, 25.07 MB, 30.24 MB, 34.82 MB, 36.13 MB, 36.13 MB, 36.35 MB, 36.81 MB, 37.53 MB, 38.49 MB, 39.49 MB, 40.56 MB, 41.51 MB, 42.34 MB, 42.83 MB, 43.00 MB, 43.20 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.29 MB, 43.55 MB, 44.31 MB, 45.37 MB, 46.40 MB, 47.37 MB, 49.12 MB, 51.58 MB, 54.26 MB, 56.60 MB, 58.74 MB, 60.93 MB - BytesReceived: 61.41 MB (64392587) - DeserializeRowBatchTimer: 220.877ms - FirstBatchArrivalWaitTime: 643.497ms - PeakMemoryUsage: 274.41 KB (280995) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 11s400ms, non-child: 1s866ms, % non-child: 16.37%) split sizes: min: 1.31 GB, max: 1.40 GB, avg: 1.34 GB, stddev: 33.03 MB completion times: min:3s837ms max:21s928ms mean: 11s413ms stddev:8s150ms execution rates: min:62.62 MB/sec max:355.40 MB/sec mean:207.94 MB/sec stddev:123.89 MB/sec num instances: 14 - AverageThreadTokens: 13.90 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 175.59 MB (184118075) - PeakReservation: 157.65 MB (165309878) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 270.64 MB (283783605) - RowsProduced: 3.90M (3897580) - TotalNetworkReceiveTime: 15.569us - TotalNetworkSendTime: 1s236ms - TotalStorageWaitTime: 4s030ms - TotalThreadsInvoluntaryContextSwitches: 9.60K (9602) - TotalThreadsTotalWallClockTime: 3m6s - TotalThreadsSysTime: 37s937ms - TotalThreadsUserTime: 9s652ms - TotalThreadsVoluntaryContextSwitches: 517.58K (517579) Fragment Instance Lifecycle Timings: - ExecTime: 10s665ms - ExecTreeExecTime: 7s533ms - OpenTime: 666.121ms - ExecTreeOpenTime: 122.493ms - PrepareTime: 69.348ms - ExecTreePrepareTime: 18.994ms DataStreamSender (dst_id=5):(Total: 1s295ms, non-child: 1s295ms, % non-child: 100.00%) - BytesSent: 63.77 MB (66864214) - NetworkThroughput(*): 175.87 MB/sec - OverallThroughput: 56.78 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.90M (3897580) - SerializeBatchTime: 842.599ms - TransmitDataRPCTime: 448.194ms - UncompressedRowBatchSize: 107.82 MB (113053669) CodeGen:(Total: 580.364ms, non-child: 580.364ms, % non-child: 100.00%) - CodegenTime: 6.151ms - CompileTime: 171.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 368.459ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 39.451ms AGGREGATION_NODE (id=3):(Total: 7s659ms, non-child: 6s939ms, % non-child: 90.60%) - GetResultsTime: 158.185ms - HTResizeTime: 148.739ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 155.79 MB (163352630) - ReductionFactorEstimate: 1.87 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.04M (1044284) - RowsReturned: 3.90M (3897580) - RowsReturnedRate: 1.69 M/sec - StreamingTime: 6s769ms Buffer pool: - AllocTime: 12.194ms - CumulativeAllocationBytes: 205.43 MB (215407469) - CumulativeAllocations: 86 (86) - PeakReservation: 155.71 MB (163278262) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 155.71 MB (163278262) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 720.055ms, non-child: 235.378ms, % non-child: 32.69%) - BuildRows: 365 (365) - BuildTime: 3.041ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084388) - ProbeRows: 3.97M (3970611) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 193.514ms - RowsReturned: 3.97M (3970611) - RowsReturnedRate: 8.47 M/sec Buffer pool: - AllocTime: 132.130us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 331.720us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 268.938us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 138.718us, non-child: 138.718us, % non-child: 100.00%) - ConvertRowBatchTime: 64.397us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.95 M/sec DataStreamReceiver: - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 42.127us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 484.554ms, non-child: 484.554ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.83 - AverageScannerThreadConcurrency: 22.51 - BytesRead: 37.25 MB (39062261) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.25 MB (39062261) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.25 MB (39062261) - CachedFileHandlesHitCount: 92 (92) - CachedFileHandlesMissCount: 12 (12) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 23 (23) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.38 MB (50726864) - PerReadThreadRawHdfsThroughput: 21.90 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.246ms - RowBatchQueuePutWaitTime: 1m55s - RowsRead: 3.97M (3970611) - RowsReturned: 3.97M (3970611) - RowsReturnedRate: 23.71 M/sec - ScanRangesComplete: 143 (143) - ScannerThreadsInvoluntaryContextSwitches: 8.20K (8201) - ScannerThreadsTotalWallClockTime: 2m55s - MaterializeTupleTime(*): 1s294ms - ScannerThreadsSysTime: 33s895ms - ScannerThreadsUserTime: 6s635ms - ScannerThreadsVoluntaryContextSwitches: 516.67K (516669) - TotalRawHdfsReadTime(*): 2s148ms - TotalReadThroughput: 10.40 MB/sec Filter 0 (1.00 MB): - Files processed: 143 (143) - Files rejected: 117 (117) - Files total: 143 (143) - RowGroups processed: 3.89K (3891) - RowGroups rejected: 0 (0) - RowGroups total: 3.89K (3891) - Rows processed: 427.15K (427154) - Rows rejected: 0 (0) - Rows total: 3.97M (3970611) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Fragment F00: Instance a14e5d1e41fe27fd:64e5e49b00000007 (host=vb0234.foo:22000):(Total: 21s920ms, non-child: 1s729ms, % non-child: 7.89%) Hdfs split stats (:<# splits>/): 1:6/62.71 MB 9:10/92.55 MB 10:11/222.11 MB 5:9/93.73 MB 2:15/151.31 MB 0:12/112.93 MB 3:15/140.96 MB 6:16/151.44 MB 7:14/150.26 MB 8:18/145.65 MB 4:14/111.63 MB Filter 0 arrival: 841ms MemoryUsage(500.000ms): 130.87 KB, 1.83 MB, 59.80 MB, 97.05 MB, 101.05 MB, 113.05 MB, 117.05 MB, 117.05 MB, 117.05 MB, 115.91 MB, 118.15 MB, 118.15 MB, 132.12 MB, 145.83 MB, 144.54 MB, 144.56 MB, 144.76 MB, 141.26 MB, 135.46 MB, 133.15 MB, 131.96 MB, 129.69 MB, 161.44 MB, 159.15 MB, 159.16 MB, 157.85 MB, 155.57 MB, 155.56 MB, 153.26 MB, 153.26 MB, 147.32 MB, 144.99 MB, 145.06 MB, 143.89 MB, 143.92 MB, 141.63 MB, 139.31 MB, 153.65 MB, 161.32 MB, 131.34 MB, 111.35 MB, 81.39 MB, 51.35 MB, 35.39 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 19.30 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 165.43 MB (173461642) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 353.74 MB (370923566) - RowsProduced: 3.80M (3795174) - TotalNetworkReceiveTime: 19.709us - TotalNetworkSendTime: 988.811ms - TotalStorageWaitTime: 5s515ms - TotalThreadsInvoluntaryContextSwitches: 23.38K (23384) - TotalThreadsTotalWallClockTime: 7m3s - TotalThreadsSysTime: 1m42s - TotalThreadsUserTime: 18s670ms - TotalThreadsVoluntaryContextSwitches: 1.23M (1231201) Fragment Instance Lifecycle Timings: - ExecTime: 21s003ms - ExecTreeExecTime: 17s432ms - OpenTime: 835.389ms - ExecTreeOpenTime: 78.998ms - PrepareTime: 81.729ms - ExecTreePrepareTime: 2.451ms DataStreamSender (dst_id=5):(Total: 1s880ms, non-child: 1s880ms, % non-child: 100.00%) - BytesSent: 62.09 MB (65106722) - NetworkThroughput(*): 72.26 MB/sec - OverallThroughput: 33.02 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.80M (3795174) - SerializeBatchTime: 1s005ms - TransmitDataRPCTime: 859.291ms - UncompressedRowBatchSize: 104.98 MB (110083250) CodeGen:(Total: 802.399ms, non-child: 802.399ms, % non-child: 100.00%) - CodegenTime: 11.957ms - CompileTime: 234.508ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 517.230ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 49.750ms AGGREGATION_NODE (id=3):(Total: 17s508ms, non-child: 16s406ms, % non-child: 93.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 181.068ms - HTResizeTime: 241.551ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167841920) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.02M (1018871) - RowsReturned: 3.80M (3795174) - RowsReturnedRate: 216.76 K/sec - StreamingTime: 16s175ms Buffer pool: - AllocTime: 33.686ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 1s102ms, non-child: 350.155ms, % non-child: 31.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.145ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.87M (3866337) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 267.353ms - RowsReturned: 3.87M (3866337) - RowsReturnedRate: 3.51 M/sec Buffer pool: - AllocTime: 98.099us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 200.917us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 192.376us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 54.422us, non-child: 54.422us, % non-child: 100.00%) - ConvertRowBatchTime: 23.208us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 6.71 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 40.625us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 751.888ms, non-child: 751.888ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:6/62.71 MB 9:10/92.55 MB 10:11/222.11 MB 5:9/93.73 MB 2:15/151.31 MB 0:12/112.93 MB 3:15/140.96 MB 6:16/151.44 MB 7:14/150.26 MB 8:18/145.65 MB 4:14/111.63 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:2.778% 2:0% 3:0% 4:0% 5:2.778% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:26 PARQUET/Unknown(Skipped):114 BytesRead(500.000ms): 0, 0, 12.05 MB, 34.05 MB, 34.05 MB, 34.05 MB, 34.05 MB, 34.05 MB, 34.05 MB, 34.05 MB, 35.48 MB, 35.48 MB, 36.24 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB, 36.34 MB - FooterProcessingTime: (Avg: 82.136ms ; Min: 1.822ms ; Max: 194.230ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 22.36 - BytesRead: 36.34 MB (38101716) - BytesReadDataNodeCache: 0 - BytesReadLocal: 36.34 MB (38101716) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 36.34 MB (38101716) - CachedFileHandlesHitCount: 101 (101) - CachedFileHandlesMissCount: 3 (3) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 23 (23) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 49.06 MB (51443079) - PerReadThreadRawHdfsThroughput: 14.32 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 70.746ms - RowBatchQueuePutWaitTime: 4m9s - RowsRead: 3.87M (3866337) - RowsReturned: 3.87M (3866337) - RowsReturnedRate: 5.14 M/sec - ScanRangesComplete: 140 (140) - ScannerThreadsInvoluntaryContextSwitches: 20.39K (20395) - ScannerThreadsTotalWallClockTime: 6m41s - MaterializeTupleTime(*): 2s411ms - ScannerThreadsSysTime: 1m32s - ScannerThreadsUserTime: 15s228ms - ScannerThreadsVoluntaryContextSwitches: 1.23M (1229418) - TotalRawHdfsReadTime(*): 2s538ms - TotalReadThroughput: 1.91 MB/sec Filter 0 (1.00 MB): - Files processed: 140 (140) - Files rejected: 114 (114) - Files total: 140 (140) - RowGroups processed: 3.79K (3790) - RowGroups rejected: 0 (0) - RowGroups total: 3.79K (3790) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 3.87M (3866337) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance a14e5d1e41fe27fd:64e5e49b0000000b (host=vb0220.foo:22000):(Total: 21s661ms, non-child: 2s081ms, % non-child: 9.61%) Hdfs split stats (:<# splits>/): 0:9/86.60 MB 10:9/93.61 MB 7:14/147.67 MB 6:16/144.12 MB 3:14/98.25 MB 8:11/110.11 MB 9:19/176.10 MB 4:13/132.06 MB 1:15/129.24 MB 5:15/116.34 MB 2:12/123.02 MB Filter 0 arrival: 1s072ms MemoryUsage(500.000ms): 1.83 MB, 138.87 KB, 96.05 MB, 104.05 MB, 104.05 MB, 108.05 MB, 120.05 MB, 120.05 MB, 120.05 MB, 120.05 MB, 150.05 MB, 149.90 MB, 150.30 MB, 147.85 MB, 143.37 MB, 138.77 MB, 138.77 MB, 132.80 MB, 131.81 MB, 162.23 MB, 161.06 MB, 161.13 MB, 158.85 MB, 158.81 MB, 156.52 MB, 154.20 MB, 154.23 MB, 151.93 MB, 151.93 MB, 149.64 MB, 147.37 MB, 146.14 MB, 155.83 MB, 171.54 MB, 169.24 MB, 165.80 MB, 161.29 MB, 141.37 MB, 111.32 MB, 91.31 MB, 61.28 MB, 35.35 MB, 35.35 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.65 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 173.86 MB (182304957) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 333.57 MB (349773460) - RowsProduced: 3.99M (3992668) - TotalNetworkReceiveTime: 21.952us - TotalNetworkSendTime: 907.963ms - TotalStorageWaitTime: 1s870ms - TotalThreadsInvoluntaryContextSwitches: 24.02K (24019) - TotalThreadsTotalWallClockTime: 6m46s - TotalThreadsSysTime: 1m40s - TotalThreadsUserTime: 17s211ms - TotalThreadsVoluntaryContextSwitches: 1.18M (1177143) Fragment Instance Lifecycle Timings: - ExecTime: 20s546ms - ExecTreeExecTime: 16s650ms - OpenTime: 1s023ms - ExecTreeOpenTime: 46.067ms - PrepareTime: 90.857ms - ExecTreePrepareTime: 2.682ms DataStreamSender (dst_id=5):(Total: 1s846ms, non-child: 1s846ms, % non-child: 100.00%) - BytesSent: 65.32 MB (68495853) - NetworkThroughput(*): 94.79 MB/sec - OverallThroughput: 35.37 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.99M (3992668) - SerializeBatchTime: 1s155ms - TransmitDataRPCTime: 689.128ms - UncompressedRowBatchSize: 110.45 MB (115811784) CodeGen:(Total: 1s045ms, non-child: 1s045ms, % non-child: 100.00%) - CodegenTime: 5.913ms - CompileTime: 302.561ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 664.322ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 75.832ms AGGREGATION_NODE (id=3):(Total: 16s688ms, non-child: 15s518ms, % non-child: 92.99%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 206.830ms - HTResizeTime: 248.484ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167850112) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.04M (1037304) - RowsReturned: 3.99M (3992668) - RowsReturnedRate: 239.25 K/sec - StreamingTime: 15s261ms Buffer pool: - AllocTime: 40.405ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 1s169ms, non-child: 401.042ms, % non-child: 34.28%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.606ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 4.07M (4067007) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 301.071ms - RowsReturned: 4.07M (4067007) - RowsReturnedRate: 3.48 M/sec Buffer pool: - AllocTime: 109.801us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 190.823us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 137.043us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 52.356us, non-child: 52.356us, % non-child: 100.00%) - ConvertRowBatchTime: 16.773us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 6.97 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 39.531us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 768.934ms, non-child: 768.934ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:9/86.60 MB 10:9/93.61 MB 7:14/147.67 MB 6:16/144.12 MB 3:14/98.25 MB 8:11/110.11 MB 9:19/176.10 MB 4:13/132.06 MB 1:15/129.24 MB 5:15/116.34 MB 2:12/123.02 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:25 PARQUET/Unknown(Skipped):122 BytesRead(500.000ms): 0, 0, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 35.58 MB, 36.60 MB, 36.60 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB, 37.99 MB - FooterProcessingTime: (Avg: 16.932ms ; Min: 2.963ms ; Max: 30.161ms ; Number of samples: 25) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 22.32 - BytesRead: 37.99 MB (39833424) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.99 MB (39833424) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.99 MB (39833424) - CachedFileHandlesHitCount: 100 (100) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 50.93 MB (53409159) - PerReadThreadRawHdfsThroughput: 34.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.141ms - RowBatchQueuePutWaitTime: 3m58s - RowsRead: 4.07M (4067007) - RowsReturned: 4.07M (4067007) - RowsReturnedRate: 5.29 M/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 21.41K (21407) - ScannerThreadsTotalWallClockTime: 6m25s - MaterializeTupleTime(*): 2s891ms - ScannerThreadsSysTime: 1m30s - ScannerThreadsUserTime: 13s466ms - ScannerThreadsVoluntaryContextSwitches: 1.18M (1175456) - TotalRawHdfsReadTime(*): 1s109ms - TotalReadThroughput: 2.10 MB/sec Filter 0 (1.00 MB): - Files processed: 147 (147) - Files rejected: 122 (122) - Files total: 147 (147) - RowGroups processed: 3.98K (3984) - RowGroups rejected: 0 (0) - RowGroups total: 3.98K (3984) - Rows processed: 409.60K (409600) - Rows rejected: 0 (0) - Rows total: 4.07M (4067007) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Instance a14e5d1e41fe27fd:64e5e49b0000000c (host=vb0218.foo:22000):(Total: 21s250ms, non-child: 1s933ms, % non-child: 9.10%) Hdfs split stats (:<# splits>/): 8:8/69.96 MB 7:11/114.76 MB 10:21/219.30 MB 5:16/156.79 MB 9:16/139.89 MB 4:12/130.79 MB 6:13/134.91 MB 1:10/107.49 MB 0:12/98.44 MB 2:14/105.01 MB 3:11/79.47 MB Filter 0 arrival: 1s045ms MemoryUsage(500.000ms): 130.87 KB, 1.83 MB, 4.40 MB, 94.30 MB, 102.30 MB, 102.30 MB, 104.30 MB, 118.30 MB, 118.30 MB, 118.30 MB, 118.30 MB, 138.30 MB, 149.28 MB, 147.04 MB, 147.20 MB, 144.89 MB, 144.89 MB, 142.73 MB, 134.57 MB, 134.58 MB, 165.02 MB, 162.70 MB, 158.07 MB, 158.12 MB, 154.64 MB, 152.33 MB, 152.37 MB, 150.07 MB, 150.07 MB, 148.81 MB, 144.14 MB, 144.14 MB, 142.90 MB, 142.90 MB, 171.58 MB, 166.18 MB, 161.44 MB, 141.32 MB, 111.32 MB, 81.35 MB, 61.36 MB, 35.32 MB, 35.35 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 18.65 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 171.61 MB (179950764) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 325.65 MB (341471738) - RowsProduced: 3.91M (3907036) - TotalNetworkReceiveTime: 71.373us - TotalNetworkSendTime: 955.826ms - TotalStorageWaitTime: 2s826ms - TotalThreadsInvoluntaryContextSwitches: 25.09K (25090) - TotalThreadsTotalWallClockTime: 6m40s - TotalThreadsSysTime: 1m28s - TotalThreadsUserTime: 16s655ms - TotalThreadsVoluntaryContextSwitches: 1.05M (1048325) Fragment Instance Lifecycle Timings: - ExecTime: 20s136ms - ExecTreeExecTime: 16s350ms - OpenTime: 1s019ms - ExecTreeOpenTime: 87.259ms - PrepareTime: 93.678ms - ExecTreePrepareTime: 3.707ms DataStreamSender (dst_id=5):(Total: 1s882ms, non-child: 1s882ms, % non-child: 100.00%) - BytesSent: 63.92 MB (67023474) - NetworkThroughput(*): 89.99 MB/sec - OverallThroughput: 33.95 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.91M (3907036) - SerializeBatchTime: 1s169ms - TransmitDataRPCTime: 710.258ms - UncompressedRowBatchSize: 108.08 MB (113327936) CodeGen:(Total: 998.210ms, non-child: 998.210ms, % non-child: 100.00%) - CodegenTime: 6.599ms - CompileTime: 287.199ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 628.306ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 79.422ms AGGREGATION_NODE (id=3):(Total: 16s436ms, non-child: 15s142ms, % non-child: 92.13%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 184.570ms - HTResizeTime: 233.827ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167841920) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.02M (1021947) - RowsReturned: 3.91M (3907036) - RowsReturnedRate: 237.71 K/sec - StreamingTime: 14s904ms Buffer pool: - AllocTime: 17.207ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 1s293ms, non-child: 435.166ms, % non-child: 33.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 19.789ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.98M (3980309) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 322.985ms - RowsReturned: 3.98M (3980309) - RowsReturnedRate: 3.08 M/sec Buffer pool: - AllocTime: 633.884us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 2.271ms - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.257ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 1.432ms, non-child: 1.432ms, % non-child: 100.00%) - ConvertRowBatchTime: 677.223us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 254.84 K/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 96.002us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 857.423ms, non-child: 857.423ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:8/69.96 MB 7:11/114.76 MB 10:21/219.30 MB 5:16/156.79 MB 9:16/139.89 MB 4:12/130.79 MB 6:13/134.91 MB 1:10/107.49 MB 0:12/98.44 MB 2:14/105.01 MB 3:11/79.47 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:97.06% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:2.941% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:25 PARQUET/Unknown(Skipped):119 BytesRead(500.000ms): 0, 0, 0, 35.97 MB, 35.97 MB, 35.97 MB, 35.97 MB, 35.97 MB, 35.97 MB, 35.97 MB, 35.97 MB, 35.97 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB, 37.23 MB - FooterProcessingTime: (Avg: 35.179ms ; Min: 2.690ms ; Max: 139.279ms ; Number of samples: 25) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 22.32 - BytesRead: 37.23 MB (39038729) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.23 MB (39038729) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.23 MB (39038729) - CachedFileHandlesHitCount: 100 (100) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 50.16 MB (52601223) - PerReadThreadRawHdfsThroughput: 23.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.865ms - RowBatchQueuePutWaitTime: 4m2s - RowsRead: 3.98M (3980309) - RowsReturned: 3.98M (3980309) - RowsReturnedRate: 4.64 M/sec - ScanRangesComplete: 144 (144) - ScannerThreadsInvoluntaryContextSwitches: 22.22K (22223) - ScannerThreadsTotalWallClockTime: 6m18s - MaterializeTupleTime(*): 2s663ms - ScannerThreadsSysTime: 1m18s - ScannerThreadsUserTime: 13s150ms - ScannerThreadsVoluntaryContextSwitches: 1.05M (1046683) - TotalRawHdfsReadTime(*): 1s558ms - TotalReadThroughput: 2.06 MB/sec Filter 0 (1.00 MB): - Files processed: 144 (144) - Files rejected: 119 (119) - Files total: 144 (144) - RowGroups processed: 3.90K (3901) - RowGroups rejected: 0 (0) - RowGroups total: 3.90K (3901) - Rows processed: 409.60K (409600) - Rows rejected: 0 (0) - Rows total: 3.98M (3980309) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Instance a14e5d1e41fe27fd:64e5e49b0000000d (host=vb0212.foo:22000):(Total: 21s085ms, non-child: 1s997ms, % non-child: 9.47%) Hdfs split stats (:<# splits>/): 3:14/162.44 MB 9:12/118.65 MB 1:10/91.20 MB 5:15/163.54 MB 10:16/160.25 MB 7:15/150.29 MB 6:6/50.02 MB 0:11/77.61 MB 2:15/138.76 MB 4:15/152.34 MB 8:12/88.99 MB Filter 0 arrival: 955ms MemoryUsage(500.000ms): 138.87 KB, 1.83 MB, 57.80 MB, 94.05 MB, 102.03 MB, 102.05 MB, 112.05 MB, 118.05 MB, 118.05 MB, 118.05 MB, 115.78 MB, 138.03 MB, 146.73 MB, 146.76 MB, 147.14 MB, 145.85 MB, 143.63 MB, 136.64 MB, 134.43 MB, 129.72 MB, 163.75 MB, 161.47 MB, 161.47 MB, 159.18 MB, 154.54 MB, 153.24 MB, 150.97 MB, 148.61 MB, 146.36 MB, 146.36 MB, 146.37 MB, 145.07 MB, 143.88 MB, 141.59 MB, 139.29 MB, 165.02 MB, 161.34 MB, 131.32 MB, 101.33 MB, 81.29 MB, 51.28 MB, 35.37 MB ThreadUsage(500.000ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 19.07 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 166.63 MB (174724234) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 319.70 MB (335225782) - RowsProduced: 3.86M (3862201) - TotalNetworkReceiveTime: 9.740us - TotalNetworkSendTime: 911.564ms - TotalStorageWaitTime: 5s284ms - TotalThreadsInvoluntaryContextSwitches: 25.21K (25207) - TotalThreadsTotalWallClockTime: 6m35s - TotalThreadsSysTime: 1m29s - TotalThreadsUserTime: 17s829ms - TotalThreadsVoluntaryContextSwitches: 1.13M (1131308) Fragment Instance Lifecycle Timings: - ExecTime: 20s031ms - ExecTreeExecTime: 16s586ms - OpenTime: 990.528ms - ExecTreeOpenTime: 101.915ms - PrepareTime: 64.016ms - ExecTreePrepareTime: 1.321ms DataStreamSender (dst_id=5):(Total: 1s642ms, non-child: 1s642ms, % non-child: 100.00%) - BytesSent: 63.19 MB (66255568) - NetworkThroughput(*): 108.69 MB/sec - OverallThroughput: 38.47 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.86M (3862201) - SerializeBatchTime: 1s049ms - TransmitDataRPCTime: 581.318ms - UncompressedRowBatchSize: 106.84 MB (112027445) CodeGen:(Total: 931.306ms, non-child: 931.306ms, % non-child: 100.00%) - CodegenTime: 4.543ms - CompileTime: 293.829ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 592.524ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 44.017ms AGGREGATION_NODE (id=3):(Total: 16s514ms, non-child: 15s310ms, % non-child: 92.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 166.351ms - HTResizeTime: 237.926ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167850112) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.04M (1040359) - RowsReturned: 3.86M (3862201) - RowsReturnedRate: 233.87 K/sec - StreamingTime: 15s060ms Buffer pool: - AllocTime: 20.159ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 1s203ms, non-child: 347.394ms, % non-child: 28.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.675ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.93M (3934080) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 263.124ms - RowsReturned: 3.93M (3934080) - RowsReturnedRate: 3.27 M/sec Buffer pool: - AllocTime: 115.590us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 212.865us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 216.351us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 47.166us, non-child: 47.166us, % non-child: 100.00%) - ConvertRowBatchTime: 24.547us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 7.74 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 32.511us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 856.277ms, non-child: 856.277ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:14/162.44 MB 9:12/118.65 MB 1:10/91.20 MB 5:15/163.54 MB 10:16/160.25 MB 7:15/150.29 MB 6:6/50.02 MB 0:11/77.61 MB 2:15/138.76 MB 4:15/152.34 MB 8:12/88.99 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:97.06% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:2.941% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:25 PARQUET/Unknown(Skipped):116 BytesRead(500.000ms): 0, 0, 12.42 MB, 35.37 MB, 35.37 MB, 35.37 MB, 35.37 MB, 35.37 MB, 35.37 MB, 35.37 MB, 35.37 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB, 36.83 MB - FooterProcessingTime: (Avg: 56.625ms ; Min: 4.876ms ; Max: 259.420ms ; Number of samples: 25) - AverageHdfsReadThreadConcurrency: 0.21 - AverageScannerThreadConcurrency: 22.32 - BytesRead: 36.83 MB (38616041) - BytesReadDataNodeCache: 0 - BytesReadLocal: 36.83 MB (38616041) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 36.83 MB (38616041) - CachedFileHandlesHitCount: 99 (99) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 23 (23) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.95 MB (51329415) - PerReadThreadRawHdfsThroughput: 15.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 78.090ms - RowBatchQueuePutWaitTime: 3m57s - RowsRead: 3.93M (3934080) - RowsReturned: 3.93M (3934080) - RowsReturnedRate: 4.59 M/sec - ScanRangesComplete: 141 (141) - ScannerThreadsInvoluntaryContextSwitches: 22.35K (22347) - ScannerThreadsTotalWallClockTime: 6m14s - MaterializeTupleTime(*): 2s724ms - ScannerThreadsSysTime: 1m19s - ScannerThreadsUserTime: 14s367ms - ScannerThreadsVoluntaryContextSwitches: 1.13M (1129741) - TotalRawHdfsReadTime(*): 2s423ms - TotalReadThroughput: 2.04 MB/sec Filter 0 (1.00 MB): - Files processed: 141 (141) - Files rejected: 116 (116) - Files total: 141 (141) - RowGroups processed: 3.86K (3858) - RowGroups rejected: 0 (0) - RowGroups total: 3.86K (3858) - Rows processed: 409.60K (409600) - Rows rejected: 0 (0) - Rows total: 3.93M (3934080) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Instance a14e5d1e41fe27fd:64e5e49b00000005 (host=vb0204.foo:22000):(Total: 19s435ms, non-child: 2s481ms, % non-child: 12.77%) Hdfs split stats (:<# splits>/): 7:10/97.22 MB 0:11/112.11 MB 8:13/149.66 MB 4:15/140.58 MB 1:11/88.98 MB 10:13/110.00 MB 6:15/126.37 MB 5:15/146.62 MB 9:11/103.93 MB 2:18/172.15 MB 3:12/114.89 MB Filter 0 arrival: 928ms MemoryUsage(500.000ms): 1.83 MB, 138.87 KB, 82.40 MB, 90.41 MB, 90.41 MB, 106.41 MB, 106.41 MB, 106.41 MB, 107.39 MB, 136.37 MB, 133.07 MB, 134.67 MB, 136.57 MB, 137.73 MB, 136.40 MB, 132.69 MB, 166.21 MB, 164.91 MB, 161.33 MB, 161.30 MB, 159.03 MB, 159.05 MB, 157.87 MB, 155.59 MB, 153.11 MB, 183.08 MB, 180.81 MB, 178.55 MB, 173.88 MB, 169.26 MB, 164.80 MB, 151.32 MB, 131.39 MB, 111.34 MB, 91.33 MB, 71.33 MB, 41.35 MB, 35.28 MB ThreadUsage(500.000ms): 1, 1, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 18, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 13.53 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 183.09 MB (191988993) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 313.16 MB (328375418) - RowsProduced: 4.19M (4193313) - TotalNetworkReceiveTime: 22.821us - TotalNetworkSendTime: 1s206ms - TotalStorageWaitTime: 2s330ms - TotalThreadsInvoluntaryContextSwitches: 9.35K (9351) - TotalThreadsTotalWallClockTime: 4m19s - TotalThreadsSysTime: 43s376ms - TotalThreadsUserTime: 13s514ms - TotalThreadsVoluntaryContextSwitches: 854.42K (854417) Fragment Instance Lifecycle Timings: - ExecTime: 18s417ms - ExecTreeExecTime: 14s025ms - OpenTime: 909.800ms - ExecTreeOpenTime: 91.929ms - PrepareTime: 108.057ms - ExecTreePrepareTime: 2.713ms DataStreamSender (dst_id=5):(Total: 1s940ms, non-child: 1s940ms, % non-child: 100.00%) - BytesSent: 68.60 MB (71932150) - NetworkThroughput(*): 115.16 MB/sec - OverallThroughput: 35.35 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 4.19M (4193313) - SerializeBatchTime: 1s337ms - TransmitDataRPCTime: 595.672ms - UncompressedRowBatchSize: 116.00 MB (121631717) CodeGen:(Total: 902.172ms, non-child: 902.172ms, % non-child: 100.00%) - CodegenTime: 11.015ms - CompileTime: 290.281ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 515.244ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 93.658ms AGGREGATION_NODE (id=3):(Total: 14s111ms, non-child: 13s108ms, % non-child: 92.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 185.358ms - HTResizeTime: 203.155ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167850112) - ReductionFactorEstimate: 1.40 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.05M (1047585) - RowsReturned: 4.19M (4193313) - RowsReturnedRate: 297.15 K/sec - StreamingTime: 12s874ms Buffer pool: - AllocTime: 33.871ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 1s003ms, non-child: 332.704ms, % non-child: 33.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.058ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2088192) - ProbeRows: 4.27M (4271960) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 264.365ms - RowsReturned: 4.27M (4271960) - RowsReturnedRate: 4.26 M/sec Buffer pool: - AllocTime: 113.882us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 215.079us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 350.628us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 70.574us, non-child: 70.574us, % non-child: 100.00%) - ConvertRowBatchTime: 29.236us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 5.17 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 133.834us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 670.855ms, non-child: 670.855ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:10/97.22 MB 0:11/112.11 MB 8:13/149.66 MB 4:15/140.58 MB 1:11/88.98 MB 10:13/110.00 MB 6:15/126.37 MB 5:15/146.62 MB 9:11/103.93 MB 2:18/172.15 MB 3:12/114.89 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:89.66% 1:10.34% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:28 PARQUET/Unknown(Skipped):116 BytesRead(500.000ms): 0, 0, 24.26 MB, 24.26 MB, 24.26 MB, 24.26 MB, 24.26 MB, 24.26 MB, 25.67 MB, 26.84 MB, 27.73 MB, 28.82 MB, 32.66 MB, 34.43 MB, 36.16 MB, 39.31 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB, 40.08 MB - FooterProcessingTime: (Avg: 29.619ms ; Min: 1.827ms ; Max: 149.959ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 16.41 - BytesRead: 40.08 MB (42022177) - BytesReadDataNodeCache: 0 - BytesReadLocal: 40.08 MB (42022177) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 40.08 MB (42022177) - CachedFileHandlesHitCount: 111 (111) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 17 (17) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 38.40 MB (40266017) - PerReadThreadRawHdfsThroughput: 20.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 53.994ms - RowBatchQueuePutWaitTime: 3m - RowsRead: 4.27M (4271960) - RowsReturned: 4.27M (4271960) - RowsReturnedRate: 6.37 M/sec - ScanRangesComplete: 144 (144) - ScannerThreadsInvoluntaryContextSwitches: 7.10K (7103) - ScannerThreadsTotalWallClockTime: 4m - MaterializeTupleTime(*): 2s641ms - ScannerThreadsSysTime: 35s212ms - ScannerThreadsUserTime: 9s864ms - ScannerThreadsVoluntaryContextSwitches: 852.94K (852938) - TotalRawHdfsReadTime(*): 1s975ms - TotalReadThroughput: 2.57 MB/sec Filter 0 (1.00 MB): - Files processed: 144 (144) - Files rejected: 116 (116) - Files total: 144 (144) - RowGroups processed: 4.19K (4186) - RowGroups rejected: 0 (0) - RowGroups total: 4.19K (4186) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 4.27M (4271960) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance a14e5d1e41fe27fd:64e5e49b00000006 (host=vb0230.foo:22000):(Total: 19s258ms, non-child: 1s740ms, % non-child: 9.04%) Hdfs split stats (:<# splits>/): 9:10/98.40 MB 10:9/96.37 MB 4:7/66.25 MB 6:13/121.13 MB 3:14/115.26 MB 7:17/141.69 MB 2:11/103.41 MB 8:13/121.70 MB 5:21/194.34 MB 1:17/129.07 MB 0:17/165.12 MB Filter 0 arrival: 839ms MemoryUsage(500.000ms): 1.83 MB, 61.52 MB, 92.68 MB, 100.68 MB, 102.62 MB, 116.65 MB, 116.68 MB, 116.68 MB, 118.88 MB, 148.93 MB, 148.93 MB, 146.88 MB, 146.89 MB, 142.29 MB, 142.28 MB, 140.03 MB, 136.57 MB, 170.51 MB, 168.22 MB, 165.90 MB, 157.82 MB, 156.65 MB, 156.73 MB, 154.41 MB, 150.90 MB, 150.92 MB, 150.97 MB, 146.33 MB, 142.70 MB, 142.72 MB, 169.26 MB, 164.08 MB, 151.32 MB, 121.35 MB, 91.32 MB, 71.39 MB, 41.32 MB, 35.29 MB ThreadUsage(500.000ms): 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 19.16 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 172.77 MB (181159101) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 302.83 MB (317537334) - RowsProduced: 3.89M (3887698) - TotalNetworkReceiveTime: 18.734us - TotalNetworkSendTime: 1s033ms - TotalStorageWaitTime: 2s805ms - TotalThreadsInvoluntaryContextSwitches: 16.66K (16661) - TotalThreadsTotalWallClockTime: 5m58s - TotalThreadsSysTime: 1m13s - TotalThreadsUserTime: 15s599ms - TotalThreadsVoluntaryContextSwitches: 993.96K (993964) Fragment Instance Lifecycle Timings: - ExecTime: 18s370ms - ExecTreeExecTime: 14s686ms - OpenTime: 822.905ms - ExecTreeOpenTime: 50.978ms - PrepareTime: 65.140ms - ExecTreePrepareTime: 3.152ms DataStreamSender (dst_id=5):(Total: 1s959ms, non-child: 1s959ms, % non-child: 100.00%) - BytesSent: 63.61 MB (66695095) - NetworkThroughput(*): 91.93 MB/sec - OverallThroughput: 32.45 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.89M (3887698) - SerializeBatchTime: 1s264ms - TransmitDataRPCTime: 691.861ms - UncompressedRowBatchSize: 107.54 MB (112767018) CodeGen:(Total: 821.519ms, non-child: 821.519ms, % non-child: 100.00%) - CodegenTime: 16.205ms - CompileTime: 239.539ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 530.776ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 50.004ms AGGREGATION_NODE (id=3):(Total: 14s736ms, non-child: 13s437ms, % non-child: 91.19%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 199.009ms - HTResizeTime: 234.559ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167850112) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.02M (1015777) - RowsReturned: 3.89M (3887698) - RowsReturnedRate: 263.82 K/sec - StreamingTime: 13s160ms Buffer pool: - AllocTime: 10.815ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 1s298ms, non-child: 328.614ms, % non-child: 25.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.911ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.96M (3960759) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 257.291ms - RowsReturned: 3.96M (3960759) - RowsReturnedRate: 3.05 M/sec Buffer pool: - AllocTime: 96.596us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 243.849us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 194.973us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 61.337us, non-child: 61.337us, % non-child: 100.00%) - ConvertRowBatchTime: 27.536us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 5.95 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 56.443us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 969.583ms, non-child: 969.583ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:10/98.40 MB 10:9/96.37 MB 4:7/66.25 MB 6:13/121.13 MB 3:14/115.26 MB 7:17/141.69 MB 2:11/103.41 MB 8:13/121.70 MB 5:21/194.34 MB 1:17/129.07 MB 0:17/165.12 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:93.55% 1:3.226% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:3.226% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:26 PARQUET/Unknown(Skipped):123 BytesRead(500.000ms): 0, 12.31 MB, 32.53 MB, 32.53 MB, 33.32 MB, 33.42 MB, 33.42 MB, 33.42 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB, 37.16 MB - FooterProcessingTime: (Avg: 21.474ms ; Min: 1.717ms ; Max: 36.220ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 22.26 - BytesRead: 37.16 MB (38964239) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.16 MB (38964239) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.16 MB (38964239) - CachedFileHandlesHitCount: 104 (104) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 23 (23) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 49.81 MB (52229511) - PerReadThreadRawHdfsThroughput: 22.51 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.012ms - RowBatchQueuePutWaitTime: 3m47s - RowsRead: 3.96M (3960759) - RowsReturned: 3.96M (3960759) - RowsReturnedRate: 4.09 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 14.30K (14297) - ScannerThreadsTotalWallClockTime: 5m39s - MaterializeTupleTime(*): 2s457ms - ScannerThreadsSysTime: 1m5s - ScannerThreadsUserTime: 12s160ms - ScannerThreadsVoluntaryContextSwitches: 992.48K (992478) - TotalRawHdfsReadTime(*): 1s651ms - TotalReadThroughput: 2.31 MB/sec Filter 0 (1.00 MB): - Files processed: 149 (149) - Files rejected: 123 (123) - Files total: 149 (149) - RowGroups processed: 3.88K (3883) - RowGroups rejected: 0 (0) - RowGroups total: 3.88K (3883) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 3.96M (3960759) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance a14e5d1e41fe27fd:64e5e49b00000008 (host=vb0224.foo:22000):(Total: 4s904ms, non-child: 1s976ms, % non-child: 40.30%) Hdfs split stats (:<# splits>/): 2:6/182.94 MB 8:11/120.98 MB 7:13/122.36 MB 10:14/132.88 MB 3:13/136.09 MB 1:12/114.35 MB 0:5/45.47 MB 5:15/139.82 MB 6:11/87.91 MB 4:19/169.74 MB 9:20/180.54 MB Filter 0 arrival: 357ms MemoryUsage(500.000ms): 4.40 MB, 147.10 MB, 148.60 MB, 177.83 MB, 164.32 MB, 131.36 MB, 101.28 MB, 71.33 MB, 41.34 MB ThreadUsage(500.000ms): 25, 25, 25, 25, 1, 1, 1, 1, 1 - AverageThreadTokens: 11.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 192.50 MB (201855301) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 246.60 MB (258575652) - RowsProduced: 4.41M (4406373) - TotalNetworkReceiveTime: 6.221us - TotalNetworkSendTime: 1s594ms - TotalStorageWaitTime: 6s586ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1588) - TotalThreadsTotalWallClockTime: 52s521ms - TotalThreadsSysTime: 5s047ms - TotalThreadsUserTime: 4s409ms - TotalThreadsVoluntaryContextSwitches: 88.30K (88299) Fragment Instance Lifecycle Timings: - ExecTime: 4s324ms - ExecTreeExecTime: 1s348ms - OpenTime: 518.940ms - ExecTreeOpenTime: 225.999ms - PrepareTime: 61.510ms - ExecTreePrepareTime: 37.543ms DataStreamSender (dst_id=5):(Total: 1s008ms, non-child: 1s008ms, % non-child: 100.00%) - BytesSent: 72.09 MB (75595561) - NetworkThroughput(*): 229.51 MB/sec - OverallThroughput: 71.50 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 4.41M (4406373) - SerializeBatchTime: 691.896ms - TransmitDataRPCTime: 314.119ms - UncompressedRowBatchSize: 121.89 MB (127811753) CodeGen:(Total: 310.349ms, non-child: 310.349ms, % non-child: 100.00%) - CodegenTime: 3.364ms - CompileTime: 92.820ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 199.450ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 17.478ms AGGREGATION_NODE (id=3):(Total: 1s609ms, non-child: 1s137ms, % non-child: 70.69%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 143.515ms - HTResizeTime: 85.653ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167850112) - ReductionFactorEstimate: 1.42 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.26M (1260645) - RowsReturned: 4.41M (4406373) - RowsReturnedRate: 2.74 M/sec - StreamingTime: 1s024ms Buffer pool: - AllocTime: 3.604ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 471.833ms, non-child: 151.021ms, % non-child: 32.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.712ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 4.49M (4489065) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 142.055ms - RowsReturned: 4.49M (4489065) - RowsReturnedRate: 9.51 M/sec Buffer pool: - AllocTime: 95.588us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 178.930us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 199.703us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 30.335us, non-child: 30.335us, % non-child: 100.00%) - ConvertRowBatchTime: 14.352us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.03 M/sec DataStreamReceiver: - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 22.743us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 320.791ms, non-child: 320.791ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:6/182.94 MB 8:11/120.98 MB 7:13/122.36 MB 10:14/132.88 MB 3:13/136.09 MB 1:12/114.35 MB 0:5/45.47 MB 5:15/139.82 MB 6:11/87.91 MB 4:19/169.74 MB 9:20/180.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:20% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:28 PARQUET/Unknown(Skipped):111 BytesRead(500.000ms): 0, 36.41 MB, 41.97 MB, 41.97 MB, 41.97 MB - FooterProcessingTime: (Avg: 167.172ms ; Min: 5.135ms ; Max: 283.168ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 19.20 - BytesRead: 41.97 MB (44009296) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.97 MB (44009296) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.97 MB (44009296) - CachedFileHandlesHitCount: 84 (84) - CachedFileHandlesMissCount: 28 (28) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 51.60 MB (54102424) - PerReadThreadRawHdfsThroughput: 11.99 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 220.238ms - RowBatchQueuePutWaitTime: 32s853ms - RowsRead: 4.49M (4489065) - RowsReturned: 4.49M (4489065) - RowsReturnedRate: 13.99 M/sec - ScanRangesComplete: 139 (139) - ScannerThreadsInvoluntaryContextSwitches: 1.07K (1067) - ScannerThreadsTotalWallClockTime: 47s675ms - MaterializeTupleTime(*): 294.569ms - ScannerThreadsSysTime: 4s942ms - ScannerThreadsUserTime: 1s538ms - ScannerThreadsVoluntaryContextSwitches: 87.90K (87898) - TotalRawHdfsReadTime(*): 3s499ms - TotalReadThroughput: 16.79 MB/sec Filter 0 (1.00 MB): - Files processed: 139 (139) - Files rejected: 111 (111) - Files total: 139 (139) - RowGroups processed: 4.40K (4400) - RowGroups rejected: 0 (0) - RowGroups total: 4.40K (4400) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 4.49M (4489065) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance a14e5d1e41fe27fd:64e5e49b00000003 (host=vb0216.foo:22000):(Total: 4s563ms, non-child: 1s846ms, % non-child: 40.46%) Hdfs split stats (:<# splits>/): 8:8/77.03 MB 1:12/135.14 MB 9:19/176.54 MB 0:18/141.79 MB 2:11/107.63 MB 3:17/171.96 MB 4:15/139.80 MB 6:10/100.86 MB 5:10/82.43 MB 10:7/36.96 MB 7:17/171.40 MB Filter 0 arrival: 324ms MemoryUsage(500.000ms): 124.02 KB, 96.19 MB, 148.40 MB, 147.10 MB, 171.48 MB, 131.37 MB, 101.30 MB, 71.39 MB, 41.32 MB, 35.38 MB ThreadUsage(500.000ms): 1, 25, 25, 25, 25, 1, 1, 1, 1, 1 - AverageThreadTokens: 10.60 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 187.61 MB (196725027) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 237.69 MB (249238795) - RowsProduced: 4.20M (4202839) - TotalNetworkReceiveTime: 5.266us - TotalNetworkSendTime: 1s429ms - TotalStorageWaitTime: 2s186ms - TotalThreadsInvoluntaryContextSwitches: 1.20K (1198) - TotalThreadsTotalWallClockTime: 45s014ms - TotalThreadsSysTime: 3s871ms - TotalThreadsUserTime: 4s256ms - TotalThreadsVoluntaryContextSwitches: 92.09K (92091) Fragment Instance Lifecycle Timings: - ExecTime: 4s227ms - ExecTreeExecTime: 1s362ms - OpenTime: 309.019ms - ExecTreeOpenTime: 15.056ms - PrepareTime: 27.764ms - ExecTreePrepareTime: 1.944ms DataStreamSender (dst_id=5):(Total: 1s028ms, non-child: 1s028ms, % non-child: 100.00%) - BytesSent: 68.76 MB (72099439) - NetworkThroughput(*): 222.41 MB/sec - OverallThroughput: 66.88 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 4.20M (4202839) - SerializeBatchTime: 716.894ms - TransmitDataRPCTime: 309.156ms - UncompressedRowBatchSize: 116.26 MB (121908023) CodeGen:(Total: 312.522ms, non-child: 312.522ms, % non-child: 100.00%) - CodegenTime: 3.688ms - CompileTime: 90.974ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 202.183ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 18.780ms AGGREGATION_NODE (id=3):(Total: 1s376ms, non-child: 1s179ms, % non-child: 85.68%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 151.875ms - HTResizeTime: 84.792ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167841920) - ReductionFactorEstimate: 1.40 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.06M (1057111) - RowsReturned: 4.20M (4202839) - RowsReturnedRate: 3.05 M/sec - StreamingTime: 1s022ms Buffer pool: - AllocTime: 594.515us - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 197.170ms, non-child: 155.465ms, % non-child: 78.85%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.581ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 4.28M (4281726) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 145.323ms - RowsReturned: 4.28M (4281726) - RowsReturnedRate: 21.72 M/sec Buffer pool: - AllocTime: 80.683us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 161.256us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 196.268us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 23.649us, non-child: 23.649us, % non-child: 100.00%) - ConvertRowBatchTime: 12.788us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 15.43 M/sec DataStreamReceiver: BytesReceived(500.000ms): 0 - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 9.510us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 41.689ms, non-child: 41.689ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:8/77.03 MB 1:12/135.14 MB 9:19/176.54 MB 0:18/141.79 MB 2:11/107.63 MB 3:17/171.96 MB 4:15/139.80 MB 6:10/100.86 MB 5:10/82.43 MB 10:7/36.96 MB 7:17/171.40 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:25% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:28 PARQUET/Unknown(Skipped):116 BytesRead(500.000ms): 0, 31.17 MB, 38.59 MB, 40.16 MB, 40.16 MB - FooterProcessingTime: (Avg: 35.324ms ; Min: 829.406us ; Max: 153.216ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 40.16 MB (42110611) - BytesReadDataNodeCache: 0 - BytesReadLocal: 40.16 MB (42110611) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 40.16 MB (42110611) - CachedFileHandlesHitCount: 107 (107) - CachedFileHandlesMissCount: 5 (5) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 50.22 MB (52660632) - PerReadThreadRawHdfsThroughput: 42.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.565ms - RowBatchQueuePutWaitTime: 32s948ms - RowsRead: 4.28M (4281726) - RowsReturned: 4.28M (4281726) - RowsReturnedRate: 102.71 M/sec - ScanRangesComplete: 144 (144) - ScannerThreadsInvoluntaryContextSwitches: 667 (667) - ScannerThreadsTotalWallClockTime: 40s476ms - MaterializeTupleTime(*): 353.782ms - ScannerThreadsSysTime: 3s783ms - ScannerThreadsUserTime: 1s293ms - ScannerThreadsVoluntaryContextSwitches: 91.67K (91665) - TotalRawHdfsReadTime(*): 940.500ms - TotalReadThroughput: 16.06 MB/sec Filter 0 (1.00 MB): - Files processed: 144 (144) - Files rejected: 116 (116) - Files total: 144 (144) - RowGroups processed: 4.20K (4195) - RowGroups rejected: 0 (0) - RowGroups total: 4.20K (4195) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 4.28M (4281726) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance a14e5d1e41fe27fd:64e5e49b00000009 (host=vb0232.foo:22000):(Total: 4s546ms, non-child: 1s790ms, % non-child: 39.38%) Hdfs split stats (:<# splits>/): 5:14/127.19 MB 8:9/72.46 MB 9:17/167.58 MB 4:12/118.78 MB 3:14/138.54 MB 1:14/144.62 MB 2:12/110.15 MB 6:12/111.53 MB 0:14/97.16 MB 7:14/121.47 MB 10:17/146.56 MB Filter 0 arrival: 367ms MemoryUsage(500.000ms): 4.53 MB, 115.22 MB, 145.17 MB, 161.66 MB, 161.35 MB, 121.32 MB, 91.30 MB, 51.35 MB, 35.32 MB ThreadUsage(500.000ms): 25, 25, 25, 25, 1, 1, 1, 1, 1 - AverageThreadTokens: 11.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 175.68 MB (184209903) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 233.88 MB (245236892) - RowsProduced: 3.96M (3961165) - TotalNetworkReceiveTime: 5.877us - TotalNetworkSendTime: 1s383ms - TotalStorageWaitTime: 5s109ms - TotalThreadsInvoluntaryContextSwitches: 1.28K (1277) - TotalThreadsTotalWallClockTime: 49s123ms - TotalThreadsSysTime: 3s450ms - TotalThreadsUserTime: 4s308ms - TotalThreadsVoluntaryContextSwitches: 75.14K (75142) Fragment Instance Lifecycle Timings: - ExecTime: 3s969ms - ExecTreeExecTime: 1s279ms - OpenTime: 505.398ms - ExecTreeOpenTime: 210.527ms - PrepareTime: 71.535ms - ExecTreePrepareTime: 44.314ms DataStreamSender (dst_id=5):(Total: 909.595ms, non-child: 909.595ms, % non-child: 100.00%) - BytesSent: 64.81 MB (67954864) - NetworkThroughput(*): 246.97 MB/sec - OverallThroughput: 71.25 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.96M (3961165) - SerializeBatchTime: 644.976ms - TransmitDataRPCTime: 262.407ms - UncompressedRowBatchSize: 109.58 MB (114898001) CodeGen:(Total: 314.744ms, non-child: 314.744ms, % non-child: 100.00%) - CodegenTime: 3.483ms - CompileTime: 92.512ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 201.684ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 19.951ms AGGREGATION_NODE (id=3):(Total: 1s531ms, non-child: 1s064ms, % non-child: 69.49%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 142.628ms - HTResizeTime: 83.614ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167846016) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.03M (1026037) - RowsReturned: 3.96M (3961165) - RowsReturnedRate: 2.59 M/sec - StreamingTime: 959.851ms Buffer pool: - AllocTime: 1.620ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 467.405ms, non-child: 147.387ms, % non-child: 31.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.653ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 4.04M (4035589) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 138.606ms - RowsReturned: 4.04M (4035589) - RowsReturnedRate: 8.63 M/sec Buffer pool: - AllocTime: 100.031us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 183.414us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 184.966us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 27.339us, non-child: 27.339us, % non-child: 100.00%) - ConvertRowBatchTime: 13.781us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.35 M/sec DataStreamReceiver: - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 38.194us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 319.999ms, non-child: 319.999ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:14/127.19 MB 8:9/72.46 MB 9:17/167.58 MB 4:12/118.78 MB 3:14/138.54 MB 1:14/144.62 MB 2:12/110.15 MB 6:12/111.53 MB 0:14/97.16 MB 7:14/121.47 MB 10:17/146.56 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 28 out of 28 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:25% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:28 PARQUET/Unknown(Skipped):121 BytesRead(500.000ms): 0, 33.29 MB, 38.01 MB, 38.01 MB - FooterProcessingTime: (Avg: 151.244ms ; Min: 5.643ms ; Max: 262.888ms ; Number of samples: 28) - AverageHdfsReadThreadConcurrency: 2.75 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 38.01 MB (39858704) - BytesReadDataNodeCache: 0 - BytesReadLocal: 38.01 MB (39858704) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 38.01 MB (39858704) - CachedFileHandlesHitCount: 84 (84) - CachedFileHandlesMissCount: 28 (28) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 11 (11) - NumRowGroups: 28 (28) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 47.01 MB (49296792) - PerReadThreadRawHdfsThroughput: 13.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 205.031ms - RowBatchQueuePutWaitTime: 33s315ms - RowsRead: 4.04M (4035589) - RowsReturned: 4.04M (4035589) - RowsReturnedRate: 12.61 M/sec - ScanRangesComplete: 149 (149) - ScannerThreadsInvoluntaryContextSwitches: 810 (810) - ScannerThreadsTotalWallClockTime: 44s646ms - MaterializeTupleTime(*): 335.830ms - ScannerThreadsSysTime: 3s364ms - ScannerThreadsUserTime: 1s551ms - ScannerThreadsVoluntaryContextSwitches: 74.75K (74745) - TotalRawHdfsReadTime(*): 2s871ms - TotalReadThroughput: 19.01 MB/sec Filter 0 (1.00 MB): - Files processed: 149 (149) - Files rejected: 121 (121) - Files total: 149 (149) - RowGroups processed: 3.96K (3957) - RowGroups rejected: 0 (0) - RowGroups total: 3.96K (3957) - Rows processed: 458.75K (458752) - Rows rejected: 0 (0) - Rows total: 4.04M (4035589) - Splits processed: 28 (28) - Splits rejected: 0 (0) - Splits total: 28 (28) Instance a14e5d1e41fe27fd:64e5e49b0000000a (host=vb0222.foo:22000):(Total: 4s432ms, non-child: 1s782ms, % non-child: 40.21%) Hdfs split stats (:<# splits>/): 0:13/132.62 MB 2:11/100.54 MB 7:14/127.16 MB 1:13/137.79 MB 8:8/66.40 MB 6:9/72.00 MB 10:20/209.85 MB 9:11/88.50 MB 5:18/153.28 MB 4:19/173.54 MB 3:11/84.11 MB Filter 0 arrival: 353ms MemoryUsage(500.000ms): 130.87 KB, 4.80 MB, 147.29 MB, 144.80 MB, 158.78 MB, 141.35 MB, 101.38 MB, 71.43 MB, 35.38 MB ThreadUsage(500.000ms): 1, 25, 25, 25, 25, 1, 1, 1, 1 - AverageThreadTokens: 11.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 172.91 MB (181304764) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 223.56 MB (234424604) - RowsProduced: 3.78M (3779983) - TotalNetworkReceiveTime: 7.273us - TotalNetworkSendTime: 1s407ms - TotalStorageWaitTime: 6s133ms - TotalThreadsInvoluntaryContextSwitches: 1.33K (1331) - TotalThreadsTotalWallClockTime: 48s427ms - TotalThreadsSysTime: 3s945ms - TotalThreadsUserTime: 4s180ms - TotalThreadsVoluntaryContextSwitches: 100.58K (100579) Fragment Instance Lifecycle Timings: - ExecTime: 3s869ms - ExecTreeExecTime: 1s219ms - OpenTime: 499.872ms - ExecTreeOpenTime: 210.590ms - PrepareTime: 63.343ms - ExecTreePrepareTime: 38.353ms DataStreamSender (dst_id=5):(Total: 877.271ms, non-child: 877.271ms, % non-child: 100.00%) - BytesSent: 61.84 MB (64847572) - NetworkThroughput(*): 240.83 MB/sec - OverallThroughput: 70.50 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.78M (3779983) - SerializeBatchTime: 618.622ms - TransmitDataRPCTime: 256.790ms - UncompressedRowBatchSize: 104.56 MB (109642623) CodeGen:(Total: 307.291ms, non-child: 307.291ms, % non-child: 100.00%) - CodegenTime: 3.454ms - CompileTime: 91.102ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 197.548ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 18.020ms AGGREGATION_NODE (id=3):(Total: 1s465ms, non-child: 1s024ms, % non-child: 69.92%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 144.026ms - HTResizeTime: 86.055ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.08 MB (167854208) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.03M (1031159) - RowsReturned: 3.78M (3779983) - RowsReturnedRate: 2.58 M/sec - StreamingTime: 913.112ms Buffer pool: - AllocTime: 3.899ms - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 440.913ms, non-child: 136.216ms, % non-child: 30.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.196ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.85M (3850759) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.628ms - RowsReturned: 3.85M (3850759) - RowsReturnedRate: 8.73 M/sec Buffer pool: - AllocTime: 46.405us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 94.563us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 104.652us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 21.255us, non-child: 21.255us, % non-child: 100.00%) - ConvertRowBatchTime: 7.126us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 17.17 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 29.168us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 304.686ms, non-child: 304.686ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:13/132.62 MB 2:11/100.54 MB 7:14/127.16 MB 1:13/137.79 MB 8:8/66.40 MB 6:9/72.00 MB 10:20/209.85 MB 9:11/88.50 MB 5:18/153.28 MB 4:19/173.54 MB 3:11/84.11 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:25% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:26 PARQUET/Unknown(Skipped):121 BytesRead(500.000ms): 0, 300.00 KB, 36.20 MB, 36.20 MB, 36.20 MB - FooterProcessingTime: (Avg: 176.985ms ; Min: 4.442ms ; Max: 299.181ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 2.50 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 36.20 MB (37957235) - BytesReadDataNodeCache: 0 - BytesReadLocal: 36.20 MB (37957235) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 36.20 MB (37957235) - CachedFileHandlesHitCount: 78 (78) - CachedFileHandlesMissCount: 26 (26) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 47.98 MB (50309528) - PerReadThreadRawHdfsThroughput: 11.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 205.780ms - RowBatchQueuePutWaitTime: 30s707ms - RowsRead: 3.85M (3850759) - RowsReturned: 3.85M (3850759) - RowsReturnedRate: 12.64 M/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 920 (920) - ScannerThreadsTotalWallClockTime: 44s057ms - MaterializeTupleTime(*): 271.159ms - ScannerThreadsSysTime: 3s860ms - ScannerThreadsUserTime: 1s545ms - ScannerThreadsVoluntaryContextSwitches: 100.21K (100214) - TotalRawHdfsReadTime(*): 3s052ms - TotalReadThroughput: 14.48 MB/sec Filter 0 (1.00 MB): - Files processed: 147 (147) - Files rejected: 121 (121) - Files total: 147 (147) - RowGroups processed: 3.77K (3771) - RowGroups rejected: 0 (0) - RowGroups total: 3.77K (3771) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 3.85M (3850759) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance a14e5d1e41fe27fd:64e5e49b00000004 (host=vb0228.foo:22000):(Total: 4s374ms, non-child: 1s748ms, % non-child: 39.97%) Hdfs split stats (:<# splits>/): 4:10/94.22 MB 8:6/61.69 MB 0:10/108.83 MB 9:12/108.40 MB 2:9/97.65 MB 1:17/156.25 MB 3:8/180.86 MB 7:18/182.50 MB 10:13/117.71 MB 6:19/173.09 MB 5:14/150.21 MB Filter 0 arrival: 371ms MemoryUsage(500.000ms): 0, 4.40 MB, 145.65 MB, 142.30 MB, 162.23 MB, 141.27 MB, 101.33 MB, 61.36 MB, 35.30 MB ThreadUsage(500.000ms): 1, 25, 25, 25, 25, 1, 1, 1, 1 - AverageThreadTokens: 11.67 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 174.00 MB (182447582) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 224.08 MB (234961350) - RowsProduced: 3.73M (3725121) - TotalNetworkReceiveTime: 6.205us - TotalNetworkSendTime: 1s390ms - TotalStorageWaitTime: 5s390ms - TotalThreadsInvoluntaryContextSwitches: 1.56K (1559) - TotalThreadsTotalWallClockTime: 47s646ms - TotalThreadsSysTime: 4s431ms - TotalThreadsUserTime: 4s723ms - TotalThreadsVoluntaryContextSwitches: 135.93K (135929) Fragment Instance Lifecycle Timings: - ExecTime: 3s804ms - ExecTreeExecTime: 1s227ms - OpenTime: 492.530ms - ExecTreeOpenTime: 199.938ms - PrepareTime: 77.003ms - ExecTreePrepareTime: 47.996ms DataStreamSender (dst_id=5):(Total: 838.578ms, non-child: 838.578ms, % non-child: 100.00%) - BytesSent: 60.95 MB (63908586) - NetworkThroughput(*): 247.19 MB/sec - OverallThroughput: 72.68 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.73M (3725121) - SerializeBatchTime: 589.912ms - TransmitDataRPCTime: 246.564ms - UncompressedRowBatchSize: 103.05 MB (108051277) CodeGen:(Total: 314.478ms, non-child: 314.478ms, % non-child: 100.00%) - CodegenTime: 3.536ms - CompileTime: 91.935ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 199.960ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 21.961ms AGGREGATION_NODE (id=3):(Total: 1s472ms, non-child: 1s009ms, % non-child: 68.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 141.770ms - HTResizeTime: 85.550ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.06 MB (167832704) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.02M (1021936) - RowsReturned: 3.73M (3725121) - RowsReturnedRate: 2.53 M/sec - StreamingTime: 909.846ms Buffer pool: - AllocTime: 980.279us - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 463.174ms, non-child: 143.134ms, % non-child: 30.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.599ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.80M (3795036) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 134.557ms - RowsReturned: 3.80M (3795036) - RowsReturnedRate: 8.19 M/sec Buffer pool: - AllocTime: 97.386us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 180.752us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 181.039us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 29.808us, non-child: 29.808us, % non-child: 100.00%) - ConvertRowBatchTime: 14.141us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.25 M/sec DataStreamReceiver: - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 25.174us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 320.019ms, non-child: 320.019ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:10/94.22 MB 8:6/61.69 MB 0:10/108.83 MB 9:12/108.40 MB 2:9/97.65 MB 1:17/156.25 MB 3:8/180.86 MB 7:18/182.50 MB 10:13/117.71 MB 6:19/173.09 MB 5:14/150.21 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:75% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:25% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:26 PARQUET/Unknown(Skipped):110 BytesRead(500.000ms): 0, 0, 35.71 MB, 35.71 MB, 35.71 MB - FooterProcessingTime: (Avg: 152.893ms ; Min: 4.742ms ; Max: 235.337ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 2.50 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 35.71 MB (37446736) - BytesReadDataNodeCache: 0 - BytesReadLocal: 35.71 MB (37446736) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 35.71 MB (37446736) - CachedFileHandlesHitCount: 78 (78) - CachedFileHandlesMissCount: 26 (26) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.72 MB (51087768) - PerReadThreadRawHdfsThroughput: 12.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 195.492ms - RowBatchQueuePutWaitTime: 29s435ms - RowsRead: 3.80M (3795036) - RowsReturned: 3.80M (3795036) - RowsReturnedRate: 11.86 M/sec - ScanRangesComplete: 136 (136) - ScannerThreadsInvoluntaryContextSwitches: 1.02K (1016) - ScannerThreadsTotalWallClockTime: 43s347ms - MaterializeTupleTime(*): 293.244ms - ScannerThreadsSysTime: 4s353ms - ScannerThreadsUserTime: 2s141ms - ScannerThreadsVoluntaryContextSwitches: 135.56K (135556) - TotalRawHdfsReadTime(*): 2s820ms - TotalReadThroughput: 14.28 MB/sec Filter 0 (1.00 MB): - Files processed: 136 (136) - Files rejected: 110 (110) - Files total: 136 (136) - RowGroups processed: 3.72K (3719) - RowGroups rejected: 0 (0) - RowGroups total: 3.72K (3719) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 3.80M (3795036) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance a14e5d1e41fe27fd:64e5e49b0000000e (host=vb0208.foo:22000):(Total: 4s228ms, non-child: 1s785ms, % non-child: 42.22%) Hdfs split stats (:<# splits>/): 1:12/126.55 MB 7:11/105.87 MB 0:17/166.97 MB 9:15/156.10 MB 8:12/116.10 MB 3:13/115.21 MB 2:11/99.63 MB 4:13/105.25 MB 10:11/96.87 MB 5:14/119.97 MB 6:15/144.12 MB Filter 0 arrival: 324ms MemoryUsage(500.000ms): 1.83 MB, 119.35 MB, 148.30 MB, 172.57 MB, 151.38 MB, 121.34 MB, 81.33 MB, 51.32 MB, 35.37 MB ThreadUsage(500.000ms): 1, 25, 25, 25, 1, 1, 1, 1, 1 - AverageThreadTokens: 9.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 178.57 MB (187249101) - PeakReservation: 161.94 MB (169803776) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 228.69 MB (239796763) - RowsProduced: 3.89M (3887885) - TotalNetworkReceiveTime: 5.825us - TotalNetworkSendTime: 1s383ms - TotalStorageWaitTime: 1s471ms - TotalThreadsInvoluntaryContextSwitches: 1.15K (1149) - TotalThreadsTotalWallClockTime: 41s651ms - TotalThreadsSysTime: 2s807ms - TotalThreadsUserTime: 4s709ms - TotalThreadsVoluntaryContextSwitches: 75.98K (75980) Fragment Instance Lifecycle Timings: - ExecTime: 3s893ms - ExecTreeExecTime: 1s216ms - OpenTime: 306.791ms - ExecTreeOpenTime: 12.185ms - PrepareTime: 28.073ms - ExecTreePrepareTime: 924.850us DataStreamSender (dst_id=5):(Total: 901.789ms, non-child: 901.789ms, % non-child: 100.00%) - BytesSent: 63.61 MB (66700200) - NetworkThroughput(*): 251.06 MB/sec - OverallThroughput: 70.54 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.89M (3887885) - SerializeBatchTime: 646.092ms - TransmitDataRPCTime: 253.371ms - UncompressedRowBatchSize: 107.55 MB (112772441) CodeGen:(Total: 313.984ms, non-child: 313.984ms, % non-child: 100.00%) - CodegenTime: 3.766ms - CompileTime: 92.014ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 201.694ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 19.678ms AGGREGATION_NODE (id=3):(Total: 1s227ms, non-child: 1s056ms, % non-child: 86.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 147.189ms - HTResizeTime: 86.780ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.07 MB (167850112) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.02M (1019887) - RowsReturned: 3.89M (3887885) - RowsReturnedRate: 3.17 M/sec - StreamingTime: 904.391ms Buffer pool: - AllocTime: 460.430us - CumulativeAllocationBytes: 210.00 MB (220200960) - CumulativeAllocations: 89 (89) - PeakReservation: 160.00 MB (167772160) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 160.00 MB (167772160) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 170.476ms, non-child: 138.221ms, % non-child: 81.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.434ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.96M (3960763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 130.403ms - RowsReturned: 3.96M (3960763) - RowsReturnedRate: 23.23 M/sec Buffer pool: - AllocTime: 73.045us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 148.035us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 170.685us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 29.330us, non-child: 29.330us, % non-child: 100.00%) - ConvertRowBatchTime: 13.855us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.44 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 11.630us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 32.234ms, non-child: 32.234ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:12/126.55 MB 7:11/105.87 MB 0:17/166.97 MB 9:15/156.10 MB 8:12/116.10 MB 3:13/115.21 MB 2:11/99.63 MB 4:13/105.25 MB 10:11/96.87 MB 5:14/119.97 MB 6:15/144.12 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:26 PARQUET/Unknown(Skipped):118 BytesRead(500.000ms): 0, 35.58 MB, 37.16 MB, 37.16 MB - FooterProcessingTime: (Avg: 19.368ms ; Min: 939.180us ; Max: 54.164ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 37.16 MB (38965566) - BytesReadDataNodeCache: 0 - BytesReadLocal: 37.16 MB (38965566) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 37.16 MB (38965566) - CachedFileHandlesHitCount: 100 (100) - CachedFileHandlesMissCount: 4 (4) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 51.20 MB (53682584) - PerReadThreadRawHdfsThroughput: 56.48 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.730ms - RowBatchQueuePutWaitTime: 30s806ms - RowsRead: 3.96M (3960763) - RowsReturned: 3.96M (3960763) - RowsReturnedRate: 122.87 M/sec - ScanRangesComplete: 144 (144) - ScannerThreadsInvoluntaryContextSwitches: 734 (734) - ScannerThreadsTotalWallClockTime: 37s449ms - MaterializeTupleTime(*): 295.387ms - ScannerThreadsSysTime: 2s720ms - ScannerThreadsUserTime: 2s022ms - ScannerThreadsVoluntaryContextSwitches: 75.58K (75576) - TotalRawHdfsReadTime(*): 657.886ms - TotalReadThroughput: 18.58 MB/sec Filter 0 (1.00 MB): - Files processed: 144 (144) - Files rejected: 118 (118) - Files total: 144 (144) - RowGroups processed: 3.88K (3880) - RowGroups rejected: 0 (0) - RowGroups total: 3.88K (3880) - Rows processed: 425.98K (425984) - Rows rejected: 0 (0) - Rows total: 3.96M (3960763) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance a14e5d1e41fe27fd:64e5e49b00000002 (host=vb0214.foo:22000):(Total: 4s111ms, non-child: 1s561ms, % non-child: 37.98%) Hdfs split stats (:<# splits>/): 8:11/109.80 MB 7:10/99.96 MB 3:10/116.72 MB 4:12/106.41 MB 2:17/176.45 MB 10:15/150.83 MB 1:17/169.98 MB 5:8/56.60 MB 6:9/72.01 MB 0:17/131.91 MB 9:19/159.39 MB Filter 0 arrival: 527ms MemoryUsage(500.000ms): 138.87 KB, 113.68 MB, 141.58 MB, 133.53 MB, 121.27 MB, 81.34 MB, 49.36 MB, 35.35 MB ThreadUsage(500.000ms): 1, 25, 25, 25, 1, 1, 1, 1 - AverageThreadTokens: 10.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 167.35 MB (175481225) - PeakReservation: 131.94 MB (138346496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 219.45 MB (230108520) - RowsProduced: 3.34M (3336522) - TotalNetworkReceiveTime: 6.098us - TotalNetworkSendTime: 1s273ms - TotalStorageWaitTime: 4s967ms - TotalThreadsInvoluntaryContextSwitches: 1.28K (1282) - TotalThreadsTotalWallClockTime: 43s996ms - TotalThreadsSysTime: 4s403ms - TotalThreadsUserTime: 4s627ms - TotalThreadsVoluntaryContextSwitches: 117.45K (117454) Fragment Instance Lifecycle Timings: - ExecTime: 3s390ms - ExecTreeExecTime: 1s072ms - OpenTime: 637.026ms - ExecTreeOpenTime: 195.385ms - PrepareTime: 84.000ms - ExecTreePrepareTime: 46.502ms DataStreamSender (dst_id=5):(Total: 768.631ms, non-child: 768.631ms, % non-child: 100.00%) - BytesSent: 54.59 MB (57241947) - NetworkThroughput(*): 225.00 MB/sec - OverallThroughput: 71.02 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.34M (3336522) - SerializeBatchTime: 524.150ms - TransmitDataRPCTime: 242.625ms - UncompressedRowBatchSize: 92.30 MB (96779542) CodeGen:(Total: 469.189ms, non-child: 469.189ms, % non-child: 100.00%) - CodegenTime: 5.381ms - CompileTime: 115.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 325.153ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 27.772ms AGGREGATION_NODE (id=3):(Total: 1s312ms, non-child: 894.716ms, % non-child: 68.17%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 136.155ms - HTResizeTime: 88.116ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 130.07 MB (136388736) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.01M (1012732) - RowsReturned: 3.34M (3336522) - RowsReturnedRate: 2.54 M/sec - StreamingTime: 799.646ms Buffer pool: - AllocTime: 984.183us - CumulativeAllocationBytes: 178.00 MB (186646528) - CumulativeAllocations: 73 (73) - PeakReservation: 130.00 MB (136314880) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 130.00 MB (136314880) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 417.797ms, non-child: 116.062ms, % non-child: 27.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.625ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.40M (3398862) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 109.041ms - RowsReturned: 3.40M (3398862) - RowsReturnedRate: 8.14 M/sec Buffer pool: - AllocTime: 96.361us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 183.350us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 191.869us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 27.473us, non-child: 27.473us, % non-child: 100.00%) - ConvertRowBatchTime: 13.398us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.29 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 29.109us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 301.716ms, non-child: 301.716ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:11/109.80 MB 7:10/99.96 MB 3:10/116.72 MB 4:12/106.41 MB 2:17/176.45 MB 10:15/150.83 MB 1:17/169.98 MB 5:8/56.60 MB 6:9/72.01 MB 0:17/131.91 MB 9:19/159.39 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:24 PARQUET/Unknown(Skipped):121 BytesRead(500.000ms): 0, 32.06 MB, 32.06 MB, 32.06 MB - FooterProcessingTime: (Avg: 172.224ms ; Min: 11.111ms ; Max: 237.591ms ; Number of samples: 24) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 32.06 MB (33613376) - BytesReadDataNodeCache: 0 - BytesReadLocal: 32.06 MB (33613376) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 32.06 MB (33613376) - CachedFileHandlesHitCount: 72 (72) - CachedFileHandlesMissCount: 24 (24) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 11 (11) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 44.55 MB (46716295) - PerReadThreadRawHdfsThroughput: 11.65 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 190.617ms - RowBatchQueuePutWaitTime: 27s037ms - RowsRead: 3.40M (3398862) - RowsReturned: 3.40M (3398862) - RowsReturnedRate: 11.27 M/sec - ScanRangesComplete: 145 (145) - ScannerThreadsInvoluntaryContextSwitches: 876 (876) - ScannerThreadsTotalWallClockTime: 39s966ms - MaterializeTupleTime(*): 238.049ms - ScannerThreadsSysTime: 4s316ms - ScannerThreadsUserTime: 2s188ms - ScannerThreadsVoluntaryContextSwitches: 117.11K (117105) - TotalRawHdfsReadTime(*): 2s752ms - TotalReadThroughput: 16.03 MB/sec Filter 0 (1.00 MB): - Files processed: 145 (145) - Files rejected: 121 (121) - Files total: 145 (145) - RowGroups processed: 3.33K (3331) - RowGroups rejected: 0 (0) - RowGroups total: 3.33K (3331) - Rows processed: 393.22K (393216) - Rows rejected: 0 (0) - Rows total: 3.40M (3398862) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Instance a14e5d1e41fe27fd:64e5e49b0000000f (host=vb0206.foo:22000):(Total: 3s835ms, non-child: 1s673ms, % non-child: 43.62%) Hdfs split stats (:<# splits>/): 6:16/155.87 MB 1:8/88.15 MB 4:13/143.13 MB 2:12/139.58 MB 9:13/127.97 MB 7:10/95.01 MB 10:9/91.22 MB 0:20/217.01 MB 3:14/99.27 MB 5:13/122.79 MB 8:10/83.90 MB Filter 0 arrival: 322ms MemoryUsage(500.000ms): 138.87 KB, 116.63 MB, 143.38 MB, 164.51 MB, 113.26 MB, 73.32 MB, 41.30 MB, 35.39 MB ThreadUsage(500.000ms): 1, 25, 25, 25, 1, 1, 1, 1 - AverageThreadTokens: 10.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 176.23 MB (184790460) - PeakReservation: 131.94 MB (138346496) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 226.33 MB (237320603) - RowsProduced: 3.63M (3628151) - TotalNetworkReceiveTime: 10.876us - TotalNetworkSendTime: 1s449ms - TotalStorageWaitTime: 3s945ms - TotalThreadsInvoluntaryContextSwitches: 1.33K (1333) - TotalThreadsTotalWallClockTime: 42s172ms - TotalThreadsSysTime: 4s360ms - TotalThreadsUserTime: 4s441ms - TotalThreadsVoluntaryContextSwitches: 124.29K (124286) Fragment Instance Lifecycle Timings: - ExecTime: 3s327ms - ExecTreeExecTime: 1s016ms - OpenTime: 453.929ms - ExecTreeOpenTime: 188.078ms - PrepareTime: 54.173ms - ExecTreePrepareTime: 32.321ms DataStreamSender (dst_id=5):(Total: 645.594ms, non-child: 645.594ms, % non-child: 100.00%) - BytesSent: 59.36 MB (62241967) - NetworkThroughput(*): 226.42 MB/sec - OverallThroughput: 91.94 MB/sec - PeakMemoryUsage: 463.64 KB (474768) - RowsReturned: 3.63M (3628151) - SerializeBatchTime: 382.128ms - TransmitDataRPCTime: 262.162ms - UncompressedRowBatchSize: 100.36 MB (105238563) CodeGen:(Total: 281.666ms, non-child: 281.666ms, % non-child: 100.00%) - CodegenTime: 3.205ms - CompileTime: 82.775ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 105 (105) - NumInstructions: 3.47K (3468) - OptimizationTime: 182.353ms - PeakMemoryUsage: 1.69 MB (1775616) - PrepareTime: 15.990ms AGGREGATION_NODE (id=3):(Total: 1s235ms, non-child: 854.957ms, % non-child: 69.21%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 84.247ms - HTResizeTime: 82.291ms - HashBuckets: 4.19M (4194304) - LargestPartitionPercent: 4 (4) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 130.07 MB (136388736) - ReductionFactorEstimate: 2.00 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 1.01M (1008626) - RowsReturned: 3.63M (3628151) - RowsReturnedRate: 2.94 M/sec - StreamingTime: 798.213ms Buffer pool: - AllocTime: 2.433ms - CumulativeAllocationBytes: 178.00 MB (186646528) - CumulativeAllocations: 73 (73) - PeakReservation: 130.00 MB (136314880) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 130.00 MB (136314880) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 380.395ms, non-child: 112.712ms, % non-child: 29.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.588ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2084096) - ProbeRows: 3.70M (3696308) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 105.391ms - RowsReturned: 3.70M (3696308) - RowsReturnedRate: 9.72 M/sec Buffer pool: - AllocTime: 92.482us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 178.740us - BuildRowsPartitioned: 365 (365) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 186.698us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=4):(Total: 34.722us, non-child: 34.722us, % non-child: 100.00%) - ConvertRowBatchTime: 13.603us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.51 M/sec DataStreamReceiver: BytesReceived(500.000ms): 2.87 KB - BytesReceived: 2.87 KB (2936) - DeserializeRowBatchTimer: 25.313us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 6.85 KB (7016) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 267.663ms, non-child: 267.663ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:16/155.87 MB 1:8/88.15 MB 4:13/143.13 MB 2:12/139.58 MB 9:13/127.97 MB 7:10/95.01 MB 10:9/91.22 MB 0:20/217.01 MB 3:14/99.27 MB 5:13/122.79 MB 8:10/83.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/NONE:24 PARQUET/Unknown(Skipped):114 BytesRead(500.000ms): 0, 34.65 MB, 34.65 MB, 34.65 MB - FooterProcessingTime: (Avg: 131.096ms ; Min: 9.054ms ; Max: 187.572ms ; Number of samples: 24) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 24.00 - BytesRead: 34.65 MB (36333812) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.65 MB (36333812) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.65 MB (36333812) - CachedFileHandlesHitCount: 72 (72) - CachedFileHandlesMissCount: 24 (24) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 10 (10) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 24 (24) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.68 MB (51041671) - PerReadThreadRawHdfsThroughput: 15.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 183.152ms - RowBatchQueuePutWaitTime: 25s870ms - RowsRead: 3.70M (3696308) - RowsReturned: 3.70M (3696308) - RowsReturnedRate: 13.81 M/sec - ScanRangesComplete: 138 (138) - ScannerThreadsInvoluntaryContextSwitches: 964 (964) - ScannerThreadsTotalWallClockTime: 38s389ms - MaterializeTupleTime(*): 255.150ms - ScannerThreadsSysTime: 4s295ms - ScannerThreadsUserTime: 2s380ms - ScannerThreadsVoluntaryContextSwitches: 123.90K (123902) - TotalRawHdfsReadTime(*): 2s225ms - TotalReadThroughput: 17.33 MB/sec Filter 0 (1.00 MB): - Files processed: 138 (138) - Files rejected: 114 (114) - Files total: 138 (138) - RowGroups processed: 3.62K (3623) - RowGroups rejected: 0 (0) - RowGroups total: 3.62K (3623) - Rows processed: 393.22K (393216) - Rows rejected: 0 (0) - Rows total: 3.70M (3696308) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Averaged Fragment F01:(Total: 199.798ms, non-child: 148.802ms, % non-child: 74.48%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:202.776ms max:202.776ms mean: 202.776ms stddev:0.000ns execution rates: min:10.69 MB/sec max:10.69 MB/sec mean:10.69 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.02 MB (1070932) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 73.15 MB (76705372) - RowsProduced: 365 (365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 140.009ms - TotalStorageWaitTime: 2.132ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 185.305ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 35 (35) Fragment Instance Lifecycle Timings: - ExecTime: 152.077ms - ExecTreeExecTime: 4.123ms - OpenTime: 29.268ms - ExecTreeOpenTime: 50.196us - PrepareTime: 18.411ms - ExecTreePrepareTime: 144.879us DataStreamSender (dst_id=4):(Total: 2.043ms, non-child: 2.043ms, % non-child: 100.00%) - BytesSent: 40.14 KB (41104) - NetworkThroughput(*): 225.14 MB/sec - OverallThroughput: 19.19 MB/sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 365 (365) - SerializeBatchTime: 25.889us - TransmitDataRPCTime: 174.116us - UncompressedRowBatchSize: 64.93 KB (66486) CodeGen:(Total: 44.461ms, non-child: 44.461ms, % non-child: 100.00%) - CodegenTime: 757.980us - CompileTime: 8.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 20 (20) - NumInstructions: 319 (319) - OptimizationTime: 20.021ms - PeakMemoryUsage: 159.50 KB (163328) - PrepareTime: 15.314ms HDFS_SCAN_NODE (id=1):(Total: 4.490ms, non-child: 4.490ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.24 KB (476402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.24 KB (476402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.24 KB (476402) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 80.067us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 838.28 KB (858394) - PerReadThreadRawHdfsThroughput: 221.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3.899ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 81.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3.966ms - MaterializeTupleTime(*): 870.995us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 2.047ms - TotalReadThroughput: 0.00 /sec Fragment F01: Instance a14e5d1e41fe27fd:64e5e49b00000001 (host=vb0216.foo:22000):(Total: 199.798ms, non-child: 148.802ms, % non-child: 74.48%) Hdfs split stats (:<# splits>/): 10:1/2.17 MB MemoryUsage(500.000ms): 199.06 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.02 MB (1070932) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 73.15 MB (76705372) - RowsProduced: 365 (365) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 140.009ms - TotalStorageWaitTime: 2.132ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 185.305ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 30.995ms - TotalThreadsVoluntaryContextSwitches: 35 (35) Fragment Instance Lifecycle Timings: - ExecTime: 152.077ms - ExecTreeExecTime: 4.123ms - OpenTime: 29.268ms - ExecTreeOpenTime: 50.196us - PrepareTime: 18.411ms - ExecTreePrepareTime: 144.879us DataStreamSender (dst_id=4):(Total: 2.043ms, non-child: 2.043ms, % non-child: 100.00%) - BytesSent: 40.14 KB (41104) - NetworkThroughput(*): 225.14 MB/sec - OverallThroughput: 19.19 MB/sec - PeakMemoryUsage: 199.06 KB (203840) - RowsReturned: 365 (365) - SerializeBatchTime: 25.889us - TransmitDataRPCTime: 174.116us - UncompressedRowBatchSize: 64.93 KB (66486) CodeGen:(Total: 44.461ms, non-child: 44.461ms, % non-child: 100.00%) - CodegenTime: 757.980us - CompileTime: 8.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.84 MB (1934380) - NumFunctions: 20 (20) - NumInstructions: 319 (319) - OptimizationTime: 20.021ms - PeakMemoryUsage: 159.50 KB (163328) - PrepareTime: 15.314ms HDFS_SCAN_NODE (id=1):(Total: 4.490ms, non-child: 4.490ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/2.17 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:1 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 767.428us ; Min: 767.428us ; Max: 767.428us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.24 KB (476402) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.24 KB (476402) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.24 KB (476402) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 80.067us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 838.28 KB (858394) - PerReadThreadRawHdfsThroughput: 221.89 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3.899ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 81.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3.966ms - MaterializeTupleTime(*): 870.995us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 2.047ms - TotalReadThroughput: 0.00 /sec