Query (id=9b439fc1ee1addb7:82d4156900000000): Summary: Session ID: 3d446639ea1c1b65:9487aab9d63595a7 Session Type: BEESWAX Start Time: 2018-02-27 19:10:51.512455000 End Time: 2018-02-27 19:12:38.842598000 Query Type: QUERY Query State: EXCEPTION Query Status: Row of size 1.82 GB could not be materialized in plan node with id 14. Increase the max_row_size query option (currently 4.00 MB) to process larger rows. Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE (build f7a2d691fd653775147fc8f6d3ec9c24db38d7c0) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.193.10:43274 Default Db: tpch_300_parquet Sql Statement: with cte as (select group_concat(cast(fnv_hash(concat(o_comment, 'd')) as string)) as c1,group_concat(cast(fnv_hash(concat(o_comment, 'e')) as string)) as c2 from orders where o_orderkey <1200000000 and o_orderdate <"1993-01-01" union all select group_concat(cast(fnv_hash(concat(o_comment, 'd')) as string)) as c1,group_concat(cast(fnv_hash(concat(o_comment, 'e')) as string)) as c2 from orders where o_orderkey <1200000000 and o_orderdate <"1993-01-01"), cte2 as (select c1,c2,s_suppkey from cte , supplier) select count(*) from cte2 t1, cte2 t2 where t1.s_suppkey = t2.s_suppkey group by t1.c1 , t1.c2 , t2.c1 , t2.c2 having count(*) = 1 Coordinator: vb0204.foo:22000 Query Options (set by configuration): NUM_SCANNER_THREADS=2,MAX_ROW_SIZE=4194304 Query Options (set by configuration and planner): NUM_SCANNER_THREADS=2,MT_DOP=0,MAX_ROW_SIZE=4194304 Plan: ---------------- Max Per-Host Resource Reservation: Memory=226.00MB Per-Host Resource Estimates: Memory=1.75GB F14:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 30:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=16 row-size=72B cardinality=6000000 | F13:PLAN FRAGMENT [HASH(t1.c1,t1.c2,t2.c1,t2.c2)] hosts=9 instances=9 Per-Host Resources: mem-estimate=453.19MB mem-reservation=38.00MB 29:AGGREGATE [FINALIZE] | output: count:merge(*) | group by: t1.c1, t1.c2, t2.c1, t2.c2 | having: count(*) = 1 | mem-estimate=453.19MB mem-reservation=38.00MB spill-buffer=2.00MB | tuple-ids=16 row-size=72B cardinality=6000000 | 28:EXCHANGE [HASH(t1.c1,t1.c2,t2.c1,t2.c2)] | mem-estimate=0B mem-reservation=0B | tuple-ids=16 row-size=72B cardinality=6000000 | F12:PLAN FRAGMENT [HASH(s_suppkey)] hosts=9 instances=9 Per-Host Resources: mem-estimate=493.19MB mem-reservation=74.00MB runtime-filters-memory=2.00MB 15:AGGREGATE [STREAMING] | output: count(*) | group by: c1, c2, c1, c2 | mem-estimate=453.19MB mem-reservation=34.00MB spill-buffer=2.00MB | tuple-ids=16 row-size=72B cardinality=6000000 | 14:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: s_suppkey = s_suppkey | fk/pk conjuncts: s_suppkey = s_suppkey | runtime filters: RF000[bloom] <- s_suppkey | mem-estimate=38.00MB mem-reservation=38.00MB spill-buffer=2.00MB | tuple-ids=6,4,14,12 row-size=80B cardinality=6000000 | |--27:EXCHANGE [HASH(s_suppkey)] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=14,12 row-size=40B cardinality=6000000 | | | F06:PLAN FRAGMENT [RANDOM] hosts=9 instances=9 | Per-Host Resources: mem-estimate=40.00MB mem-reservation=8.00MB | 13:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | | mem-estimate=64B mem-reservation=0B | | tuple-ids=14,12 row-size=40B cardinality=6000000 | | | |--25:EXCHANGE [BROADCAST] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=12 row-size=32B cardinality=2 | | | | | F11:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | | Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B | | 07:UNION | | | pass-through-operands: all | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=12 row-size=32B cardinality=2 | | | | | |--24:AGGREGATE [FINALIZE] | | | | output: group_concat:merge(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat:merge(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | | | tuple-ids=11 row-size=32B cardinality=1 | | | | | | | 23:EXCHANGE [UNPARTITIONED] | | | | mem-estimate=0B mem-reservation=0B | | | | tuple-ids=11 row-size=32B cardinality=1 | | | | | | | F09:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 | | | Per-Host Resources: mem-estimate=186.00MB mem-reservation=24.00MB | | | 11:AGGREGATE | | | | output: group_concat(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | | | tuple-ids=11 row-size=32B cardinality=1 | | | | | | | 10:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | | | partitions=1/1 files=81 size=18.82GB | | | predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | | stored statistics: | | | table: rows=450000000 size=18.82GB | | | columns: all | | | extrapolated-rows=450000000 | | | parquet statistics predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | | parquet dictionary predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | | mem-estimate=176.00MB mem-reservation=24.00MB | | | tuple-ids=10 row-size=98B cardinality=45000000 | | | | | 22:AGGREGATE [FINALIZE] | | | output: group_concat:merge(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat:merge(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | | tuple-ids=9 row-size=32B cardinality=1 | | | | | 21:EXCHANGE [UNPARTITIONED] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=9 row-size=32B cardinality=1 | | | | | F07:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 | | Per-Host Resources: mem-estimate=186.00MB mem-reservation=24.00MB | | 09:AGGREGATE | | | output: group_concat(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | | tuple-ids=9 row-size=32B cardinality=1 | | | | | 08:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | stored statistics: | | table: rows=450000000 size=18.82GB | | columns: all | | extrapolated-rows=450000000 | | parquet statistics predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | parquet dictionary predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | mem-estimate=176.00MB mem-reservation=24.00MB | | tuple-ids=8 row-size=98B cardinality=45000000 | | | 12:SCAN HDFS [tpch_300_parquet.supplier, RANDOM] | partitions=1/1 files=9 size=233.61MB | stored statistics: | table: rows=3000000 size=233.61MB | columns: all | extrapolated-rows=3000000 | mem-estimate=40.00MB mem-reservation=8.00MB | tuple-ids=14 row-size=8B cardinality=3000000 | 26:EXCHANGE [HASH(s_suppkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=6,4 row-size=40B cardinality=6000000 | F00:PLAN FRAGMENT [RANDOM] hosts=9 instances=9 Per-Host Resources: mem-estimate=42.00MB mem-reservation=10.00MB runtime-filters-memory=2.00MB 06:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | mem-estimate=64B mem-reservation=0B | tuple-ids=6,4 row-size=40B cardinality=6000000 | |--20:EXCHANGE [BROADCAST] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=4 row-size=32B cardinality=2 | | | F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=10.00MB mem-reservation=0B | 00:UNION | | pass-through-operands: all | | mem-estimate=0B mem-reservation=0B | | tuple-ids=4 row-size=32B cardinality=2 | | | |--19:AGGREGATE [FINALIZE] | | | output: group_concat:merge(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat:merge(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | | tuple-ids=3 row-size=32B cardinality=1 | | | | | 18:EXCHANGE [UNPARTITIONED] | | | mem-estimate=0B mem-reservation=0B | | | tuple-ids=3 row-size=32B cardinality=1 | | | | | F03:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 | | Per-Host Resources: mem-estimate=186.00MB mem-reservation=24.00MB | | 04:AGGREGATE | | | output: group_concat(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | | tuple-ids=3 row-size=32B cardinality=1 | | | | | 03:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | | partitions=1/1 files=81 size=18.82GB | | predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | stored statistics: | | table: rows=450000000 size=18.82GB | | columns: all | | extrapolated-rows=450000000 | | parquet statistics predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | parquet dictionary predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | | mem-estimate=176.00MB mem-reservation=24.00MB | | tuple-ids=2 row-size=98B cardinality=45000000 | | | 17:AGGREGATE [FINALIZE] | | output: group_concat:merge(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat:merge(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | tuple-ids=1 row-size=32B cardinality=1 | | | 16:EXCHANGE [UNPARTITIONED] | | mem-estimate=0B mem-reservation=0B | | tuple-ids=1 row-size=32B cardinality=1 | | | F01:PLAN FRAGMENT [RANDOM] hosts=14 instances=14 | Per-Host Resources: mem-estimate=186.00MB mem-reservation=24.00MB | 02:AGGREGATE | | output: group_concat(CAST(fnv_hash(concat(o_comment, 'd')) AS STRING)), group_concat(CAST(fnv_hash(concat(o_comment, 'e')) AS STRING)) | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB | | tuple-ids=1 row-size=32B cardinality=1 | | | 01:SCAN HDFS [tpch_300_parquet.orders, RANDOM] | partitions=1/1 files=81 size=18.82GB | predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | stored statistics: | table: rows=450000000 size=18.82GB | columns: all | extrapolated-rows=450000000 | parquet statistics predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | parquet dictionary predicates: o_orderkey < 1200000000, o_orderdate < '1993-01-01' | mem-estimate=176.00MB mem-reservation=24.00MB | tuple-ids=0 row-size=98B cardinality=45000000 | 05:SCAN HDFS [tpch_300_parquet.supplier, RANDOM] partitions=1/1 files=9 size=233.61MB runtime filters: RF000[bloom] -> s_suppkey stored statistics: table: rows=3000000 size=233.61MB columns: all extrapolated-rows=3000000 mem-estimate=40.00MB mem-reservation=8.00MB tuple-ids=6 row-size=8B cardinality=3000000 ---------------- Estimated Per-Host Mem: 1879438464 Per Host Min Reservation: vb0204.foo:22000(0) vb0206.foo:22000(226.00 MB) vb0208.foo:22000(226.00 MB) vb0212.foo:22000(96.00 MB) vb0214.foo:22000(226.00 MB) vb0216.foo:22000(226.00 MB) vb0218.foo:22000(226.00 MB) vb0220.foo:22000(96.00 MB) vb0222.foo:22000(226.00 MB) vb0224.foo:22000(226.00 MB) vb0228.foo:22000(96.00 MB) vb0230.foo:22000(226.00 MB) vb0232.foo:22000(226.00 MB) vb0234.foo:22000(96.00 MB) Request Pool: root.default Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------------------- 30:EXCHANGE 1 0.000ns 0.000ns 0 6.00M 0 0 UNPARTITIONED 29:AGGREGATE 9 1.536ms 10.844ms 0 6.00M 76.12 KB 453.19 MB FINALIZE 28:EXCHANGE 9 0.000ns 0.000ns 0 6.00M 0 0 HASH(t1.c1,t1.c2,t2.c1,t2.c2) 15:AGGREGATE 9 50.393us 322.354us 0 6.00M 76.12 KB 453.19 MB STREAMING 14:HASH JOIN 9 35s454ms 1m44s 0 6.00M 1.85 GB 38.00 MB INNER JOIN, PARTITIONED |--27:EXCHANGE 9 54s733ms 1m42s 5 6.00M 1.82 GB 0 HASH(s_suppkey) | 13:NESTED LOOP JOIN 9 94.861ms 237.080ms 2.36M 6.00M 3.63 GB 64.00 B CROSS JOIN, BROADCAST | |--25:EXCHANGE 9 1m19s 1m23s 2 2 1.82 GB 0 BROADCAST | | 07:UNION 1 372.034ms 372.034ms 2 2 0 0 | | |--24:AGGREGATE 1 6s196ms 6s196ms 1 1 4.04 GB 10.00 MB FINALIZE | | | 23:EXCHANGE 1 768.049ms 768.049ms 13 1 325.25 MB 0 UNPARTITIONED | | | 11:AGGREGATE 13 5s600ms 6s403ms 13 1 516.33 MB 10.00 MB | | | 10:SCAN HDFS 13 98.478ms 139.094ms 45.63M 45.00M 355.44 MB 176.00 MB tpch_300_parquet.orders | | 22:AGGREGATE 1 5s720ms 5s720ms 1 1 4.04 GB 10.00 MB FINALIZE | | 21:EXCHANGE 1 10s537ms 10s537ms 13 1 319.41 MB 0 UNPARTITIONED | | 09:AGGREGATE 13 5s587ms 6s716ms 13 1 516.33 MB 10.00 MB | | 08:SCAN HDFS 13 96.627ms 167.372ms 45.63M 45.00M 358.25 MB 176.00 MB tpch_300_parquet.orders | 12:SCAN HDFS 9 8.806ms 11.052ms 9.22K 3.00M 26.88 MB 40.00 MB tpch_300_parquet.supplier 26:EXCHANGE 9 53s495ms 1m43s 0 6.00M 3.63 GB 0 HASH(s_suppkey) 06:NESTED LOOP JOIN 9 52.163ms 182.744ms 2.36M 6.00M 3.63 GB 64.00 B CROSS JOIN, BROADCAST |--20:EXCHANGE 9 1m21s 1m24s 2 2 1.82 GB 0 BROADCAST | 00:UNION 1 350.115ms 350.115ms 2 2 0 0 | |--19:AGGREGATE 1 5s625ms 5s625ms 1 1 4.04 GB 10.00 MB FINALIZE | | 18:EXCHANGE 1 969.299ms 969.299ms 13 1 325.25 MB 0 UNPARTITIONED | | 04:AGGREGATE 13 5s537ms 6s656ms 13 1 516.33 MB 10.00 MB | | 03:SCAN HDFS 13 88.793ms 129.687ms 45.63M 45.00M 354.96 MB 176.00 MB tpch_300_parquet.orders | 17:AGGREGATE 1 5s505ms 5s505ms 1 1 4.04 GB 10.00 MB FINALIZE | 16:EXCHANGE 1 10s151ms 10s151ms 13 1 332.05 MB 0 UNPARTITIONED | 02:AGGREGATE 13 5s562ms 6s764ms 13 1 516.33 MB 10.00 MB | 01:SCAN HDFS 13 98.847ms 155.000ms 45.63M 45.00M 355.05 MB 176.00 MB tpch_300_parquet.orders 05:SCAN HDFS 9 27.893ms 29.627ms 9.22K 3.00M 26.88 MB 40.00 MB tpch_300_parquet.supplier Errors: Query Compilation: 14.688ms - Metadata of all 2 tables cached: 1.634ms (1.634ms) - Analysis finished: 5.790ms (4.155ms) - Value transfer graph computed: 5.872ms (82.694us) - Single node plan created: 9.930ms (4.057ms) - Runtime filters computed: 10.607ms (677.066us) - Distributed plan created: 10.645ms (37.381us) - Lineage info computed: 10.717ms (72.901us) - Planning finished: 14.688ms (3.970ms) Query Timeline: 1m47s - Query submitted: 73.053us (73.053us) - Planning finished: 18.067ms (17.994ms) - Submit for admission: 20.207ms (2.140ms) - Completed admission: 20.274ms (66.481us) - Ready to start on 14 backends: 21.122ms (848.230us) - All 14 execution backends (91 fragment instances) started: 35.337ms (14.214ms) - Released admission control resources: 1m46s (1m46s) - Rows available: 1m46s (22.067ms) - Unregister query: 1m47s (1s010ms) - ComputeScanRangeAssignmentTimer: 822.431us ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile 9b439fc1ee1addb7:82d4156900000000:(Total: 1m46s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 0 14 5 REMOTE false 9 (9) N/A N/A true Backend startup latencies: Count: 14, min / max: 2ms / 13ms, 25th %-ile: 4ms, 50th %-ile: 4ms, 75th %-ile: 5ms, 90th %-ile: 12ms, 95th %-ile: 12ms, 99.9th %-ile: 13ms Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 0 14 5 REMOTE false 9 (9) N/A N/A true Per Node Peak Memory Usage: vb0204.foo:22000(11.63 GB) vb0206.foo:22000(21.97 GB) vb0208.foo:22000(14.70 GB) vb0212.foo:22000(2.37 GB) vb0214.foo:22000(19.25 GB) vb0216.foo:22000(14.70 GB) vb0218.foo:22000(16.52 GB) vb0220.foo:22000(3.37 GB) vb0222.foo:22000(16.52 GB) vb0224.foo:22000(18.34 GB) vb0228.foo:22000(3.37 GB) vb0230.foo:22000(18.34 GB) vb0232.foo:22000(14.70 GB) vb0234.foo:22000(3.24 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - NumBackends: 14 (14) - NumFragmentInstances: 91 (91) - NumFragments: 11 (11) Averaged Fragment F14:(Total: 1.176ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m46s max:1m46s mean: 1m46s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 11.63 GB (12482366368) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.121ms - ExecTreePrepareTime: 90.051us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 EXCHANGE_NODE (id=30): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 20.221ms, non-child: 20.221ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.608ms Coordinator Fragment F14: Instance 9b439fc1ee1addb7:82d4156900000000 (host=vb0204.foo:22000):(Total: 1.176ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 1.423ms - Prepare Finished: 1.423ms (1.423ms) MemoryUsage(2s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.00 KB (8192) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 11.63 GB (12482366368) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.121ms - ExecTreePrepareTime: 90.051us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 EXCHANGE_NODE (id=30): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 20.221ms, non-child: 20.221ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.608ms Averaged Fragment F13:(Total: 3.428ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m46s max:1m46s mean: 1m46s stddev:5.832ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 9 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.62 GB (17845810471) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 3.372ms - ExecTreePrepareTime: 1.537ms DataStreamSender (dst_id=30):(Total: 739.745us, non-child: 739.745us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 1.536ms, non-child: 1.536ms, % non-child: 100.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 240.490ms, non-child: 240.490ms, % non-child: 100.00%) - CodegenTime: 4.030ms - CompileTime: 55.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 146.640ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 37.747ms Fragment F13: Instance 9b439fc1ee1addb7:82d415690000005a (host=vb0224.foo:22000):(Total: 12.056ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 12.759ms - Prepare Finished: 12.759ms (12.759ms) MemoryUsage(2s000ms): 225.26 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 12.003ms - ExecTreePrepareTime: 10.845ms DataStreamSender (dst_id=30):(Total: 533.761us, non-child: 533.761us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 10.844ms, non-child: 10.844ms, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 344.438ms, non-child: 344.438ms, % non-child: 100.00%) - CodegenTime: 4.922ms - CompileTime: 54.693ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 249.050ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 39.884ms Instance 9b439fc1ee1addb7:82d4156900000052 (host=vb0216.foo:22000):(Total: 3.401ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 4.153ms - Prepare Finished: 4.153ms (4.153ms) MemoryUsage(2s000ms): 88.51 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 3.349ms - ExecTreePrepareTime: 529.189us DataStreamSender (dst_id=30):(Total: 727.173us, non-child: 727.173us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 527.731us, non-child: 527.731us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 219.638ms, non-child: 219.638ms, % non-child: 100.00%) - CodegenTime: 3.479ms - CompileTime: 54.148ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 129.257ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 35.642ms Instance 9b439fc1ee1addb7:82d4156900000054 (host=vb0206.foo:22000):(Total: 3.140ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 3.846ms - Prepare Finished: 3.846ms (3.846ms) MemoryUsage(2s000ms): 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 20.15 GB (21639853647) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 3.078ms - ExecTreePrepareTime: 523.076us DataStreamSender (dst_id=30):(Total: 760.762us, non-child: 760.762us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 521.442us, non-child: 521.442us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 220.230ms, non-child: 220.230ms, % non-child: 100.00%) - CodegenTime: 3.451ms - CompileTime: 53.692ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 128.431ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 37.474ms Instance 9b439fc1ee1addb7:82d4156900000056 (host=vb0218.foo:22000):(Total: 3.007ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 3.804ms - Prepare Finished: 3.804ms (3.804ms) MemoryUsage(2s000ms): 88.51 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189092) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 2.950ms - ExecTreePrepareTime: 540.672us DataStreamSender (dst_id=30):(Total: 760.171us, non-child: 760.171us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 539.577us, non-child: 539.577us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 253.377ms, non-child: 253.377ms, % non-child: 100.00%) - CodegenTime: 4.979ms - CompileTime: 64.885ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 147.883ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 39.849ms Instance 9b439fc1ee1addb7:82d4156900000057 (host=vb0230.foo:22000):(Total: 2.002ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 2.890ms - Prepare Finished: 2.890ms (2.890ms) MemoryUsage(2s000ms): 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.940ms - ExecTreePrepareTime: 288.033us DataStreamSender (dst_id=30):(Total: 864.510us, non-child: 864.510us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 286.867us, non-child: 286.867us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 222.351ms, non-child: 222.351ms, % non-child: 100.00%) - CodegenTime: 3.820ms - CompileTime: 53.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 128.832ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 39.032ms Instance 9b439fc1ee1addb7:82d4156900000058 (host=vb0214.foo:22000):(Total: 1.982ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 2.762ms - Prepare Finished: 2.762ms (2.762ms) MemoryUsage(2s000ms): 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 17.43 GB (18713025446) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.924ms - ExecTreePrepareTime: 278.058us DataStreamSender (dst_id=30):(Total: 809.179us, non-child: 809.179us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 276.852us, non-child: 276.852us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 223.132ms, non-child: 223.132ms, % non-child: 100.00%) - CodegenTime: 3.770ms - CompileTime: 53.287ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 129.946ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 39.258ms Instance 9b439fc1ee1addb7:82d4156900000059 (host=vb0208.foo:22000):(Total: 1.896ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 2.714ms - Prepare Finished: 2.714ms (2.714ms) MemoryUsage(2s000ms): 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786181032) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.841ms - ExecTreePrepareTime: 294.266us DataStreamSender (dst_id=30):(Total: 827.101us, non-child: 827.101us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 292.979us, non-child: 292.979us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 215.746ms, non-child: 215.746ms, % non-child: 100.00%) - CodegenTime: 3.353ms - CompileTime: 53.207ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 128.584ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 33.391ms Instance 9b439fc1ee1addb7:82d4156900000055 (host=vb0232.foo:22000):(Total: 1.751ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 2.597ms - Prepare Finished: 2.597ms (2.597ms) MemoryUsage(2s000ms): 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.699ms - ExecTreePrepareTime: 250.988us DataStreamSender (dst_id=30):(Total: 768.062us, non-child: 768.062us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 249.902us, non-child: 249.902us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 250.291ms, non-child: 250.291ms, % non-child: 100.00%) - CodegenTime: 5.015ms - CompileTime: 57.189ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 146.978ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 45.349ms Instance 9b439fc1ee1addb7:82d4156900000053 (host=vb0222.foo:22000):(Total: 1.616ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 1.958ms - Prepare Finished: 1.958ms (1.958ms) MemoryUsage(2s000ms): 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB, 89.39 KB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 632.88 KB (648064) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737402545) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 1.566ms - ExecTreePrepareTime: 290.403us DataStreamSender (dst_id=30):(Total: 606.994us, non-child: 606.994us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1.75 KB (1792) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=29):(Total: 289.257us, non-child: 289.257us, % non-child: 100.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 215.209ms, non-child: 215.209ms, % non-child: 100.00%) - CodegenTime: 3.475ms - CompileTime: 53.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 53 (53) - NumInstructions: 1.09K (1094) - OptimizationTime: 130.796ms - PeakMemoryUsage: 547.00 KB (560128) - PrepareTime: 29.848ms Averaged Fragment F12:(Total: 23s207ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m44s max:1m46s mean: 1m45s stddev:725.301ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 9 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.11 MB (1165084) - PeakMemoryUsage: 2.65 GB (2843468284) - PeakReservation: 23.11 MB (24233756) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.82 GB (18062613310) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 20 (20) - TotalThreadsTotalWallClockTime: 45s841ms - TotalThreadsSysTime: 73.210ms - TotalThreadsUserTime: 114.426ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 83.634ms - CumulativeAllocationBytes: 1.11 MB (1165084) - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.11 MB (1165084) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 23s192ms - ExecTreeOpenTime: 23s065ms - PrepareTime: 14.776ms - ExecTreePrepareTime: 873.729us DataStreamSender (dst_id=28):(Total: 13.038ms, non-child: 13.038ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 23s066ms, non-child: 0.000ns, % non-child: 0.00%) - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 23s066ms, non-child: 35s454ms, % non-child: 100.00%) - BuildRows: 0 (0) - BuildTime: 123.164ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.03 GB (1106208195) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): - BuildRowsPartitionTime: 38.111ms - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 8 (8) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27):(Total: 54s733ms, non-child: 54s733ms, % non-child: 100.00%) - ConvertRowBatchTime: 1.853us - PeakMemoryUsage: 1.21 GB (1300814345) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 1.49 GB (1594902902) - DeserializeRowBatchTimer: 2s249ms - FirstBatchArrivalWaitTime: 51s102ms - PeakMemoryUsage: 1.21 GB (1300814345) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 53s495ms, non-child: 53s495ms, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 1.62 GB (1734419122) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 1.49 GB (1594887545) - DeserializeRowBatchTimer: 1s729ms - FirstBatchArrivalWaitTime: 53s495ms - PeakMemoryUsage: 1.62 GB (1734419122) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 38.00 MB (39845888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 550.103ms, non-child: 550.103ms, % non-child: 100.00%) - CodegenTime: 2.735ms - CompileTime: 190.598ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 329.503ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 29.395ms Fragment F12: Instance 9b439fc1ee1addb7:82d415690000004a (host=vb0222.foo:22000):(Total: 1m44s, non-child: 10.819ms, % non-child: 0.01%) Fragment Instance Lifecycle Event Timeline: 1m44s - Prepare Finished: 8.338ms (8.338ms) - ExecInternal Finished: 1m44s (1m44s) MemoryUsage(2s000ms): 2.62 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 1.37 GB, 1.84 GB, 1.86 GB, 1.86 GB, 2.31 GB, 3.67 GB, 5.04 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 5.49 GB (5895781272) - PeakReservation: 40.00 MB (41943040) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737402545) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3m26s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 88 (88) - TotalThreadsTotalWallClockTime: 3m27s - TotalThreadsSysTime: 311.951ms - TotalThreadsUserTime: 525.919ms - TotalThreadsVoluntaryContextSwitches: 64 (64) Buffer pool: - AllocTime: 167.800ms - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 1m44s - ExecTreeOpenTime: 1m43s - PrepareTime: 7.441ms - ExecTreePrepareTime: 745.999us DataStreamSender (dst_id=28):(Total: 6.060ms, non-child: 6.060ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m43s, non-child: 68.659us, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 1m43s, non-child: 1.710ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 377.641ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.85 GB (1991127033) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 206.908ms - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27):(Total: 1m42s, non-child: 1m42s, % non-child: 100.00%) - ConvertRowBatchTime: 4.434us - PeakMemoryUsage: 1.82 GB (1951221529) - RowsReturned: 1 (1) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.09 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588531532) - DeserializeRowBatchTimer: 6s205ms - FirstBatchArrivalWaitTime: 1m32s - PeakMemoryUsage: 1.82 GB (1951221529) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 1m43s, non-child: 1m43s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 3.63 GB (3902443026) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB - BytesReceived: 3.34 GB (3588499060) - DeserializeRowBatchTimer: 2s614ms - FirstBatchArrivalWaitTime: 1m43s - PeakMemoryUsage: 3.63 GB (3902443026) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 38.00 MB (39845888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 515.000ms, non-child: 515.000ms, % non-child: 100.00%) - CodegenTime: 4.353ms - CompileTime: 166.863ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 311.097ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 36.270ms Instance 9b439fc1ee1addb7:82d4156900000051 (host=vb0224.foo:22000):(Total: 1m44s, non-child: 7.455ms, % non-child: 0.01%) Fragment Instance Lifecycle Event Timeline: 1m44s - Prepare Finished: 28.615ms (28.615ms) - ExecInternal Finished: 1m44s (1m44s) MemoryUsage(2s000ms): 2.62 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 467.37 MB, 1.82 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 2.31 GB, 3.67 GB, 2.31 GB, 1.86 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 3.67 GB (3944559759) - PeakReservation: 40.00 MB (41943040) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 92 (92) - TotalThreadsTotalWallClockTime: 3m24s - TotalThreadsSysTime: 346.947ms - TotalThreadsUserTime: 503.923ms - TotalThreadsVoluntaryContextSwitches: 80 (80) Buffer pool: - AllocTime: 210.056ms - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 1m44s - ExecTreeOpenTime: 1m43s - PrepareTime: 16.820ms - ExecTreePrepareTime: 786.165us DataStreamSender (dst_id=28):(Total: 15.182ms, non-child: 15.182ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1m43s, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 1m43s, non-child: 1.617ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 349.200ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.85 GB (1991127033) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 136.090ms - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27):(Total: 1m39s, non-child: 1m39s, % non-child: 100.00%) - ConvertRowBatchTime: 5.324us - PeakMemoryUsage: 1.82 GB (1951221529) - RowsReturned: 1 (1) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.79 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.09 GB, 3.34 GB - BytesReceived: 3.34 GB (3588531532) - DeserializeRowBatchTimer: 5s975ms - FirstBatchArrivalWaitTime: 1m17s - PeakMemoryUsage: 1.82 GB (1951221529) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 1m43s, non-child: 1m43s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 3.63 GB (3902443026) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.78 MB, 1.67 GB - BytesReceived: 3.34 GB (3588499060) - DeserializeRowBatchTimer: 2s840ms - FirstBatchArrivalWaitTime: 1m43s - PeakMemoryUsage: 3.63 GB (3902443026) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 38.00 MB (39845888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 613.163ms, non-child: 613.163ms, % non-child: 100.00%) - CodegenTime: 2.540ms - CompileTime: 167.091ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 417.024ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 28.446ms Instance 9b439fc1ee1addb7:82d415690000004f (host=vb0214.foo:22000):(Total: 17.610ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 18.884ms - Prepare Finished: 18.884ms (18.884ms) MemoryUsage(2s000ms): 2.16 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 1.82 GB, 1.84 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB, 1.86 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 1.86 GB (1993338246) - PeakReservation: 40.00 MB (41943040) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688636172) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m30s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 137.236ms - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 17.538ms - ExecTreePrepareTime: 939.388us DataStreamSender (dst_id=28):(Total: 15.739ms, non-child: 15.739ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 938.376us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 1.052ms, non-child: 10s646ms, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 140.278ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.85 GB (1991127033) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27):(Total: 1m30s, non-child: 1m30s, % non-child: 100.00%) - ConvertRowBatchTime: 2.560us - PeakMemoryUsage: 1.82 GB (1951221513) - RowsReturned: 1 (1) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794265766) - DeserializeRowBatchTimer: 2s914ms - FirstBatchArrivalWaitTime: 1m30s - PeakMemoryUsage: 1.82 GB (1951221513) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 38.00 MB (39845888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 627.666ms, non-child: 627.666ms, % non-child: 100.00%) - CodegenTime: 2.432ms - CompileTime: 229.896ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 368.225ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 28.960ms Instance 9b439fc1ee1addb7:82d4156900000050 (host=vb0208.foo:22000):(Total: 16.970ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 18.292ms - Prepare Finished: 18.292ms (18.292ms) MemoryUsage(2s000ms): 2.62 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 467.37 MB, 1.82 GB, 1.82 GB, 1.82 GB, 3.64 GB, 3.66 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 3.67 GB (3944559759) - PeakReservation: 40.00 MB (41943040) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786181032) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 127.228ms - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 16.851ms - ExecTreePrepareTime: 1.038ms DataStreamSender (dst_id=28):(Total: 14.996ms, non-child: 14.996ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 1.037ms, non-child: 62.528us, % non-child: 6.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 974.824us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 128.877ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.85 GB (1991127033) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27):(Total: 1m39s, non-child: 1m39s, % non-child: 100.00%) - ConvertRowBatchTime: 2.507us - PeakMemoryUsage: 1.82 GB (1951221513) - RowsReturned: 1 (1) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794265766) - DeserializeRowBatchTimer: 2s635ms - FirstBatchArrivalWaitTime: 1m39s - PeakMemoryUsage: 1.82 GB (1951221513) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 1m33s, non-child: 1m33s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 1.82 GB (1951221513) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.78 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794249530) - DeserializeRowBatchTimer: 2s508ms - FirstBatchArrivalWaitTime: 1m33s - PeakMemoryUsage: 1.82 GB (1951221513) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 38.00 MB (39845888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 492.597ms, non-child: 492.597ms, % non-child: 100.00%) - CodegenTime: 2.515ms - CompileTime: 162.149ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 302.185ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 27.689ms Instance 9b439fc1ee1addb7:82d415690000004b (host=vb0206.foo:22000):(Total: 16.846ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 18.018ms - Prepare Finished: 18.018ms (18.018ms) MemoryUsage(2s000ms): 2.62 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 1.37 GB, 1.82 GB, 1.82 GB, 1.82 GB, 1.82 GB, 1.82 GB, 1.82 GB, 1.82 GB, 3.64 GB, 3.64 GB, 3.64 GB, 4.09 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.45 GB (5855935384) - PeakReservation: 2.00 MB (2097152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 19.25 GB (20664242921) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1m18s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 16.776ms - ExecTreePrepareTime: 879.289us DataStreamSender (dst_id=28):(Total: 15.148ms, non-child: 15.148ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 878.317us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 946.066us, non-child: 950.146us, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 58.25 KB (59648) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 1.82 GB (1951221513) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.79 MB - BytesReceived: 1.67 GB (1794265764) - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 1.82 GB (1951221513) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 1m18s, non-child: 1m18s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 3.63 GB (3902443026) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490726) - DeserializeRowBatchTimer: 5s095ms - FirstBatchArrivalWaitTime: 1m18s - PeakMemoryUsage: 3.63 GB (3902443026) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 491.745ms, non-child: 491.745ms, % non-child: 100.00%) - CodegenTime: 2.457ms - CompileTime: 163.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 297.268ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 30.456ms Instance 9b439fc1ee1addb7:82d415690000004e (host=vb0230.foo:22000):(Total: 15.751ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 16.982ms - Prepare Finished: 16.982ms (16.982ms) MemoryUsage(2s000ms): 2.62 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 467.37 MB, 1.82 GB, 3.67 GB, 3.67 GB, 3.67 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 3.67 GB (3944559759) - PeakReservation: 40.00 MB (41943040) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 3m21s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 110.388ms - CumulativeAllocationBytes: 2.00 MB (2097152) - CumulativeAllocations: 1 (1) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 15.674ms - ExecTreePrepareTime: 993.835us DataStreamSender (dst_id=28):(Total: 13.508ms, non-child: 13.508ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 992.465us, non-child: 322.354us, % non-child: 32.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 670.111us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 112.484ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.85 GB (1991127033) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27):(Total: 1m39s, non-child: 1m39s, % non-child: 100.00%) - ConvertRowBatchTime: 1.852us - PeakMemoryUsage: 1.82 GB (1951221513) - RowsReturned: 1 (1) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.79 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794265766) - DeserializeRowBatchTimer: 2s515ms - FirstBatchArrivalWaitTime: 1m39s - PeakMemoryUsage: 1.82 GB (1951221513) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 1m41s, non-child: 1m41s, % non-child: 100.00%) - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 1.82 GB (1951221513) - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794249530) - DeserializeRowBatchTimer: 2s509ms - FirstBatchArrivalWaitTime: 1m41s - PeakMemoryUsage: 1.82 GB (1951221513) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 38.00 MB (39845888) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 502.635ms, non-child: 502.635ms, % non-child: 100.00%) - CodegenTime: 2.756ms - CompileTime: 167.441ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 307.330ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 27.288ms Instance 9b439fc1ee1addb7:82d4156900000049 (host=vb0216.foo:22000):(Total: 15.722ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 16.870ms - Prepare Finished: 16.870ms (16.870ms) MemoryUsage(2s000ms): 2.16 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.97 MB (4160128) - PeakReservation: 2.00 MB (2097152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 15.652ms - ExecTreePrepareTime: 675.089us DataStreamSender (dst_id=28):(Total: 14.328ms, non-child: 14.328ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 674.237us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 894.331us, non-child: 1m41s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 58.25 KB (59648) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 513.260ms, non-child: 513.260ms, % non-child: 100.00%) - CodegenTime: 2.452ms - CompileTime: 168.525ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 316.004ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 28.156ms Instance 9b439fc1ee1addb7:82d415690000004c (host=vb0232.foo:22000):(Total: 15.044ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 16.370ms - Prepare Finished: 16.370ms (16.370ms) MemoryUsage(2s000ms): 2.62 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.97 MB (4160128) - PeakReservation: 2.00 MB (2097152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 14.969ms - ExecTreePrepareTime: 899.103us DataStreamSender (dst_id=28):(Total: 12.812ms, non-child: 12.812ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 895.704us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 980.364us, non-child: 1m42s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 58.25 KB (59648) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 639.555ms, non-child: 639.555ms, % non-child: 100.00%) - CodegenTime: 2.621ms - CompileTime: 254.909ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 354.321ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 29.730ms Instance 9b439fc1ee1addb7:82d415690000004d (host=vb0218.foo:22000):(Total: 11.331ms, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 12.579ms - Prepare Finished: 12.579ms (12.579ms) MemoryUsage(2s000ms): 2.16 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB, 2.17 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 3.97 MB (4160128) - PeakReservation: 2.00 MB (2097152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737414643) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 11.263ms - ExecTreePrepareTime: 906.132us DataStreamSender (dst_id=28):(Total: 9.568ms, non-child: 9.568ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.75 KB (16128) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=15):(Total: 905.119us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 76.12 KB (77952) - ReductionFactorEstimate: 0.00 - ReductionFactorThresholdToExpand: 0.00 - RowsPassedThrough: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - StreamingTime: 0.000ns HASH_JOIN_NODE (id=14):(Total: 906.634us, non-child: 1m44s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 58.25 KB (59648) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=27): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26): - ConvertRowBatchTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns CodeGen:(Total: 555.305ms, non-child: 555.305ms, % non-child: 100.00%) - CodegenTime: 2.488ms - CompileTime: 235.087ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 3.71K (3713) - OptimizationTime: 292.068ms - PeakMemoryUsage: 1.81 MB (1901056) - PrepareTime: 27.561ms Averaged Fragment F00:(Total: 1m21s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 25.70 MB, max: 26.47 MB, avg: 25.96 MB, stddev: 363.28 KB completion times: min:1m46s max:1m46s mean: 1m46s stddev:6.160ms execution rates: min:247.61 KB/sec max:255.05 KB/sec mean:250.09 KB/sec stddev:3.42 KB/sec num instances: 9 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.20 GB (7726889266) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.92 GB (18171014502) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m21s - TotalNetworkSendTime: 977.359ms - TotalStorageWaitTime: 2.543ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 2m42s - TotalThreadsSysTime: 1.444ms - TotalThreadsUserTime: 64.545ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 104.517us - OpenTime: 1m21s - ExecTreeOpenTime: 1m21s - PrepareTime: 14.556ms - ExecTreePrepareTime: 303.293us DataStreamSender (dst_id=26):(Total: 14s190ms, non-child: 14s190ms, % non-child: 100.00%) - BytesSent: 2.23 GB (2392331780) - NetworkThroughput(*): 457.09 MB/sec - OverallThroughput: 166.10 MB/sec - PeakMemoryUsage: 3.53 GB (3794106070) - RowsReturned: 0 (0) - SerializeBatchTime: 13s044ms - TransmitDataRPCTime: 5s039ms - UncompressedRowBatchSize: 2.42 GB (2601628684) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m21s, non-child: 52.163ms, % non-child: 0.06%) - BuildRows: 2 (2) - BuildTime: 27.457us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.27 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m21s, non-child: 1m21s, % non-child: 100.00%) - ConvertRowBatchTime: 6.166us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s520ms - FirstBatchArrivalWaitTime: 53s369ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 27.893ms, non-child: 27.893ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.21 - BytesRead: 1.45 MB (1519804) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2.908ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 637.84 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 36.75 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2.452ms - TotalReadThroughput: 14.49 KB/sec Buffer pool: - AllocTime: 593.027us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 78.703ms, non-child: 78.703ms, % non-child: 100.00%) - CodegenTime: 1.597ms - CompileTime: 22.835ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 25.784ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 29.452ms Fragment F00: Instance 9b439fc1ee1addb7:82d4156900000024 (host=vb0224.foo:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB Fragment Instance Lifecycle Event Timeline: 1m25s - Prepare Finished: 28.022ms (28.022ms) - Open Finished: 1m25s (1m25s) - First Batch Produced: 1m25s (123.903us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 491.29 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.21 GB, 4.12 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 6.62 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7835290458) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 4.128us - TotalStorageWaitTime: 3.383ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 54.992ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 122.125us - OpenTime: 1m25s - ExecTreeOpenTime: 1m24s - PrepareTime: 15.550ms - ExecTreePrepareTime: 212.742us DataStreamSender (dst_id=26):(Total: 9s675ms, non-child: 9s675ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249528) - NetworkThroughput(*): 490.59 MB/sec - OverallThroughput: 176.85 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s661ms - TransmitDataRPCTime: 3s487ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m24s, non-child: 155.558ms, % non-child: 0.18%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 16.551us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 6.049us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.78 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s458ms - FirstBatchArrivalWaitTime: 59s953ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 28.635ms, non-child: 28.635ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 735.55 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 632.674us ; Min: 632.674us ; Max: 632.674us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.15 - BytesRead: 1.44 MB (1506401) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.049ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 432.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 35.76 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.322ms - TotalReadThroughput: 14.71 KB/sec Buffer pool: - AllocTime: 540.883us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 171.670ms, non-child: 171.670ms, % non-child: 100.00%) - CodegenTime: 1.391ms - CompileTime: 124.040ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 21.428ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 25.648ms Instance 9b439fc1ee1addb7:82d415690000001f (host=vb0232.foo:22000):(Total: 1m25s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/25.70 MB Fragment Instance Lifecycle Event Timeline: 1m25s - Prepare Finished: 16.003ms (16.003ms) - Open Finished: 1m25s (1m25s) - First Batch Produced: 1m25s (122.620us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.66 GB, 4.12 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 6.84 GB, 7.30 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7835290458) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 3.640us - TotalStorageWaitTime: 2.401ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 80.988ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 120.893us - OpenTime: 1m25s - ExecTreeOpenTime: 1m25s - PrepareTime: 14.197ms - ExecTreePrepareTime: 337.449us DataStreamSender (dst_id=26):(Total: 9s562ms, non-child: 9s562ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249530) - NetworkThroughput(*): 338.37 MB/sec - OverallThroughput: 178.95 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s549ms - TransmitDataRPCTime: 5s057ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m25s, non-child: 125.243ms, % non-child: 0.15%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 37.215us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 5.897us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s579ms - FirstBatchArrivalWaitTime: 1m1s - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 28.012ms, non-child: 28.012ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/25.70 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 735.52 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 442.606us ; Min: 442.606us ; Max: 442.606us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.17 - BytesRead: 1.44 MB (1506350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.063ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 700.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 36.55 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2.051ms - TotalReadThroughput: 14.42 KB/sec Buffer pool: - AllocTime: 699.698us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 80.594ms, non-child: 80.594ms, % non-child: 100.00%) - CodegenTime: 1.823ms - CompileTime: 13.207ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 31.437ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 35.206ms Instance 9b439fc1ee1addb7:82d415690000001c (host=vb0216.foo:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB Fragment Instance Lifecycle Event Timeline: 1m24s - Prepare Finished: 17.552ms (17.552ms) - Open Finished: 1m24s (1m24s) - First Batch Produced: 1m24s (121.851us) MemoryUsage(2s000ms): 20.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 2.75 GB, 3.66 GB, 3.66 GB, 4.12 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 6.39 GB, 7.30 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7835290458) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 3.527us - TotalStorageWaitTime: 2.037ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 53.992ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 119.829us - OpenTime: 1m24s - ExecTreeOpenTime: 1m24s - PrepareTime: 15.967ms - ExecTreePrepareTime: 291.472us DataStreamSender (dst_id=26):(Total: 9s745ms, non-child: 9s745ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249530) - NetworkThroughput(*): 534.58 MB/sec - OverallThroughput: 175.58 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s730ms - TransmitDataRPCTime: 3s200ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m24s, non-child: 832.927us, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 32.171us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 5.819us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.51 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s373ms - FirstBatchArrivalWaitTime: 53s044ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 27.290ms, non-child: 27.290ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 21ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 735.52 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 442.750us ; Min: 442.750us ; Max: 442.750us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.17 - BytesRead: 1.44 MB (1506346) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.047ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 747.54 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 37.52 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1.921ms - TotalReadThroughput: 14.35 KB/sec Buffer pool: - AllocTime: 610.438us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 55.551ms, non-child: 55.551ms, % non-child: 100.00%) - CodegenTime: 1.420ms - CompileTime: 8.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 21.087ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 25.271ms Instance 9b439fc1ee1addb7:82d415690000001e (host=vb0206.foo:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/25.70 MB Fragment Instance Lifecycle Event Timeline: 1m24s - Prepare Finished: 18.407ms (18.407ms) - Open Finished: 1m24s (1m24s) - First Batch Produced: 1m24s (83.702us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.21 GB, 3.66 GB, 4.12 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7835290458) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 20.15 GB (21639853647) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 2.881us - TotalStorageWaitTime: 1.965ms - TotalThreadsInvoluntaryContextSwitches: 9 (9) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 71.989ms - TotalThreadsVoluntaryContextSwitches: 9 (9) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 80.624us - OpenTime: 1m24s - ExecTreeOpenTime: 1m24s - PrepareTime: 16.801ms - ExecTreePrepareTime: 359.179us DataStreamSender (dst_id=26):(Total: 10s875ms, non-child: 10s875ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249530) - NetworkThroughput(*): 525.97 MB/sec - OverallThroughput: 157.33 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 10s860ms - TransmitDataRPCTime: 3s253ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m24s, non-child: 902.021us, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 26.187us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 5.571us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s343ms - FirstBatchArrivalWaitTime: 1m1s - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 26.387ms, non-child: 26.387ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/25.70 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 735.57 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 276.748us ; Min: 276.748us ; Max: 276.748us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.16 - BytesRead: 1.44 MB (1506446) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.246ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 744.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 38.80 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1.929ms - TotalReadThroughput: 14.57 KB/sec Buffer pool: - AllocTime: 179.433us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 75.316ms, non-child: 75.316ms, % non-child: 100.00%) - CodegenTime: 1.941ms - CompileTime: 9.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 30.969ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 34.522ms Instance 9b439fc1ee1addb7:82d4156900000023 (host=vb0208.foo:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/25.70 MB Fragment Instance Lifecycle Event Timeline: 1m24s - Prepare Finished: 17.063ms (17.063ms) - Open Finished: 1m24s (1m24s) - First Batch Produced: 1m24s (60.999us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 2.30 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 4.34 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 5.48 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.48 GB (5884064907) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786181032) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 2.795us - TotalStorageWaitTime: 1.854ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 55.992ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 59.901us - OpenTime: 1m24s - ExecTreeOpenTime: 1m24s - PrepareTime: 15.222ms - ExecTreePrepareTime: 299.689us DataStreamSender (dst_id=26):(Total: 10s115ms, non-child: 10s115ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249530) - NetworkThroughput(*): 502.21 MB/sec - OverallThroughput: 169.17 MB/sec - PeakMemoryUsage: 1.82 GB (1951281711) - RowsReturned: 0 (0) - SerializeBatchTime: 10s101ms - TransmitDataRPCTime: 3s407ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m24s, non-child: 1.107ms, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 21.669us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 4.919us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.09 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s490ms - FirstBatchArrivalWaitTime: 48s521ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 27.085ms, non-child: 27.085ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/25.70 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 735.53 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 316.201us ; Min: 316.201us ; Max: 316.201us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.15 - BytesRead: 1.44 MB (1506363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.074ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 784.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 37.81 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1.831ms - TotalReadThroughput: 14.71 KB/sec Buffer pool: - AllocTime: 646.128us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 56.758ms, non-child: 56.758ms, % non-child: 100.00%) - CodegenTime: 1.287ms - CompileTime: 8.141ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 21.710ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 26.360ms Instance 9b439fc1ee1addb7:82d4156900000021 (host=vb0230.foo:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/26.45 MB Fragment Instance Lifecycle Event Timeline: 1m24s - Prepare Finished: 19.316ms (19.316ms) - Open Finished: 1m24s (1m24s) - First Batch Produced: 1m24s (75.574us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.21 GB, 3.66 GB, 3.66 GB, 4.12 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 6.84 GB, 7.30 GB, 7.30 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7835290458) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 3.774us - TotalStorageWaitTime: 1.935ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 2.999ms - TotalThreadsUserTime: 52.992ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 73.906us - OpenTime: 1m24s - ExecTreeOpenTime: 1m24s - PrepareTime: 17.325ms - ExecTreePrepareTime: 267.858us DataStreamSender (dst_id=26):(Total: 9s753ms, non-child: 9s753ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249530) - NetworkThroughput(*): 244.90 MB/sec - OverallThroughput: 175.43 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s737ms - TransmitDataRPCTime: 6s987ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m24s, non-child: 805.511us, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 29.828us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 7.973us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s463ms - FirstBatchArrivalWaitTime: 41s083ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 27.725ms, non-child: 27.725ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/26.45 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 755.14 KB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB - FooterProcessingTime: (Avg: 601.613us ; Min: 601.613us ; Max: 601.613us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.19 - BytesRead: 1.47 MB (1546527) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1.541ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 757.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 36.93 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1.946ms - TotalReadThroughput: 14.38 KB/sec Buffer pool: - AllocTime: 640.781us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 55.768ms, non-child: 55.768ms, % non-child: 100.00%) - CodegenTime: 1.359ms - CompileTime: 8.756ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 20.492ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 25.955ms Instance 9b439fc1ee1addb7:82d4156900000022 (host=vb0214.foo:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/26.47 MB Fragment Instance Lifecycle Event Timeline: 1m24s - Prepare Finished: 18.680ms (18.680ms) - Open Finished: 1m24s (1m24s) - First Batch Produced: 1m24s (120.892us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 491.29 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 2.30 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 4.34 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 5.71 GB, 7.07 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7835290458) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688636172) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m24s - TotalNetworkSendTime: 5.171us - TotalStorageWaitTime: 2.000ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 2m49s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 57.991ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 118.973us - OpenTime: 1m24s - ExecTreeOpenTime: 1m24s - PrepareTime: 16.866ms - ExecTreePrepareTime: 274.155us DataStreamSender (dst_id=26):(Total: 10s264ms, non-child: 10s264ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794249530) - NetworkThroughput(*): 358.04 MB/sec - OverallThroughput: 166.70 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 10s249ms - TransmitDataRPCTime: 4s779ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m24s, non-child: 848.499us, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 22.411us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.09 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m24s, non-child: 1m24s, % non-child: 100.00%) - ConvertRowBatchTime: 5.871us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.78 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.09 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 6s098ms - FirstBatchArrivalWaitTime: 46s568ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 27.491ms, non-child: 27.491ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/26.47 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 755.35 KB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB - FooterProcessingTime: (Avg: 357.523us ; Min: 357.523us ; Max: 357.523us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.17 - BytesRead: 1.48 MB (1546967) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.067ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 755.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 37.25 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1.953ms - TotalReadThroughput: 14.81 KB/sec Buffer pool: - AllocTime: 640.651us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 59.570ms, non-child: 59.570ms, % non-child: 100.00%) - CodegenTime: 1.288ms - CompileTime: 8.670ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 21.220ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 29.128ms Instance 9b439fc1ee1addb7:82d4156900000020 (host=vb0218.foo:22000):(Total: 1m15s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/25.71 MB Fragment Instance Lifecycle Event Timeline: 1m15s - Prepare Finished: 13.539ms (13.539ms) - Open Finished: 1m15s (1m15s) - First Batch Produced: 1m15s (124.889us) MemoryUsage(2s000ms): 20.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.21 GB, 3.66 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.03 GB, 6.84 GB, 7.30 GB, 7.30 GB, 7.30 GB, 7.30 GB, 7.30 GB, 7.07 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 9.11 GB (9786516009) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737414643) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 6.809us - TotalStorageWaitTime: 3.672ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 2m30s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 77.988ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 122.363us - OpenTime: 1m15s - ExecTreeOpenTime: 1m15s - PrepareTime: 11.820ms - ExecTreePrepareTime: 387.479us DataStreamSender (dst_id=26):(Total: 23s938ms, non-child: 23s938ms, % non-child: 100.00%) - BytesSent: 3.34 GB (3588499060) - NetworkThroughput(*): 533.03 MB/sec - OverallThroughput: 142.96 MB/sec - PeakMemoryUsage: 5.45 GB (5853732813) - RowsReturned: 0 (0) - SerializeBatchTime: 20s739ms - TransmitDataRPCTime: 6s420ms - UncompressedRowBatchSize: 3.63 GB (3902443026) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m15s, non-child: 182.744ms, % non-child: 0.24%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 21.433us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.48 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m15s, non-child: 1m15s, % non-child: 100.00%) - ConvertRowBatchTime: 6.074us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s605ms - FirstBatchArrivalWaitTime: 1m1s - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 29.627ms, non-child: 29.627ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/25.71 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 367.77 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 617.593us ; Min: 617.593us ; Max: 617.593us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.29 - BytesRead: 1.44 MB (1506385) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.069ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 402.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 34.56 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.569ms - TotalReadThroughput: 13.94 KB/sec Buffer pool: - AllocTime: 738.657us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 78.375ms, non-child: 78.375ms, % non-child: 100.00%) - CodegenTime: 1.931ms - CompileTime: 13.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 31.526ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 32.841ms Instance 9b439fc1ee1addb7:82d415690000001d (host=vb0222.foo:22000):(Total: 1m1s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/26.45 MB Fragment Instance Lifecycle Event Timeline: 1m1s - Prepare Finished: 8.815ms (8.815ms) - Open Finished: 1m1s (1m1s) - First Batch Produced: 1m1s (124.350us) MemoryUsage(2s000ms): 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 26.09 MB, 491.29 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.21 GB, 3.66 GB, 3.66 GB, 4.12 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.39 GB (6859679732) - PeakReservation: 26.00 MB (27262976) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737402545) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 8s796ms - TotalStorageWaitTime: 3.642ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 2m2s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 73.988ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.00 MB (2097152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 2.00 MB (2097152) - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 122.044us - OpenTime: 1m1s - ExecTreeOpenTime: 1m1s - PrepareTime: 7.257ms - ExecTreePrepareTime: 299.619us DataStreamSender (dst_id=26):(Total: 33s783ms, non-child: 33s783ms, % non-child: 100.00%) - BytesSent: 5.01 GB (5382740256) - NetworkThroughput(*): 586.11 MB/sec - OverallThroughput: 151.95 MB/sec - PeakMemoryUsage: 2.73 GB (2926896536) - RowsReturned: 0 (0) - SerializeBatchTime: 26s767ms - TransmitDataRPCTime: 8s758ms - UncompressedRowBatchSize: 5.45 GB (5853664539) NESTED_LOOP_JOIN_NODE (id=6):(Total: 1m1s, non-child: 1.429ms, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 39.653us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 4.30 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=20):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - ConvertRowBatchTime: 7.321us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.78 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588490694) - DeserializeRowBatchTimer: 5s267ms - FirstBatchArrivalWaitTime: 48s010ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=5):(Total: 28.785ms, non-child: 28.785ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/26.45 MB ExecOption: PARQUET Codegen Enabled Runtime filters: Not all filters arrived (arrived: [], missing [0]), waited for 20ms BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 755.11 KB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB - FooterProcessingTime: (Avg: 596.899us ; Min: 596.899us ; Max: 596.899us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.41 - BytesRead: 1.47 MB (1546456) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.016ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 416.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 35.57 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.543ms - TotalReadThroughput: 14.52 KB/sec Buffer pool: - AllocTime: 640.582us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (2.00 MB): - Files processed: 0 (0) - Files rejected: 0 (0) - Files total: 0 (0) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 74.729ms, non-child: 74.729ms, % non-child: 100.00%) - CodegenTime: 1.935ms - CompileTime: 11.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 29 (29) - NumInstructions: 445 (445) - OptimizationTime: 32.191ms - PeakMemoryUsage: 222.50 KB (227840) - PrepareTime: 30.137ms Averaged Fragment F05:(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m24s max:1m24s mean: 1m24s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.81 GB (6242380618) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 11.63 GB (12482366368) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 11s120ms - TotalNetworkSendTime: 40s662ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.34K (3344) - TotalThreadsTotalWallClockTime: 1m24s - TotalThreadsSysTime: 11s674ms - TotalThreadsUserTime: 21s172ms - TotalThreadsVoluntaryContextSwitches: 89 (89) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 8s649ms - OpenTime: 13s972ms - ExecTreeOpenTime: 13s952ms - PrepareTime: 2.265ms - ExecTreePrepareTime: 507.523us DataStreamSender (dst_id=20):(Total: 1m14s, non-child: 1m14s, % non-child: 100.00%) - BytesSent: 30.08 GB (32296416246) - NetworkThroughput(*): 581.11 MB/sec - OverallThroughput: 413.23 MB/sec - PeakMemoryUsage: 34.88 KB (35712) - RowsReturned: 2 (2) - SerializeBatchTime: 21s531ms - TransmitDataRPCTime: 53s002ms - UncompressedRowBatchSize: 32.71 GB (35121986928) UNION_NODE (id=0):(Total: 22s602ms, non-child: 350.115ms, % non-child: 1.55%) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 6s595ms, non-child: 5s625ms, % non-child: 85.30%) - BuildTime: 3s925ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=18):(Total: 969.299ms, non-child: 969.299ms, % non-child: 100.00%) - ConvertRowBatchTime: 36.835us - PeakMemoryUsage: 325.25 MB (341052294) - RowsReturned: 13 (13) - RowsReturnedRate: 13.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 1.67 GB (1794246755) - DeserializeRowBatchTimer: 3s330ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 325.25 MB (341052294) - SendersBlockedTimer: 24s959ms - SendersBlockedTotalTimer(*): 3m43s AGGREGATION_NODE (id=17):(Total: 15s656ms, non-child: 5s505ms, % non-child: 35.16%) - BuildTime: 3s801ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=16):(Total: 10s151ms, non-child: 10s151ms, % non-child: 100.00%) - ConvertRowBatchTime: 43.501us - PeakMemoryUsage: 332.05 MB (348183360) - RowsReturned: 13 (13) - RowsReturnedRate: 1.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 1.67 GB (1794254942) - DeserializeRowBatchTimer: 3s404ms - FirstBatchArrivalWaitTime: 5s596ms - PeakMemoryUsage: 332.05 MB (348183360) - SendersBlockedTimer: 1s597ms - SendersBlockedTotalTimer(*): 4s599ms CodeGen:(Total: 19.949ms, non-child: 19.949ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.395ms Fragment F05: Instance 9b439fc1ee1addb7:82d415690000001b (host=vb0204.foo:22000):(Total: 1m24s, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 1m24s - Prepare Finished: 2.861ms (2.861ms) - Open Finished: 13s975ms (13s972ms) - First Batch Produced: 15s679ms (1s704ms) - First Batch Sent: 26s663ms (10s984ms) - ExecInternal Finished: 1m24s (58s308ms) MemoryUsage(2s000ms): 50.88 KB, 50.88 KB, 61.71 MB, 246.69 MB, 809.82 MB, 2.59 GB, 4.33 GB, 5.59 GB, 5.81 GB, 5.81 GB, 5.81 GB, 5.81 GB, 5.81 GB, 2.71 GB, 2.39 GB, 4.25 GB, 5.24 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.81 GB (6242380618) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 11.63 GB (12482366368) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 11s120ms - TotalNetworkSendTime: 40s662ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.34K (3344) - TotalThreadsTotalWallClockTime: 1m24s - TotalThreadsSysTime: 11s674ms - TotalThreadsUserTime: 21s172ms - TotalThreadsVoluntaryContextSwitches: 89 (89) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1m10s - ExecTreeExecTime: 8s649ms - OpenTime: 13s972ms - ExecTreeOpenTime: 13s952ms - PrepareTime: 2.265ms - ExecTreePrepareTime: 507.523us DataStreamSender (dst_id=20):(Total: 1m14s, non-child: 1m14s, % non-child: 100.00%) - BytesSent: 30.08 GB (32296416246) - NetworkThroughput(*): 581.11 MB/sec - OverallThroughput: 413.23 MB/sec - PeakMemoryUsage: 34.88 KB (35712) - RowsReturned: 2 (2) - SerializeBatchTime: 21s531ms - TransmitDataRPCTime: 53s002ms - UncompressedRowBatchSize: 32.71 GB (35121986928) UNION_NODE (id=0):(Total: 22s602ms, non-child: 350.115ms, % non-child: 1.55%) ExecOption: Codegen Enabled - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 0 AGGREGATION_NODE (id=19):(Total: 6s595ms, non-child: 5s625ms, % non-child: 85.30%) - BuildTime: 3s925ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=18):(Total: 969.299ms, non-child: 969.299ms, % non-child: 100.00%) - ConvertRowBatchTime: 36.835us - PeakMemoryUsage: 325.25 MB (341052294) - RowsReturned: 13 (13) - RowsReturnedRate: 13.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(1s000ms): 0, 0, 0, 0, 0, 56.70 MB, 224.68 MB, 224.68 MB, 342.45 MB, 342.45 MB, 545.49 MB, 1.39 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794246755) - DeserializeRowBatchTimer: 3s330ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 325.25 MB (341052294) - SendersBlockedTimer: 24s959ms - SendersBlockedTotalTimer(*): 3m43s AGGREGATION_NODE (id=17):(Total: 15s656ms, non-child: 5s505ms, % non-child: 35.16%) - BuildTime: 3s801ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=16):(Total: 10s151ms, non-child: 10s151ms, % non-child: 100.00%) - ConvertRowBatchTime: 43.501us - PeakMemoryUsage: 332.05 MB (348183360) - RowsReturned: 13 (13) - RowsReturnedRate: 1.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 113.39 MB, 113.39 MB, 113.39 MB, 113.39 MB, 113.39 MB, 342.45 MB, 342.45 MB, 342.45 MB, 599.27 MB, 599.27 MB, 734.71 MB, 994.12 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794254942) - DeserializeRowBatchTimer: 3s404ms - FirstBatchArrivalWaitTime: 5s596ms - PeakMemoryUsage: 332.05 MB (348183360) - SendersBlockedTimer: 1s597ms - SendersBlockedTotalTimer(*): 4s599ms CodeGen:(Total: 19.949ms, non-child: 19.949ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.395ms Averaged Fragment F01:(Total: 10s907ms, non-child: 945.510ms, % non-child: 8.67%) split sizes: min: 1.24 GB, max: 1.73 GB, avg: 1.45 GB, stddev: 144.00 MB completion times: min:5s611ms max:13s638ms mean: 10s912ms stddev:2s254ms execution rates: min:118.37 MB/sec max:226.54 MB/sec mean:140.86 MB/sec stddev:27.31 MB/sec num instances: 13 - AverageThreadTokens: 1.96 - BloomFilterBytes: 0 - PeakMemoryUsage: 810.19 MB (849547471) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.22 GB (3459681964) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s965ms - TotalStorageWaitTime: 268.986ms - TotalThreadsInvoluntaryContextSwitches: 1.70K (1704) - TotalThreadsTotalWallClockTime: 21s065ms - TotalThreadsSysTime: 919.628ms - TotalThreadsUserTime: 10s774ms - TotalThreadsVoluntaryContextSwitches: 3.60K (3596) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s142ms - ExecTreeExecTime: 143.529ms - OpenTime: 5s760ms - ExecTreeOpenTime: 5s516ms - PrepareTime: 4.345ms - ExecTreePrepareTime: 602.632us DataStreamSender (dst_id=16):(Total: 4s060ms, non-child: 4s060ms, % non-child: 100.00%) - BytesSent: 131.63 MB (138019610) - NetworkThroughput(*): 74.24 MB/sec - OverallThroughput: 38.38 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 864.105ms - TransmitDataRPCTime: 3s195ms - UncompressedRowBatchSize: 143.14 MB (150094007) AGGREGATION_NODE (id=2):(Total: 5s660ms, non-child: 5s562ms, % non-child: 98.25%) - BuildTime: 5s413ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 476.92 MB (500084984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 98.847ms, non-child: 98.847ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 858.43 MB (900127497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 858.43 MB (900127497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 858.43 MB (900127497) - CachedFileHandlesHitCount: 124 (124) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s121ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 351.23 MB (368290832) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 74.110ms - RowBatchQueuePutWaitTime: 4s827ms - RowsRead: 34.62M (34615384) - RowsReturned: 3.51M (3510215) - RowsReturnedRate: 37.54 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1009) - ScannerThreadsTotalWallClockTime: 10s162ms - MaterializeTupleTime(*): 1s709ms - ScannerThreadsSysTime: 302.952ms - ScannerThreadsUserTime: 4s733ms - ScannerThreadsVoluntaryContextSwitches: 3.19K (3189) - TotalRawHdfsReadTime(*): 656.432ms - TotalReadThroughput: 147.24 MB/sec Buffer pool: - AllocTime: 6.731ms - CumulativeAllocationBytes: 342.74 MB (359389341) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 110.96 MB (116351606) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 240.524ms, non-child: 240.524ms, % non-child: 100.00%) - CodegenTime: 7.984ms - CompileTime: 56.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 151.674ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.726ms Fragment F01: Instance 9b439fc1ee1addb7:82d415690000000a (host=vb0228.foo:22000):(Total: 13s636ms, non-child: 2s119ms, % non-child: 15.54%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB Fragment Instance Lifecycle Event Timeline: 13s636ms - Prepare Finished: 2.850ms (2.850ms) - Open Finished: 6s262ms (6s259ms) - First Batch Produced: 6s406ms (144.799ms) - First Batch Sent: 7s345ms (938.361ms) - ExecInternal Finished: 13s636ms (6s291ms) MemoryUsage(500.000ms): 855.38 KB, 296.02 MB, 420.60 MB, 482.14 MB, 479.27 MB, 484.20 MB, 613.27 MB, 613.05 MB, 602.93 MB, 602.59 MB, 602.68 MB, 854.69 MB, 824.92 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.79 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.10 MB (907128014) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3621254943) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s291ms - TotalStorageWaitTime: 270.045ms - TotalThreadsInvoluntaryContextSwitches: 1.94K (1941) - TotalThreadsTotalWallClockTime: 24s956ms - TotalThreadsSysTime: 928.858ms - TotalThreadsUserTime: 11s973ms - TotalThreadsVoluntaryContextSwitches: 3.50K (3498) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7s374ms - ExecTreeExecTime: 144.793ms - OpenTime: 6s259ms - ExecTreeOpenTime: 6s037ms - PrepareTime: 1.926ms - ExecTreePrepareTime: 302.939us DataStreamSender (dst_id=16):(Total: 5s115ms, non-child: 5s115ms, % non-child: 100.00%) - BytesSent: 140.81 MB (147654663) - NetworkThroughput(*): 33.72 MB/sec - OverallThroughput: 27.53 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 938.342ms - TransmitDataRPCTime: 4s176ms - UncompressedRowBatchSize: 153.13 MB (160567743) AGGREGATION_NODE (id=2):(Total: 6s182ms, non-child: 6s086ms, % non-child: 98.46%) ExecOption: Codegen Enabled - BuildTime: 5s937ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541373528) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 95.472ms, non-child: 95.472ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 150.39 MB, 230.39 MB, 286.39 MB, 411.47 MB, 475.47 MB, 539.47 MB, 586.17 MB, 736.56 MB, 784.56 MB, 848.56 MB, 891.14 MB, 934.77 MB - FooterProcessingTime: (Avg: 289.366us ; Min: 184.074us ; Max: 365.073us ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 1.83 - BytesRead: 934.77 MB (980181299) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.77 MB (980181299) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.77 MB (980181299) - CachedFileHandlesHitCount: 136 (136) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s477ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 355.05 MB (372301313) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 70.579ms - RowBatchQueuePutWaitTime: 5s387ms - RowsRead: 37.69M (37689367) - RowsReturned: 3.76M (3755189) - RowsReturnedRate: 39.33 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1199) - ScannerThreadsTotalWallClockTime: 11s322ms - MaterializeTupleTime(*): 1s915ms - ScannerThreadsSysTime: 318.951ms - ScannerThreadsUserTime: 5s328ms - ScannerThreadsVoluntaryContextSwitches: 3.31K (3314) - TotalRawHdfsReadTime(*): 712.812ms - TotalReadThroughput: 143.81 MB/sec Buffer pool: - AllocTime: 8.440ms - CumulativeAllocationBytes: 376.88 MB (395182080) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 219.257ms, non-child: 219.257ms, % non-child: 100.00%) - CodegenTime: 7.875ms - CompileTime: 53.994ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.937ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 25.714ms Instance 9b439fc1ee1addb7:82d4156900000008 (host=vb0214.foo:22000):(Total: 13s626ms, non-child: 1s977ms, % non-child: 14.51%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB Fragment Instance Lifecycle Event Timeline: 13s628ms - Prepare Finished: 8.565ms (8.565ms) - Open Finished: 6s555ms (6s546ms) - First Batch Produced: 6s726ms (170.787ms) - First Batch Sent: 7s701ms (975.140ms) - ExecInternal Finished: 13s628ms (5s927ms) MemoryUsage(500.000ms): 253.18 MB, 411.53 MB, 413.08 MB, 478.04 MB, 478.19 MB, 603.43 MB, 608.05 MB, 605.78 MB, 605.75 MB, 601.77 MB, 860.61 MB, 863.43 MB, 785.20 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 868.07 MB (910241087) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.54 GB (3800541826) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s686ms - TotalStorageWaitTime: 344.393ms - TotalThreadsInvoluntaryContextSwitches: 1.98K (1980) - TotalThreadsTotalWallClockTime: 25s309ms - TotalThreadsSysTime: 1s085ms - TotalThreadsUserTime: 12s117ms - TotalThreadsVoluntaryContextSwitches: 4.22K (4220) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7s073ms - ExecTreeExecTime: 170.780ms - OpenTime: 6s546ms - ExecTreeOpenTime: 6s312ms - PrepareTime: 6.320ms - ExecTreePrepareTime: 329.727us DataStreamSender (dst_id=16):(Total: 4s934ms, non-child: 4s934ms, % non-child: 100.00%) - BytesSent: 147.07 MB (154214256) - NetworkThroughput(*): 37.15 MB/sec - OverallThroughput: 29.81 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 975.123ms - TransmitDataRPCTime: 3s958ms - UncompressedRowBatchSize: 159.93 MB (167698809) AGGREGATION_NODE (id=2):(Total: 6s483ms, non-child: 6s393ms, % non-child: 98.61%) ExecOption: Codegen Enabled - BuildTime: 6s217ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541409989) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 89.979ms, non-child: 89.979ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:84.62% 1:15.38% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 96.70 MB, 177.13 MB, 280.32 MB, 331.66 MB, 442.85 MB, 478.21 MB, 597.41 MB, 679.94 MB, 751.94 MB, 842.48 MB, 890.48 MB, 933.82 MB, 961.16 MB - FooterProcessingTime: (Avg: 427.815us ; Min: 204.511us ; Max: 1.166ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 961.16 MB (1007851294) - BytesReadDataNodeCache: 0 - BytesReadLocal: 961.16 MB (1007851294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 961.16 MB (1007851294) - CachedFileHandlesHitCount: 139 (139) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s457ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.91 MB (370051920) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 63.644ms - RowBatchQueuePutWaitTime: 5s722ms - RowsRead: 38.76M (38758503) - RowsReturned: 3.92M (3921890) - RowsReturnedRate: 43.59 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.18K (1178) - ScannerThreadsTotalWallClockTime: 11s689ms - MaterializeTupleTime(*): 1s906ms - ScannerThreadsSysTime: 343.947ms - ScannerThreadsUserTime: 5s251ms - ScannerThreadsVoluntaryContextSwitches: 3.62K (3617) - TotalRawHdfsReadTime(*): 701.963ms - TotalReadThroughput: 147.87 MB/sec Buffer pool: - AllocTime: 7.963ms - CumulativeAllocationBytes: 387.88 MB (406716416) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 231.290ms, non-child: 231.290ms, % non-child: 100.00%) - CodegenTime: 7.769ms - CompileTime: 55.472ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.538ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 35.364ms Instance 9b439fc1ee1addb7:82d4156900000003 (host=vb0230.foo:22000):(Total: 13s390ms, non-child: 1s718ms, % non-child: 12.84%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 13s393ms - Prepare Finished: 9.388ms (9.388ms) - Open Finished: 6s981ms (6s971ms) - First Batch Produced: 7s152ms (171.694ms) - First Batch Sent: 8s168ms (1s015ms) - ExecInternal Finished: 13s393ms (5s224ms) MemoryUsage(500.000ms): 216.81 MB, 376.84 MB, 409.22 MB, 473.54 MB, 475.18 MB, 481.25 MB, 608.77 MB, 608.79 MB, 603.36 MB, 608.75 MB, 608.28 MB, 864.97 MB, 845.41 MB, 836.52 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.33 MB (907360497) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.53 GB (3787138653) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s963ms - TotalStorageWaitTime: 290.478ms - TotalThreadsInvoluntaryContextSwitches: 2.03K (2033) - TotalThreadsTotalWallClockTime: 25s603ms - TotalThreadsSysTime: 1s022ms - TotalThreadsUserTime: 13s037ms - TotalThreadsVoluntaryContextSwitches: 4.14K (4143) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s411ms - ExecTreeExecTime: 171.686ms - OpenTime: 6s971ms - ExecTreeOpenTime: 6s735ms - PrepareTime: 5.812ms - ExecTreePrepareTime: 500.996us DataStreamSender (dst_id=16):(Total: 4s530ms, non-child: 4s530ms, % non-child: 100.00%) - BytesSent: 158.28 MB (165964666) - NetworkThroughput(*): 45.04 MB/sec - OverallThroughput: 34.93 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 1s015ms - TransmitDataRPCTime: 3s514ms - UncompressedRowBatchSize: 172.12 MB (180484551) AGGREGATION_NODE (id=2):(Total: 6s907ms, non-child: 6s764ms, % non-child: 97.92%) ExecOption: Codegen Enabled - BuildTime: 6s579ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541410146) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 143.701ms, non-child: 143.701ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:92.86% 1:0% 2:7.143% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 33.20 MB, 182.39 MB, 246.39 MB, 293.09 MB, 411.48 MB, 475.48 MB, 523.48 MB, 582.82 MB, 704.57 MB, 784.57 MB, 864.57 MB, 879.24 MB, 982.44 MB, 1.00 GB - FooterProcessingTime: (Avg: 3.761ms ; Min: 217.408us ; Max: 12.853ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.79 - BytesRead: 1.00 GB (1075606152) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.00 GB (1075606152) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.00 GB (1075606152) - CachedFileHandlesHitCount: 147 (147) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s744ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 351.34 MB (368408435) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.442ms - RowBatchQueuePutWaitTime: 5s862ms - RowsRead: 41.37M (41368075) - RowsReturned: 4.22M (4220849) - RowsReturnedRate: 29.37 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.21K (1208) - ScannerThreadsTotalWallClockTime: 12s219ms - MaterializeTupleTime(*): 2s041ms - ScannerThreadsSysTime: 332.949ms - ScannerThreadsUserTime: 5s710ms - ScannerThreadsVoluntaryContextSwitches: 3.80K (3801) - TotalRawHdfsReadTime(*): 757.455ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 5.327ms - CumulativeAllocationBytes: 396.38 MB (415629312) - CumulativeAllocations: 63 (63) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 233.429ms, non-child: 233.429ms, % non-child: 100.00%) - CodegenTime: 8.544ms - CompileTime: 58.624ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.092ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 35.126ms Instance 9b439fc1ee1addb7:82d4156900000005 (host=vb0220.foo:22000):(Total: 12s044ms, non-child: 627.002ms, % non-child: 5.21%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 12s045ms - Prepare Finished: 3.768ms (3.768ms) - Open Finished: 6s306ms (6s302ms) - First Batch Produced: 6s458ms (152.200ms) - First Batch Sent: 7s342ms (883.893ms) - ExecInternal Finished: 12s045ms (4s702ms) MemoryUsage(500.000ms): 250.73 MB, 380.70 MB, 406.66 MB, 471.07 MB, 475.83 MB, 477.19 MB, 604.70 MB, 605.70 MB, 612.55 MB, 605.21 MB, 604.44 MB, 859.26 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.99 MB (902818478) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3617652252) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s442ms - TotalStorageWaitTime: 401.763ms - TotalThreadsInvoluntaryContextSwitches: 1.90K (1899) - TotalThreadsTotalWallClockTime: 23s742ms - TotalThreadsSysTime: 916.860ms - TotalThreadsUserTime: 11s476ms - TotalThreadsVoluntaryContextSwitches: 3.85K (3849) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s738ms - ExecTreeExecTime: 152.195ms - OpenTime: 6s302ms - ExecTreeOpenTime: 6s077ms - PrepareTime: 3.001ms - ExecTreePrepareTime: 306.899us DataStreamSender (dst_id=16):(Total: 4s965ms, non-child: 4s965ms, % non-child: 100.00%) - BytesSent: 134.10 MB (140616990) - NetworkThroughput(*): 32.87 MB/sec - OverallThroughput: 27.01 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 883.874ms - TransmitDataRPCTime: 4s080ms - UncompressedRowBatchSize: 145.84 MB (152920393) AGGREGATION_NODE (id=2):(Total: 6s229ms, non-child: 6s074ms, % non-child: 97.51%) ExecOption: Codegen Enabled - BuildTime: 5s917ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.30 MB (541376606) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 155.000ms, non-child: 155.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 94.39 MB, 182.39 MB, 230.39 MB, 289.73 MB, 411.47 MB, 475.47 MB, 523.47 MB, 582.80 MB, 712.53 MB, 768.53 MB, 832.53 MB, 879.21 MB - FooterProcessingTime: (Avg: 7.753ms ; Min: 393.442us ; Max: 13.481ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.21 MB (921923583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.21 MB (921923583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.21 MB (921923583) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s224ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 354.52 MB (371739989) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 129.370ms - RowBatchQueuePutWaitTime: 6s104ms - RowsRead: 35.46M (35457025) - RowsReturned: 3.58M (3576349) - RowsReturnedRate: 23.07 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.14K (1142) - ScannerThreadsTotalWallClockTime: 11s700ms - MaterializeTupleTime(*): 1s739ms - ScannerThreadsSysTime: 291.955ms - ScannerThreadsUserTime: 4s905ms - ScannerThreadsVoluntaryContextSwitches: 3.38K (3382) - TotalRawHdfsReadTime(*): 630.521ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 5.822ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 222.803ms, non-child: 222.803ms, % non-child: 100.00%) - CodegenTime: 7.822ms - CompileTime: 53.972ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.627ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.584ms Instance 9b439fc1ee1addb7:82d4156900000006 (host=vb0206.foo:22000):(Total: 12s044ms, non-child: 949.381ms, % non-child: 7.88%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 12s046ms - Prepare Finished: 5.795ms (5.795ms) - Open Finished: 5s890ms (5s884ms) - First Batch Produced: 6s038ms (147.950ms) - First Batch Sent: 6s918ms (880.223ms) - ExecInternal Finished: 12s046ms (5s127ms) MemoryUsage(500.000ms): 216.81 MB, 380.04 MB, 412.88 MB, 475.88 MB, 469.68 MB, 477.17 MB, 605.28 MB, 604.89 MB, 595.54 MB, 602.58 MB, 855.93 MB, 822.84 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 857.98 MB (899657332) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.51 GB (3767381641) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5s127ms - TotalStorageWaitTime: 265.682ms - TotalThreadsInvoluntaryContextSwitches: 1.75K (1747) - TotalThreadsTotalWallClockTime: 23s036ms - TotalThreadsSysTime: 924.858ms - TotalThreadsUserTime: 10s937ms - TotalThreadsVoluntaryContextSwitches: 3.85K (3846) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s155ms - ExecTreeExecTime: 147.945ms - OpenTime: 5s884ms - ExecTreeOpenTime: 5s651ms - PrepareTime: 3.694ms - ExecTreePrepareTime: 495.039us DataStreamSender (dst_id=16):(Total: 5s064ms, non-child: 5s064ms, % non-child: 100.00%) - BytesSent: 136.75 MB (143390548) - NetworkThroughput(*): 32.69 MB/sec - OverallThroughput: 27.00 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 880.201ms - TransmitDataRPCTime: 4s183ms - UncompressedRowBatchSize: 148.71 MB (155931717) AGGREGATION_NODE (id=2):(Total: 5s800ms, non-child: 5s712ms, % non-child: 98.49%) ExecOption: Codegen Enabled - BuildTime: 5s559ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541412360) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 87.617ms, non-child: 87.617ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 25.20 MB, 174.40 MB, 238.40 MB, 286.40 MB, 356.86 MB, 475.46 MB, 531.46 MB, 582.81 MB, 720.54 MB, 784.54 MB, 856.54 MB, 879.24 MB - FooterProcessingTime: (Avg: 545.731us ; Min: 251.186us ; Max: 1.000ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 1.83 - BytesRead: 879.24 MB (921947767) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921947767) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921947767) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s097ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 347.32 MB (364189244) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 59.586ms - RowBatchQueuePutWaitTime: 5s685ms - RowsRead: 35.46M (35458085) - RowsReturned: 3.65M (3646907) - RowsReturnedRate: 41.62 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.03K (1027) - ScannerThreadsTotalWallClockTime: 10s995ms - MaterializeTupleTime(*): 1s714ms - ScannerThreadsSysTime: 286.955ms - ScannerThreadsUserTime: 4s745ms - ScannerThreadsVoluntaryContextSwitches: 3.49K (3490) - TotalRawHdfsReadTime(*): 741.859ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 11.162ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 229.989ms, non-child: 229.989ms, % non-child: 100.00%) - CodegenTime: 7.682ms - CompileTime: 53.962ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.170ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 37.237ms Instance 9b439fc1ee1addb7:82d4156900000009 (host=vb0224.foo:22000):(Total: 11s772ms, non-child: 1s093ms, % non-child: 9.29%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 11s785ms - Prepare Finished: 22.476ms (22.476ms) - Open Finished: 5s564ms (5s541ms) - First Batch Produced: 5s712ms (148.774ms) - First Batch Sent: 6s583ms (870.977ms) - ExecInternal Finished: 11s785ms (5s201ms) MemoryUsage(500.000ms): 855.38 KB, 325.03 MB, 416.79 MB, 481.69 MB, 471.36 MB, 475.18 MB, 604.34 MB, 601.10 MB, 606.78 MB, 606.79 MB, 861.48 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 863.41 MB (905351488) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3782209420) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s953ms - TotalStorageWaitTime: 195.037ms - TotalThreadsInvoluntaryContextSwitches: 1.68K (1684) - TotalThreadsTotalWallClockTime: 21s591ms - TotalThreadsSysTime: 928.857ms - TotalThreadsUserTime: 10s683ms - TotalThreadsVoluntaryContextSwitches: 3.73K (3730) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s221ms - ExecTreeExecTime: 148.768ms - OpenTime: 5s541ms - ExecTreeOpenTime: 5s160ms - PrepareTime: 8.574ms - ExecTreePrepareTime: 1.719ms DataStreamSender (dst_id=16):(Total: 4s989ms, non-child: 4s989ms, % non-child: 100.00%) - BytesSent: 131.73 MB (138125596) - NetworkThroughput(*): 32.00 MB/sec - OverallThroughput: 26.40 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 870.958ms - TransmitDataRPCTime: 4s115ms - UncompressedRowBatchSize: 143.26 MB (150214034) AGGREGATION_NODE (id=2):(Total: 5s310ms, non-child: 5s224ms, % non-child: 98.38%) ExecOption: Codegen Enabled - BuildTime: 5s071ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541369598) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 85.865ms, non-child: 85.865ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 150.40 MB, 222.40 MB, 289.74 MB, 419.48 MB, 499.48 MB, 571.48 MB, 696.55 MB, 768.55 MB, 848.55 MB, 879.24 MB - FooterProcessingTime: (Avg: 3.042ms ; Min: 207.744us ; Max: 16.956ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921949692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921949692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921949692) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s271ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 351.44 MB (368510065) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 61.704ms - RowBatchQueuePutWaitTime: 4s354ms - RowsRead: 35.46M (35458554) - RowsReturned: 3.51M (3513064) - RowsReturnedRate: 40.91 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1015) - ScannerThreadsTotalWallClockTime: 9s828ms - MaterializeTupleTime(*): 1s766ms - ScannerThreadsSysTime: 268.958ms - ScannerThreadsUserTime: 4s983ms - ScannerThreadsVoluntaryContextSwitches: 3.23K (3230) - TotalRawHdfsReadTime(*): 635.478ms - TotalReadThroughput: 159.86 MB/sec Buffer pool: - AllocTime: 3.467ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 378.929ms, non-child: 378.929ms, % non-child: 100.00%) - CodegenTime: 7.419ms - CompileTime: 62.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 285.676ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.225ms Instance 9b439fc1ee1addb7:82d415690000000d (host=vb0234.foo:22000):(Total: 11s535ms, non-child: 959.000ms, % non-child: 8.31%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 11s536ms - Prepare Finished: 4.671ms (4.671ms) - Open Finished: 5s782ms (5s777ms) - First Batch Produced: 5s921ms (138.756ms) - First Batch Sent: 6s767ms (846.583ms) - ExecInternal Finished: 11s536ms (4s768ms) MemoryUsage(500.000ms): 276.63 MB, 375.94 MB, 400.73 MB, 473.75 MB, 480.37 MB, 603.74 MB, 598.50 MB, 601.44 MB, 603.12 MB, 602.99 MB, 856.48 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 857.16 MB (898793743) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.24 GB (3474569233) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s440ms - TotalStorageWaitTime: 238.750ms - TotalThreadsInvoluntaryContextSwitches: 1.72K (1717) - TotalThreadsTotalWallClockTime: 21s760ms - TotalThreadsSysTime: 909.861ms - TotalThreadsUserTime: 10s502ms - TotalThreadsVoluntaryContextSwitches: 3.28K (3278) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s754ms - ExecTreeExecTime: 138.751ms - OpenTime: 5s777ms - ExecTreeOpenTime: 5s552ms - PrepareTime: 3.540ms - ExecTreePrepareTime: 677.984us DataStreamSender (dst_id=16):(Total: 4s662ms, non-child: 4s662ms, % non-child: 100.00%) - BytesSent: 127.69 MB (133891998) - NetworkThroughput(*): 33.48 MB/sec - OverallThroughput: 27.39 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 846.564ms - TransmitDataRPCTime: 3s814ms - UncompressedRowBatchSize: 138.86 MB (145608801) AGGREGATION_NODE (id=2):(Total: 5s691ms, non-child: 5s617ms, % non-child: 98.70%) ExecOption: Codegen Enabled - BuildTime: 5s474ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541366165) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 73.714ms, non-child: 73.714ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 113.12 MB, 177.12 MB, 266.31 MB, 317.67 MB, 420.87 MB, 472.21 MB, 575.41 MB, 618.76 MB, 721.96 MB, 773.29 MB, 813.29 MB - FooterProcessingTime: (Avg: 3.059ms ; Min: 319.610us ; Max: 15.635ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.91 - BytesRead: 816.62 MB (856291544) - BytesReadDataNodeCache: 0 - BytesReadLocal: 816.62 MB (856291544) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 816.62 MB (856291544) - CachedFileHandlesHitCount: 118 (118) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s909ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.94 MB (367983330) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.267ms - RowBatchQueuePutWaitTime: 5s263ms - RowsRead: 32.93M (32928322) - RowsReturned: 3.41M (3405300) - RowsReturnedRate: 46.20 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1013) - ScannerThreadsTotalWallClockTime: 10s228ms - MaterializeTupleTime(*): 1s602ms - ScannerThreadsSysTime: 292.954ms - ScannerThreadsUserTime: 4s420ms - ScannerThreadsVoluntaryContextSwitches: 3.03K (3032) - TotalRawHdfsReadTime(*): 613.635ms - TotalReadThroughput: 147.87 MB/sec Buffer pool: - AllocTime: 5.344ms - CumulativeAllocationBytes: 331.25 MB (347340800) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 223.021ms, non-child: 223.021ms, % non-child: 100.00%) - CodegenTime: 7.237ms - CompileTime: 55.364ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.452ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.588ms Instance 9b439fc1ee1addb7:82d4156900000002 (host=vb0218.foo:22000):(Total: 11s199ms, non-child: 604.581ms, % non-child: 5.40%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 11s202ms - Prepare Finished: 5.417ms (5.417ms) - Open Finished: 5s691ms (5s685ms) - First Batch Produced: 5s834ms (143.491ms) - First Batch Sent: 6s737ms (902.700ms) - ExecInternal Finished: 11s202ms (4s464ms) MemoryUsage(500.000ms): 15.88 KB, 343.63 MB, 416.11 MB, 416.98 MB, 474.71 MB, 482.79 MB, 608.70 MB, 608.92 MB, 605.83 MB, 605.68 MB, 863.08 MB, 839.93 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 864.11 MB (906088388) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3783367163) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s151ms - TotalStorageWaitTime: 209.443ms - TotalThreadsInvoluntaryContextSwitches: 1.71K (1706) - TotalThreadsTotalWallClockTime: 21s547ms - TotalThreadsSysTime: 978.849ms - TotalThreadsUserTime: 10s574ms - TotalThreadsVoluntaryContextSwitches: 3.94K (3943) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s510ms - ExecTreeExecTime: 143.486ms - OpenTime: 5s685ms - ExecTreeOpenTime: 5s455ms - PrepareTime: 3.246ms - ExecTreePrepareTime: 505.609us DataStreamSender (dst_id=16):(Total: 4s768ms, non-child: 4s768ms, % non-child: 100.00%) - BytesSent: 135.44 MB (142019088) - NetworkThroughput(*): 35.05 MB/sec - OverallThroughput: 28.40 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 902.680ms - TransmitDataRPCTime: 3s864ms - UncompressedRowBatchSize: 147.29 MB (154441584) AGGREGATION_NODE (id=2):(Total: 5s599ms, non-child: 5s520ms, % non-child: 98.58%) ExecOption: Codegen Enabled - BuildTime: 5s371ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541369431) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 79.304ms, non-child: 79.304ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 158.40 MB, 206.40 MB, 286.40 MB, 403.48 MB, 475.48 MB, 539.48 MB, 586.16 MB, 744.55 MB, 808.55 MB, 856.55 MB, 879.24 MB - FooterProcessingTime: (Avg: 1.320ms ; Min: 201.182us ; Max: 6.083ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 879.24 MB (921948124) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921948124) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921948124) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s108ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.38 MB (369494900) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 49.400ms - RowBatchQueuePutWaitTime: 5s081ms - RowsRead: 35.46M (35459311) - RowsReturned: 3.61M (3611897) - RowsReturnedRate: 45.54 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 982 (982) - ScannerThreadsTotalWallClockTime: 10s350ms - MaterializeTupleTime(*): 1s722ms - ScannerThreadsSysTime: 317.950ms - ScannerThreadsUserTime: 4s629ms - ScannerThreadsVoluntaryContextSwitches: 3.50K (3505) - TotalRawHdfsReadTime(*): 709.013ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 4.532ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 227.258ms, non-child: 227.258ms, % non-child: 100.00%) - CodegenTime: 7.570ms - CompileTime: 55.160ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.197ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.263ms Instance 9b439fc1ee1addb7:82d4156900000004 (host=vb0222.foo:22000):(Total: 9s935ms, non-child: 454.647ms, % non-child: 4.58%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 9s938ms - Prepare Finished: 5.241ms (5.241ms) - Open Finished: 5s283ms (5s278ms) - First Batch Produced: 5s417ms (133.789ms) - First Batch Sent: 6s212ms (795.260ms) - ExecInternal Finished: 9s938ms (3s725ms) MemoryUsage(500.000ms): 216.04 MB, 378.08 MB, 410.61 MB, 475.54 MB, 474.07 MB, 594.18 MB, 600.86 MB, 598.80 MB, 600.42 MB, 594.72 MB, 737.56 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 810.28 MB (849636862) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.10 GB (3327786148) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s724ms - TotalStorageWaitTime: 277.949ms - TotalThreadsInvoluntaryContextSwitches: 1.50K (1505) - TotalThreadsTotalWallClockTime: 18s735ms - TotalThreadsSysTime: 870.866ms - TotalThreadsUserTime: 9s819ms - TotalThreadsVoluntaryContextSwitches: 3.25K (3249) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4s654ms - ExecTreeExecTime: 133.782ms - OpenTime: 5s278ms - ExecTreeOpenTime: 5s026ms - PrepareTime: 2.827ms - ExecTreePrepareTime: 196.645us DataStreamSender (dst_id=16):(Total: 4s072ms, non-child: 4s072ms, % non-child: 100.00%) - BytesSent: 121.60 MB (127503415) - NetworkThroughput(*): 37.11 MB/sec - OverallThroughput: 29.85 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 795.236ms - TransmitDataRPCTime: 3s276ms - UncompressedRowBatchSize: 132.23 MB (138652919) AGGREGATION_NODE (id=2):(Total: 5s160ms, non-child: 5s029ms, % non-child: 97.45%) ExecOption: Codegen Enabled - BuildTime: 4s891ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541368056) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 131.419ms, non-child: 131.419ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 174.40 MB, 246.40 MB, 293.06 MB, 423.90 MB, 513.76 MB, 577.76 MB, 676.29 MB, 727.62 MB, 783.62 MB, 786.96 MB - FooterProcessingTime: (Avg: 7.554ms ; Min: 245.867us ; Max: 21.766ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.73 - BytesRead: 786.96 MB (825192372) - BytesReadDataNodeCache: 0 - BytesReadLocal: 786.96 MB (825192372) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 786.96 MB (825192372) - CachedFileHandlesHitCount: 115 (115) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s879ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 345.30 MB (362073541) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 110.072ms - RowBatchQueuePutWaitTime: 3s881ms - RowsRead: 31.73M (31733865) - RowsReturned: 3.24M (3242551) - RowsReturnedRate: 24.67 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 863 (863) - ScannerThreadsTotalWallClockTime: 8s802ms - MaterializeTupleTime(*): 1s547ms - ScannerThreadsSysTime: 300.953ms - ScannerThreadsUserTime: 4s315ms - ScannerThreadsVoluntaryContextSwitches: 2.95K (2953) - TotalRawHdfsReadTime(*): 584.094ms - TotalReadThroughput: 143.08 MB/sec Buffer pool: - AllocTime: 3.969ms - CumulativeAllocationBytes: 319.75 MB (335282176) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 247.488ms, non-child: 247.488ms, % non-child: 100.00%) - CodegenTime: 11.061ms - CompileTime: 60.576ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 154.077ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 32.066ms Instance 9b439fc1ee1addb7:82d4156900000001 (host=vb0216.foo:22000):(Total: 9s935ms, non-child: 620.670ms, % non-child: 6.25%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB Fragment Instance Lifecycle Event Timeline: 9s937ms - Prepare Finished: 8.197ms (8.197ms) - Open Finished: 6s055ms (6s047ms) - First Batch Produced: 6s206ms (150.669ms) - First Batch Sent: 7s082ms (876.720ms) - ExecInternal Finished: 9s937ms (2s854ms) MemoryUsage(500.000ms): 15.88 KB, 290.98 MB, 400.31 MB, 447.87 MB, 475.14 MB, 477.33 MB, 597.70 MB, 599.87 MB, 600.48 MB, 600.44 MB, 602.63 MB, 862.71 MB, 751.35 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 863.85 MB (905814815) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3784557319) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s514ms - TotalStorageWaitTime: 312.279ms - TotalThreadsInvoluntaryContextSwitches: 1.73K (1732) - TotalThreadsTotalWallClockTime: 20s230ms - TotalThreadsSysTime: 987.849ms - TotalThreadsUserTime: 11s135ms - TotalThreadsVoluntaryContextSwitches: 3.73K (3733) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 3s882ms - ExecTreeExecTime: 150.663ms - OpenTime: 6s047ms - ExecTreeOpenTime: 5s813ms - PrepareTime: 6.187ms - ExecTreePrepareTime: 468.167us DataStreamSender (dst_id=16):(Total: 3s119ms, non-child: 3s119ms, % non-child: 100.00%) - BytesSent: 135.22 MB (141790096) - NetworkThroughput(*): 60.35 MB/sec - OverallThroughput: 43.35 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 876.702ms - TransmitDataRPCTime: 2s240ms - UncompressedRowBatchSize: 147.05 MB (154191767) AGGREGATION_NODE (id=2):(Total: 5s964ms, non-child: 5s880ms, % non-child: 98.59%) ExecOption: Codegen Enabled - BuildTime: 5s724ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541408161) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 84.123ms, non-child: 84.123ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 125.36 MB, 177.37 MB, 291.91 MB, 371.23 MB, 427.55 MB, 541.29 MB, 605.29 MB, 669.29 MB, 720.65 MB, 795.20 MB, 851.20 MB, 870.55 MB - FooterProcessingTime: (Avg: 3.335ms ; Min: 241.042us ; Max: 12.984ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.67 - BytesRead: 870.55 MB (912842440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 870.55 MB (912842440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 870.55 MB (912842440) - CachedFileHandlesHitCount: 128 (128) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s149ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.51 MB (367540932) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 59.211ms - RowBatchQueuePutWaitTime: 4s839ms - RowsRead: 35.10M (35096614) - RowsReturned: 3.61M (3606066) - RowsReturnedRate: 42.87 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1015) - ScannerThreadsTotalWallClockTime: 10s300ms - MaterializeTupleTime(*): 1s755ms - ScannerThreadsSysTime: 318.951ms - ScannerThreadsUserTime: 4s815ms - ScannerThreadsVoluntaryContextSwitches: 3.17K (3169) - TotalRawHdfsReadTime(*): 693.491ms - TotalReadThroughput: 133.93 MB/sec Buffer pool: - AllocTime: 8.841ms - CumulativeAllocationBytes: 367.38 MB (385220608) - CumulativeAllocations: 59 (59) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 112.50 MB (117964800) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 230.930ms, non-child: 230.930ms, % non-child: 100.00%) - CodegenTime: 7.853ms - CompileTime: 56.275ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.015ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 33.996ms Instance 9b439fc1ee1addb7:82d415690000000b (host=vb0212.foo:22000):(Total: 8s536ms, non-child: 426.747ms, % non-child: 5.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 8s536ms - Prepare Finished: 2.059ms (2.059ms) - Open Finished: 4s930ms (4s928ms) - First Batch Produced: 5s047ms (116.622ms) - First Batch Sent: 5s767ms (720.741ms) - ExecInternal Finished: 8s536ms (2s768ms) MemoryUsage(500.000ms): 855.38 KB, 372.71 MB, 410.01 MB, 472.63 MB, 471.85 MB, 478.50 MB, 605.53 MB, 605.93 MB, 599.11 MB, 598.67 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 612.39 MB (642137708) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.37 GB (2543089953) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s767ms - TotalStorageWaitTime: 216.877ms - TotalThreadsInvoluntaryContextSwitches: 1.39K (1387) - TotalThreadsTotalWallClockTime: 16s662ms - TotalThreadsSysTime: 717.889ms - TotalThreadsUserTime: 9s149ms - TotalThreadsVoluntaryContextSwitches: 2.95K (2952) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 3s605ms - ExecTreeExecTime: 116.614ms - OpenTime: 4s928ms - ExecTreeOpenTime: 4s707ms - PrepareTime: 1.643ms - ExecTreePrepareTime: 319.747us DataStreamSender (dst_id=16):(Total: 3s066ms, non-child: 3s066ms, % non-child: 100.00%) - BytesSent: 111.29 MB (116692088) - NetworkThroughput(*): 47.45 MB/sec - OverallThroughput: 36.29 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 720.720ms - TransmitDataRPCTime: 2s345ms - UncompressedRowBatchSize: 121.02 MB (126901687) AGGREGATION_NODE (id=2):(Total: 4s824ms, non-child: 4s725ms, % non-child: 97.94%) ExecOption: Codegen Enabled - BuildTime: 4s604ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.29 MB (272934880) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 99.169ms, non-child: 99.169ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0, 166.39 MB, 222.39 MB, 286.39 MB, 411.47 MB, 475.47 MB, 539.47 MB, 586.17 MB, 681.37 MB, 732.71 MB - FooterProcessingTime: (Avg: 2.141ms ; Min: 184.026us ; Max: 9.565ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 732.71 MB (768298333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 732.71 MB (768298333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 732.71 MB (768298333) - CachedFileHandlesHitCount: 105 (105) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s617ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 353.31 MB (370468016) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 79.318ms - RowBatchQueuePutWaitTime: 3s661ms - RowsRead: 29.55M (29548778) - RowsReturned: 2.97M (2967885) - RowsReturnedRate: 29.93 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 806 (806) - ScannerThreadsTotalWallClockTime: 8s127ms - MaterializeTupleTime(*): 1s433ms - ScannerThreadsSysTime: 241.962ms - ScannerThreadsUserTime: 3s970ms - ScannerThreadsVoluntaryContextSwitches: 2.49K (2491) - TotalRawHdfsReadTime(*): 572.336ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 5.583ms - CumulativeAllocationBytes: 283.12 MB (296878080) - CumulativeAllocations: 45 (45) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 218.673ms, non-child: 218.673ms, % non-child: 100.00%) - CodegenTime: 7.395ms - CompileTime: 54.486ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 137.736ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 25.848ms Instance 9b439fc1ee1addb7:82d4156900000007 (host=vb0208.foo:22000):(Total: 8s530ms, non-child: 549.344ms, % non-child: 6.44%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB Fragment Instance Lifecycle Event Timeline: 8s532ms - Prepare Finished: 7.931ms (7.931ms) - Open Finished: 5s358ms (5s350ms) - First Batch Produced: 5s488ms (130.485ms) - First Batch Sent: 6s263ms (775.228ms) - ExecInternal Finished: 8s532ms (2s268ms) MemoryUsage(500.000ms): 15.88 KB, 372.96 MB, 416.55 MB, 480.47 MB, 481.10 MB, 475.95 MB, 605.59 MB, 606.61 MB, 600.44 MB, 593.70 MB, 606.73 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 734.73 MB (770417199) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.79 GB (2991089100) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s054ms - TotalStorageWaitTime: 300.962ms - TotalThreadsInvoluntaryContextSwitches: 1.53K (1526) - TotalThreadsTotalWallClockTime: 17s406ms - TotalThreadsSysTime: 890.863ms - TotalThreadsUserTime: 9s919ms - TotalThreadsVoluntaryContextSwitches: 3.23K (3227) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 3s174ms - ExecTreeExecTime: 130.478ms - OpenTime: 5s350ms - ExecTreeOpenTime: 5s114ms - PrepareTime: 5.614ms - ExecTreePrepareTime: 1.614ms DataStreamSender (dst_id=16):(Total: 2s501ms, non-child: 2s501ms, % non-child: 100.00%) - BytesSent: 117.78 MB (123496168) - NetworkThroughput(*): 68.25 MB/sec - OverallThroughput: 47.08 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 775.206ms - TransmitDataRPCTime: 1s725ms - UncompressedRowBatchSize: 128.08 MB (134303344) AGGREGATION_NODE (id=2):(Total: 5s247ms, non-child: 5s149ms, % non-child: 98.14%) ExecOption: Codegen Enabled - BuildTime: 5s014ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541369184) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 97.508ms, non-child: 97.508ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 165.06 MB, 259.68 MB, 311.01 MB, 409.55 MB, 504.74 MB, 568.74 MB, 612.10 MB, 710.65 MB, 758.65 MB, 777.99 MB - FooterProcessingTime: (Avg: 5.826ms ; Min: 203.691us ; Max: 18.326ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 1.70 - BytesRead: 777.99 MB (815780517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 777.99 MB (815780517) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 777.99 MB (815780517) - CachedFileHandlesHitCount: 113 (113) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s889ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.27 MB (367284614) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 74.221ms - RowBatchQueuePutWaitTime: 3s892ms - RowsRead: 31.37M (31367379) - RowsReturned: 3.14M (3140888) - RowsReturnedRate: 32.21 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 890 (890) - ScannerThreadsTotalWallClockTime: 8s882ms - MaterializeTupleTime(*): 1s572ms - ScannerThreadsSysTime: 294.954ms - ScannerThreadsUserTime: 4s356ms - ScannerThreadsVoluntaryContextSwitches: 2.80K (2798) - TotalRawHdfsReadTime(*): 606.813ms - TotalReadThroughput: 141.45 MB/sec Buffer pool: - AllocTime: 7.791ms - CumulativeAllocationBytes: 319.25 MB (334757888) - CumulativeAllocations: 51 (51) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 112.50 MB (117964800) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 232.527ms, non-child: 232.527ms, % non-child: 100.00%) - CodegenTime: 7.784ms - CompileTime: 58.528ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.569ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 32.513ms Instance 9b439fc1ee1addb7:82d415690000000c (host=vb0232.foo:22000):(Total: 5s608ms, non-child: 191.402ms, % non-child: 3.41%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 5s610ms - Prepare Finished: 6.449ms (6.449ms) - Open Finished: 4s314ms (4s307ms) - First Batch Produced: 4s430ms (115.938ms) - First Batch Sent: 5s182ms (752.025ms) - ExecInternal Finished: 5s610ms (428.160ms) MemoryUsage(500.000ms): 216.81 MB, 345.87 MB, 416.55 MB, 479.39 MB, 479.25 MB, 599.25 MB, 598.70 MB, 599.63 MB, 503.05 MB, 381.58 MB, 381.58 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1 - AverageThreadTokens: 2.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 609.08 MB (638671522) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.51 GB (2695227883) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 427.885ms - TotalStorageWaitTime: 173.167ms - TotalThreadsInvoluntaryContextSwitches: 1.29K (1295) - TotalThreadsTotalWallClockTime: 13s266ms - TotalThreadsSysTime: 790.878ms - TotalThreadsUserTime: 8s749ms - TotalThreadsVoluntaryContextSwitches: 3.09K (3089) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s296ms - ExecTreeExecTime: 115.935ms - OpenTime: 4s307ms - ExecTreeOpenTime: 4s073ms - PrepareTime: 4.104ms - ExecTreePrepareTime: 395.612us DataStreamSender (dst_id=16):(Total: 995.448ms, non-child: 995.448ms, % non-child: 100.00%) - BytesSent: 113.39 MB (118895370) - NetworkThroughput(*): 469.91 MB/sec - OverallThroughput: 113.91 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 752.002ms - TransmitDataRPCTime: 241.294ms - UncompressedRowBatchSize: 123.31 MB (129304747) AGGREGATION_NODE (id=2):(Total: 4s189ms, non-child: 4s127ms, % non-child: 98.52%) ExecOption: Codegen Enabled - BuildTime: 4s007ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.29 MB (272936696) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 62.144ms, non-child: 62.144ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:77.78% 1:11.11% 2:11.11% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 32.57 MB, 169.92 MB, 289.12 MB, 395.65 MB, 462.99 MB, 566.18 MB, 657.59 MB, 724.74 MB, 736.09 MB - FooterProcessingTime: (Avg: 384.642us ; Min: 228.089us ; Max: 612.828us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 736.09 MB (771844345) - BytesReadDataNodeCache: 0 - BytesReadLocal: 736.09 MB (771844345) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 736.09 MB (771844345) - CachedFileHandlesHitCount: 108 (108) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s753ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.70 MB (367734517) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 43.617ms - RowBatchQueuePutWaitTime: 3s015ms - RowsRead: 29.68M (29676122) - RowsReturned: 3.02M (3023972) - RowsReturnedRate: 48.66 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 779 (779) - ScannerThreadsTotalWallClockTime: 7s663ms - MaterializeTupleTime(*): 1s505ms - ScannerThreadsSysTime: 326.949ms - ScannerThreadsUserTime: 4s105ms - ScannerThreadsVoluntaryContextSwitches: 2.69K (2686) - TotalRawHdfsReadTime(*): 574.149ms - TotalReadThroughput: 163.58 MB/sec Buffer pool: - AllocTime: 9.266ms - CumulativeAllocationBytes: 314.75 MB (330039296) - CumulativeAllocations: 50 (50) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 231.217ms, non-child: 231.217ms, % non-child: 100.00%) - CodegenTime: 7.776ms - CompileTime: 54.983ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.675ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 35.909ms Averaged Fragment F03:(Total: 27s702ms, non-child: 17s643ms, % non-child: 63.69%) split sizes: min: 1.24 GB, max: 1.73 GB, avg: 1.45 GB, stddev: 144.00 MB completion times: min:5s871ms max:31s738ms mean: 27s746ms stddev:6s477ms execution rates: min:42.33 MB/sec max:216.52 MB/sec mean:63.50 MB/sec stddev:44.34 MB/sec num instances: 13 - AverageThreadTokens: 1.44 - BloomFilterBytes: 0 - PeakMemoryUsage: 809.32 MB (848631781) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.22 GB (3459681964) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s816ms - TotalStorageWaitTime: 240.193ms - TotalThreadsInvoluntaryContextSwitches: 1.68K (1676) - TotalThreadsTotalWallClockTime: 37s840ms - TotalThreadsSysTime: 915.859ms - TotalThreadsUserTime: 10s682ms - TotalThreadsVoluntaryContextSwitches: 3.61K (3606) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s975ms - ExecTreeExecTime: 143.419ms - OpenTime: 5s722ms - ExecTreeOpenTime: 5s481ms - PrepareTime: 4.263ms - ExecTreePrepareTime: 827.165us DataStreamSender (dst_id=18):(Total: 4s195ms, non-child: 4s195ms, % non-child: 100.00%) - BytesSent: 131.63 MB (138018981) - NetworkThroughput(*): 84.37 MB/sec - OverallThroughput: 40.56 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 863.711ms - TransmitDataRPCTime: 3s330ms - UncompressedRowBatchSize: 143.14 MB (150094007) AGGREGATION_NODE (id=4):(Total: 5s625ms, non-child: 5s537ms, % non-child: 98.42%) - BuildTime: 5s389ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 476.93 MB (500094484) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 88.793ms, non-child: 88.793ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.88 - BytesRead: 858.43 MB (900127497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 858.43 MB (900127497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 858.43 MB (900127497) - CachedFileHandlesHitCount: 124 (124) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s071ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.96 MB (368004590) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 63.499ms - RowBatchQueuePutWaitTime: 4s905ms - RowsRead: 34.62M (34615384) - RowsReturned: 3.51M (3510215) - RowsReturnedRate: 41.12 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 994 (994) - ScannerThreadsTotalWallClockTime: 10s142ms - MaterializeTupleTime(*): 1s694ms - ScannerThreadsSysTime: 299.415ms - ScannerThreadsUserTime: 4s665ms - ScannerThreadsVoluntaryContextSwitches: 3.20K (3203) - TotalRawHdfsReadTime(*): 676.495ms - TotalReadThroughput: 150.75 MB/sec Buffer pool: - AllocTime: 7.641ms - CumulativeAllocationBytes: 342.74 MB (359389341) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 112.31 MB (117763150) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 237.658ms, non-child: 237.658ms, % non-child: 100.00%) - CodegenTime: 8.258ms - CompileTime: 55.852ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 149.891ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.247ms Fragment F03: Instance 9b439fc1ee1addb7:82d4156900000014 (host=vb0208.foo:22000):(Total: 31s734ms, non-child: 23s522ms, % non-child: 74.12%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB Fragment Instance Lifecycle Event Timeline: 31s737ms - Prepare Finished: 8.128ms (8.128ms) - Open Finished: 5s248ms (5s240ms) - First Batch Produced: 5s381ms (132.887ms) - First Batch Sent: 6s160ms (779.175ms) - ExecInternal Finished: 31s737ms (25s576ms) MemoryUsage(1s000ms): 187.55 MB, 442.47 MB, 475.14 MB, 604.76 MB, 606.40 MB, 688.26 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB ThreadUsage(1s000ms): 2, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 734.18 MB (769843695) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.79 GB (2991089100) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25s572ms - TotalStorageWaitTime: 182.445ms - TotalThreadsInvoluntaryContextSwitches: 1.52K (1518) - TotalThreadsTotalWallClockTime: 40s399ms - TotalThreadsSysTime: 918.859ms - TotalThreadsUserTime: 9s751ms - TotalThreadsVoluntaryContextSwitches: 3.20K (3196) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 26s488ms - ExecTreeExecTime: 132.878ms - OpenTime: 5s240ms - ExecTreeOpenTime: 5s015ms - PrepareTime: 5.292ms - ExecTreePrepareTime: 1.371ms DataStreamSender (dst_id=18):(Total: 2s840ms, non-child: 2s840ms, % non-child: 100.00%) - BytesSent: 117.77 MB (123495046) - NetworkThroughput(*): 57.15 MB/sec - OverallThroughput: 41.46 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 779.154ms - TransmitDataRPCTime: 2s060ms - UncompressedRowBatchSize: 128.08 MB (134303344) AGGREGATION_NODE (id=4):(Total: 5s150ms, non-child: 5s077ms, % non-child: 98.60%) ExecOption: Codegen Enabled - BuildTime: 4s941ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541410059) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 72.351ms, non-child: 72.351ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 132.48 MB, 243.68 MB, 299.68 MB, 398.22 MB, 504.77 MB, 560.77 MB, 612.12 MB, 710.65 MB, 774.65 MB, 777.99 MB - FooterProcessingTime: (Avg: 302.684us ; Min: 252.386us ; Max: 359.115us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 1.70 - BytesRead: 777.99 MB (815780517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 777.99 MB (815780517) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 777.99 MB (815780517) - CachedFileHandlesHitCount: 113 (113) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s854ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 349.92 MB (366919638) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 48.591ms - RowBatchQueuePutWaitTime: 3s859ms - RowsRead: 31.37M (31367379) - RowsReturned: 3.14M (3140888) - RowsReturnedRate: 43.41 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 869 (869) - ScannerThreadsTotalWallClockTime: 8s670ms - MaterializeTupleTime(*): 1s562ms - ScannerThreadsSysTime: 310.952ms - ScannerThreadsUserTime: 4s277ms - ScannerThreadsVoluntaryContextSwitches: 2.71K (2711) - TotalRawHdfsReadTime(*): 599.729ms - TotalReadThroughput: 141.45 MB/sec Buffer pool: - AllocTime: 6.593ms - CumulativeAllocationBytes: 319.25 MB (334757888) - CumulativeAllocations: 51 (51) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 112.50 MB (117964800) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 220.756ms, non-child: 220.756ms, % non-child: 100.00%) - CodegenTime: 8.660ms - CompileTime: 53.905ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.047ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 27.148ms Instance 9b439fc1ee1addb7:82d4156900000010 (host=vb0230.foo:22000):(Total: 31s731ms, non-child: 20s053ms, % non-child: 63.20%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 31s733ms - Prepare Finished: 9.349ms (9.349ms) - Open Finished: 6s817ms (6s808ms) - First Batch Produced: 6s993ms (175.986ms) - First Batch Sent: 8s017ms (1s024ms) - ExecInternal Finished: 31s733ms (23s716ms) MemoryUsage(500.000ms): 222.72 MB, 378.83 MB, 411.50 MB, 476.09 MB, 473.24 MB, 601.52 MB, 601.51 MB, 588.47 MB, 607.84 MB, 607.69 MB, 864.06 MB, 856.26 MB, 859.65 MB, 600.32 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 864.75 MB (906758920) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.53 GB (3787138653) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s445ms - TotalStorageWaitTime: 300.947ms - TotalThreadsInvoluntaryContextSwitches: 1.97K (1969) - TotalThreadsTotalWallClockTime: 43s563ms - TotalThreadsSysTime: 1s024ms - TotalThreadsUserTime: 12s703ms - TotalThreadsVoluntaryContextSwitches: 3.97K (3966) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24s916ms - ExecTreeExecTime: 175.982ms - OpenTime: 6s808ms - ExecTreeOpenTime: 6s578ms - PrepareTime: 5.172ms - ExecTreePrepareTime: 394.631us DataStreamSender (dst_id=18):(Total: 4s695ms, non-child: 4s695ms, % non-child: 100.00%) - BytesSent: 158.28 MB (165967859) - NetworkThroughput(*): 43.12 MB/sec - OverallThroughput: 33.71 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 1s024ms - TransmitDataRPCTime: 3s670ms - UncompressedRowBatchSize: 172.12 MB (180484551) AGGREGATION_NODE (id=4):(Total: 6s754ms, non-child: 6s656ms, % non-child: 98.54%) ExecOption: Codegen Enabled - BuildTime: 6s474ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541372054) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 98.388ms, non-child: 98.388ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:7.692% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 63.78 MB, 190.39 MB, 254.39 MB, 293.06 MB, 451.46 MB, 499.46 MB, 563.46 MB, 619.33 MB, 752.55 MB, 816.55 MB, 872.55 MB, 942.42 MB, 1006.42 MB - FooterProcessingTime: (Avg: 2.276ms ; Min: 257.286us ; Max: 9.604ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.85 - BytesRead: 1.00 GB (1075606152) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.00 GB (1075606152) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.00 GB (1075606152) - CachedFileHandlesHitCount: 147 (147) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s606ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 349.66 MB (366642193) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 71.692ms - RowBatchQueuePutWaitTime: 5s688ms - RowsRead: 41.37M (41368075) - RowsReturned: 4.22M (4220849) - RowsReturnedRate: 42.90 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1157) - ScannerThreadsTotalWallClockTime: 11s838ms - MaterializeTupleTime(*): 1s989ms - ScannerThreadsSysTime: 324.950ms - ScannerThreadsUserTime: 5s492ms - ScannerThreadsVoluntaryContextSwitches: 3.69K (3695) - TotalRawHdfsReadTime(*): 766.463ms - TotalReadThroughput: 154.83 MB/sec Buffer pool: - AllocTime: 9.844ms - CumulativeAllocationBytes: 396.38 MB (415629312) - CumulativeAllocations: 63 (63) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 226.623ms, non-child: 226.623ms, % non-child: 100.00%) - CodegenTime: 7.487ms - CompileTime: 54.932ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.455ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.656ms Instance 9b439fc1ee1addb7:82d4156900000017 (host=vb0228.foo:22000):(Total: 31s466ms, non-child: 20s013ms, % non-child: 63.60%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB Fragment Instance Lifecycle Event Timeline: 31s467ms - Prepare Finished: 3.042ms (3.042ms) - Open Finished: 6s469ms (6s466ms) - First Batch Produced: 6s628ms (158.845ms) - First Batch Sent: 7s549ms (921.309ms) - ExecInternal Finished: 31s467ms (23s918ms) MemoryUsage(500.000ms): 855.38 KB, 288.09 MB, 419.97 MB, 485.86 MB, 475.11 MB, 475.07 MB, 603.44 MB, 603.28 MB, 604.36 MB, 612.60 MB, 613.75 MB, 864.36 MB, 863.48 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 867.05 MB (909167302) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3621254943) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s601ms - TotalStorageWaitTime: 241.877ms - TotalThreadsInvoluntaryContextSwitches: 1.87K (1874) - TotalThreadsTotalWallClockTime: 43s223ms - TotalThreadsSysTime: 1s006ms - TotalThreadsUserTime: 12s118ms - TotalThreadsVoluntaryContextSwitches: 3.86K (3864) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24s998ms - ExecTreeExecTime: 158.836ms - OpenTime: 6s466ms - ExecTreeOpenTime: 6s243ms - PrepareTime: 1.637ms - ExecTreePrepareTime: 325.429us DataStreamSender (dst_id=18):(Total: 4s830ms, non-child: 4s830ms, % non-child: 100.00%) - BytesSent: 140.81 MB (147655053) - NetworkThroughput(*): 36.03 MB/sec - OverallThroughput: 29.15 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 921.287ms - TransmitDataRPCTime: 3s908ms - UncompressedRowBatchSize: 153.13 MB (160567743) AGGREGATION_NODE (id=4):(Total: 6s402ms, non-child: 6s310ms, % non-child: 98.56%) ExecOption: Codegen Enabled - BuildTime: 6s145ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541372425) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 91.966ms, non-child: 91.966ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 150.40 MB, 230.40 MB, 289.73 MB, 419.48 MB, 475.48 MB, 531.48 MB, 582.82 MB, 704.56 MB, 768.56 MB, 832.56 MB, 875.90 MB, 931.14 MB - FooterProcessingTime: (Avg: 2.119ms ; Min: 205.794us ; Max: 13.164ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 934.77 MB (980181299) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.77 MB (980181299) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.77 MB (980181299) - CachedFileHandlesHitCount: 136 (136) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s500ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 354.96 MB (372202774) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 62.537ms - RowBatchQueuePutWaitTime: 5s845ms - RowsRead: 37.69M (37689367) - RowsReturned: 3.76M (3755189) - RowsReturnedRate: 40.83 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.12K (1122) - ScannerThreadsTotalWallClockTime: 11s759ms - MaterializeTupleTime(*): 1s912ms - ScannerThreadsSysTime: 348.946ms - ScannerThreadsUserTime: 5s312ms - ScannerThreadsVoluntaryContextSwitches: 3.33K (3330) - TotalRawHdfsReadTime(*): 709.689ms - TotalReadThroughput: 143.25 MB/sec Buffer pool: - AllocTime: 7.163ms - CumulativeAllocationBytes: 376.88 MB (395182080) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 220.556ms, non-child: 220.556ms, % non-child: 100.00%) - CodegenTime: 8.061ms - CompileTime: 54.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.625ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 26.667ms Instance 9b439fc1ee1addb7:82d4156900000015 (host=vb0214.foo:22000):(Total: 30s051ms, non-child: 18s722ms, % non-child: 62.30%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB Fragment Instance Lifecycle Event Timeline: 30s055ms - Prepare Finished: 11.034ms (11.034ms) - Open Finished: 6s526ms (6s515ms) - First Batch Produced: 6s691ms (165.014ms) - First Batch Sent: 7s666ms (975.268ms) - ExecInternal Finished: 30s055ms (22s388ms) MemoryUsage(500.000ms): 256.67 MB, 419.65 MB, 418.39 MB, 466.13 MB, 476.68 MB, 606.90 MB, 603.44 MB, 600.76 MB, 606.57 MB, 606.41 MB, 863.73 MB, 845.40 MB, 760.43 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.04 MB (907062070) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.54 GB (3800541826) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s105ms - TotalStorageWaitTime: 369.264ms - TotalThreadsInvoluntaryContextSwitches: 1.91K (1908) - TotalThreadsTotalWallClockTime: 41s559ms - TotalThreadsSysTime: 1s085ms - TotalThreadsUserTime: 12s042ms - TotalThreadsVoluntaryContextSwitches: 4.15K (4147) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 23s528ms - ExecTreeExecTime: 165.006ms - OpenTime: 6s515ms - ExecTreeOpenTime: 6s284ms - PrepareTime: 7.462ms - ExecTreePrepareTime: 3.033ms DataStreamSender (dst_id=18):(Total: 4s648ms, non-child: 4s648ms, % non-child: 100.00%) - BytesSent: 147.07 MB (154211034) - NetworkThroughput(*): 40.06 MB/sec - OverallThroughput: 31.64 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 975.248ms - TransmitDataRPCTime: 3s671ms - UncompressedRowBatchSize: 159.93 MB (167698809) AGGREGATION_NODE (id=4):(Total: 6s452ms, non-child: 6s322ms, % non-child: 97.99%) ExecOption: Codegen Enabled - BuildTime: 6s155ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541416306) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 129.687ms, non-child: 129.687ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:76.92% 1:23.08% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 102.40 MB, 206.40 MB, 270.40 MB, 380.85 MB, 467.47 MB, 515.47 MB, 582.81 MB, 712.55 MB, 776.55 MB, 840.55 MB, 879.24 MB, 944.73 MB, 961.16 MB - FooterProcessingTime: (Avg: 351.150us ; Min: 237.140us ; Max: 643.106us ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 961.16 MB (1007851294) - BytesReadDataNodeCache: 0 - BytesReadLocal: 961.16 MB (1007851294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 961.16 MB (1007851294) - CachedFileHandlesHitCount: 139 (139) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s428ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 353.88 MB (371065729) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 96.968ms - RowBatchQueuePutWaitTime: 5s539ms - RowsRead: 38.76M (38758503) - RowsReturned: 3.92M (3921890) - RowsReturnedRate: 30.24 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.14K (1138) - ScannerThreadsTotalWallClockTime: 11s515ms - MaterializeTupleTime(*): 1s913ms - ScannerThreadsSysTime: 366.943ms - ScannerThreadsUserTime: 5s219ms - ScannerThreadsVoluntaryContextSwitches: 3.50K (3504) - TotalRawHdfsReadTime(*): 754.419ms - TotalReadThroughput: 147.87 MB/sec Buffer pool: - AllocTime: 10.739ms - CumulativeAllocationBytes: 387.88 MB (406716416) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 228.826ms, non-child: 228.826ms, % non-child: 100.00%) - CodegenTime: 7.849ms - CompileTime: 55.811ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.279ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 32.875ms Instance 9b439fc1ee1addb7:82d4156900000016 (host=vb0224.foo:22000):(Total: 30s051ms, non-child: 18s736ms, % non-child: 62.35%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 30s064ms - Prepare Finished: 22.486ms (22.486ms) - Open Finished: 5s483ms (5s461ms) - First Batch Produced: 5s628ms (144.812ms) - First Batch Sent: 6s479ms (850.971ms) - ExecInternal Finished: 30s064ms (23s585ms) MemoryUsage(500.000ms): 855.38 KB, 340.98 MB, 413.68 MB, 477.21 MB, 482.26 MB, 609.08 MB, 610.54 MB, 595.03 MB, 602.44 MB, 604.37 MB, 860.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 861.55 MB (903401801) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3782209420) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s580ms - TotalStorageWaitTime: 358.408ms - TotalThreadsInvoluntaryContextSwitches: 1.58K (1576) - TotalThreadsTotalWallClockTime: 39s761ms - TotalThreadsSysTime: 932.858ms - TotalThreadsUserTime: 10s273ms - TotalThreadsVoluntaryContextSwitches: 3.74K (3744) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24s580ms - ExecTreeExecTime: 144.803ms - OpenTime: 5s461ms - ExecTreeOpenTime: 5s076ms - PrepareTime: 8.482ms - ExecTreePrepareTime: 1.687ms DataStreamSender (dst_id=18):(Total: 5s710ms, non-child: 5s710ms, % non-child: 100.00%) - BytesSent: 131.72 MB (138123445) - NetworkThroughput(*): 27.12 MB/sec - OverallThroughput: 23.07 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 850.947ms - TransmitDataRPCTime: 4s856ms - UncompressedRowBatchSize: 143.26 MB (150214034) AGGREGATION_NODE (id=4):(Total: 5s223ms, non-child: 5s102ms, % non-child: 97.68%) ExecOption: Codegen Enabled - BuildTime: 4s954ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541410161) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 121.243ms, non-child: 121.243ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 158.39 MB, 238.39 MB, 293.08 MB, 451.48 MB, 515.48 MB, 582.82 MB, 720.56 MB, 784.56 MB, 856.56 MB, 879.24 MB - FooterProcessingTime: (Avg: 9.134ms ; Min: 317.136us ; Max: 19.189ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921949692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921949692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921949692) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s066ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.22 MB (369325666) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.385ms - RowBatchQueuePutWaitTime: 4s356ms - RowsRead: 35.46M (35458554) - RowsReturned: 3.51M (3513064) - RowsReturnedRate: 28.98 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 931 (931) - ScannerThreadsTotalWallClockTime: 9s719ms - MaterializeTupleTime(*): 1s690ms - ScannerThreadsSysTime: 292.955ms - ScannerThreadsUserTime: 4s677ms - ScannerThreadsVoluntaryContextSwitches: 3.23K (3232) - TotalRawHdfsReadTime(*): 738.844ms - TotalReadThroughput: 159.86 MB/sec Buffer pool: - AllocTime: 7.969ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 380.568ms, non-child: 380.568ms, % non-child: 100.00%) - CodegenTime: 11.169ms - CompileTime: 65.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 275.199ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 38.926ms Instance 9b439fc1ee1addb7:82d415690000000f (host=vb0218.foo:22000):(Total: 29s771ms, non-child: 18s601ms, % non-child: 62.48%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 29s773ms - Prepare Finished: 5.113ms (5.113ms) - Open Finished: 5s493ms (5s487ms) - First Batch Produced: 5s628ms (135.221ms) - First Batch Sent: 6s520ms (891.788ms) - ExecInternal Finished: 29s773ms (23s253ms) MemoryUsage(500.000ms): 15.88 KB, 332.33 MB, 412.89 MB, 480.02 MB, 475.05 MB, 480.85 MB, 608.91 MB, 603.84 MB, 609.75 MB, 608.48 MB, 864.36 MB, 587.91 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.28 MB (907311878) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3783367163) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s963ms - TotalStorageWaitTime: 166.960ms - TotalThreadsInvoluntaryContextSwitches: 1.64K (1641) - TotalThreadsTotalWallClockTime: 39s772ms - TotalThreadsSysTime: 942.856ms - TotalThreadsUserTime: 10s332ms - TotalThreadsVoluntaryContextSwitches: 3.86K (3862) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24s280ms - ExecTreeExecTime: 135.215ms - OpenTime: 5s487ms - ExecTreeOpenTime: 5s258ms - PrepareTime: 2.572ms - ExecTreePrepareTime: 334.387us DataStreamSender (dst_id=18):(Total: 5s548ms, non-child: 5s548ms, % non-child: 100.00%) - BytesSent: 135.44 MB (142014347) - NetworkThroughput(*): 29.09 MB/sec - OverallThroughput: 24.41 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 891.765ms - TransmitDataRPCTime: 4s656ms - UncompressedRowBatchSize: 147.29 MB (154441584) AGGREGATION_NODE (id=4):(Total: 5s394ms, non-child: 5s324ms, % non-child: 98.70%) ExecOption: Codegen Enabled - BuildTime: 5s183ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541371971) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 69.883ms, non-child: 69.883ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90% 1:10% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 150.39 MB, 206.39 MB, 278.39 MB, 403.47 MB, 475.47 MB, 539.47 MB, 610.73 MB, 752.55 MB, 824.55 MB, 875.90 MB - FooterProcessingTime: (Avg: 310.212us ; Min: 265.369us ; Max: 358.723us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921948124) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921948124) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921948124) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s086ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 351.70 MB (368787192) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 46.221ms - RowBatchQueuePutWaitTime: 4s833ms - RowsRead: 35.46M (35459311) - RowsReturned: 3.61M (3611897) - RowsReturnedRate: 51.68 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 985 (985) - ScannerThreadsTotalWallClockTime: 10s003ms - MaterializeTupleTime(*): 1s701ms - ScannerThreadsSysTime: 314.951ms - ScannerThreadsUserTime: 4s561ms - ScannerThreadsVoluntaryContextSwitches: 3.49K (3488) - TotalRawHdfsReadTime(*): 669.531ms - TotalReadThroughput: 159.25 MB/sec Buffer pool: - AllocTime: 3.815ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 226.519ms, non-child: 226.519ms, % non-child: 100.00%) - CodegenTime: 7.611ms - CompileTime: 54.621ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.333ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.911ms Instance 9b439fc1ee1addb7:82d415690000001a (host=vb0234.foo:22000):(Total: 29s491ms, non-child: 18s524ms, % non-child: 62.81%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 29s493ms - Prepare Finished: 7.653ms (7.653ms) - Open Finished: 5s568ms (5s560ms) - First Batch Produced: 5s701ms (133.568ms) - First Batch Sent: 6s551ms (849.528ms) - ExecInternal Finished: 29s493ms (22s942ms) MemoryUsage(500.000ms): 267.75 MB, 411.81 MB, 411.98 MB, 468.84 MB, 472.41 MB, 599.92 MB, 600.96 MB, 603.32 MB, 603.41 MB, 598.13 MB, 841.11 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.32 - BloomFilterBytes: 0 - PeakMemoryUsage: 857.29 MB (898931154) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.24 GB (3474569233) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s637ms - TotalStorageWaitTime: 238.082ms - TotalThreadsInvoluntaryContextSwitches: 1.60K (1598) - TotalThreadsTotalWallClockTime: 39s084ms - TotalThreadsSysTime: 874.867ms - TotalThreadsUserTime: 10s273ms - TotalThreadsVoluntaryContextSwitches: 3.26K (3263) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 23s925ms - ExecTreeExecTime: 133.563ms - OpenTime: 5s560ms - ExecTreeOpenTime: 5s334ms - PrepareTime: 5.814ms - ExecTreePrepareTime: 855.677us DataStreamSender (dst_id=18):(Total: 5s275ms, non-child: 5s275ms, % non-child: 100.00%) - BytesSent: 127.69 MB (133891173) - NetworkThroughput(*): 28.86 MB/sec - OverallThroughput: 24.21 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 849.506ms - TransmitDataRPCTime: 4s424ms - UncompressedRowBatchSize: 138.86 MB (145608801) AGGREGATION_NODE (id=4):(Total: 5s468ms, non-child: 5s364ms, % non-child: 98.09%) ExecOption: Codegen Enabled - BuildTime: 5s227ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541366165) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 104.185ms, non-child: 104.185ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 118.39 MB, 214.39 MB, 278.39 MB, 364.88 MB, 467.48 MB, 515.48 MB, 574.81 MB, 644.09 MB, 749.29 MB, 789.29 MB, 816.62 MB - FooterProcessingTime: (Avg: 306.379us ; Min: 188.905us ; Max: 453.253us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.73 - BytesRead: 816.62 MB (856291544) - BytesReadDataNodeCache: 0 - BytesReadLocal: 816.62 MB (856291544) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 816.62 MB (856291544) - CachedFileHandlesHitCount: 118 (118) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s897ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 346.08 MB (362894259) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 78.404ms - RowBatchQueuePutWaitTime: 4s649ms - RowsRead: 32.93M (32928322) - RowsReturned: 3.41M (3405300) - RowsReturnedRate: 32.68 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 943 (943) - ScannerThreadsTotalWallClockTime: 9s598ms - MaterializeTupleTime(*): 1s599ms - ScannerThreadsSysTime: 290.955ms - ScannerThreadsUserTime: 4s404ms - ScannerThreadsVoluntaryContextSwitches: 3.08K (3085) - TotalRawHdfsReadTime(*): 623.574ms - TotalReadThroughput: 148.48 MB/sec Buffer pool: - AllocTime: 6.667ms - CumulativeAllocationBytes: 331.25 MB (347340800) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 223.212ms, non-child: 223.212ms, % non-child: 100.00%) - CodegenTime: 7.800ms - CompileTime: 55.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.811ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.252ms Instance 9b439fc1ee1addb7:82d4156900000011 (host=vb0222.foo:22000):(Total: 28s523ms, non-child: 17s724ms, % non-child: 62.14%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 28s526ms - Prepare Finished: 4.756ms (4.756ms) - Open Finished: 5s585ms (5s580ms) - First Batch Produced: 5s716ms (130.318ms) - First Batch Sent: 6s506ms (790.798ms) - ExecInternal Finished: 28s526ms (22s019ms) MemoryUsage(500.000ms): 216.81 MB, 378.19 MB, 408.60 MB, 471.60 MB, 471.35 MB, 469.48 MB, 603.56 MB, 604.07 MB, 601.42 MB, 597.24 MB, 595.71 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 811.94 MB (851382553) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.10 GB (3327786148) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s016ms - TotalStorageWaitTime: 192.197ms - TotalThreadsInvoluntaryContextSwitches: 1.67K (1670) - TotalThreadsTotalWallClockTime: 38s065ms - TotalThreadsSysTime: 841.871ms - TotalThreadsUserTime: 10s317ms - TotalThreadsVoluntaryContextSwitches: 3.08K (3084) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 22s940ms - ExecTreeExecTime: 130.311ms - OpenTime: 5s580ms - ExecTreeOpenTime: 5s337ms - PrepareTime: 1.928ms - ExecTreePrepareTime: 303.272us DataStreamSender (dst_id=18):(Total: 5s091ms, non-child: 5s091ms, % non-child: 100.00%) - BytesSent: 121.60 MB (127501764) - NetworkThroughput(*): 28.27 MB/sec - OverallThroughput: 23.88 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 790.781ms - TransmitDataRPCTime: 4s300ms - UncompressedRowBatchSize: 132.23 MB (138652919) AGGREGATION_NODE (id=4):(Total: 5s468ms, non-child: 5s407ms, % non-child: 98.88%) ExecOption: Codegen Enabled - BuildTime: 5s272ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.28 MB (541363687) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 61.033ms, non-child: 61.033ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:72.73% 1:18.18% 2:9.091% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 28.24 MB, 141.50 MB, 252.70 MB, 304.04 MB, 391.24 MB, 451.17 MB, 553.77 MB, 597.10 MB, 692.30 MB, 735.63 MB, 786.96 MB - FooterProcessingTime: (Avg: 1.808ms ; Min: 138.463us ; Max: 5.789ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.36 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 786.96 MB (825192372) - BytesReadDataNodeCache: 0 - BytesReadLocal: 786.96 MB (825192372) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 786.96 MB (825192372) - CachedFileHandlesHitCount: 115 (115) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s925ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 346.09 MB (362897114) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 37.715ms - RowBatchQueuePutWaitTime: 4s614ms - RowsRead: 31.73M (31733865) - RowsReturned: 3.24M (3242551) - RowsReturnedRate: 53.13 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 987 (987) - ScannerThreadsTotalWallClockTime: 9s544ms - MaterializeTupleTime(*): 1s587ms - ScannerThreadsSysTime: 252.961ms - ScannerThreadsUserTime: 4s457ms - ScannerThreadsVoluntaryContextSwitches: 2.89K (2886) - TotalRawHdfsReadTime(*): 642.002ms - TotalReadThroughput: 143.08 MB/sec Buffer pool: - AllocTime: 6.338ms - CumulativeAllocationBytes: 319.75 MB (335282176) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 239.160ms, non-child: 239.160ms, % non-child: 100.00%) - CodegenTime: 11.352ms - CompileTime: 57.163ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 143.250ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 37.994ms Instance 9b439fc1ee1addb7:82d4156900000013 (host=vb0206.foo:22000):(Total: 28s142ms, non-child: 17s444ms, % non-child: 61.99%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 28s145ms - Prepare Finished: 7.998ms (7.998ms) - Open Finished: 5s622ms (5s614ms) - First Batch Produced: 5s770ms (147.780ms) - First Batch Sent: 6s660ms (890.175ms) - ExecInternal Finished: 28s145ms (21s484ms) MemoryUsage(500.000ms): 216.81 MB, 386.46 MB, 414.32 MB, 470.27 MB, 469.10 MB, 598.29 MB, 597.59 MB, 599.33 MB, 603.32 MB, 602.78 MB, 860.10 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 861.04 MB (902867309) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.51 GB (3767381641) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s479ms - TotalStorageWaitTime: 197.341ms - TotalThreadsInvoluntaryContextSwitches: 1.66K (1661) - TotalThreadsTotalWallClockTime: 38s457ms - TotalThreadsSysTime: 903.861ms - TotalThreadsUserTime: 10s764ms - TotalThreadsVoluntaryContextSwitches: 3.71K (3714) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 22s522ms - ExecTreeExecTime: 147.775ms - OpenTime: 5s614ms - ExecTreeOpenTime: 5s383ms - PrepareTime: 5.567ms - ExecTreePrepareTime: 364.068us DataStreamSender (dst_id=18):(Total: 4s937ms, non-child: 4s937ms, % non-child: 100.00%) - BytesSent: 136.75 MB (143397213) - NetworkThroughput(*): 33.81 MB/sec - OverallThroughput: 27.69 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 890.156ms - TransmitDataRPCTime: 4s044ms - UncompressedRowBatchSize: 148.71 MB (155931717) AGGREGATION_NODE (id=4):(Total: 5s532ms, non-child: 5s450ms, % non-child: 98.52%) ExecOption: Codegen Enabled - BuildTime: 5s297ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541414149) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 81.601ms, non-child: 81.601ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:9.091% 2:9.091% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 41.18 MB, 198.39 MB, 278.39 MB, 387.48 MB, 459.48 MB, 523.48 MB, 582.82 MB, 712.57 MB, 776.57 MB, 848.57 MB, 879.24 MB - FooterProcessingTime: (Avg: 582.035us ; Min: 219.942us ; Max: 869.546us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921947767) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921947767) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921947767) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s130ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.16 MB (369267314) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 54.353ms - RowBatchQueuePutWaitTime: 5s004ms - RowsRead: 35.46M (35458085) - RowsReturned: 3.65M (3646907) - RowsReturnedRate: 44.69 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 990 (990) - ScannerThreadsTotalWallClockTime: 10s320ms - MaterializeTupleTime(*): 1s748ms - ScannerThreadsSysTime: 295.954ms - ScannerThreadsUserTime: 4s794ms - ScannerThreadsVoluntaryContextSwitches: 3.43K (3431) - TotalRawHdfsReadTime(*): 688.755ms - TotalReadThroughput: 159.86 MB/sec Buffer pool: - AllocTime: 8.189ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 227.989ms, non-child: 227.989ms, % non-child: 100.00%) - CodegenTime: 7.642ms - CompileTime: 54.732ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 137.546ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 35.078ms Instance 9b439fc1ee1addb7:82d415690000000e (host=vb0216.foo:22000):(Total: 27s857ms, non-child: 17s210ms, % non-child: 61.78%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB Fragment Instance Lifecycle Event Timeline: 27s860ms - Prepare Finished: 7.454ms (7.454ms) - Open Finished: 5s975ms (5s967ms) - First Batch Produced: 6s125ms (149.806ms) - First Batch Sent: 7s016ms (891.365ms) - ExecInternal Finished: 27s860ms (20s843ms) MemoryUsage(500.000ms): 15.88 KB, 338.85 MB, 412.83 MB, 444.97 MB, 472.72 MB, 482.50 MB, 599.02 MB, 601.80 MB, 601.87 MB, 604.46 MB, 602.43 MB, 854.79 MB, 587.79 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 858.17 MB (899857625) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3784557319) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s840ms - TotalStorageWaitTime: 236.045ms - TotalThreadsInvoluntaryContextSwitches: 1.80K (1796) - TotalThreadsTotalWallClockTime: 38s834ms - TotalThreadsSysTime: 940.855ms - TotalThreadsUserTime: 11s024ms - TotalThreadsVoluntaryContextSwitches: 3.86K (3863) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s884ms - ExecTreeExecTime: 149.798ms - OpenTime: 5s967ms - ExecTreeOpenTime: 5s736ms - PrepareTime: 5.071ms - ExecTreePrepareTime: 1.238ms DataStreamSender (dst_id=18):(Total: 4s530ms, non-child: 4s530ms, % non-child: 100.00%) - BytesSent: 135.22 MB (141786127) - NetworkThroughput(*): 37.16 MB/sec - OverallThroughput: 29.84 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 891.346ms - TransmitDataRPCTime: 3s638ms - UncompressedRowBatchSize: 147.05 MB (154191767) AGGREGATION_NODE (id=4):(Total: 5s887ms, non-child: 5s813ms, % non-child: 98.74%) ExecOption: Codegen Enabled - BuildTime: 5s660ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541367253) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 74.316ms, non-child: 74.316ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 150.39 MB, 214.39 MB, 278.39 MB, 332.42 MB, 443.94 MB, 539.14 MB, 603.14 MB, 701.70 MB, 753.05 MB, 839.21 MB, 870.55 MB - FooterProcessingTime: (Avg: 371.438us ; Min: 210.314us ; Max: 641.191us ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 870.55 MB (912842440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 870.55 MB (912842440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 870.55 MB (912842440) - CachedFileHandlesHitCount: 128 (128) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s090ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.35 MB (369462193) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 50.389ms - RowBatchQueuePutWaitTime: 5s699ms - RowsRead: 35.10M (35096614) - RowsReturned: 3.61M (3606066) - RowsReturnedRate: 48.52 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.08K (1080) - ScannerThreadsTotalWallClockTime: 10s981ms - MaterializeTupleTime(*): 1s715ms - ScannerThreadsSysTime: 268.958ms - ScannerThreadsUserTime: 4s761ms - ScannerThreadsVoluntaryContextSwitches: 3.46K (3460) - TotalRawHdfsReadTime(*): 734.552ms - TotalReadThroughput: 145.09 MB/sec Buffer pool: - AllocTime: 7.718ms - CumulativeAllocationBytes: 367.38 MB (385220608) - CumulativeAllocations: 59 (59) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 228.380ms, non-child: 228.380ms, % non-child: 100.00%) - CodegenTime: 7.505ms - CompileTime: 54.894ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.807ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 33.053ms Instance 9b439fc1ee1addb7:82d4156900000012 (host=vb0220.foo:22000):(Total: 27s851ms, non-child: 17s306ms, % non-child: 62.14%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 27s852ms - Prepare Finished: 2.294ms (2.294ms) - Open Finished: 6s186ms (6s184ms) - First Batch Produced: 6s329ms (142.412ms) - First Batch Sent: 7s230ms (900.811ms) - ExecInternal Finished: 27s852ms (20s622ms) MemoryUsage(500.000ms): 276.40 MB, 377.10 MB, 407.25 MB, 471.04 MB, 482.57 MB, 473.36 MB, 599.84 MB, 600.56 MB, 607.26 MB, 608.62 MB, 608.68 MB, 862.11 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 866.03 MB (908102766) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3617652252) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s367ms - TotalStorageWaitTime: 232.106ms - TotalThreadsInvoluntaryContextSwitches: 1.83K (1826) - TotalThreadsTotalWallClockTime: 39s205ms - TotalThreadsSysTime: 917.860ms - TotalThreadsUserTime: 11s321ms - TotalThreadsVoluntaryContextSwitches: 3.79K (3792) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s666ms - ExecTreeExecTime: 142.405ms - OpenTime: 6s184ms - ExecTreeOpenTime: 5s958ms - PrepareTime: 1.276ms - ExecTreePrepareTime: 230.714us DataStreamSender (dst_id=18):(Total: 4s221ms, non-child: 4s221ms, % non-child: 100.00%) - BytesSent: 134.10 MB (140613825) - NetworkThroughput(*): 40.39 MB/sec - OverallThroughput: 31.77 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 900.792ms - TransmitDataRPCTime: 3s319ms - UncompressedRowBatchSize: 145.84 MB (152920393) AGGREGATION_NODE (id=4):(Total: 6s101ms, non-child: 6s006ms, % non-child: 98.44%) ExecOption: Codegen Enabled - BuildTime: 5s858ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.32 MB (541404551) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 95.305ms, non-child: 95.305ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:8.333% 2:8.333% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 126.39 MB, 190.39 MB, 238.39 MB, 293.07 MB, 435.46 MB, 483.46 MB, 547.46 MB, 586.13 MB, 736.52 MB, 800.52 MB, 856.52 MB, 879.21 MB - FooterProcessingTime: (Avg: 335.606us ; Min: 247.843us ; Max: 426.105us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 879.21 MB (921923583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.21 MB (921923583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.21 MB (921923583) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s157ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.72 MB (369850312) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 71.734ms - RowBatchQueuePutWaitTime: 6s020ms - RowsRead: 35.46M (35457025) - RowsReturned: 3.58M (3576349) - RowsReturnedRate: 37.53 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1090) - ScannerThreadsTotalWallClockTime: 11s355ms - MaterializeTupleTime(*): 1s708ms - ScannerThreadsSysTime: 292.955ms - ScannerThreadsUserTime: 4s803ms - ScannerThreadsVoluntaryContextSwitches: 3.35K (3347) - TotalRawHdfsReadTime(*): 687.794ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 8.044ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 222.959ms, non-child: 222.959ms, % non-child: 100.00%) - CodegenTime: 7.632ms - CompileTime: 55.016ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.022ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.270ms Instance 9b439fc1ee1addb7:82d4156900000018 (host=vb0212.foo:22000):(Total: 27s595ms, non-child: 21s296ms, % non-child: 77.17%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 27s596ms - Prepare Finished: 2.216ms (2.216ms) - Open Finished: 4s952ms (4s950ms) - First Batch Produced: 5s071ms (119.058ms) - First Batch Sent: 5s798ms (726.802ms) - ExecInternal Finished: 27s596ms (21s797ms) MemoryUsage(500.000ms): 855.38 KB, 367.89 MB, 418.64 MB, 478.00 MB, 468.60 MB, 473.59 MB, 602.21 MB, 601.20 MB, 598.74 MB, 598.21 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB, 379.29 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 602.76 MB (632036994) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.37 GB (2543089953) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s556ms - TotalStorageWaitTime: 231.753ms - TotalThreadsInvoluntaryContextSwitches: 1.39K (1393) - TotalThreadsTotalWallClockTime: 35s828ms - TotalThreadsSysTime: 733.887ms - TotalThreadsUserTime: 9s071ms - TotalThreadsVoluntaryContextSwitches: 3.08K (3085) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 22s643ms - ExecTreeExecTime: 119.051ms - OpenTime: 4s950ms - ExecTreeOpenTime: 4s734ms - PrepareTime: 1.199ms - ExecTreePrepareTime: 224.448us DataStreamSender (dst_id=18):(Total: 1s231ms, non-child: 1s231ms, % non-child: 100.00%) - BytesSent: 111.29 MB (116690843) - NetworkThroughput(*): 220.59 MB/sec - OverallThroughput: 90.36 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 726.784ms - TransmitDataRPCTime: 504.485ms - UncompressedRowBatchSize: 121.02 MB (126901687) AGGREGATION_NODE (id=4):(Total: 4s854ms, non-child: 4s764ms, % non-child: 98.15%) ExecOption: Codegen Enabled - BuildTime: 4s640ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.33 MB (272978531) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 89.921ms, non-child: 89.921ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0, 174.39 MB, 230.39 MB, 289.74 MB, 411.49 MB, 475.49 MB, 531.49 MB, 582.83 MB, 673.37 MB, 732.71 MB - FooterProcessingTime: (Avg: 4.230ms ; Min: 307.209us ; Max: 11.492ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 732.71 MB (768298333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 732.71 MB (768298333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 732.71 MB (768298333) - CachedFileHandlesHitCount: 105 (105) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s543ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 353.50 MB (370674029) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 67.208ms - RowBatchQueuePutWaitTime: 3s864ms - RowsRead: 29.55M (29548778) - RowsReturned: 2.97M (2967885) - RowsReturnedRate: 33.01 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 808 (808) - ScannerThreadsTotalWallClockTime: 8s234ms - MaterializeTupleTime(*): 1s406ms - ScannerThreadsSysTime: 245.962ms - ScannerThreadsUserTime: 3s861ms - ScannerThreadsVoluntaryContextSwitches: 2.58K (2581) - TotalRawHdfsReadTime(*): 571.261ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 6.902ms - CumulativeAllocationBytes: 283.12 MB (296878080) - CumulativeAllocations: 45 (45) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 213.246ms, non-child: 213.246ms, % non-child: 100.00%) - CodegenTime: 7.158ms - CompileTime: 54.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 137.936ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 20.148ms Instance 9b439fc1ee1addb7:82d4156900000019 (host=vb0232.foo:22000):(Total: 5s866ms, non-child: 211.862ms, % non-child: 3.61%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 5s869ms - Prepare Finished: 6.605ms (6.605ms) - Open Finished: 4s558ms (4s551ms) - First Batch Produced: 4s687ms (128.823ms) - First Batch Sent: 5s423ms (736.269ms) - ExecInternal Finished: 5s869ms (445.984ms) MemoryUsage(500.000ms): 216.81 MB, 380.24 MB, 412.59 MB, 476.75 MB, 475.46 MB, 602.04 MB, 604.76 MB, 604.04 MB, 602.05 MB, 381.58 MB, 381.58 MB, 381.58 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1 - AverageThreadTokens: 2.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 606.05 MB (635489089) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.51 GB (2695227883) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 445.469ms - TotalStorageWaitTime: 175.081ms - TotalThreadsInvoluntaryContextSwitches: 1.37K (1370) - TotalThreadsTotalWallClockTime: 14s174ms - TotalThreadsSysTime: 780.881ms - TotalThreadsUserTime: 8s885ms - TotalThreadsVoluntaryContextSwitches: 3.30K (3301) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s311ms - ExecTreeExecTime: 128.818ms - OpenTime: 4s551ms - ExecTreeOpenTime: 4s318ms - PrepareTime: 3.945ms - ExecTreePrepareTime: 390.316us DataStreamSender (dst_id=18):(Total: 976.745ms, non-child: 976.745ms, % non-child: 100.00%) - BytesSent: 113.39 MB (118899026) - NetworkThroughput(*): 475.11 MB/sec - OverallThroughput: 116.09 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 736.251ms - TransmitDataRPCTime: 238.661ms - UncompressedRowBatchSize: 123.31 MB (129304747) AGGREGATION_NODE (id=4):(Total: 4s447ms, non-child: 4s382ms, % non-child: 98.55%) ExecOption: Codegen Enabled - BuildTime: 4s250ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.33 MB (272980984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=3):(Total: 64.433ms, non-child: 64.433ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:0% 2:11.11% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 33.20 MB, 198.39 MB, 262.39 MB, 293.08 MB, 436.36 MB, 479.51 MB, 594.04 MB, 690.01 MB, 736.09 MB - FooterProcessingTime: (Avg: 325.628us ; Min: 261.553us ; Max: 376.038us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 736.09 MB (771844345) - BytesReadDataNodeCache: 0 - BytesReadLocal: 736.09 MB (771844345) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 736.09 MB (771844345) - CachedFileHandlesHitCount: 108 (108) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s641ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 347.21 MB (364071267) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45.285ms - RowBatchQueuePutWaitTime: 3s790ms - RowsRead: 29.68M (29676122) - RowsReturned: 3.02M (3023972) - RowsReturnedRate: 46.93 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 825 (825) - ScannerThreadsTotalWallClockTime: 8s311ms - MaterializeTupleTime(*): 1s485ms - ScannerThreadsSysTime: 284.956ms - ScannerThreadsUserTime: 4s032ms - ScannerThreadsVoluntaryContextSwitches: 2.90K (2895) - TotalRawHdfsReadTime(*): 607.822ms - TotalReadThroughput: 163.58 MB/sec Buffer pool: - AllocTime: 9.357ms - CumulativeAllocationBytes: 314.75 MB (330039296) - CumulativeAllocations: 50 (50) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 230.758ms, non-child: 230.758ms, % non-child: 100.00%) - CodegenTime: 7.429ms - CompileTime: 54.627ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.278ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 35.230ms Averaged Fragment F06:(Total: 1m19s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 25.70 MB, max: 26.47 MB, avg: 25.96 MB, stddev: 363.28 KB completion times: min:1m46s max:1m46s mean: 1m46s stddev:6.316ms execution rates: min:247.61 KB/sec max:255.05 KB/sec mean:250.09 KB/sec stddev:3.42 KB/sec num instances: 9 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.19 GB (7724791720) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 17.23 GB (18496218540) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m19s - TotalNetworkSendTime: 495.142ms - TotalStorageWaitTime: 3.206ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 2m39s - TotalThreadsSysTime: 2.444ms - TotalThreadsUserTime: 37.994ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 105.479us - OpenTime: 1m19s - ExecTreeOpenTime: 1m19s - PrepareTime: 12.257ms - ExecTreePrepareTime: 668.329us DataStreamSender (dst_id=27):(Total: 15s731ms, non-child: 15s731ms, % non-child: 100.00%) - BytesSent: 2.23 GB (2392351629) - NetworkThroughput(*): 469.98 MB/sec - OverallThroughput: 147.51 MB/sec - PeakMemoryUsage: 3.53 GB (3794106070) - RowsReturned: 0 (0) - SerializeBatchTime: 13s161ms - TransmitDataRPCTime: 4s977ms - UncompressedRowBatchSize: 2.42 GB (2601628684) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m19s, non-child: 94.861ms, % non-child: 0.12%) - BuildRows: 2 (2) - BuildTime: 25.314us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.33 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m19s, non-child: 1m19s, % non-child: 100.00%) - ConvertRowBatchTime: 5.954us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s439ms - FirstBatchArrivalWaitTime: 49s902ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 8.806ms, non-child: 8.806ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.22 - BytesRead: 1.45 MB (1519804) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2.846ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 491.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 118.84 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.108ms - TotalReadThroughput: 14.44 KB/sec Buffer pool: - AllocTime: 626.973us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 53.601ms, non-child: 53.601ms, % non-child: 100.00%) - CodegenTime: 474.069us - CompileTime: 19.181ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.692ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 24.121ms Fragment F06: Instance 9b439fc1ee1addb7:82d4156900000042 (host=vb0206.foo:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/25.70 MB Fragment Instance Lifecycle Event Timeline: 1m23s - Prepare Finished: 18.585ms (18.585ms) - Open Finished: 1m23s (1m23s) - First Batch Produced: 1m23s (128.152us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.20 GB, 3.89 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 5.71 GB, 7.30 GB, 7.30 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7833192912) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 21.97 GB (23591075160) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 5.018us - TotalStorageWaitTime: 3.675ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 40.993ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 125.741us - OpenTime: 1m23s - ExecTreeOpenTime: 1m23s - PrepareTime: 13.454ms - ExecTreePrepareTime: 231.855us DataStreamSender (dst_id=27):(Total: 10s080ms, non-child: 10s080ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265766) - NetworkThroughput(*): 402.88 MB/sec - OverallThroughput: 169.74 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 10s068ms - TransmitDataRPCTime: 4s247ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m23s, non-child: 237.080ms, % non-child: 0.28%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 17.504us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.14 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - ConvertRowBatchTime: 6.253us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s433ms - FirstBatchArrivalWaitTime: 51s338ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 8.972ms, non-child: 8.972ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/25.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 367.78 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 596.416us ; Min: 596.416us ; Max: 596.416us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.19 - BytesRead: 1.44 MB (1506446) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.272ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 404.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 114.12 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.552ms - TotalReadThroughput: 14.28 KB/sec Buffer pool: - AllocTime: 760.243us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 41.391ms, non-child: 41.391ms, % non-child: 100.00%) - CodegenTime: 455.910us - CompileTime: 5.980ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.104ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 25.750ms Instance 9b439fc1ee1addb7:82d4156900000044 (host=vb0218.foo:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/25.71 MB Fragment Instance Lifecycle Event Timeline: 1m23s - Prepare Finished: 14.220ms (14.220ms) - Open Finished: 1m23s (1m23s) - First Batch Produced: 1m23s (74.238us) MemoryUsage(2s000ms): 18.08 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 2.75 GB, 3.66 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.02 GB, 6.39 GB, 7.30 GB, 7.30 GB, 7.30 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7833192912) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737414643) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 3.587us - TotalStorageWaitTime: 3.290ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 36.995ms - TotalThreadsVoluntaryContextSwitches: 23 (23) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 72.739us - OpenTime: 1m23s - ExecTreeOpenTime: 1m23s - PrepareTime: 10.237ms - ExecTreePrepareTime: 349.520us DataStreamSender (dst_id=27):(Total: 12s511ms, non-child: 12s511ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265766) - NetworkThroughput(*): 590.33 MB/sec - OverallThroughput: 136.76 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s603ms - TransmitDataRPCTime: 2s898ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m23s, non-child: 164.280ms, % non-child: 0.20%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 17.167us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.14 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - ConvertRowBatchTime: 4.826us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.51 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s342ms - FirstBatchArrivalWaitTime: 42s228ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 8.312ms, non-child: 8.312ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/25.71 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 614.693us ; Min: 614.693us ; Max: 614.693us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.20 - BytesRead: 1.44 MB (1506385) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2.997ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 444.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 123.19 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.233ms - TotalReadThroughput: 13.94 KB/sec Buffer pool: - AllocTime: 579.855us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 37.748ms, non-child: 37.748ms, % non-child: 100.00%) - CodegenTime: 464.113us - CompileTime: 5.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 8.808ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 22.653ms Instance 9b439fc1ee1addb7:82d4156900000041 (host=vb0222.foo:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/26.45 MB Fragment Instance Lifecycle Event Timeline: 1m23s - Prepare Finished: 9.406ms (9.406ms) - Open Finished: 1m23s (1m23s) - First Batch Produced: 1m23s (63.976us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 1.39 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.66 GB, 3.89 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.02 GB, 5.48 GB, 5.48 GB, 5.48 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.48 GB (5881967361) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 16.52 GB (17737402545) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 3.619us - TotalStorageWaitTime: 2.058ms - TotalThreadsInvoluntaryContextSwitches: 3 (3) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 35.994ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 62.489us - OpenTime: 1m23s - ExecTreeOpenTime: 1m23s - PrepareTime: 6.131ms - ExecTreePrepareTime: 168.003us DataStreamSender (dst_id=27):(Total: 9s873ms, non-child: 9s873ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265766) - NetworkThroughput(*): 267.80 MB/sec - OverallThroughput: 173.31 MB/sec - PeakMemoryUsage: 1.82 GB (1951281711) - RowsReturned: 0 (0) - SerializeBatchTime: 9s867ms - TransmitDataRPCTime: 6s389ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m23s, non-child: 729.738us, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 27.851us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.15 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - ConvertRowBatchTime: 4.217us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s554ms - FirstBatchArrivalWaitTime: 47s406ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 6.856ms, non-child: 6.856ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/26.45 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 377.55 KB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB - FooterProcessingTime: (Avg: 436.620us ; Min: 436.620us ; Max: 436.620us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.18 - BytesRead: 1.47 MB (1546456) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.062ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 743.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 149.35 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 1.984ms - TotalReadThroughput: 14.81 KB/sec Buffer pool: - AllocTime: 603.203us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 35.690ms, non-child: 35.690ms, % non-child: 100.00%) - CodegenTime: 433.111us - CompileTime: 6.041ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.225ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.861ms Instance 9b439fc1ee1addb7:82d4156900000043 (host=vb0232.foo:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/25.70 MB Fragment Instance Lifecycle Event Timeline: 1m23s - Prepare Finished: 17.025ms (17.025ms) - Open Finished: 1m23s (1m23s) - First Batch Produced: 1m23s (123.673us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 954.50 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 2.75 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.89 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.02 GB, 6.39 GB, 7.30 GB, 7.30 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7833192912) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 5.096us - TotalStorageWaitTime: 3.447ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 121.692us - OpenTime: 1m23s - ExecTreeOpenTime: 1m23s - PrepareTime: 13.805ms - ExecTreePrepareTime: 1.418ms DataStreamSender (dst_id=27):(Total: 9s797ms, non-child: 9s797ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265766) - NetworkThroughput(*): 248.04 MB/sec - OverallThroughput: 174.65 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s785ms - TransmitDataRPCTime: 6s898ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m23s, non-child: 1.207ms, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 37.499us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.15 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - ConvertRowBatchTime: 6.587us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 855.57 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.51 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s378ms - FirstBatchArrivalWaitTime: 57s776ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 11.052ms, non-child: 11.052ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/25.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 367.76 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 540.970us ; Min: 540.970us ; Max: 540.970us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.18 - BytesRead: 1.44 MB (1506350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.053ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 416.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 92.65 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.446ms - TotalReadThroughput: 14.42 KB/sec Buffer pool: - AllocTime: 710.380us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 41.263ms, non-child: 41.263ms, % non-child: 100.00%) - CodegenTime: 436.676us - CompileTime: 5.973ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.096ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 25.643ms Instance 9b439fc1ee1addb7:82d4156900000048 (host=vb0224.foo:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB Fragment Instance Lifecycle Event Timeline: 1m23s - Prepare Finished: 29.153ms (29.153ms) - Open Finished: 1m23s (1m23s) - First Batch Produced: 1m23s (64.793us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 489.29 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.66 GB, 3.89 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 5.93 GB, 7.30 GB, 7.30 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7833192912) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m23s - TotalNetworkSendTime: 3.877us - TotalStorageWaitTime: 2.051ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 2m46s - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 49.993ms - TotalThreadsVoluntaryContextSwitches: 16 (16) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 63.067us - OpenTime: 1m23s - ExecTreeOpenTime: 1m23s - PrepareTime: 15.951ms - ExecTreePrepareTime: 1.795ms DataStreamSender (dst_id=27):(Total: 14s443ms, non-child: 14s443ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265764) - NetworkThroughput(*): 400.03 MB/sec - OverallThroughput: 118.47 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 10s152ms - TransmitDataRPCTime: 4s277ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m23s, non-child: 1.303ms, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 26.138us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.16 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) - ConvertRowBatchTime: 6.718us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 427.79 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s477ms - FirstBatchArrivalWaitTime: 52s218ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 8.691ms, non-child: 8.691ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 367.77 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 391.125us ; Min: 391.125us ; Max: 391.125us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.19 - BytesRead: 1.44 MB (1506401) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1.694ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 689.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 117.82 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2.084ms - TotalReadThroughput: 14.28 KB/sec Buffer pool: - AllocTime: 508.012us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 170.367ms, non-child: 170.367ms, % non-child: 100.00%) - CodegenTime: 600.064us - CompileTime: 126.239ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 12.953ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 30.465ms Instance 9b439fc1ee1addb7:82d4156900000040 (host=vb0216.foo:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB Fragment Instance Lifecycle Event Timeline: 1m22s - Prepare Finished: 18.354ms (18.354ms) - Open Finished: 1m22s (1m22s) - First Batch Produced: 1m22s (122.887us) MemoryUsage(2s000ms): 18.08 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.66 GB, 4.34 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 6.84 GB, 7.30 GB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7833192912) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786189108) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m22s - TotalNetworkSendTime: 4.556us - TotalStorageWaitTime: 3.457ms - TotalThreadsInvoluntaryContextSwitches: 5 (5) - TotalThreadsTotalWallClockTime: 2m44s - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 38.994ms - TotalThreadsVoluntaryContextSwitches: 10 (10) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 120.461us - OpenTime: 1m22s - ExecTreeOpenTime: 1m22s - PrepareTime: 11.502ms - ExecTreePrepareTime: 1.217ms DataStreamSender (dst_id=27):(Total: 13s042ms, non-child: 13s042ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265766) - NetworkThroughput(*): 525.51 MB/sec - OverallThroughput: 131.20 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s776ms - TransmitDataRPCTime: 3s256ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m22s, non-child: 155.099ms, % non-child: 0.19%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 26.235us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.18 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m22s, non-child: 1m22s, % non-child: 100.00%) - ConvertRowBatchTime: 7.599us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s623ms - FirstBatchArrivalWaitTime: 40s441ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 10.252ms, non-child: 10.252ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/25.71 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 735.52 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 590.462us ; Min: 590.462us ; Max: 590.462us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.17 - BytesRead: 1.44 MB (1506346) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.372ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 429.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 99.88 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.343ms - TotalReadThroughput: 14.64 KB/sec Buffer pool: - AllocTime: 561.710us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 39.752ms, non-child: 39.752ms, % non-child: 100.00%) - CodegenTime: 505.321us - CompileTime: 5.940ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.840ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.397ms Instance 9b439fc1ee1addb7:82d4156900000045 (host=vb0230.foo:22000):(Total: 1m22s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/26.45 MB Fragment Instance Lifecycle Event Timeline: 1m22s - Prepare Finished: 19.130ms (19.130ms) - Open Finished: 1m22s (1m22s) - First Batch Produced: 1m22s (129.758us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 954.50 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 2.30 GB, 3.66 GB, 3.66 GB, 3.66 GB, 4.80 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 7.07 GB, 7.30 GB, 7.30 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.30 GB (7833192912) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 18.34 GB (19688632134) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m22s - TotalNetworkSendTime: 3.613us - TotalStorageWaitTime: 3.406ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 2m44s - TotalThreadsSysTime: 4.999ms - TotalThreadsUserTime: 32.995ms - TotalThreadsVoluntaryContextSwitches: 12 (12) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 127.052us - OpenTime: 1m22s - ExecTreeOpenTime: 1m22s - PrepareTime: 15.698ms - ExecTreePrepareTime: 308.839us DataStreamSender (dst_id=27):(Total: 13s153ms, non-child: 13s153ms, % non-child: 100.00%) - BytesSent: 1.67 GB (1794265766) - NetworkThroughput(*): 495.84 MB/sec - OverallThroughput: 130.09 MB/sec - PeakMemoryUsage: 3.63 GB (3902507262) - RowsReturned: 0 (0) - SerializeBatchTime: 9s687ms - TransmitDataRPCTime: 3s451ms - UncompressedRowBatchSize: 1.82 GB (1951221513) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m22s, non-child: 1.238ms, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 33.838us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.19 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m22s, non-child: 1m22s, % non-child: 100.00%) - ConvertRowBatchTime: 7.211us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 855.57 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.09 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s804ms - FirstBatchArrivalWaitTime: 49s710ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 7.119ms, non-child: 7.119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/26.45 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.11 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB, 1.47 MB - FooterProcessingTime: (Avg: 534.393us ; Min: 534.393us ; Max: 534.393us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.19 - BytesRead: 1.47 MB (1546527) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 1.995ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 442.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 143.82 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 3.329ms - TotalReadThroughput: 14.81 KB/sec Buffer pool: - AllocTime: 594.105us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 38.603ms, non-child: 38.603ms, % non-child: 100.00%) - CodegenTime: 481.110us - CompileTime: 5.503ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.236ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 23.296ms Instance 9b439fc1ee1addb7:82d4156900000047 (host=vb0208.foo:22000):(Total: 1m15s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/25.70 MB Fragment Instance Lifecycle Event Timeline: 1m15s - Prepare Finished: 18.481ms (18.481ms) - Open Finished: 1m15s (1m15s) - First Batch Produced: 1m15s (141.623us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 1.84 GB, 3.20 GB, 3.89 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.02 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.48 GB (5881967361) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 14.70 GB (15786181032) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 1m15s - TotalNetworkSendTime: 4s456ms - TotalStorageWaitTime: 4.466ms - TotalThreadsInvoluntaryContextSwitches: 4 (4) - TotalThreadsTotalWallClockTime: 2m30s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 31.995ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 139.067us - OpenTime: 1m15s - ExecTreeOpenTime: 1m15s - PrepareTime: 11.116ms - ExecTreePrepareTime: 243.621us DataStreamSender (dst_id=27):(Total: 22s721ms, non-child: 22s721ms, % non-child: 100.00%) - BytesSent: 3.34 GB (3588507005) - NetworkThroughput(*): 688.62 MB/sec - OverallThroughput: 150.62 MB/sec - PeakMemoryUsage: 1.82 GB (1951281711) - RowsReturned: 0 (0) - SerializeBatchTime: 19s248ms - TransmitDataRPCTime: 4s969ms - UncompressedRowBatchSize: 3.63 GB (3902443026) NESTED_LOOP_JOIN_NODE (id=13):(Total: 1m15s, non-child: 146.868ms, % non-child: 0.20%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 25.827us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 3.49 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 1m15s, non-child: 1m15s, % non-child: 100.00%) - ConvertRowBatchTime: 5.043us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 2.92 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 4s971ms - FirstBatchArrivalWaitTime: 56s294ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 9.670ms, non-child: 9.670ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/25.70 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 367.76 KB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB, 1.44 MB - FooterProcessingTime: (Avg: 587.154us ; Min: 587.154us ; Max: 587.154us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.27 - BytesRead: 1.44 MB (1506363) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2.932ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 354.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 105.89 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 4.058ms - TotalReadThroughput: 14.14 KB/sec Buffer pool: - AllocTime: 679.293us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 35.683ms, non-child: 35.683ms, % non-child: 100.00%) - CodegenTime: 464.549us - CompileTime: 5.518ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.741ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 19.596ms Instance 9b439fc1ee1addb7:82d4156900000046 (host=vb0214.foo:22000):(Total: 59s968ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/26.47 MB Fragment Instance Lifecycle Event Timeline: 59s977ms - Prepare Finished: 20.859ms (20.859ms) - Open Finished: 59s977ms (59s956ms) - First Batch Produced: 59s977ms (119.185us) MemoryUsage(2s000ms): 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 24.09 MB, 954.50 MB, 1.84 GB, 1.84 GB, 1.84 GB, 2.75 GB, 3.66 GB, 5.25 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.48 GB, 5.25 GB, 6.84 GB, 7.30 GB, 7.30 GB, 7.30 GB, 7.30 GB, 7.07 GB, 7.07 GB, 8.66 GB, 9.11 GB, 9.11 GB, 9.11 GB, 9.11 GB, 9.11 GB, 8.43 GB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.02 GB (10760033288) - PeakReservation: 24.00 MB (25165824) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 19.25 GB (20664250997) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 59s760ms - TotalNetworkSendTime: 6.385us - TotalStorageWaitTime: 3.003ms - TotalThreadsInvoluntaryContextSwitches: 6 (6) - TotalThreadsTotalWallClockTime: 1m59s - TotalThreadsSysTime: 3.000ms - TotalThreadsUserTime: 38.994ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 117.009us - OpenTime: 59s956ms - ExecTreeOpenTime: 59s914ms - PrepareTime: 12.423ms - ExecTreePrepareTime: 281.507us DataStreamSender (dst_id=27):(Total: 35s957ms, non-child: 35s957ms, % non-child: 100.00%) - BytesSent: 5.01 GB (5382797298) - NetworkThroughput(*): 610.74 MB/sec - OverallThroughput: 142.76 MB/sec - PeakMemoryUsage: 6.36 GB (6829347638) - RowsReturned: 0 (0) - SerializeBatchTime: 30s265ms - TransmitDataRPCTime: 8s405ms - UncompressedRowBatchSize: 5.45 GB (5853664539) NESTED_LOOP_JOIN_NODE (id=13):(Total: 59s914ms, non-child: 145.943ms, % non-child: 0.24%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 2 (2) - BuildTime: 15.771us - PeakMemoryUsage: 3.63 GB (3902484960) - ProbeRows: 1.02K (1024) - ProbeTime: 0.000ns - RowsReturned: 262.66K (262656) - RowsReturnedRate: 4.38 K/sec Nested Loop Join Builder: - PeakMemoryUsage: 3.63 GB (3902459360) EXCHANGE_NODE (id=25):(Total: 59s760ms, non-child: 59s760ms, % non-child: 100.00%) - ConvertRowBatchTime: 5.140us - PeakMemoryUsage: 1.82 GB (1951221504) - RowsReturned: 2 (2) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 855.57 MB, 1.67 GB, 1.67 GB, 1.67 GB, 2.51 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB, 3.34 GB - BytesReceived: 3.34 GB (3588506973) - DeserializeRowBatchTimer: 5s366ms - FirstBatchArrivalWaitTime: 51s706ms - PeakMemoryUsage: 1.82 GB (1951221504) - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=12):(Total: 8.333ms, non-child: 8.333ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/26.47 MB ExecOption: PARQUET Codegen Enabled BytesRead(2s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB, 1.48 MB - FooterProcessingTime: (Avg: 369.584us ; Min: 369.584us ; Max: 369.584us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.42 - BytesRead: 1.48 MB (1546967) - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3.242ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 26.88 MB (28184072) - PerReadThreadRawHdfsThroughput: 500.62 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 155.65K (155648) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 122.87 K/sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 2.946ms - TotalReadThroughput: 14.67 KB/sec Buffer pool: - AllocTime: 645.963us - CumulativeAllocationBytes: 2.12 MB (2228224) - CumulativeAllocations: 2 (2) - PeakReservation: 24.00 MB (25165824) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.00 MB (2097152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 41.913ms, non-child: 41.913ms, % non-child: 100.00%) - CodegenTime: 425.767us - CompileTime: 5.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 7 (7) - NumInstructions: 105 (105) - OptimizationTime: 9.220ms - PeakMemoryUsage: 52.50 KB (53760) - PrepareTime: 26.427ms Averaged Fragment F11:(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1m23s max:1m23s mean: 1m23s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.81 GB (6239977558) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 11.63 GB (12482366368) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 11s305ms - TotalNetworkSendTime: 38s197ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.42K (3416) - TotalThreadsTotalWallClockTime: 1m23s - TotalThreadsSysTime: 12s021ms - TotalThreadsUserTime: 21s256ms - TotalThreadsVoluntaryContextSwitches: 104 (104) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1m8s - ExecTreeExecTime: 8s948ms - OpenTime: 14s666ms - ExecTreeOpenTime: 14s646ms - PrepareTime: 1.615ms - ExecTreePrepareTime: 191.068us DataStreamSender (dst_id=25):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 30.08 GB (32296562757) - NetworkThroughput(*): 562.41 MB/sec - OverallThroughput: 404.08 MB/sec - PeakMemoryUsage: 34.88 KB (35712) - RowsReturned: 2 (2) - SerializeBatchTime: 21s457ms - TransmitDataRPCTime: 54s764ms - UncompressedRowBatchSize: 32.71 GB (35121986928) UNION_NODE (id=7):(Total: 23s594ms, non-child: 372.034ms, % non-child: 1.58%) - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 0 AGGREGATION_NODE (id=24):(Total: 6s964ms, non-child: 6s196ms, % non-child: 88.97%) - BuildTime: 4s350ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 768.049ms, non-child: 768.049ms, % non-child: 100.00%) - ConvertRowBatchTime: 41.814us - PeakMemoryUsage: 325.25 MB (341052294) - RowsReturned: 13 (13) - RowsReturnedRate: 16.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 1.67 GB (1794246627) - DeserializeRowBatchTimer: 3s377ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 325.25 MB (341052294) - SendersBlockedTimer: 23s660ms - SendersBlockedTotalTimer(*): 3m39s AGGREGATION_NODE (id=22):(Total: 16s258ms, non-child: 5s720ms, % non-child: 35.19%) - BuildTime: 4s108ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 10s537ms, non-child: 10s537ms, % non-child: 100.00%) - ConvertRowBatchTime: 45.066us - PeakMemoryUsage: 319.41 MB (334926135) - RowsReturned: 13 (13) - RowsReturnedRate: 1.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 1.67 GB (1794271519) - DeserializeRowBatchTimer: 3s352ms - FirstBatchArrivalWaitTime: 6s279ms - PeakMemoryUsage: 319.41 MB (334926135) - SendersBlockedTimer: 2s296ms - SendersBlockedTotalTimer(*): 8s735ms CodeGen:(Total: 19.999ms, non-child: 19.999ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.445ms Fragment F11: Instance 9b439fc1ee1addb7:82d415690000003f (host=vb0204.foo:22000):(Total: 1m23s, non-child: 0.000ns, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 1m23s - Prepare Finished: 2.980ms (2.980ms) - Open Finished: 14s669ms (14s666ms) - First Batch Produced: 16s281ms (1s611ms) - First Batch Sent: 26s043ms (9s762ms) - ExecInternal Finished: 1m23s (57s369ms) MemoryUsage(2s000ms): 50.88 KB, 50.88 KB, 50.88 KB, 371.40 MB, 764.54 MB, 1.65 GB, 3.66 GB, 4.98 GB, 5.81 GB, 5.81 GB, 5.81 GB, 5.81 GB, 5.81 GB, 1.59 GB, 2.52 GB, 4.41 GB, 5.47 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB, 5.69 GB ThreadUsage(2s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.81 GB (6239977558) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 11.63 GB (12482366368) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 11s305ms - TotalNetworkSendTime: 38s197ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 3.42K (3416) - TotalThreadsTotalWallClockTime: 1m23s - TotalThreadsSysTime: 12s021ms - TotalThreadsUserTime: 21s256ms - TotalThreadsVoluntaryContextSwitches: 104 (104) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1m8s - ExecTreeExecTime: 8s948ms - OpenTime: 14s666ms - ExecTreeOpenTime: 14s646ms - PrepareTime: 1.615ms - ExecTreePrepareTime: 191.068us DataStreamSender (dst_id=25):(Total: 1m16s, non-child: 1m16s, % non-child: 100.00%) - BytesSent: 30.08 GB (32296562757) - NetworkThroughput(*): 562.41 MB/sec - OverallThroughput: 404.08 MB/sec - PeakMemoryUsage: 34.88 KB (35712) - RowsReturned: 2 (2) - SerializeBatchTime: 21s457ms - TransmitDataRPCTime: 54s764ms - UncompressedRowBatchSize: 32.71 GB (35121986928) UNION_NODE (id=7):(Total: 23s594ms, non-child: 372.034ms, % non-child: 1.58%) ExecOption: Codegen Enabled - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 0 AGGREGATION_NODE (id=24):(Total: 6s964ms, non-child: 6s196ms, % non-child: 88.97%) - BuildTime: 4s350ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 768.049ms, non-child: 768.049ms, % non-child: 100.00%) - ConvertRowBatchTime: 41.814us - PeakMemoryUsage: 325.25 MB (341052294) - RowsReturned: 13 (13) - RowsReturnedRate: 16.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 111.28 MB, 111.28 MB, 224.67 MB, 224.67 MB, 342.45 MB, 342.45 MB, 342.45 MB, 342.45 MB, 595.76 MB, 860.21 MB, 1.24 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794246627) - DeserializeRowBatchTimer: 3s377ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 325.25 MB (341052294) - SendersBlockedTimer: 23s660ms - SendersBlockedTotalTimer(*): 3m39s AGGREGATION_NODE (id=22):(Total: 16s258ms, non-child: 5s720ms, % non-child: 35.19%) - BuildTime: 4s108ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.04 GB (4342299151) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=21):(Total: 10s537ms, non-child: 10s537ms, % non-child: 100.00%) - ConvertRowBatchTime: 45.066us - PeakMemoryUsage: 319.41 MB (334926135) - RowsReturned: 13 (13) - RowsReturnedRate: 1.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 224.67 MB, 224.67 MB, 224.67 MB, 224.67 MB, 224.67 MB, 224.67 MB, 464.04 MB, 595.77 MB, 595.77 MB, 595.77 MB, 1003.18 MB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB, 1.67 GB - BytesReceived: 1.67 GB (1794271519) - DeserializeRowBatchTimer: 3s352ms - FirstBatchArrivalWaitTime: 6s279ms - PeakMemoryUsage: 319.41 MB (334926135) - SendersBlockedTimer: 2s296ms - SendersBlockedTotalTimer(*): 8s735ms CodeGen:(Total: 19.999ms, non-child: 19.999ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 19.445ms Averaged Fragment F07:(Total: 11s187ms, non-child: 1s159ms, % non-child: 10.36%) split sizes: min: 1.24 GB, max: 1.73 GB, avg: 1.45 GB, stddev: 144.00 MB completion times: min:6s535ms max:14s323ms mean: 11s195ms stddev:2s561ms execution rates: min:100.08 MB/sec max:194.51 MB/sec mean:138.40 MB/sec stddev:27.54 MB/sec num instances: 13 - AverageThreadTokens: 1.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 808.64 MB (847915587) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.22 GB (3459681964) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s240ms - TotalStorageWaitTime: 278.671ms - TotalThreadsInvoluntaryContextSwitches: 1.72K (1717) - TotalThreadsTotalWallClockTime: 21s359ms - TotalThreadsSysTime: 910.091ms - TotalThreadsUserTime: 10s822ms - TotalThreadsVoluntaryContextSwitches: 3.65K (3645) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s385ms - ExecTreeExecTime: 143.771ms - OpenTime: 5s797ms - ExecTreeOpenTime: 5s539ms - PrepareTime: 4.034ms - ExecTreePrepareTime: 764.064us DataStreamSender (dst_id=21):(Total: 4s088ms, non-child: 4s088ms, % non-child: 100.00%) - BytesSent: 131.63 MB (138020886) - NetworkThroughput(*): 74.41 MB/sec - OverallThroughput: 40.34 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 861.711ms - TransmitDataRPCTime: 3s225ms - UncompressedRowBatchSize: 143.14 MB (150094007) AGGREGATION_NODE (id=9):(Total: 5s683ms, non-child: 5s587ms, % non-child: 98.30%) - BuildTime: 5s438ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 476.92 MB (500091650) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 96.627ms, non-child: 96.627ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 1.81 - BytesRead: 858.43 MB (900127497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 858.43 MB (900127497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 858.43 MB (900127497) - CachedFileHandlesHitCount: 124 (124) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s121ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 351.39 MB (368462226) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 72.032ms - RowBatchQueuePutWaitTime: 4s831ms - RowsRead: 34.62M (34615384) - RowsReturned: 3.51M (3510215) - RowsReturnedRate: 37.92 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1008) - ScannerThreadsTotalWallClockTime: 10s176ms - MaterializeTupleTime(*): 1s706ms - ScannerThreadsSysTime: 289.954ms - ScannerThreadsUserTime: 4s744ms - ScannerThreadsVoluntaryContextSwitches: 3.17K (3173) - TotalRawHdfsReadTime(*): 668.830ms - TotalReadThroughput: 146.86 MB/sec Buffer pool: - AllocTime: 7.658ms - CumulativeAllocationBytes: 342.74 MB (359389341) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 111.69 MB (117117873) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 255.433ms, non-child: 255.433ms, % non-child: 100.00%) - CodegenTime: 8.747ms - CompileTime: 61.329ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 161.743ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.720ms Fragment F07: Instance 9b439fc1ee1addb7:82d4156900000027 (host=vb0230.foo:22000):(Total: 14s316ms, non-child: 2s628ms, % non-child: 18.36%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 14s322ms - Prepare Finished: 10.343ms (10.343ms) - Open Finished: 6s879ms (6s869ms) - First Batch Produced: 7s065ms (185.873ms) - First Batch Sent: 8s072ms (1s007ms) - ExecInternal Finished: 14s322ms (6s250ms) MemoryUsage(500.000ms): 222.62 MB, 379.72 MB, 411.74 MB, 476.19 MB, 476.04 MB, 604.67 MB, 604.00 MB, 600.29 MB, 608.27 MB, 607.78 MB, 863.95 MB, 855.66 MB, 853.45 MB, 768.06 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 864.50 MB (906488784) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.53 GB (3787138653) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s017ms - TotalStorageWaitTime: 309.245ms - TotalThreadsInvoluntaryContextSwitches: 1.98K (1978) - TotalThreadsTotalWallClockTime: 26s285ms - TotalThreadsSysTime: 1s012ms - TotalThreadsUserTime: 12s932ms - TotalThreadsVoluntaryContextSwitches: 4.10K (4099) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7s443ms - ExecTreeExecTime: 185.868ms - OpenTime: 6s869ms - ExecTreeOpenTime: 6s640ms - PrepareTime: 4.587ms - ExecTreePrepareTime: 1.473ms DataStreamSender (dst_id=21):(Total: 4s635ms, non-child: 4s635ms, % non-child: 100.00%) - BytesSent: 158.28 MB (165966339) - NetworkThroughput(*): 43.65 MB/sec - OverallThroughput: 34.15 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 1s007ms - TransmitDataRPCTime: 3s625ms - UncompressedRowBatchSize: 172.12 MB (180484551) AGGREGATION_NODE (id=9):(Total: 6s827ms, non-child: 6s716ms, % non-child: 98.36%) ExecOption: Codegen Enabled - BuildTime: 6s525ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541372054) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 111.667ms, non-child: 111.667ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:78.57% 1:14.29% 2:7.143% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 57.16 MB, 182.39 MB, 254.39 MB, 293.06 MB, 443.45 MB, 499.45 MB, 563.45 MB, 610.74 MB, 744.56 MB, 808.56 MB, 864.56 MB, 934.44 MB, 998.44 MB, 1.00 GB - FooterProcessingTime: (Avg: 3.750ms ; Min: 246.142us ; Max: 13.609ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 1.71 - BytesRead: 1.00 GB (1075606152) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.00 GB (1075606152) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.00 GB (1075606152) - CachedFileHandlesHitCount: 147 (147) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s703ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 349.85 MB (366841028) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 76.942ms - RowBatchQueuePutWaitTime: 5s645ms - RowsRead: 41.37M (41368075) - RowsReturned: 4.22M (4220849) - RowsReturnedRate: 37.80 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1158) - ScannerThreadsTotalWallClockTime: 11s972ms - MaterializeTupleTime(*): 2s040ms - ScannerThreadsSysTime: 311.951ms - ScannerThreadsUserTime: 5s675ms - ScannerThreadsVoluntaryContextSwitches: 3.77K (3772) - TotalRawHdfsReadTime(*): 772.858ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 9.587ms - CumulativeAllocationBytes: 396.38 MB (415629312) - CumulativeAllocations: 63 (63) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 225.768ms, non-child: 225.768ms, % non-child: 100.00%) - CodegenTime: 7.708ms - CompileTime: 54.893ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.596ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.643ms Instance 9b439fc1ee1addb7:82d4156900000026 (host=vb0218.foo:22000):(Total: 14s312ms, non-child: 3s099ms, % non-child: 21.66%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 14s316ms - Prepare Finished: 8.279ms (8.279ms) - Open Finished: 5s861ms (5s853ms) - First Batch Produced: 6s009ms (148.309ms) - First Batch Sent: 6s893ms (883.365ms) - ExecInternal Finished: 14s316ms (7s423ms) MemoryUsage(500.000ms): 15.88 KB, 248.30 MB, 387.95 MB, 421.36 MB, 480.74 MB, 481.86 MB, 608.65 MB, 608.54 MB, 603.27 MB, 602.66 MB, 602.67 MB, 854.44 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.72 - BloomFilterBytes: 0 - PeakMemoryUsage: 859.45 MB (901203750) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3783367163) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7s423ms - TotalStorageWaitTime: 294.602ms - TotalThreadsInvoluntaryContextSwitches: 1.76K (1761) - TotalThreadsTotalWallClockTime: 24s769ms - TotalThreadsSysTime: 900.861ms - TotalThreadsUserTime: 11s139ms - TotalThreadsVoluntaryContextSwitches: 4.03K (4028) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8s454ms - ExecTreeExecTime: 148.303ms - OpenTime: 5s853ms - ExecTreeOpenTime: 5s506ms - PrepareTime: 3.801ms - ExecTreePrepareTime: 324.483us DataStreamSender (dst_id=21):(Total: 5s214ms, non-child: 5s214ms, % non-child: 100.00%) - BytesSent: 135.44 MB (142017690) - NetworkThroughput(*): 31.28 MB/sec - OverallThroughput: 25.97 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 883.347ms - TransmitDataRPCTime: 4s329ms - UncompressedRowBatchSize: 147.29 MB (154441584) AGGREGATION_NODE (id=9):(Total: 5s654ms, non-child: 5s548ms, % non-child: 98.12%) ExecOption: Codegen Enabled - BuildTime: 5s395ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541371679) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 106.189ms, non-child: 106.189ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 102.40 MB, 198.40 MB, 262.40 MB, 348.29 MB, 467.48 MB, 515.48 MB, 566.83 MB, 649.36 MB, 768.56 MB, 848.56 MB, 875.89 MB - FooterProcessingTime: (Avg: 2.766ms ; Min: 205.501us ; Max: 13.994ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.91 - BytesRead: 879.24 MB (921948124) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921948124) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921948124) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s366ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 355.47 MB (372736548) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 82.151ms - RowBatchQueuePutWaitTime: 4s731ms - RowsRead: 35.46M (35459311) - RowsReturned: 3.61M (3611897) - RowsReturnedRate: 34.01 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.02K (1023) - ScannerThreadsTotalWallClockTime: 10s461ms - MaterializeTupleTime(*): 1s815ms - ScannerThreadsSysTime: 273.957ms - ScannerThreadsUserTime: 5s039ms - ScannerThreadsVoluntaryContextSwitches: 3.25K (3251) - TotalRawHdfsReadTime(*): 656.693ms - TotalReadThroughput: 145.98 MB/sec Buffer pool: - AllocTime: 6.341ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 343.158ms, non-child: 343.158ms, % non-child: 100.00%) - CodegenTime: 11.132ms - CompileTime: 87.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 216.877ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 38.194ms Instance 9b439fc1ee1addb7:82d4156900000031 (host=vb0234.foo:22000):(Total: 14s087ms, non-child: 2s545ms, % non-child: 18.07%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 14s090ms - Prepare Finished: 8.012ms (8.012ms) - Open Finished: 5s936ms (5s928ms) - First Batch Produced: 6s076ms (139.863ms) - First Batch Sent: 6s906ms (829.634ms) - ExecInternal Finished: 14s090ms (7s183ms) MemoryUsage(500.000ms): 238.69 MB, 379.93 MB, 411.62 MB, 476.85 MB, 476.10 MB, 474.75 MB, 603.12 MB, 603.20 MB, 602.46 MB, 599.92 MB, 592.61 MB, 756.57 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - PeakMemoryUsage: 850.20 MB (891495906) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.24 GB (3474569233) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6s909ms - TotalStorageWaitTime: 297.799ms - TotalThreadsInvoluntaryContextSwitches: 1.75K (1753) - TotalThreadsTotalWallClockTime: 24s531ms - TotalThreadsSysTime: 893.862ms - TotalThreadsUserTime: 10s829ms - TotalThreadsVoluntaryContextSwitches: 3.33K (3334) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8s153ms - ExecTreeExecTime: 139.856ms - OpenTime: 5s928ms - ExecTreeOpenTime: 5s700ms - PrepareTime: 4.894ms - ExecTreePrepareTime: 743.140us DataStreamSender (dst_id=21):(Total: 5s474ms, non-child: 5s474ms, % non-child: 100.00%) - BytesSent: 127.69 MB (133896098) - NetworkThroughput(*): 27.49 MB/sec - OverallThroughput: 23.33 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 829.619ms - TransmitDataRPCTime: 4s644ms - UncompressedRowBatchSize: 138.86 MB (145608801) AGGREGATION_NODE (id=9):(Total: 5s840ms, non-child: 5s761ms, % non-child: 98.63%) ExecOption: Codegen Enabled - BuildTime: 5s616ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.30 MB (541375867) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 79.893ms, non-child: 79.893ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 95.78 MB, 198.40 MB, 246.40 MB, 289.73 MB, 411.46 MB, 475.46 MB, 531.46 MB, 582.81 MB, 699.26 MB, 757.26 MB, 805.26 MB, 816.62 MB - FooterProcessingTime: (Avg: 2.255ms ; Min: 300.768us ; Max: 11.802ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.75 - BytesRead: 816.62 MB (856291544) - BytesReadDataNodeCache: 0 - BytesReadLocal: 816.62 MB (856291544) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 816.62 MB (856291544) - CachedFileHandlesHitCount: 118 (118) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s022ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 347.84 MB (364737855) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 53.538ms - RowBatchQueuePutWaitTime: 5s250ms - RowsRead: 32.93M (32928322) - RowsReturned: 3.41M (3405300) - RowsReturnedRate: 42.62 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.02K (1024) - ScannerThreadsTotalWallClockTime: 10s449ms - MaterializeTupleTime(*): 1s654ms - ScannerThreadsSysTime: 248.961ms - ScannerThreadsUserTime: 4s646ms - ScannerThreadsVoluntaryContextSwitches: 2.95K (2948) - TotalRawHdfsReadTime(*): 626.556ms - TotalReadThroughput: 136.10 MB/sec Buffer pool: - AllocTime: 5.449ms - CumulativeAllocationBytes: 331.25 MB (347340800) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 225.939ms, non-child: 225.939ms, % non-child: 100.00%) - CodegenTime: 7.979ms - CompileTime: 57.543ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.363ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.456ms Instance 9b439fc1ee1addb7:82d4156900000029 (host=vb0220.foo:22000):(Total: 12s675ms, non-child: 1s295ms, % non-child: 10.22%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 12s676ms - Prepare Finished: 4.109ms (4.109ms) - Open Finished: 6s466ms (6s462ms) - First Batch Produced: 6s612ms (146.139ms) - First Batch Sent: 7s482ms (870.041ms) - ExecInternal Finished: 12s676ms (5s194ms) MemoryUsage(500.000ms): 242.43 MB, 375.03 MB, 407.20 MB, 471.79 MB, 477.65 MB, 478.06 MB, 604.84 MB, 604.12 MB, 606.86 MB, 604.11 MB, 604.00 MB, 860.58 MB, 778.68 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.96 - BloomFilterBytes: 0 - PeakMemoryUsage: 862.01 MB (903881428) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3617652252) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s926ms - TotalStorageWaitTime: 431.981ms - TotalThreadsInvoluntaryContextSwitches: 1.93K (1929) - TotalThreadsTotalWallClockTime: 24s771ms - TotalThreadsSysTime: 940.856ms - TotalThreadsUserTime: 11s668ms - TotalThreadsVoluntaryContextSwitches: 3.70K (3702) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s210ms - ExecTreeExecTime: 146.133ms - OpenTime: 6s462ms - ExecTreeOpenTime: 6s237ms - PrepareTime: 2.729ms - ExecTreePrepareTime: 446.793us DataStreamSender (dst_id=21):(Total: 4s773ms, non-child: 4s773ms, % non-child: 100.00%) - BytesSent: 134.11 MB (140621105) - NetworkThroughput(*): 34.36 MB/sec - OverallThroughput: 28.09 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 870.020ms - TransmitDataRPCTime: 3s903ms - UncompressedRowBatchSize: 145.84 MB (152920393) AGGREGATION_NODE (id=9):(Total: 6s383ms, non-child: 6s216ms, % non-child: 97.38%) ExecOption: Codegen Enabled - BuildTime: 6s065ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.32 MB (541404551) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 167.372ms, non-child: 167.372ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:92.31% 1:0% 2:7.692% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 78.39 MB, 198.39 MB, 246.39 MB, 289.73 MB, 411.47 MB, 467.47 MB, 531.47 MB, 579.47 MB, 704.53 MB, 768.53 MB, 824.53 MB, 867.87 MB, 879.21 MB - FooterProcessingTime: (Avg: 7.065ms ; Min: 232.800us ; Max: 13.470ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 1.85 - BytesRead: 879.21 MB (921923583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.21 MB (921923583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.21 MB (921923583) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s287ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 348.98 MB (365931899) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 142.438ms - RowBatchQueuePutWaitTime: 6s370ms - RowsRead: 35.46M (35457025) - RowsReturned: 3.58M (3576349) - RowsReturnedRate: 21.37 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.19K (1186) - ScannerThreadsTotalWallClockTime: 12s099ms - MaterializeTupleTime(*): 1s762ms - ScannerThreadsSysTime: 271.958ms - ScannerThreadsUserTime: 5s016ms - ScannerThreadsVoluntaryContextSwitches: 3.24K (3239) - TotalRawHdfsReadTime(*): 645.547ms - TotalReadThroughput: 135.26 MB/sec Buffer pool: - AllocTime: 7.489ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 222.569ms, non-child: 222.569ms, % non-child: 100.00%) - CodegenTime: 7.447ms - CompileTime: 54.548ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.868ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.578ms Instance 9b439fc1ee1addb7:82d415690000002c (host=vb0214.foo:22000):(Total: 12s661ms, non-child: 1s119ms, % non-child: 8.84%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB Fragment Instance Lifecycle Event Timeline: 12s670ms - Prepare Finished: 14.533ms (14.533ms) - Open Finished: 6s551ms (6s537ms) - First Batch Produced: 6s718ms (166.427ms) - First Batch Sent: 7s686ms (967.905ms) - ExecInternal Finished: 12s670ms (4s984ms) MemoryUsage(500.000ms): 288.04 MB, 381.83 MB, 414.82 MB, 479.82 MB, 479.23 MB, 605.91 MB, 606.20 MB, 601.01 MB, 607.42 MB, 611.42 MB, 864.09 MB, 847.87 MB, 774.75 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.80 MB (907857134) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.54 GB (3800541826) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s983ms - TotalStorageWaitTime: 209.858ms - TotalThreadsInvoluntaryContextSwitches: 1.97K (1974) - TotalThreadsTotalWallClockTime: 24s260ms - TotalThreadsSysTime: 1s082ms - TotalThreadsUserTime: 12s154ms - TotalThreadsVoluntaryContextSwitches: 4.58K (4575) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s118ms - ExecTreeExecTime: 166.418ms - OpenTime: 6s537ms - ExecTreeOpenTime: 6s307ms - PrepareTime: 5.653ms - ExecTreePrepareTime: 1.682ms DataStreamSender (dst_id=21):(Total: 4s838ms, non-child: 4s838ms, % non-child: 100.00%) - BytesSent: 147.07 MB (154215584) - NetworkThroughput(*): 38.00 MB/sec - OverallThroughput: 30.39 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 967.870ms - TransmitDataRPCTime: 3s870ms - UncompressedRowBatchSize: 159.93 MB (167698809) AGGREGATION_NODE (id=9):(Total: 6s475ms, non-child: 6s381ms, % non-child: 98.54%) ExecOption: Codegen Enabled - BuildTime: 6s210ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541409989) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 94.232ms, non-child: 94.232ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 126.39 MB, 190.39 MB, 254.39 MB, 293.07 MB, 435.48 MB, 499.48 MB, 563.48 MB, 696.54 MB, 760.54 MB, 824.54 MB, 875.88 MB, 936.73 MB, 961.16 MB - FooterProcessingTime: (Avg: 2.741ms ; Min: 203.290us ; Max: 17.471ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 961.16 MB (1007851294) - BytesReadDataNodeCache: 0 - BytesReadLocal: 961.16 MB (1007851294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 961.16 MB (1007851294) - CachedFileHandlesHitCount: 139 (139) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s493ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 355.17 MB (372421311) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 65.517ms - RowBatchQueuePutWaitTime: 5s709ms - RowsRead: 38.76M (38758503) - RowsReturned: 3.92M (3921890) - RowsReturnedRate: 41.62 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.14K (1139) - ScannerThreadsTotalWallClockTime: 11s604ms - MaterializeTupleTime(*): 1s928ms - ScannerThreadsSysTime: 352.945ms - ScannerThreadsUserTime: 5s310ms - ScannerThreadsVoluntaryContextSwitches: 3.79K (3795) - TotalRawHdfsReadTime(*): 712.385ms - TotalReadThroughput: 147.87 MB/sec Buffer pool: - AllocTime: 7.594ms - CumulativeAllocationBytes: 387.88 MB (406716416) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 226.882ms, non-child: 226.882ms, % non-child: 100.00%) - CodegenTime: 7.386ms - CompileTime: 55.791ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.505ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.015ms Instance 9b439fc1ee1addb7:82d415690000002e (host=vb0228.foo:22000):(Total: 12s408ms, non-child: 1s162ms, % non-child: 9.37%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB Fragment Instance Lifecycle Event Timeline: 12s409ms - Prepare Finished: 4.033ms (4.033ms) - Open Finished: 6s522ms (6s518ms) - First Batch Produced: 6s683ms (161.163ms) - First Batch Sent: 7s628ms (944.323ms) - ExecInternal Finished: 12s409ms (4s781ms) MemoryUsage(500.000ms): 855.38 KB, 369.63 MB, 421.81 MB, 420.51 MB, 479.62 MB, 487.34 MB, 607.96 MB, 610.70 MB, 603.52 MB, 603.15 MB, 603.37 MB, 860.86 MB, 857.90 MB, 590.83 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 861.28 MB (903118606) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3621254943) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s543ms - TotalStorageWaitTime: 250.248ms - TotalThreadsInvoluntaryContextSwitches: 1.93K (1934) - TotalThreadsTotalWallClockTime: 24s227ms - TotalThreadsSysTime: 956.853ms - TotalThreadsUserTime: 12s071ms - TotalThreadsVoluntaryContextSwitches: 4.05K (4050) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s887ms - ExecTreeExecTime: 161.156ms - OpenTime: 6s518ms - ExecTreeOpenTime: 6s297ms - PrepareTime: 2.047ms - ExecTreePrepareTime: 583.522us DataStreamSender (dst_id=21):(Total: 4s568ms, non-child: 4s568ms, % non-child: 100.00%) - BytesSent: 140.82 MB (147657661) - NetworkThroughput(*): 38.86 MB/sec - OverallThroughput: 30.82 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 944.306ms - TransmitDataRPCTime: 3s623ms - UncompressedRowBatchSize: 153.13 MB (160567743) AGGREGATION_NODE (id=9):(Total: 6s459ms, non-child: 6s372ms, % non-child: 98.65%) ExecOption: Codegen Enabled - BuildTime: 6s205ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541373528) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 86.979ms, non-child: 86.979ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:75% 1:25% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 158.40 MB, 214.40 MB, 278.40 MB, 348.29 MB, 435.83 MB, 515.02 MB, 579.02 MB, 677.56 MB, 728.90 MB, 832.10 MB, 880.10 MB, 923.44 MB - FooterProcessingTime: (Avg: 464.360us ; Min: 239.973us ; Max: 1.074ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 934.77 MB (980181299) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.77 MB (980181299) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.77 MB (980181299) - CachedFileHandlesHitCount: 136 (136) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s378ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 358.25 MB (375657188) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 63.715ms - RowBatchQueuePutWaitTime: 6s072ms - RowsRead: 37.69M (37689367) - RowsReturned: 3.76M (3755189) - RowsReturnedRate: 43.17 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.15K (1150) - ScannerThreadsTotalWallClockTime: 11s821ms - MaterializeTupleTime(*): 1s860ms - ScannerThreadsSysTime: 282.956ms - ScannerThreadsUserTime: 5s199ms - ScannerThreadsVoluntaryContextSwitches: 3.56K (3563) - TotalRawHdfsReadTime(*): 754.844ms - TotalReadThroughput: 142.07 MB/sec Buffer pool: - AllocTime: 10.451ms - CumulativeAllocationBytes: 376.88 MB (395182080) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 218.150ms, non-child: 218.150ms, % non-child: 100.00%) - CodegenTime: 7.569ms - CompileTime: 53.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.691ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 24.932ms Instance 9b439fc1ee1addb7:82d415690000002a (host=vb0206.foo:22000):(Total: 11s555ms, non-child: 656.830ms, % non-child: 5.68%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 11s561ms - Prepare Finished: 12.225ms (12.225ms) - Open Finished: 5s544ms (5s531ms) - First Batch Produced: 5s692ms (148.253ms) - First Batch Sent: 6s596ms (904.522ms) - ExecInternal Finished: 11s561ms (4s964ms) MemoryUsage(500.000ms): 72.04 MB, 380.45 MB, 413.15 MB, 477.21 MB, 476.07 MB, 604.06 MB, 604.32 MB, 591.23 MB, 602.40 MB, 728.01 MB, 856.80 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB ThreadUsage(500.000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 858.32 MB (900015310) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.51 GB (3767381641) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s672ms - TotalStorageWaitTime: 333.955ms - TotalThreadsInvoluntaryContextSwitches: 1.80K (1802) - TotalThreadsTotalWallClockTime: 21s643ms - TotalThreadsSysTime: 880.866ms - TotalThreadsUserTime: 10s968ms - TotalThreadsVoluntaryContextSwitches: 3.71K (3706) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s017ms - ExecTreeExecTime: 148.247ms - OpenTime: 5s531ms - ExecTreeOpenTime: 5s269ms - PrepareTime: 6.294ms - ExecTreePrepareTime: 267.678us DataStreamSender (dst_id=21):(Total: 5s222ms, non-child: 5s222ms, % non-child: 100.00%) - BytesSent: 136.76 MB (143402691) - NetworkThroughput(*): 31.69 MB/sec - OverallThroughput: 26.19 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 904.499ms - TransmitDataRPCTime: 4s314ms - UncompressedRowBatchSize: 148.71 MB (155931717) AGGREGATION_NODE (id=9):(Total: 5s418ms, non-child: 5s309ms, % non-child: 98.00%) ExecOption: Codegen Enabled - BuildTime: 5s156ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541412360) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 108.403ms, non-child: 108.403ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 174.39 MB, 238.39 MB, 293.08 MB, 443.48 MB, 507.48 MB, 579.48 MB, 712.54 MB, 776.54 MB, 856.54 MB, 879.24 MB - FooterProcessingTime: (Avg: 8.824ms ; Min: 347.337us ; Max: 19.176ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.91 - BytesRead: 879.24 MB (921947767) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921947767) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921947767) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s342ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 347.36 MB (364232556) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 81.588ms - RowBatchQueuePutWaitTime: 4s350ms - RowsRead: 35.46M (35458085) - RowsReturned: 3.65M (3646907) - RowsReturnedRate: 33.64 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.14K (1136) - ScannerThreadsTotalWallClockTime: 10s094ms - MaterializeTupleTime(*): 1s795ms - ScannerThreadsSysTime: 273.958ms - ScannerThreadsUserTime: 5s091ms - ScannerThreadsVoluntaryContextSwitches: 3.35K (3346) - TotalRawHdfsReadTime(*): 719.980ms - TotalReadThroughput: 159.86 MB/sec Buffer pool: - AllocTime: 8.377ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 258.373ms, non-child: 258.373ms, % non-child: 100.00%) - CodegenTime: 10.957ms - CompileTime: 68.024ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 148.945ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 40.647ms Instance 9b439fc1ee1addb7:82d4156900000025 (host=vb0216.foo:22000):(Total: 11s554ms, non-child: 364.685ms, % non-child: 3.16%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB Fragment Instance Lifecycle Event Timeline: 11s563ms - Prepare Finished: 12.814ms (12.814ms) - Open Finished: 6s027ms (6s014ms) - First Batch Produced: 6s180ms (153.588ms) - First Batch Sent: 7s066ms (885.803ms) - ExecInternal Finished: 11s563ms (4s496ms) MemoryUsage(500.000ms): 15.88 KB, 336.13 MB, 392.07 MB, 418.96 MB, 475.82 MB, 474.72 MB, 593.98 MB, 599.67 MB, 599.48 MB, 600.71 MB, 594.63 MB, 863.24 MB, 587.79 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 863.85 MB (905814815) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3784557319) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4s496ms - TotalStorageWaitTime: 371.303ms - TotalThreadsInvoluntaryContextSwitches: 1.67K (1670) - TotalThreadsTotalWallClockTime: 21s606ms - TotalThreadsSysTime: 984.848ms - TotalThreadsUserTime: 10s807ms - TotalThreadsVoluntaryContextSwitches: 3.69K (3692) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s536ms - ExecTreeExecTime: 153.581ms - OpenTime: 6s014ms - ExecTreeOpenTime: 5s785ms - PrepareTime: 4.068ms - ExecTreePrepareTime: 576.815us DataStreamSender (dst_id=21):(Total: 5s025ms, non-child: 5s025ms, % non-child: 100.00%) - BytesSent: 135.22 MB (141785019) - NetworkThroughput(*): 32.68 MB/sec - OverallThroughput: 26.91 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 885.785ms - TransmitDataRPCTime: 4s137ms - UncompressedRowBatchSize: 147.05 MB (154191767) AGGREGATION_NODE (id=9):(Total: 5s939ms, non-child: 5s847ms, % non-child: 98.45%) ExecOption: Codegen Enabled - BuildTime: 5s688ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541408161) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 92.076ms, non-child: 92.076ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 117.47 MB, 162.38 MB, 304.21 MB, 368.21 MB, 424.21 MB, 541.29 MB, 613.29 MB, 669.29 MB, 724.00 MB, 803.20 MB, 859.20 MB - FooterProcessingTime: (Avg: 4.018ms ; Min: 220.018us ; Max: 13.875ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 870.55 MB (912842440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 870.55 MB (912842440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 870.55 MB (912842440) - CachedFileHandlesHitCount: 128 (128) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s954ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 353.12 MB (370275926) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.523ms - RowBatchQueuePutWaitTime: 4s844ms - RowsRead: 35.10M (35096614) - RowsReturned: 3.61M (3606066) - RowsReturnedRate: 39.16 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 945 (945) - ScannerThreadsTotalWallClockTime: 10s055ms - MaterializeTupleTime(*): 1s652ms - ScannerThreadsSysTime: 331.948ms - ScannerThreadsUserTime: 4s494ms - ScannerThreadsVoluntaryContextSwitches: 3.04K (3043) - TotalRawHdfsReadTime(*): 714.333ms - TotalReadThroughput: 143.20 MB/sec Buffer pool: - AllocTime: 10.521ms - CumulativeAllocationBytes: 367.38 MB (385220608) - CumulativeAllocations: 59 (59) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 225.707ms, non-child: 225.707ms, % non-child: 100.00%) - CodegenTime: 8.761ms - CompileTime: 55.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.572ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.491ms Instance 9b439fc1ee1addb7:82d415690000002b (host=vb0208.foo:22000):(Total: 9s854ms, non-child: 596.991ms, % non-child: 6.06%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB Fragment Instance Lifecycle Event Timeline: 9s862ms - Prepare Finished: 11.293ms (11.293ms) - Open Finished: 5s207ms (5s196ms) - First Batch Produced: 5s333ms (126.322ms) - First Batch Sent: 6s101ms (767.926ms) - ExecInternal Finished: 9s862ms (3s761ms) MemoryUsage(500.000ms): 15.88 KB, 381.72 MB, 413.36 MB, 478.28 MB, 480.39 MB, 479.10 MB, 608.49 MB, 601.56 MB, 591.49 MB, 594.45 MB, 578.30 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 734.73 MB (770417199) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.79 GB (2991089100) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s489ms - TotalStorageWaitTime: 204.404ms - TotalThreadsInvoluntaryContextSwitches: 1.50K (1499) - TotalThreadsTotalWallClockTime: 18s434ms - TotalThreadsSysTime: 881.864ms - TotalThreadsUserTime: 9s561ms - TotalThreadsVoluntaryContextSwitches: 3.43K (3428) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4s655ms - ExecTreeExecTime: 126.316ms - OpenTime: 5s196ms - ExecTreeOpenTime: 4s971ms - PrepareTime: 3.169ms - ExecTreePrepareTime: 1.564ms DataStreamSender (dst_id=21):(Total: 3s936ms, non-child: 3s936ms, % non-child: 100.00%) - BytesSent: 117.77 MB (123494249) - NetworkThroughput(*): 37.17 MB/sec - OverallThroughput: 29.92 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 767.908ms - TransmitDataRPCTime: 3s168ms - UncompressedRowBatchSize: 128.08 MB (134303344) AGGREGATION_NODE (id=9):(Total: 5s099ms, non-child: 5s031ms, % non-child: 98.67%) ExecOption: Codegen Enabled - BuildTime: 4s899ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541369184) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 67.930ms, non-child: 67.930ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 182.40 MB, 238.40 MB, 293.10 MB, 435.49 MB, 507.49 MB, 571.49 MB, 675.09 MB, 718.65 MB, 777.99 MB - FooterProcessingTime: (Avg: 470.749us ; Min: 208.509us ; Max: 1.157ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 777.99 MB (815780517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 777.99 MB (815780517) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 777.99 MB (815780517) - CachedFileHandlesHitCount: 113 (113) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s730ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.24 MB (367250952) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 48.450ms - RowBatchQueuePutWaitTime: 3s935ms - RowsRead: 31.37M (31367379) - RowsReturned: 3.14M (3140888) - RowsReturnedRate: 46.24 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 832 (832) - ScannerThreadsTotalWallClockTime: 8s582ms - MaterializeTupleTime(*): 1s505ms - ScannerThreadsSysTime: 287.955ms - ScannerThreadsUserTime: 4s132ms - ScannerThreadsVoluntaryContextSwitches: 2.94K (2935) - TotalRawHdfsReadTime(*): 665.543ms - TotalReadThroughput: 155.60 MB/sec Buffer pool: - AllocTime: 7.243ms - CumulativeAllocationBytes: 319.25 MB (334757888) - CumulativeAllocations: 51 (51) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 221.656ms, non-child: 221.656ms, % non-child: 100.00%) - CodegenTime: 7.754ms - CompileTime: 54.111ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.333ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 27.643ms Instance 9b439fc1ee1addb7:82d415690000002d (host=vb0224.foo:22000):(Total: 9s845ms, non-child: 417.106ms, % non-child: 4.24%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 9s863ms - Prepare Finished: 23.239ms (23.239ms) - Open Finished: 5s367ms (5s343ms) - First Batch Produced: 5s498ms (131.750ms) - First Batch Sent: 6s367ms (868.596ms) - ExecInternal Finished: 9s863ms (3s496ms) MemoryUsage(500.000ms): 855.38 KB, 336.06 MB, 413.00 MB, 473.84 MB, 478.08 MB, 606.60 MB, 599.32 MB, 608.74 MB, 608.81 MB, 737.71 MB, 790.36 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.90 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.92 MB (907978405) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3782209420) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3s495ms - TotalStorageWaitTime: 175.220ms - TotalThreadsInvoluntaryContextSwitches: 1.56K (1556) - TotalThreadsTotalWallClockTime: 19s234ms - TotalThreadsSysTime: 955.853ms - TotalThreadsUserTime: 10s366ms - TotalThreadsVoluntaryContextSwitches: 3.28K (3282) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4s496ms - ExecTreeExecTime: 131.743ms - OpenTime: 5s343ms - ExecTreeOpenTime: 4s992ms - PrepareTime: 5.121ms - ExecTreePrepareTime: 887.081us DataStreamSender (dst_id=21):(Total: 3s954ms, non-child: 3s954ms, % non-child: 100.00%) - BytesSent: 131.73 MB (138128544) - NetworkThroughput(*): 42.73 MB/sec - OverallThroughput: 33.31 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 868.575ms - TransmitDataRPCTime: 3s082ms - UncompressedRowBatchSize: 143.26 MB (150214034) AGGREGATION_NODE (id=9):(Total: 5s125ms, non-child: 5s053ms, % non-child: 98.61%) ExecOption: Codegen Enabled - BuildTime: 4s917ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541410161) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 71.485ms, non-child: 71.485ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 166.40 MB, 254.40 MB, 348.28 MB, 459.47 MB, 523.47 MB, 607.40 MB, 736.56 MB, 816.56 MB, 859.90 MB, 879.24 MB - FooterProcessingTime: (Avg: 312.342us ; Min: 241.654us ; Max: 364.824us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 1.80 - BytesRead: 879.24 MB (921949692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921949692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921949692) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s224ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 353.02 MB (370165288) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 47.723ms - RowBatchQueuePutWaitTime: 4s020ms - RowsRead: 35.46M (35458554) - RowsReturned: 3.51M (3513064) - RowsReturnedRate: 49.14 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 930 (930) - ScannerThreadsTotalWallClockTime: 9s393ms - MaterializeTupleTime(*): 1s741ms - ScannerThreadsSysTime: 333.948ms - ScannerThreadsUserTime: 4s822ms - ScannerThreadsVoluntaryContextSwitches: 3.02K (3016) - TotalRawHdfsReadTime(*): 647.692ms - TotalReadThroughput: 159.86 MB/sec Buffer pool: - AllocTime: 5.458ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 348.582ms, non-child: 348.582ms, % non-child: 100.00%) - CodegenTime: 7.690ms - CompileTime: 56.446ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 261.016ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.482ms Instance 9b439fc1ee1addb7:82d4156900000028 (host=vb0222.foo:22000):(Total: 9s098ms, non-child: 293.500ms, % non-child: 3.23%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 9s102ms - Prepare Finished: 7.247ms (7.247ms) - Open Finished: 5s449ms (5s442ms) - First Batch Produced: 5s579ms (129.839ms) - First Batch Sent: 6s387ms (808.206ms) - ExecInternal Finished: 9s102ms (2s714ms) MemoryUsage(500.000ms): 216.43 MB, 379.93 MB, 411.68 MB, 473.76 MB, 473.16 MB, 469.63 MB, 601.21 MB, 600.39 MB, 599.65 MB, 593.73 MB, 810.28 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.06 - BloomFilterBytes: 0 - PeakMemoryUsage: 810.28 MB (849636862) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.10 GB (3327786148) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2s713ms - TotalStorageWaitTime: 234.329ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1591) - TotalThreadsTotalWallClockTime: 18s198ms - TotalThreadsSysTime: 877.866ms - TotalThreadsUserTime: 10s065ms - TotalThreadsVoluntaryContextSwitches: 3.20K (3203) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 3s653ms - ExecTreeExecTime: 129.833ms - OpenTime: 5s442ms - ExecTreeOpenTime: 5s199ms - PrepareTime: 2.682ms - ExecTreePrepareTime: 443.781us DataStreamSender (dst_id=21):(Total: 3s235ms, non-child: 3s235ms, % non-child: 100.00%) - BytesSent: 121.59 MB (127501254) - NetworkThroughput(*): 50.11 MB/sec - OverallThroughput: 37.58 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 808.188ms - TransmitDataRPCTime: 2s426ms - UncompressedRowBatchSize: 132.23 MB (138652919) AGGREGATION_NODE (id=9):(Total: 5s330ms, non-child: 5s252ms, % non-child: 98.54%) ExecOption: Codegen Enabled - BuildTime: 5s118ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541368056) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 77.632ms, non-child: 77.632ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 16.70 MB, 141.50 MB, 244.70 MB, 304.03 MB, 407.24 MB, 505.76 MB, 561.76 MB, 613.10 MB, 711.62 MB, 759.62 MB, 786.96 MB - FooterProcessingTime: (Avg: 3.309ms ; Min: 146.396us ; Max: 10.231ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.73 - BytesRead: 786.96 MB (825192372) - BytesReadDataNodeCache: 0 - BytesReadLocal: 786.96 MB (825192372) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 786.96 MB (825192372) - CachedFileHandlesHitCount: 115 (115) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s877ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 345.62 MB (362413913) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 55.876ms - RowBatchQueuePutWaitTime: 4s197ms - RowsRead: 31.73M (31733865) - RowsReturned: 3.24M (3242551) - RowsReturnedRate: 41.77 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 931 (931) - ScannerThreadsTotalWallClockTime: 9s103ms - MaterializeTupleTime(*): 1s571ms - ScannerThreadsSysTime: 282.956ms - ScannerThreadsUserTime: 4s351ms - ScannerThreadsVoluntaryContextSwitches: 2.93K (2934) - TotalRawHdfsReadTime(*): 606.716ms - TotalReadThroughput: 143.08 MB/sec Buffer pool: - AllocTime: 4.898ms - CumulativeAllocationBytes: 319.75 MB (335282176) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 239.140ms, non-child: 239.140ms, % non-child: 100.00%) - CodegenTime: 11.029ms - CompileTime: 58.886ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 143.231ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 36.248ms Instance 9b439fc1ee1addb7:82d415690000002f (host=vb0212.foo:22000):(Total: 6s539ms, non-child: 443.475ms, % non-child: 6.78%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 6s540ms - Prepare Finished: 2.952ms (2.952ms) - Open Finished: 4s888ms (4s885ms) - First Batch Produced: 5s005ms (116.227ms) - First Batch Sent: 5s726ms (721.500ms) - ExecInternal Finished: 6s540ms (813.861ms) MemoryUsage(500.000ms): 855.38 KB, 377.01 MB, 409.89 MB, 472.57 MB, 475.47 MB, 480.64 MB, 606.18 MB, 601.17 MB, 599.13 MB, 598.11 MB, 379.29 MB, 379.29 MB, 379.29 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1 - AverageThreadTokens: 2.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 611.98 MB (641711782) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.37 GB (2543089953) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 574.459ms - TotalStorageWaitTime: 244.215ms - TotalThreadsInvoluntaryContextSwitches: 1.38K (1379) - TotalThreadsTotalWallClockTime: 14s659ms - TotalThreadsSysTime: 724.888ms - TotalThreadsUserTime: 9s008ms - TotalThreadsVoluntaryContextSwitches: 3.01K (3013) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s651ms - ExecTreeExecTime: 116.218ms - OpenTime: 4s885ms - ExecTreeOpenTime: 4s665ms - PrepareTime: 1.451ms - ExecTreePrepareTime: 301.290us DataStreamSender (dst_id=21):(Total: 1s095ms, non-child: 1s095ms, % non-child: 100.00%) - BytesSent: 111.29 MB (116691455) - NetworkThroughput(*): 297.74 MB/sec - OverallThroughput: 101.56 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 721.476ms - TransmitDataRPCTime: 373.771ms - UncompressedRowBatchSize: 121.02 MB (126901687) AGGREGATION_NODE (id=9):(Total: 4s781ms, non-child: 4s688ms, % non-child: 98.05%) ExecOption: Codegen Enabled - BuildTime: 4s568ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.29 MB (272934880) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 93.114ms, non-child: 93.114ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:11.11% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0, 166.39 MB, 230.39 MB, 289.74 MB, 419.47 MB, 483.47 MB, 539.47 MB, 607.39 MB, 681.37 MB, 732.71 MB - FooterProcessingTime: (Avg: 2.734ms ; Min: 348.224us ; Max: 11.457ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 732.71 MB (768298333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 732.71 MB (768298333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 732.71 MB (768298333) - CachedFileHandlesHitCount: 105 (105) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s557ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.95 MB (370094945) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 74.476ms - RowBatchQueuePutWaitTime: 3s726ms - RowsRead: 29.55M (29548778) - RowsReturned: 2.97M (2967885) - RowsReturnedRate: 31.87 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 803 (803) - ScannerThreadsTotalWallClockTime: 8s122ms - MaterializeTupleTime(*): 1s404ms - ScannerThreadsSysTime: 256.959ms - ScannerThreadsUserTime: 3s855ms - ScannerThreadsVoluntaryContextSwitches: 2.58K (2578) - TotalRawHdfsReadTime(*): 571.408ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 7.335ms - CumulativeAllocationBytes: 283.12 MB (296878080) - CumulativeAllocations: 45 (45) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 217.952ms, non-child: 217.952ms, % non-child: 100.00%) - CodegenTime: 7.287ms - CompileTime: 54.130ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.275ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 24.986ms Instance 9b439fc1ee1addb7:82d4156900000030 (host=vb0232.foo:22000):(Total: 6s527ms, non-child: 449.699ms, % non-child: 6.89%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 6s533ms - Prepare Finished: 11.494ms (11.494ms) - Open Finished: 4s797ms (4s786ms) - First Batch Produced: 4s913ms (115.359ms) - First Batch Sent: 5s656ms (743.664ms) - ExecInternal Finished: 6s533ms (876.239ms) MemoryUsage(500.000ms): 855.38 KB, 367.49 MB, 416.29 MB, 415.37 MB, 472.34 MB, 472.76 MB, 599.27 MB, 601.49 MB, 602.76 MB, 498.59 MB, 381.58 MB, 381.58 MB, 381.58 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1 - AverageThreadTokens: 2.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 603.95 MB (633282662) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.51 GB (2695227883) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 875.419ms - TotalStorageWaitTime: 265.567ms - TotalThreadsInvoluntaryContextSwitches: 1.50K (1497) - TotalThreadsTotalWallClockTime: 15s050ms - TotalThreadsSysTime: 736.888ms - TotalThreadsUserTime: 9s115ms - TotalThreadsVoluntaryContextSwitches: 3.28K (3277) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s735ms - ExecTreeExecTime: 115.355ms - OpenTime: 4s786ms - ExecTreeOpenTime: 4s435ms - PrepareTime: 5.946ms - ExecTreePrepareTime: 638.745us DataStreamSender (dst_id=21):(Total: 1s179ms, non-child: 1s179ms, % non-child: 100.00%) - BytesSent: 113.39 MB (118893830) - NetworkThroughput(*): 261.50 MB/sec - OverallThroughput: 96.14 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 743.642ms - TransmitDataRPCTime: 433.598ms - UncompressedRowBatchSize: 123.31 MB (129304747) AGGREGATION_NODE (id=9):(Total: 4s551ms, non-child: 4s452ms, % non-child: 97.82%) ExecOption: Codegen Enabled - BuildTime: 4s333ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.33 MB (272980984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 99.183ms, non-child: 99.183ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 151.27 MB, 186.43 MB, 292.97 MB, 396.16 MB, 463.49 MB, 558.69 MB, 610.04 MB, 706.01 MB, 736.09 MB - FooterProcessingTime: (Avg: 383.460us ; Min: 244.230us ; Max: 576.715us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 736.09 MB (771844345) - BytesReadDataNodeCache: 0 - BytesReadLocal: 736.09 MB (771844345) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 736.09 MB (771844345) - CachedFileHandlesHitCount: 108 (108) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s634ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.24 MB (367249540) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 77.484ms - RowBatchQueuePutWaitTime: 3s953ms - RowsRead: 29.68M (29676122) - RowsReturned: 3.02M (3023972) - RowsReturnedRate: 30.49 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 854 (854) - ScannerThreadsTotalWallClockTime: 8s528ms - MaterializeTupleTime(*): 1s457ms - ScannerThreadsSysTime: 258.959ms - ScannerThreadsUserTime: 4s042ms - ScannerThreadsVoluntaryContextSwitches: 2.83K (2831) - TotalRawHdfsReadTime(*): 600.232ms - TotalReadThroughput: 147.22 MB/sec Buffer pool: - AllocTime: 8.809ms - CumulativeAllocationBytes: 314.75 MB (330039296) - CumulativeAllocations: 50 (50) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 346.756ms, non-child: 346.756ms, % non-child: 100.00%) - CodegenTime: 11.008ms - CompileTime: 86.573ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 219.385ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 40.041ms Averaged Fragment F09:(Total: 27s342ms, non-child: 17s313ms, % non-child: 63.32%) split sizes: min: 1.24 GB, max: 1.73 GB, avg: 1.45 GB, stddev: 144.00 MB completion times: min:6s590ms max:31s325ms mean: 27s424ms stddev:6s204ms execution rates: min:42.89 MB/sec max:191.99 MB/sec mean:62.27 MB/sec stddev:37.60 MB/sec num instances: 13 - AverageThreadTokens: 1.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 808.45 MB (847725408) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.22 GB (3459681964) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s385ms - TotalStorageWaitTime: 279.646ms - TotalThreadsInvoluntaryContextSwitches: 1.70K (1703) - TotalThreadsTotalWallClockTime: 37s579ms - TotalThreadsSysTime: 926.011ms - TotalThreadsUserTime: 10s779ms - TotalThreadsVoluntaryContextSwitches: 3.73K (3731) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s528ms - ExecTreeExecTime: 142.004ms - OpenTime: 5s810ms - ExecTreeOpenTime: 5s556ms - PrepareTime: 3.711ms - ExecTreePrepareTime: 492.419us DataStreamSender (dst_id=23):(Total: 4s078ms, non-child: 4s078ms, % non-child: 100.00%) - BytesSent: 131.63 MB (138018971) - NetworkThroughput(*): 60.82 MB/sec - OverallThroughput: 38.22 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 868.532ms - TransmitDataRPCTime: 3s208ms - UncompressedRowBatchSize: 143.14 MB (150094007) AGGREGATION_NODE (id=11):(Total: 5s698ms, non-child: 5s600ms, % non-child: 98.27%) - BuildTime: 5s453ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 476.93 MB (500094669) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 98.478ms, non-child: 98.478ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 858.43 MB (900127497) - BytesReadDataNodeCache: 0 - BytesReadLocal: 858.43 MB (900127497) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 858.43 MB (900127497) - CachedFileHandlesHitCount: 124 (124) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s078ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 351.02 MB (368067046) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 74.051ms - RowBatchQueuePutWaitTime: 4s942ms - RowsRead: 34.62M (34615384) - RowsReturned: 3.51M (3510215) - RowsReturnedRate: 38.02 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1006) - ScannerThreadsTotalWallClockTime: 10s240ms - MaterializeTupleTime(*): 1s705ms - ScannerThreadsSysTime: 295.723ms - ScannerThreadsUserTime: 4s694ms - ScannerThreadsVoluntaryContextSwitches: 3.21K (3207) - TotalRawHdfsReadTime(*): 660.128ms - TotalReadThroughput: 147.39 MB/sec Buffer pool: - AllocTime: 7.519ms - CumulativeAllocationBytes: 342.74 MB (359389341) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 111.69 MB (117117873) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 251.643ms, non-child: 251.643ms, % non-child: 100.00%) - CodegenTime: 8.455ms - CompileTime: 60.499ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 160.636ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 29.885ms Fragment F09: Instance 9b439fc1ee1addb7:82d4156900000038 (host=vb0208.foo:22000):(Total: 31s313ms, non-child: 23s270ms, % non-child: 74.32%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB Fragment Instance Lifecycle Event Timeline: 31s323ms - Prepare Finished: 13.562ms (13.562ms) - Open Finished: 5s292ms (5s279ms) - First Batch Produced: 5s418ms (125.568ms) - First Batch Sent: 6s198ms (780.250ms) - ExecInternal Finished: 31s323ms (25s125ms) MemoryUsage(500.000ms): 15.88 KB, 372.56 MB, 415.83 MB, 480.42 MB, 480.26 MB, 540.65 MB, 606.59 MB, 600.05 MB, 600.87 MB, 593.79 MB, 734.73 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB, 642.34 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.27 - BloomFilterBytes: 0 - PeakMemoryUsage: 734.73 MB (770417199) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.79 GB (2991089100) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25s121ms - TotalStorageWaitTime: 357.421ms - TotalThreadsInvoluntaryContextSwitches: 1.48K (1480) - TotalThreadsTotalWallClockTime: 40s126ms - TotalThreadsSysTime: 897.862ms - TotalThreadsUserTime: 9s572ms - TotalThreadsVoluntaryContextSwitches: 3.30K (3299) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 26s031ms - ExecTreeExecTime: 125.562ms - OpenTime: 5s279ms - ExecTreeOpenTime: 5s050ms - PrepareTime: 3.514ms - ExecTreePrepareTime: 284.410us DataStreamSender (dst_id=23):(Total: 2s640ms, non-child: 2s640ms, % non-child: 100.00%) - BytesSent: 117.78 MB (123498756) - NetworkThroughput(*): 63.34 MB/sec - OverallThroughput: 44.60 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 780.228ms - TransmitDataRPCTime: 1s859ms - UncompressedRowBatchSize: 128.08 MB (134303344) AGGREGATION_NODE (id=11):(Total: 5s176ms, non-child: 5s065ms, % non-child: 97.84%) ExecOption: Codegen Enabled - BuildTime: 4s934ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541369184) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 111.658ms, non-child: 111.658ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.10 MB 7:1/253.09 MB 8:2/331.24 MB 6:2/506.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 140.58 MB, 259.68 MB, 303.01 MB, 417.55 MB, 512.74 MB, 576.74 MB, 675.29 MB, 718.65 MB, 774.65 MB, 777.99 MB - FooterProcessingTime: (Avg: 6.251ms ; Min: 206.544us ; Max: 18.243ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.70 - BytesRead: 777.99 MB (815780517) - BytesReadDataNodeCache: 0 - BytesReadLocal: 777.99 MB (815780517) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 777.99 MB (815780517) - CachedFileHandlesHitCount: 113 (113) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s718ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.52 MB (367547597) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 90.134ms - RowBatchQueuePutWaitTime: 4s031ms - RowsRead: 31.37M (31367379) - RowsReturned: 3.14M (3140888) - RowsReturnedRate: 28.13 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 852 (852) - ScannerThreadsTotalWallClockTime: 8s815ms - MaterializeTupleTime(*): 1s499ms - ScannerThreadsSysTime: 291.955ms - ScannerThreadsUserTime: 4s100ms - ScannerThreadsVoluntaryContextSwitches: 2.92K (2921) - TotalRawHdfsReadTime(*): 589.993ms - TotalReadThroughput: 141.45 MB/sec Buffer pool: - AllocTime: 7.149ms - CumulativeAllocationBytes: 319.25 MB (334757888) - CumulativeAllocations: 51 (51) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 225.507ms, non-child: 225.507ms, % non-child: 100.00%) - CodegenTime: 7.469ms - CompileTime: 56.280ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.502ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 28.144ms Instance 9b439fc1ee1addb7:82d4156900000034 (host=vb0230.foo:22000):(Total: 31s306ms, non-child: 19s684ms, % non-child: 62.88%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 31s314ms - Prepare Finished: 13.326ms (13.326ms) - Open Finished: 6s523ms (6s510ms) - First Batch Produced: 6s685ms (162.414ms) - First Batch Sent: 7s739ms (1s053ms) - ExecInternal Finished: 31s314ms (23s575ms) MemoryUsage(500.000ms): 230.01 MB, 381.32 MB, 414.18 MB, 476.58 MB, 476.57 MB, 604.17 MB, 604.93 MB, 594.62 MB, 602.31 MB, 603.37 MB, 859.67 MB, 856.28 MB, 841.04 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB, 686.39 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 860.95 MB (902769277) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.53 GB (3787138653) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s355ms - TotalStorageWaitTime: 234.427ms - TotalThreadsInvoluntaryContextSwitches: 1.86K (1863) - TotalThreadsTotalWallClockTime: 42s575ms - TotalThreadsSysTime: 1s014ms - TotalThreadsUserTime: 12s528ms - TotalThreadsVoluntaryContextSwitches: 4.19K (4186) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24s790ms - ExecTreeExecTime: 162.410ms - OpenTime: 6s510ms - ExecTreeOpenTime: 6s278ms - PrepareTime: 3.954ms - ExecTreePrepareTime: 269.970us DataStreamSender (dst_id=23):(Total: 4s952ms, non-child: 4s952ms, % non-child: 100.00%) - BytesSent: 158.27 MB (165961185) - NetworkThroughput(*): 40.61 MB/sec - OverallThroughput: 31.96 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 1s053ms - TransmitDataRPCTime: 3s897ms - UncompressedRowBatchSize: 172.12 MB (180484551) AGGREGATION_NODE (id=11):(Total: 6s441ms, non-child: 6s355ms, % non-child: 98.66%) ExecOption: Codegen Enabled - BuildTime: 6s186ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541410146) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 86.340ms, non-child: 86.340ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/253.08 MB 5:2/506.18 MB 0:2/506.16 MB 6:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 78.40 MB, 198.40 MB, 262.40 MB, 293.08 MB, 451.47 MB, 515.47 MB, 582.82 MB, 712.57 MB, 776.57 MB, 848.57 MB, 879.24 MB, 982.44 MB, 1.00 GB - FooterProcessingTime: (Avg: 330.356us ; Min: 223.545us ; Max: 618.927us ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 1.00 GB (1075606152) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.00 GB (1075606152) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.00 GB (1075606152) - CachedFileHandlesHitCount: 147 (147) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s650ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 348.20 MB (365113766) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 60.221ms - RowBatchQueuePutWaitTime: 5s100ms - RowsRead: 41.37M (41368075) - RowsReturned: 4.22M (4220849) - RowsReturnedRate: 48.89 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.09K (1087) - ScannerThreadsTotalWallClockTime: 11s273ms - MaterializeTupleTime(*): 2s022ms - ScannerThreadsSysTime: 343.947ms - ScannerThreadsUserTime: 5s559ms - ScannerThreadsVoluntaryContextSwitches: 3.83K (3827) - TotalRawHdfsReadTime(*): 810.366ms - TotalReadThroughput: 157.81 MB/sec Buffer pool: - AllocTime: 10.049ms - CumulativeAllocationBytes: 396.38 MB (415629312) - CumulativeAllocations: 63 (63) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 228.272ms, non-child: 228.272ms, % non-child: 100.00%) - CodegenTime: 7.847ms - CompileTime: 57.553ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.820ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 31.323ms Instance 9b439fc1ee1addb7:82d415690000003b (host=vb0228.foo:22000):(Total: 31s096ms, non-child: 19s504ms, % non-child: 62.72%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB Fragment Instance Lifecycle Event Timeline: 31s099ms - Prepare Finished: 4.728ms (4.728ms) - Open Finished: 6s516ms (6s512ms) - First Batch Produced: 6s673ms (156.831ms) - First Batch Sent: 7s598ms (925.123ms) - ExecInternal Finished: 31s099ms (23s500ms) MemoryUsage(500.000ms): 855.38 KB, 321.50 MB, 388.79 MB, 419.35 MB, 481.33 MB, 477.47 MB, 601.57 MB, 606.79 MB, 607.74 MB, 613.09 MB, 608.89 MB, 865.50 MB, 863.79 MB, 590.83 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB, 667.39 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.66 MB (907714434) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3621254943) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s170ms - TotalStorageWaitTime: 379.530ms - TotalThreadsInvoluntaryContextSwitches: 1.98K (1976) - TotalThreadsTotalWallClockTime: 43s051ms - TotalThreadsSysTime: 1s010ms - TotalThreadsUserTime: 11s825ms - TotalThreadsVoluntaryContextSwitches: 3.98K (3978) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 24s582ms - ExecTreeExecTime: 156.823ms - OpenTime: 6s512ms - ExecTreeOpenTime: 6s290ms - PrepareTime: 2.202ms - ExecTreePrepareTime: 354.786us DataStreamSender (dst_id=23):(Total: 4s925ms, non-child: 4s925ms, % non-child: 100.00%) - BytesSent: 140.81 MB (147654887) - NetworkThroughput(*): 35.20 MB/sec - OverallThroughput: 28.59 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 925.102ms - TransmitDataRPCTime: 3s999ms - UncompressedRowBatchSize: 153.13 MB (160567743) AGGREGATION_NODE (id=11):(Total: 6s447ms, non-child: 6s310ms, % non-child: 97.88%) ExecOption: Codegen Enabled - BuildTime: 6s149ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541373528) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 136.839ms, non-child: 136.839ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 1:1/253.10 MB 0:1/253.09 MB 6:2/348.94 MB 7:1/253.08 MB 4:1/253.07 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 142.39 MB, 206.39 MB, 254.39 MB, 293.08 MB, 419.80 MB, 515.00 MB, 579.00 MB, 622.34 MB, 712.90 MB, 824.10 MB, 880.10 MB, 923.44 MB - FooterProcessingTime: (Avg: 5.419ms ; Min: 318.694us ; Max: 23.549ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 934.77 MB (980181299) - BytesReadDataNodeCache: 0 - BytesReadLocal: 934.77 MB (980181299) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 934.77 MB (980181299) - CachedFileHandlesHitCount: 136 (136) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s278ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 354.66 MB (371885596) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.706ms - RowBatchQueuePutWaitTime: 6s201ms - RowsRead: 37.69M (37689367) - RowsReturned: 3.76M (3755189) - RowsReturnedRate: 27.44 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.21K (1209) - ScannerThreadsTotalWallClockTime: 11s956ms - MaterializeTupleTime(*): 1s843ms - ScannerThreadsSysTime: 277.957ms - ScannerThreadsUserTime: 5s094ms - ScannerThreadsVoluntaryContextSwitches: 3.45K (3454) - TotalRawHdfsReadTime(*): 731.942ms - TotalReadThroughput: 142.07 MB/sec Buffer pool: - AllocTime: 11.656ms - CumulativeAllocationBytes: 376.88 MB (395182080) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 218.979ms, non-child: 218.979ms, % non-child: 100.00%) - CodegenTime: 8.053ms - CompileTime: 54.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.801ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 24.949ms Instance 9b439fc1ee1addb7:82d4156900000039 (host=vb0214.foo:22000):(Total: 29s664ms, non-child: 18s191ms, % non-child: 61.32%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB Fragment Instance Lifecycle Event Timeline: 29s675ms - Prepare Finished: 15.046ms (15.046ms) - Open Finished: 6s562ms (6s547ms) - First Batch Produced: 6s729ms (166.679ms) - First Batch Sent: 7s690ms (960.687ms) - ExecInternal Finished: 29s675ms (21s985ms) MemoryUsage(500.000ms): 280.21 MB, 383.68 MB, 414.28 MB, 472.94 MB, 474.82 MB, 610.21 MB, 609.98 MB, 606.76 MB, 606.26 MB, 606.14 MB, 863.82 MB, 850.03 MB, 781.92 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB, 674.19 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 865.12 MB (907146871) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.54 GB (3800541826) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s977ms - TotalStorageWaitTime: 265.533ms - TotalThreadsInvoluntaryContextSwitches: 1.90K (1902) - TotalThreadsTotalWallClockTime: 41s295ms - TotalThreadsSysTime: 1s081ms - TotalThreadsUserTime: 12s096ms - TotalThreadsVoluntaryContextSwitches: 4.56K (4562) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 23s112ms - ExecTreeExecTime: 166.674ms - OpenTime: 6s547ms - ExecTreeOpenTime: 6s320ms - PrepareTime: 4.055ms - ExecTreePrepareTime: 303.753us DataStreamSender (dst_id=23):(Total: 4s761ms, non-child: 4s761ms, % non-child: 100.00%) - BytesSent: 147.07 MB (154210704) - NetworkThroughput(*): 38.72 MB/sec - OverallThroughput: 30.89 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 960.674ms - TransmitDataRPCTime: 3s798ms - UncompressedRowBatchSize: 159.93 MB (167698809) AGGREGATION_NODE (id=11):(Total: 6s486ms, non-child: 6s403ms, % non-child: 98.71%) ExecOption: Codegen Enabled - BuildTime: 6s230ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541416306) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 83.599ms, non-child: 83.599ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/253.07 MB 8:1/253.09 MB 0:1/253.09 MB 3:1/253.10 MB 5:1/253.08 MB 7:2/394.54 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 126.40 MB, 206.40 MB, 262.40 MB, 293.09 MB, 459.48 MB, 515.48 MB, 579.48 MB, 704.55 MB, 760.55 MB, 824.55 MB, 872.55 MB, 936.73 MB, 961.16 MB - FooterProcessingTime: (Avg: 1.633ms ; Min: 221.057us ; Max: 6.244ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.77 - BytesRead: 961.16 MB (1007851294) - BytesReadDataNodeCache: 0 - BytesReadLocal: 961.16 MB (1007851294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 961.16 MB (1007851294) - CachedFileHandlesHitCount: 139 (139) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s440ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.90 MB (370045594) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 55.485ms - RowBatchQueuePutWaitTime: 5s768ms - RowsRead: 38.76M (38758503) - RowsReturned: 3.92M (3921890) - RowsReturnedRate: 46.91 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 1.12K (1125) - ScannerThreadsTotalWallClockTime: 11s635ms - MaterializeTupleTime(*): 1s902ms - ScannerThreadsSysTime: 379.941ms - ScannerThreadsUserTime: 5s203ms - ScannerThreadsVoluntaryContextSwitches: 3.70K (3699) - TotalRawHdfsReadTime(*): 713.999ms - TotalReadThroughput: 147.87 MB/sec Buffer pool: - AllocTime: 6.677ms - CumulativeAllocationBytes: 387.88 MB (406716416) - CumulativeAllocations: 61 (61) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 224.883ms, non-child: 224.883ms, % non-child: 100.00%) - CodegenTime: 7.624ms - CompileTime: 54.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.050ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.349ms Instance 9b439fc1ee1addb7:82d4156900000033 (host=vb0218.foo:22000):(Total: 29s662ms, non-child: 18s401ms, % non-child: 62.04%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 29s667ms - Prepare Finished: 9.111ms (9.111ms) - Open Finished: 5s827ms (5s818ms) - First Batch Produced: 5s978ms (151.115ms) - First Batch Sent: 6s867ms (888.233ms) - ExecInternal Finished: 29s667ms (22s800ms) MemoryUsage(500.000ms): 15.88 KB, 255.45 MB, 387.28 MB, 421.13 MB, 472.10 MB, 480.74 MB, 608.93 MB, 608.84 MB, 599.15 MB, 602.34 MB, 602.80 MB, 858.19 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB, 661.55 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 859.57 MB (901325940) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3783367163) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22s484ms - TotalStorageWaitTime: 317.259ms - TotalThreadsInvoluntaryContextSwitches: 1.74K (1744) - TotalThreadsTotalWallClockTime: 40s115ms - TotalThreadsSysTime: 936.855ms - TotalThreadsUserTime: 11s044ms - TotalThreadsVoluntaryContextSwitches: 4.17K (4165) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 23s839ms - ExecTreeExecTime: 151.107ms - OpenTime: 5s818ms - ExecTreeOpenTime: 5s472ms - PrepareTime: 4.094ms - ExecTreePrepareTime: 425.541us DataStreamSender (dst_id=23):(Total: 5s294ms, non-child: 5s294ms, % non-child: 100.00%) - BytesSent: 135.44 MB (142016558) - NetworkThroughput(*): 30.76 MB/sec - OverallThroughput: 25.58 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 888.211ms - TransmitDataRPCTime: 4s403ms - UncompressedRowBatchSize: 147.29 MB (154441584) AGGREGATION_NODE (id=11):(Total: 5s624ms, non-child: 5s509ms, % non-child: 97.97%) ExecOption: Codegen Enabled - BuildTime: 5s353ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541371679) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 114.445ms, non-child: 114.445ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:2/506.16 MB 8:1/253.09 MB 6:1/253.11 MB 3:1/253.07 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:81.82% 1:9.091% 2:9.091% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 110.40 MB, 206.40 MB, 270.40 MB, 326.28 MB, 459.48 MB, 523.48 MB, 582.83 MB, 712.56 MB, 768.56 MB, 848.56 MB, 879.24 MB - FooterProcessingTime: (Avg: 4.837ms ; Min: 198.452us ; Max: 20.811ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921948124) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921948124) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921948124) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s235ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 355.44 MB (372703041) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 89.514ms - RowBatchQueuePutWaitTime: 4s752ms - RowsRead: 35.46M (35459311) - RowsReturned: 3.61M (3611897) - RowsReturnedRate: 31.56 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.03K (1030) - ScannerThreadsTotalWallClockTime: 10s457ms - MaterializeTupleTime(*): 1s897ms - ScannerThreadsSysTime: 271.957ms - ScannerThreadsUserTime: 5s012ms - ScannerThreadsVoluntaryContextSwitches: 3.23K (3234) - TotalRawHdfsReadTime(*): 659.478ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 5.311ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 342.468ms, non-child: 342.468ms, % non-child: 100.00%) - CodegenTime: 10.894ms - CompileTime: 87.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 216.636ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 37.781ms Instance 9b439fc1ee1addb7:82d4156900000036 (host=vb0220.foo:22000):(Total: 29s356ms, non-child: 18s165ms, % non-child: 61.88%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 29s357ms - Prepare Finished: 4.424ms (4.424ms) - Open Finished: 6s170ms (6s165ms) - First Batch Produced: 6s308ms (137.881ms) - First Batch Sent: 7s201ms (893.602ms) - ExecInternal Finished: 29s357ms (22s155ms) MemoryUsage(500.000ms): 269.05 MB, 413.34 MB, 412.73 MB, 479.11 MB, 475.14 MB, 598.84 MB, 598.67 MB, 596.14 MB, 605.26 MB, 604.74 MB, 734.52 MB, 857.86 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB, 660.10 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.40 - BloomFilterBytes: 0 - PeakMemoryUsage: 862.55 MB (904445284) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.37 GB (3617652252) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s881ms - TotalStorageWaitTime: 149.822ms - TotalThreadsInvoluntaryContextSwitches: 1.78K (1783) - TotalThreadsTotalWallClockTime: 40s715ms - TotalThreadsSysTime: 945.855ms - TotalThreadsUserTime: 11s175ms - TotalThreadsVoluntaryContextSwitches: 3.86K (3860) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 23s187ms - ExecTreeExecTime: 137.876ms - OpenTime: 6s165ms - ExecTreeOpenTime: 5s938ms - PrepareTime: 2.954ms - ExecTreePrepareTime: 399.572us DataStreamSender (dst_id=23):(Total: 4s889ms, non-child: 4s889ms, % non-child: 100.00%) - BytesSent: 134.10 MB (140618895) - NetworkThroughput(*): 33.57 MB/sec - OverallThroughput: 27.43 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 893.578ms - TransmitDataRPCTime: 3s994ms - UncompressedRowBatchSize: 145.84 MB (152920393) AGGREGATION_NODE (id=11):(Total: 6s076ms, non-child: 6s002ms, % non-child: 98.77%) ExecOption: Codegen Enabled - BuildTime: 5s859ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.32 MB (541404551) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 74.498ms, non-child: 74.498ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.07 MB 3:2/506.15 MB 9:1/253.09 MB 4:1/253.08 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 126.39 MB, 222.39 MB, 286.39 MB, 419.46 MB, 467.46 MB, 515.46 MB, 579.46 MB, 696.53 MB, 752.53 MB, 808.53 MB, 864.53 MB, 879.21 MB - FooterProcessingTime: (Avg: 280.275us ; Min: 186.750us ; Max: 344.014us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.92 - BytesRead: 879.21 MB (921923583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.21 MB (921923583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.21 MB (921923583) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s087ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 349.07 MB (366031034) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 51.217ms - RowBatchQueuePutWaitTime: 6s202ms - RowsRead: 35.46M (35457025) - RowsReturned: 3.58M (3576349) - RowsReturnedRate: 48.01 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.06K (1058) - ScannerThreadsTotalWallClockTime: 11s362ms - MaterializeTupleTime(*): 1s694ms - ScannerThreadsSysTime: 330.949ms - ScannerThreadsUserTime: 4s659ms - ScannerThreadsVoluntaryContextSwitches: 3.40K (3403) - TotalRawHdfsReadTime(*): 622.027ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 4.669ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 224.883ms, non-child: 224.883ms, % non-child: 100.00%) - CodegenTime: 8.038ms - CompileTime: 55.602ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 139.526ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 29.184ms Instance 9b439fc1ee1addb7:82d4156900000032 (host=vb0216.foo:22000):(Total: 29s072ms, non-child: 18s251ms, % non-child: 62.78%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB Fragment Instance Lifecycle Event Timeline: 29s081ms - Prepare Finished: 13.445ms (13.445ms) - Open Finished: 5s978ms (5s965ms) - First Batch Produced: 6s125ms (146.472ms) - First Batch Sent: 7s011ms (886.369ms) - ExecInternal Finished: 29s081ms (22s070ms) MemoryUsage(500.000ms): 15.88 KB, 300.18 MB, 397.68 MB, 415.60 MB, 473.53 MB, 477.73 MB, 595.07 MB, 599.77 MB, 599.85 MB, 600.16 MB, 606.72 MB, 863.21 MB, 587.79 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB, 661.31 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 0 - PeakMemoryUsage: 863.85 MB (905814815) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3784557319) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s775ms - TotalStorageWaitTime: 401.544ms - TotalThreadsInvoluntaryContextSwitches: 1.67K (1668) - TotalThreadsTotalWallClockTime: 39s063ms - TotalThreadsSysTime: 1s019ms - TotalThreadsUserTime: 11s041ms - TotalThreadsVoluntaryContextSwitches: 3.62K (3618) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 23s103ms - ExecTreeExecTime: 146.463ms - OpenTime: 5s965ms - ExecTreeOpenTime: 5s736ms - PrepareTime: 3.776ms - ExecTreePrepareTime: 1.106ms DataStreamSender (dst_id=23):(Total: 4s710ms, non-child: 4s710ms, % non-child: 100.00%) - BytesSent: 135.22 MB (141785011) - NetworkThroughput(*): 35.37 MB/sec - OverallThroughput: 28.71 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 886.326ms - TransmitDataRPCTime: 3s822ms - UncompressedRowBatchSize: 147.05 MB (154191767) AGGREGATION_NODE (id=11):(Total: 5s884ms, non-child: 5s745ms, % non-child: 97.64%) ExecOption: Codegen Enabled - BuildTime: 5s594ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541408161) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 139.094ms, non-child: 139.094ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/253.09 MB 6:1/253.08 MB 7:2/367.32 MB 3:1/253.13 MB 5:1/253.09 MB 2:1/123.69 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 7 out of 7 Hdfs Read Thread Concurrency Bucket: 0:72.73% 1:27.27% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:7 BytesRead(500.000ms): 0, 117.36 MB, 177.47 MB, 288.57 MB, 371.23 MB, 430.57 MB, 549.29 MB, 613.29 MB, 677.29 MB, 724.00 MB, 811.20 MB, 867.20 MB - FooterProcessingTime: (Avg: 5.922ms ; Min: 203.152us ; Max: 13.081ms ; Number of samples: 7) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 870.55 MB (912842440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 870.55 MB (912842440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 870.55 MB (912842440) - CachedFileHandlesHitCount: 128 (128) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s190ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 6 (6) - NumRowGroups: 7 (7) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.08 MB (367087147) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 111.999ms - RowBatchQueuePutWaitTime: 4s382ms - RowsRead: 35.10M (35096614) - RowsReturned: 3.61M (3606066) - RowsReturnedRate: 25.93 M/sec - ScanRangesComplete: 7 (7) - ScannerThreadsInvoluntaryContextSwitches: 972 (972) - ScannerThreadsTotalWallClockTime: 9s995ms - MaterializeTupleTime(*): 1s763ms - ScannerThreadsSysTime: 352.946ms - ScannerThreadsUserTime: 4s837ms - ScannerThreadsVoluntaryContextSwitches: 3.09K (3094) - TotalRawHdfsReadTime(*): 668.370ms - TotalReadThroughput: 144.53 MB/sec Buffer pool: - AllocTime: 6.257ms - CumulativeAllocationBytes: 367.38 MB (385220608) - CumulativeAllocations: 59 (59) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 225.723ms, non-child: 225.723ms, % non-child: 100.00%) - CodegenTime: 7.782ms - CompileTime: 55.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.356ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 29.105ms Instance 9b439fc1ee1addb7:82d4156900000037 (host=vb0206.foo:22000):(Total: 28s208ms, non-child: 17s415ms, % non-child: 61.74%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 28s216ms - Prepare Finished: 14.588ms (14.588ms) - Open Finished: 5s705ms (5s691ms) - First Batch Produced: 5s849ms (143.397ms) - First Batch Sent: 6s748ms (899.056ms) - ExecInternal Finished: 28s216ms (21s468ms) MemoryUsage(500.000ms): 216.74 MB, 377.97 MB, 409.91 MB, 474.20 MB, 479.86 MB, 610.27 MB, 607.19 MB, 592.20 MB, 599.58 MB, 599.58 MB, 856.03 MB, 588.62 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB, 662.97 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.39 - BloomFilterBytes: 0 - PeakMemoryUsage: 856.60 MB (898213458) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.51 GB (3767381641) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21s464ms - TotalStorageWaitTime: 283.066ms - TotalThreadsInvoluntaryContextSwitches: 1.71K (1705) - TotalThreadsTotalWallClockTime: 38s788ms - TotalThreadsSysTime: 909.861ms - TotalThreadsUserTime: 10s667ms - TotalThreadsVoluntaryContextSwitches: 3.78K (3781) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 22s510ms - ExecTreeExecTime: 143.393ms - OpenTime: 5s691ms - ExecTreeOpenTime: 5s464ms - PrepareTime: 6.926ms - ExecTreePrepareTime: 999.346us DataStreamSender (dst_id=23):(Total: 4s960ms, non-child: 4s960ms, % non-child: 100.00%) - BytesSent: 136.76 MB (143400539) - NetworkThroughput(*): 33.69 MB/sec - OverallThroughput: 27.57 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 899.037ms - TransmitDataRPCTime: 4s058ms - UncompressedRowBatchSize: 148.71 MB (155931717) AGGREGATION_NODE (id=11):(Total: 5s608ms, non-child: 5s531ms, % non-child: 98.63%) ExecOption: Codegen Enabled - BuildTime: 5s383ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.33 MB (541414149) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 76.657ms, non-child: 76.657ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.08 MB 10:2/506.16 MB 8:1/253.08 MB 2:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:9.091% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 24.70 MB, 190.40 MB, 254.40 MB, 293.08 MB, 443.48 MB, 507.48 MB, 574.82 MB, 704.56 MB, 752.56 MB, 824.56 MB, 875.91 MB - FooterProcessingTime: (Avg: 3.640ms ; Min: 68.522us ; Max: 10.306ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921947767) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921947767) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921947767) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s021ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 352.10 MB (369205265) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 47.832ms - RowBatchQueuePutWaitTime: 5s380ms - RowsRead: 35.46M (35458085) - RowsReturned: 3.65M (3646907) - RowsReturnedRate: 47.57 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.01K (1010) - ScannerThreadsTotalWallClockTime: 10s587ms - MaterializeTupleTime(*): 1s680ms - ScannerThreadsSysTime: 259.959ms - ScannerThreadsUserTime: 4s652ms - ScannerThreadsVoluntaryContextSwitches: 3.47K (3468) - TotalRawHdfsReadTime(*): 700.988ms - TotalReadThroughput: 159.26 MB/sec Buffer pool: - AllocTime: 5.772ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 224.220ms, non-child: 224.220ms, % non-child: 100.00%) - CodegenTime: 7.378ms - CompileTime: 55.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 137.950ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 30.094ms Instance 9b439fc1ee1addb7:82d415690000003e (host=vb0234.foo:22000):(Total: 27s777ms, non-child: 17s233ms, % non-child: 62.04%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB Fragment Instance Lifecycle Event Timeline: 27s782ms - Prepare Finished: 8.677ms (8.677ms) - Open Finished: 5s918ms (5s910ms) - First Batch Produced: 6s061ms (142.534ms) - First Batch Sent: 6s904ms (843.554ms) - ExecInternal Finished: 27s782ms (20s877ms) MemoryUsage(500.000ms): 250.42 MB, 380.00 MB, 411.85 MB, 475.72 MB, 470.48 MB, 471.66 MB, 599.85 MB, 599.77 MB, 600.64 MB, 603.33 MB, 599.64 MB, 742.98 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB, 653.13 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 857.38 MB (899023570) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.24 GB (3474569233) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s876ms - TotalStorageWaitTime: 358.697ms - TotalThreadsInvoluntaryContextSwitches: 1.73K (1734) - TotalThreadsTotalWallClockTime: 38s118ms - TotalThreadsSysTime: 926.859ms - TotalThreadsUserTime: 10s662ms - TotalThreadsVoluntaryContextSwitches: 3.26K (3259) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s863ms - ExecTreeExecTime: 142.525ms - OpenTime: 5s910ms - ExecTreeOpenTime: 5s685ms - PrepareTime: 4.458ms - ExecTreePrepareTime: 425.257us DataStreamSender (dst_id=23):(Total: 4s494ms, non-child: 4s494ms, % non-child: 100.00%) - BytesSent: 127.69 MB (133894293) - NetworkThroughput(*): 35.00 MB/sec - OverallThroughput: 28.41 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 843.534ms - TransmitDataRPCTime: 3s648ms - UncompressedRowBatchSize: 138.86 MB (145608801) AGGREGATION_NODE (id=11):(Total: 5s828ms, non-child: 5s697ms, % non-child: 97.76%) ExecOption: Codegen Enabled - BuildTime: 5s550ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541366165) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 130.837ms, non-child: 130.837ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/144.90 MB 6:1/253.09 MB 2:1/253.08 MB 10:1/253.09 MB 3:2/506.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:8.333% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 94.39 MB, 190.39 MB, 246.39 MB, 289.74 MB, 411.48 MB, 483.48 MB, 531.48 MB, 574.81 MB, 707.29 MB, 757.29 MB, 805.29 MB, 816.62 MB - FooterProcessingTime: (Avg: 864.660us ; Min: 305.471us ; Max: 3.044ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.75 - BytesRead: 816.62 MB (856291544) - BytesReadDataNodeCache: 0 - BytesReadLocal: 816.62 MB (856291544) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 816.62 MB (856291544) - CachedFileHandlesHitCount: 118 (118) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s960ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 346.11 MB (362918278) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 105.817ms - RowBatchQueuePutWaitTime: 5s169ms - RowsRead: 32.93M (32928322) - RowsReturned: 3.41M (3405300) - RowsReturnedRate: 26.03 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.03K (1026) - ScannerThreadsTotalWallClockTime: 10s344ms - MaterializeTupleTime(*): 1s634ms - ScannerThreadsSysTime: 278.957ms - ScannerThreadsUserTime: 4s533ms - ScannerThreadsVoluntaryContextSwitches: 2.92K (2917) - TotalRawHdfsReadTime(*): 584.404ms - TotalReadThroughput: 136.10 MB/sec Buffer pool: - AllocTime: 8.605ms - CumulativeAllocationBytes: 331.25 MB (347340800) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 222.310ms, non-child: 222.310ms, % non-child: 100.00%) - CodegenTime: 7.593ms - CompileTime: 55.386ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 138.829ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 27.520ms Instance 9b439fc1ee1addb7:82d415690000003a (host=vb0224.foo:22000):(Total: 27s472ms, non-child: 17s502ms, % non-child: 63.71%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 27s493ms - Prepare Finished: 24.458ms (24.458ms) - Open Finished: 5s544ms (5s520ms) - First Batch Produced: 5s692ms (148.409ms) - First Batch Sent: 6s577ms (884.119ms) - ExecInternal Finished: 27s493ms (20s916ms) MemoryUsage(500.000ms): 855.38 KB, 365.86 MB, 414.59 MB, 477.84 MB, 483.20 MB, 608.55 MB, 609.57 MB, 596.34 MB, 604.10 MB, 603.63 MB, 860.03 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB, 657.52 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.36 - BloomFilterBytes: 0 - PeakMemoryUsage: 861.00 MB (902827066) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.52 GB (3782209420) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s916ms - TotalStorageWaitTime: 223.098ms - TotalThreadsInvoluntaryContextSwitches: 1.62K (1624) - TotalThreadsTotalWallClockTime: 37s343ms - TotalThreadsSysTime: 918.858ms - TotalThreadsUserTime: 10s669ms - TotalThreadsVoluntaryContextSwitches: 4.07K (4067) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s949ms - ExecTreeExecTime: 148.401ms - OpenTime: 5s520ms - ExecTreeOpenTime: 5s157ms - PrepareTime: 2.002ms - ExecTreePrepareTime: 257.760us DataStreamSender (dst_id=23):(Total: 4s304ms, non-child: 4s304ms, % non-child: 100.00%) - BytesSent: 131.73 MB (138126168) - NetworkThroughput(*): 38.52 MB/sec - OverallThroughput: 30.60 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 884.098ms - TransmitDataRPCTime: 3s419ms - UncompressedRowBatchSize: 143.26 MB (150214034) AGGREGATION_NODE (id=11):(Total: 5s306ms, non-child: 5s230ms, % non-child: 98.58%) ExecOption: Codegen Enabled - BuildTime: 5s077ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541368745) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 75.463ms, non-child: 75.463ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/253.07 MB 3:1/253.08 MB 4:1/253.11 MB 6:2/506.16 MB 7:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:80% 1:20% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 166.39 MB, 230.39 MB, 289.73 MB, 435.47 MB, 507.47 MB, 582.82 MB, 712.56 MB, 776.56 MB, 856.56 MB, 879.24 MB - FooterProcessingTime: (Avg: 982.809us ; Min: 220.190us ; Max: 3.905ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 879.24 MB (921949692) - BytesReadDataNodeCache: 0 - BytesReadLocal: 879.24 MB (921949692) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 879.24 MB (921949692) - CachedFileHandlesHitCount: 126 (126) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 3s232ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 353.25 MB (370406878) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 49.948ms - RowBatchQueuePutWaitTime: 4s416ms - RowsRead: 35.46M (35458554) - RowsReturned: 3.51M (3513064) - RowsReturnedRate: 46.55 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 954 (954) - ScannerThreadsTotalWallClockTime: 9s874ms - MaterializeTupleTime(*): 1s758ms - ScannerThreadsSysTime: 279.956ms - ScannerThreadsUserTime: 4s926ms - ScannerThreadsVoluntaryContextSwitches: 3.35K (3350) - TotalRawHdfsReadTime(*): 685.987ms - TotalReadThroughput: 159.86 MB/sec Buffer pool: - AllocTime: 4.940ms - CumulativeAllocationBytes: 339.75 MB (356253696) - CumulativeAllocations: 54 (54) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 358.618ms, non-child: 358.618ms, % non-child: 100.00%) - CodegenTime: 10.995ms - CompileTime: 58.637ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 260.528ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 38.702ms Instance 9b439fc1ee1addb7:82d4156900000035 (host=vb0222.foo:22000):(Total: 26s986ms, non-child: 17s053ms, % non-child: 63.19%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB Fragment Instance Lifecycle Event Timeline: 26s991ms - Prepare Finished: 6.245ms (6.245ms) - Open Finished: 5s508ms (5s502ms) - First Batch Produced: 5s640ms (131.775ms) - First Batch Sent: 6s441ms (801.199ms) - ExecInternal Finished: 26s991ms (20s549ms) MemoryUsage(500.000ms): 221.58 MB, 377.40 MB, 408.86 MB, 473.06 MB, 471.33 MB, 467.76 MB, 599.26 MB, 599.20 MB, 600.91 MB, 598.98 MB, 687.93 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB, 646.49 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 815.93 MB (855568224) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 3.10 GB (3327786148) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s549ms - TotalStorageWaitTime: 180.426ms - TotalThreadsInvoluntaryContextSwitches: 1.59K (1595) - TotalThreadsTotalWallClockTime: 36s337ms - TotalThreadsSysTime: 899.862ms - TotalThreadsUserTime: 10s149ms - TotalThreadsVoluntaryContextSwitches: 3.15K (3154) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s482ms - ExecTreeExecTime: 131.768ms - OpenTime: 5s502ms - ExecTreeOpenTime: 5s281ms - PrepareTime: 1.526ms - ExecTreePrepareTime: 205.939us DataStreamSender (dst_id=23):(Total: 4s301ms, non-child: 4s301ms, % non-child: 100.00%) - BytesSent: 121.59 MB (127497322) - NetworkThroughput(*): 34.75 MB/sec - OverallThroughput: 28.27 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 801.175ms - TransmitDataRPCTime: 3s499ms - UncompressedRowBatchSize: 132.23 MB (138652919) AGGREGATION_NODE (id=11):(Total: 5s413ms, non-child: 5s345ms, % non-child: 98.74%) ExecOption: Codegen Enabled - BuildTime: 5s208ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 516.29 MB (541368569) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 67.974ms, non-child: 67.974ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/253.10 MB 5:1/253.07 MB 4:1/93.74 MB 9:1/253.08 MB 0:2/506.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:90.91% 1:0% 2:9.091% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 65.16 MB, 182.40 MB, 246.40 MB, 289.73 MB, 410.56 MB, 505.76 MB, 553.76 MB, 613.10 MB, 700.29 MB, 751.64 MB, 786.96 MB - FooterProcessingTime: (Avg: 240.655us ; Min: 56.620us ; Max: 296.214us ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 1.73 - BytesRead: 786.96 MB (825192372) - BytesReadDataNodeCache: 0 - BytesReadLocal: 786.96 MB (825192372) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 786.96 MB (825192372) - CachedFileHandlesHitCount: 115 (115) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s917ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 346.20 MB (363014233) - PerReadThreadRawHdfsThroughput: 1.25 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 46.775ms - RowBatchQueuePutWaitTime: 4s451ms - RowsRead: 31.73M (31733865) - RowsReturned: 3.24M (3242551) - RowsReturnedRate: 47.70 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 929 (929) - ScannerThreadsTotalWallClockTime: 9s352ms - MaterializeTupleTime(*): 1s580ms - ScannerThreadsSysTime: 288.955ms - ScannerThreadsUserTime: 4s392ms - ScannerThreadsVoluntaryContextSwitches: 2.84K (2839) - TotalRawHdfsReadTime(*): 613.304ms - TotalReadThroughput: 143.08 MB/sec Buffer pool: - AllocTime: 8.544ms - CumulativeAllocationBytes: 319.75 MB (335282176) - CumulativeAllocations: 52 (52) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 218.283ms, non-child: 218.283ms, % non-child: 100.00%) - CodegenTime: 8.060ms - CompileTime: 54.879ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 140.445ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 22.312ms Instance 9b439fc1ee1addb7:82d415690000003d (host=vb0232.foo:22000):(Total: 26s978ms, non-child: 20s119ms, % non-child: 74.57%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB Fragment Instance Lifecycle Event Timeline: 26s984ms - Prepare Finished: 13.918ms (13.918ms) - Open Finished: 5s171ms (5s157ms) - First Batch Produced: 5s285ms (113.236ms) - First Batch Sent: 6s036ms (750.987ms) - ExecInternal Finished: 26s984ms (20s948ms) MemoryUsage(500.000ms): 855.38 KB, 366.76 MB, 415.89 MB, 416.79 MB, 476.36 MB, 472.46 MB, 601.63 MB, 601.00 MB, 601.40 MB, 602.68 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB, 381.58 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 603.90 MB (633231362) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.51 GB (2695227883) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20s682ms - TotalStorageWaitTime: 229.342ms - TotalThreadsInvoluntaryContextSwitches: 1.67K (1671) - TotalThreadsTotalWallClockTime: 36s227ms - TotalThreadsSysTime: 784.880ms - TotalThreadsUserTime: 9s593ms - TotalThreadsVoluntaryContextSwitches: 3.25K (3247) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 21s812ms - ExecTreeExecTime: 113.230ms - OpenTime: 5s157ms - ExecTreeOpenTime: 4s809ms - PrepareTime: 7.711ms - ExecTreePrepareTime: 1.133ms DataStreamSender (dst_id=23):(Total: 1s590ms, non-child: 1s590ms, % non-child: 100.00%) - BytesSent: 113.39 MB (118893253) - NetworkThroughput(*): 135.56 MB/sec - OverallThroughput: 71.27 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 750.961ms - TransmitDataRPCTime: 836.399ms - UncompressedRowBatchSize: 123.31 MB (129304747) AGGREGATION_NODE (id=11):(Total: 4s924ms, non-child: 4s854ms, % non-child: 98.58%) ExecOption: Codegen Enabled - BuildTime: 4s736ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.33 MB (272980984) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 69.922ms, non-child: 69.922ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.06 MB 0:2/258.90 MB 7:1/253.09 MB 9:1/253.08 MB 1:1/253.09 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 6 out of 6 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:6 BytesRead(500.000ms): 0, 151.27 MB, 178.43 MB, 297.63 MB, 388.16 MB, 444.16 MB, 471.49 MB, 582.69 MB, 618.04 MB, 722.01 MB - FooterProcessingTime: (Avg: 748.028us ; Min: 308.811us ; Max: 2.487ms ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 736.09 MB (771844345) - BytesReadDataNodeCache: 0 - BytesReadLocal: 736.09 MB (771844345) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 736.09 MB (771844345) - CachedFileHandlesHitCount: 108 (108) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s730ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 5 (5) - NumRowGroups: 6 (6) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 350.45 MB (367474853) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 48.316ms - RowBatchQueuePutWaitTime: 4s584ms - RowsRead: 29.68M (29676122) - RowsReturned: 3.02M (3023972) - RowsReturnedRate: 43.25 M/sec - ScanRangesComplete: 6 (6) - ScannerThreadsInvoluntaryContextSwitches: 1.03K (1028) - ScannerThreadsTotalWallClockTime: 9s256ms - MaterializeTupleTime(*): 1s492ms - ScannerThreadsSysTime: 259.959ms - ScannerThreadsUserTime: 4s167ms - ScannerThreadsVoluntaryContextSwitches: 2.84K (2838) - TotalRawHdfsReadTime(*): 607.233ms - TotalReadThroughput: 144.40 MB/sec Buffer pool: - AllocTime: 10.559ms - CumulativeAllocationBytes: 314.75 MB (330039296) - CumulativeAllocations: 50 (50) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 104.50 MB (109576192) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 344.484ms, non-child: 344.484ms, % non-child: 100.00%) - CodegenTime: 11.083ms - CompileTime: 85.742ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 219.077ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 38.928ms Instance 9b439fc1ee1addb7:82d415690000003c (host=vb0212.foo:22000):(Total: 6s560ms, non-child: 287.186ms, % non-child: 4.38%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB Fragment Instance Lifecycle Event Timeline: 6s562ms - Prepare Finished: 2.863ms (2.863ms) - Open Finished: 4s961ms (4s958ms) - First Batch Produced: 5s081ms (119.827ms) - First Batch Sent: 5s806ms (724.879ms) - ExecInternal Finished: 6s562ms (756.595ms) MemoryUsage(500.000ms): 855.38 KB, 351.68 MB, 420.35 MB, 478.74 MB, 467.37 MB, 473.25 MB, 601.70 MB, 601.19 MB, 597.95 MB, 598.34 MB, 379.29 MB, 379.29 MB, 379.29 MB ThreadUsage(500.000ms): 1, 3, 3, 3, 3, 3, 3, 3, 2, 2, 1, 1, 1 - AverageThreadTokens: 2.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 602.66 MB (631932812) - PeakReservation: 216.00 MB (226492416) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 2.37 GB (2543089953) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 755.767ms - TotalStorageWaitTime: 255.230ms - TotalThreadsInvoluntaryContextSwitches: 1.40K (1399) - TotalThreadsTotalWallClockTime: 14s777ms - TotalThreadsSysTime: 689.894ms - TotalThreadsUserTime: 9s112ms - TotalThreadsVoluntaryContextSwitches: 3.34K (3339) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1s601ms - ExecTreeExecTime: 119.824ms - OpenTime: 4s958ms - ExecTreeOpenTime: 4s743ms - PrepareTime: 1.075ms - ExecTreePrepareTime: 234.993us DataStreamSender (dst_id=23):(Total: 1s197ms, non-child: 1s197ms, % non-child: 100.00%) - BytesSent: 111.28 MB (116689056) - NetworkThroughput(*): 235.55 MB/sec - OverallThroughput: 92.92 MB/sec - PeakMemoryUsage: 3.88 KB (3968) - RowsReturned: 1 (1) - SerializeBatchTime: 724.864ms - TransmitDataRPCTime: 472.434ms - UncompressedRowBatchSize: 121.02 MB (126901687) AGGREGATION_NODE (id=11):(Total: 4s863ms, non-child: 4s750ms, % non-child: 97.68%) ExecOption: Codegen Enabled - BuildTime: 4s626ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 260.33 MB (272978531) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 112.891ms, non-child: 112.891ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.09 MB 6:1/253.08 MB 5:2/506.17 MB 2:1/253.08 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 5 out of 5 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% File Formats: PARQUET/SNAPPY:5 BytesRead(500.000ms): 0, 166.40 MB, 238.40 MB, 289.74 MB, 419.47 MB, 475.47 MB, 539.47 MB, 582.82 MB, 681.35 MB, 732.71 MB - FooterProcessingTime: (Avg: 1.203ms ; Min: 361.544us ; Max: 3.999ms ; Number of samples: 5) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 732.71 MB (768298333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 732.71 MB (768298333) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 732.71 MB (768298333) - CachedFileHandlesHitCount: 105 (105) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DecompressionTime: 2s558ms - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 4 (4) - NumRowGroups: 5 (5) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 354.23 MB (371438326) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 93.701ms - RowBatchQueuePutWaitTime: 3s808ms - RowsRead: 29.55M (29548778) - RowsReturned: 2.97M (2967885) - RowsReturnedRate: 26.29 M/sec - ScanRangesComplete: 5 (5) - ScannerThreadsInvoluntaryContextSwitches: 807 (807) - ScannerThreadsTotalWallClockTime: 8s217ms - MaterializeTupleTime(*): 1s403ms - ScannerThreadsSysTime: 226.965ms - ScannerThreadsUserTime: 3s895ms - ScannerThreadsVoluntaryContextSwitches: 2.65K (2653) - TotalRawHdfsReadTime(*): 593.575ms - TotalReadThroughput: 146.54 MB/sec Buffer pool: - AllocTime: 7.561ms - CumulativeAllocationBytes: 283.12 MB (296878080) - CumulativeAllocations: 45 (45) - PeakReservation: 216.00 MB (226492416) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 113.00 MB (118489088) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 212.725ms, non-child: 212.725ms, % non-child: 100.00%) - CodegenTime: 7.093ms - CompileTime: 54.293ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039484) - NumFunctions: 108 (108) - NumInstructions: 1.68K (1679) - OptimizationTime: 137.752ms - PeakMemoryUsage: 839.50 KB (859648) - PrepareTime: 20.107ms