Query (id=e0424d84963f6618:f987655900000000): Summary: Session ID: 0d4a654265665fc4:c24f46793b0b8ba5 Session Type: BEESWAX Start Time: 2019-11-03 17:15:30.191396000 End Time: 2019-11-03 18:44:55.666229000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 3.4.0-SNAPSHOT RELEASE (build b28d56f5b42acef8f95890d647700ef9b8c7ea66) User: tarmstrong Connected User: tarmstrong Delegated User: Network Address: ::ffff:127.0.0.1:33958 Default Db: functional_parquet Sql Statement: SELECT COUNT(t2.month) AS int_col_1 FROM alltypesagg t1 CROSS JOIN alltypesagg t2 FULL OUTER JOIN alltypestiny t3 ON t3.year = t2.int_col AND t3.int_col = t2.year WHERE t1.day NOT IN (SELECT tt1.year AS int_col_1 FROM alltypes tt1 RIGHT JOIN alltypes tt2 ON tt2.month = tt1.year WHERE t3.tinyint_col = tt2.tinyint_col AND t3.bigint_col = tt2.bigint_col AND t3.int_col = tt1.id) AND t1.day NOT IN (SELECT ttt1.tinyint_col AS tinyint_col_1 FROM alltypestiny ttt1 WHERE t1.tinyint_col = ttt1.month AND ttt1.month IS NULL AND ttt1.tinyint_col NOT IN (SELECT tttt2.int_col AS int_col_1 FROM alltypesagg tttt1 RIGHT JOIN alltypes tttt2 ON tttt2.id = tttt1.year) AND ttt1.month NOT IN (SELECT MIN(tttt2.year + tttt1.smallint_col * tttt1.int_col - tttt2.bigint_col) + MAX(tttt2.tinyint_col) AS bigint_col_1 FROM alltypestiny tttt1 INNER JOIN alltypestiny tttt2 ON tttt2.month = tttt1.smallint_col) AND ttt1.month IS NOT NULL AND t2.smallint_col = ttt1.bigint_col) Coordinator: tarmstrong-box:22000 Query Options (set by configuration): TIMEZONE=SystemV/PST8PDT,CLIENT_IDENTIFIER=Impala Shell v3.4.0-SNAPSHOT (b28d56f) built on Sun Nov 3 17:10:24 PST 2019 Query Options (set by configuration and planner): MT_DOP=0,TIMEZONE=SystemV/PST8PDT,CLIENT_IDENTIFIER=Impala Shell v3.4.0-SNAPSHOT (b28d56f) built on Sun Nov 3 17:10:24 PST 2019 Plan: ---------------- Max Per-Host Resource Reservation: Memory=20.54MB Threads=25 Per-Host Resource Estimates: Memory=312MB WARNING: The following tables have potentially corrupt table statistics. Drop and re-compute statistics to resolve this problem. functional_parquet.alltypestiny WARNING: The following tables are missing relevant table and/or column statistics. functional_parquet.alltypes, functional_parquet.alltypesagg, functional_parquet.alltypestiny Analyzed query: SELECT count(t2.`month`) int_col_1 FROM functional_parquet.alltypesagg t1 CROSS JOIN functional_parquet.alltypesagg t2 FULL OUTER JOIN functional_parquet.alltypestiny t3 ON t3.`year` = t2.int_col AND t3.int_col = t2.`year` NULL AWARE LEFT ANTI JOIN (SELECT tt1.`year` int_col_1, tt2.tinyint_col, tt2.bigint_col, tt1.id FROM functional_parquet.alltypes tt1 RIGHT OUTER JOIN functional_parquet.alltypes tt2 ON tt2.`month` = tt1.`year`) `$a$1` (`$c$1`, `$c$2`, `$c$3`, `$c$4`) ON t3.tinyint_col = `$a$1`.`$c$2` AND t3.bigint_col = `$a$1`.`$c$3` AND t3.int_col = `$a$1`.`$c$4` AND t1.`day` = `$a$1`.`$c$1` NULL AWARE LEFT ANTI JOIN (SELECT ttt1.tinyint_col tinyint_col_1, ttt1.`month`, ttt1.bigint_col FROM functional_parquet.alltypestiny ttt1 NULL AWARE LEFT ANTI JOIN (SELECT tttt2.int_col int_col_1 FROM functional_parquet.alltypesagg tttt1 RIGHT OUTER JOIN functional_parquet.alltypes tttt2 ON tttt2.id = tttt1.`year`) `$a$2` (`$c$1`) ON CAST(ttt1.tinyint_col AS INT) = `$a$2`.`$c$1` NULL AWARE LEFT ANTI JOIN (SELECT min(CAST(tttt2.`year` AS BIGINT) + CAST(tttt1.smallint_col AS BIGINT) * CAST(tttt1.int_col AS BIGINT) - tttt2.bigint_col) + CAST(max(tttt2.tinyint_col) AS BIGINT) bigint_col_1 FROM functional_parquet.alltypestiny tttt1 INNER JOIN functional_parquet.alltypestiny tttt2 ON tttt2.`month` = CAST(tttt1.smallint_col AS INT)) `$a$3` (`$c$1`) ON CAST(ttt1.`month` AS BIGINT) = `$a$3`.`$c$1` WHERE TRUE AND ttt1.`month` IS NULL AND TRUE AND TRUE AND ttt1.`month` IS NOT NULL AND TRUE) `$a$2` (`$c$1`, `$c$2`, `$c$3`) ON CAST(t1.tinyint_col AS INT) = `$a$2`.`$c$2` AND CAST(t2.smallint_col AS BIGINT) = `$a$2`.`$c$3` AND t1.`day` = CAST(`$a$2`.`$c$1` AS INT) F15:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=10.02MB mem-reservation=0B thread-reservation=1 PLAN-ROOT SINK | output exprs: count(t2.`month`) | mem-estimate=0B mem-reservation=0B thread-reservation=0 | 37:AGGREGATE [FINALIZE] | output: count:merge(t2.`month`) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=15 row-size=8B cardinality=1 | in pipelines: 37(GETNEXT), 20(OPEN) | 36:EXCHANGE [UNPARTITIONED] | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | tuple-ids=15 row-size=8B cardinality=1 | in pipelines: 20(GETNEXT) | F03:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 Per-Host Resources: mem-estimate=26.27MB mem-reservation=6.19MB thread-reservation=1 20:AGGREGATE | output: count(t2.`month`) | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | tuple-ids=15 row-size=8B cardinality=1 | in pipelines: 20(GETNEXT), 01(OPEN) | 19:HASH JOIN [NULL AWARE LEFT ANTI JOIN, BROADCAST] | hash predicates: t1.`day` = ttt1.tinyint_col | other join predicates: CAST(t1.tinyint_col AS INT) = ttt1.`month`, CAST(t2.smallint_col AS BIGINT) = ttt1.bigint_col | mem-estimate=2.12MB mem-reservation=2.12MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=1N,0N,2N row-size=36B cardinality=807.81M | in pipelines: 01(GETNEXT), 06(OPEN) | |--35:EXCHANGE [BROADCAST] | | mem-estimate=17.00KB mem-reservation=0B thread-reservation=0 | | tuple-ids=6 row-size=13B cardinality=0 | | in pipelines: 06(GETNEXT) | | | F07:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 | Per-Host Resources: mem-estimate=4.65MB mem-reservation=4.25MB thread-reservation=1 | 15:HASH JOIN [NULL AWARE LEFT ANTI JOIN, BROADCAST] | | hash predicates: ttt1.`month` = min(tttt2.`year` + tttt1.smallint_col * tttt1.int_col - tttt2.bigint_col) + max(tttt2.tinyint_col) | | mem-estimate=2.12MB mem-reservation=2.12MB spill-buffer=64.00KB thread-reservation=0 | | tuple-ids=6 row-size=13B cardinality=0 | | in pipelines: 06(GETNEXT), 33(OPEN) | | | |--34:EXCHANGE [BROADCAST] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=12 row-size=9B cardinality=1 | | | in pipelines: 33(GETNEXT) | | | | | F14:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | | Per-Host Resources: mem-estimate=10.02MB mem-reservation=0B thread-reservation=1 | | 33:AGGREGATE [FINALIZE] | | | output: min:merge(tttt2.`year` + tttt1.smallint_col * tttt1.int_col - tttt2.bigint_col), max:merge(tttt2.tinyint_col) | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | | | tuple-ids=12 row-size=9B cardinality=1 | | | in pipelines: 33(GETNEXT), 13(OPEN) | | | | | 32:EXCHANGE [UNPARTITIONED] | | | mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=12 row-size=9B cardinality=1 | | | in pipelines: 13(GETNEXT) | | | | | F13:PLAN FRAGMENT [HASH(tttt2.`month`)] hosts=3 instances=3 | | Per-Host Resources: mem-estimate=12.99MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB | | 13:AGGREGATE | | | output: min(CAST(tttt2.`year` AS BIGINT) + CAST(tttt1.smallint_col AS BIGINT) * CAST(tttt1.int_col AS BIGINT) - tttt2.bigint_col), max(tttt2.tinyint_col) | | | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB thread-reservation=0 | | | tuple-ids=12 row-size=9B cardinality=1 | | | in pipelines: 13(GETNEXT), 11(OPEN) | | | | | 12:HASH JOIN [INNER JOIN, PARTITIONED] | | | hash predicates: tttt2.`month` = tttt1.smallint_col | | | fk/pk conjuncts: assumed fk/pk | | | runtime filters: RF002[bloom] <- tttt1.smallint_col | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | | | tuple-ids=11,10 row-size=23B cardinality=742 | | | in pipelines: 11(GETNEXT), 10(OPEN) | | | | | |--31:EXCHANGE [HASH(tttt1.smallint_col)] | | | | mem-estimate=23.19KB mem-reservation=0B thread-reservation=0 | | | | tuple-ids=10 row-size=6B cardinality=742 | | | | in pipelines: 10(GETNEXT) | | | | | | | F12:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | | | Per-Host Resources: mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=2 | | | 10:SCAN HDFS [functional_parquet.alltypestiny tttt1, RANDOM] | | | HDFS partitions=4/4 files=4 size=11.67KB | | | stored statistics: | | | table: rows=unavailable size=unavailable | | | partitions: 0/4 rows=unavailable | | | columns: unavailable | | | extrapolated-rows=disabled max-scan-range-rows=unavailable | | | mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 | | | tuple-ids=10 row-size=6B cardinality=742 | | | in pipelines: 10(GETNEXT) | | | | | 30:EXCHANGE [HASH(tttt2.`month`)] | | | mem-estimate=49.76KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=11 row-size=17B cardinality=742 | | | in pipelines: 11(GETNEXT) | | | | | F11:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | | Per-Host Resources: mem-estimate=33.00MB mem-reservation=1.02MB thread-reservation=2 runtime-filters-memory=1.00MB | | 11:SCAN HDFS [functional_parquet.alltypestiny tttt2, RANDOM] | | HDFS partitions=4/4 files=4 size=11.67KB | | runtime filters: RF002[bloom] -> tttt2.`month` | | stored statistics: | | table: rows=unavailable size=unavailable | | partitions: 0/4 rows=unavailable | | columns missing stats: bigint_col, tinyint_col | | extrapolated-rows=disabled max-scan-range-rows=unavailable | | mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 | | tuple-ids=11 row-size=17B cardinality=742 | | in pipelines: 11(GETNEXT) | | | 14:HASH JOIN [NULL AWARE LEFT ANTI JOIN, BROADCAST] | | hash predicates: ttt1.tinyint_col = tttt2.int_col | | mem-estimate=2.12MB mem-reservation=2.12MB spill-buffer=64.00KB thread-reservation=0 | | tuple-ids=6 row-size=13B cardinality=0 | | in pipelines: 06(GETNEXT), 07(OPEN) | | | |--29:EXCHANGE [BROADCAST] | | | mem-estimate=393.07KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=7N,8 row-size=12B cardinality=28.42K | | | in pipelines: 07(GETNEXT) | | | | | F10:PLAN FRAGMENT [HASH(tttt2.id)] hosts=3 instances=3 | | Per-Host Resources: mem-estimate=3.06MB mem-reservation=2.94MB thread-reservation=1 runtime-filters-memory=1.00MB | | 09:HASH JOIN [RIGHT OUTER JOIN, PARTITIONED] | | | hash predicates: tttt1.`year` = tttt2.id | | | fk/pk conjuncts: assumed fk/pk | | | runtime filters: RF000[bloom] <- tttt2.id | | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | | | tuple-ids=7N,8 row-size=12B cardinality=28.42K | | | in pipelines: 07(GETNEXT), 08(OPEN) | | | | | |--28:EXCHANGE [HASH(tttt2.id)] | | | | mem-estimate=69.43KB mem-reservation=0B thread-reservation=0 | | | | tuple-ids=8 row-size=8B cardinality=12.84K | | | | in pipelines: 08(GETNEXT) | | | | | | | F09:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | | | Per-Host Resources: mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=2 | | | 08:SCAN HDFS [functional_parquet.alltypes tttt2, RANDOM] | | | HDFS partitions=24/24 files=24 size=201.80KB | | | stored statistics: | | | table: rows=unavailable size=unavailable | | | partitions: 0/24 rows=unavailable | | | columns: unavailable | | | extrapolated-rows=disabled max-scan-range-rows=unavailable | | | mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 | | | tuple-ids=8 row-size=8B cardinality=12.84K | | | in pipelines: 08(GETNEXT) | | | | | 27:EXCHANGE [HASH(tttt1.`year`)] | | | mem-estimate=61.01KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=7 row-size=4B cardinality=28.42K | | | in pipelines: 07(GETNEXT) | | | | | F08:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | | Per-Host Resources: mem-estimate=2.00MB mem-reservation=1.06MB thread-reservation=2 runtime-filters-memory=1.00MB | | 07:SCAN HDFS [functional_parquet.alltypesagg tttt1, RANDOM] | | HDFS partitions=11/11 files=11 size=469.11KB | | runtime filters: RF000[bloom] -> tttt1.`year` | | stored statistics: | | table: rows=unavailable size=unavailable | | partitions: 0/11 rows=unavailable | | columns: all | | extrapolated-rows=disabled max-scan-range-rows=unavailable | | mem-estimate=1.00MB mem-reservation=64.00KB thread-reservation=1 | | tuple-ids=7 row-size=4B cardinality=28.42K | | in pipelines: 07(GETNEXT) | | | 06:SCAN HDFS [functional_parquet.alltypestiny ttt1, RANDOM] | partition predicates: ttt1.`month` IS NULL, ttt1.`month` IS NOT NULL | partitions=0/4 files=0 size=0B | stored statistics: | table: rows=unavailable size=unavailable | partitions: 0/0 rows=unavailable | columns missing stats: tinyint_col, bigint_col | extrapolated-rows=disabled max-scan-range-rows=0 | mem-estimate=0B mem-reservation=0B thread-reservation=0 | tuple-ids=6 row-size=13B cardinality=0 | in pipelines: 06(GETNEXT) | 18:HASH JOIN [NULL AWARE LEFT ANTI JOIN, BROADCAST] | hash predicates: t1.`day` = tt1.`year` | other join predicates: t3.bigint_col = tt2.bigint_col, t3.int_col = tt1.id, t3.tinyint_col = tt2.tinyint_col | mem-estimate=2.12MB mem-reservation=2.12MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=1N,0N,2N row-size=36B cardinality=807.81M | in pipelines: 01(GETNEXT), 04(OPEN) | |--26:EXCHANGE [BROADCAST] | | mem-estimate=350.28KB mem-reservation=0B thread-reservation=0 | | tuple-ids=4,3N row-size=21B cardinality=12.84K | | in pipelines: 04(GETNEXT) | | | F06:PLAN FRAGMENT [HASH(tt2.`month`)] hosts=3 instances=3 | Per-Host Resources: mem-estimate=2.11MB mem-reservation=1.94MB thread-reservation=1 | 05:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | | hash predicates: tt2.`month` = tt1.`year` | | fk/pk conjuncts: assumed fk/pk | | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | | tuple-ids=4,3N row-size=21B cardinality=12.84K | | in pipelines: 04(GETNEXT), 03(OPEN) | | | |--25:EXCHANGE [HASH(tt1.`year`)] | | | mem-estimate=69.43KB mem-reservation=0B thread-reservation=0 | | | tuple-ids=3 row-size=8B cardinality=12.84K | | | in pipelines: 03(GETNEXT) | | | | | F05:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | | Per-Host Resources: mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=2 | | 03:SCAN HDFS [functional_parquet.alltypes tt1, RANDOM] | | HDFS partitions=24/24 files=24 size=201.80KB | | stored statistics: | | table: rows=unavailable size=unavailable | | partitions: 0/24 rows=unavailable | | columns missing stats: id | | extrapolated-rows=disabled max-scan-range-rows=unavailable | | mem-estimate=16.00MB mem-reservation=16.00KB thread-reservation=1 | | tuple-ids=3 row-size=8B cardinality=12.84K | | in pipelines: 03(GETNEXT) | | | 24:EXCHANGE [HASH(tt2.`month`)] | | mem-estimate=105.33KB mem-reservation=0B thread-reservation=0 | | tuple-ids=4 row-size=13B cardinality=12.84K | | in pipelines: 04(GETNEXT) | | | F04:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | Per-Host Resources: mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=2 | 04:SCAN HDFS [functional_parquet.alltypes tt2, RANDOM] | HDFS partitions=24/24 files=24 size=201.80KB | stored statistics: | table: rows=unavailable size=unavailable | partitions: 0/24 rows=unavailable | columns missing stats: tinyint_col, bigint_col | extrapolated-rows=disabled max-scan-range-rows=unavailable | mem-estimate=32.00MB mem-reservation=16.00KB thread-reservation=1 | tuple-ids=4 row-size=13B cardinality=12.84K | in pipelines: 04(GETNEXT) | 17:HASH JOIN [FULL OUTER JOIN, PARTITIONED] | hash predicates: t2.`year` = t3.int_col, t2.int_col = t3.`year` | fk/pk conjuncts: assumed fk/pk | mem-estimate=1.94MB mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 | tuple-ids=1N,0N,2N row-size=36B cardinality=807.81M | in pipelines: 01(GETNEXT), 02(OPEN) | |--23:EXCHANGE [HASH(t3.int_col,t3.`year`)] | | mem-estimate=49.76KB mem-reservation=0B thread-reservation=0 | | tuple-ids=2 row-size=17B cardinality=742 | | in pipelines: 02(GETNEXT) | | | F02:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | Per-Host Resources: mem-estimate=48.00MB mem-reservation=24.00KB thread-reservation=2 | 02:SCAN HDFS [functional_parquet.alltypestiny t3, RANDOM] | HDFS partitions=4/4 files=4 size=11.67KB | stored statistics: | table: rows=unavailable size=unavailable | partitions: 0/4 rows=unavailable | columns missing stats: int_col, tinyint_col, bigint_col | extrapolated-rows=disabled max-scan-range-rows=unavailable | mem-estimate=48.00MB mem-reservation=24.00KB thread-reservation=1 | tuple-ids=2 row-size=17B cardinality=742 | in pipelines: 02(GETNEXT) | 22:EXCHANGE [HASH(t2.`year`,t2.int_col)] | mem-estimate=10.08MB mem-reservation=0B thread-reservation=0 | tuple-ids=1,0 row-size=19B cardinality=807.81M | in pipelines: 01(GETNEXT) | F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 Per-Host Resources: mem-estimate=32.30MB mem-reservation=64.00KB thread-reservation=2 16:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | mem-estimate=138.78KB mem-reservation=0B thread-reservation=0 | tuple-ids=1,0 row-size=19B cardinality=807.81M | in pipelines: 01(GETNEXT), 00(OPEN) | |--21:EXCHANGE [BROADCAST] | | mem-estimate=165.78KB mem-reservation=0B thread-reservation=0 | | tuple-ids=0 row-size=5B cardinality=28.42K | | in pipelines: 00(GETNEXT) | | | F01:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 | Per-Host Resources: mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=2 | 00:SCAN HDFS [functional_parquet.alltypesagg t1, RANDOM] | HDFS partitions=11/11 files=11 size=469.11KB | stored statistics: | table: rows=unavailable size=unavailable | partitions: 0/11 rows=unavailable | columns missing stats: tinyint_col | extrapolated-rows=disabled max-scan-range-rows=unavailable | mem-estimate=16.00MB mem-reservation=64.00KB thread-reservation=1 | tuple-ids=0 row-size=5B cardinality=28.42K | in pipelines: 00(GETNEXT) | 01:SCAN HDFS [functional_parquet.alltypesagg t2, RANDOM] HDFS partitions=11/11 files=11 size=469.11KB stored statistics: table: rows=unavailable size=unavailable partitions: 0/11 rows=unavailable columns missing stats: int_col, smallint_col extrapolated-rows=disabled max-scan-range-rows=unavailable mem-estimate=32.00MB mem-reservation=64.00KB thread-reservation=1 tuple-ids=1 row-size=14B cardinality=28.42K in pipelines: 01(GETNEXT) ---------------- Estimated Per-Host Mem: 327579221 Tables Missing Stats: functional_parquet.alltypes,functional_parquet.alltypesagg,functional_parquet.alltypestiny Tables With Corrupt Table Stats: functional_parquet.alltypestiny Request Pool: default-pool Per Host Min Memory Reservation: tarmstrong-box:22001(16.29 MB) tarmstrong-box:22002(16.29 MB) tarmstrong-box:22000(20.54 MB) Per Host Number of Fragment Instances: tarmstrong-box:22001(13) tarmstrong-box:22002(13) tarmstrong-box:22000(16) Admission result: Admitted immediately Cluster Memory Admitted: 937.21 MB Executor Group: default ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------------------------- F15:ROOT 1 12.951us 12.951us 0 0 37:AGGREGATE 1 107.127us 107.127us 1 1 16.00 KB 10.00 MB FINALIZE 36:EXCHANGE 1 22.746us 22.746us 3 1 32.00 KB 16.00 KB UNPARTITIONED F03:EXCHANGE SENDER 3 63.573us 69.612us 16.00 KB 0 20:AGGREGATE 3 154.816ms 158.802ms 3 1 32.00 KB 10.00 MB 19:HASH JOIN 3 609.169ms 615.570ms 121.00M 807.81M 2.18 MB 2.12 MB NULL AWARE LEFT ANTI JOIN, BROADCAST |--35:EXCHANGE 3 8.794us 14.218us 0 0 0 17.00 KB BROADCAST | F07:EXCHANGE SENDER 1 52.478us 52.478us 27.42 KB 0 | 15:HASH JOIN 1 315.468us 315.468us 0 0 2.18 MB 2.12 MB NULL AWARE LEFT ANTI JOIN, BROADCAST | |--34:EXCHANGE 1 7.908us 7.908us 1 1 16.00 KB 16.00 KB BROADCAST | | F14:EXCHANGE SENDER 1 36.392us 36.392us 12.80 KB 0 | | 33:AGGREGATE 1 147.979us 147.979us 1 1 16.00 KB 10.00 MB FINALIZE | | 32:EXCHANGE 1 13.258us 13.258us 3 1 32.00 KB 16.00 KB UNPARTITIONED | | F13:EXCHANGE SENDER 3 100.969us 221.182us 12.80 KB 0 | | 13:AGGREGATE 3 30.245us 90.736us 3 1 24.00 KB 10.00 MB | | 12:HASH JOIN 3 1.128ms 1.503ms 8 742 1.99 MB 1.94 MB INNER JOIN, PARTITIONED | | |--31:EXCHANGE 3 10.639us 13.358us 8 742 48.00 KB 23.19 KB HASH(tttt1.smallint_col) | | | F12:EXCHANGE SENDER 3 123.010us 129.369us 66.84 KB 0 | | | 10:SCAN HDFS 3 164.687ms 261.686ms 8 742 51.00 KB 32.00 MB functional_parquet.alltypestiny tttt1 | | 30:EXCHANGE 3 7.700us 10.039us 2 742 16.00 KB 49.76 KB HASH(tttt2.`month`) | | F11:EXCHANGE SENDER 3 735.229us 2.062ms 25.33 KB 0 | | 11:SCAN HDFS 3 512.884ms 541.006ms 2 742 70.00 KB 32.00 MB functional_parquet.alltypestiny tttt2 | 14:HASH JOIN 1 2.837ms 2.837ms 0 0 2.69 MB 2.12 MB NULL AWARE LEFT ANTI JOIN, BROADCAST | |--29:EXCHANGE 1 340.865us 340.865us 18.30K 28.42K 1016.00 KB 393.07 KB BROADCAST | | F10:EXCHANGE SENDER 3 514.136us 854.619us 18.28 KB 0 | | 09:HASH JOIN 3 15.314ms 18.395ms 18.30K 28.42K 1.98 MB 1.94 MB RIGHT OUTER JOIN, PARTITIONED | | |--28:EXCHANGE 3 41.518us 43.332us 7.30K 12.84K 48.00 KB 69.43 KB HASH(tttt2.id) | | | F09:EXCHANGE SENDER 3 333.201us 355.480us 126.66 KB 0 | | | 08:SCAN HDFS 3 323.515ms 500.682ms 7.30K 12.84K 77.00 KB 32.00 MB functional_parquet.alltypes tttt2 | | 27:EXCHANGE 3 48.553us 130.271us 11.00K 28.42K 112.00 KB 61.01 KB HASH(tttt1.`year`) | | F08:EXCHANGE SENDER 3 320.437us 356.683us 104.78 KB 0 | | 07:SCAN HDFS 3 601.987ms 733.542ms 11.00K 28.42K 260.00 KB 1.00 MB functional_parquet.alltypesagg tttt1 | 06:SCAN HDFS 1 145.361us 145.361us 0 0 0 0 functional_parquet.alltypestiny ttt1 18:HASH JOIN 3 1h28m 1h29m 121.00M 807.81M 849.87 MB 2.12 MB NULL AWARE LEFT ANTI JOIN, BROADCAST |--26:EXCHANGE 3 97.524us 102.043us 7.30K 12.84K 256.00 KB 350.28 KB BROADCAST | F06:EXCHANGE SENDER 3 326.945us 481.408us 33.38 KB 0 | 05:HASH JOIN 3 888.175us 1.278ms 7.30K 12.84K 1.98 MB 1.94 MB LEFT OUTER JOIN, PARTITIONED | |--25:EXCHANGE 3 35.107us 94.986us 7.30K 12.84K 144.00 KB 69.43 KB HASH(tt1.`year`) | | F05:EXCHANGE SENDER 3 1.423ms 3.121ms 102.66 KB 0 | | 03:SCAN HDFS 3 339.381ms 551.863ms 7.30K 12.84K 118.00 KB 16.00 MB functional_parquet.alltypes tt1 | 24:EXCHANGE 3 40.325us 65.497us 7.30K 12.84K 128.00 KB 105.33 KB HASH(tt2.`month`) | F04:EXCHANGE SENDER 3 301.393us 315.638us 79.42 KB 0 | 04:SCAN HDFS 3 402.317ms 651.015ms 7.30K 12.84K 94.00 KB 32.00 MB functional_parquet.alltypes tt2 17:HASH JOIN 3 848.765ms 863.224ms 121.00M 807.81M 2.00 MB 1.94 MB FULL OUTER JOIN, PARTITIONED |--23:EXCHANGE 3 7.735us 10.188us 8 742 48.00 KB 49.76 KB HASH(t3.int_col,t3.`year`) | F02:EXCHANGE SENDER 3 101.020us 103.080us 29.33 KB 0 | 02:SCAN HDFS 3 268.902ms 340.819ms 8 742 86.00 KB 48.00 MB functional_parquet.alltypestiny t3 22:EXCHANGE 3 590.912ms 598.261ms 121.00M 807.81M 12.48 MB 10.08 MB HASH(t2.`year`,t2.int_col) F00:EXCHANGE SENDER 3 4s419ms 4s759ms 120.56 KB 0 16:NESTED LOOP JOIN 3 870.742ms 940.978ms 121.00M 807.81M 339.00 KB 138.78 KB CROSS JOIN, BROADCAST |--21:EXCHANGE 3 583.615us 1.386ms 11.00K 28.42K 24.00 KB 165.78 KB BROADCAST | F01:EXCHANGE SENDER 3 348.323us 403.668us 63.98 KB 0 | 00:SCAN HDFS 3 530.702ms 640.428ms 11.00K 28.42K 200.00 KB 16.00 MB functional_parquet.alltypesagg t1 01:SCAN HDFS 3 59.153ms 63.761ms 11.00K 28.42K 310.00 KB 32.00 MB functional_parquet.alltypesagg t2 Errors: Query Compilation: 4s574ms - Metadata load started: 53.553ms (53.553ms) - Metadata load finished. loaded-tables=3/3 load-requests=1 catalog-updates=3 storage-load-time=443ms: 4s140ms (4s086ms) - Analysis finished: 4s191ms (51.420ms) - Authorization finished (noop): 4s192ms (776.161us) - Value transfer graph computed: 4s227ms (34.551ms) - Single node plan created: 4s335ms (108.523ms) - Runtime filters computed: 4s365ms (30.267ms) - Distributed plan created: 4s366ms (991.171us) - Planning finished: 4s574ms (207.423ms) Query Timeline: 1h29m - Query submitted: 19.335us (19.335us) - Planning finished: 4s601ms (4s601ms) - Submit for admission: 4s602ms (410.897us) - Completed admission: 4s602ms (645.535us) - Ready to start on 3 backends: 4s603ms (469.127us) - All 3 execution backends (42 fragment instances) started: 4s607ms (4.142ms) - First dynamic filter received: 5s360ms (752.632ms) - Rows available: 1h29m (1h29m) - First row fetched: 1h29m (840.844ms) - Last row fetched: 1h29m (12.410us) - Released admission control resources: 1h29m (1.216ms) - Unregister query: 1h29m (4.716ms) - AdmissionControlTimeSinceLastUpdate: 95.000ms - ComputeScanRangeAssignmentTimer: 350.023us Frontend: ImpalaServer: - ClientFetchWaitTimer: 841.268ms - NumRowsFetched: 1 (1) - NumRowsFetchedFromCache: 0 (0) - RowMaterializationRate: 181.00 /sec - RowMaterializationTimer: 5.521ms Execution Profile e0424d84963f6618:f987655900000000:(Total: 1h29m, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 2 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 2 12 11 REMOTE true 3 (3) N/A N/A true 0 9 7 REMOTE true 3 (3) N/A N/A true Backend startup latencies: Count: 3, min / max: 2ms / 3ms, 25th %-ile: 2ms, 50th %-ile: 2ms, 75th %-ile: 2ms, 90th %-ile: 3ms, 95th %-ile: 3ms, 99.9th %-ile: 3ms Slowest backend to start up: tarmstrong-box:22001 Final filter table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- 2 12 11 REMOTE true 0 (3) 5s360ms 5s572ms false 0 9 7 REMOTE true 0 (3) 5s457ms 5s514ms false Per Node Peak Memory Usage: tarmstrong-box:22001(867.04 MB) tarmstrong-box:22002(856.77 MB) tarmstrong-box:22000(866.09 MB) Per Node Bytes Read: tarmstrong-box:22001(722.34 KB) tarmstrong-box:22002(815.08 KB) tarmstrong-box:22000(660.47 KB) Per Node User Time: tarmstrong-box:22001(1h29m) tarmstrong-box:22002(1h28m) tarmstrong-box:22000(1h29m) Per Node System Time: tarmstrong-box:22001(944.000ms) tarmstrong-box:22002(552.000ms) tarmstrong-box:22000(720.000ms) - ExchangeScanRatio: 467.27 - FiltersReceived: 6 (6) - FinalizationTimer: 0.000ns - InnerNodeSelectivityRatio: 0.00 - NumBackends: 3 (3) - NumCompletedBackends: 3 (3) - NumFragmentInstances: 42 (42) - NumFragments: 16 (16) - TotalBytesRead: 2.15 MB (2250651) - TotalBytesSent: 1003.32 MB (1052053964) - TotalCpuTime: 4h27m - TotalInnerBytesSent: 374.51 KB (383502) - TotalScanBytesSent: 1002.95 MB (1051670462) Per Node Profiles: tarmstrong-box:22001: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns tarmstrong-box:22002: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns tarmstrong-box:22000: - AdmissionSlots: 1 (1) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns Averaged Fragment F15:(Total: 1h29m, non-child: 230.530us, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1h29m max:1h29m mean: 1h29m stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 56.01 KB (57353) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 866.09 MB (908166381) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1h29m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1h29m - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 20.000ms - TotalThreadsVoluntaryContextSwitches: 22 (22) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 840.850ms - ExecTreeExecTime: 2.155us - OpenTime: 1h29m - ExecTreeOpenTime: 1h29m - PrepareTime: 207.057us - ExecTreePrepareTime: 71.641us PLAN_ROOT_SINK:(Total: 840.831ms, non-child: 840.831ms, % non-child: 100.00%) - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 1.00 /sec AGGREGATION_NODE (id=37):(Total: 1h29m, non-child: 107.127us, % non-child: 0.00%) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 3.012us - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=36):(Total: 1h29m, non-child: 1h29m, % non-child: 100.00%) - ConvertRowBatchTime: 2.469us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 3 (3) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.465us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.599us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 1h28m - TotalBytesDequeued: 48.00 B (48) - TotalGetBatchTime: 1h29m - DataWaitTime: 1h29m Enqueue: - DeserializeRowBatchTime: 16.870us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 36.00 B (36) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 106.350ms, non-child: 106.350ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 34 (34) - CodegenTotalWallClockTime: 106.344ms - CodegenSysTime: 4.000ms - CodegenUserTime: 20.000ms - CodegenVoluntaryContextSwitches: 16 (16) - CompileTime: 10.137ms - IrGenerationTime: 40.681us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 1 (1) - NumInstructions: 13 (13) - OptimizationTime: 3.949ms - PeakMemoryUsage: 6.50 KB (6656) - PrepareTime: 91.328ms Coordinator Fragment F15: Instance e0424d84963f6618:f987655900000000 (host=tarmstrong-box:22000):(Total: 1h29m, non-child: 230.530us, % non-child: 0.00%) Last report received time: 2019-11-03 18:44:55.665 Fragment Instance Lifecycle Event Timeline: 1h29m - Prepare Finished: 319.024us (319.024us) - Open Finished: 1h29m (1h29m) - First Batch Produced: 1h29m (2.670us) - First Batch Sent: 1h29m (840.830ms) - ExecInternal Finished: 1h29m (104.554us) - MemoryUsage (2m8s): 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB, 12.01 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 56.01 KB (57353) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 866.09 MB (908166381) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 1h29m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34 (34) - TotalThreadsTotalWallClockTime: 1h29m - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 20.000ms - TotalThreadsVoluntaryContextSwitches: 22 (22) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 840.850ms - ExecTreeExecTime: 2.155us - OpenTime: 1h29m - ExecTreeOpenTime: 1h29m - PrepareTime: 207.057us - ExecTreePrepareTime: 71.641us PLAN_ROOT_SINK:(Total: 840.831ms, non-child: 12.951us, % non-child: 0.00%) - PeakMemoryUsage: 0 - RowsSent: 1 (1) - RowsSentRate: 1.00 /sec AGGREGATION_NODE (id=37):(Total: 1h29m, non-child: 107.127us, % non-child: 0.00%) Node Lifecycle Event Timeline: 1h29m - Open Started: 106.716ms (106.716ms) - Open Finished: 1h29m (1h29m) - First Batch Requested: 1h29m (21.889us) - First Batch Returned: 1h29m (1.082us) - Last Batch Returned: 1h29m (144.000ns) - Closed: 1h29m (840.861ms) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 3.012us - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=36):(Total: 1h29m, non-child: 22.746us, % non-child: 0.00%) Node Lifecycle Event Timeline: 1h29m - Open Started: 106.719ms (106.719ms) - Open Finished: 1h28m (1h28m) - First Batch Requested: 1h28m (7.527us) - First Batch Returned: 1h29m (59s981ms) - Last Batch Returned: 1h29m (249.000ns) - Closed: 1h29m (24.238us) - ConvertRowBatchTime: 2.469us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 3 (3) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.465us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.599us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - FirstBatchWaitTime: 1h28m - TotalBytesDequeued: 48.00 B (48) - TotalGetBatchTime: 1h29m - DataWaitTime: 1h29m Enqueue: - BytesReceived (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DeferredQueueSize (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 36.426us ; Min: 21.349us ; Max: 54.125us ; Number of samples: 3) - DeserializeRowBatchTime: 16.870us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 36.00 B (36) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 106.350ms, non-child: 106.350ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 34 (34) - CodegenTotalWallClockTime: 106.344ms - CodegenSysTime: 4.000ms - CodegenUserTime: 20.000ms - CodegenVoluntaryContextSwitches: 16 (16) - CompileTime: 10.137ms - IrGenerationTime: 40.681us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 1 (1) - NumInstructions: 13 (13) - OptimizationTime: 3.949ms - PeakMemoryUsage: 6.50 KB (6656) - PrepareTime: 91.328ms Averaged Fragment F03:(Total: 1h28m, non-child: 315.345us, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1h28m max:1h29m mean: 1h28m stddev:28s001ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 863.14 MB (905064334) - PeakReservation: 850.79 MB (892119722) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 863.30 MB (905237925) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2s518ms - TotalNetworkSendTime: 346.571us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 9.85K (9851) - TotalThreadsTotalWallClockTime: 1h28m - TotalThreadsSysTime: 532.000ms - TotalThreadsUserTime: 1h28m - TotalThreadsVoluntaryContextSwitches: 10.54K (10536) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 386.919us - ExecTreeExecTime: 2.960us - OpenTime: 1h28m - ExecTreeOpenTime: 1h28m - PrepareTime: 629.417us - ExecTreePrepareTime: 374.362us KrpcDataStreamSender (dst_id=36):(Total: 410.667us, non-child: 410.667us, % non-child: 100.00%) - EosSent: 1 (1) - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 3.490us - TotalBytesSent: 12.00 B (12) - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=20):(Total: 1h28m, non-child: 154.816ms, % non-child: 0.00%) - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: - BuildTime: 80.575ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=19):(Total: 1h28m, non-child: 609.169ms, % non-child: 0.01%) - BuildRows: 0 (0) - BuildTime: 145.441us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.18 MB (2287872) - ProbeRows: 40.33M (40333336) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 543.591ms - RowsReturned: 40.33M (40333336) - RowsReturnedRate: 7.55 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.12 MB (2228224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=19): - BuildRowsPartitionTime: 628.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=35):(Total: 8.794us, non-child: 8.794us, % non-child: 100.00%) - ConvertRowBatchTime: 311.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 612.000ns - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=18):(Total: 1h28m, non-child: 1h28m, % non-child: 99.93%) - BuildRows: 7.30K (7300) - BuildTime: 328.853us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 846.79 MB (887923626) - ProbeRows: 40.33M (40333336) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s410ms - RowsReturned: 40.33M (40333336) - RowsReturnedRate: 7.56 K/sec Buffer pool: - AllocTime: 56.060ms - CumulativeAllocationBytes: 846.67 MB (887794346) - CumulativeAllocations: 13.55K (13546) - PeakReservation: 846.73 MB (887859882) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 846.67 MB (887794346) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 50.211ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=18): - BuildRowsPartitionTime: 201.093us - BuildRowsPartitioned: 7.30K (7300) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=26):(Total: 97.524us, non-child: 97.524us, % non-child: 100.00%) - ConvertRowBatchTime: 81.884us - PeakMemoryUsage: 256.00 KB (262144) - RowsReturned: 7.30K (7300) - RowsReturnedRate: 75.13 M/sec Buffer pool: - AllocTime: 40.253us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 18 (18) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 256.00 KB (262144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 32.621us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 213.87 KB (219000) - TotalGetBatchTime: 8.356us - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 165.881us - TotalBatchesEnqueued: 9 (9) - TotalBatchesReceived: 9 (9) - TotalBytesReceived: 64.61 KB (66161) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=17):(Total: 3s898ms, non-child: 848.765ms, % non-child: 21.77%) - BuildRows: 2 (2) - BuildTime: 134.528us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2090581) - ProbeRows: 40.33M (40333333) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 819.911ms - RowsReturned: 40.33M (40333336) - RowsReturnedRate: 10.35 M/sec Buffer pool: - AllocTime: 3.062us - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 2 (2) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 2.379us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=17): - BuildRowsPartitionTime: 2.702us - BuildRowsPartitioned: 2 (2) - HashTablesBuildTime: 11.319us - LargestPartitionPercent: 66 (66) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 19.46 KB (19925) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 5 (5) - HashCollisions: 0 (0) - Probes: 1.32M (1320002) - Resizes: 0 (0) - Travel: 73.33K (73333) EXCHANGE_NODE (id=23):(Total: 7.735us, non-child: 7.735us, % non-child: 100.00%) - ConvertRowBatchTime: 838.000ns - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 2 (2) - RowsReturnedRate: 286.87 K/sec Buffer pool: - AllocTime: 5.431us - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.231us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 69.00 B (69) - TotalGetBatchTime: 2.179us - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 13.952us - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 46.00 B (46) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=22):(Total: 3s049ms, non-child: 3s049ms, % non-child: 100.00%) - ConvertRowBatchTime: 511.607ms - PeakMemoryUsage: 12.11 MB (12702094) - RowsReturned: 40.33M (40333333) - RowsReturnedRate: 13.23 M/sec Buffer pool: - AllocTime: 54.892ms - CumulativeAllocationBytes: 1.58 GB (1694427818) - CumulativeAllocations: 103.42K (103422) - PeakReservation: 12.11 MB (12697600) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.11 MB (12697600) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 14.406ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.39 GB (1492333333) - TotalGetBatchTime: 2s512ms - DataWaitTime: 2s458ms Enqueue: - DeserializeRowBatchTime: 391.287ms - TotalBatchesEnqueued: 51.71K (51711) - TotalBatchesReceived: 51.71K (51711) - TotalBytesReceived: 334.21 MB (350441029) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 156.603ms - TotalRPCsDeferred: 11 (11) CodeGen:(Total: 1s332ms, non-child: 1s332ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 298 (298) - CodegenTotalWallClockTime: 1s332ms - CodegenSysTime: 5.333ms - CodegenUserTime: 710.666ms - CodegenVoluntaryContextSwitches: 25 (25) - CompileTime: 187.907ms - IrGenerationTime: 80.815ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 160 (160) - NumInstructions: 9.82K (9822) - OptimizationTime: 1s030ms - PeakMemoryUsage: 4.80 MB (5028864) - PrepareTime: 26.913ms Fragment F03: Instance e0424d84963f6618:f987655900000029 (host=tarmstrong-box:22000):(Total: 1h29m, non-child: 285.020us, % non-child: 0.00%) Last report received time: 2019-11-03 18:44:55.665 Fragment Instance Lifecycle Event Timeline: 1h29m - Prepare Finished: 851.624us (851.624us) - Open Finished: 1h29m (1h29m) - First Batch Produced: 1h29m (3.353us) - First Batch Sent: 1h29m (15.610us) - ExecInternal Finished: 1h29m (580.068us) - MemoryUsage (2m8s): 836.29 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB, 866.05 MB - ThreadUsage (2m8s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 866.05 MB (908117220) - PeakReservation: 853.88 MB (895352832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 866.09 MB (908166381) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2s555ms - TotalNetworkSendTime: 401.780us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10.30K (10301) - TotalThreadsTotalWallClockTime: 1h29m - TotalThreadsSysTime: 564.000ms - TotalThreadsUserTime: 1h29m - TotalThreadsVoluntaryContextSwitches: 11.02K (11016) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 447.128us - ExecTreeExecTime: 3.041us - OpenTime: 1h29m - ExecTreeOpenTime: 1h29m - PrepareTime: 707.295us - ExecTreePrepareTime: 456.262us KrpcDataStreamSender (dst_id=36):(Total: 460.979us, non-child: 58.512us, % non-child: 12.69%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 86.03 KB/sec ; Min: 86.03 KB/sec ; Max: 86.03 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 3.426us - TotalBytesSent: 12.00 B (12) - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=20):(Total: 1h29m, non-child: 152.071ms, % non-child: 0.00%) Node Lifecycle Event Timeline: 1h29m - Open Started: 1s320ms (1s320ms) - Open Finished: 1h29m (1h29m) - First Batch Requested: 1h29m (10.498us) - First Batch Returned: 1h29m (1.699us) - Last Batch Returned: 1h29m (115.000ns) - Closed: 1h29m (473.492us) - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 80.737ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=19):(Total: 1h29m, non-child: 602.268ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h29m - Open Started: 1s320ms (1s320ms) - Open Finished: 7s825ms (6s504ms) - First Batch Requested: 7s825ms (6.638us) - First Batch Returned: 7s825ms (18.199us) - Last Batch Returned: 1h29m (1h29m) - Closed: 1h29m (59.471us) - BuildRows: 0 (0) - BuildTime: 163.683us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.18 MB (2287872) - ProbeRows: 40.48M (40480004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 539.256ms - RowsReturned: 40.48M (40480004) - RowsReturnedRate: 7.55 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.12 MB (2228224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 712.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=35):(Total: 5.306us, non-child: 5.306us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s321ms - Open Started: 1s320ms (1s320ms) - Open Finished: 1s320ms (2.533us) - First Batch Requested: 1s321ms (156.673us) - First Batch Returned: 1s321ms (1.092us) - Last Batch Returned: 1s321ms (136.000ns) - Closed: 1s321ms (157.733us) - ConvertRowBatchTime: 249.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 480.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0 - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=18):(Total: 1h29m, non-child: 1h29m, % non-child: 99.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h29m - Open Started: 1s320ms (1s320ms) - Open Finished: 1s321ms (808.898us) - First Batch Requested: 1s321ms (1.745us) - First Batch Returned: 1s351ms (29.273ms) - Last Batch Returned: 1h29m (1h29m) - Closed: 1h29m (73.699us) - BuildRows: 7.30K (7300) - BuildTime: 338.304us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 849.87 MB (891156736) - ProbeRows: 40.48M (40480004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s387ms - RowsReturned: 40.48M (40480004) - RowsReturnedRate: 7.55 K/sec Buffer pool: - AllocTime: 59.945ms - CumulativeAllocationBytes: 849.75 MB (891027456) - CumulativeAllocations: 13.60K (13596) - PeakReservation: 849.81 MB (891092992) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 849.75 MB (891027456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 53.811ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 185.562us - BuildRowsPartitioned: 7.30K (7300) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=26):(Total: 102.043us, non-child: 102.043us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s321ms - Open Started: 1s321ms (1s321ms) - Open Finished: 1s321ms (1.741us) - First Batch Requested: 1s321ms (136.598us) - First Batch Returned: 1s321ms (20.548us) - Last Batch Returned: 1s321ms (268.212us) - Closed: 1s321ms (70.170us) - ConvertRowBatchTime: 84.692us - PeakMemoryUsage: 256.00 KB (262144) - RowsReturned: 7.30K (7300) - RowsReturnedRate: 71.54 M/sec Buffer pool: - AllocTime: 33.248us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 18 (18) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 256.00 KB (262144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 25.365us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 213.87 KB (219000) - TotalGetBatchTime: 10.177us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 64.61 KB - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: (Avg: 78.918us ; Min: 12.094us ; Max: 567.457us ; Number of samples: 9) - DeserializeRowBatchTime: 154.418us - TotalBatchesEnqueued: 9 (9) - TotalBatchesReceived: 9 (9) - TotalBytesReceived: 64.61 KB (66161) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=17):(Total: 3s936ms, non-child: 855.488ms, % non-child: 21.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h29m - Open Started: 1s321ms (1s321ms) - Open Finished: 1s321ms (211.930us) - First Batch Requested: 1s321ms (2.368us) - First Batch Returned: 1s321ms (22.440us) - Last Batch Returned: 7s686ms (6s364ms) - Closed: 1h29m (1h29m) - BuildRows: 4 (4) - BuildTime: 87.754us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.00 MB (2093312) - ProbeRows: 40.48M (40480000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 827.797ms - RowsReturned: 40.48M (40480004) - RowsReturnedRate: 10.28 M/sec Buffer pool: - AllocTime: 3.386us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 3 (3) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 2.482us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=17): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 3.661us - BuildRowsPartitioned: 4 (4) - HashTablesBuildTime: 9.744us - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 22.12 KB (22656) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 8 (8) - HashCollisions: 0 (0) - Probes: 2.09M (2090004) - Resizes: 0 (0) - Travel: 110.00K (110000) EXCHANGE_NODE (id=23):(Total: 8.547us, non-child: 8.547us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s321ms - Open Started: 1s321ms (1s321ms) - Open Finished: 1s321ms (1.866us) - First Batch Requested: 1s321ms (64.652us) - First Batch Returned: 1s321ms (5.572us) - Last Batch Returned: 1s321ms (111.000ns) - Closed: 1s321ms (57.877us) - ConvertRowBatchTime: 1.203us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 4 (4) - RowsReturnedRate: 468.00 K/sec Buffer pool: - AllocTime: 10.449us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 7.213us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 104.00 B (104) - TotalGetBatchTime: 2.879us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 51.00 B, 71.00 B - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: (Avg: 20.700us ; Min: 12.307us ; Max: 26.542us ; Number of samples: 3) - DeserializeRowBatchTime: 21.253us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 71.00 B (71) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=22):(Total: 3s080ms, non-child: 585.265ms, % non-child: 19.00%) Node Lifecycle Event Timeline: 1h29m - Open Started: 1s321ms (1s321ms) - Open Finished: 1s321ms (5.041us) - First Batch Requested: 1s321ms (149.006us) - First Batch Returned: 1s321ms (24.215us) - Last Batch Returned: 7s686ms (6s364ms) - Closed: 1h29m (1h29m) - ConvertRowBatchTime: 505.941ms - PeakMemoryUsage: 11.94 MB (12517376) - RowsReturned: 40.48M (40480000) - RowsReturnedRate: 13.14 M/sec Buffer pool: - AllocTime: 74.586ms - CumulativeAllocationBytes: 1.58 GB (1700585472) - CumulativeAllocations: 103.80K (103798) - PeakReservation: 11.94 MB (12517376) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 11.94 MB (12517376) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 33.287ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (2m8s): 1.35 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.39 GB (1497760000) - TotalGetBatchTime: 2s548ms - DataWaitTime: 2s495ms Enqueue: - BytesReceived (2m8s): 323.73 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB - DeferredQueueSize (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 13.323us ; Min: 4.303us ; Max: 4.636ms ; Number of samples: 51899) - DeserializeRowBatchTime: 424.310ms - TotalBatchesEnqueued: 51.90K (51899) - TotalBatchesReceived: 51.90K (51899) - TotalBytesReceived: 335.42 MB (351718602) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 434.765ms - TotalRPCsDeferred: 3 (3) CodeGen:(Total: 1s320ms, non-child: 1s320ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 261 (261) - CodegenTotalWallClockTime: 1s319ms - CodegenSysTime: 4.000ms - CodegenUserTime: 708.000ms - CodegenVoluntaryContextSwitches: 28 (28) - CompileTime: 186.151ms - IrGenerationTime: 37.217ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 160 (160) - NumInstructions: 9.82K (9822) - OptimizationTime: 1s063ms - PeakMemoryUsage: 4.80 MB (5028864) - PrepareTime: 16.299ms Instance e0424d84963f6618:f987655900000028 (host=tarmstrong-box:22001):(Total: 1h29m, non-child: 405.920us, % non-child: 0.00%) Last report received time: 2019-11-03 18:44:52.710 Fragment Instance Lifecycle Event Timeline: 1h29m - Prepare Finished: 6.456ms (6.456ms) - Open Finished: 1h29m (1h29m) - First Batch Produced: 1h29m (3.089us) - First Batch Sent: 1h29m (17.819us) - ExecInternal Finished: 1h29m (488.890us) - MemoryUsage (2m8s): 836.71 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB, 866.59 MB - ThreadUsage (2m8s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 866.59 MB (908690660) - PeakReservation: 853.88 MB (895352832) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 867.04 MB (909162272) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2s491ms - TotalNetworkSendTime: 301.746us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 7.89K (7891) - TotalThreadsTotalWallClockTime: 1h29m - TotalThreadsSysTime: 684.000ms - TotalThreadsUserTime: 1h29m - TotalThreadsVoluntaryContextSwitches: 10.26K (10256) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 345.459us - ExecTreeExecTime: 2.869us - OpenTime: 1h29m - ExecTreeOpenTime: 1h29m - PrepareTime: 634.716us - ExecTreePrepareTime: 348.520us KrpcDataStreamSender (dst_id=36):(Total: 364.795us, non-child: 62.595us, % non-child: 17.16%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 113.23 KB/sec ; Min: 113.23 KB/sec ; Max: 113.23 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 3.715us - TotalBytesSent: 12.00 B (12) - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=20):(Total: 1h29m, non-child: 158.802ms, % non-child: 0.00%) Node Lifecycle Event Timeline: 1h29m - Open Started: 1s307ms (1s307ms) - Open Finished: 1h29m (1h29m) - First Batch Requested: 1h29m (11.097us) - First Batch Returned: 1h29m (1.644us) - Last Batch Returned: 1h29m (147.000ns) - Closed: 1h29m (362.759us) - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 80.654ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=19):(Total: 1h29m, non-child: 615.570ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h29m - Open Started: 1s307ms (1s307ms) - Open Finished: 7s879ms (6s572ms) - First Batch Requested: 7s879ms (5.312us) - First Batch Returned: 7s879ms (18.629us) - Last Batch Returned: 1h29m (1h29m) - Closed: 1h29m (137.121us) - BuildRows: 0 (0) - BuildTime: 149.700us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.18 MB (2287872) - ProbeRows: 40.48M (40480004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 551.005ms - RowsReturned: 40.48M (40480004) - RowsReturnedRate: 7.56 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.12 MB (2228224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 660.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=35):(Total: 6.858us, non-child: 6.858us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s307ms - Open Started: 1s307ms (1s307ms) - Open Finished: 1s307ms (3.067us) - First Batch Requested: 1s307ms (154.644us) - First Batch Returned: 1s307ms (1.645us) - Last Batch Returned: 1s307ms (135.000ns) - Closed: 1s307ms (85.236us) - ConvertRowBatchTime: 413.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 717.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0 - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=18):(Total: 1h29m, non-child: 1h29m, % non-child: 99.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h29m - Open Started: 1s307ms (1s307ms) - Open Finished: 1s308ms (756.957us) - First Batch Requested: 1s308ms (1.834us) - First Batch Returned: 1s409ms (101.174ms) - Last Batch Returned: 1h29m (1h29m) - Closed: 1h29m (221.265us) - BuildRows: 7.30K (7300) - BuildTime: 259.481us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 849.87 MB (891156736) - ProbeRows: 40.48M (40480004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s443ms - RowsReturned: 40.48M (40480004) - RowsReturnedRate: 7.56 K/sec Buffer pool: - AllocTime: 54.263ms - CumulativeAllocationBytes: 849.75 MB (891027456) - CumulativeAllocations: 13.60K (13596) - PeakReservation: 849.81 MB (891092992) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 849.75 MB (891027456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 48.530ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 173.934us - BuildRowsPartitioned: 7.30K (7300) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=26):(Total: 89.388us, non-child: 89.388us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s308ms - Open Started: 1s308ms (1s308ms) - Open Finished: 1s308ms (1.551us) - First Batch Requested: 1s308ms (76.561us) - First Batch Returned: 1s308ms (13.285us) - Last Batch Returned: 1s308ms (249.148us) - Closed: 1s308ms (75.130us) - ConvertRowBatchTime: 75.333us - PeakMemoryUsage: 256.00 KB (262144) - RowsReturned: 7.30K (7300) - RowsReturnedRate: 81.67 M/sec Buffer pool: - AllocTime: 46.054us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 18 (18) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 256.00 KB (262144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 39.634us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 213.87 KB (219000) - TotalGetBatchTime: 7.194us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 64.61 KB - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: (Avg: 19.048us ; Min: 13.354us ; Max: 28.867us ; Number of samples: 9) - DeserializeRowBatchTime: 179.825us - TotalBatchesEnqueued: 9 (9) - TotalBatchesReceived: 9 (9) - TotalBytesReceived: 64.61 KB (66161) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=17):(Total: 3s891ms, non-child: 863.224ms, % non-child: 22.18%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h29m - Open Started: 1s308ms (1s308ms) - Open Finished: 1s308ms (445.884us) - First Batch Requested: 1s308ms (2.924us) - First Batch Returned: 1s308ms (23.278us) - Last Batch Returned: 7s684ms (6s376ms) - Closed: 1h29m (1h29m) - BuildRows: 4 (4) - BuildTime: 166.195us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.00 MB (2093312) - ProbeRows: 40.48M (40480000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 832.647ms - RowsReturned: 40.48M (40480004) - RowsReturnedRate: 10.40 M/sec Buffer pool: - AllocTime: 5.801us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 3 (3) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.656us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=17): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 4.022us - BuildRowsPartitioned: 4 (4) - HashTablesBuildTime: 24.213us - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 22.12 KB (22656) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 8 (8) - HashCollisions: 0 (0) - Probes: 1.87M (1870004) - Resizes: 0 (0) - Travel: 110.00K (110000) EXCHANGE_NODE (id=23):(Total: 10.188us, non-child: 10.188us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s308ms - Open Started: 1s308ms (1s308ms) - Open Finished: 1s308ms (2.074us) - First Batch Requested: 1s308ms (119.587us) - First Batch Returned: 1s308ms (6.755us) - Last Batch Returned: 1s308ms (160.000ns) - Closed: 1s308ms (95.825us) - ConvertRowBatchTime: 1.081us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 4 (4) - RowsReturnedRate: 392.62 K/sec Buffer pool: - AllocTime: 5.845us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 2.480us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 104.00 B (104) - TotalGetBatchTime: 3.355us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 50.00 B, 69.00 B - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: (Avg: 27.469us ; Min: 23.393us ; Max: 29.980us ; Number of samples: 3) - DeserializeRowBatchTime: 20.603us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 69.00 B (69) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=22):(Total: 3s027ms, non-child: 598.261ms, % non-child: 19.76%) Node Lifecycle Event Timeline: 1h29m - Open Started: 1s308ms (1s308ms) - Open Finished: 1s308ms (1.442us) - First Batch Requested: 1s308ms (272.161us) - First Batch Returned: 1s308ms (26.782us) - Last Batch Returned: 7s684ms (6s376ms) - Closed: 1h29m (1h29m) - ConvertRowBatchTime: 517.360ms - PeakMemoryUsage: 12.48 MB (13090816) - RowsReturned: 40.48M (40480000) - RowsReturnedRate: 13.37 M/sec Buffer pool: - AllocTime: 44.895ms - CumulativeAllocationBytes: 1.58 GB (1700593664) - CumulativeAllocations: 103.80K (103798) - PeakReservation: 12.48 MB (13090816) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 12.48 MB (13090816) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.021ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (2m8s): 1.35 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB, 1.39 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.39 GB (1497760000) - TotalGetBatchTime: 2s485ms - DataWaitTime: 2s429ms Enqueue: - BytesReceived (2m8s): 323.72 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB, 335.42 MB - DeferredQueueSize (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 13.311us ; Min: 4.121us ; Max: 7.337ms ; Number of samples: 51899) - DeserializeRowBatchTime: 375.295ms - TotalBatchesEnqueued: 51.90K (51899) - TotalBatchesReceived: 51.90K (51899) - TotalBytesReceived: 335.42 MB (351712529) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 1s301ms, non-child: 1s301ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 302 (302) - CodegenTotalWallClockTime: 1s301ms - CodegenSysTime: 0.000ns - CodegenUserTime: 720.000ms - CodegenVoluntaryContextSwitches: 17 (17) - CompileTime: 186.745ms - IrGenerationTime: 122.557ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 160 (160) - NumInstructions: 9.82K (9822) - OptimizationTime: 955.452ms - PeakMemoryUsage: 4.80 MB (5028864) - PrepareTime: 35.141ms Instance e0424d84963f6618:f987655900000027 (host=tarmstrong-box:22002):(Total: 1h28m, non-child: 255.090us, % non-child: 0.00%) Last report received time: 2019-11-03 18:43:54.843 Fragment Instance Lifecycle Event Timeline: 1h28m - Prepare Finished: 673.973us (673.973us) - Open Finished: 1h28m (1h28m) - First Batch Produced: 1h28m (3.249us) - First Batch Sent: 1h28m (16.505us) - ExecInternal Finished: 1h28m (482.027us) - MemoryUsage (2m8s): 827.32 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB, 856.77 MB - ThreadUsage (2m8s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 856.77 MB (898385124) - PeakReservation: 844.62 MB (885653504) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 856.77 MB (898385124) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 2s508ms - TotalNetworkSendTime: 336.187us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 11.36K (11361) - TotalThreadsTotalWallClockTime: 1h28m - TotalThreadsSysTime: 348.000ms - TotalThreadsUserTime: 1h28m - TotalThreadsVoluntaryContextSwitches: 10.34K (10336) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 368.171us - ExecTreeExecTime: 2.970us - OpenTime: 1h28m - ExecTreeOpenTime: 1h28m - PrepareTime: 546.241us - ExecTreePrepareTime: 318.304us KrpcDataStreamSender (dst_id=36):(Total: 406.229us, non-child: 69.612us, % non-child: 17.14%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - NetworkThroughput: (Avg: 86.69 KB/sec ; Min: 86.69 KB/sec ; Max: 86.69 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 16.00 KB (16384) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 3.329us - TotalBytesSent: 12.00 B (12) - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=20):(Total: 1h28m, non-child: 153.575ms, % non-child: 0.00%) Node Lifecycle Event Timeline: 1h28m - Open Started: 1s376ms (1s376ms) - Open Finished: 1h28m (1h28m) - First Batch Requested: 1h28m (10.371us) - First Batch Returned: 1h28m (1.693us) - Last Batch Returned: 1h28m (163.000ns) - Closed: 1h28m (384.429us) - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 1 (1) - RowsReturnedRate: 0 NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 80.334ms - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=19):(Total: 1h28m, non-child: 609.669ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h28m - Open Started: 1s376ms (1s376ms) - Open Finished: 7s878ms (6s502ms) - First Batch Requested: 7s878ms (4.935us) - First Batch Returned: 7s878ms (13.235us) - Last Batch Returned: 1h28m (1h28m) - Closed: 1h28m (59.712us) - BuildRows: 0 (0) - BuildTime: 122.941us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.18 MB (2287872) - ProbeRows: 40.04M (40040000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 540.513ms - RowsReturned: 40.04M (40040000) - RowsReturnedRate: 7.56 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 2.12 MB (2228224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 514.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=35):(Total: 14.218us, non-child: 14.218us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s376ms - Open Started: 1s376ms (1s376ms) - Open Finished: 1s376ms (1.967us) - First Batch Requested: 1s376ms (127.581us) - First Batch Returned: 1s376ms (1.131us) - Last Batch Returned: 1s376ms (100.000ns) - Closed: 1s376ms (67.685us) - ConvertRowBatchTime: 273.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 641.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0 - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=18):(Total: 1h28m, non-child: 1h28m, % non-child: 99.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h28m - Open Started: 1s376ms (1s376ms) - Open Finished: 1s376ms (653.773us) - First Batch Requested: 1s376ms (1.272us) - First Batch Returned: 1s412ms (35.554ms) - Last Batch Returned: 1h28m (1h28m) - Closed: 1h28m (73.599us) - BuildRows: 7.30K (7300) - BuildTime: 388.775us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 840.62 MB (881457408) - ProbeRows: 40.04M (40040000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s400ms - RowsReturned: 40.04M (40040000) - RowsReturnedRate: 7.56 K/sec Buffer pool: - AllocTime: 53.972ms - CumulativeAllocationBytes: 840.50 MB (881328128) - CumulativeAllocations: 13.45K (13448) - PeakReservation: 840.56 MB (881393664) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 840.50 MB (881328128) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 48.293ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 243.785us - BuildRowsPartitioned: 7.30K (7300) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=26):(Total: 101.143us, non-child: 101.143us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s376ms - Open Started: 1s376ms (1s376ms) - Open Finished: 1s376ms (2.148us) - First Batch Requested: 1s376ms (142.427us) - First Batch Returned: 1s376ms (22.858us) - Last Batch Returned: 1s376ms (324.743us) - Closed: 1s376ms (60.721us) - ConvertRowBatchTime: 85.628us - PeakMemoryUsage: 256.00 KB (262144) - RowsReturned: 7.30K (7300) - RowsReturnedRate: 72.18 M/sec Buffer pool: - AllocTime: 41.457us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 18 (18) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 256.00 KB (262144) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 32.864us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 213.87 KB (219000) - TotalGetBatchTime: 7.698us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 64.61 KB - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: (Avg: 22.867us ; Min: 13.786us ; Max: 53.176us ; Number of samples: 9) - DeserializeRowBatchTime: 163.401us - TotalBatchesEnqueued: 9 (9) - TotalBatchesReceived: 9 (9) - TotalBytesReceived: 64.61 KB (66161) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=17):(Total: 3s867ms, non-child: 827.583ms, % non-child: 21.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1h28m - Open Started: 1s376ms (1s376ms) - Open Finished: 1s376ms (317.360us) - First Batch Requested: 1s376ms (257.627us) - First Batch Returned: 1s376ms (32.147us) - Last Batch Returned: 7s685ms (6s308ms) - Closed: 1h28m (1h28m) - BuildRows: 0 (0) - BuildTime: 149.636us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2085120) - ProbeRows: 40.04M (40040000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 799.288ms - RowsReturned: 40.04M (40040000) - RowsReturnedRate: 10.35 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=17): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 422.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=23):(Total: 4.471us, non-child: 4.471us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s376ms - Open Started: 1s376ms (1s376ms) - Open Finished: 1s376ms (1.351us) - First Batch Requested: 1s376ms (117.793us) - First Batch Returned: 1s376ms (1.024us) - Last Batch Returned: 1s376ms (144.000ns) - Closed: 1s376ms (77.632us) - ConvertRowBatchTime: 230.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 303.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0, 0 - DeferredQueueSize (500.000ms): 0, 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=22):(Total: 3s039ms, non-child: 589.211ms, % non-child: 19.39%) Node Lifecycle Event Timeline: 1h28m - Open Started: 1s376ms (1s376ms) - Open Finished: 1s376ms (4.312us) - First Batch Requested: 1s376ms (238.856us) - First Batch Returned: 1s376ms (52.610us) - Last Batch Returned: 7s685ms (6s308ms) - Closed: 1h28m (1h28m) - ConvertRowBatchTime: 511.520ms - PeakMemoryUsage: 11.92 MB (12498092) - RowsReturned: 40.04M (40040000) - RowsReturnedRate: 13.17 M/sec Buffer pool: - AllocTime: 45.196ms - CumulativeAllocationBytes: 1.57 GB (1682104320) - CumulativeAllocations: 102.67K (102670) - PeakReservation: 11.91 MB (12484608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 11.91 MB (12484608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.912ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (2m8s): 1.33 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB, 1.38 GB - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 1.38 GB (1481480000) - TotalGetBatchTime: 2s502ms - DataWaitTime: 2s450ms Enqueue: - BytesReceived (2m8s): 320.21 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB, 331.78 MB - DeferredQueueSize (2m8s): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 12.973us ; Min: 3.798us ; Max: 2.634ms ; Number of samples: 51335) - DeserializeRowBatchTime: 374.256ms - TotalBatchesEnqueued: 51.34K (51335) - TotalBatchesReceived: 51.34K (51335) - TotalBytesReceived: 331.78 MB (347891956) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 35.044ms - TotalRPCsDeferred: 31 (31) CodeGen:(Total: 1s375ms, non-child: 1s375ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 332 (332) - CodegenTotalWallClockTime: 1s375ms - CodegenSysTime: 12.000ms - CodegenUserTime: 704.000ms - CodegenVoluntaryContextSwitches: 31 (31) - CompileTime: 190.825ms - IrGenerationTime: 82.672ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 160 (160) - NumInstructions: 9.82K (9822) - OptimizationTime: 1s071ms - PeakMemoryUsage: 4.80 MB (5028864) - PrepareTime: 29.299ms Averaged Fragment F00:(Total: 7s137ms, non-child: 9.519ms, % non-child: 0.13%) split sizes: min: 134.88 KB, max: 179.57 KB, avg: 156.37 KB, stddev: 18.28 KB completion times: min:10s100ms max:10s255ms mean: 10s168ms stddev:65.048ms execution rates: min:13.35 KB/sec max:17.51 KB/sec mean:15.37 KB/sec stddev:1.70 KB/sec num instances: 3 - AverageThreadTokens: 1.07 - BloomFilterBytes: 0 - ExchangeScanRatio: 1921.80 - PeakMemoryUsage: 727.92 KB (745394) - PeakReservation: 213.33 KB (218453) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 863.29 MB (905225637) - RowsProduced: 40.33M (40333333) - TotalNetworkReceiveTime: 347.946ms - TotalNetworkSendTime: 1s074ms - TotalStorageWaitTime: 24.132ms - TotalThreadsInvoluntaryContextSwitches: 17.45K (17449) - TotalThreadsTotalWallClockTime: 7s504ms - TotalThreadsSysTime: 186.666ms - TotalThreadsUserTime: 4s724ms - TotalThreadsVoluntaryContextSwitches: 12.44K (12436) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s382ms - ExecTreeExecTime: 865.854ms - OpenTime: 732.299ms - ExecTreeOpenTime: 381.630ms - PrepareTime: 22.424ms - ExecTreePrepareTime: 22.300ms KrpcDataStreamSender (dst_id=22):(Total: 5s499ms, non-child: 5s499ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 120.56 KB (123456) - RowsSent: 40.33M (40333333) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1s947ms - TotalBytesSent: 334.21 MB (350441029) - UncompressedRowBatchSize: 1.39 GB (1492333333) NESTED_LOOP_JOIN_NODE (id=16):(Total: 1s278ms, non-child: 870.742ms, % non-child: 68.12%) - BuildRows: 11.00K (11000) - BuildTime: 2.912ms - PeakMemoryUsage: 339.00 KB (347136) - ProbeRows: 1.00K (1000) - ProbeTime: 0.000ns - RowsReturned: 40.33M (40333333) - RowsReturnedRate: 31.45 M/sec Nested Loop Join Builder: - PeakMemoryUsage: 308.00 KB (315392) EXCHANGE_NODE (id=21):(Total: 348.500ms, non-child: 348.500ms, % non-child: 100.00%) - ConvertRowBatchTime: 534.437us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 11.00K (11000) - RowsReturnedRate: 31.81 K/sec Buffer pool: - AllocTime: 453.895us - CumulativeAllocationBytes: 176.00 KB (180224) - CumulativeAllocations: 22 (22) - PeakReservation: 24.00 KB (24576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 438.959us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 48.162ms - TotalBytesDequeued: 150.39 KB (154000) - TotalGetBatchTime: 347.939ms - DataWaitTime: 347.916ms Enqueue: - DeserializeRowBatchTime: 3.687ms - TotalBatchesEnqueued: 11 (11) - TotalBatchesReceived: 11 (11) - TotalBytesReceived: 47.80 KB (48949) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 59.153ms, non-child: 59.153ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 178.21 KB (182491) - BytesReadDataNodeCache: 0 - BytesReadLocal: 178.21 KB (182491) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 178.21 KB (182491) - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 19.391us - MaterializeTupleTime(*): 1.744ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 7 (7) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 264.70 KB (271051) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 19.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 69.67 KB (71338) - RowBatchQueueGetWaitTime: 9.423ms - RowBatchQueuePeakMemoryUsage: 134.67 KB (137898) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 11 (11) - RowsRead: 3.67K (3666) - RowsReturned: 3.67K (3666) - RowsReturnedRate: 61.84 K/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 24.132ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 37.738ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsOpenFileTime(*): 1.695ms - TotalRawHdfsReadTime(*): 16.687ms - TotalReadThroughput: 24.33 KB/sec Buffer pool: - AllocTime: 257.158us - CumulativeAllocationBytes: 282.67 KB (289450) - CumulativeAllocations: 11 (11) - PeakReservation: 213.33 KB (218453) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 112.00 KB (114688) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 248.190us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 350.622ms, non-child: 350.622ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 52 (52) - CodegenTotalWallClockTime: 350.616ms - CodegenSysTime: 2.666ms - CodegenUserTime: 65.333ms - CodegenVoluntaryContextSwitches: 30 (30) - CompileTime: 88.239ms - IrGenerationTime: 11.237ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 194.567ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 55.698ms Fragment F00: Instance e0424d84963f6618:f987655900000005 (host=tarmstrong-box:22001):(Total: 7s675ms, non-child: 9.308ms, % non-child: 0.12%) Last report received time: 2019-11-03 17:15:44.946 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/154.66 KB Fragment Instance Lifecycle Event Timeline: 7s684ms - Prepare Finished: 33.766ms (33.766ms) - Open Finished: 759.570ms (725.804ms) - First Batch Produced: 759.597ms (26.965us) - First Batch Sent: 759.728ms (131.355us) - ExecInternal Finished: 7s684ms (6s925ms) - MemoryUsage (500.000ms): 307.56 KB, 357.56 KB, 685.56 KB, 701.56 KB, 693.56 KB, 669.56 KB, 658.56 KB, 634.56 KB, 674.56 KB, 650.56 KB, 599.56 KB, 599.56 KB, 591.56 KB, 540.56 KB, 572.56 KB, 588.56 KB - ThreadUsage (500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.06 - BloomFilterBytes: 0 - ExchangeScanRatio: 2128.78 - PeakMemoryUsage: 750.65 KB (768670) - PeakReservation: 256.00 KB (262144) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 867.04 MB (909162272) - RowsProduced: 44.00M (44000000) - TotalNetworkReceiveTime: 392.350ms - TotalNetworkSendTime: 1s307ms - TotalStorageWaitTime: 16.160ms - TotalThreadsInvoluntaryContextSwitches: 17.10K (17096) - TotalThreadsTotalWallClockTime: 8s080ms - TotalThreadsSysTime: 232.000ms - TotalThreadsUserTime: 5s076ms - TotalThreadsVoluntaryContextSwitches: 15.32K (15316) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s925ms - ExecTreeExecTime: 923.514ms - OpenTime: 725.799ms - ExecTreeOpenTime: 440.295ms - PrepareTime: 24.410ms - ExecTreePrepareTime: 24.243ms KrpcDataStreamSender (dst_id=22):(Total: 5s983ms, non-child: 4s670ms, % non-child: 78.06%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0, 1.89 MB, 16.11 MB, 42.10 MB, 70.02 MB, 97.56 MB, 124.89 MB, 152.56 MB, 178.99 MB, 206.10 MB, 233.66 MB, 260.81 MB, 294.65 MB, 326.81 MB, 362.45 MB - NetworkThroughput: (Avg: 114.32 MB/sec ; Min: 1008.36 KB/sec ; Max: 236.03 MB/sec ; Number of samples: 56412) - EosSent: 3 (3) - PeakMemoryUsage: 120.56 KB (123456) - RowsSent: 44.00M (44000000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 2s089ms - TotalBytesSent: 364.59 MB (382299620) - UncompressedRowBatchSize: 1.52 GB (1628000000) NESTED_LOOP_JOIN_NODE (id=16):(Total: 1s397ms, non-child: 940.978ms, % non-child: 67.35%) ExecOption: Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 7s684ms - Open Started: 319.265ms (319.265ms) - Open Finished: 759.557ms (440.292ms) - First Batch Requested: 759.572ms (14.305us) - First Batch Returned: 759.597ms (24.866us) - Last Batch Returned: 7s684ms (6s924ms) - Closed: 7s684ms (700.568us) - BuildRows: 11.00K (11000) - BuildTime: 299.930us - PeakMemoryUsage: 339.00 KB (347136) - ProbeRows: 1.00K (1000) - ProbeTime: 0.000ns - RowsReturned: 44.00M (44000000) - RowsReturnedRate: 31.49 M/sec Nested Loop Join Builder: - PeakMemoryUsage: 308.00 KB (315392) EXCHANGE_NODE (id=21):(Total: 392.502ms, non-child: 178.528us, % non-child: 0.05%) Node Lifecycle Event Timeline: 7s684ms - Open Started: 349.608ms (349.608ms) - Open Finished: 435.648ms (86.040ms) - First Batch Requested: 435.652ms (3.700us) - First Batch Returned: 450.985ms (15.333ms) - Last Batch Returned: 742.407ms (291.421ms) - Closed: 7s684ms (6s942ms) - ConvertRowBatchTime: 133.308us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 11.00K (11000) - RowsReturnedRate: 28.02 K/sec Buffer pool: - AllocTime: 38.849us - CumulativeAllocationBytes: 176.00 KB (180224) - CumulativeAllocations: 22 (22) - PeakReservation: 24.00 KB (24576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 25.529us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 109.38 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB - FirstBatchWaitTime: 86.033ms - TotalBytesDequeued: 150.39 KB (154000) - TotalGetBatchTime: 392.343ms - DataWaitTime: 392.324ms Enqueue: - BytesReceived (500.000ms): 0, 34.56 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 66.216us ; Min: 17.521us ; Max: 221.256us ; Number of samples: 11) - DeserializeRowBatchTime: 138.869us - TotalBatchesEnqueued: 11 (11) - TotalBatchesReceived: 11 (11) - TotalBytesReceived: 47.80 KB (48949) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 63.761ms, non-child: 63.761ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/154.66 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:4 Node Lifecycle Event Timeline: 7s684ms - Open Started: 349.610ms (349.610ms) - Open Finished: 349.683ms (72.762us) - First Batch Requested: 742.483ms (392.800ms) - First Batch Returned: 759.556ms (17.072ms) - Last Batch Returned: 7s684ms (6s924ms) - Closed: 7s684ms (690.499us) - BytesRead (500.000ms): 0, 0, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB, 175.38 KB - FooterProcessingTime: (Avg: 2.799ms ; Min: 663.915us ; Max: 5.717ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 56.00 KB (57344) ; Min: 32.00 KB (32768) ; Max: 64.00 KB (65536) ; Number of samples: 4) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 3.56 KB (3643) ; Min: 2.76 KB (2831) ; Max: 4.35 KB (4455) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 910.00 B (910) ; Min: 304.00 B (304) ; Max: 1.24 KB (1270) ; Number of samples: 8) - ParquetRowGroupActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 4) - ParquetUncompressedBytesReadPerColumn: (Avg: 3.96 KB (4058) ; Min: 3.32 KB (3399) ; Max: 4.61 KB (4718) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 1014.00 B (1014) ; Min: 629.00 B (629) ; Max: 1.24 KB (1265) ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 175.38 KB (179586) - BytesReadDataNodeCache: 0 - BytesReadLocal: 175.38 KB (179586) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 175.38 KB (179586) - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 18.816us - MaterializeTupleTime(*): 2.554ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 8 (8) - NumRowGroups: 4 (4) - NumRowGroupsWithPageIndex: 4 (4) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 306.10 KB (313442) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 15.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 76.00 KB (77824) - RowBatchQueueGetWaitTime: 9.255ms - RowBatchQueuePeakMemoryUsage: 149.00 KB (152576) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 12 (12) - RowsRead: 4.00K (4000) - RowsReturned: 4.00K (4000) - RowsReturnedRate: 62.73 K/sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 16.160ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 36.778ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsOpenFileTime(*): 2.282ms - TotalRawHdfsReadTime(*): 11.313ms - TotalReadThroughput: 21.92 KB/sec Buffer pool: - AllocTime: 24.766us - CumulativeAllocationBytes: 288.00 KB (294912) - CumulativeAllocations: 12 (12) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 144.00 KB (147456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 16.645us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 285.455ms, non-child: 285.455ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 75 (75) - CodegenTotalWallClockTime: 285.447ms - CodegenSysTime: 0.000ns - CodegenUserTime: 68.000ms - CodegenVoluntaryContextSwitches: 16 (16) - CompileTime: 52.290ms - IrGenerationTime: 24.948ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 153.125ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 54.021ms Instance e0424d84963f6618:f987655900000004 (host=tarmstrong-box:22002):(Total: 7s528ms, non-child: 5.260ms, % non-child: 0.07%) Last report received time: 2019-11-03 17:15:45.053 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/179.57 KB Fragment Instance Lifecycle Event Timeline: 7s529ms - Prepare Finished: 28.912ms (28.912ms) - Open Finished: 750.185ms (721.273ms) - First Batch Produced: 750.226ms (40.937us) - First Batch Sent: 750.357ms (131.310us) - ExecInternal Finished: 7s529ms (6s779ms) - MemoryUsage (500.000ms): 307.56 KB, 385.56 KB, 701.56 KB, 669.56 KB, 661.56 KB, 693.56 KB, 618.56 KB, 642.56 KB, 634.56 KB, 607.56 KB, 575.56 KB, 615.56 KB, 599.56 KB, 572.56 KB, 556.56 KB - ThreadUsage (500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 0 - ExchangeScanRatio: 1820.05 - PeakMemoryUsage: 758.56 KB (776764) - PeakReservation: 256.00 KB (262144) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 856.77 MB (898385124) - RowsProduced: 44.00M (44000000) - TotalNetworkReceiveTime: 318.537ms - TotalNetworkSendTime: 1s057ms - TotalStorageWaitTime: 18.428ms - TotalThreadsInvoluntaryContextSwitches: 17.94K (17944) - TotalThreadsTotalWallClockTime: 7s851ms - TotalThreadsSysTime: 188.000ms - TotalThreadsUserTime: 5s132ms - TotalThreadsVoluntaryContextSwitches: 12.66K (12660) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 6s779ms - ExecTreeExecTime: 937.410ms - OpenTime: 721.265ms - ExecTreeOpenTime: 334.127ms - PrepareTime: 28.179ms - ExecTreePrepareTime: 28.077ms KrpcDataStreamSender (dst_id=22):(Total: 5s823ms, non-child: 4s759ms, % non-child: 81.74%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0, 1.72 MB, 15.83 MB, 43.91 MB, 72.22 MB, 100.58 MB, 130.70 MB, 158.88 MB, 187.54 MB, 216.30 MB, 244.17 MB, 272.90 MB, 307.04 MB, 340.87 MB - NetworkThroughput: (Avg: 116.17 MB/sec ; Min: 1.53 MB/sec ; Max: 222.27 MB/sec ; Number of samples: 56412) - EosSent: 3 (3) - PeakMemoryUsage: 120.56 KB (123456) - RowsSent: 44.00M (44000000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 2s118ms - TotalBytesSent: 364.59 MB (382299352) - UncompressedRowBatchSize: 1.52 GB (1628000000) NESTED_LOOP_JOIN_NODE (id=16):(Total: 1s313ms, non-child: 930.902ms, % non-child: 70.89%) ExecOption: Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 7s529ms - Open Started: 416.045ms (416.045ms) - Open Finished: 750.169ms (334.124ms) - First Batch Requested: 750.187ms (17.397us) - First Batch Returned: 750.225ms (38.392us) - Last Batch Returned: 7s528ms (6s778ms) - Closed: 7s529ms (796.233us) - BuildRows: 11.00K (11000) - BuildTime: 301.081us - PeakMemoryUsage: 339.00 KB (347136) - ProbeRows: 1.00K (1000) - ProbeTime: 0.000ns - RowsReturned: 44.00M (44000000) - RowsReturnedRate: 33.51 M/sec Nested Loop Join Builder: - PeakMemoryUsage: 308.00 KB (315392) EXCHANGE_NODE (id=21):(Total: 318.690ms, non-child: 186.183us, % non-child: 0.06%) Node Lifecycle Event Timeline: 7s529ms - Open Started: 423.584ms (423.584ms) - Open Finished: 450.377ms (26.793ms) - First Batch Requested: 450.381ms (4.255us) - First Batch Returned: 451.957ms (1.575ms) - Last Batch Returned: 742.581ms (290.624ms) - Closed: 7s529ms (6s786ms) - ConvertRowBatchTime: 135.607us - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 11.00K (11000) - RowsReturnedRate: 34.52 K/sec Buffer pool: - AllocTime: 1.276ms - CumulativeAllocationBytes: 176.00 KB (180224) - CumulativeAllocations: 22 (22) - PeakReservation: 24.00 KB (24576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.259ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 123.05 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB - FirstBatchWaitTime: 26.785ms - TotalBytesDequeued: 150.39 KB (154000) - TotalGetBatchTime: 318.530ms - DataWaitTime: 318.504ms Enqueue: - BytesReceived (500.000ms): 0, 39.03 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 44.601us ; Min: 25.410us ; Max: 99.514us ; Number of samples: 11) - DeserializeRowBatchTime: 3.270ms - TotalBatchesEnqueued: 11 (11) - TotalBatchesReceived: 11 (11) - TotalBytesReceived: 47.80 KB (48949) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 63.639ms, non-child: 63.639ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/179.57 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:4 Node Lifecycle Event Timeline: 7s529ms - Open Started: 423.614ms (423.614ms) - Open Finished: 423.708ms (94.554us) - First Batch Requested: 742.667ms (318.958ms) - First Batch Returned: 750.167ms (7.500ms) - Last Batch Returned: 7s528ms (6s778ms) - Closed: 7s529ms (786.912us) - BytesRead (500.000ms): 0, 0, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB, 205.13 KB - FooterProcessingTime: (Avg: 3.252ms ; Min: 501.922us ; Max: 10.503ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 4.04 KB (4137) ; Min: 3.12 KB (3196) ; Max: 4.96 KB (5079) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 1.01 KB (1034) ; Min: 705.00 B (705) ; Max: 1.24 KB (1270) ; Number of samples: 8) - ParquetRowGroupActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 4) - ParquetUncompressedBytesReadPerColumn: (Avg: 4.27 KB (4376) ; Min: 3.61 KB (3693) ; Max: 4.94 KB (5059) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 1.07 KB (1094) ; Min: 923.00 B (923) ; Max: 1.24 KB (1265) ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 205.13 KB (210049) - BytesReadDataNodeCache: 0 - BytesReadLocal: 205.13 KB (210049) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 205.13 KB (210049) - CachedFileHandlesHitCount: 12 (12) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 22.440us - MaterializeTupleTime(*): 142.431us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 8 (8) - NumRowGroups: 4 (4) - NumRowGroupsWithPageIndex: 4 (4) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 310.00 KB (317440) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 38.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 76.00 KB (77824) - RowBatchQueueGetWaitTime: 2.434ms - RowBatchQueuePeakMemoryUsage: 149.00 KB (152576) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 12 (12) - RowsRead: 4.00K (4000) - RowsReturned: 4.00K (4000) - RowsReturnedRate: 62.85 K/sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 18.428ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 31.976ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 14 (14) - TotalRawHdfsOpenFileTime(*): 19.320us - TotalRawHdfsReadTime(*): 5.253ms - TotalReadThroughput: 27.35 KB/sec Buffer pool: - AllocTime: 22.306us - CumulativeAllocationBytes: 320.00 KB (327680) - CumulativeAllocations: 12 (12) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.236us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 387.094ms, non-child: 387.094ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 27 (27) - CodegenTotalWallClockTime: 387.086ms - CodegenSysTime: 4.000ms - CodegenUserTime: 64.000ms - CodegenVoluntaryContextSwitches: 30 (30) - CompileTime: 108.684ms - IrGenerationTime: 7.563ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 233.581ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 36.519ms Instance e0424d84963f6618:f987655900000006 (host=tarmstrong-box:22000):(Total: 6s208ms, non-child: 13.988ms, % non-child: 0.23%) Last report received time: 2019-11-03 17:15:44.897 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/134.88 KB Fragment Instance Lifecycle Event Timeline: 6s208ms - Prepare Finished: 14.872ms (14.872ms) - Open Finished: 764.716ms (749.844ms) - First Batch Produced: 764.815ms (98.329us) - First Batch Sent: 764.937ms (122.652us) - ExecInternal Finished: 6s208ms (5s443ms) - MemoryUsage (500.000ms): 307.56 KB, 385.56 KB, 634.56 KB, 618.56 KB, 634.56 KB, 674.56 KB, 599.56 KB, 583.56 KB, 599.56 KB, 524.56 KB, 572.56 KB, 540.56 KB, 588.56 KB - ThreadUsage (500.000ms): 1, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.08 - BloomFilterBytes: 0 - ExchangeScanRatio: 1816.57 - PeakMemoryUsage: 674.56 KB (690748) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 866.06 MB (908129517) - RowsProduced: 33.00M (33000000) - TotalNetworkReceiveTime: 332.951ms - TotalNetworkSendTime: 858.674ms - TotalStorageWaitTime: 37.807ms - TotalThreadsInvoluntaryContextSwitches: 17.31K (17307) - TotalThreadsTotalWallClockTime: 6s580ms - TotalThreadsSysTime: 140.000ms - TotalThreadsUserTime: 3s964ms - TotalThreadsVoluntaryContextSwitches: 9.33K (9332) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5s444ms - ExecTreeExecTime: 736.638ms - OpenTime: 749.833ms - ExecTreeOpenTime: 370.469ms - PrepareTime: 14.684ms - ExecTreePrepareTime: 14.580ms KrpcDataStreamSender (dst_id=22):(Total: 4s690ms, non-child: 3s827ms, % non-child: 81.60%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0, 2.27 MB, 16.71 MB, 45.62 MB, 73.88 MB, 103.05 MB, 130.16 MB, 157.84 MB, 187.16 MB, 214.75 MB, 243.30 MB, 271.23 MB - NetworkThroughput: (Avg: 112.34 MB/sec ; Min: 449.61 KB/sec ; Max: 232.17 MB/sec ; Number of samples: 42309) - EosSent: 3 (3) - PeakMemoryUsage: 120.56 KB (123456) - RowsSent: 33.00M (33000000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1s635ms - TotalBytesSent: 273.44 MB (286724115) - UncompressedRowBatchSize: 1.14 GB (1221000000) NESTED_LOOP_JOIN_NODE (id=16):(Total: 1s124ms, non-child: 740.345ms, % non-child: 65.83%) ExecOption: Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 6s208ms - Open Started: 394.233ms (394.233ms) - Open Finished: 764.699ms (370.466ms) - First Batch Requested: 764.718ms (18.897us) - First Batch Returned: 764.814ms (96.117us) - Last Batch Returned: 6s208ms (5s443ms) - Closed: 6s208ms (789.233us) - BuildRows: 11.00K (11000) - BuildTime: 8.135ms - PeakMemoryUsage: 339.00 KB (347136) - ProbeRows: 1.00K (1000) - ProbeTime: 0.000ns - RowsReturned: 33.00M (33000000) - RowsReturnedRate: 29.34 M/sec Nested Loop Join Builder: - PeakMemoryUsage: 308.00 KB (315392) EXCHANGE_NODE (id=21):(Total: 334.306ms, non-child: 1.386ms, % non-child: 0.41%) Node Lifecycle Event Timeline: 6s208ms - Open Started: 401.156ms (401.156ms) - Open Finished: 432.830ms (31.673ms) - First Batch Requested: 432.834ms (4.120us) - First Batch Returned: 449.632ms (16.798ms) - Last Batch Returned: 743.607ms (293.974ms) - Closed: 6s208ms (5s465ms) - ConvertRowBatchTime: 1.334ms - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 11.00K (11000) - RowsReturnedRate: 32.90 K/sec Buffer pool: - AllocTime: 46.790us - CumulativeAllocationBytes: 176.00 KB (180224) - CumulativeAllocations: 22 (22) - PeakReservation: 24.00 KB (24576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 32.217us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 123.05 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB, 150.39 KB - FirstBatchWaitTime: 31.668ms - TotalBytesDequeued: 150.39 KB (154000) - TotalGetBatchTime: 332.943ms - DataWaitTime: 332.920ms Enqueue: - BytesReceived (500.000ms): 0, 39.03 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB, 47.80 KB - DeferredQueueSize (500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - DispatchTime: (Avg: 56.469us ; Min: 24.323us ; Max: 189.843us ; Number of samples: 11) - DeserializeRowBatchTime: 7.653ms - TotalBatchesEnqueued: 11 (11) - TotalBatchesReceived: 11 (11) - TotalBytesReceived: 47.80 KB (48949) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=1):(Total: 50.060ms, non-child: 50.060ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/134.88 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 6s208ms - Open Started: 401.157ms (401.157ms) - Open Finished: 401.242ms (84.646us) - First Batch Requested: 743.664ms (342.421ms) - First Batch Returned: 764.698ms (21.034ms) - Last Batch Returned: 6s208ms (5s443ms) - Closed: 6s208ms (777.292us) - BytesRead (500.000ms): 0, 0, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB, 154.14 KB - FooterProcessingTime: (Avg: 10.142ms ; Min: 5.268ms ; Max: 17.405ms ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 3.08 KB (3150) ; Min: 2.43 KB (2490) ; Max: 3.72 KB (3810) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 1.03 KB (1050) ; Min: 772.00 B (772) ; Max: 1.24 KB (1270) ; Number of samples: 6) - ParquetRowGroupActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 3.21 KB (3283) ; Min: 2.71 KB (2771) ; Max: 3.71 KB (3795) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 1.07 KB (1094) ; Min: 923.00 B (923) ; Max: 1.24 KB (1265) ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 154.14 KB (157838) - BytesReadDataNodeCache: 0 - BytesReadLocal: 154.14 KB (157838) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 154.14 KB (157838) - CachedFileHandlesHitCount: 8 (8) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 16.919us - MaterializeTupleTime(*): 2.537ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 6 (6) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 178.00 KB (182272) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 4.49 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 57.00 KB (58368) - RowBatchQueueGetWaitTime: 16.582ms - RowBatchQueuePeakMemoryUsage: 106.00 KB (108544) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 9 (9) - RowsRead: 3.00K (3000) - RowsReturned: 3.00K (3000) - RowsReturnedRate: 59.93 K/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 37.807ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 44.460ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 13 (13) - TotalRawHdfsOpenFileTime(*): 2.783ms - TotalRawHdfsReadTime(*): 33.495ms - TotalReadThroughput: 23.71 KB/sec Buffer pool: - AllocTime: 724.402us - CumulativeAllocationBytes: 240.00 KB (245760) - CumulativeAllocations: 9 (9) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 64.00 KB (65536) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 716.691us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 379.319ms, non-child: 379.319ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 56 (56) - CodegenTotalWallClockTime: 379.313ms - CodegenSysTime: 4.000ms - CodegenUserTime: 64.000ms - CodegenVoluntaryContextSwitches: 45 (45) - CompileTime: 103.743ms - IrGenerationTime: 1.201ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 196.996ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 76.556ms Averaged Fragment F01:(Total: 620.076ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 134.88 KB, max: 179.57 KB, avg: 156.37 KB, stddev: 18.28 KB completion times: min:5s097ms max:5s253ms mean: 5s165ms stddev:65.459ms execution rates: min:26.46 KB/sec max:34.18 KB/sec mean:30.23 KB/sec stddev:3.15 KB/sec num instances: 3 - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.30 - PeakMemoryUsage: 240.92 KB (246698) - PeakReservation: 149.33 KB (152917) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.49 MB (581426979) - RowsProduced: 3.67K (3666) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7.801ms - TotalStorageWaitTime: 625.361ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 1s252ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 25.333ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 507.543ms - ExecTreeExecTime: 499.421ms - OpenTime: 96.869ms - ExecTreeOpenTime: 282.784us - PrepareTime: 15.644ms - ExecTreePrepareTime: 15.517ms KrpcDataStreamSender (dst_id=21):(Total: 8.152ms, non-child: 8.152ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 63.98 KB (65520) - RowsSent: 3.67K (3666) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 138.366us - TotalBytesSent: 47.80 KB (48949) - UncompressedRowBatchSize: 150.39 KB (154000) HDFS_SCAN_NODE (id=0):(Total: 530.702ms, non-child: 530.702ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 1.33 - AverageScannerThreadConcurrency: 1.33 - BytesRead: 157.62 KB (161399) - BytesReadDataNodeCache: 0 - BytesReadLocal: 157.62 KB (161399) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 157.62 KB (161399) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 3 (3) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 19.309us - MaterializeTupleTime(*): 136.864us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 3 (3) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 168.67 KB (172714) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 458.29 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 36.67 KB (37546) - RowBatchQueueGetWaitTime: 478.602ms - RowBatchQueuePeakMemoryUsage: 34.00 KB (34816) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 11 (11) - RowsRead: 3.67K (3666) - RowsReturned: 3.67K (3666) - RowsReturnedRate: 7.25 K/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 625.361ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 647.681ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsOpenFileTime(*): 216.113ms - TotalRawHdfsReadTime(*): 412.580ms - TotalReadThroughput: 15.17 KB/sec Buffer pool: - AllocTime: 527.218us - CumulativeAllocationBytes: 253.33 KB (259413) - CumulativeAllocations: 7 (7) - PeakReservation: 149.33 KB (152917) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 88.00 KB (90112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 517.850us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 96.540ms, non-child: 96.540ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 13 (13) - CodegenTotalWallClockTime: 96.534ms - CodegenSysTime: 4.000ms - CodegenUserTime: 25.333ms - CodegenVoluntaryContextSwitches: 14 (14) - CompileTime: 33.548ms - IrGenerationTime: 577.583us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 18.780ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 42.725ms Fragment F01: Instance e0424d84963f6618:f987655900000003 (host=tarmstrong-box:22000):(Total: 743.698ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.894 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/134.88 KB Fragment Instance Lifecycle Event Timeline: 744.086ms - Prepare Finished: 14.717ms (14.717ms) - Open Finished: 131.079ms (116.361ms) - First Batch Produced: 656.403ms (525.324ms) - First Batch Sent: 656.465ms (61.553us) - ExecInternal Finished: 744.086ms (87.621ms) - MemoryUsage (500.000ms): 144.25 KB, 144.25 KB - ThreadUsage (500.000ms): 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.29 - PeakMemoryUsage: 204.25 KB (209152) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 3.00K (3000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 889.764us - TotalStorageWaitTime: 567.161ms - TotalThreadsInvoluntaryContextSwitches: 24 (24) - TotalThreadsTotalWallClockTime: 1s333ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 32.000ms - TotalThreadsVoluntaryContextSwitches: 53 (53) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 612.858ms - ExecTreeExecTime: 611.660ms - OpenTime: 116.358ms - ExecTreeOpenTime: 85.813us - PrepareTime: 14.462ms - ExecTreePrepareTime: 14.365ms KrpcDataStreamSender (dst_id=21):(Total: 1.217ms, non-child: 325.688us, % non-child: 26.75%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 8.92 KB - NetworkThroughput: (Avg: 11.77 MB/sec ; Min: 325.75 KB/sec ; Max: 21.76 MB/sec ; Number of samples: 9) - EosSent: 3 (3) - PeakMemoryUsage: 63.98 KB (65520) - RowsSent: 3.00K (3000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 158.742us - TotalBytesSent: 39.71 KB (40665) - UncompressedRowBatchSize: 123.05 KB (126000) HDFS_SCAN_NODE (id=0):(Total: 640.428ms, non-child: 640.428ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/134.88 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:3 Node Lifecycle Event Timeline: 743.982ms - Open Started: 130.987ms (130.987ms) - Open Finished: 131.071ms (83.563us) - First Batch Requested: 131.081ms (10.010us) - First Batch Returned: 656.402ms (525.321ms) - Last Batch Returned: 743.012ms (86.609ms) - Closed: 743.982ms (969.643us) - BytesRead (500.000ms): 0, 45.51 KB - FooterProcessingTime: (Avg: 181.694ms ; Min: 17.527ms ; Max: 483.473ms ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 918.00 B (918) ; Min: 918.00 B (918) ; Max: 918.00 B (918) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 306.00 B (306) ; Min: 207.00 B (207) ; Max: 359.00 B (359) ; Number of samples: 3) - ParquetRowGroupActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 3) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.85 KB (1897) ; Min: 1.85 KB (1897) ; Max: 1.85 KB (1897) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 632.00 B (632) ; Min: 628.00 B (628) ; Max: 637.00 B (637) ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 135.98 KB (139247) - BytesReadDataNodeCache: 0 - BytesReadLocal: 135.98 KB (139247) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 135.98 KB (139247) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 3 (3) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 12.191us - MaterializeTupleTime(*): 73.569us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 3 (3) - NumRowGroups: 3 (3) - NumRowGroupsWithPageIndex: 3 (3) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 132.00 KB (135168) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 343.39 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 30.00 KB (30720) - RowBatchQueueGetWaitTime: 599.394ms - RowBatchQueuePeakMemoryUsage: 34.00 KB (34816) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 9 (9) - RowsRead: 3.00K (3000) - RowsReturned: 3.00K (3000) - RowsReturnedRate: 4.68 K/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 567.161ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 604.345ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsOpenFileTime(*): 185.189ms - TotalRawHdfsReadTime(*): 395.996ms - TotalReadThroughput: 45.51 KB/sec Buffer pool: - AllocTime: 1.489ms - CumulativeAllocationBytes: 216.00 KB (221184) - CumulativeAllocations: 6 (6) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 64.00 KB (65536) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.482ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 116.224ms, non-child: 116.224ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 20 (20) - CodegenTotalWallClockTime: 116.217ms - CodegenSysTime: 0.000ns - CodegenUserTime: 32.000ms - CodegenVoluntaryContextSwitches: 26 (26) - CompileTime: 14.003ms - IrGenerationTime: 1.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 15.743ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 83.948ms Instance e0424d84963f6618:f987655900000001 (host=tarmstrong-box:22002):(Total: 634.759ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:40.052 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/179.57 KB Fragment Instance Lifecycle Event Timeline: 680.156ms - Prepare Finished: 25.642ms (25.642ms) - Open Finished: 119.840ms (94.198ms) - First Batch Produced: 598.241ms (478.400ms) - First Batch Sent: 598.319ms (77.400us) - ExecInternal Finished: 680.156ms (81.837ms) - MemoryUsage (500.000ms): 212.25 KB - ThreadUsage (500.000ms): 3 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.29 - PeakMemoryUsage: 272.25 KB (278784) - PeakReservation: 192.00 KB (196608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.94 MB (590287648) - RowsProduced: 4.00K (4000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18.459ms - TotalStorageWaitTime: 936.636ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 1s588ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 24.000ms - TotalThreadsVoluntaryContextSwitches: 40 (40) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 530.087ms - ExecTreeExecTime: 511.282ms - OpenTime: 94.193ms - ExecTreeOpenTime: 669.675us - PrepareTime: 10.458ms - ExecTreePrepareTime: 10.292ms KrpcDataStreamSender (dst_id=21):(Total: 18.865ms, non-child: 403.668us, % non-child: 2.14%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 13.75 MB/sec ; Min: 346.43 KB/sec ; Max: 33.56 MB/sec ; Number of samples: 12) - EosSent: 3 (3) - PeakMemoryUsage: 63.98 KB (65520) - RowsSent: 4.00K (4000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 127.043us - TotalBytesSent: 51.93 KB (53181) - UncompressedRowBatchSize: 164.06 KB (168000) HDFS_SCAN_NODE (id=0):(Total: 532.501ms, non-child: 532.501ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/179.57 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:100% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:4 Node Lifecycle Event Timeline: 650.026ms - Open Started: 119.162ms (119.162ms) - Open Finished: 119.829ms (667.254us) - First Batch Requested: 119.843ms (14.469us) - First Batch Returned: 598.240ms (478.397ms) - Last Batch Returned: 644.872ms (46.631ms) - Closed: 650.026ms (5.153ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 223.873ms ; Min: 9.051ms ; Max: 441.120ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.11 KB (1132) ; Min: 1.11 KB (1132) ; Max: 1.11 KB (1132) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 283.00 B (283) ; Min: 240.00 B (240) ; Max: 345.00 B (345) ; Number of samples: 4) - ParquetRowGroupActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 4) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.46 KB (2517) ; Min: 2.46 KB (2517) ; Max: 2.46 KB (2517) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 629.00 B (629) ; Min: 628.00 B (628) ; Max: 631.00 B (631) ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 180.95 KB (185294) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.95 KB (185294) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.95 KB (185294) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 4 (4) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 26.011us - MaterializeTupleTime(*): 101.160us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 4 (4) - NumRowGroups: 4 (4) - NumRowGroupsWithPageIndex: 4 (4) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 200.00 KB (204800) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 286.05 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 40.00 KB (40960) - RowBatchQueueGetWaitTime: 475.979ms - RowBatchQueuePeakMemoryUsage: 34.00 KB (34816) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 12 (12) - RowsRead: 4.00K (4000) - RowsReturned: 4.00K (4000) - RowsReturnedRate: 7.51 K/sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 936.636ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 964.595ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsOpenFileTime(*): 304.508ms - TotalRawHdfsReadTime(*): 632.584ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 50.253us - CumulativeAllocationBytes: 288.00 KB (294912) - CumulativeAllocations: 8 (8) - PeakReservation: 192.00 KB (196608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 40.756us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 93.476ms, non-child: 93.476ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 7 (7) - CodegenTotalWallClockTime: 93.470ms - CodegenSysTime: 4.000ms - CodegenUserTime: 24.000ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 51.745ms - IrGenerationTime: 336.502us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 15.221ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 25.514ms Instance e0424d84963f6618:f987655900000002 (host=tarmstrong-box:22001):(Total: 481.770ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.944 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/154.66 KB Fragment Instance Lifecycle Event Timeline: 491.316ms - Prepare Finished: 31.420ms (31.420ms) - Open Finished: 111.478ms (80.058ms) - First Batch Produced: 424.034ms (312.555ms) - First Batch Sent: 424.098ms (64.436us) - ExecInternal Finished: 491.316ms (67.218ms) - MemoryUsage (500.000ms): 144.25 KB - ThreadUsage (500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.33 - PeakMemoryUsage: 246.25 KB (252160) - PeakReservation: 128.00 KB (131072) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.42 MB (582398752) - RowsProduced: 4.00K (4000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.056ms - TotalStorageWaitTime: 372.287ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 833.830ms - TotalThreadsSysTime: 8.000ms - TotalThreadsUserTime: 20.000ms - TotalThreadsVoluntaryContextSwitches: 29 (29) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 379.684ms - ExecTreeExecTime: 375.322ms - OpenTime: 80.054ms - ExecTreeOpenTime: 92.865us - PrepareTime: 22.011ms - ExecTreePrepareTime: 21.893ms KrpcDataStreamSender (dst_id=21):(Total: 4.375ms, non-child: 315.614us, % non-child: 7.21%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 6.68 MB/sec ; Min: 167.28 KB/sec ; Max: 21.76 MB/sec ; Number of samples: 12) - EosSent: 3 (3) - PeakMemoryUsage: 63.98 KB (65520) - RowsSent: 4.00K (4000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 129.315us - TotalBytesSent: 51.76 KB (53001) - UncompressedRowBatchSize: 164.06 KB (168000) HDFS_SCAN_NODE (id=0):(Total: 419.176ms, non-child: 419.176ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/154.66 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:4 Node Lifecycle Event Timeline: 491.212ms - Open Started: 111.379ms (111.379ms) - Open Finished: 111.470ms (90.646us) - First Batch Requested: 111.480ms (10.345us) - First Batch Returned: 424.032ms (312.552ms) - Last Batch Returned: 489.830ms (65.797ms) - Closed: 491.212ms (1.381ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 84.962ms ; Min: 10.979ms ; Max: 292.678ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 56.00 KB (57344) ; Min: 32.00 KB (32768) ; Max: 64.00 KB (65536) ; Number of samples: 4) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.02 KB (1041) ; Min: 1.02 KB (1041) ; Max: 1.02 KB (1041) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 260.00 B (260) ; Min: 9.00 B (9) ; Max: 437.00 B (437) ; Number of samples: 4) - ParquetRowGroupActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 4) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.87 KB (1913) ; Min: 1.87 KB (1913) ; Max: 1.87 KB (1913) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 478.00 B (478) ; Min: 7.00 B (7) ; Max: 637.00 B (637) ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 155.91 KB (159656) - BytesReadDataNodeCache: 0 - BytesReadLocal: 155.91 KB (159656) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 155.91 KB (159656) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 4 (4) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 19.725us - MaterializeTupleTime(*): 235.863us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 4 (4) - NumRowGroups: 4 (4) - NumRowGroupsWithPageIndex: 4 (4) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 174.00 KB (178176) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 745.43 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 40.00 KB (40960) - RowBatchQueueGetWaitTime: 360.433ms - RowBatchQueuePeakMemoryUsage: 34.00 KB (34816) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 12 (12) - RowsRead: 4.00K (4000) - RowsReturned: 4.00K (4000) - RowsReturnedRate: 9.54 K/sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 372.287ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 374.101ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsOpenFileTime(*): 158.643ms - TotalRawHdfsReadTime(*): 209.160ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 41.435us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 8 (8) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 72.00 KB (73728) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 30.460us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 79.920ms, non-child: 79.920ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 12 (12) - CodegenTotalWallClockTime: 79.914ms - CodegenSysTime: 8.000ms - CodegenUserTime: 20.000ms - CodegenVoluntaryContextSwitches: 6 (6) - CompileTime: 34.897ms - IrGenerationTime: 316.522us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 4 (4) - NumInstructions: 102 (102) - OptimizationTime: 25.378ms - PeakMemoryUsage: 51.00 KB (52224) - PrepareTime: 18.712ms Averaged Fragment F02:(Total: 571.253ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.92 KB, max: 5.83 KB, avg: 3.89 KB, stddev: 1.38 KB completion times: min:5s097ms max:5s253ms mean: 5s165ms stddev:65.096ms execution rates: min:580.00 B/sec max:1.11 KB/sec mean:767.33 B/sec stddev:261.21 B/sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 268.33 KB (274768) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.39 MB (581317752) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 15.966ms - TotalStorageWaitTime: 215.854ms - TotalThreadsInvoluntaryContextSwitches: 66 (66) - TotalThreadsTotalWallClockTime: 791.588ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 65.333ms - TotalThreadsVoluntaryContextSwitches: 43 (43) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 260.034ms - ExecTreeExecTime: 243.994ms - OpenTime: 298.600ms - ExecTreeOpenTime: 78.146us - PrepareTime: 12.599ms - ExecTreePrepareTime: 12.428ms KrpcDataStreamSender (dst_id=23):(Total: 16.069ms, non-child: 16.069ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 29.33 KB (30032) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 7.474us - TotalBytesSent: 46.00 B (46) - UncompressedRowBatchSize: 69.00 B (69) HDFS_SCAN_NODE (id=2):(Total: 268.902ms, non-child: 268.902ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.10 KB (4197) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.10 KB (4197) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.10 KB (4197) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 7.420us - MaterializeTupleTime(*): 33.690us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 4 (4) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.00 KB (88064) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 21.66 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 29.33 KB (30037) - RowBatchQueueGetWaitTime: 230.484ms - RowBatchQueuePeakMemoryUsage: 46.00 KB (47104) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 9.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 215.854ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 232.960ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 26.484ms - TotalRawHdfsReadTime(*): 197.769ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 19.372us - CumulativeAllocationBytes: 42.67 KB (43690) - CumulativeAllocations: 5 (5) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 15.165us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 298.478ms, non-child: 298.478ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 63 (63) - CodegenTotalWallClockTime: 298.470ms - CodegenSysTime: 0.000ns - CodegenUserTime: 64.000ms - CodegenVoluntaryContextSwitches: 28 (28) - CompileTime: 65.306ms - IrGenerationTime: 1.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 193.956ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 37.187ms Fragment F02: Instance e0424d84963f6618:f987655900000009 (host=tarmstrong-box:22000):(Total: 670.539ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.895 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB Fragment Instance Lifecycle Event Timeline: 692.693ms - Prepare Finished: 14.729ms (14.729ms) - Open Finished: 337.176ms (322.446ms) - First Batch Produced: 649.813ms (312.637ms) - First Batch Sent: 649.818ms (4.673us) - ExecInternal Finished: 692.693ms (42.874ms) - MemoryUsage (500.000ms): 268.33 KB, 62.36 KB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 268.33 KB (274768) - PeakReservation: 24.00 KB (24576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 20.972ms - TotalStorageWaitTime: 260.902ms - TotalThreadsInvoluntaryContextSwitches: 61 (61) - TotalThreadsTotalWallClockTime: 960.240ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 68.000ms - TotalThreadsVoluntaryContextSwitches: 67 (67) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 333.719ms - ExecTreeExecTime: 312.677ms - OpenTime: 322.441ms - ExecTreeOpenTime: 74.675us - PrepareTime: 14.360ms - ExecTreePrepareTime: 14.053ms KrpcDataStreamSender (dst_id=23):(Total: 21.073ms, non-child: 98.949us, % non-child: 0.47%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 88.98 KB/sec ; Min: 1.41 KB/sec ; Max: 176.56 KB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 29.33 KB (30032) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 6.357us - TotalBytesSent: 39.00 B (39) - UncompressedRowBatchSize: 52.00 B (52) HDFS_SCAN_NODE (id=2):(Total: 340.819ms, non-child: 340.819ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 670.926ms - Open Started: 337.094ms (337.094ms) - Open Finished: 337.166ms (72.488us) - First Batch Requested: 337.177ms (10.851us) - First Batch Returned: 649.812ms (312.634ms) - Last Batch Returned: 649.860ms (48.261us) - Closed: 670.926ms (21.065ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 259.779ms ; Min: 259.779ms ; Max: 259.779ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 3) - ParquetRowGroupActualReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.07 KB (3148) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.07 KB (3148) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.07 KB (3148) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 6.027us - MaterializeTupleTime(*): 21.637us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 3 (3) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.00 KB (88064) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 12.53 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 22.00 KB (22528) - RowBatchQueueGetWaitTime: 303.008ms - RowBatchQueuePeakMemoryUsage: 46.00 KB (47104) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 5.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 260.902ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 304.086ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsOpenFileTime(*): 52.225ms - TotalRawHdfsReadTime(*): 245.293ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 16.819us - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - PeakReservation: 24.00 KB (24576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 13.238us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 322.331ms, non-child: 322.331ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 57 (57) - CodegenTotalWallClockTime: 322.324ms - CodegenSysTime: 0.000ns - CodegenUserTime: 68.000ms - CodegenVoluntaryContextSwitches: 48 (48) - CompileTime: 94.806ms - IrGenerationTime: 1.483ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 179.921ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 45.244ms Instance e0424d84963f6618:f987655900000007 (host=tarmstrong-box:22002):(Total: 602.057ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:40.051 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/5.83 KB Fragment Instance Lifecycle Event Timeline: 679.944ms - Prepare Finished: 28.857ms (28.857ms) - Open Finished: 362.347ms (333.490ms) - First Batch Produced: 606.371ms (244.023ms) - First Batch Sent: 606.375ms (4.585us) - ExecInternal Finished: 679.944ms (73.568ms) - MemoryUsage (500.000ms): 268.33 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 268.33 KB (274768) - PeakReservation: 48.00 KB (49152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.69 MB (590025504) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.413ms - TotalStorageWaitTime: 252.831ms - TotalThreadsInvoluntaryContextSwitches: 66 (66) - TotalThreadsTotalWallClockTime: 861.965ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.000ms - TotalThreadsVoluntaryContextSwitches: 48 (48) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 267.873ms - ExecTreeExecTime: 266.384ms - OpenTime: 333.486ms - ExecTreeOpenTime: 78.597us - PrepareTime: 676.409us - ExecTreePrepareTime: 579.962us KrpcDataStreamSender (dst_id=23):(Total: 1.517ms, non-child: 103.080us, % non-child: 6.79%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 340.37 KB/sec ; Min: 304.29 KB/sec ; Max: 376.44 KB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 29.33 KB (30032) - RowsSent: 4 (4) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 7.587us - TotalBytesSent: 62.00 B (62) - UncompressedRowBatchSize: 104.00 B (104) HDFS_SCAN_NODE (id=2):(Total: 267.598ms, non-child: 267.598ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/5.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 630.266ms - Open Started: 362.262ms (362.262ms) - Open Finished: 362.338ms (76.452us) - First Batch Requested: 362.349ms (10.493us) - First Batch Returned: 606.370ms (244.020ms) - Last Batch Returned: 628.743ms (22.373ms) - Closed: 630.266ms (1.523ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 117.360ms ; Min: 19.678ms ; Max: 215.043ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 22.00 B (22) ; Min: 22.00 B (22) ; Max: 22.00 B (22) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 6) - ParquetRowGroupActualReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 18.00 B (18) ; Min: 18.00 B (18) ; Max: 18.00 B (18) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 6) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 6.15 KB (6296) - BytesReadDataNodeCache: 0 - BytesReadLocal: 6.15 KB (6296) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 6.15 KB (6296) - CachedFileHandlesHitCount: 5 (5) - CachedFileHandlesMissCount: 3 (3) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 10.271us - MaterializeTupleTime(*): 53.531us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 6 (6) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.00 KB (88064) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 27.12 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 44.00 KB (45056) - RowBatchQueueGetWaitTime: 254.244ms - RowBatchQueuePeakMemoryUsage: 46.00 KB (47104) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 6 (6) - RowsRead: 4 (4) - RowsReturned: 4 (4) - RowsReturnedRate: 14.00 /sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 252.831ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 260.613ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsOpenFileTime(*): 24.386ms - TotalRawHdfsReadTime(*): 226.678ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 21.001us - CumulativeAllocationBytes: 64.00 KB (65536) - CumulativeAllocations: 8 (8) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 14.992us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 333.360ms, non-child: 333.360ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 62 (62) - CodegenTotalWallClockTime: 333.353ms - CodegenSysTime: 0.000ns - CodegenUserTime: 64.000ms - CodegenVoluntaryContextSwitches: 33 (33) - CompileTime: 31.790ms - IrGenerationTime: 1.193ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 251.472ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 48.163ms Instance e0424d84963f6618:f987655900000008 (host=tarmstrong-box:22001):(Total: 441.164ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.944 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB Fragment Instance Lifecycle Event Timeline: 489.103ms - Prepare Finished: 37.278ms (37.278ms) - Open Finished: 277.156ms (239.878ms) - First Batch Produced: 430.040ms (152.883ms) - First Batch Sent: 430.044ms (4.552us) - ExecInternal Finished: 489.103ms (59.058ms) - MemoryUsage (500.000ms): 268.33 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 268.33 KB (274768) - PeakReservation: 24.00 KB (24576) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.36 MB (582333216) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.514ms - TotalStorageWaitTime: 133.830ms - TotalThreadsInvoluntaryContextSwitches: 73 (73) - TotalThreadsTotalWallClockTime: 552.559ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.000ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 178.510ms - ExecTreeExecTime: 152.921ms - OpenTime: 239.874ms - ExecTreeOpenTime: 81.168us - PrepareTime: 22.760ms - ExecTreePrepareTime: 22.652ms KrpcDataStreamSender (dst_id=23):(Total: 25.616ms, non-child: 101.032us, % non-child: 0.39%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 195.11 KB/sec ; Min: 169.88 KB/sec ; Max: 220.35 KB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 29.33 KB (30032) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 8.478us - TotalBytesSent: 39.00 B (39) - UncompressedRowBatchSize: 52.00 B (52) HDFS_SCAN_NODE (id=2):(Total: 198.289ms, non-child: 198.289ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 455.713ms - Open Started: 277.069ms (277.069ms) - Open Finished: 277.148ms (78.364us) - First Batch Requested: 277.158ms (10.031us) - First Batch Returned: 430.038ms (152.880ms) - Last Batch Returned: 430.084ms (46.203us) - Closed: 455.713ms (25.628ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 123.865ms ; Min: 123.865ms ; Max: 123.865ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 3) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 3) - ParquetRowGroupActualReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 24.00 KB (24576) ; Min: 24.00 KB (24576) ; Max: 24.00 KB (24576) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 3) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 3) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.07 KB (3148) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.07 KB (3148) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.07 KB (3148) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 5.964us - MaterializeTupleTime(*): 25.902us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 3 (3) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.00 KB (88064) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 25.34 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 22.00 KB (22528) - RowBatchQueueGetWaitTime: 134.200ms - RowBatchQueuePeakMemoryUsage: 46.00 KB (47104) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 10.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 133.830ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 134.182ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsOpenFileTime(*): 2.843ms - TotalRawHdfsReadTime(*): 121.336ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 20.297us - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - PeakReservation: 24.00 KB (24576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 24.00 KB (24576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 17.267us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 239.742ms, non-child: 239.742ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 71 (71) - CodegenTotalWallClockTime: 239.734ms - CodegenSysTime: 0.000ns - CodegenUserTime: 60.000ms - CodegenVoluntaryContextSwitches: 5 (5) - CompileTime: 69.321ms - IrGenerationTime: 1.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 19 (19) - NumInstructions: 478 (478) - OptimizationTime: 150.474ms - PeakMemoryUsage: 239.00 KB (244736) - PrepareTime: 18.153ms Averaged Fragment F06:(Total: 852.351ms, non-child: 1.506ms, % non-child: 0.18%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s097ms max:5s253ms mean: 5s165ms stddev:65.161ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 2.16 MB (2261483) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.39 MB (581317752) - RowsProduced: 2.43K (2433) - TotalNetworkReceiveTime: 27.692ms - TotalNetworkSendTime: 1.333ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 198 (198) - TotalThreadsTotalWallClockTime: 872.259ms - TotalThreadsSysTime: 5.333ms - TotalThreadsUserTime: 230.666ms - TotalThreadsVoluntaryContextSwitches: 42 (42) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 8.292ms - ExecTreeExecTime: 6.652ms - OpenTime: 842.383ms - ExecTreeOpenTime: 21.790ms - PrepareTime: 267.052us - ExecTreePrepareTime: 121.959us KrpcDataStreamSender (dst_id=26):(Total: 1.662ms, non-child: 1.662ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 33.38 KB (34176) - RowsSent: 2.43K (2433) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 104.041us - TotalBytesSent: 64.61 KB (66161) - UncompressedRowBatchSize: 213.87 KB (219000) HASH_JOIN_NODE (id=5):(Total: 28.644ms, non-child: 888.175us, % non-child: 3.10%) - BuildRows: 2.43K (2433) - BuildTime: 375.038us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.97 MB (2069418) - ProbeRows: 2.43K (2433) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 37.896us - RowsReturned: 2.43K (2433) - RowsReturnedRate: 1.12 M/sec Buffer pool: - AllocTime: 12.576us - CumulativeAllocationBytes: 213.33 KB (218453) - CumulativeAllocations: 2 (2) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 213.33 KB (218453) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.260us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=5): - BuildRowsPartitionTime: 62.446us - BuildRowsPartitioned: 2.43K (2433) - HashTablesBuildTime: 129.705us - LargestPartitionPercent: 16 (16) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.79 KB (12074) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 5.46K (5461) - HashCollisions: 0 (0) - Probes: 2.64K (2640) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=25):(Total: 21.140ms, non-child: 21.140ms, % non-child: 100.00%) - ConvertRowBatchTime: 26.152us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 2.43K (2433) - RowsReturnedRate: 25.62 M/sec Buffer pool: - AllocTime: 11.394us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 4 (4) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.957us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 21.105ms - TotalBytesDequeued: 40.40 KB (41366) - TotalGetBatchTime: 21.108ms - DataWaitTime: 21.105ms Enqueue: - DeserializeRowBatchTime: 1.242ms - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 19.07 KB (19526) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=24):(Total: 6.616ms, non-child: 6.616ms, % non-child: 100.00%) - ConvertRowBatchTime: 27.616us - PeakMemoryUsage: 82.67 KB (84650) - RowsReturned: 2.43K (2433) - RowsReturnedRate: 35.80 M/sec Buffer pool: - AllocTime: 18.822us - CumulativeAllocationBytes: 90.67 KB (92842) - CumulativeAllocations: 7 (7) - PeakReservation: 82.67 KB (84650) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 82.67 KB (84650) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 15.287us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 52.28 KB (53533) - TotalGetBatchTime: 6.581ms - DataWaitTime: 6.576ms Enqueue: - DeserializeRowBatchTime: 56.790us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 11.98 KB (12272) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 820.538ms, non-child: 820.538ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 194 (194) - CodegenTotalWallClockTime: 820.531ms - CodegenSysTime: 5.333ms - CodegenUserTime: 230.666ms - CodegenVoluntaryContextSwitches: 32 (32) - CompileTime: 134.243ms - IrGenerationTime: 36.680ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 50 (50) - NumInstructions: 2.66K (2661) - OptimizationTime: 572.561ms - PeakMemoryUsage: 1.30 MB (1362432) - PrepareTime: 69.472ms Fragment F06: Instance e0424d84963f6618:f987655900000012 (host=tarmstrong-box:22000):(Total: 906.979ms, non-child: 199.987us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.894 Fragment Instance Lifecycle Event Timeline: 907.671ms - Prepare Finished: 816.651us (816.651us) - Open Finished: 906.334ms (905.517ms) - First Batch Produced: 906.357ms (23.027us) - First Batch Sent: 906.424ms (67.407us) - ExecInternal Finished: 907.671ms (1.247ms) - MemoryUsage (500.000ms): 1.38 MB, 1.43 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 2.22 MB (2329750) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 1.22K (1220) - TotalNetworkReceiveTime: 13.009us - TotalNetworkSendTime: 580.114us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 273 (273) - TotalThreadsTotalWallClockTime: 907.544ms - TotalThreadsSysTime: 12.000ms - TotalThreadsUserTime: 228.000ms - TotalThreadsVoluntaryContextSwitches: 54 (54) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1.084ms - ExecTreeExecTime: 48.922us - OpenTime: 905.512ms - ExecTreeOpenTime: 1.106ms - PrepareTime: 362.543us - ExecTreePrepareTime: 142.002us KrpcDataStreamSender (dst_id=26):(Total: 1.062ms, non-child: 481.408us, % non-child: 45.30%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 36.98 MB/sec ; Min: 17.38 MB/sec ; Max: 73.29 MB/sec ; Number of samples: 6) - EosSent: 3 (3) - PeakMemoryUsage: 33.38 KB (34176) - RowsSent: 1.22K (1220) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 55.570us - TotalBytesSent: 31.98 KB (32751) - UncompressedRowBatchSize: 107.23 KB (109800) HASH_JOIN_NODE (id=5):(Total: 1.393ms, non-child: 1.278ms, % non-child: 91.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 907.529ms - Open Started: 905.221ms (905.221ms) - Open Finished: 906.325ms (1.104ms) - First Batch Requested: 906.335ms (9.692us) - First Batch Returned: 906.356ms (21.115us) - Last Batch Returned: 906.929ms (572.829us) - Closed: 907.529ms (599.478us) - BuildRows: 7.30K (7300) - BuildTime: 783.399us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2074880) - ProbeRows: 1.22K (1220) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 23.440us - RowsReturned: 1.22K (1220) - RowsReturnedRate: 875.52 K/sec Buffer pool: - AllocTime: 37.729us - CumulativeAllocationBytes: 640.00 KB (655360) - CumulativeAllocations: 8 (8) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 640.00 KB (655360) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 33.781us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 185.921us - BuildRowsPartitioned: 7.30K (7300) - HashTablesBuildTime: 389.116us - LargestPartitionPercent: 50 (50) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 16.38K (16384) - HashCollisions: 0 (0) - Probes: 7.92K (7920) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=25):(Total: 94.986us, non-child: 94.986us, % non-child: 100.00%) Node Lifecycle Event Timeline: 906.251ms - Open Started: 905.304ms (905.304ms) - Open Finished: 905.307ms (2.927us) - First Batch Requested: 905.469ms (162.299us) - First Batch Returned: 905.482ms (13.300us) - Last Batch Returned: 905.749ms (266.765us) - Closed: 906.251ms (502.450us) - ConvertRowBatchTime: 77.869us - PeakMemoryUsage: 144.00 KB (147456) - RowsReturned: 7.30K (7300) - RowsReturnedRate: 76.85 M/sec Buffer pool: - AllocTime: 34.183us - CumulativeAllocationBytes: 144.00 KB (147456) - CumulativeAllocations: 12 (12) - PeakReservation: 144.00 KB (147456) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 144.00 KB (147456) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 26.871us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 121.19 KB (124100) - TotalGetBatchTime: 7.485us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 18.96 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 32.601us ; Min: 13.708us ; Max: 67.030us ; Number of samples: 6) - DeserializeRowBatchTime: 3.726ms - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 57.21 KB (58578) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=24):(Total: 25.198us, non-child: 25.198us, % non-child: 100.00%) Node Lifecycle Event Timeline: 907.525ms - Open Started: 905.406ms (905.406ms) - Open Finished: 905.408ms (1.970us) - First Batch Requested: 906.310ms (902.069us) - First Batch Returned: 906.325ms (14.842us) - Last Batch Returned: 906.433ms (108.338us) - Closed: 907.525ms (1.092ms) - ConvertRowBatchTime: 16.890us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 1.22K (1220) - RowsReturnedRate: 48.42 M/sec Buffer pool: - AllocTime: 11.124us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 4 (4) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.698us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 26.21 KB (26840) - TotalGetBatchTime: 3.049us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 722.901us ; Min: 28.273us ; Max: 1.417ms ; Number of samples: 2) - DeserializeRowBatchTime: 32.369us - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 5.93 KB (6076) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 904.323ms, non-child: 904.323ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 261 (261) - CodegenTotalWallClockTime: 904.317ms - CodegenSysTime: 12.000ms - CodegenUserTime: 228.000ms - CodegenVoluntaryContextSwitches: 50 (50) - CompileTime: 203.932ms - IrGenerationTime: 39.743ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 50 (50) - NumInstructions: 2.66K (2661) - OptimizationTime: 592.783ms - PeakMemoryUsage: 1.30 MB (1362432) - PrepareTime: 67.212ms Instance e0424d84963f6618:f987655900000010 (host=tarmstrong-box:22002):(Total: 845.204ms, non-child: 4.250ms, % non-child: 0.50%) Last report received time: 2019-11-03 17:15:40.051 Fragment Instance Lifecycle Event Timeline: 902.284ms - Prepare Finished: 61.411ms (61.411ms) - Open Finished: 900.490ms (839.079ms) - First Batch Produced: 900.507ms (17.416us) - First Batch Sent: 900.577ms (69.325us) - ExecInternal Finished: 902.284ms (1.707ms) - MemoryUsage (500.000ms): 83.62 KB, 1.43 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 2.10 MB (2198678) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.69 MB (590025504) - RowsProduced: 1.78K (1780) - TotalNetworkReceiveTime: 5.704us - TotalNetworkSendTime: 1.477ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 208 (208) - TotalThreadsTotalWallClockTime: 840.999ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 228.000ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1.672ms - ExecTreeExecTime: 46.074us - OpenTime: 839.074ms - ExecTreeOpenTime: 454.673us - PrepareTime: 269.382us - ExecTreePrepareTime: 138.819us KrpcDataStreamSender (dst_id=26):(Total: 1.651ms, non-child: 172.484us, % non-child: 10.44%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 46.40 MB/sec ; Min: 13.26 MB/sec ; Max: 86.52 MB/sec ; Number of samples: 6) - EosSent: 3 (3) - PeakMemoryUsage: 33.38 KB (34176) - RowsSent: 1.78K (1780) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 72.906us - TotalBytesSent: 47.43 KB (48567) - UncompressedRowBatchSize: 156.45 KB (160200) HASH_JOIN_NODE (id=5):(Total: 731.627us, non-child: 697.479us, % non-child: 95.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 902.223ms - Open Started: 900.028ms (900.028ms) - Open Finished: 900.480ms (452.384us) - First Batch Requested: 900.492ms (11.479us) - First Batch Returned: 900.507ms (15.315us) - Last Batch Returned: 900.606ms (98.816us) - Closed: 902.223ms (1.617ms) - BuildRows: 0 (0) - BuildTime: 181.988us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.97 MB (2066688) - ProbeRows: 1.78K (1780) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 24.564us - RowsReturned: 1.78K (1780) - RowsReturnedRate: 2.43 M/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 578.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=25):(Total: 3.866us, non-child: 3.866us, % non-child: 100.00%) Node Lifecycle Event Timeline: 900.387ms - Open Started: 900.132ms (900.132ms) - Open Finished: 900.134ms (1.292us) - First Batch Requested: 900.268ms (133.949us) - First Batch Returned: 900.269ms (1.402us) - Last Batch Returned: 900.269ms (146.000ns) - Closed: 900.387ms (118.138us) - ConvertRowBatchTime: 313.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 294.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=24):(Total: 30.282us, non-child: 30.282us, % non-child: 100.00%) Node Lifecycle Event Timeline: 902.220ms - Open Started: 900.126ms (900.126ms) - Open Finished: 900.127ms (1.782us) - First Batch Requested: 900.466ms (338.940us) - First Batch Returned: 900.479ms (13.232us) - Last Batch Returned: 900.593ms (113.527us) - Closed: 902.220ms (1.626ms) - ConvertRowBatchTime: 20.096us - PeakMemoryUsage: 72.00 KB (73728) - RowsReturned: 1.78K (1780) - RowsReturnedRate: 58.78 M/sec Buffer pool: - AllocTime: 20.187us - CumulativeAllocationBytes: 72.00 KB (73728) - CumulativeAllocations: 6 (6) - PeakReservation: 72.00 KB (73728) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 72.00 KB (73728) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 17.301us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 38.24 KB (39160) - TotalGetBatchTime: 3.841us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 6.06 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.219us ; Min: 13.912us ; Max: 26.201us ; Number of samples: 3) - DeserializeRowBatchTime: 51.478us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 8.86 KB (9074) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 838.570ms, non-child: 838.570ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 208 (208) - CodegenTotalWallClockTime: 838.561ms - CodegenSysTime: 4.000ms - CodegenUserTime: 228.000ms - CodegenVoluntaryContextSwitches: 34 (34) - CompileTime: 123.065ms - IrGenerationTime: 14.699ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 50 (50) - NumInstructions: 2.66K (2661) - OptimizationTime: 601.092ms - PeakMemoryUsage: 1.30 MB (1362432) - PrepareTime: 90.023ms Instance e0424d84963f6618:f987655900000011 (host=tarmstrong-box:22001):(Total: 804.870ms, non-child: 69.686us, % non-child: 0.01%) Last report received time: 2019-11-03 17:15:39.944 Fragment Instance Lifecycle Event Timeline: 832.716ms - Prepare Finished: 27.886ms (27.886ms) - Open Finished: 810.455ms (782.569ms) - First Batch Produced: 810.477ms (22.272us) - First Batch Sent: 810.544ms (66.958us) - ExecInternal Finished: 832.716ms (22.171ms) - MemoryUsage (500.000ms): 83.62 KB, 1.43 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 2.15 MB (2256022) - PeakReservation: 1.94 MB (2031616) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.36 MB (582333216) - RowsProduced: 4.30K (4300) - TotalNetworkReceiveTime: 83.059ms - TotalNetworkSendTime: 1.943ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 115 (115) - TotalThreadsTotalWallClockTime: 868.233ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 236.000ms - TotalThreadsVoluntaryContextSwitches: 27 (27) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 22.119ms - ExecTreeExecTime: 19.863ms - OpenTime: 782.564ms - ExecTreeOpenTime: 63.810ms - PrepareTime: 169.232us - ExecTreePrepareTime: 85.057us KrpcDataStreamSender (dst_id=26):(Total: 2.272ms, non-child: 326.945us, % non-child: 14.39%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 39.52 MB/sec ; Min: 6.61 MB/sec ; Max: 91.30 MB/sec ; Number of samples: 15) - EosSent: 3 (3) - PeakMemoryUsage: 33.38 KB (34176) - RowsSent: 4.30K (4300) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 183.649us - TotalBytesSent: 114.42 KB (117165) - UncompressedRowBatchSize: 377.93 KB (387000) HASH_JOIN_NODE (id=5):(Total: 83.807ms, non-child: 688.505us, % non-child: 0.82%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 832.645ms - Open Started: 746.637ms (746.637ms) - Open Finished: 810.446ms (63.808ms) - First Batch Requested: 810.457ms (10.768us) - First Batch Returned: 810.477ms (20.359us) - Last Batch Returned: 831.466ms (20.988ms) - Closed: 832.645ms (1.179ms) - BuildRows: 0 (0) - BuildTime: 159.729us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.97 MB (2066688) - ProbeRows: 4.30K (4300) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 65.686us - RowsReturned: 4.30K (4300) - RowsReturnedRate: 51.31 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=5): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 841.000ns - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.12 KB (9344) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=25):(Total: 63.323ms, non-child: 6.471us, % non-child: 0.01%) Node Lifecycle Event Timeline: 810.386ms - Open Started: 746.834ms (746.834ms) - Open Finished: 810.154ms (63.320ms) - First Batch Requested: 810.283ms (129.154us) - First Batch Returned: 810.285ms (1.655us) - Last Batch Returned: 810.285ms (148.000ns) - Closed: 810.386ms (100.690us) - ConvertRowBatchTime: 275.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 63.317ms - TotalBytesDequeued: 0 - TotalGetBatchTime: 63.318ms - DataWaitTime: 63.317ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=24):(Total: 19.795ms, non-child: 65.497us, % non-child: 0.33%) Node Lifecycle Event Timeline: 832.641ms - Open Started: 746.827ms (746.827ms) - Open Finished: 746.829ms (2.670us) - First Batch Requested: 810.434ms (63.604ms) - First Batch Returned: 810.445ms (11.441us) - Last Batch Returned: 831.457ms (21.012ms) - Closed: 832.641ms (1.183ms) - ConvertRowBatchTime: 45.863us - PeakMemoryUsage: 128.00 KB (131072) - RowsReturned: 4.30K (4300) - RowsReturnedRate: 217.22 K/sec Buffer pool: - AllocTime: 25.155us - CumulativeAllocationBytes: 152.00 KB (155648) - CumulativeAllocations: 12 (12) - PeakReservation: 128.00 KB (131072) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 19.862us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 92.38 KB (94600) - TotalGetBatchTime: 19.738ms - DataWaitTime: 19.729ms Enqueue: - BytesReceived (500.000ms): 0, 6.05 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 25.002us ; Min: 13.462us ; Max: 39.986us ; Number of samples: 6) - DeserializeRowBatchTime: 86.523us - TotalBatchesEnqueued: 6 (6) - TotalBatchesReceived: 6 (6) - TotalBytesReceived: 21.16 KB (21668) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 718.721ms, non-child: 718.721ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 115 (115) - CodegenTotalWallClockTime: 718.714ms - CodegenSysTime: 0.000ns - CodegenUserTime: 236.000ms - CodegenVoluntaryContextSwitches: 12 (12) - CompileTime: 75.731ms - IrGenerationTime: 55.598ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 50 (50) - NumInstructions: 2.66K (2661) - OptimizationTime: 523.809ms - PeakMemoryUsage: 1.30 MB (1362432) - PrepareTime: 51.182ms Averaged Fragment F04:(Total: 643.825ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 66.72 KB, max: 68.10 KB, avg: 67.27 KB, stddev: 609.98 B completion times: min:5s097ms max:5s253ms mean: 5s165ms stddev:65.161ms execution rates: min:12.96 KB/sec max:13.09 KB/sec mean:13.02 KB/sec stddev:53.30 B/sec num instances: 3 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.17 - PeakMemoryUsage: 256.92 KB (263088) - PeakReservation: 37.33 KB (38229) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.45 MB (581383288) - RowsProduced: 2.43K (2433) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.315ms - TotalStorageWaitTime: 376.375ms - TotalThreadsInvoluntaryContextSwitches: 40 (40) - TotalThreadsTotalWallClockTime: 1s033ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 60 (60) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 393.691ms - ExecTreeExecTime: 392.088ms - OpenTime: 244.909ms - ExecTreeOpenTime: 79.854us - PrepareTime: 5.194ms - ExecTreePrepareTime: 5.086ms KrpcDataStreamSender (dst_id=24):(Total: 1.618ms, non-child: 1.618ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 67.42 KB (69040) - RowsSent: 2.43K (2433) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 107.372us - TotalBytesSent: 11.98 KB (12272) - UncompressedRowBatchSize: 52.28 KB (53533) HDFS_SCAN_NODE (id=4):(Total: 402.317ms, non-child: 402.317ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 70.12 KB (71807) - BytesReadDataNodeCache: 0 - BytesReadLocal: 70.12 KB (71807) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 70.12 KB (71807) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 7 (7) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 38.475us - MaterializeTupleTime(*): 3.424ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 82.00 KB (83968) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 310.18 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 144.00 KB (147456) - RowBatchQueueGetWaitTime: 379.458ms - RowBatchQueuePeakMemoryUsage: 42.00 KB (43008) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.43K (2433) - RowsReturned: 2.43K (2433) - RowsReturnedRate: 7.39 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 376.375ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 395.400ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsOpenFileTime(*): 114.590ms - TotalRawHdfsReadTime(*): 276.990ms - TotalReadThroughput: 14.58 KB/sec Buffer pool: - AllocTime: 54.192us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 37.33 KB (38229) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 26.67 KB (27306) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 35.191us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 244.686ms, non-child: 244.686ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 28 (28) - CodegenTotalWallClockTime: 244.679ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 21 (21) - CompileTime: 66.119ms - IrGenerationTime: 4.809ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 76.042ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 94.685ms Fragment F04: Instance e0424d84963f6618:f98765590000000c (host=tarmstrong-box:22000):(Total: 825.012ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.895 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.72 KB Fragment Instance Lifecycle Event Timeline: 844.863ms - Prepare Finished: 24.785ms (24.785ms) - Open Finished: 210.999ms (186.213ms) - First Batch Produced: 658.617ms (447.618ms) - First Batch Sent: 658.633ms (16.490us) - ExecInternal Finished: 844.863ms (186.229ms) - MemoryUsage (500.000ms): 256.92 KB, 72.27 KB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.17 - PeakMemoryUsage: 256.92 KB (263088) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 2.42K (2420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.496ms - TotalStorageWaitTime: 589.299ms - TotalThreadsInvoluntaryContextSwitches: 29 (29) - TotalThreadsTotalWallClockTime: 1s411ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 623.564ms - ExecTreeExecTime: 620.765ms - OpenTime: 186.209ms - ExecTreeOpenTime: 79.486us - PrepareTime: 15.200ms - ExecTreePrepareTime: 15.097ms KrpcDataStreamSender (dst_id=24):(Total: 2.813ms, non-child: 315.638us, % non-child: 11.22%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 11.27 MB/sec ; Min: 3.05 MB/sec ; Max: 26.40 MB/sec ; Number of samples: 4) - EosSent: 3 (3) - PeakMemoryUsage: 79.42 KB (81328) - RowsSent: 2.42K (2420) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 114.407us - TotalBytesSent: 11.62 KB (11898) - UncompressedRowBatchSize: 51.99 KB (53240) HDFS_SCAN_NODE (id=4):(Total: 651.015ms, non-child: 651.015ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.72 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 834.620ms - Open Started: 210.912ms (210.912ms) - Open Finished: 210.989ms (77.021us) - First Batch Requested: 211.001ms (11.845us) - First Batch Returned: 658.616ms (447.614ms) - Last Batch Returned: 831.953ms (173.337ms) - Closed: 834.620ms (2.667ms) - BytesRead (500.000ms): 0, 8.50 KB - FooterProcessingTime: (Avg: 65.860ms ; Min: 297.639us ; Max: 411.834ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 780.00 B (780) ; Min: 780.00 B (780) ; Max: 780.00 B (780) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 97.00 B (97) ; Min: 77.00 B (77) ; Max: 110.00 B (110) ; Number of samples: 16) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.27 KB (1296) ; Min: 1.27 KB (1296) ; Max: 1.27 KB (1296) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 162.00 B (162) ; Min: 161.00 B (161) ; Max: 165.00 B (165) ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 69.47 KB (71134) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.47 KB (71134) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.47 KB (71134) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 8 (8) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 42.245us - MaterializeTupleTime(*): 9.915ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 66.00 KB (67584) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 153.22 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 144.00 KB (147456) - RowBatchQueueGetWaitTime: 601.364ms - RowBatchQueuePeakMemoryUsage: 42.00 KB (43008) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.42K (2420) - RowsReturned: 2.42K (2420) - RowsReturnedRate: 3.72 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 589.299ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 601.540ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsOpenFileTime(*): 174.660ms - TotalRawHdfsReadTime(*): 453.363ms - TotalReadThroughput: 8.50 KB/sec Buffer pool: - AllocTime: 50.754us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 31.857us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 185.773ms, non-child: 185.773ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 25 (25) - CodegenTotalWallClockTime: 185.766ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 25 (25) - CompileTime: 42.169ms - IrGenerationTime: 12.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 81.440ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 48.407ms Instance e0424d84963f6618:f98765590000000a (host=tarmstrong-box:22002):(Total: 615.547ms, non-child: 108.824us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:40.051 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/68.10 KB Fragment Instance Lifecycle Event Timeline: 690.534ms - Prepare Finished: 75.064ms (75.064ms) - Open Finished: 472.252ms (397.188ms) - First Batch Produced: 606.554ms (134.302ms) - First Batch Sent: 606.569ms (14.803us) - ExecInternal Finished: 690.534ms (83.965ms) - MemoryUsage (500.000ms): 35.42 KB, 96.27 KB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.17 - PeakMemoryUsage: 256.92 KB (263088) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.82 MB (590156576) - RowsProduced: 2.46K (2460) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 476.355us - TotalStorageWaitTime: 215.360ms - TotalThreadsInvoluntaryContextSwitches: 50 (50) - TotalThreadsTotalWallClockTime: 840.727ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 71 (71) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 218.123ms - ExecTreeExecTime: 217.366ms - OpenTime: 397.184ms - ExecTreeOpenTime: 82.035us - PrepareTime: 203.216us - ExecTreePrepareTime: 90.367us KrpcDataStreamSender (dst_id=24):(Total: 769.897us, non-child: 292.438us, % non-child: 37.98%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 29.55 MB/sec ; Min: 10.18 MB/sec ; Max: 41.23 MB/sec ; Number of samples: 3) - EosSent: 3 (3) - PeakMemoryUsage: 55.42 KB (56752) - RowsSent: 2.46K (2460) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 103.652us - TotalBytesSent: 12.23 KB (12528) - UncompressedRowBatchSize: 52.85 KB (54120) HDFS_SCAN_NODE (id=4):(Total: 217.604ms, non-child: 217.604ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/68.10 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:100% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 690.473ms - Open Started: 472.162ms (472.162ms) - Open Finished: 472.242ms (79.636us) - First Batch Requested: 472.253ms (11.354us) - First Batch Returned: 606.554ms (134.300ms) - Last Batch Returned: 689.865ms (83.311ms) - Closed: 690.473ms (608.595us) - BytesRead (500.000ms): 0, 35.25 KB - FooterProcessingTime: (Avg: 20.791ms ; Min: 305.028us ; Max: 107.374ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 897.00 B (897) ; Min: 897.00 B (897) ; Max: 897.00 B (897) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 112.00 B (112) ; Min: 93.00 B (93) ; Max: 127.00 B (127) ; Number of samples: 16) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.28 KB (1312) ; Min: 1.28 KB (1312) ; Max: 1.28 KB (1312) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 164.00 B (164) ; Min: 161.00 B (161) ; Max: 165.00 B (165) ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 71.07 KB (72772) - BytesReadDataNodeCache: 0 - BytesReadLocal: 71.07 KB (72772) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 71.07 KB (72772) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 9 (9) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 35.812us - MaterializeTupleTime(*): 174.526us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.00 KB (88064) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 467.91 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 144.00 KB (147456) - RowBatchQueueGetWaitTime: 215.454ms - RowBatchQueuePeakMemoryUsage: 42.00 KB (43008) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.46K (2460) - RowsReturned: 2.46K (2460) - RowsReturnedRate: 11.30 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 215.360ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 225.429ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsOpenFileTime(*): 75.915ms - TotalRawHdfsReadTime(*): 151.880ms - TotalReadThroughput: 35.25 KB/sec Buffer pool: - AllocTime: 60.423us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 41.914us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 397.064ms, non-child: 397.064ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 41 (41) - CodegenTotalWallClockTime: 397.057ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 34 (34) - CompileTime: 112.274ms - IrGenerationTime: 1.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 78.587ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 200.736ms Instance e0424d84963f6618:f98765590000000b (host=tarmstrong-box:22001):(Total: 490.917ms, non-child: 90.172us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.944 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.99 KB Fragment Instance Lifecycle Event Timeline: 526.066ms - Prepare Finished: 35.215ms (35.215ms) - Open Finished: 186.553ms (151.338ms) - First Batch Produced: 433.490ms (246.936ms) - First Batch Sent: 433.503ms (12.356us) - ExecInternal Finished: 526.066ms (92.563ms) - MemoryUsage (500.000ms): 35.42 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.17 - PeakMemoryUsage: 256.92 KB (263088) - PeakReservation: 48.00 KB (49152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.42 MB (582398752) - RowsProduced: 2.42K (2420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 975.002us - TotalStorageWaitTime: 324.466ms - TotalThreadsInvoluntaryContextSwitches: 43 (43) - TotalThreadsTotalWallClockTime: 849.940ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 339.385ms - ExecTreeExecTime: 338.134ms - OpenTime: 151.334ms - ExecTreeOpenTime: 78.043us - PrepareTime: 178.616us - ExecTreePrepareTime: 71.094us KrpcDataStreamSender (dst_id=24):(Total: 1.272ms, non-child: 296.103us, % non-child: 23.27%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 10.79 MB/sec ; Min: 803.31 KB/sec ; Max: 34.42 MB/sec ; Number of samples: 4) - EosSent: 3 (3) - PeakMemoryUsage: 67.42 KB (69040) - RowsSent: 2.42K (2420) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 104.059us - TotalBytesSent: 12.10 KB (12392) - UncompressedRowBatchSize: 51.99 KB (53240) HDFS_SCAN_NODE (id=4):(Total: 338.332ms, non-child: 338.332ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.99 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 525.980ms - Open Started: 186.469ms (186.469ms) - Open Finished: 186.545ms (76.034us) - First Batch Requested: 186.556ms (10.869us) - First Batch Returned: 433.489ms (246.933ms) - Last Batch Returned: 524.924ms (91.434ms) - Closed: 525.980ms (1.056ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 37.832ms ; Min: 153.434us ; Max: 208.861ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 832.00 B (832) ; Min: 832.00 B (832) ; Max: 832.00 B (832) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 104.00 B (104) ; Min: 97.00 B (97) ; Max: 110.00 B (110) ; Number of samples: 16) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 1.26 KB (1288) ; Min: 1.26 KB (1288) ; Max: 1.26 KB (1288) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 161.00 B (161) ; Min: 149.00 B (149) ; Max: 165.00 B (165) ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 69.84 KB (71515) - BytesReadDataNodeCache: 0 - BytesReadLocal: 69.84 KB (71515) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 69.84 KB (71515) - CachedFileHandlesHitCount: 19 (19) - CachedFileHandlesMissCount: 5 (5) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 37.369us - MaterializeTupleTime(*): 184.099us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 94.00 KB (96256) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 309.39 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 144.00 KB (147456) - RowBatchQueueGetWaitTime: 321.556ms - RowBatchQueuePeakMemoryUsage: 42.00 KB (43008) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.42K (2420) - RowsReturned: 2.42K (2420) - RowsReturnedRate: 7.15 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 324.466ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 23 (23) - ScannerThreadsTotalWallClockTime: 359.230ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 19 (19) - TotalRawHdfsOpenFileTime(*): 93.195ms - TotalRawHdfsReadTime(*): 225.728ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 51.400us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 31.804us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 151.222ms, non-child: 151.222ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 20 (20) - CodegenTotalWallClockTime: 151.215ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 6 (6) - CompileTime: 43.914ms - IrGenerationTime: 1.126ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 68.098ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 34.913ms Averaged Fragment F05:(Total: 622.467ms, non-child: 2.885ms, % non-child: 0.46%) split sizes: min: 66.72 KB, max: 68.10 KB, avg: 67.27 KB, stddev: 609.98 B completion times: min:5s097ms max:5s253ms mean: 5s165ms stddev:65.157ms execution rates: min:12.96 KB/sec max:13.09 KB/sec mean:13.02 KB/sec stddev:53.31 B/sec num instances: 3 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 42.67 KB (43690) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.49 MB (581421517) - RowsProduced: 2.43K (2433) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.978ms - TotalStorageWaitTime: 328.476ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 960.697ms - TotalThreadsSysTime: 1.333ms - TotalThreadsUserTime: 46.666ms - TotalThreadsVoluntaryContextSwitches: 56 (56) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 342.528ms - ExecTreeExecTime: 339.133ms - OpenTime: 276.916ms - ExecTreeOpenTime: 73.116us - PrepareTime: 841.209us - ExecTreePrepareTime: 100.251us KrpcDataStreamSender (dst_id=25):(Total: 3.403ms, non-child: 3.403ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 102.66 KB (105120) - RowsSent: 2.43K (2433) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 524.799us - TotalBytesSent: 19.07 KB (19526) - UncompressedRowBatchSize: 40.40 KB (41366) HDFS_SCAN_NODE (id=3):(Total: 339.381ms, non-child: 339.381ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.67 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 79.90 KB (81816) - BytesReadDataNodeCache: 0 - BytesReadLocal: 79.90 KB (81816) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 79.90 KB (81816) - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 5 (5) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 28.610us - MaterializeTupleTime(*): 282.428us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 8 (8) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.67 KB (88746) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 394.90 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 330.389ms - RowBatchQueuePeakMemoryUsage: 49.33 KB (50517) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.43K (2433) - RowsReturned: 2.43K (2433) - RowsReturnedRate: 8.44 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 328.476ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 341.261ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsOpenFileTime(*): 70.182ms - TotalRawHdfsReadTime(*): 257.480ms - TotalReadThroughput: 20.24 KB/sec Buffer pool: - AllocTime: 5.180ms - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 16 (16) - PeakReservation: 42.67 KB (43690) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 26.67 KB (27306) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.164ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 276.797ms, non-child: 276.797ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 35 (35) - CodegenTotalWallClockTime: 276.790ms - CodegenSysTime: 1.333ms - CodegenUserTime: 46.666ms - CodegenVoluntaryContextSwitches: 19 (19) - CompileTime: 74.167ms - IrGenerationTime: 1.387ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 84.908ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 105.272ms Fragment F05: Instance e0424d84963f6618:f98765590000000f (host=tarmstrong-box:22000):(Total: 796.544ms, non-child: 6.591ms, % non-child: 0.83%) Last report received time: 2019-11-03 17:15:39.895 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.72 KB Fragment Instance Lifecycle Event Timeline: 812.451ms - Prepare Finished: 22.476ms (22.476ms) - Open Finished: 258.935ms (236.459ms) - First Batch Produced: 644.132ms (385.196ms) - First Batch Sent: 644.146ms (14.167us) - ExecInternal Finished: 812.451ms (168.304ms) - MemoryUsage (500.000ms): 272.16 KB, 87.49 KB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 2.42K (2420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 921.804us - TotalStorageWaitTime: 519.082ms - TotalThreadsInvoluntaryContextSwitches: 71 (71) - TotalThreadsTotalWallClockTime: 1s322ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 65 (65) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 553.378ms - ExecTreeExecTime: 551.637ms - OpenTime: 236.456ms - ExecTreeOpenTime: 72.060us - PrepareTime: 215.066us - ExecTreePrepareTime: 91.035us KrpcDataStreamSender (dst_id=25):(Total: 1.752ms, non-child: 829.452us, % non-child: 47.33%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 29.34 MB/sec ; Min: 16.51 MB/sec ; Max: 42.18 MB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 102.66 KB (105120) - RowsSent: 2.42K (2420) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 122.390us - TotalBytesSent: 18.96 KB (19411) - UncompressedRowBatchSize: 40.18 KB (41140) HDFS_SCAN_NODE (id=3):(Total: 551.863ms, non-child: 551.863ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.72 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 812.354ms - Open Started: 258.857ms (258.857ms) - Open Finished: 258.927ms (69.934us) - First Batch Requested: 258.937ms (9.582us) - First Batch Returned: 644.131ms (385.194ms) - Last Batch Returned: 811.318ms (167.187ms) - Closed: 812.354ms (1.036ms) - BytesRead (500.000ms): 0, 10.17 KB - FooterProcessingTime: (Avg: 56.073ms ; Min: 297.811us ; Max: 353.329ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 2.80 KB (2866) ; Min: 2.80 KB (2866) ; Max: 2.80 KB (2866) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 358.00 B (358) ; Min: 356.00 B (356) ; Max: 365.00 B (365) ; Number of samples: 8) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.76 KB (2826) ; Min: 2.76 KB (2826) ; Max: 2.76 KB (2826) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 353.00 B (353) ; Min: 351.00 B (351) ; Max: 360.00 B (360) ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 79.29 KB (81197) - BytesReadDataNodeCache: 0 - BytesReadLocal: 79.29 KB (81197) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 79.29 KB (81197) - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 25.937us - MaterializeTupleTime(*): 616.864us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 8 (8) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.00 KB (62464) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 176.72 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 531.899ms - RowBatchQueuePeakMemoryUsage: 37.00 KB (37888) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.42K (2420) - RowsReturned: 2.42K (2420) - RowsReturnedRate: 4.38 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 519.082ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 532.666ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 27 (27) - TotalRawHdfsOpenFileTime(*): 79.452ms - TotalRawHdfsReadTime(*): 448.702ms - TotalReadThroughput: 10.17 KB/sec Buffer pool: - AllocTime: 37.556us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 16 (16) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 21.789us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 236.337ms, non-child: 236.337ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 59 (59) - CodegenTotalWallClockTime: 236.329ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 23 (23) - CompileTime: 51.513ms - IrGenerationTime: 1.763ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 92.752ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 89.483ms Instance e0424d84963f6618:f98765590000000d (host=tarmstrong-box:22002):(Total: 582.516ms, non-child: 1.989ms, % non-child: 0.34%) Last report received time: 2019-11-03 17:15:40.051 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/68.10 KB Fragment Instance Lifecycle Event Timeline: 692.901ms - Prepare Finished: 112.327ms (112.327ms) - Open Finished: 450.211ms (337.884ms) - First Batch Produced: 606.752ms (156.540ms) - First Batch Sent: 606.764ms (12.314us) - ExecInternal Finished: 692.901ms (86.136ms) - MemoryUsage (500.000ms): 50.66 KB, 119.49 KB - ThreadUsage (500.000ms): 1, 3 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 48.00 KB (49152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.88 MB (590222112) - RowsProduced: 2.46K (2460) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4.569ms - TotalStorageWaitTime: 213.078ms - TotalThreadsInvoluntaryContextSwitches: 28 (28) - TotalThreadsTotalWallClockTime: 815.713ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 67 (67) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 242.507ms - ExecTreeExecTime: 234.818ms - OpenTime: 337.880ms - ExecTreeOpenTime: 78.782us - PrepareTime: 2.100ms - ExecTreePrepareTime: 105.705us KrpcDataStreamSender (dst_id=25):(Total: 7.692ms, non-child: 3.121ms, % non-child: 40.57%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 25.23 MB/sec ; Min: 17.35 MB/sec ; Max: 33.10 MB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 102.66 KB (105120) - RowsSent: 2.46K (2460) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1.331ms - TotalBytesSent: 19.29 KB (19756) - UncompressedRowBatchSize: 40.84 KB (41820) HDFS_SCAN_NODE (id=3):(Total: 235.083ms, non-child: 235.083ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/68.10 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 692.767ms - Open Started: 450.125ms (450.125ms) - Open Finished: 450.202ms (76.726us) - First Batch Requested: 450.212ms (10.472us) - First Batch Returned: 606.751ms (156.538ms) - Last Batch Returned: 688.061ms (81.309ms) - Closed: 692.767ms (4.706ms) - BytesRead (500.000ms): 0, 50.55 KB - FooterProcessingTime: (Avg: 22.337ms ; Min: 369.576us ; Max: 115.366ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 2.83 KB (2902) ; Min: 2.83 KB (2902) ; Max: 2.83 KB (2902) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 362.00 B (362) ; Min: 356.00 B (356) ; Max: 365.00 B (365) ; Number of samples: 8) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.79 KB (2862) ; Min: 2.79 KB (2862) ; Max: 2.79 KB (2862) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 357.00 B (357) ; Min: 351.00 B (351) ; Max: 360.00 B (360) ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 80.86 KB (82801) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.86 KB (82801) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.86 KB (82801) - CachedFileHandlesHitCount: 10 (10) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 32.274us - MaterializeTupleTime(*): 109.523us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 8 (8) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 81.00 KB (82944) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 571.59 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 229.388ms - RowBatchQueuePeakMemoryUsage: 37.00 KB (37888) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.46K (2460) - RowsReturned: 2.46K (2460) - RowsReturnedRate: 10.46 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 213.078ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 235.335ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 23 (23) - TotalRawHdfsOpenFileTime(*): 68.924ms - TotalRawHdfsReadTime(*): 141.466ms - TotalReadThroughput: 50.55 KB/sec Buffer pool: - AllocTime: 15.453ms - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 16 (16) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 15.437ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 337.750ms, non-child: 337.750ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 25 (25) - CodegenTotalWallClockTime: 337.743ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 27 (27) - CompileTime: 66.343ms - IrGenerationTime: 1.225ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 92.834ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 145.870ms Instance e0424d84963f6618:f98765590000000e (host=tarmstrong-box:22001):(Total: 488.343ms, non-child: 76.135us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.945 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.99 KB Fragment Instance Lifecycle Event Timeline: 550.116ms - Prepare Finished: 39.853ms (39.853ms) - Open Finished: 296.269ms (256.415ms) - First Batch Produced: 427.461ms (131.192ms) - First Batch Sent: 427.474ms (12.718us) - ExecInternal Finished: 550.116ms (122.642ms) - MemoryUsage (500.000ms): 272.16 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 48.00 KB (49152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.47 MB (582447904) - RowsProduced: 2.42K (2420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 445.517us - TotalStorageWaitTime: 253.267ms - TotalThreadsInvoluntaryContextSwitches: 26 (26) - TotalThreadsTotalWallClockTime: 743.884ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 44.000ms - TotalThreadsVoluntaryContextSwitches: 36 (36) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 231.700ms - ExecTreeExecTime: 230.944ms - OpenTime: 256.411ms - ExecTreeOpenTime: 68.507us - PrepareTime: 208.178us - ExecTreePrepareTime: 104.015us KrpcDataStreamSender (dst_id=25):(Total: 766.105us, non-child: 319.400us, % non-child: 41.69%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 46.46 MB/sec ; Min: 40.20 MB/sec ; Max: 52.72 MB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 102.66 KB (105120) - RowsSent: 2.42K (2420) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 120.170us - TotalBytesSent: 18.96 KB (19411) - UncompressedRowBatchSize: 40.18 KB (41140) HDFS_SCAN_NODE (id=3):(Total: 231.197ms, non-child: 231.197ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.99 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 528.040ms - Open Started: 296.193ms (296.193ms) - Open Finished: 296.260ms (66.654us) - First Batch Requested: 296.270ms (9.644us) - First Batch Returned: 427.460ms (131.190ms) - Last Batch Returned: 527.447ms (99.986ms) - Closed: 528.040ms (593.245us) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 25.921ms ; Min: 468.986us ; Max: 121.979ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 2.78 KB (2848) ; Min: 2.78 KB (2848) ; Max: 2.78 KB (2848) ; Number of samples: 1) - ParquetCompressedPageSize: (Avg: 356.00 B (356) ; Min: 329.00 B (329) ; Max: 365.00 B (365) ; Number of samples: 8) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.74 KB (2808) ; Min: 2.74 KB (2808) ; Max: 2.74 KB (2808) ; Number of samples: 1) - ParquetUncompressedPageSize: (Avg: 351.00 B (351) ; Min: 324.00 B (324) ; Max: 360.00 B (360) ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 79.54 KB (81450) - BytesReadDataNodeCache: 0 - BytesReadLocal: 79.54 KB (81450) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 79.54 KB (81450) - CachedFileHandlesHitCount: 11 (11) - CachedFileHandlesMissCount: 5 (5) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 27.619us - MaterializeTupleTime(*): 120.897us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 8 (8) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 118.00 KB (120832) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 436.38 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 104.00 KB (106496) - RowBatchQueueGetWaitTime: 229.879ms - RowBatchQueuePeakMemoryUsage: 74.00 KB (75776) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.42K (2420) - RowsReturned: 2.42K (2420) - RowsReturnedRate: 10.47 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 253.267ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 255.782ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 17 (17) - TotalRawHdfsOpenFileTime(*): 62.169ms - TotalRawHdfsReadTime(*): 182.274ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 50.465us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 16 (16) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 34.953us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 256.303ms, non-child: 256.303ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 22 (22) - CodegenTotalWallClockTime: 256.297ms - CodegenSysTime: 4.000ms - CodegenUserTime: 44.000ms - CodegenVoluntaryContextSwitches: 7 (7) - CompileTime: 104.644ms - IrGenerationTime: 1.174ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 69.139ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 80.463ms Averaged Fragment F07:(Total: 1s025ms, non-child: 34.217us, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s097ms max:5s097ms mean: 5s097ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 5.90 MB (6182623) - PeakReservation: 4.75 MB (4980736) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 50.744us - TotalNetworkSendTime: 380.836us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 679 (679) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 496.000ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 456.875us - ExecTreeExecTime: 46.573us - OpenTime: 1s024ms - ExecTreeOpenTime: 3.199ms - PrepareTime: 353.834us - ExecTreePrepareTime: 213.147us KrpcDataStreamSender (dst_id=35):(Total: 433.965us, non-child: 433.965us, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 27.42 KB (28080) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=15):(Total: 3.633ms, non-child: 315.468us, % non-child: 8.68%) - BuildRows: 1 (1) - BuildTime: 165.794us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.18 MB (2287872) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 315.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.852us - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 2 (2) - PeakReservation: 2.12 MB (2228224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 6.426us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=15): - BuildRowsPartitionTime: 9.440us - BuildRowsPartitioned: 1 (1) - HashTablesBuildTime: 8.189us - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.12 KB (25728) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 1 (1) - HashCollisions: 0 (0) - Probes: 1 (1) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=34):(Total: 7.908us, non-child: 7.908us, % non-child: 100.00%) - ConvertRowBatchTime: 626.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 126.45 K/sec Buffer pool: - AllocTime: 897.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 18.00 B (18) - TotalGetBatchTime: 2.834us - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 3.116us - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 14.00 B (14) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=14):(Total: 3.319ms, non-child: 2.837ms, % non-child: 85.48%) - BuildRows: 18.30K (18299) - BuildTime: 2.421ms - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.69 MB (2816256) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 355.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 87.767us - CumulativeAllocationBytes: 2.44 MB (2555904) - CumulativeAllocations: 32 (32) - PeakReservation: 2.62 MB (2752512) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.44 MB (2555904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 78.156us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): - BuildRowsPartitionTime: 874.141us - BuildRowsPartitioned: 18.30K (18299) - HashTablesBuildTime: 1.415ms - LargestPartitionPercent: 64 (64) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.12 KB (25728) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 51.20K (51200) - HashCollisions: 0 (0) - Probes: 18.30K (18299) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=29):(Total: 340.865us, non-child: 340.865us, % non-child: 100.00%) - ConvertRowBatchTime: 270.739us - PeakMemoryUsage: 1016.00 KB (1040384) - RowsReturned: 18.30K (18299) - RowsReturnedRate: 53.68 M/sec Buffer pool: - AllocTime: 185.347us - CumulativeAllocationBytes: 1016.00 KB (1040384) - CumulativeAllocations: 116 (116) - PeakReservation: 1016.00 KB (1040384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1016.00 KB (1040384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 151.539us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 403.88 KB (413574) - TotalGetBatchTime: 41.661us - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 455.294us - TotalBatchesEnqueued: 58 (58) - TotalBatchesReceived: 58 (58) - TotalBytesReceived: 180.59 KB (184927) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=6):(Total: 145.361us, non-child: 145.361us, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 0 - PeakScannerThreadConcurrency: 0 (0) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 0 - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 1s021ms, non-child: 1s021ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 679 (679) - CodegenTotalWallClockTime: 1s021ms - CodegenSysTime: 0.000ns - CodegenUserTime: 496.000ms - CodegenVoluntaryContextSwitches: 48 (48) - CompileTime: 124.103ms - IrGenerationTime: 83.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 114 (114) - NumInstructions: 6.77K (6772) - OptimizationTime: 747.320ms - PeakMemoryUsage: 3.31 MB (3467264) - PrepareTime: 60.623ms Fragment F07: Instance e0424d84963f6618:f987655900000026 (host=tarmstrong-box:22000):(Total: 1s025ms, non-child: 34.217us, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.894 Fragment Instance Lifecycle Event Timeline: 1s049ms - Prepare Finished: 23.719ms (23.719ms) - Open Finished: 1s048ms (1s024ms) - First Batch Produced: 1s048ms (5.503us) - First Batch Sent: 1s048ms (424.000ns) - ExecInternal Finished: 1s049ms (554.216us) - MemoryUsage (500.000ms): 119.92 KB, 3.42 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 5.90 MB (6182623) - PeakReservation: 4.75 MB (4980736) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 50.744us - TotalNetworkSendTime: 380.836us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 679 (679) - TotalThreadsTotalWallClockTime: 1s028ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 496.000ms - TotalThreadsVoluntaryContextSwitches: 57 (57) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 456.875us - ExecTreeExecTime: 46.573us - OpenTime: 1s024ms - ExecTreeOpenTime: 3.199ms - PrepareTime: 353.834us - ExecTreePrepareTime: 213.147us KrpcDataStreamSender (dst_id=35):(Total: 433.965us, non-child: 52.478us, % non-child: 12.09%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: 0.00 /sec (Number of samples: 0) - EosSent: 3 (3) - PeakMemoryUsage: 27.42 KB (28080) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 0 - UncompressedRowBatchSize: 0 HASH_JOIN_NODE (id=15):(Total: 3.633ms, non-child: 315.468us, % non-child: 8.68%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1s048ms - Open Started: 1s045ms (1s045ms) - Open Finished: 1s048ms (3.197ms) - First Batch Requested: 1s048ms (9.451us) - First Batch Returned: 1s048ms (4.542us) - Last Batch Returned: 1s048ms (9.810us) - Closed: 1s048ms (483.024us) - BuildRows: 1 (1) - BuildTime: 165.794us - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.18 MB (2287872) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 315.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 7.852us - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 2 (2) - PeakReservation: 2.12 MB (2228224) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 6.426us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.440us - BuildRowsPartitioned: 1 (1) - HashTablesBuildTime: 8.189us - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.12 KB (25728) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 1 (1) - HashCollisions: 0 (0) - Probes: 1 (1) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=34):(Total: 7.908us, non-child: 7.908us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s045ms - Open Started: 1s045ms (1s045ms) - Open Finished: 1s045ms (2.699us) - First Batch Requested: 1s045ms (151.234us) - First Batch Returned: 1s045ms (3.901us) - Last Batch Returned: 1s045ms (111.000ns) - Closed: 1s045ms (84.233us) - ConvertRowBatchTime: 626.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 126.45 K/sec Buffer pool: - AllocTime: 897.000ns - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 18.00 B (18) - TotalGetBatchTime: 2.834us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 10.938us ; Min: 10.938us ; Max: 10.938us ; Number of samples: 1) - DeserializeRowBatchTime: 3.116us - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 14.00 B (14) - TotalEarlySenders: 0 (0) - TotalEosReceived: 1 (1) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HASH_JOIN_NODE (id=14):(Total: 3.319ms, non-child: 2.837ms, % non-child: 85.48%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 1s048ms - Open Started: 1s045ms (1s045ms) - Open Finished: 1s048ms (3.057ms) - First Batch Requested: 1s048ms (3.434us) - First Batch Returned: 1s048ms (42.976us) - Last Batch Returned: 1s048ms (11.742us) - Closed: 1s048ms (506.363us) - BuildRows: 18.30K (18299) - BuildTime: 2.421ms - NullAwareAntiJoinEvalTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.69 MB (2816256) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 355.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 87.767us - CumulativeAllocationBytes: 2.44 MB (2555904) - CumulativeAllocations: 32 (32) - PeakReservation: 2.62 MB (2752512) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 2.44 MB (2555904) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 78.156us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 874.141us - BuildRowsPartitioned: 18.30K (18299) - HashTablesBuildTime: 1.415ms - LargestPartitionPercent: 64 (64) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 25.12 KB (25728) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 51.20K (51200) - HashCollisions: 0 (0) - Probes: 18.30K (18299) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=29):(Total: 340.865us, non-child: 340.865us, % non-child: 100.00%) Node Lifecycle Event Timeline: 1s048ms - Open Started: 1s045ms (1s045ms) - Open Finished: 1s045ms (2.312us) - First Batch Requested: 1s045ms (162.835us) - First Batch Returned: 1s045ms (22.236us) - Last Batch Returned: 1s046ms (1.174ms) - Closed: 1s048ms (1.536ms) - ConvertRowBatchTime: 270.739us - PeakMemoryUsage: 1016.00 KB (1040384) - RowsReturned: 18.30K (18299) - RowsReturnedRate: 53.68 M/sec Buffer pool: - AllocTime: 185.347us - CumulativeAllocationBytes: 1016.00 KB (1040384) - CumulativeAllocations: 116 (116) - PeakReservation: 1016.00 KB (1040384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1016.00 KB (1040384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 151.539us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 403.88 KB (413574) - TotalGetBatchTime: 41.661us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 55.006us ; Min: 8.865us ; Max: 619.642us ; Number of samples: 58) - DeserializeRowBatchTime: 455.294us - TotalBatchesEnqueued: 58 (58) - TotalBatchesReceived: 58 (58) - TotalBytesReceived: 180.59 KB (184927) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) HDFS_SCAN_NODE (id=6):(Total: 145.361us, non-child: 145.361us, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% ExecOption: Codegen enabled: 0 out of 0 Node Lifecycle Event Timeline: 1s048ms - Open Started: 1s045ms (1s045ms) - Open Finished: 1s045ms (64.998us) - First Batch Requested: 1s048ms (2.920ms) - First Batch Returned: 1s048ms (25.914us) - Last Batch Returned: 1s048ms (104.000ns) - Closed: 1s048ms (563.788us) - BytesRead (500.000ms): 0, 0 - InitialRangeActualReservation: 0 (Number of samples: 0) - InitialRangeIdealReservation: 0 (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 0 - PeakScannerThreadConcurrency: 0 (0) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 0 - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 1s021ms, non-child: 1s021ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 679 (679) - CodegenTotalWallClockTime: 1s021ms - CodegenSysTime: 0.000ns - CodegenUserTime: 496.000ms - CodegenVoluntaryContextSwitches: 48 (48) - CompileTime: 124.103ms - IrGenerationTime: 83.883ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 114 (114) - NumInstructions: 6.77K (6772) - OptimizationTime: 747.320ms - PeakMemoryUsage: 3.31 MB (3467264) - PrepareTime: 60.623ms Averaged Fragment F10:(Total: 855.934ms, non-child: 1.842ms, % non-child: 0.22%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s096ms max:5s253ms mean: 5s165ms stddev:65.574ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.08 MB (3231822) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.47 MB (581405133) - RowsProduced: 6.10K (6099) - TotalNetworkReceiveTime: 56.198ms - TotalNetworkSendTime: 3.826ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 239 (239) - TotalThreadsTotalWallClockTime: 859.134ms - TotalThreadsSysTime: 1.333ms - TotalThreadsUserTime: 244.000ms - TotalThreadsVoluntaryContextSwitches: 45 (45) Buffer pool: - AllocTime: 10.670us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 9.438us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 7.341ms - ExecTreeExecTime: 2.996ms - OpenTime: 845.725ms - ExecTreeOpenTime: 67.478ms - PrepareTime: 685.372us - ExecTreePrepareTime: 561.893us KrpcDataStreamSender (dst_id=29):(Total: 4.343ms, non-child: 4.343ms, % non-child: 100.00%) - EosSent: 1 (1) - PeakMemoryUsage: 18.28 KB (18720) - RowsSent: 6.10K (6099) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 291.757us - TotalBytesSent: 60.20 KB (61642) - UncompressedRowBatchSize: 134.63 KB (137858) HASH_JOIN_NODE (id=9):(Total: 71.545ms, non-child: 15.314ms, % non-child: 21.41%) - BuildRows: 2.43K (2433) - BuildTime: 5.939ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2074880) - ProbeRows: 3.67K (3666) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 271.416us - RowsReturned: 6.10K (6099) - RowsReturnedRate: 107.69 K/sec Buffer pool: - AllocTime: 44.844us - CumulativeAllocationBytes: 1.10 MB (1157802) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.10 MB (1157802) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 40.297us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 4.690ms - BuildRowsPartitioned: 2.43K (2433) - HashTablesBuildTime: 171.268us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.27K (4266) - HashCollisions: 0 (0) - Probes: 6.10K (6100) - Resizes: 0 (0) - Travel: 4.35K (4352) EXCHANGE_NODE (id=28):(Total: 41.518us, non-child: 41.518us, % non-child: 100.00%) - ConvertRowBatchTime: 26.740us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 2.43K (2433) - RowsReturnedRate: 58.67 M/sec Buffer pool: - AllocTime: 8.070us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.010us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 40.40 KB (41366) - TotalGetBatchTime: 5.314us - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 531.351us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 19.72 KB (20193) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=27):(Total: 56.235ms, non-child: 56.235ms, % non-child: 100.00%) - ConvertRowBatchTime: 38.083us - PeakMemoryUsage: 37.33 KB (38229) - RowsReturned: 3.67K (3666) - RowsReturnedRate: 95.12 K/sec Buffer pool: - AllocTime: 7.265us - CumulativeAllocationBytes: 58.67 KB (60074) - CumulativeAllocations: 3 (3) - PeakReservation: 37.33 KB (38229) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 37.33 KB (38229) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.886us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 53.526ms - TotalBytesDequeued: 46.55 KB (47666) - TotalGetBatchTime: 56.190ms - DataWaitTime: 56.187ms Enqueue: - DeserializeRowBatchTime: 33.873us - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 14.42 KB (14763) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 778.202ms, non-child: 778.202ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 239 (239) - CodegenTotalWallClockTime: 778.194ms - CodegenSysTime: 0.000ns - CodegenUserTime: 244.000ms - CodegenVoluntaryContextSwitches: 21 (21) - CompileTime: 174.172ms - IrGenerationTime: 47.721ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 62 (62) - NumInstructions: 2.84K (2842) - OptimizationTime: 486.163ms - PeakMemoryUsage: 1.39 MB (1455104) - PrepareTime: 68.524ms Fragment F10: Instance e0424d84963f6618:f98765590000001b (host=tarmstrong-box:22000):(Total: 901.251ms, non-child: 0.000ns, % non-child: 0.00%) Last report received time: 2019-11-03 17:15:39.894 Fragment Instance Lifecycle Event Timeline: 930.160ms - Prepare Finished: 30.320ms (30.320ms) - Open Finished: 917.283ms (886.962ms) - First Batch Produced: 917.318ms (34.993us) - First Batch Sent: 917.479ms (160.638us) - ExecInternal Finished: 930.160ms (12.681ms) - MemoryUsage (500.000ms): 2.45 MB, 2.47 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.11 MB (3264590) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 13.48K (13478) - TotalNetworkReceiveTime: 38.431ms - TotalNetworkSendTime: 3.280ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 282 (282) - TotalThreadsTotalWallClockTime: 914.596ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 252.000ms - TotalThreadsVoluntaryContextSwitches: 59 (59) Buffer pool: - AllocTime: 2.044us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 949.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 12.754ms - ExecTreeExecTime: 8.595ms - OpenTime: 886.956ms - ExecTreeOpenTime: 40.033ms - PrepareTime: 1.513ms - ExecTreePrepareTime: 1.404ms KrpcDataStreamSender (dst_id=29):(Total: 4.139ms, non-child: 854.619us, % non-child: 20.65%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 50.47 MB/sec ; Min: 2.98 MB/sec ; Max: 137.28 MB/sec ; Number of samples: 26) - EosSent: 1 (1) - PeakMemoryUsage: 18.28 KB (18720) - RowsSent: 13.48K (13478) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 536.514us - TotalBytesSent: 118.33 KB (121173) - UncompressedRowBatchSize: 286.18 KB (293049) HASH_JOIN_NODE (id=9):(Total: 51.372ms, non-child: 12.833ms, % non-child: 24.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 930.093ms - Open Started: 877.242ms (877.242ms) - Open Finished: 917.273ms (40.030ms) - First Batch Requested: 917.285ms (11.951us) - First Batch Returned: 917.318ms (32.896us) - Last Batch Returned: 929.878ms (12.560ms) - Closed: 930.093ms (215.542us) - BuildRows: 2.48K (2479) - BuildTime: 14.759ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2074880) - ProbeRows: 11.00K (11000) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 460.325us - RowsReturned: 13.48K (13478) - RowsReturnedRate: 262.36 K/sec Buffer pool: - AllocTime: 41.563us - CumulativeAllocationBytes: 1.12 MB (1179648) - CumulativeAllocations: 18 (18) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.12 MB (1179648) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 36.464us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.499ms - BuildRowsPartitioned: 2.48K (2479) - HashTablesBuildTime: 175.852us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.35K (4352) - HashCollisions: 0 (0) - Probes: 13.48K (13479) - Resizes: 0 (0) - Travel: 11.69K (11693) EXCHANGE_NODE (id=28):(Total: 41.885us, non-child: 41.885us, % non-child: 100.00%) Node Lifecycle Event Timeline: 901.696ms - Open Started: 886.811ms (886.811ms) - Open Finished: 886.814ms (3.254us) - First Batch Requested: 887.376ms (561.818us) - First Batch Returned: 887.391ms (14.661us) - Last Batch Returned: 900.876ms (13.484ms) - Closed: 901.696ms (820.716us) - ConvertRowBatchTime: 26.281us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 2.48K (2479) - RowsReturnedRate: 59.19 M/sec Buffer pool: - AllocTime: 8.636us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.414us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 41.16 KB (42143) - TotalGetBatchTime: 4.867us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 6.69 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 20.548us ; Min: 15.913us ; Max: 23.646us ; Number of samples: 3) - DeserializeRowBatchTime: 1.514ms - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 20.05 KB (20532) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=27):(Total: 38.545ms, non-child: 130.271us, % non-child: 0.34%) Node Lifecycle Event Timeline: 930.091ms - Open Started: 886.812ms (886.812ms) - Open Finished: 917.249ms (30.436ms) - First Batch Requested: 917.258ms (8.743us) - First Batch Returned: 917.272ms (14.290us) - Last Batch Returned: 926.674ms (9.401ms) - Closed: 930.091ms (3.416ms) - ConvertRowBatchTime: 112.755us - PeakMemoryUsage: 112.00 KB (114688) - RowsReturned: 11.00K (11000) - RowsReturnedRate: 285.38 K/sec Buffer pool: - AllocTime: 21.797us - CumulativeAllocationBytes: 176.00 KB (180224) - CumulativeAllocations: 10 (10) - PeakReservation: 112.00 KB (114688) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 112.00 KB (114688) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 17.658us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 30.433ms - TotalBytesDequeued: 139.65 KB (143000) - TotalGetBatchTime: 38.422ms - DataWaitTime: 38.415ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 20.000us ; Min: 12.855us ; Max: 28.770us ; Number of samples: 5) - DeserializeRowBatchTime: 101.619us - TotalBatchesEnqueued: 5 (5) - TotalBatchesReceived: 5 (5) - TotalBytesReceived: 43.25 KB (44289) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 846.887ms, non-child: 846.887ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 282 (282) - CodegenTotalWallClockTime: 846.878ms - CodegenSysTime: 0.000ns - CodegenUserTime: 252.000ms - CodegenVoluntaryContextSwitches: 28 (28) - CompileTime: 177.139ms - IrGenerationTime: 39.393ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 62 (62) - NumInstructions: 2.84K (2842) - OptimizationTime: 564.437ms - PeakMemoryUsage: 1.39 MB (1455104) - PrepareTime: 64.694ms Instance e0424d84963f6618:f98765590000001a (host=tarmstrong-box:22001):(Total: 879.042ms, non-child: 114.094us, % non-child: 0.01%) Last report received time: 2019-11-03 17:15:39.944 Fragment Instance Lifecycle Event Timeline: 928.946ms - Prepare Finished: 50.083ms (50.083ms) - Open Finished: 924.566ms (874.482ms) - First Batch Produced: 924.596ms (30.496us) - First Batch Sent: 924.621ms (25.061us) - ExecInternal Finished: 928.946ms (4.325ms) - MemoryUsage (500.000ms): 2.45 MB, 1.08 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.07 MB (3215438) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.42 MB (582398752) - RowsProduced: 2.45K (2447) - TotalNetworkReceiveTime: 77.283ms - TotalNetworkSendTime: 3.709ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 213 (213) - TotalThreadsTotalWallClockTime: 880.436ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 240.000ms - TotalThreadsVoluntaryContextSwitches: 29 (29) Buffer pool: - AllocTime: 16.577us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 15.189us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 4.256ms - ExecTreeExecTime: 196.286us - OpenTime: 874.477ms - ExecTreeOpenTime: 95.246ms - PrepareTime: 279.020us - ExecTreePrepareTime: 137.856us KrpcDataStreamSender (dst_id=29):(Total: 4.078ms, non-child: 366.993us, % non-child: 9.00%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 12.90 MB/sec ; Min: 6.25 MB/sec ; Max: 23.96 MB/sec ; Number of samples: 16) - EosSent: 1 (1) - PeakMemoryUsage: 18.28 KB (18720) - RowsSent: 2.45K (2447) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 169.084us - TotalBytesSent: 31.56 KB (32321) - UncompressedRowBatchSize: 59.74 KB (61175) HASH_JOIN_NODE (id=9):(Total: 95.671ms, non-child: 18.395ms, % non-child: 19.23%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 928.872ms - Open Started: 829.312ms (829.312ms) - Open Finished: 924.556ms (95.243ms) - First Batch Requested: 924.578ms (22.291us) - First Batch Returned: 924.596ms (18.011us) - Last Batch Returned: 928.481ms (3.885ms) - Closed: 928.872ms (391.564us) - BuildRows: 2.45K (2447) - BuildTime: 1.568ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2074880) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 176.625us - RowsReturned: 2.45K (2447) - RowsReturnedRate: 25.58 K/sec Buffer pool: - AllocTime: 50.776us - CumulativeAllocationBytes: 1.12 MB (1179648) - CumulativeAllocations: 18 (18) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.12 MB (1179648) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 45.775us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 309.631us - BuildRowsPartitioned: 2.45K (2447) - HashTablesBuildTime: 180.644us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.35K (4352) - HashCollisions: 0 (0) - Probes: 2.45K (2447) - Resizes: 0 (0) - Travel: 682 (682) EXCHANGE_NODE (id=28):(Total: 43.332us, non-child: 43.332us, % non-child: 100.00%) Node Lifecycle Event Timeline: 848.951ms - Open Started: 847.249ms (847.249ms) - Open Finished: 847.253ms (3.786us) - First Batch Requested: 847.833ms (579.427us) - First Batch Returned: 847.851ms (18.641us) - Last Batch Returned: 848.143ms (291.704us) - Closed: 848.951ms (808.185us) - ConvertRowBatchTime: 26.818us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 2.45K (2447) - RowsReturnedRate: 56.47 M/sec Buffer pool: - AllocTime: 4.058us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.405us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 40.62 KB (41599) - TotalGetBatchTime: 7.047us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 6.53 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 19.912us ; Min: 13.382us ; Max: 28.296us ; Number of samples: 3) - DeserializeRowBatchTime: 34.348us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 19.85 KB (20322) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=27):(Total: 77.280ms, non-child: 6.962us, % non-child: 0.01%) Node Lifecycle Event Timeline: 928.870ms - Open Started: 847.251ms (847.251ms) - Open Finished: 924.527ms (77.276ms) - First Batch Requested: 924.553ms (25.667us) - First Batch Returned: 924.555ms (1.923us) - Last Batch Returned: 924.555ms (185.000ns) - Closed: 928.870ms (4.314ms) - ConvertRowBatchTime: 727.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 77.273ms - TotalBytesDequeued: 0 - TotalGetBatchTime: 77.273ms - DataWaitTime: 77.273ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 779.177ms, non-child: 779.177ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 213 (213) - CodegenTotalWallClockTime: 779.170ms - CodegenSysTime: 0.000ns - CodegenUserTime: 240.000ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 226.057ms - IrGenerationTime: 45.107ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 62 (62) - NumInstructions: 2.84K (2842) - OptimizationTime: 471.709ms - PeakMemoryUsage: 1.39 MB (1455104) - PrepareTime: 35.220ms Instance e0424d84963f6618:f987655900000019 (host=tarmstrong-box:22002):(Total: 787.510ms, non-child: 6.561ms, % non-child: 0.83%) Last report received time: 2019-11-03 17:15:40.052 Fragment Instance Lifecycle Event Timeline: 930.119ms - Prepare Finished: 149.253ms (149.253ms) - Open Finished: 925.000ms (775.747ms) - First Batch Produced: 925.025ms (24.334us) - First Batch Sent: 925.051ms (26.086us) - ExecInternal Finished: 930.119ms (5.067ms) - MemoryUsage (500.000ms): 1.07 MB, 2.47 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.07 MB (3215438) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.88 MB (590222112) - RowsProduced: 2.37K (2374) - TotalNetworkReceiveTime: 52.880ms - TotalNetworkSendTime: 4.490ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 222 (222) - TotalThreadsTotalWallClockTime: 782.371ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 240.000ms - TotalThreadsVoluntaryContextSwitches: 47 (47) Buffer pool: - AllocTime: 13.389us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 12.176us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 5.014ms - ExecTreeExecTime: 199.382us - OpenTime: 775.741ms - ExecTreeOpenTime: 67.156ms - PrepareTime: 263.311us - ExecTreePrepareTime: 142.919us KrpcDataStreamSender (dst_id=29):(Total: 4.814ms, non-child: 320.799us, % non-child: 6.66%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 12.25 MB/sec ; Min: 4.61 MB/sec ; Max: 20.41 MB/sec ; Number of samples: 16) - EosSent: 1 (1) - PeakMemoryUsage: 18.28 KB (18720) - RowsSent: 2.37K (2374) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 169.675us - TotalBytesSent: 30.70 KB (31433) - UncompressedRowBatchSize: 57.96 KB (59350) HASH_JOIN_NODE (id=9):(Total: 67.592ms, non-child: 14.714ms, % non-child: 21.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 930.064ms - Open Started: 857.835ms (857.835ms) - Open Finished: 924.989ms (67.153ms) - First Batch Requested: 925.002ms (13.658us) - First Batch Returned: 925.024ms (22.160us) - Last Batch Returned: 929.313ms (4.288ms) - Closed: 930.064ms (750.783us) - BuildRows: 2.37K (2374) - BuildTime: 1.490ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2074880) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 177.300us - RowsReturned: 2.37K (2374) - RowsReturnedRate: 35.12 K/sec Buffer pool: - AllocTime: 42.195us - CumulativeAllocationBytes: 1.06 MB (1114112) - CumulativeAllocations: 17 (17) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.06 MB (1114112) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 38.653us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 263.014us - BuildRowsPartitioned: 2.37K (2374) - HashTablesBuildTime: 157.308us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 4.10K (4096) - HashCollisions: 0 (0) - Probes: 2.37K (2374) - Resizes: 0 (0) - Travel: 683 (683) EXCHANGE_NODE (id=28):(Total: 39.337us, non-child: 39.337us, % non-child: 100.00%) Node Lifecycle Event Timeline: 873.450ms - Open Started: 871.835ms (871.835ms) - Open Finished: 871.838ms (2.994us) - First Batch Requested: 872.390ms (552.267us) - First Batch Returned: 872.407ms (16.860us) - Last Batch Returned: 872.664ms (256.731us) - Closed: 873.450ms (786.703us) - ConvertRowBatchTime: 27.123us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 2.37K (2374) - RowsReturnedRate: 60.35 M/sec Buffer pool: - AllocTime: 11.518us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 8.211us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 39.41 KB (40358) - TotalGetBatchTime: 4.030us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 6.38 KB - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 25.061us ; Min: 17.121us ; Max: 33.481us ; Number of samples: 3) - DeserializeRowBatchTime: 45.523us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 19.26 KB (19726) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=27):(Total: 52.881ms, non-child: 8.427us, % non-child: 0.02%) Node Lifecycle Event Timeline: 930.061ms - Open Started: 872.078ms (872.078ms) - Open Finished: 924.956ms (52.877ms) - First Batch Requested: 924.985ms (29.356us) - First Batch Returned: 924.987ms (2.172us) - Last Batch Returned: 924.987ms (204.000ns) - Closed: 930.061ms (5.073ms) - ConvertRowBatchTime: 767.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 52.873ms - TotalBytesDequeued: 0 - TotalGetBatchTime: 52.874ms - DataWaitTime: 52.873ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 708.542ms, non-child: 708.542ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 222 (222) - CodegenTotalWallClockTime: 708.533ms - CodegenSysTime: 0.000ns - CodegenUserTime: 240.000ms - CodegenVoluntaryContextSwitches: 27 (27) - CompileTime: 119.319ms - IrGenerationTime: 58.664ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 62 (62) - NumInstructions: 2.84K (2842) - OptimizationTime: 422.343ms - PeakMemoryUsage: 1.39 MB (1455104) - PrepareTime: 105.659ms Averaged Fragment F08:(Total: 845.970ms, non-child: 134.554us, % non-child: 0.02%) split sizes: min: 134.88 KB, max: 179.57 KB, avg: 156.37 KB, stddev: 18.28 KB completion times: min:5s096ms max:5s254ms mean: 5s165ms stddev:65.787ms execution rates: min:26.46 KB/sec max:34.18 KB/sec mean:30.23 KB/sec stddev:3.15 KB/sec num instances: 3 - AverageThreadTokens: 1.83 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.09 - PeakMemoryUsage: 1.45 MB (1522976) - PeakReservation: 1.23 MB (1288874) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.51 MB (581443363) - RowsProduced: 3.67K (3666) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.032ms - TotalStorageWaitTime: 12.319ms - TotalThreadsInvoluntaryContextSwitches: 51 (51) - TotalThreadsTotalWallClockTime: 1s622ms - TotalThreadsSysTime: 1.333ms - TotalThreadsUserTime: 60.000ms - TotalThreadsVoluntaryContextSwitches: 75 (75) Buffer pool: - AllocTime: 11.748us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 10.568us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 603.129ms - ExecTreeExecTime: 601.790ms - OpenTime: 242.610ms - ExecTreeOpenTime: 70.944us - PrepareTime: 206.949us - ExecTreePrepareTime: 68.679us KrpcDataStreamSender (dst_id=27):(Total: 1.354ms, non-child: 1.354ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 104.78 KB (107296) - RowsSent: 3.67K (3666) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 109.800us - TotalBytesSent: 14.42 KB (14763) - UncompressedRowBatchSize: 46.55 KB (47666) HDFS_SCAN_NODE (id=7):(Total: 601.987ms, non-child: 601.987ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.67 - BytesRead: 156.37 KB (160121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 156.37 KB (160121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 156.37 KB (160121) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 9.424us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 0 (0) - NumRowGroups: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 238.67 KB (244394) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 78.37 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 14.67 KB (15018) - RowBatchQueueGetWaitTime: 5.705ms - RowBatchQueuePeakMemoryUsage: 37.33 KB (38229) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 11 (11) - RowsRead: 3.67K (3666) - RowsReturned: 3.67K (3666) - RowsReturnedRate: 6.42 K/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 12.319ms - ScannerThreadWorklessLoops: 36 (36) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 776.453ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 44 (44) - TotalRawHdfsOpenFileTime(*): 6.922us - TotalRawHdfsReadTime(*): 3.996ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 289.619us - CumulativeAllocationBytes: 224.00 KB (229376) - CumulativeAllocations: 3 (3) - PeakReservation: 234.67 KB (240298) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 170.67 KB (174762) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 286.168us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 3 (3) - Files rejected: 0 (0) - Files total: 3 (3) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) CodeGen:(Total: 242.493ms, non-child: 242.493ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 51 (51) - CodegenTotalWallClockTime: 242.486ms - CodegenSysTime: 1.333ms - CodegenUserTime: 60.000ms - CodegenVoluntaryContextSwitches: 22 (22) - CompileTime: 44.980ms - IrGenerationTime: 1.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 105.018ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 80.038ms Fragment F08: Instance e0424d84963f6618:f987655900000015 (host=tarmstrong-box:22000):(Total: 896.183ms, non-child: 130.752us, % non-child: 0.01%) Last report received time: 2019-11-03 17:15:39.893 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/134.88 KB Filter 0 arrival: 886ms Fragment Instance Lifecycle Event Timeline: 926.554ms - Prepare Finished: 30.413ms (30.413ms) - Open Finished: 192.110ms (161.697ms) - First Batch Produced: 917.071ms (724.960ms) - First Batch Sent: 917.111ms (39.640us) - ExecInternal Finished: 926.554ms (9.443ms) - MemoryUsage (500.000ms): 1.45 MB, 1.15 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.09 - PeakMemoryUsage: 1.45 MB (1522976) - PeakReservation: 1.19 MB (1245184) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 3.00K (3000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 661.735us - TotalStorageWaitTime: 17.285ms - TotalThreadsInvoluntaryContextSwitches: 15 (15) - TotalThreadsTotalWallClockTime: 1s229ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 60.000ms - TotalThreadsVoluntaryContextSwitches: 62 (62) Buffer pool: - AllocTime: 12.091us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 10.706us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 734.296ms - ExecTreeExecTime: 733.379ms - OpenTime: 161.693ms - ExecTreeOpenTime: 74.030us - PrepareTime: 177.156us - ExecTreePrepareTime: 51.467us KrpcDataStreamSender (dst_id=27):(Total: 933.439us, non-child: 270.507us, % non-child: 28.98%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 105.77 MB/sec ; Min: 105.77 MB/sec ; Max: 105.77 MB/sec ; Number of samples: 1) - EosSent: 3 (3) - PeakMemoryUsage: 104.78 KB (107296) - RowsSent: 3.00K (3000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 93.900us - TotalBytesSent: 11.79 KB (12073) - UncompressedRowBatchSize: 38.09 KB (39000) HDFS_SCAN_NODE (id=7):(Total: 733.542ms, non-child: 733.542ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:3/134.88 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 3 out of 3 Runtime filters: All filters arrived. Waited 724ms. Maximum arrival delay: 886ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/NONE:3 Node Lifecycle Event Timeline: 926.449ms - Open Started: 192.030ms (192.030ms) - Open Finished: 192.102ms (71.771us) - First Batch Requested: 192.112ms (10.162us) - First Batch Returned: 917.070ms (724.958ms) - Last Batch Returned: 925.610ms (8.540ms) - Closed: 926.449ms (838.833us) - BytesRead (500.000ms): 0, 0 - FooterProcessingTime: (Avg: 5.814ms ; Min: 729.630us ; Max: 8.403ms ; Number of samples: 3) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 3) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: 0 (Number of samples: 0) - ParquetRowGroupIdealReservation: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedPageSize: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 134.88 KB (138116) - BytesReadDataNodeCache: 0 - BytesReadLocal: 134.88 KB (138116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 134.88 KB (138116) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 3.778us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 0 (0) - NumRowGroups: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 196.00 KB (200704) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 110.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 12.00 KB (12288) - RowBatchQueueGetWaitTime: 9.275ms - RowBatchQueuePeakMemoryUsage: 28.00 KB (28672) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 9 (9) - RowsRead: 3.00K (3000) - RowsReturned: 3.00K (3000) - RowsReturnedRate: 4.09 K/sec - ScanRangesComplete: 3 (3) - ScannerIoWaitTime: 17.285ms - ScannerThreadWorklessLoops: 15 (15) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 333.523ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsOpenFileTime(*): 5.099us - TotalRawHdfsReadTime(*): 1.190ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 796.075us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 3 (3) - PeakReservation: 192.00 KB (196608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 793.091us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 3 (3) - Files rejected: 0 (0) - Files total: 3 (3) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 3 (3) - Splits rejected: 0 (0) - Splits total: 3 (3) CodeGen:(Total: 161.576ms, non-child: 161.576ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 15 (15) - CodegenTotalWallClockTime: 161.570ms - CodegenSysTime: 0.000ns - CodegenUserTime: 60.000ms - CodegenVoluntaryContextSwitches: 32 (32) - CompileTime: 14.587ms - IrGenerationTime: 1.675ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 83.778ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 59.756ms Instance e0424d84963f6618:f987655900000014 (host=tarmstrong-box:22001):(Total: 871.908ms, non-child: 124.688us, % non-child: 0.01%) Last report received time: 2019-11-03 17:15:39.945 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/154.66 KB Filter 0 arrival: 864ms Fragment Instance Lifecycle Event Timeline: 917.197ms - Prepare Finished: 45.363ms (45.363ms) - Open Finished: 308.406ms (263.043ms) - First Batch Produced: 913.910ms (605.503ms) - First Batch Sent: 913.951ms (41.222us) - ExecInternal Finished: 917.197ms (3.245ms) - MemoryUsage (500.000ms): 1.45 MB, 1.28 MB - ThreadUsage (500.000ms): 1, 4 - AverageThreadTokens: 2.50 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.10 - PeakMemoryUsage: 1.45 MB (1522976) - PeakReservation: 1.25 MB (1310720) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.47 MB (582447904) - RowsProduced: 4.00K (4000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.747ms - TotalStorageWaitTime: 12.984ms - TotalThreadsInvoluntaryContextSwitches: 84 (84) - TotalThreadsTotalWallClockTime: 2s128ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 56.000ms - TotalThreadsVoluntaryContextSwitches: 87 (87) Buffer pool: - AllocTime: 11.202us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 10.276us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 608.638ms - ExecTreeExecTime: 606.538ms - OpenTime: 263.040ms - ExecTreeOpenTime: 75.510us - PrepareTime: 206.318us - ExecTreePrepareTime: 74.405us KrpcDataStreamSender (dst_id=27):(Total: 2.105ms, non-child: 356.683us, % non-child: 16.94%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 19.77 MB/sec ; Min: 14.87 MB/sec ; Max: 24.68 MB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 104.78 KB (107296) - RowsSent: 4.00K (4000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 126.619us - TotalBytesSent: 15.73 KB (16108) - UncompressedRowBatchSize: 50.78 KB (52000) HDFS_SCAN_NODE (id=7):(Total: 606.757ms, non-child: 606.757ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/154.66 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 601ms. Maximum arrival delay: 864ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/NONE:4 Node Lifecycle Event Timeline: 917.089ms - Open Started: 308.325ms (308.325ms) - Open Finished: 308.398ms (73.285us) - First Batch Requested: 308.408ms (9.659us) - First Batch Returned: 913.899ms (605.491ms) - Last Batch Returned: 915.235ms (1.335ms) - Closed: 917.089ms (1.853ms) - BytesRead (500.000ms): 0, 0 - FooterProcessingTime: (Avg: 3.300ms ; Min: 1.085ms ; Max: 4.450ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 56.00 KB (57344) ; Min: 32.00 KB (32768) ; Max: 64.00 KB (65536) ; Number of samples: 4) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: 0 (Number of samples: 0) - ParquetRowGroupIdealReservation: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedPageSize: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.00 - BytesRead: 154.66 KB (158370) - BytesReadDataNodeCache: 0 - BytesReadLocal: 154.66 KB (158370) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 154.66 KB (158370) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 16.125us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 0 (0) - NumRowGroups: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 260.00 KB (266240) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 16.46 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 16.00 KB (16384) - RowBatchQueueGetWaitTime: 4.875ms - RowBatchQueuePeakMemoryUsage: 56.00 KB (57344) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 12 (12) - RowsRead: 4.00K (4000) - RowsReturned: 4.00K (4000) - RowsReturnedRate: 6.59 K/sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 12.984ms - ScannerThreadWorklessLoops: 60 (60) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 1s257ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 69 (69) - TotalRawHdfsOpenFileTime(*): 6.568us - TotalRawHdfsReadTime(*): 9.174ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 57.689us - CumulativeAllocationBytes: 224.00 KB (229376) - CumulativeAllocations: 4 (4) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 53.882us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 4 (4) - Files rejected: 0 (0) - Files total: 4 (4) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) CodeGen:(Total: 262.920ms, non-child: 262.920ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 84 (84) - CodegenTotalWallClockTime: 262.912ms - CodegenSysTime: 4.000ms - CodegenUserTime: 56.000ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 27.633ms - IrGenerationTime: 1.579ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 145.308ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 87.508ms Instance e0424d84963f6618:f987655900000013 (host=tarmstrong-box:22002):(Total: 769.818ms, non-child: 148.219us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:40.052 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/179.57 KB Filter 0 arrival: 766ms Fragment Instance Lifecycle Event Timeline: 917.235ms - Prepare Finished: 147.540ms (147.540ms) - Open Finished: 450.647ms (303.107ms) - First Batch Produced: 915.472ms (464.825ms) - First Batch Sent: 915.509ms (36.353us) - ExecInternal Finished: 917.235ms (1.726ms) - MemoryUsage (500.000ms): 1.08 MB, 1.21 MB - ThreadUsage (500.000ms): 1, 3 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.09 - PeakMemoryUsage: 1.45 MB (1522976) - PeakReservation: 1.25 MB (1310720) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.94 MB (590287648) - RowsProduced: 4.00K (4000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 688.031us - TotalStorageWaitTime: 6.688ms - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 1s508ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.000ms - TotalThreadsVoluntaryContextSwitches: 76 (76) Buffer pool: - AllocTime: 11.951us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 10.722us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 466.453ms - ExecTreeExecTime: 465.454ms - OpenTime: 303.096ms - ExecTreeOpenTime: 63.292us - PrepareTime: 237.373us - ExecTreePrepareTime: 80.165us KrpcDataStreamSender (dst_id=27):(Total: 1.023ms, non-child: 334.122us, % non-child: 32.65%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 34.20 MB/sec ; Min: 17.00 MB/sec ; Max: 51.40 MB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 104.78 KB (107296) - RowsSent: 4.00K (4000) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 108.882us - TotalBytesSent: 15.73 KB (16108) - UncompressedRowBatchSize: 50.78 KB (52000) HDFS_SCAN_NODE (id=7):(Total: 465.661ms, non-child: 465.661ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:4/179.57 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 4 out of 4 Runtime filters: All filters arrived. Waited 463ms. Maximum arrival delay: 766ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/NONE:4 Node Lifecycle Event Timeline: 917.133ms - Open Started: 450.570ms (450.570ms) - Open Finished: 450.631ms (61.719us) - First Batch Requested: 450.648ms (16.923us) - First Batch Returned: 915.472ms (464.823ms) - Last Batch Returned: 916.350ms (878.779us) - Closed: 917.133ms (783.051us) - BytesRead (500.000ms): 0, 0 - FooterProcessingTime: (Avg: 1.715ms ; Min: 579.592us ; Max: 2.579ms ; Number of samples: 4) - InitialRangeActualReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - InitialRangeIdealReservation: (Avg: 64.00 KB (65536) ; Min: 64.00 KB (65536) ; Max: 64.00 KB (65536) ; Number of samples: 4) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetCompressedPageSize: 0 (Number of samples: 0) - ParquetRowGroupActualReservation: 0 (Number of samples: 0) - ParquetRowGroupIdealReservation: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedPageSize: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 179.57 KB (183878) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.57 KB (183878) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.57 KB (183878) - CachedFileHandlesHitCount: 4 (4) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 0.000ns - MaterializeTupleTime(*): 8.371us - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 0 (0) - NumRowGroups: 0 (0) - NumRowGroupsWithPageIndex: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 260.00 KB (266240) - PeakScannerThreadConcurrency: 3 (3) - PerReadThreadRawHdfsThroughput: 108.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 16.00 KB (16384) - RowBatchQueueGetWaitTime: 2.964ms - RowBatchQueuePeakMemoryUsage: 28.00 KB (28672) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 12 (12) - RowsRead: 4.00K (4000) - RowsReturned: 4.00K (4000) - RowsReturnedRate: 8.59 K/sec - ScanRangesComplete: 4 (4) - ScannerIoWaitTime: 6.688ms - ScannerThreadWorklessLoops: 34 (34) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 738.599ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 41 (41) - TotalRawHdfsOpenFileTime(*): 9.101us - TotalRawHdfsReadTime(*): 1.623ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 15.095us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 4 (4) - PeakReservation: 256.00 KB (262144) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 11.532us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 0 (1.00 MB): - Files processed: 4 (4) - Files rejected: 0 (0) - Files total: 4 (4) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 4 (4) - Splits rejected: 0 (0) - Splits total: 4 (4) CodeGen:(Total: 302.984ms, non-child: 302.984ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 55 (55) - CodegenTotalWallClockTime: 302.976ms - CodegenSysTime: 0.000ns - CodegenUserTime: 64.000ms - CodegenVoluntaryContextSwitches: 26 (26) - CompileTime: 92.718ms - IrGenerationTime: 1.611ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 85.969ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 92.850ms Averaged Fragment F09:(Total: 594.521ms, non-child: 92.395us, % non-child: 0.02%) split sizes: min: 66.72 KB, max: 68.10 KB, avg: 67.27 KB, stddev: 609.98 B completion times: min:5s096ms max:5s253ms mean: 5s164ms stddev:65.486ms execution rates: min:12.96 KB/sec max:13.09 KB/sec mean:13.02 KB/sec stddev:54.26 B/sec num instances: 3 - AverageThreadTokens: 1.33 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 37.33 KB (38229) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.33 MB (581252216) - RowsProduced: 2.43K (2433) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.846ms - TotalStorageWaitTime: 304.457ms - TotalThreadsInvoluntaryContextSwitches: 41 (41) - TotalThreadsTotalWallClockTime: 918.655ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 49.333ms - TotalThreadsVoluntaryContextSwitches: 58 (58) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 325.426ms - ExecTreeExecTime: 323.276ms - OpenTime: 268.864ms - ExecTreeOpenTime: 83.867us - PrepareTime: 204.365us - ExecTreePrepareTime: 91.379us KrpcDataStreamSender (dst_id=28):(Total: 2.180ms, non-child: 2.180ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 126.66 KB (129696) - RowsSent: 2.43K (2433) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 111.699us - TotalBytesSent: 19.72 KB (20193) - UncompressedRowBatchSize: 40.40 KB (41366) HDFS_SCAN_NODE (id=8):(Total: 323.515ms, non-child: 323.515ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.67 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 81.28 KB (83234) - BytesReadDataNodeCache: 0 - BytesReadLocal: 81.28 KB (83234) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 81.28 KB (83234) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 7 (7) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 39.984us - MaterializeTupleTime(*): 307.940us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.00 KB (62464) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 391.62 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 72.00 KB (73728) - RowBatchQueueGetWaitTime: 314.194ms - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.43K (2433) - RowsReturned: 2.43K (2433) - RowsReturnedRate: 8.57 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 304.457ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 324.372ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 22 (22) - TotalRawHdfsOpenFileTime(*): 105.860ms - TotalRawHdfsReadTime(*): 223.203ms - TotalReadThroughput: 13.70 KB/sec Buffer pool: - AllocTime: 9.885ms - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 37.33 KB (38229) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 21.33 KB (21845) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 9.866ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 268.733ms, non-child: 268.733ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 37 (37) - CodegenTotalWallClockTime: 268.725ms - CodegenSysTime: 0.000ns - CodegenUserTime: 49.333ms - CodegenVoluntaryContextSwitches: 19 (19) - CompileTime: 69.418ms - IrGenerationTime: 2.960ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 99.049ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 93.129ms Fragment F09: Instance e0424d84963f6618:f987655900000018 (host=tarmstrong-box:22000):(Total: 787.173ms, non-child: 60.780us, % non-child: 0.01%) Last report received time: 2019-11-03 17:15:39.893 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.72 KB Fragment Instance Lifecycle Event Timeline: 845.162ms - Prepare Finished: 50.395ms (50.395ms) - Open Finished: 335.819ms (285.424ms) - First Batch Produced: 656.983ms (321.163ms) - First Batch Sent: 656.997ms (14.114us) - ExecInternal Finished: 845.162ms (188.165ms) - MemoryUsage (500.000ms): 272.16 KB, 79.49 KB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 2.42K (2420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 771.953us - TotalStorageWaitTime: 453.320ms - TotalThreadsInvoluntaryContextSwitches: 62 (62) - TotalThreadsTotalWallClockTime: 1s278ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 52.000ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 501.505ms - ExecTreeExecTime: 500.421ms - OpenTime: 285.420ms - ExecTreeOpenTime: 78.329us - PrepareTime: 223.099us - ExecTreePrepareTime: 109.574us KrpcDataStreamSender (dst_id=28):(Total: 1.128ms, non-child: 355.480us, % non-child: 31.50%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 56.84 MB/sec ; Min: 31.76 MB/sec ; Max: 75.10 MB/sec ; Number of samples: 3) - EosSent: 3 (3) - PeakMemoryUsage: 126.66 KB (129696) - RowsSent: 2.42K (2420) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 107.600us - TotalBytesSent: 19.60 KB (20071) - UncompressedRowBatchSize: 40.18 KB (41140) HDFS_SCAN_NODE (id=8):(Total: 500.682ms, non-child: 500.682ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.72 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 837.416ms - Open Started: 335.733ms (335.733ms) - Open Finished: 335.809ms (75.674us) - First Batch Requested: 335.820ms (11.735us) - First Batch Returned: 656.975ms (321.154ms) - Last Batch Returned: 836.393ms (179.418ms) - Closed: 837.416ms (1.022ms) - BytesRead (500.000ms): 0, 10.35 KB - FooterProcessingTime: (Avg: 50.456ms ; Min: 423.087us ; Max: 261.405ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.78 KB (1823) ; Min: 780.00 B (780) ; Max: 2.80 KB (2866) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 227.00 B (227) ; Min: 77.00 B (77) ; Max: 365.00 B (365) ; Number of samples: 16) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.01 KB (2061) ; Min: 1.27 KB (1296) ; Max: 2.76 KB (2826) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 257.00 B (257) ; Min: 161.00 B (161) ; Max: 360.00 B (360) ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 80.62 KB (82556) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.62 KB (82556) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.62 KB (82556) - CachedFileHandlesHitCount: 15 (15) - CachedFileHandlesMissCount: 9 (9) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 45.674us - MaterializeTupleTime(*): 98.042us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 53.00 KB (54272) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 265.51 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 72.00 KB (73728) - RowBatchQueueGetWaitTime: 489.363ms - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.42K (2420) - RowsReturned: 2.42K (2420) - RowsReturnedRate: 4.83 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 453.320ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 491.392ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 23 (23) - TotalRawHdfsOpenFileTime(*): 172.866ms - TotalRawHdfsReadTime(*): 303.643ms - TotalReadThroughput: 10.35 KB/sec Buffer pool: - AllocTime: 29.404ms - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 29.386ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 285.301ms, non-child: 285.301ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 60 (60) - CodegenTotalWallClockTime: 285.294ms - CodegenSysTime: 0.000ns - CodegenUserTime: 52.000ms - CodegenVoluntaryContextSwitches: 21 (21) - CompileTime: 89.971ms - IrGenerationTime: 3.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 112.738ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 68.189ms Instance e0424d84963f6618:f987655900000016 (host=tarmstrong-box:22002):(Total: 538.317ms, non-child: 111.736us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:40.051 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/68.10 KB Fragment Instance Lifecycle Event Timeline: 692.529ms - Prepare Finished: 154.263ms (154.263ms) - Open Finished: 470.985ms (316.722ms) - First Batch Produced: 592.270ms (121.285ms) - First Batch Sent: 592.286ms (15.627us) - ExecInternal Finished: 692.529ms (100.243ms) - MemoryUsage (500.000ms): 50.66 KB, 103.49 KB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.57 MB (589894432) - RowsProduced: 2.46K (2460) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.769ms - TotalStorageWaitTime: 197.641ms - TotalThreadsInvoluntaryContextSwitches: 19 (19) - TotalThreadsTotalWallClockTime: 754.106ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 68 (68) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 221.374ms - ExecTreeExecTime: 218.306ms - OpenTime: 316.719ms - ExecTreeOpenTime: 96.002us - PrepareTime: 195.977us - ExecTreePrepareTime: 82.458us KrpcDataStreamSender (dst_id=28):(Total: 3.090ms, non-child: 319.269us, % non-child: 10.33%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 66.45 MB/sec ; Min: 53.66 MB/sec ; Max: 91.74 MB/sec ; Number of samples: 3) - EosSent: 3 (3) - PeakMemoryUsage: 126.66 KB (129696) - RowsSent: 2.46K (2460) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 112.416us - TotalBytesSent: 19.96 KB (20441) - UncompressedRowBatchSize: 40.84 KB (41820) HDFS_SCAN_NODE (id=8):(Total: 218.541ms, non-child: 218.541ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/68.10 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:100% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 692.428ms - Open Started: 470.882ms (470.882ms) - Open Finished: 470.976ms (93.590us) - First Batch Requested: 470.986ms (10.240us) - First Batch Returned: 592.269ms (121.283ms) - Last Batch Returned: 689.426ms (97.156ms) - Closed: 692.428ms (3.002ms) - BytesRead (500.000ms): 0, 30.74 KB - FooterProcessingTime: (Avg: 21.196ms ; Min: 308.198us ; Max: 100.796ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.85 KB (1899) ; Min: 897.00 B (897) ; Max: 2.83 KB (2902) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 237.00 B (237) ; Min: 93.00 B (93) ; Max: 365.00 B (365) ; Number of samples: 16) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.04 KB (2087) ; Min: 1.28 KB (1312) ; Max: 2.79 KB (2862) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 260.00 B (260) ; Min: 161.00 B (161) ; Max: 360.00 B (360) ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 82.30 KB (84280) - BytesReadDataNodeCache: 0 - BytesReadLocal: 82.30 KB (84280) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 82.30 KB (84280) - CachedFileHandlesHitCount: 18 (18) - CachedFileHandlesMissCount: 6 (6) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 37.002us - MaterializeTupleTime(*): 722.924us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 53.00 KB (54272) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 519.33 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 72.00 KB (73728) - RowBatchQueueGetWaitTime: 215.216ms - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.46K (2460) - RowsReturned: 2.46K (2460) - RowsReturnedRate: 11.26 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 197.641ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 216.019ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsOpenFileTime(*): 51.643ms - TotalRawHdfsReadTime(*): 158.481ms - TotalReadThroughput: 30.74 KB/sec Buffer pool: - AllocTime: 40.255us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 21.310us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 316.573ms, non-child: 316.573ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 19 (19) - CodegenTotalWallClockTime: 316.566ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 30 (30) - CompileTime: 54.465ms - IrGenerationTime: 1.175ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 106.299ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 153.693ms Instance e0424d84963f6618:f987655900000017 (host=tarmstrong-box:22001):(Total: 458.074ms, non-child: 104.668us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.944 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.99 KB Fragment Instance Lifecycle Event Timeline: 525.607ms - Prepare Finished: 67.597ms (67.597ms) - Open Finished: 272.055ms (204.457ms) - First Batch Produced: 438.547ms (166.491ms) - First Batch Sent: 438.560ms (12.955us) - ExecInternal Finished: 525.607ms (87.047ms) - MemoryUsage (500.000ms): 272.16 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.24 - PeakMemoryUsage: 272.16 KB (278688) - PeakReservation: 48.00 KB (49152) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.29 MB (582267680) - RowsProduced: 2.42K (2420) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.998ms - TotalStorageWaitTime: 262.412ms - TotalThreadsInvoluntaryContextSwitches: 44 (44) - TotalThreadsTotalWallClockTime: 723.548ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 253.400ms - ExecTreeExecTime: 251.100ms - OpenTime: 204.454ms - ExecTreeOpenTime: 77.272us - PrepareTime: 194.019us - ExecTreePrepareTime: 82.106us KrpcDataStreamSender (dst_id=28):(Total: 2.324ms, non-child: 324.856us, % non-child: 13.98%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 70.42 MB/sec ; Min: 46.38 MB/sec ; Max: 89.94 MB/sec ; Number of samples: 3) - EosSent: 3 (3) - PeakMemoryUsage: 126.66 KB (129696) - RowsSent: 2.42K (2420) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 115.081us - TotalBytesSent: 19.60 KB (20068) - UncompressedRowBatchSize: 40.18 KB (41140) HDFS_SCAN_NODE (id=8):(Total: 251.321ms, non-child: 251.321ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:8/66.99 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:8 Node Lifecycle Event Timeline: 525.540ms - Open Started: 271.972ms (271.972ms) - Open Finished: 272.047ms (74.938us) - First Batch Requested: 272.057ms (9.810us) - First Batch Returned: 438.546ms (166.489ms) - Last Batch Returned: 523.287ms (84.741ms) - Closed: 525.540ms (2.253ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 22.669ms ; Min: 336.571us ; Max: 133.580ms ; Number of samples: 8) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - InitialRangeIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 1.80 KB (1840) ; Min: 832.00 B (832) ; Max: 2.78 KB (2848) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 230.00 B (230) ; Min: 97.00 B (97) ; Max: 365.00 B (365) ; Number of samples: 16) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 8) - ParquetUncompressedBytesReadPerColumn: (Avg: 2.00 KB (2048) ; Min: 1.26 KB (1288) ; Max: 2.74 KB (2808) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 256.00 B (256) ; Min: 149.00 B (149) ; Max: 360.00 B (360) ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 80.92 KB (82867) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.92 KB (82867) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.92 KB (82867) - CachedFileHandlesHitCount: 16 (16) - CachedFileHandlesMissCount: 8 (8) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 37.277us - MaterializeTupleTime(*): 102.854us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 16 (16) - NumRowGroups: 8 (8) - NumRowGroupsWithPageIndex: 8 (8) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 77.00 KB (78848) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 390.03 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 72.00 KB (73728) - RowBatchQueueGetWaitTime: 238.003ms - RowBatchQueuePeakMemoryUsage: 33.00 KB (33792) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 24 (24) - RowsRead: 2.42K (2420) - RowsReturned: 2.42K (2420) - RowsReturnedRate: 9.63 K/sec - ScanRangesComplete: 8 (8) - ScannerIoWaitTime: 262.412ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 5 (5) - ScannerThreadsTotalWallClockTime: 265.705ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 23 (23) - TotalRawHdfsOpenFileTime(*): 93.071ms - TotalRawHdfsReadTime(*): 207.485ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 212.806us - CumulativeAllocationBytes: 256.00 KB (262144) - CumulativeAllocations: 24 (24) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 192.684us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 204.324ms, non-child: 204.324ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 32 (32) - CodegenTotalWallClockTime: 204.316ms - CodegenSysTime: 0.000ns - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 8 (8) - CompileTime: 63.820ms - IrGenerationTime: 3.921ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 18 (18) - NumInstructions: 443 (443) - OptimizationTime: 78.110ms - PeakMemoryUsage: 221.50 KB (226816) - PrepareTime: 57.504ms Averaged Fragment F14:(Total: 905.565ms, non-child: 182.169us, % non-child: 0.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s096ms max:5s096ms mean: 5s096ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 68.80 KB (70448) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 807.297ms - TotalNetworkSendTime: 195.173us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 905.335ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 16.000ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 220.074us - ExecTreeExecTime: 2.667us - OpenTime: 905.118ms - ExecTreeOpenTime: 807.380ms - PrepareTime: 202.832us - ExecTreePrepareTime: 71.148us KrpcDataStreamSender (dst_id=34):(Total: 231.855us, non-child: 231.855us, % non-child: 100.00%) - EosSent: 1 (1) - PeakMemoryUsage: 12.80 KB (13104) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 5.810us - TotalBytesSent: 14.00 B (14) - UncompressedRowBatchSize: 18.00 B (18) AGGREGATION_NODE (id=33):(Total: 807.451ms, non-child: 147.979us, % non-child: 0.02%) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec NonGroupingAggregator 0: - BuildTime: 3.545us - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=32):(Total: 807.303ms, non-child: 807.303ms, % non-child: 100.00%) - ConvertRowBatchTime: 1.214us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 3 (3) - RowsReturnedRate: 3.00 /sec Buffer pool: - AllocTime: 7.294us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.908us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 805.362ms - TotalBytesDequeued: 54.00 B (54) - TotalGetBatchTime: 807.295ms - DataWaitTime: 807.290ms Enqueue: - DeserializeRowBatchTime: 15.863us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 42.00 B (42) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 97.699ms, non-child: 97.699ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 31 (31) - CodegenTotalWallClockTime: 97.694ms - CodegenSysTime: 0.000ns - CodegenUserTime: 16.000ms - CodegenVoluntaryContextSwitches: 9 (9) - CompileTime: 0.000ns - IrGenerationTime: 78.084us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 97.613ms Fragment F14: Instance e0424d84963f6618:f987655900000025 (host=tarmstrong-box:22000):(Total: 905.565ms, non-child: 182.169us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.893 Fragment Instance Lifecycle Event Timeline: 972.076ms - Prepare Finished: 66.705ms (66.705ms) - Open Finished: 971.829ms (905.123ms) - First Batch Produced: 971.832ms (3.291us) - First Batch Sent: 971.846ms (13.608us) - ExecInternal Finished: 972.076ms (230.593us) - MemoryUsage (500.000ms): 24.80 KB, 24.80 KB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 68.80 KB (70448) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 807.297ms - TotalNetworkSendTime: 195.173us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 31 (31) - TotalThreadsTotalWallClockTime: 905.335ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 16.000ms - TotalThreadsVoluntaryContextSwitches: 15 (15) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 220.074us - ExecTreeExecTime: 2.667us - OpenTime: 905.118ms - ExecTreeOpenTime: 807.380ms - PrepareTime: 202.832us - ExecTreePrepareTime: 71.148us KrpcDataStreamSender (dst_id=34):(Total: 231.855us, non-child: 36.392us, % non-child: 15.70%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 142.31 KB/sec ; Min: 142.31 KB/sec ; Max: 142.31 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 12.80 KB (13104) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 5.810us - TotalBytesSent: 14.00 B (14) - UncompressedRowBatchSize: 18.00 B (18) AGGREGATION_NODE (id=33):(Total: 807.451ms, non-child: 147.979us, % non-child: 0.02%) Node Lifecycle Event Timeline: 972.064ms - Open Started: 164.440ms (164.440ms) - Open Finished: 971.819ms (807.378ms) - First Batch Requested: 971.830ms (10.802us) - First Batch Returned: 971.831ms (1.396us) - Last Batch Returned: 971.831ms (127.000ns) - Closed: 972.064ms (232.989us) - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec NonGroupingAggregator 0: - BuildTime: 3.545us - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) EXCHANGE_NODE (id=32):(Total: 807.303ms, non-child: 13.258us, % non-child: 0.00%) Node Lifecycle Event Timeline: 971.818ms - Open Started: 164.441ms (164.441ms) - Open Finished: 969.807ms (805.365ms) - First Batch Requested: 969.814ms (6.943us) - First Batch Returned: 971.751ms (1.936ms) - Last Batch Returned: 971.751ms (256.000ns) - Closed: 971.818ms (66.824us) - ConvertRowBatchTime: 1.214us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 3 (3) - RowsReturnedRate: 3.00 /sec Buffer pool: - AllocTime: 7.294us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.908us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 805.362ms - TotalBytesDequeued: 54.00 B (54) - TotalGetBatchTime: 807.295ms - DataWaitTime: 807.290ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 96.656us ; Min: 17.035us ; Max: 247.286us ; Number of samples: 3) - DeserializeRowBatchTime: 15.863us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 42.00 B (42) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 97.699ms, non-child: 97.699ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 31 (31) - CodegenTotalWallClockTime: 97.694ms - CodegenSysTime: 0.000ns - CodegenUserTime: 16.000ms - CodegenVoluntaryContextSwitches: 9 (9) - CompileTime: 0.000ns - IrGenerationTime: 78.084us - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 97.613ms Averaged Fragment F13:(Total: 843.649ms, non-child: 8.520ms, % non-child: 1.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s096ms max:5s252ms mean: 5s164ms stddev:65.557ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 3 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.05 MB (3199724) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.28 MB (581208525) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 97.052ms - TotalNetworkSendTime: 762.695us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 268 (268) - TotalThreadsTotalWallClockTime: 836.008ms - TotalThreadsSysTime: 1.333ms - TotalThreadsUserTime: 284.000ms - TotalThreadsVoluntaryContextSwitches: 24 (24) Buffer pool: - AllocTime: 7.900us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 6.492us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 854.728us - ExecTreeExecTime: 3.102us - OpenTime: 834.146ms - ExecTreeOpenTime: 98.041ms - PrepareTime: 6.952ms - ExecTreePrepareTime: 157.932us KrpcDataStreamSender (dst_id=32):(Total: 864.152us, non-child: 864.152us, % non-child: 100.00%) - EosSent: 1 (1) - PeakMemoryUsage: 12.80 KB (13104) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 2.874us - TotalBytesSent: 14.00 B (14) - UncompressedRowBatchSize: 18.00 B (18) AGGREGATION_NODE (id=13):(Total: 98.198ms, non-child: 18.853us, % non-child: 0.02%) - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 1 (1) - RowsReturnedRate: 55.00 /sec NonGroupingAggregator 0: - BuildTime: 362.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=12):(Total: 98.180ms, non-child: 1.128ms, % non-child: 1.15%) - BuildRows: 2 (2) - BuildTime: 925.297us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2080341) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 960.000ns - RowsReturned: 2 (2) - RowsReturnedRate: 11.00 /sec Buffer pool: - AllocTime: 4.861us - CumulativeAllocationBytes: 128.00 KB (131072) - CumulativeAllocations: 2 (2) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 128.00 KB (131072) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 3.165us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=12): - BuildRowsPartitionTime: 5.646us - BuildRowsPartitioned: 2 (2) - HashTablesBuildTime: 14.158us - LargestPartitionPercent: 66 (66) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.46 KB (18901) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 5 (5) - HashCollisions: 0 (0) - Probes: 3 (3) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=31):(Total: 10.639us, non-child: 10.639us, % non-child: 100.00%) - ConvertRowBatchTime: 1.093us - PeakMemoryUsage: 32.00 KB (32768) - RowsReturned: 2 (2) - RowsReturnedRate: 212.07 K/sec Buffer pool: - AllocTime: 6.908us - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 32.00 KB (32768) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 4.607us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 40.00 B (40) - TotalGetBatchTime: 3.041us - DataWaitTime: 0.000ns Enqueue: - DeserializeRowBatchTime: 16.105us - TotalBatchesEnqueued: 2 (2) - TotalBatchesReceived: 2 (2) - TotalBytesReceived: 28.00 B (28) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=30):(Total: 97.053ms, non-child: 97.053ms, % non-child: 100.00%) - ConvertRowBatchTime: 581.000ns - PeakMemoryUsage: 5.33 KB (5461) - RowsReturned: 0 (0) - RowsReturnedRate: 3.00 /sec Buffer pool: - AllocTime: 1.002us - CumulativeAllocationBytes: 5.33 KB (5461) - CumulativeAllocations: 0 (0) - PeakReservation: 5.33 KB (5461) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 5.33 KB (5461) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 652.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - FirstBatchWaitTime: 96.991ms - TotalBytesDequeued: 17.00 B (17) - TotalGetBatchTime: 97.047ms - DataWaitTime: 97.046ms Enqueue: - DeserializeRowBatchTime: 2.556us - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 13.00 B (13) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 736.066ms, non-child: 736.066ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 265 (265) - CodegenTotalWallClockTime: 736.059ms - CodegenSysTime: 1.333ms - CodegenUserTime: 281.333ms - CodegenVoluntaryContextSwitches: 19 (19) - CompileTime: 183.055ms - IrGenerationTime: 39.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 89 (89) - NumInstructions: 3.54K (3538) - OptimizationTime: 433.999ms - PeakMemoryUsage: 1.73 MB (1811456) - PrepareTime: 77.002ms Fragment F13: Instance e0424d84963f6618:f987655900000024 (host=tarmstrong-box:22000):(Total: 903.536ms, non-child: 13.330ms, % non-child: 1.48%) Last report received time: 2019-11-03 17:15:39.893 Fragment Instance Lifecycle Event Timeline: 972.272ms - Prepare Finished: 82.155ms (82.155ms) - Open Finished: 970.930ms (888.775ms) - First Batch Produced: 970.933ms (2.745us) - First Batch Sent: 970.946ms (12.657us) - ExecInternal Finished: 972.272ms (1.326ms) - MemoryUsage (500.000ms): 1.06 MB, 2.82 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.07 MB (3214743) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.05 MB (571529001) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 6.331ms - TotalNetworkSendTime: 1.056ms - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 297 (297) - TotalThreadsTotalWallClockTime: 890.875ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 292.000ms - TotalThreadsVoluntaryContextSwitches: 28 (28) Buffer pool: - AllocTime: 1.911us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 1.266ms - ExecTreeExecTime: 2.247us - OpenTime: 888.771ms - ExecTreeOpenTime: 6.541ms - PrepareTime: 8.448ms - ExecTreePrepareTime: 171.206us KrpcDataStreamSender (dst_id=32):(Total: 1.278ms, non-child: 221.182us, % non-child: 17.30%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 131.05 KB/sec ; Min: 131.05 KB/sec ; Max: 131.05 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 12.80 KB (13104) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 2.099us - TotalBytesSent: 14.00 B (14) - UncompressedRowBatchSize: 18.00 B (18) AGGREGATION_NODE (id=13):(Total: 6.711ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 972.220ms - Open Started: 964.382ms (964.382ms) - Open Finished: 970.921ms (6.539ms) - First Batch Requested: 970.931ms (10.155us) - First Batch Returned: 970.933ms (1.024us) - Last Batch Returned: 970.933ms (147.000ns) - Closed: 972.220ms (1.287ms) - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 1 (1) - RowsReturnedRate: 148.00 /sec NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 278.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=12):(Total: 6.734ms, non-child: 405.311us, % non-child: 6.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 970.921ms - Open Started: 964.384ms (964.384ms) - Open Finished: 970.846ms (6.462ms) - First Batch Requested: 970.859ms (12.865us) - First Batch Returned: 970.870ms (11.034us) - Last Batch Returned: 970.872ms (1.480us) - Closed: 970.921ms (49.159us) - BuildRows: 4 (4) - BuildTime: 748.532us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2083072) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 520.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 2.622us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 3 (3) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 5.370us - BuildRowsPartitioned: 4 (4) - HashTablesBuildTime: 19.568us - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 8 (8) - HashCollisions: 0 (0) - Probes: 4 (4) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=31):(Total: 13.358us, non-child: 13.358us, % non-child: 100.00%) Node Lifecycle Event Timeline: 965.323ms - Open Started: 964.484ms (964.484ms) - Open Finished: 964.486ms (2.793us) - First Batch Requested: 964.669ms (182.620us) - First Batch Returned: 964.678ms (9.044us) - Last Batch Returned: 964.678ms (139.000ns) - Closed: 965.323ms (644.402us) - ConvertRowBatchTime: 1.427us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 4 (4) - RowsReturnedRate: 299.45 K/sec Buffer pool: - AllocTime: 10.823us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 7.245us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 60.00 B (60) - TotalGetBatchTime: 4.629us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 29.00 B - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 24.394us ; Min: 20.168us ; Max: 27.261us ; Number of samples: 3) - DeserializeRowBatchTime: 22.195us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 40.00 B (40) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=30):(Total: 6.330ms, non-child: 6.450us, % non-child: 0.10%) Node Lifecycle Event Timeline: 970.918ms - Open Started: 964.489ms (964.489ms) - Open Finished: 970.816ms (6.327ms) - First Batch Requested: 970.843ms (27.283us) - First Batch Returned: 970.845ms (1.721us) - Last Batch Returned: 970.845ms (224.000ns) - Closed: 970.918ms (72.818us) - ConvertRowBatchTime: 516.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 6.324ms - TotalBytesDequeued: 0 - TotalGetBatchTime: 6.325ms - DataWaitTime: 6.324ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 882.192ms, non-child: 882.192ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 292 (292) - CodegenTotalWallClockTime: 882.184ms - CodegenSysTime: 0.000ns - CodegenUserTime: 288.000ms - CodegenVoluntaryContextSwitches: 25 (25) - CompileTime: 169.118ms - IrGenerationTime: 34.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 89 (89) - NumInstructions: 3.54K (3538) - OptimizationTime: 574.026ms - PeakMemoryUsage: 1.73 MB (1811456) - PrepareTime: 99.045ms Instance e0424d84963f6618:f987655900000023 (host=tarmstrong-box:22001):(Total: 889.273ms, non-child: 256.208us, % non-child: 0.03%) Last report received time: 2019-11-03 17:15:39.943 Fragment Instance Lifecycle Event Timeline: 970.046ms - Prepare Finished: 81.053ms (81.053ms) - Open Finished: 969.170ms (888.116ms) - First Batch Produced: 969.174ms (3.464us) - First Batch Sent: 969.182ms (8.880us) - ExecInternal Finished: 970.046ms (863.477us) - MemoryUsage (500.000ms): 1.06 MB, 1.09 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.07 MB (3214743) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.29 MB (582267680) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 221.858ms - TotalNetworkSendTime: 777.657us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 284 (284) - TotalThreadsTotalWallClockTime: 890.261ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 284.000ms - TotalThreadsVoluntaryContextSwitches: 22 (22) Buffer pool: - AllocTime: 12.148us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 10.762us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 799.028us - ExecTreeExecTime: 2.887us - OpenTime: 888.113ms - ExecTreeOpenTime: 223.290ms - PrepareTime: 342.675us - ExecTreePrepareTime: 134.663us KrpcDataStreamSender (dst_id=32):(Total: 807.107us, non-child: 29.054us, % non-child: 3.60%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 85.85 KB/sec ; Min: 85.85 KB/sec ; Max: 85.85 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 12.80 KB (13104) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 2.425us - TotalBytesSent: 14.00 B (14) - UncompressedRowBatchSize: 18.00 B (18) AGGREGATION_NODE (id=13):(Total: 223.424ms, non-child: 90.736us, % non-child: 0.04%) Node Lifecycle Event Timeline: 970.004ms - Open Started: 745.872ms (745.872ms) - Open Finished: 969.160ms (223.287ms) - First Batch Requested: 969.171ms (11.769us) - First Batch Returned: 969.173ms (1.462us) - Last Batch Returned: 969.173ms (242.000ns) - Closed: 970.004ms (830.543us) - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 1 (1) - RowsReturnedRate: 4.00 /sec NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 522.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=12):(Total: 223.333ms, non-child: 1.476ms, % non-child: 0.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 969.067ms - Open Started: 745.874ms (745.874ms) - Open Finished: 968.992ms (223.117ms) - First Batch Requested: 969.007ms (14.949us) - First Batch Returned: 969.024ms (16.865us) - Last Batch Returned: 969.026ms (2.232us) - Closed: 969.067ms (41.345us) - BuildRows: 4 (4) - BuildTime: 1.258ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.99 MB (2083072) - ProbeRows: 2 (2) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.947us - RowsReturned: 8 (8) - RowsReturnedRate: 35.00 /sec Buffer pool: - AllocTime: 11.961us - CumulativeAllocationBytes: 192.00 KB (196608) - CumulativeAllocations: 3 (3) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 192.00 KB (196608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 9.496us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.521us - BuildRowsPartitioned: 4 (4) - HashTablesBuildTime: 22.907us - LargestPartitionPercent: 100 (100) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 8 (8) - HashCollisions: 0 (0) - Probes: 6 (6) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=31):(Total: 11.878us, non-child: 11.878us, % non-child: 100.00%) Node Lifecycle Event Timeline: 748.462ms - Open Started: 747.112ms (747.112ms) - Open Finished: 747.113ms (1.702us) - First Batch Requested: 747.716ms (602.844us) - First Batch Returned: 747.725ms (8.691us) - Last Batch Returned: 747.725ms (148.000ns) - Closed: 748.462ms (736.871us) - ConvertRowBatchTime: 1.257us - PeakMemoryUsage: 48.00 KB (49152) - RowsReturned: 4 (4) - RowsReturnedRate: 336.76 K/sec Buffer pool: - AllocTime: 9.901us - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 48.00 KB (49152) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 48.00 KB (49152) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 6.577us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 60.00 B (60) - TotalGetBatchTime: 4.050us - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0, 33.00 B - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 51.742us ; Min: 27.275us ; Max: 84.932us ; Number of samples: 3) - DeserializeRowBatchTime: 26.121us - TotalBatchesEnqueued: 3 (3) - TotalBatchesReceived: 3 (3) - TotalBytesReceived: 44.00 B (44) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=30):(Total: 221.859ms, non-child: 10.039us, % non-child: 0.00%) Node Lifecycle Event Timeline: 969.065ms - Open Started: 747.106ms (747.106ms) - Open Finished: 968.796ms (221.690ms) - First Batch Requested: 968.823ms (27.007us) - First Batch Returned: 968.990ms (166.962us) - Last Batch Returned: 968.991ms (147.000ns) - Closed: 969.065ms (74.096us) - ConvertRowBatchTime: 776.000ns - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 2 (2) - RowsReturnedRate: 9.00 /sec Buffer pool: - AllocTime: 3.008us - CumulativeAllocationBytes: 16.00 KB (16384) - CumulativeAllocations: 2 (2) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.958us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0, 0 - FirstBatchWaitTime: 221.685ms - TotalBytesDequeued: 52.00 B (52) - TotalGetBatchTime: 221.851ms - DataWaitTime: 221.849ms Enqueue: - BytesReceived (500.000ms): 0, 0 - DeferredQueueSize (500.000ms): 0, 0 - DispatchTime: (Avg: 36.638us ; Min: 36.638us ; Max: 36.638us ; Number of samples: 1) - DeserializeRowBatchTime: 7.670us - TotalBatchesEnqueued: 1 (1) - TotalBatchesReceived: 1 (1) - TotalBytesReceived: 39.00 B (39) - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 664.785ms, non-child: 664.785ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 283 (283) - CodegenTotalWallClockTime: 664.778ms - CodegenSysTime: 0.000ns - CodegenUserTime: 280.000ms - CodegenVoluntaryContextSwitches: 16 (16) - CompileTime: 264.595ms - IrGenerationTime: 55.370ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 89 (89) - NumInstructions: 3.54K (3538) - OptimizationTime: 298.421ms - PeakMemoryUsage: 1.73 MB (1811456) - PrepareTime: 45.368ms Instance e0424d84963f6618:f987655900000022 (host=tarmstrong-box:22002):(Total: 738.139ms, non-child: 11.939ms, % non-child: 1.62%) Last report received time: 2019-11-03 17:15:40.051 Fragment Instance Lifecycle Event Timeline: 969.592ms - Prepare Finished: 243.338ms (243.338ms) - Open Finished: 968.897ms (725.558ms) - First Batch Produced: 968.911ms (14.250us) - First Batch Sent: 968.930ms (18.667us) - ExecInternal Finished: 969.592ms (662.924us) - MemoryUsage (500.000ms): 2.79 MB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 3.02 MB (3169687) - PeakReservation: 2.94 MB (3080192) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.50 MB (589828896) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 62.968ms - TotalNetworkSendTime: 453.744us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 223 (223) - TotalThreadsTotalWallClockTime: 726.890ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 276.000ms - TotalThreadsVoluntaryContextSwitches: 22 (22) Buffer pool: - AllocTime: 9.641us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 8.716us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 499.150us - ExecTreeExecTime: 4.172us - OpenTime: 725.553ms - ExecTreeOpenTime: 64.291ms - PrepareTime: 12.067ms - ExecTreePrepareTime: 167.929us KrpcDataStreamSender (dst_id=32):(Total: 506.851us, non-child: 52.673us, % non-child: 10.39%) ExecOption: Unpartitioned Sender Codegen Disabled: not needed - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 51.98 KB/sec ; Min: 51.98 KB/sec ; Max: 51.98 KB/sec ; Number of samples: 1) - EosSent: 1 (1) - PeakMemoryUsage: 12.80 KB (13104) - RowsSent: 1 (1) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 4.099us - TotalBytesSent: 14.00 B (14) - UncompressedRowBatchSize: 18.00 B (18) AGGREGATION_NODE (id=13):(Total: 64.460ms, non-child: 0.000ns, % non-child: 0.00%) Node Lifecycle Event Timeline: 969.449ms - Open Started: 904.597ms (904.597ms) - Open Finished: 968.886ms (64.289ms) - First Batch Requested: 968.907ms (21.485us) - First Batch Returned: 968.910ms (2.697us) - Last Batch Returned: 968.910ms (205.000ns) - Closed: 969.449ms (538.307us) - PeakMemoryUsage: 24.00 KB (24576) - RowsReturned: 1 (1) - RowsReturnedRate: 15.00 /sec NonGroupingAggregator 0: ExecOption: Codegen Enabled - BuildTime: 288.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 1 (1) HASH_JOIN_NODE (id=12):(Total: 64.471ms, non-child: 1.503ms, % non-child: 2.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously Node Lifecycle Event Timeline: 968.885ms - Open Started: 904.598ms (904.598ms) - Open Finished: 968.822ms (64.223ms) - First Batch Requested: 968.836ms (14.706us) - First Batch Returned: 968.839ms (2.509us) - Last Batch Returned: 968.839ms (190.000ns) - Closed: 968.885ms (46.296us) - BuildRows: 0 (0) - BuildTime: 768.457us - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.98 MB (2074880) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 415.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 1.94 MB (2031616) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Hash Join Builder (join_node_id=12): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.049us - BuildRowsPartitioned: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 13.12 KB (13440) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) Hash Table: - HashBuckets: 0 (0) - HashCollisions: 0 (0) - Probes: 0 (0) - Resizes: 0 (0) - Travel: 0 (0) EXCHANGE_NODE (id=31):(Total: 6.683us, non-child: 6.683us, % non-child: 100.00%) Node Lifecycle Event Timeline: 906.578ms - Open Started: 905.739ms (905.739ms) - Open Finished: 905.742ms (2.270us) - First Batch Requested: 906.337ms (595.100us) - First Batch Returned: 906.339ms (2.191us) - Last Batch Returned: 906.339ms (156.000ns) - Closed: 906.578ms (239.172us) - ConvertRowBatchTime: 596.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 0.000ns - TotalBytesDequeued: 0 - TotalGetBatchTime: 444.000ns - DataWaitTime: 0.000ns Enqueue: - BytesReceived (500.000ms): 0 - DeferredQueueSize (500.000ms): 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) EXCHANGE_NODE (id=30):(Total: 62.971ms, non-child: 6.612us, % non-child: 0.01%) Node Lifecycle Event Timeline: 968.881ms - Open Started: 905.824ms (905.824ms) - Open Finished: 968.791ms (62.967ms) - First Batch Requested: 968.819ms (27.289us) - First Batch Returned: 968.821ms (1.905us) - Last Batch Returned: 968.821ms (175.000ns) - Closed: 968.881ms (60.076us) - ConvertRowBatchTime: 452.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Dequeue: - BytesDequeued (500.000ms): 0 - FirstBatchWaitTime: 62.964ms - TotalBytesDequeued: 0 - TotalGetBatchTime: 62.965ms - DataWaitTime: 62.964ms Enqueue: - BytesReceived (500.000ms): 0 - DeferredQueueSize (500.000ms): 0 - DispatchTime: 0.000ns (Number of samples: 0) - DeserializeRowBatchTime: 0.000ns - TotalBatchesEnqueued: 0 (0) - TotalBatchesReceived: 0 (0) - TotalBytesReceived: 0 - TotalEarlySenders: 0 (0) - TotalEosReceived: 3 (3) - TotalHasDeferredRPCsTime: 0.000ns - TotalRPCsDeferred: 0 (0) CodeGen:(Total: 661.221ms, non-child: 661.221ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 221 (221) - CodegenTotalWallClockTime: 661.214ms - CodegenSysTime: 4.000ms - CodegenUserTime: 276.000ms - CodegenVoluntaryContextSwitches: 18 (18) - CompileTime: 115.453ms - IrGenerationTime: 28.569ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 89 (89) - NumInstructions: 3.54K (3538) - OptimizationTime: 429.549ms - PeakMemoryUsage: 1.73 MB (1811456) - PrepareTime: 86.592ms Averaged Fragment F11:(Total: 832.961ms, non-child: 2.833ms, % non-child: 0.34%) split sizes: min: 2.92 KB, max: 5.83 KB, avg: 3.89 KB, stddev: 1.38 KB completion times: min:5s095ms max:5s252ms mean: 5s164ms stddev:65.568ms execution rates: min:580.00 B/sec max:1.11 KB/sec mean:767.67 B/sec stddev:261.33 B/sec num instances: 3 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.40 MB (1466192) - PeakReservation: 1.02 MB (1070421) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.27 MB (581189411) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 898.161us - TotalStorageWaitTime: 362.436us - TotalThreadsInvoluntaryContextSwitches: 55 (55) - TotalThreadsTotalWallClockTime: 1s293ms - TotalThreadsSysTime: 2.666ms - TotalThreadsUserTime: 61.333ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Buffer pool: - AllocTime: 5.722us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 3.944us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 510.702ms - ExecTreeExecTime: 509.761ms - OpenTime: 315.739ms - ExecTreeOpenTime: 79.847us - PrepareTime: 3.815ms - ExecTreePrepareTime: 2.996ms KrpcDataStreamSender (dst_id=30):(Total: 1.634ms, non-child: 1.634ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 22.66 KB (23205) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 1.301us - TotalBytesSent: 13.00 B (13) - UncompressedRowBatchSize: 17.00 B (17) HDFS_SCAN_NODE (id=11):(Total: 512.884ms, non-child: 512.884ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 1.01 KB (1032) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.01 KB (1032) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.01 KB (1032) - CachedFileHandlesHitCount: 1 (1) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 5.577us - MaterializeTupleTime(*): 8.089us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 36.67 KB (37546) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 1.03 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 7.33 KB (7509) - RowBatchQueueGetWaitTime: 483.083us - RowBatchQueuePeakMemoryUsage: 15.33 KB (15701) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 1 (1) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 1.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 362.436us - ScannerThreadWorklessLoops: 22 (22) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 467.191ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 24 (24) - TotalRawHdfsOpenFileTime(*): 1.541us - TotalRawHdfsReadTime(*): 318.151us - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 1.460us - CumulativeAllocationBytes: 8.00 KB (8192) - CumulativeAllocations: 1 (1) - PeakReservation: 21.33 KB (21845) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 5.33 KB (5461) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 572.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 2 (1.00 MB): - Files processed: 1 (1) - Files rejected: 1 (1) - Files total: 1 (1) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 315.608ms, non-child: 315.608ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 55 (55) - CodegenTotalWallClockTime: 315.601ms - CodegenSysTime: 2.666ms - CodegenUserTime: 60.000ms - CodegenVoluntaryContextSwitches: 20 (20) - CompileTime: 90.818ms - IrGenerationTime: 3.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 143.109ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 76.837ms Fragment F11: Instance e0424d84963f6618:f98765590000001e (host=tarmstrong-box:22000):(Total: 896.637ms, non-child: 8.197ms, % non-child: 0.91%) Last report received time: 2019-11-03 17:15:39.893 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB Filter 2 arrival: 887ms Fragment Instance Lifecycle Event Timeline: 970.522ms - Prepare Finished: 82.001ms (82.001ms) - Open Finished: 428.613ms (346.612ms) - First Batch Produced: 969.420ms (540.806ms) - First Batch Sent: 969.422ms (1.406us) - ExecInternal Finished: 970.522ms (1.099ms) - MemoryUsage (500.000ms): 1.40 MB, 1.05 MB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.40 MB (1466192) - PeakReservation: 1.02 MB (1064960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.00 MB (571471657) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 897.111us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 54 (54) - TotalThreadsTotalWallClockTime: 1s178ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.000ms - TotalThreadsVoluntaryContextSwitches: 59 (59) Buffer pool: - AllocTime: 13.345us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 11.834us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 541.742ms - ExecTreeExecTime: 540.805ms - OpenTime: 346.609ms - ExecTreeOpenTime: 81.904us - PrepareTime: 227.836us - ExecTreePrepareTime: 67.468us KrpcDataStreamSender (dst_id=30):(Total: 970.543us, non-child: 72.386us, % non-child: 7.46%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: 0.00 /sec (Number of samples: 0) - EosSent: 3 (3) - PeakMemoryUsage: 21.33 KB (21840) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=11):(Total: 541.006ms, non-child: 541.006ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Runtime filters: All filters arrived. Waited 540ms. Maximum arrival delay: 887ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/Unknown(Skipped):1 Node Lifecycle Event Timeline: 970.390ms - Open Started: 428.526ms (428.526ms) - Open Finished: 428.605ms (79.121us) - First Batch Requested: 428.615ms (9.938us) - First Batch Returned: 969.419ms (540.804ms) - Last Batch Returned: 969.419ms (190.000ns) - Closed: 970.390ms (970.987us) - BytesRead (500.000ms): 0, 0 - InitialRangeActualReservation: 0 (Number of samples: 0) - InitialRangeIdealReservation: 0 (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.00 KB (20480) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 0 - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 14 (14) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 290.456ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 15 (15) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 2 (1.00 MB): - Files processed: 1 (1) - Files rejected: 1 (1) - Files total: 1 (1) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 346.462ms, non-child: 346.462ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 54 (54) - CodegenTotalWallClockTime: 346.455ms - CodegenSysTime: 0.000ns - CodegenUserTime: 60.000ms - CodegenVoluntaryContextSwitches: 40 (40) - CompileTime: 128.957ms - IrGenerationTime: 3.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 158.293ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 54.408ms Instance e0424d84963f6618:f98765590000001d (host=tarmstrong-box:22001):(Total: 854.427ms, non-child: 144.404us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.943 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB Filter 2 arrival: 854ms Fragment Instance Lifecycle Event Timeline: 966.261ms - Prepare Finished: 111.891ms (111.891ms) - Open Finished: 449.822ms (337.931ms) - First Batch Produced: 965.620ms (515.798ms) - First Batch Sent: 965.622ms (1.984us) - ExecInternal Finished: 966.261ms (639.014us) - MemoryUsage (500.000ms): 1.03 MB, 1.05 MB - ThreadUsage (500.000ms): 1, 2 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.00 - PeakMemoryUsage: 1.40 MB (1466192) - PeakReservation: 1.02 MB (1064960) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.29 MB (582267680) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 419.072us - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 74 (74) - TotalThreadsTotalWallClockTime: 1s356ms - TotalThreadsSysTime: 8.000ms - TotalThreadsUserTime: 56.000ms - TotalThreadsVoluntaryContextSwitches: 39 (39) Buffer pool: - AllocTime: 1.887us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 516.256ms - ExecTreeExecTime: 515.796ms - OpenTime: 337.928ms - ExecTreeOpenTime: 81.881us - PrepareTime: 218.469us - ExecTreePrepareTime: 62.892us KrpcDataStreamSender (dst_id=30):(Total: 491.052us, non-child: 70.986us, % non-child: 14.46%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: 0.00 /sec (Number of samples: 0) - EosSent: 3 (3) - PeakMemoryUsage: 21.33 KB (21840) - RowsSent: 0 (0) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 0.000ns - TotalBytesSent: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=11):(Total: 515.985ms, non-child: 515.985ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 0 out of 0 Runtime filters: All filters arrived. Waited 516ms. Maximum arrival delay: 854ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/Unknown(Skipped):1 Node Lifecycle Event Timeline: 966.144ms - Open Started: 449.735ms (449.735ms) - Open Finished: 449.815ms (79.843us) - First Batch Requested: 449.823ms (7.807us) - First Batch Returned: 965.618ms (515.795ms) - Last Batch Returned: 965.619ms (197.000ns) - Closed: 966.144ms (525.248us) - BytesRead (500.000ms): 0, 0 - InitialRangeActualReservation: 0 (Number of samples: 0) - InitialRangeIdealReservation: 0 (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: 0 (Number of samples: 0) - ParquetUncompressedBytesReadPerColumn: 0 (Number of samples: 0) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - MaterializeTupleTime(*): 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 20.00 KB (20480) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePeakMemoryUsage: 0 - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 0 (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 0.000ns - ScannerThreadWorklessLoops: 24 (24) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 501.960ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsOpenFileTime(*): 0.000ns - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 2 (1.00 MB): - Files processed: 1 (1) - Files rejected: 1 (1) - Files total: 1 (1) - RowGroups processed: 0 (0) - RowGroups rejected: 0 (0) - RowGroups total: 0 (0) - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) - Splits processed: 0 (0) - Splits rejected: 0 (0) - Splits total: 0 (0) CodeGen:(Total: 337.806ms, non-child: 337.806ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 74 (74) - CodegenTotalWallClockTime: 337.799ms - CodegenSysTime: 8.000ms - CodegenUserTime: 56.000ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 98.325ms - IrGenerationTime: 5.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 152.604ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 80.276ms Instance e0424d84963f6618:f98765590000001c (host=tarmstrong-box:22002):(Total: 747.819ms, non-child: 158.154us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:40.051 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/5.83 KB Filter 2 arrival: 745ms Fragment Instance Lifecycle Event Timeline: 970.265ms - Prepare Finished: 233.294ms (233.294ms) - Open Finished: 495.977ms (262.682ms) - First Batch Produced: 968.606ms (472.629ms) - First Batch Sent: 968.611ms (4.831us) - ExecInternal Finished: 970.265ms (1.654ms) - MemoryUsage (500.000ms): 1.05 MB - ThreadUsage (500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 1.40 MB (1466192) - PeakReservation: 1.03 MB (1081344) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.50 MB (589828896) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.378ms - TotalStorageWaitTime: 1.087ms - TotalThreadsInvoluntaryContextSwitches: 37 (37) - TotalThreadsTotalWallClockTime: 1s345ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 64.000ms - TotalThreadsVoluntaryContextSwitches: 49 (49) Buffer pool: - AllocTime: 1.936us - CumulativeAllocationBytes: 1.00 MB (1048576) - CumulativeAllocations: 1 (1) - PeakReservation: 1.00 MB (1048576) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 1.00 MB (1048576) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 1.00 MB (1048576) - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 474.110ms - ExecTreeExecTime: 472.680ms - OpenTime: 262.680ms - ExecTreeOpenTime: 75.758us - PrepareTime: 11.001ms - ExecTreePrepareTime: 8.858ms KrpcDataStreamSender (dst_id=30):(Total: 3.441ms, non-child: 2.062ms, % non-child: 59.92%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 289.62 KB/sec ; Min: 289.62 KB/sec ; Max: 289.62 KB/sec ; Number of samples: 1) - EosSent: 3 (3) - PeakMemoryUsage: 25.33 KB (25936) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 3.904us - TotalBytesSent: 39.00 B (39) - UncompressedRowBatchSize: 52.00 B (52) HDFS_SCAN_NODE (id=11):(Total: 481.662ms, non-child: 481.662ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/5.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 471ms. Maximum arrival delay: 745ms. Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:1 PARQUET/Unknown(Skipped):1 Node Lifecycle Event Timeline: 970.141ms - Open Started: 495.895ms (495.895ms) - Open Finished: 495.968ms (73.406us) - First Batch Requested: 495.978ms (9.595us) - First Batch Returned: 968.605ms (472.627ms) - Last Batch Returned: 968.664ms (59.028us) - Closed: 970.141ms (1.476ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 589.012us ; Min: 589.012us ; Max: 589.012us ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 2) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 3.02 KB (3097) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.02 KB (3097) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.02 KB (3097) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 5.577us - MaterializeTupleTime(*): 24.269us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 70.00 KB (71680) - PeakScannerThreadConcurrency: 2 (2) - PerReadThreadRawHdfsThroughput: 3.09 MB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 22.00 KB (22528) - RowBatchQueueGetWaitTime: 1.449ms - RowBatchQueuePeakMemoryUsage: 46.00 KB (47104) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 4.00 /sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 1.087ms - ScannerThreadWorklessLoops: 29 (29) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 609.159ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 33 (33) - TotalRawHdfsOpenFileTime(*): 4.624us - TotalRawHdfsReadTime(*): 954.455us - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 4.381us - CumulativeAllocationBytes: 24.00 KB (24576) - CumulativeAllocations: 3 (3) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.717us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Filter 2 (1.00 MB): - Files processed: 2 (2) - Files rejected: 1 (1) - Files total: 2 (2) - RowGroups processed: 1 (1) - RowGroups rejected: 0 (0) - RowGroups total: 1 (1) - Rows processed: 2 (2) - Rows rejected: 0 (0) - Rows total: 2 (2) - Splits processed: 1 (1) - Splits rejected: 0 (0) - Splits total: 1 (1) CodeGen:(Total: 262.557ms, non-child: 262.557ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 37 (37) - CodegenTotalWallClockTime: 262.548ms - CodegenSysTime: 0.000ns - CodegenUserTime: 64.000ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 45.172ms - IrGenerationTime: 1.852ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 30 (30) - NumInstructions: 757 (757) - OptimizationTime: 118.429ms - PeakMemoryUsage: 378.50 KB (387584) - PrepareTime: 95.827ms Averaged Fragment F12:(Total: 429.620ms, non-child: 147.625us, % non-child: 0.03%) split sizes: min: 2.92 KB, max: 5.83 KB, avg: 3.89 KB, stddev: 1.38 KB completion times: min:5s097ms max:5s253ms mean: 5s165ms stddev:65.046ms execution rates: min:580.00 B/sec max:1.11 KB/sec mean:767.33 B/sec stddev:261.22 B/sec num instances: 3 - AverageThreadTokens: 0.67 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 305.84 KB (313184) - PeakReservation: 21.33 KB (21845) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 554.37 MB (581295907) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11.970ms - TotalStorageWaitTime: 152.866ms - TotalThreadsInvoluntaryContextSwitches: 42 (42) - TotalThreadsTotalWallClockTime: 583.575ms - TotalThreadsSysTime: 1.333ms - TotalThreadsUserTime: 52.000ms - TotalThreadsVoluntaryContextSwitches: 37 (37) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 176.542ms - ExecTreeExecTime: 164.492ms - OpenTime: 252.816ms - ExecTreeOpenTime: 78.253us - PrepareTime: 234.974us - ExecTreePrepareTime: 65.459us KrpcDataStreamSender (dst_id=31):(Total: 12.095ms, non-child: 12.095ms, % non-child: 100.00%) - EosSent: 3 (3) - PeakMemoryUsage: 66.84 KB (68448) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 10.073us - TotalBytesSent: 28.00 B (28) - UncompressedRowBatchSize: 40.00 B (40) HDFS_SCAN_NODE (id=10):(Total: 164.687ms, non-child: 164.687ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.02 KB (4118) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.02 KB (4118) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.02 KB (4118) - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 2 (2) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 11.599us - MaterializeTupleTime(*): 23.646us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 48.34 KB (49497) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 42.29 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 9.33 KB (9557) - RowBatchQueueGetWaitTime: 154.661ms - RowBatchQueuePeakMemoryUsage: 26.00 KB (26624) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 4 (4) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 21.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 152.866ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 154.225ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 6 (6) - TotalRawHdfsOpenFileTime(*): 23.820ms - TotalRawHdfsReadTime(*): 134.301ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 490.014us - CumulativeAllocationBytes: 32.00 KB (32768) - CumulativeAllocations: 4 (4) - PeakReservation: 21.33 KB (21845) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 486.382us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 252.689ms, non-child: 252.689ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 41 (41) - CodegenTotalWallClockTime: 252.681ms - CodegenSysTime: 1.333ms - CodegenUserTime: 50.666ms - CodegenVoluntaryContextSwitches: 23 (23) - CompileTime: 57.595ms - IrGenerationTime: 12.594ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 20 (20) - NumInstructions: 486 (486) - OptimizationTime: 118.685ms - PeakMemoryUsage: 243.00 KB (248832) - PrepareTime: 62.840ms Fragment F12: Instance e0424d84963f6618:f987655900000021 (host=tarmstrong-box:22000):(Total: 581.227ms, non-child: 257.269us, % non-child: 0.04%) Last report received time: 2019-11-03 17:15:39.895 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB Fragment Instance Lifecycle Event Timeline: 680.706ms - Prepare Finished: 89.790ms (89.790ms) - Open Finished: 398.118ms (308.328ms) - First Batch Produced: 659.571ms (261.452ms) - First Batch Sent: 659.576ms (4.667us) - ExecInternal Finished: 680.706ms (21.130ms) - MemoryUsage (500.000ms): 62.84 KB, 87.74 KB - ThreadUsage (500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 305.84 KB (313184) - PeakReservation: 16.00 KB (16384) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 545.12 MB (571594537) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.985ms - TotalStorageWaitTime: 237.925ms - TotalThreadsInvoluntaryContextSwitches: 49 (49) - TotalThreadsTotalWallClockTime: 819.267ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 56.000ms - TotalThreadsVoluntaryContextSwitches: 58 (58) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 272.568ms - ExecTreeExecTime: 261.512ms - OpenTime: 308.323ms - ExecTreeOpenTime: 85.320us - PrepareTime: 317.669us - ExecTreePrepareTime: 51.260us KrpcDataStreamSender (dst_id=31):(Total: 11.098ms, non-child: 111.328us, % non-child: 1.00%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0, 0 - NetworkThroughput: (Avg: 48.61 KB/sec ; Min: 1.04 KB/sec ; Max: 96.18 KB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 66.84 KB (68448) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 10.659us - TotalBytesSent: 22.00 B (22) - UncompressedRowBatchSize: 30.00 B (30) HDFS_SCAN_NODE (id=10):(Total: 261.686ms, non-child: 261.686ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 670.797ms - Open Started: 398.021ms (398.021ms) - Open Finished: 398.104ms (82.745us) - First Batch Requested: 398.119ms (15.781us) - First Batch Returned: 659.570ms (261.450ms) - Last Batch Returned: 659.636ms (66.667us) - Closed: 670.797ms (11.160ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 222.656ms ; Min: 222.656ms ; Max: 222.656ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 2) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.02 KB (3089) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.02 KB (3089) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.02 KB (3089) - CachedFileHandlesHitCount: 1 (1) - CachedFileHandlesMissCount: 2 (2) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 5.125us - MaterializeTupleTime(*): 10.400us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 43.01 KB (44044) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 14.19 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 7.00 KB (7168) - RowBatchQueueGetWaitTime: 238.232ms - RowBatchQueuePeakMemoryUsage: 16.00 KB (16384) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 7.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 237.925ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 238.383ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsOpenFileTime(*): 33.512ms - TotalRawHdfsReadTime(*): 212.584ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 10.419us - CumulativeAllocationBytes: 24.00 KB (24576) - CumulativeAllocations: 3 (3) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 7.794us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 308.185ms, non-child: 308.185ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 49 (49) - CodegenTotalWallClockTime: 308.176ms - CodegenSysTime: 0.000ns - CodegenUserTime: 52.000ms - CodegenVoluntaryContextSwitches: 43 (43) - CompileTime: 66.422ms - IrGenerationTime: 16.550ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 20 (20) - NumInstructions: 486 (486) - OptimizationTime: 154.789ms - PeakMemoryUsage: 243.00 KB (248832) - PrepareTime: 69.364ms Instance e0424d84963f6618:f98765590000001f (host=tarmstrong-box:22002):(Total: 394.829ms, non-child: 107.517us, % non-child: 0.03%) Last report received time: 2019-11-03 17:15:40.051 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/5.83 KB Fragment Instance Lifecycle Event Timeline: 655.426ms - Prepare Finished: 233.865ms (233.865ms) - Open Finished: 449.567ms (215.701ms) - First Batch Produced: 596.282ms (146.715ms) - First Batch Sent: 596.288ms (5.605us) - ExecInternal Finished: 655.426ms (59.138ms) - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 305.84 KB (313184) - PeakReservation: 32.00 KB (32768) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 562.63 MB (589959968) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.233ms - TotalStorageWaitTime: 169.678ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 567.383ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 52.000ms - TotalThreadsVoluntaryContextSwitches: 33 (33) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 178.909ms - ExecTreeExecTime: 177.586ms - OpenTime: 215.694ms - ExecTreeOpenTime: 77.560us - PrepareTime: 187.623us - ExecTreePrepareTime: 69.368us KrpcDataStreamSender (dst_id=31):(Total: 1.363ms, non-child: 129.369us, % non-child: 9.49%) ExecOption: Hash Partitioned Sender Codegen Enabled - NetworkThroughput: (Avg: 134.69 KB/sec ; Min: 115.58 KB/sec ; Max: 153.80 KB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 66.84 KB (68448) - RowsSent: 4 (4) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 10.977us - TotalBytesSent: 40.00 B (40) - UncompressedRowBatchSize: 60.00 B (60) HDFS_SCAN_NODE (id=10):(Total: 177.787ms, non-child: 177.787ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:2/5.83 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:2 Node Lifecycle Event Timeline: 628.534ms - Open Started: 449.474ms (449.474ms) - Open Finished: 449.549ms (75.395us) - First Batch Requested: 449.569ms (19.614us) - First Batch Returned: 596.281ms (146.711ms) - Last Batch Returned: 627.163ms (30.881ms) - Closed: 628.534ms (1.371ms) - FooterProcessingTime: (Avg: 74.400ms ; Min: 16.769ms ; Max: 132.031ms ; Number of samples: 2) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 2) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 2) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 22.00 B (22) ; Min: 22.00 B (22) ; Max: 22.00 B (22) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 4) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 2) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 2) - ParquetUncompressedBytesReadPerColumn: (Avg: 18.00 B (18) ; Min: 18.00 B (18) ; Max: 18.00 B (18) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 4) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 6.03 KB (6178) - BytesReadDataNodeCache: 0 - BytesReadLocal: 6.03 KB (6178) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 6.03 KB (6178) - CachedFileHandlesHitCount: 3 (3) - CachedFileHandlesMissCount: 3 (3) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 18.060us - MaterializeTupleTime(*): 28.898us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 4 (4) - NumRowGroups: 2 (2) - NumRowGroupsWithPageIndex: 2 (2) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 51.00 KB (52224) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 40.64 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 14.00 KB (14336) - RowBatchQueueGetWaitTime: 171.746ms - RowBatchQueuePeakMemoryUsage: 31.00 KB (31744) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 6 (6) - RowsRead: 4 (4) - RowsReturned: 4 (4) - RowsReturnedRate: 22.00 /sec - ScanRangesComplete: 2 (2) - ScannerIoWaitTime: 169.678ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 172.789ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsOpenFileTime(*): 31.336ms - TotalRawHdfsReadTime(*): 148.436ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 1.451ms - CumulativeAllocationBytes: 48.00 KB (49152) - CumulativeAllocations: 6 (6) - PeakReservation: 32.00 KB (32768) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 1.446ms - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 215.571ms, non-child: 215.571ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 15 (15) - CodegenTotalWallClockTime: 215.563ms - CodegenSysTime: 0.000ns - CodegenUserTime: 52.000ms - CodegenVoluntaryContextSwitches: 16 (16) - CompileTime: 69.314ms - IrGenerationTime: 13.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 20 (20) - NumInstructions: 486 (486) - OptimizationTime: 70.740ms - PeakMemoryUsage: 243.00 KB (248832) - PrepareTime: 60.874ms Instance e0424d84963f6618:f987655900000020 (host=tarmstrong-box:22001):(Total: 312.803ms, non-child: 78.084us, % non-child: 0.02%) Last report received time: 2019-11-03 17:15:39.944 Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB Fragment Instance Lifecycle Event Timeline: 463.382ms - Prepare Finished: 138.603ms (138.603ms) - Open Finished: 373.036ms (234.432ms) - First Batch Produced: 427.374ms (54.337ms) - First Batch Sent: 427.379ms (5.111us) - ExecInternal Finished: 463.382ms (36.002ms) - MemoryUsage (500.000ms): 62.84 KB - ThreadUsage (500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - ExchangeScanRatio: 0.01 - PeakMemoryUsage: 305.84 KB (313184) - PeakReservation: 16.00 KB (16384) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 555.36 MB (582333216) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23.693ms - TotalStorageWaitTime: 50.995ms - TotalThreadsInvoluntaryContextSwitches: 61 (61) - TotalThreadsTotalWallClockTime: 364.076ms - TotalThreadsSysTime: 4.000ms - TotalThreadsUserTime: 48.000ms - TotalThreadsVoluntaryContextSwitches: 21 (21) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - SystemAllocTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 78.150ms - ExecTreeExecTime: 54.380ms - OpenTime: 234.429ms - ExecTreeOpenTime: 71.880us - PrepareTime: 199.631us - ExecTreePrepareTime: 75.754us KrpcDataStreamSender (dst_id=31):(Total: 23.823ms, non-child: 128.333us, % non-child: 0.54%) ExecOption: Hash Partitioned Sender Codegen Enabled - BytesSent (500.000ms): 0 - NetworkThroughput: (Avg: 72.56 KB/sec ; Min: 30.26 KB/sec ; Max: 114.87 KB/sec ; Number of samples: 2) - EosSent: 3 (3) - PeakMemoryUsage: 66.84 KB (68448) - RowsSent: 2 (2) - RpcFailure: 0 (0) - RpcRetry: 0 (0) - SerializeBatchTime: 8.584us - TotalBytesSent: 22.00 B (22) - UncompressedRowBatchSize: 30.00 B (30) HDFS_SCAN_NODE (id=10):(Total: 54.589ms, non-child: 54.589ms, % non-child: 100.00%) Hdfs split stats (<volume id>:<# splits>/<split lengths>): -1:1/2.92 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% File Formats: PARQUET/SNAPPY:1 Node Lifecycle Event Timeline: 451.250ms - Open Started: 372.954ms (372.954ms) - Open Finished: 373.024ms (69.888us) - First Batch Requested: 373.037ms (13.565us) - First Batch Returned: 427.373ms (54.335ms) - Last Batch Returned: 427.423ms (50.382us) - Closed: 451.250ms (23.827ms) - BytesRead (500.000ms): 0 - FooterProcessingTime: (Avg: 48.161ms ; Min: 48.161ms ; Max: 48.161ms ; Number of samples: 1) - InitialRangeActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - InitialRangeIdealReservation: (Avg: 8.00 KB (8192) ; Min: 8.00 KB (8192) ; Max: 8.00 KB (8192) ; Number of samples: 1) - PageIndexProcessingTime: 0.000ns (Number of samples: 0) - ParquetCompressedBytesReadPerColumn: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 2) - ParquetCompressedPageSize: (Avg: 11.00 B (11) ; Min: 11.00 B (11) ; Max: 11.00 B (11) ; Number of samples: 2) - ParquetRowGroupActualReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - ParquetRowGroupIdealReservation: (Avg: 16.00 KB (16384) ; Min: 16.00 KB (16384) ; Max: 16.00 KB (16384) ; Number of samples: 1) - ParquetUncompressedBytesReadPerColumn: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 2) - ParquetUncompressedPageSize: (Avg: 9.00 B (9) ; Min: 9.00 B (9) ; Max: 9.00 B (9) ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.02 KB (3089) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.02 KB (3089) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.02 KB (3089) - CachedFileHandlesHitCount: 2 (2) - CachedFileHandlesMissCount: 1 (1) - CollectionItemsRead: 0 (0) - DataCacheHitBytes: 0 - DataCacheHitCount: 0 (0) - DataCacheMissBytes: 0 - DataCacheMissCount: 0 (0) - DataCachePartialHitCount: 0 (0) - DecompressionTime: 11.613us - MaterializeTupleTime(*): 31.641us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumPages: 2 (2) - NumRowGroups: 1 (1) - NumRowGroupsWithPageIndex: 1 (1) - NumScannerThreadMemUnavailable: 0 (0) - NumScannerThreadReservationsDenied: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredPages: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 51.00 KB (52224) - PeakScannerThreadConcurrency: 1 (1) - PerReadThreadRawHdfsThroughput: 72.02 KB/sec - RemoteScanRanges: 0 (0) - RowBatchBytesEnqueued: 7.00 KB (7168) - RowBatchQueueGetWaitTime: 54.004ms - RowBatchQueuePeakMemoryUsage: 31.00 KB (31744) - RowBatchQueuePutWaitTime: 0.000ns - RowBatchesEnqueued: 3 (3) - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 36.00 /sec - ScanRangesComplete: 1 (1) - ScannerIoWaitTime: 50.995ms - ScannerThreadWorklessLoops: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 51.502ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsOpenFileTime(*): 6.611ms - TotalRawHdfsReadTime(*): 41.884ms - TotalReadThroughput: 0.00 /sec Buffer pool: - AllocTime: 8.324us - CumulativeAllocationBytes: 24.00 KB (24576) - CumulativeAllocations: 3 (3) - PeakReservation: 16.00 KB (16384) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 16.00 KB (16384) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - SystemAllocTime: 5.350us - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns CodeGen:(Total: 234.312ms, non-child: 234.312ms, % non-child: 100.00%) - CodegenInvoluntaryContextSwitches: 59 (59) - CodegenTotalWallClockTime: 234.305ms - CodegenSysTime: 4.000ms - CodegenUserTime: 48.000ms - CodegenVoluntaryContextSwitches: 10 (10) - CompileTime: 37.049ms - IrGenerationTime: 7.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 2.40 MB (2513968) - NumFunctions: 20 (20) - NumInstructions: 486 (486) - OptimizationTime: 130.525ms - PeakMemoryUsage: 243.00 KB (248832) - PrepareTime: 58.282ms