Query (id=e84a99bb0c926c46:9c59890200000000): Summary: Session ID: c465e34067e90cc:17c9d474a0783f83 Session Type: BEESWAX Start Time: 2017-04-04 10:48:26.134129000 End Time: 2017-04-04 11:10:03.863159000 Query Type: QUERY Query State: EXCEPTION Query Status: Cannot perform aggregation at node with id 30. Repartitioning did not reduce the size of a spilled partition. Repartitioning level 8. Number of rows 1. Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 07021cc117c56e4bbc0744b342fee6f5a8cce964) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.234.19:43634 Default Db: tpcds_10000_parquet Sql Statement: with ws as (select d_year AS ws_sold_year, ws_item_sk, ws_bill_customer_sk ws_customer_sk, sum(ws_quantity) ws_qty, sum(ws_wholesale_cost) ws_wc, sum(ws_sales_price) ws_sp from web_sales left join web_returns on wr_order_number=ws_order_number and ws_item_sk=wr_item_sk join date_dim on ws_sold_date_sk = d_date_sk where wr_order_number is null group by d_year, ws_item_sk, ws_bill_customer_sk ), cs as (select d_year AS cs_sold_year, cs_item_sk, cs_bill_customer_sk cs_customer_sk, sum(cs_quantity) cs_qty, sum(cs_wholesale_cost) cs_wc, sum(cs_sales_price) cs_sp from catalog_sales left join catalog_returns on cr_order_number=cs_order_number and cs_item_sk=cr_item_sk join date_dim on cs_sold_date_sk = d_date_sk where cr_order_number is null group by d_year, cs_item_sk, cs_bill_customer_sk ), ss as (select d_year AS ss_sold_year, ss_item_sk, ss_customer_sk, sum(ss_quantity) ss_qty, sum(ss_wholesale_cost) ss_wc, sum(ss_sales_price) ss_sp from store_sales left join store_returns on sr_ticket_number=ss_ticket_number and ss_item_sk=sr_item_sk join date_dim on ss_sold_date_sk = d_date_sk where sr_ticket_number is null group by d_year, ss_item_sk, ss_customer_sk ) select ss_item_sk, round(ss_qty/(coalesce(ws_qty+cs_qty,1)),2) ratio, ss_qty store_qty, ss_wc store_wholesale_cost, ss_sp store_sales_price, coalesce(ws_qty,0)+coalesce(cs_qty,0) other_chan_qty, coalesce(ws_wc,0)+coalesce(cs_wc,0) other_chan_wholesale_cost, coalesce(ws_sp,0)+coalesce(cs_sp,0) other_chan_sales_price from ss left join ws on (ws_sold_year=ss_sold_year and ws_item_sk=ss_item_sk and ws_customer_sk=ss_customer_sk) left join cs on (cs_sold_year=ss_sold_year and cs_item_sk=cs_item_sk and cs_customer_sk=ss_customer_sk) where coalesce(ws_qty,0)>0 and coalesce(cs_qty, 0)>0 and ss_sold_year=2000 order by ss_item_sk, ss_qty desc, ss_wc desc, ss_sp desc, other_chan_qty, other_chan_wholesale_cost, other_chan_sales_price, round(ss_qty/(coalesce(ws_qty+cs_qty,1)),2) limit 100 Coordinator: vd1309.halxg.cloudera.com:22000 Query Options (non default): MEM_LIMIT=10737418240,NUM_SCANNER_THREADS=1 Plan: ---------------- Estimated Per-Host Requirements: Memory=682.58GB VCores=4 PLAN-ROOT SINK | 38:MERGING-EXCHANGE [UNPARTITIONED] | order by: ss_item_sk ASC, ss_qty DESC, ss_wc DESC, ss_sp DESC, coalesce(ws_qty, 0) + coalesce(cs_qty, 0) ASC, coalesce(ws_wc, 0) + coalesce(cs_wc, 0) ASC, coalesce(ws_sp, 0) + coalesce(cs_sp, 0) ASC, round(ss_qty / (coalesce(ws_qty + cs_qty, 1)), 2) ASC | limit: 100 | hosts=7 per-host-mem=unavailable | tuple-ids=15 row-size=128B cardinality=100 | 20:TOP-N [LIMIT=100] | order by: ss_item_sk ASC, ss_qty DESC, ss_wc DESC, ss_sp DESC, coalesce(ws_qty, 0) + coalesce(cs_qty, 0) ASC, coalesce(ws_wc, 0) + coalesce(cs_wc, 0) ASC, coalesce(ws_sp, 0) + coalesce(cs_sp, 0) ASC, round(ss_qty / (coalesce(ws_qty + cs_qty, 1)), 2) ASC | hosts=7 per-host-mem=12.50KB | tuple-ids=15 row-size=128B cardinality=100 | 19:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | hash predicates: d_year = d_year, ss_customer_sk = cs_bill_customer_sk | other predicates: coalesce(sum(cs_quantity), 0) > 0 | hosts=7 per-host-mem=2.40GB | tuple-ids=3,8N,13N row-size=168B cardinality=5889461911 | |--37:EXCHANGE [HASH(d_year,cs_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 35:AGGREGATE [FINALIZE] | | output: sum:merge(cs_quantity), sum:merge(cs_wholesale_cost), sum:merge(cs_sales_price) | | group by: d_year, cs_item_sk, cs_bill_customer_sk | | having: coalesce(sum(cs_quantity), 0) > 0 | | hosts=7 per-host-mem=16.77GB | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 34:EXCHANGE [HASH(d_year,cs_item_sk,cs_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 17:AGGREGATE [STREAMING] | | output: sum(cs_quantity), sum(cs_wholesale_cost), sum(cs_sales_price) | | group by: d_year, cs_item_sk, cs_bill_customer_sk | | hosts=7 per-host-mem=16.77GB | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 16:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: cs_sold_date_sk = d_date_sk | | runtime filters: RF002 <- d_date_sk | | hosts=7 per-host-mem=3.21KB | | tuple-ids=10,11N,12 row-size=64B cardinality=292389050 | | | |--33:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=12 row-size=8B cardinality=373 | | | | | 14:SCAN HDFS [tpcds_10000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | table stats: 73049 rows total | | column stats: all | | parquet statistics predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | parquet dictionary predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | hosts=1 per-host-mem=16.00MB | | tuple-ids=12 row-size=8B cardinality=373 | | | 15:HASH JOIN [LEFT OUTER JOIN, BROADCAST] | | hash predicates: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number | | other predicates: cr_order_number IS NULL | | hosts=7 per-host-mem=2.36GB | | tuple-ids=10,11N row-size=56B cardinality=1439996471 | | | |--32:EXCHANGE [BROADCAST] | | | hosts=7 per-host-mem=0B | | | tuple-ids=11 row-size=16B cardinality=144003311 | | | | | 13:SCAN HDFS [tpcds_10000_parquet.catalog_returns, RANDOM] | | partitions=2104/2104 files=2104 size=106.77GB | | predicates: tpcds_10000_parquet.catalog_returns.cr_item_sk = tpcds_10000_parquet.catalog_returns.cr_item_sk | | table stats: 1440033112 rows total | | column stats: all | | parquet dictionary predicates: tpcds_10000_parquet.catalog_returns.cr_item_sk = tpcds_10000_parquet.catalog_returns.cr_item_sk | | hosts=7 per-host-mem=64.00MB | | tuple-ids=11 row-size=16B cardinality=144003311 | | | 12:SCAN HDFS [tpcds_10000_parquet.catalog_sales, RANDOM] | partitions=1837/1837 files=5055 size=971.94GB | predicates: tpcds_10000_parquet.catalog_sales.cs_item_sk = tpcds_10000_parquet.catalog_sales.cs_item_sk | runtime filters: RF002 -> cs_sold_date_sk | table stats: 14399964710 rows total | column stats: all | parquet dictionary predicates: tpcds_10000_parquet.catalog_sales.cs_item_sk = tpcds_10000_parquet.catalog_sales.cs_item_sk | hosts=7 per-host-mem=88.00MB | tuple-ids=10 row-size=40B cardinality=1439996471 | 36:EXCHANGE [HASH(d_year,ss_customer_sk)] | hosts=7 per-host-mem=0B | tuple-ids=3,8N row-size=112B cardinality=5889461911 | 18:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | hash predicates: d_year = d_year, ss_customer_sk = ws_bill_customer_sk, ss_item_sk = ws_item_sk | other predicates: coalesce(sum(ws_quantity), 0) > 0 | hosts=7 per-host-mem=12.07GB | tuple-ids=3,8N row-size=112B cardinality=5889461911 | |--31:EXCHANGE [HASH(d_year,ws_item_sk,ws_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 30:AGGREGATE [FINALIZE] | | output: sum:merge(ws_quantity), sum:merge(ws_wholesale_cost), sum:merge(ws_sales_price) | | group by: d_year, ws_item_sk, ws_bill_customer_sk | | having: coalesce(sum(ws_quantity), 0) > 0 | | hosts=7 per-host-mem=84.47GB | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 29:EXCHANGE [HASH(d_year,ws_item_sk,ws_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 11:AGGREGATE [STREAMING] | | output: sum(ws_quantity), sum(ws_wholesale_cost), sum(ws_sales_price) | | group by: d_year, ws_item_sk, ws_bill_customer_sk | | hosts=7 per-host-mem=84.47GB | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ws_sold_date_sk = d_date_sk | | runtime filters: RF001 <- d_date_sk | | hosts=7 per-host-mem=3.21KB | | tuple-ids=5,6N,7 row-size=60B cardinality=1472360921 | | | |--28:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=7 row-size=8B cardinality=373 | | | | | 08:SCAN HDFS [tpcds_10000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | table stats: 73049 rows total | | column stats: all | | parquet statistics predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | parquet dictionary predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | hosts=1 per-host-mem=16.00MB | | tuple-ids=7 row-size=8B cardinality=373 | | | 09:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | | hash predicates: ws_item_sk = wr_item_sk, ws_order_number = wr_order_number | | other predicates: wr_order_number IS NULL | | hosts=7 per-host-mem=1.69GB | | tuple-ids=5,6N row-size=52B cardinality=7199963324 | | | |--27:EXCHANGE [HASH(wr_item_sk,wr_order_number)] | | | hosts=7 per-host-mem=0B | | | tuple-ids=6 row-size=16B cardinality=720020485 | | | | | 07:SCAN HDFS [tpcds_10000_parquet.web_returns, RANDOM] | | partitions=2185/2185 files=2190 size=52.11GB | | table stats: 720020485 rows total | | column stats: all | | hosts=7 per-host-mem=40.00MB | | tuple-ids=6 row-size=16B cardinality=720020485 | | | 26:EXCHANGE [HASH(ws_item_sk,ws_order_number)] | | hosts=7 per-host-mem=0B | | tuple-ids=5 row-size=36B cardinality=7199963324 | | | 06:SCAN HDFS [tpcds_10000_parquet.web_sales, RANDOM] | partitions=1824/1824 files=2900 size=508.98GB | runtime filters: RF001 -> ws_sold_date_sk | table stats: 7199963324 rows total | column stats: all | hosts=7 per-host-mem=88.00MB | tuple-ids=5 row-size=36B cardinality=7199963324 | 25:AGGREGATE [FINALIZE] | output: sum:merge(ss_quantity), sum:merge(ss_wholesale_cost), sum:merge(ss_sales_price) | group by: d_year, ss_item_sk, ss_customer_sk | having: d_year = 2000 | hosts=7 per-host-mem=337.88GB | tuple-ids=3 row-size=56B cardinality=5889461911 | 24:EXCHANGE [HASH(d_year,ss_item_sk,ss_customer_sk)] | hosts=7 per-host-mem=0B | tuple-ids=3 row-size=56B cardinality=5889461911 | 05:AGGREGATE [STREAMING] | output: sum(ss_quantity), sum(ss_wholesale_cost), sum(ss_sales_price) | group by: d_year, ss_item_sk, ss_customer_sk | hosts=7 per-host-mem=337.88GB | tuple-ids=3 row-size=56B cardinality=5889461911 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF000 <- d_date_sk | hosts=7 per-host-mem=3.21KB | tuple-ids=0,1N,2 row-size=60B cardinality=5889461911 | |--23:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=8B cardinality=373 | | | 02:SCAN HDFS [tpcds_10000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.15MB | predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | table stats: 73049 rows total | column stats: all | parquet statistics predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | parquet dictionary predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | hosts=1 per-host-mem=16.00MB | tuple-ids=2 row-size=8B cardinality=373 | 03:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | hash predicates: ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number | other predicates: sr_ticket_number IS NULL | hosts=7 per-host-mem=6.74GB | tuple-ids=0,1N row-size=52B cardinality=28799942425 | |--22:EXCHANGE [HASH(sr_item_sk,sr_ticket_number)] | | hosts=7 per-host-mem=0B | | tuple-ids=1 row-size=16B cardinality=2879765003 | | | 01:SCAN HDFS [tpcds_10000_parquet.store_returns, RANDOM] | partitions=2004/2004 files=2017 size=160.68GB | table stats: 2879765003 rows total | column stats: all | hosts=7 per-host-mem=88.00MB | tuple-ids=1 row-size=16B cardinality=2879765003 | 21:EXCHANGE [HASH(ss_item_sk,ss_ticket_number)] | hosts=7 per-host-mem=0B | tuple-ids=0 row-size=36B cardinality=28799942425 | 00:SCAN HDFS [tpcds_10000_parquet.store_sales, RANDOM] partitions=1824/1824 files=5994 size=1.35TB runtime filters: RF000 -> ss_sold_date_sk table stats: 28799942425 rows total column stats: all hosts=7 per-host-mem=88.00MB tuple-ids=0 row-size=36B cardinality=28799942425 ---------------- Estimated Per-Host Mem: 732914509771 Estimated Per-Host VCores: 4 Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 38:MERGING-EXCHANGE 1 0.000ns 0.000ns 0 100 4.00 KB -1.00 B UNPARTITIONED 20:TOP-N 7 120.700us 844.900us 0 100 8.00 KB 12.50 KB 19:HASH JOIN 7 21m34s 21m34s 0 5.89B 34.05 MB 2.40 GB LEFT OUTER JOIN, PARTITIONED |--37:EXCHANGE 7 0.000ns 0.000ns 0 292.39M 0 0 HASH(d_year,cs_bill_custome... | 35:AGGREGATE 7 0.000ns 0.000ns 0 292.39M 34.10 MB 16.77 GB FINALIZE | 34:EXCHANGE 7 7s132ms 7s921ms 775.04M 292.39M 0 0 HASH(d_year,cs_item_sk,cs_b... | 17:AGGREGATE 7 20s010ms 21s828ms 775.06M 292.39M 82.05 MB 16.77 GB STREAMING | 16:HASH JOIN 7 7s611ms 8s140ms 777.61M 292.39M 42.96 MB 3.21 KB INNER JOIN, BROADCAST | |--33:EXCHANGE 7 14.628us 26.120us 366 373 0 0 BROADCAST | | 14:SCAN HDFS 1 8.988ms 8.988ms 366 373 1.54 MB 16.00 MB tpcds_10000_parquet.date_dim | 15:HASH JOIN 7 7m49s 9m35s 777.62M 1.44B 5.44 GB 2.36 GB LEFT OUTER JOIN, BROADCAST | |--32:EXCHANGE 7 55s441ms 57s260ms 1.44B 144.00M 0 0 BROADCAST | | 13:SCAN HDFS 7 2m58s 3m46s 1.44B 144.00M 22.40 MB 64.00 MB tpcds_10000_parquet.catalog... | 12:SCAN HDFS 7 3m11s 3m52s 2.87B 1.44B 60.00 MB 88.00 MB tpcds_10000_parquet.catalog... 36:EXCHANGE 7 0.000ns 0.000ns 0 5.89B 0 0 HASH(d_year,ss_customer_sk) 18:HASH JOIN 7 21m34s 21m34s 0 5.89B 34.06 MB 12.07 GB LEFT OUTER JOIN, PARTITIONED |--31:EXCHANGE 7 0.000ns 0.000ns 0 1.47B 0 0 HASH(d_year,ws_item_sk,ws_b... | 30:AGGREGATE 7 3m55s 7m8s 1.02K 1.47B 898.04 MB 84.47 GB FINALIZE | 29:EXCHANGE 7 12s564ms 15s130ms 1.30B 1.47B 0 0 HASH(d_year,ws_item_sk,ws_b... | 11:AGGREGATE 7 42s099ms 44s281ms 1.30B 1.47B 34.48 MB 84.47 GB STREAMING | 10:HASH JOIN 7 6s005ms 6s153ms 1.30B 1.47B 34.31 MB 3.21 KB INNER JOIN, BROADCAST | |--28:EXCHANGE 7 23.393us 27.870us 366 373 0 0 BROADCAST | | 08:SCAN HDFS 1 9.894ms 9.894ms 366 373 1.54 MB 16.00 MB tpcds_10000_parquet.date_dim | 09:HASH JOIN 7 6m5s 8m43s 1.30B 7.20B 1.13 GB 1.69 GB LEFT OUTER JOIN, PARTITIONED | |--27:EXCHANGE 7 4s140ms 5s845ms 720.02M 720.02M 0 0 HASH(wr_item_sk,wr_order_nu... | | 07:SCAN HDFS 7 1m9s 1m53s 720.02M 720.02M 57.55 MB 40.00 MB tpcds_10000_parquet.web_ret... | 26:EXCHANGE 7 13s877ms 29s895ms 1.45B 7.20B 0 0 HASH(ws_item_sk,ws_order_nu... | 06:SCAN HDFS 7 2m5s 2m55s 1.45B 7.20B 62.03 MB 88.00 MB tpcds_10000_parquet.web_sales 25:AGGREGATE 7 0.000ns 0.000ns 0 5.89B 34.10 MB 337.88 GB FINALIZE 24:EXCHANGE 7 3s576ms 4s576ms 555.06M 5.89B 0 0 HASH(d_year,ss_item_sk,ss_c... 05:AGGREGATE 7 26s934ms 31s197ms 555.07M 5.89B 1.22 GB 337.88 GB STREAMING 04:HASH JOIN 7 3s824ms 3s927ms 629.49M 5.89B 34.77 MB 3.21 KB INNER JOIN, BROADCAST |--23:EXCHANGE 7 23.250us 33.316us 366 373 0 0 BROADCAST | 02:SCAN HDFS 1 11.191ms 11.191ms 366 373 1.54 MB 16.00 MB tpcds_10000_parquet.date_dim 03:HASH JOIN 7 3m49s 5m42s 629.49M 28.80B 2.01 GB 6.74 GB LEFT OUTER JOIN, PARTITIONED |--22:EXCHANGE 7 15s493ms 17s174ms 2.88B 2.88B 0 0 HASH(sr_item_sk,sr_ticket_n... | 01:SCAN HDFS 7 3m19s 4m4s 2.88B 2.88B 71.55 MB 88.00 MB tpcds_10000_parquet.store_r... 21:EXCHANGE 7 43s512ms 1m8s 5.53B 28.80B 0 0 HASH(ss_item_sk,ss_ticket_n... 00:SCAN HDFS 7 4m21s 6m29s 5.53B 28.80B 79.55 MB 88.00 MB tpcds_10000_parquet.store_s... Planner Timeline: 197.226ms - Analysis finished: 26.595ms (26.595ms) - Equivalence classes computed: 27.210ms (615.287us) - Single node plan created: 173.589ms (146.378ms) - Runtime filters computed: 173.755ms (165.347us) - Distributed plan created: 175.020ms (1.265ms) - Lineage info computed: 175.321ms (301.508us) - Planning finished: 197.226ms (21.904ms) Query Timeline: 21m37s - Query submitted: 577.478us (577.478us) - Planning finished: 367.975ms (367.398ms) - Submit for admission: 457.435ms (89.459ms) - Completed admission: 458.844ms (1.408ms) - Ready to start 88 fragment instances: 495.681ms (36.836ms) - First dynamic filter received: 1s177ms (681.420ms) - All 88 fragment instances started: 1s180ms (3.304ms) - Rows available: 21m36s (21m35s) - Unregister query: 21m37s (877.435ms) - ComputeScanRangeAssignmentTimer: 28.703ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile e84a99bb0c926c46:9c59890200000000:(Total: 21m36s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 2 16 12 7 LOCAL true 0 (7) N/A N/A true 1 10 6 7 REMOTE true 1 (3) N/A N/A true 0 4 0 7 REMOTE true 1 (3) N/A N/A true Fragment instance start latencies: Count: 88, min / max: 1ms / 625ms, 25th %-ile: 3ms, 50th %-ile: 16ms, 75th %-ile: 24ms, 90th %-ile: 248ms, 95th %-ile: 381ms, 99.9th %-ile: 625ms Per Node Peak Memory Usage: vd1310.halxg.cloudera.com:22000(8.26 GB) vd1313.halxg.cloudera.com:22000(8.25 GB) vd1312.halxg.cloudera.com:22000(8.23 GB) vd1311.halxg.cloudera.com:22000(8.27 GB) vd1314.halxg.cloudera.com:22000(8.27 GB) vd1316.halxg.cloudera.com:22000(8.28 GB) vd1309.halxg.cloudera.com:22000(8.25 GB) Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 2 16 12 7 LOCAL true 0 (7) N/A N/A true 1 10 6 7 REMOTE true 0 (3) 1s177ms 1s177ms false 0 4 0 7 REMOTE true 0 (3) 1s177ms 1s177ms false - FiltersReceived: 2 (2) - FinalizationTimer: 0.000ns Coordinator Fragment F15: Instance e84a99bb0c926c46:9c59890200000000 (host=vd1309.halxg.cloudera.com:22000):(Total: 25.502ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB, 17.59 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.53 MB (1601536) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 25.470ms - ExecTreePrepareTime: 42.426us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 167.075ms, non-child: 167.075ms, % non-child: 100.00%) - CodegenTime: 3.782ms - CompileTime: 39.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 115 (115) - NumInstructions: 3.11K (3112) - OptimizationTime: 107.521ms - PeakMemoryUsage: 1.52 MB (1593344) - PrepareTime: 19.705ms EXCHANGE_NODE (id=38): ExecOption: Codegen Enabled BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - MergeGetNext: 0.000ns - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F14:(Total: 83.092ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21m36s max:21m36s mean: 21m36s stddev:107.278ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 83.024ms - ExecTreePrepareTime: 711.607us DataStreamSender (dst_id=38):(Total: 448.811us, non-child: 448.811us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 523.754ms, non-child: 523.754ms, % non-child: 100.00%) - CodegenTime: 4.433ms - CompileTime: 134.488ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 318.247ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 70.477ms SORT_NODE (id=20):(Total: 710.781us, non-child: 0.000ns, % non-child: 0.00%) - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 835.637us, non-child: 21m34s, % non-child: 100.00%) - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F14: Instance e84a99bb0c926c46:9c59890200000055 (host=vd1313.halxg.cloudera.com:22000):(Total: 363.306ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 363.210ms - ExecTreePrepareTime: 2.147ms DataStreamSender (dst_id=38):(Total: 2.864ms, non-child: 2.864ms, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 1s089ms, non-child: 1s089ms, % non-child: 100.00%) - CodegenTime: 9.449ms - CompileTime: 247.548ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 507.247ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 334.295ms SORT_NODE (id=20):(Total: 2.146ms, non-child: 844.900us, % non-child: 39.37%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 1.301ms, non-child: 21m33s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000053 (host=vd1309.halxg.cloudera.com:22000):(Total: 46.377ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.321ms - ExecTreePrepareTime: 367.994us DataStreamSender (dst_id=38):(Total: 170.255us, non-child: 170.255us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 474.664ms, non-child: 474.664ms, % non-child: 100.00%) - CodegenTime: 4.144ms - CompileTime: 113.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 329.012ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 31.678ms SORT_NODE (id=20):(Total: 367.239us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 530.609us, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000052 (host=vd1311.halxg.cloudera.com:22000):(Total: 37.975ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 37.913ms - ExecTreePrepareTime: 840.920us DataStreamSender (dst_id=38):(Total: 21.723us, non-child: 21.723us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 426.974ms, non-child: 426.974ms, % non-child: 100.00%) - CodegenTime: 3.896ms - CompileTime: 120.054ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 277.650ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 28.753ms SORT_NODE (id=20):(Total: 840.015us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 1.491ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000054 (host=vd1314.halxg.cloudera.com:22000):(Total: 33.965ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.901ms - ExecTreePrepareTime: 780.013us DataStreamSender (dst_id=38):(Total: 26.117us, non-child: 26.117us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 407.288ms, non-child: 407.288ms, % non-child: 100.00%) - CodegenTime: 3.411ms - CompileTime: 117.446ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 264.432ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 24.939ms SORT_NODE (id=20):(Total: 779.085us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 1.400ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000057 (host=vd1312.halxg.cloudera.com:22000):(Total: 33.806ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.723ms - ExecTreePrepareTime: 351.210us DataStreamSender (dst_id=38):(Total: 23.698us, non-child: 23.698us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 413.351ms, non-child: 413.351ms, % non-child: 100.00%) - CodegenTime: 3.157ms - CompileTime: 123.262ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 264.688ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 24.906ms SORT_NODE (id=20):(Total: 350.217us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 418.969us, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000056 (host=vd1310.halxg.cloudera.com:22000):(Total: 33.775ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.723ms - ExecTreePrepareTime: 267.630us DataStreamSender (dst_id=38):(Total: 20.544us, non-child: 20.544us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 419.179ms, non-child: 419.179ms, % non-child: 100.00%) - CodegenTime: 3.161ms - CompileTime: 110.620ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 282.467ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 25.643ms SORT_NODE (id=20):(Total: 266.941us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 376.304us, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000051 (host=vd1316.halxg.cloudera.com:22000):(Total: 32.444ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.373ms - ExecTreePrepareTime: 226.106us DataStreamSender (dst_id=38):(Total: 14.981us, non-child: 14.981us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 434.931ms, non-child: 434.931ms, % non-child: 100.00%) - CodegenTime: 3.814ms - CompileTime: 109.060ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 302.232ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 23.127ms SORT_NODE (id=20):(Total: 225.751us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 330.293us, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 75.576ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21m36s max:21m36s mean: 21m36s stddev:106.176ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 88.09 MB (92364818) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 75.520ms - ExecTreePrepareTime: 1.836ms DataStreamSender (dst_id=36):(Total: 35.043us, non-child: 35.043us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 359.283ms, non-child: 359.283ms, % non-child: 100.00%) - CodegenTime: 2.497ms - CompileTime: 96.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 198.171ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 64.096ms HASH_JOIN_NODE (id=18):(Total: 3.572ms, non-child: 21m34s, % non-child: 100.00%) - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): - BytesReceived: 1.18 KB (1205) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.611ms, non-child: 0.000ns, % non-child: 0.00%) - BufferPoolAllocTime: 529.756ms - BufferPoolAllocationBytes: 4.25 GB (4560706413) - BufferPoolAllocations: 2.17K (2174) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4525054829) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4525054829) - BufferPoolWriteIoBytes: 4.21 GB (4525054829) - BufferPoolWriteIoOps: 2.16K (2157) - BufferPoolWriteIoWaitTime: 1m10s - BuildTime: 1m32s - GetResultsTime: 0.000ns - HTResizeTime: 9.450ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 19m59s, non-child: 19m59s, % non-child: 100.00%) - BytesReceived: 2.14 GB (2301238694) - ConvertRowBatchTime: 1s989ms - DeserializeRowBatchTimer: 18s630ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.29M (79294082) - RowsReturnedRate: 66.15 K/sec - SendersBlockedTimer: 9s320ms - SendersBlockedTotalTimer(*): 1m4s Fragment F04: Instance e84a99bb0c926c46:9c59890200000038 (host=vd1313.halxg.cloudera.com:22000):(Total: 329.307ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.16 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.22 MB, 70.43 MB, 72.53 MB, 69.39 MB, 68.21 MB, 68.54 MB, 69.16 MB, 68.81 MB, 68.28 MB, 69.36 MB, 68.31 MB, 68.21 MB, 68.37 MB, 69.84 MB, 68.38 MB, 68.28 MB, 68.39 MB, 69.37 MB, 68.30 MB, 68.18 MB, 68.20 MB, 68.21 MB, 68.21 MB, 68.18 MB, 68.19 MB, 68.23 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 329.265ms - ExecTreePrepareTime: 4.322ms DataStreamSender (dst_id=36):(Total: 46.528us, non-child: 46.528us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 749.806ms, non-child: 749.806ms, % non-child: 100.00%) - CodegenTime: 3.250ms - CompileTime: 127.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 316.986ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 304.859ms HASH_JOIN_NODE (id=18):(Total: 8.528ms, non-child: 21m33s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 4.077ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 563.250ms - BufferPoolAllocationBytes: 4.25 GB (4559208448) - BufferPoolAllocations: 2.17K (2174) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4523556864) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4523556864) - BufferPoolWriteIoBytes: 4.21 GB (4523556864) - BufferPoolWriteIoOps: 2.16K (2157) - BufferPoolWriteIoWaitTime: 1m14s - BuildTime: 1m34s - GetResultsTime: 0.000ns - HTResizeTime: 16.130ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 19m58s, non-child: 4s081ms, % non-child: 0.34%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.26 MB, 64.22 MB, 125.68 MB, 166.39 MB, 230.35 MB, 294.48 MB, 376.20 MB, 451.30 MB, 527.72 MB, 590.38 MB, 638.09 MB, 712.19 MB, 758.89 MB, 805.24 MB, 873.97 MB, 939.30 MB, 1004.79 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.53 GB - BytesReceived: 2.14 GB (2300946685) - ConvertRowBatchTime: 1s995ms - DeserializeRowBatchTimer: 12s807ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.28M (79284324) - RowsReturnedRate: 66.14 K/sec - SendersBlockedTimer: 5s358ms - SendersBlockedTotalTimer(*): 37s452ms Instance e84a99bb0c926c46:9c59890200000034 (host=vd1316.halxg.cloudera.com:22000):(Total: 38.622ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.43 MB, 68.21 MB, 68.25 MB, 68.38 MB, 70.35 MB, 69.75 MB, 68.79 MB, 71.43 MB, 69.41 MB, 78.79 MB, 70.10 MB, 69.49 MB, 68.31 MB, 68.30 MB, 68.37 MB, 68.24 MB, 68.18 MB, 68.20 MB, 68.20 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.25 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m55s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 38.537ms - ExecTreePrepareTime: 1.719ms DataStreamSender (dst_id=36):(Total: 34.703us, non-child: 34.703us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 324.713ms, non-child: 324.713ms, % non-child: 100.00%) - CodegenTime: 3.276ms - CompileTime: 104.332ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 192.630ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 27.168ms HASH_JOIN_NODE (id=18):(Total: 3.332ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.477ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 572.110ms - BufferPoolAllocationBytes: 4.25 GB (4563402752) - BufferPoolAllocations: 2.18K (2176) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.22 GB (4527751168) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.22 GB (4527751168) - BufferPoolWriteIoBytes: 4.22 GB (4527751168) - BufferPoolWriteIoOps: 2.16K (2159) - BufferPoolWriteIoWaitTime: 1m16s - BuildTime: 1m35s - GetResultsTime: 0.000ns - HTResizeTime: 8.029ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 19m55s, non-child: 1s354ms, % non-child: 0.11%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.00 MB, 63.50 MB, 125.02 MB, 165.98 MB, 229.57 MB, 293.68 MB, 375.38 MB, 450.44 MB, 526.77 MB, 589.75 MB, 637.37 MB, 711.33 MB, 758.34 MB, 804.35 MB, 873.17 MB, 938.43 MB, 1004.07 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.52 GB - BytesReceived: 2.14 GB (2301144463) - ConvertRowBatchTime: 2s001ms - DeserializeRowBatchTimer: 13s285ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.29M (79292934) - RowsReturnedRate: 66.35 K/sec - SendersBlockedTimer: 15s527ms - SendersBlockedTotalTimer(*): 1m48s Instance e84a99bb0c926c46:9c59890200000037 (host=vd1314.halxg.cloudera.com:22000):(Total: 38.095ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.16 MB, 68.50 MB, 68.61 MB, 68.75 MB, 68.40 MB, 68.37 MB, 68.36 MB, 68.24 MB, 68.40 MB, 68.27 MB, 68.20 MB, 68.21 MB, 68.23 MB, 68.46 MB, 68.30 MB, 68.36 MB, 68.19 MB, 68.19 MB, 68.58 MB, 68.19 MB, 68.17 MB, 68.16 MB, 68.16 MB, 68.18 MB, 68.19 MB, 68.28 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 81.62 MB (85585068) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m32s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 38.023ms - ExecTreePrepareTime: 1.688ms DataStreamSender (dst_id=36):(Total: 30.731us, non-child: 30.731us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 275.007ms, non-child: 275.007ms, % non-child: 100.00%) - CodegenTime: 2.375ms - CompileTime: 78.128ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 168.596ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 27.833ms HASH_JOIN_NODE (id=18):(Total: 3.264ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.432ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 400.953ms - BufferPoolAllocationBytes: 4.25 GB (4561305600) - BufferPoolAllocations: 2.17K (2175) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4525654016) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4525654016) - BufferPoolWriteIoBytes: 4.21 GB (4525654016) - BufferPoolWriteIoOps: 2.16K (2158) - BufferPoolWriteIoWaitTime: 39s244ms - BuildTime: 58s484ms - GetResultsTime: 0.000ns - HTResizeTime: 8.018ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 20m35s, non-child: 4s339ms, % non-child: 0.35%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.70 MB, 62.79 MB, 124.41 MB, 165.75 MB, 228.88 MB, 292.98 MB, 374.77 MB, 449.94 MB, 526.22 MB, 589.61 MB, 636.98 MB, 710.89 MB, 758.53 MB, 804.16 MB, 873.01 MB, 938.18 MB, 1004.02 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.51 GB - BytesReceived: 2.14 GB (2301589780) - ConvertRowBatchTime: 1s976ms - DeserializeRowBatchTimer: 12s996ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.31M (79307858) - RowsReturnedRate: 64.20 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c5989020000003a (host=vd1312.halxg.cloudera.com:22000):(Total: 34.608ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.17 MB, 68.41 MB, 68.22 MB, 68.22 MB, 68.58 MB, 68.35 MB, 68.38 MB, 68.20 MB, 68.92 MB, 68.22 MB, 68.60 MB, 68.26 MB, 68.18 MB, 68.45 MB, 68.29 MB, 68.19 MB, 68.28 MB, 68.21 MB, 68.21 MB, 68.19 MB, 68.19 MB, 68.19 MB, 68.19 MB, 68.19 MB, 68.19 MB, 68.22 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 81.87 MB (85846222) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 34.549ms - ExecTreePrepareTime: 1.442ms DataStreamSender (dst_id=36):(Total: 43.685us, non-child: 43.685us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 265.408ms, non-child: 265.408ms, % non-child: 100.00%) - CodegenTime: 1.892ms - CompileTime: 74.728ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 163.829ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 26.439ms HASH_JOIN_NODE (id=18):(Total: 2.777ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.204ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 601.811ms - BufferPoolAllocationBytes: 4.25 GB (4559208448) - BufferPoolAllocations: 2.17K (2174) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4523556864) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4523556864) - BufferPoolWriteIoBytes: 4.21 GB (4523556864) - BufferPoolWriteIoOps: 2.16K (2157) - BufferPoolWriteIoWaitTime: 32s293ms - BuildTime: 52s712ms - GetResultsTime: 0.000ns - HTResizeTime: 8.943ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 20m40s, non-child: 4s514ms, % non-child: 0.36%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.89 MB, 63.14 MB, 124.67 MB, 165.84 MB, 229.19 MB, 293.27 MB, 374.97 MB, 450.00 MB, 526.29 MB, 589.52 MB, 636.94 MB, 710.80 MB, 758.17 MB, 804.02 MB, 872.83 MB, 938.00 MB, 1003.75 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.51 GB - BytesReceived: 2.14 GB (2300830453) - ConvertRowBatchTime: 2s031ms - DeserializeRowBatchTimer: 14s526ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.28M (79282315) - RowsReturnedRate: 63.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance e84a99bb0c926c46:9c59890200000035 (host=vd1311.halxg.cloudera.com:22000):(Total: 33.117ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.31 MB, 68.47 MB, 68.93 MB, 72.35 MB, 71.56 MB, 71.61 MB, 70.75 MB, 68.60 MB, 72.10 MB, 68.56 MB, 68.50 MB, 68.42 MB, 68.19 MB, 68.32 MB, 68.28 MB, 68.66 MB, 68.18 MB, 68.40 MB, 68.78 MB, 68.27 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.23 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m52s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.052ms - ExecTreePrepareTime: 1.733ms DataStreamSender (dst_id=36):(Total: 32.548us, non-child: 32.548us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 297.548ms, non-child: 297.548ms, % non-child: 100.00%) - CodegenTime: 2.202ms - CompileTime: 102.025ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 170.880ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 24.269ms HASH_JOIN_NODE (id=18):(Total: 3.360ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.483ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 498.421ms - BufferPoolAllocationBytes: 4.25 GB (4561305600) - BufferPoolAllocations: 2.17K (2175) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4525654016) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4525654016) - BufferPoolWriteIoBytes: 4.21 GB (4525654016) - BufferPoolWriteIoOps: 2.16K (2158) - BufferPoolWriteIoWaitTime: 1m20s - BuildTime: 1m38s - GetResultsTime: 0.000ns - HTResizeTime: 9.139ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 19m52s, non-child: 1s852ms, % non-child: 0.16%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.02 MB, 63.55 MB, 124.99 MB, 165.92 MB, 229.52 MB, 293.68 MB, 375.38 MB, 450.44 MB, 526.78 MB, 589.74 MB, 637.30 MB, 711.27 MB, 758.40 MB, 804.39 MB, 873.17 MB, 938.43 MB, 1004.09 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.52 GB - BytesReceived: 2.14 GB (2301106664) - ConvertRowBatchTime: 1s884ms - DeserializeRowBatchTimer: 14s685ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.29M (79287768) - RowsReturnedRate: 66.51 K/sec - SendersBlockedTimer: 9s971ms - SendersBlockedTotalTimer(*): 1m9s Instance e84a99bb0c926c46:9c59890200000036 (host=vd1309.halxg.cloudera.com:22000):(Total: 28.899ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 71.49 MB, 70.59 MB, 71.75 MB, 79.03 MB, 69.08 MB, 69.88 MB, 69.62 MB, 68.40 MB, 68.26 MB, 68.20 MB, 68.64 MB, 69.69 MB, 68.28 MB, 68.19 MB, 70.31 MB, 72.35 MB, 68.68 MB, 68.41 MB, 68.36 MB, 68.21 MB, 68.18 MB, 68.18 MB, 68.18 MB, 68.19 MB, 68.19 MB, 68.28 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024498) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 18m51s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.869ms - ExecTreePrepareTime: 1.220ms DataStreamSender (dst_id=36):(Total: 32.247us, non-child: 32.247us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 335.270ms, non-child: 335.270ms, % non-child: 100.00%) - CodegenTime: 2.502ms - CompileTime: 112.279ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 203.409ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 19.029ms HASH_JOIN_NODE (id=18):(Total: 2.363ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 8.24 KB (8440) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.040ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 543.723ms - BufferPoolAllocationBytes: 4.25 GB (4559208448) - BufferPoolAllocations: 2.17K (2174) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4523556864) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4523556864) - BufferPoolWriteIoBytes: 4.21 GB (4523556864) - BufferPoolWriteIoOps: 2.16K (2157) - BufferPoolWriteIoWaitTime: 1m55s - BuildTime: 2m37s - GetResultsTime: 0.000ns - HTResizeTime: 8.034ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 18m53s, non-child: 4s576ms, % non-child: 0.40%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.00 MB, 63.49 MB, 125.09 MB, 166.10 MB, 229.68 MB, 293.70 MB, 375.43 MB, 450.54 MB, 526.82 MB, 589.79 MB, 637.36 MB, 711.36 MB, 758.53 MB, 804.54 MB, 873.29 MB, 938.55 MB, 1004.28 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.52 GB - BytesReceived: 2.14 GB (2301669314) - ConvertRowBatchTime: 2s014ms - DeserializeRowBatchTimer: 48s008ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.30M (79304704) - RowsReturnedRate: 69.96 K/sec - SendersBlockedTimer: 18s001ms - SendersBlockedTotalTimer(*): 2m3s Instance e84a99bb0c926c46:9c59890200000039 (host=vd1310.halxg.cloudera.com:22000):(Total: 26.387ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.14 MB, 68.67 MB, 68.46 MB, 68.74 MB, 68.44 MB, 68.49 MB, 68.25 MB, 69.20 MB, 68.52 MB, 68.25 MB, 68.40 MB, 68.28 MB, 69.99 MB, 79.87 MB, 68.26 MB, 68.58 MB, 68.78 MB, 68.26 MB, 68.36 MB, 68.19 MB, 68.19 MB, 68.20 MB, 68.21 MB, 68.21 MB, 68.18 MB, 68.18 MB, 68.24 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024498) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m58s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 26.343ms - ExecTreePrepareTime: 726.871us DataStreamSender (dst_id=36):(Total: 24.863us, non-child: 24.863us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 267.231ms, non-child: 267.231ms, % non-child: 100.00%) - CodegenTime: 1.984ms - CompileTime: 76.848ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 170.868ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 19.077ms HASH_JOIN_NODE (id=18):(Total: 1.381ms, non-child: 21m34s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 566.272us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 528.026ms - BufferPoolAllocationBytes: 4.25 GB (4561305600) - BufferPoolAllocations: 2.17K (2175) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 4.21 GB (4525654016) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.21 GB (4525654016) - BufferPoolWriteIoBytes: 4.21 GB (4525654016) - BufferPoolWriteIoOps: 2.16K (2158) - BufferPoolWriteIoWaitTime: 1m11s - BuildTime: 1m32s - GetResultsTime: 0.000ns - HTResizeTime: 7.860ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 20m1s, non-child: 4s318ms, % non-child: 0.36%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 9.99 MB, 63.48 MB, 125.00 MB, 166.00 MB, 229.63 MB, 293.71 MB, 375.38 MB, 450.47 MB, 526.78 MB, 589.71 MB, 637.24 MB, 711.24 MB, 758.37 MB, 804.36 MB, 873.17 MB, 938.42 MB, 1004.14 MB, 1.04 GB, 1.10 GB, 1.15 GB, 1.17 GB, 1.17 GB, 1.17 GB, 1.18 GB, 1.19 GB, 1.52 GB - BytesReceived: 2.14 GB (2301383502) - ConvertRowBatchTime: 2s027ms - DeserializeRowBatchTimer: 14s100ms - FirstBatchArrivalWaitTime: 7m41s - PeakMemoryUsage: 0 - RowsReturned: 79.30M (79298674) - RowsReturnedRate: 66.02 K/sec - SendersBlockedTimer: 16s385ms - SendersBlockedTotalTimer(*): 1m54s Averaged Fragment F02:(Total: 7m27s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21m36s max:21m36s mean: 21m36s stddev:104.886ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.35 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.92 GB (3131047936) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 2.92 GB (3132554971) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 79.30M (79295929) - TotalNetworkReceiveTime: 14m58s - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18.50K (18497) - TotalThreadsTotalWallClockTime: 14m54s - TotalThreadsSysTime: 6s124ms - TotalThreadsUserTime: 41s080ms - TotalThreadsVoluntaryContextSwitches: 364.49K (364486) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m22s - OpenTime: 7m27s - ExecTreeOpenTime: 7m26s - PrepareTime: 86.449ms - ExecTreePrepareTime: 2.429ms DataStreamSender (dst_id=24):(Total: 23s800ms, non-child: 23s800ms, % non-child: 100.00%) - BytesSent: 2.14 GB (2301239890) - NetworkThroughput(*): 334.06 MB/sec - OverallThroughput: 92.12 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 79.30M (79295645) - SerializeBatchTime: 17s180ms - TransmitDataRPCTime: 6s574ms - UncompressedRowBatchSize: 4.51 GB (4838086672) CodeGen:(Total: 495.847ms, non-child: 495.847ms, % non-child: 100.00%) - CodegenTime: 2.876ms - CompileTime: 145.208ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 318.783ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 31.122ms AGGREGATION_NODE (id=5):(Total: 19m49s, non-child: 26s934ms, % non-child: 2.26%) - BufferPoolAllocTime: 36.863ms - BufferPoolAllocationBytes: 1.19 GB (1277764754) - BufferPoolAllocations: 348 (348) - BufferPoolPeakReservation: 894.00 MB (937426944) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 894.00 MB (937426944) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s045ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 894.05 MB (937479296) - ReductionFactorEstimate: 81.22 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 79.30M (79295929) - RowsReturned: 79.30M (79295929) - RowsReturnedRate: 66.67 K/sec - StreamingTime: 29s649ms HASH_JOIN_NODE (id=4):(Total: 19m22s, non-child: 3s824ms, % non-child: 0.33%) - BufferPoolAllocTime: 1.250ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 7.629ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 89.93M (89927462) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s601ms - RowsReturned: 89.93M (89927023) - RowsReturnedRate: 77.36 K/sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 3.501ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 356.393us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 23.250us, non-child: 23.250us, % non-child: 100.00%) - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 11.274us - DeserializeRowBatchTimer: 15.501us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 16.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m18s, non-child: 3m49s, % non-child: 19.83%) - BufferPoolAllocTime: 3s409ms - BufferPoolAllocationBytes: 35.36 GB (37967438994) - BufferPoolAllocations: 16.72K (16717) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33999327817) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 586.86 MB (615364315) - BufferPoolReadIoOps: 293 (293) - BufferPoolReadIoWaitTime: 19s944ms - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33999327817) - BufferPoolWriteIoBytes: 31.66 GB (33999327817) - BufferPoolWriteIoOps: 16.21K (16212) - BufferPoolWriteIoWaitTime: 25s085ms - BuildRows: 411.39M (411395000) - BuildTime: 1m5s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158081336) - ProbeRows: 789.98M (789975808) - ProbeRowsPartitioned: 77.58M (77581302) - ProbeTime: 2m18s - RowsReturned: 89.93M (89927345) - RowsReturnedRate: 77.61 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 1m2s - BuildRowsPartitioned: 411.39M (411395000) - HashBuckets: 172.57M (172565650) - HashCollisions: 11.45M (11452904) - HashTablesBuildTime: 15s452ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m18s, non-child: 6m18s, % non-child: 100.00%) - BytesReceived: 5.85 GB (6286194714) - ConvertRowBatchTime: 9s772ms - DeserializeRowBatchTimer: 25s401ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.39M (411395000) - RowsReturnedRate: 1.09 M/sec - SendersBlockedTimer: 13s972ms - SendersBlockedTotalTimer(*): 1m28s EXCHANGE_NODE (id=21):(Total: 9m10s, non-child: 9m10s, % non-child: 100.00%) - BytesReceived: 21.24 GB (22806142063) - ConvertRowBatchTime: 18s018ms - DeserializeRowBatchTimer: 1m42s - FirstBatchArrivalWaitTime: 234.261ms - PeakMemoryUsage: 0 - RowsReturned: 789.98M (789975808) - RowsReturnedRate: 1.45 M/sec - SendersBlockedTimer: 7m34s - SendersBlockedTotalTimer(*): 41m17s Fragment F02: Instance e84a99bb0c926c46:9c59890200000014 (host=vd1313.halxg.cloudera.com:22000):(Total: 7m34s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 863.20 MB, 2.01 GB, 2.09 GB, 2.10 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.57 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.35 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.27 GB (3508535296) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.27 GB (3510110208) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 80.66M (80659857) - TotalNetworkReceiveTime: 14m53s - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.57K (17566) - TotalThreadsTotalWallClockTime: 15m6s - TotalThreadsSysTime: 5s988ms - TotalThreadsUserTime: 40s678ms - TotalThreadsVoluntaryContextSwitches: 364.70K (364697) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m18s - OpenTime: 7m33s - ExecTreeOpenTime: 7m32s - PrepareTime: 375.588ms - ExecTreePrepareTime: 10.916ms DataStreamSender (dst_id=24):(Total: 23s980ms, non-child: 23s980ms, % non-child: 100.00%) - BytesSent: 2.18 GB (2341290903) - NetworkThroughput(*): 334.69 MB/sec - OverallThroughput: 93.11 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 80.66M (80658869) - SerializeBatchTime: 17s262ms - TransmitDataRPCTime: 6s671ms - UncompressedRowBatchSize: 4.58 GB (4921256418) CodeGen:(Total: 768.368ms, non-child: 768.368ms, % non-child: 100.00%) - CodegenTime: 4.987ms - CompileTime: 217.499ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 480.420ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 67.911ms AGGREGATION_NODE (id=5):(Total: 19m51s, non-child: 30s041ms, % non-child: 2.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 47.840ms - BufferPoolAllocationBytes: 1.71 GB (1837105152) - BufferPoolAllocations: 460 (460) - BufferPoolPeakReservation: 1.22 GB (1314914304) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.22 GB (1314914304) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s101ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.22 GB (1314966656) - ReductionFactorEstimate: 12.10 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 80.66M (80659857) - RowsReturned: 80.66M (80659857) - RowsReturnedRate: 67.68 K/sec - StreamingTime: 29s401ms HASH_JOIN_NODE (id=4):(Total: 19m21s, non-child: 3s875ms, % non-child: 0.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3.225ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 19.635ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 95.18M (95184444) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s639ms - RowsReturned: 95.18M (95183420) - RowsReturnedRate: 81.93 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.388ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.168ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 22.322us, non-child: 22.322us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 11.326us - DeserializeRowBatchTimer: 15.977us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 16.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m17s, non-child: 3m53s, % non-child: 20.16%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s992ms - BufferPoolAllocationBytes: 35.68 GB (38306578432) - BufferPoolAllocations: 16.73K (16733) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33994833920) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 622.00 MB (652214272) - BufferPoolReadIoOps: 311 (311) - BufferPoolReadIoWaitTime: 16s328ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33994833920) - BufferPoolWriteIoBytes: 31.66 GB (33994833920) - BufferPoolWriteIoOps: 16.21K (16210) - BufferPoolWriteIoWaitTime: 47s047ms - BuildRows: 411.38M (411380486) - BuildTime: 1m26s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158080166) - ProbeRows: 789.97M (789968934) - ProbeRowsPartitioned: 98.73M (98731774) - ProbeTime: 2m2s - RowsReturned: 95.18M (95184048) - RowsReturnedRate: 82.21 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 1m15s - BuildRowsPartitioned: 411.38M (411380486) - HashBuckets: 201.33M (201326592) - HashCollisions: 11.45M (11448975) - HashTablesBuildTime: 23s238ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m4s, non-child: 15s350ms, % non-child: 4.21%) BytesReceived(32s000ms): 684.88 MB, 1.86 GB, 2.40 GB, 2.66 GB, 2.91 GB, 3.30 GB, 3.73 GB, 4.05 GB, 4.35 GB, 4.71 GB, 5.12 GB, 5.49 GB, 5.73 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6285962105) - ConvertRowBatchTime: 9s737ms - DeserializeRowBatchTimer: 24s839ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.38M (411380486) - RowsReturnedRate: 1.13 M/sec - SendersBlockedTimer: 21s840ms - SendersBlockedTotalTimer(*): 2m23s EXCHANGE_NODE (id=21):(Total: 9m19s, non-child: 39s786ms, % non-child: 7.11%) BytesReceived(32s000ms): 9.93 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 210.77 MB, 1.15 GB, 2.21 GB, 2.92 GB, 4.02 GB, 5.13 GB, 6.54 GB, 7.84 GB, 9.16 GB, 10.24 GB, 11.07 GB, 12.35 GB, 13.16 GB, 13.95 GB, 15.14 GB, 16.27 GB, 17.40 GB, 18.51 GB, 19.54 GB, 20.45 GB, 20.81 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22805924211) - ConvertRowBatchTime: 18s238ms - DeserializeRowBatchTimer: 1m21s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789968934) - RowsReturnedRate: 1.41 M/sec - SendersBlockedTimer: 7m36s - SendersBlockedTotalTimer(*): 53m Instance e84a99bb0c926c46:9c59890200000016 (host=vd1312.halxg.cloudera.com:22000):(Total: 7m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 839.56 MB, 2.00 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.21 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.30 GB (2470445056) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.30 GB (2472019968) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 85.26M (85263835) - TotalNetworkReceiveTime: 15m32s - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.89K (17889) - TotalThreadsTotalWallClockTime: 14m52s - TotalThreadsSysTime: 5s930ms - TotalThreadsUserTime: 41s376ms - TotalThreadsVoluntaryContextSwitches: 362.71K (362709) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m23s - OpenTime: 7m26s - ExecTreeOpenTime: 7m26s - PrepareTime: 39.154ms - ExecTreePrepareTime: 971.467us DataStreamSender (dst_id=24):(Total: 25s272ms, non-child: 25s272ms, % non-child: 100.00%) - BytesSent: 2.30 GB (2474505440) - NetworkThroughput(*): 318.62 MB/sec - OverallThroughput: 93.38 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 85.26M (85263835) - SerializeBatchTime: 17s820ms - TransmitDataRPCTime: 7s406ms - UncompressedRowBatchSize: 4.84 GB (5202220413) CodeGen:(Total: 450.150ms, non-child: 450.150ms, % non-child: 100.00%) - CodegenTime: 2.861ms - CompileTime: 134.470ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 288.188ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 27.025ms AGGREGATION_NODE (id=5):(Total: 19m49s, non-child: 29s080ms, % non-child: 2.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 13.120ms - BufferPoolAllocationBytes: 318.00 MB (333447168) - BufferPoolAllocations: 140 (140) - BufferPoolPeakReservation: 264.00 MB (276824064) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 264.00 MB (276824064) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 625.166ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 264.05 MB (276876416) - ReductionFactorEstimate: 185.24 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 85.26M (85263835) - RowsReturned: 85.26M (85263835) - RowsReturnedRate: 71.70 K/sec - StreamingTime: 28s595ms HASH_JOIN_NODE (id=4):(Total: 19m20s, non-child: 3s831ms, % non-child: 0.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 981.863us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 4.052ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 88.88M (88879178) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s605ms - RowsReturned: 88.88M (88879178) - RowsReturnedRate: 76.61 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 167.810us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 191.745us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 20.738us, non-child: 20.738us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 10.143us - DeserializeRowBatchTimer: 17.250us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 17.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m16s, non-child: 3m13s, % non-child: 16.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s195ms - BufferPoolAllocationBytes: 34.63 GB (37188796416) - BufferPoolAllocations: 16.71K (16711) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.67 GB (34003222528) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 572.00 MB (599785472) - BufferPoolReadIoOps: 286 (286) - BufferPoolReadIoWaitTime: 20s155ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.67 GB (34003222528) - BufferPoolWriteIoBytes: 31.67 GB (34003222528) - BufferPoolWriteIoOps: 16.21K (16214) - BufferPoolWriteIoWaitTime: 10s407ms - BuildRows: 411.39M (411391204) - BuildTime: 50s016ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158080166) - ProbeRows: 790.02M (790021543) - ProbeRowsPartitioned: 49.37M (49372454) - ProbeTime: 2m2s - RowsReturned: 88.88M (88879178) - RowsReturnedRate: 76.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 47s141ms - BuildRowsPartitioned: 411.39M (411391204) - HashBuckets: 134.22M (134217728) - HashCollisions: 11.46M (11455405) - HashTablesBuildTime: 11s343ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m34s, non-child: 15s863ms, % non-child: 4.03%) BytesReceived(32s000ms): 663.65 MB, 1.85 GB, 2.39 GB, 2.66 GB, 2.91 GB, 3.29 GB, 3.73 GB, 4.05 GB, 4.34 GB, 4.71 GB, 5.11 GB, 5.48 GB, 5.72 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6286154335) - ConvertRowBatchTime: 10s036ms - DeserializeRowBatchTimer: 23s978ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.39M (411391204) - RowsReturnedRate: 1.04 M/sec - SendersBlockedTimer: 5s637ms - SendersBlockedTotalTimer(*): 35s756ms EXCHANGE_NODE (id=21):(Total: 9m28s, non-child: 40s221ms, % non-child: 7.07%) BytesReceived(32s000ms): 9.77 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 203.57 MB, 1.13 GB, 2.20 GB, 2.91 GB, 4.00 GB, 5.11 GB, 6.52 GB, 7.82 GB, 9.14 GB, 10.23 GB, 11.05 GB, 12.33 GB, 13.15 GB, 13.94 GB, 15.13 GB, 16.25 GB, 17.39 GB, 18.49 GB, 19.53 GB, 20.44 GB, 20.81 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22807424950) - ConvertRowBatchTime: 18s046ms - DeserializeRowBatchTimer: 1m18s - FirstBatchArrivalWaitTime: 274.800ms - PeakMemoryUsage: 0 - RowsReturned: 790.02M (790021543) - RowsReturnedRate: 1.39 M/sec - SendersBlockedTimer: 7m27s - SendersBlockedTotalTimer(*): 52m2s Instance e84a99bb0c926c46:9c59890200000013 (host=vd1314.halxg.cloudera.com:22000):(Total: 7m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 832.79 MB, 2.00 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.10 GB, 2.10 GB, 2.10 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.14 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.27 GB (3508535296) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.27 GB (3510110208) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 74.57M (74569375) - TotalNetworkReceiveTime: 14m52s - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18.66K (18661) - TotalThreadsTotalWallClockTime: 14m52s - TotalThreadsSysTime: 6s167ms - TotalThreadsUserTime: 41s172ms - TotalThreadsVoluntaryContextSwitches: 361.19K (361194) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m24s - OpenTime: 7m26s - ExecTreeOpenTime: 7m26s - PrepareTime: 40.796ms - ExecTreePrepareTime: 1.319ms DataStreamSender (dst_id=24):(Total: 22s851ms, non-child: 22s851ms, % non-child: 100.00%) - BytesSent: 2.02 GB (2164112915) - NetworkThroughput(*): 337.96 MB/sec - OverallThroughput: 90.32 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 74.57M (74569375) - SerializeBatchTime: 16s699ms - TransmitDataRPCTime: 6s106ms - UncompressedRowBatchSize: 4.24 GB (4549743042) CodeGen:(Total: 430.445ms, non-child: 430.445ms, % non-child: 100.00%) - CodegenTime: 2.170ms - CompileTime: 126.069ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 275.953ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 27.993ms AGGREGATION_NODE (id=5):(Total: 19m50s, non-child: 29s236ms, % non-child: 2.46%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 40.091ms - BufferPoolAllocationBytes: 1.71 GB (1837105152) - BufferPoolAllocations: 460 (460) - BufferPoolPeakReservation: 1.22 GB (1314914304) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.22 GB (1314914304) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s147ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.22 GB (1314966656) - ReductionFactorEstimate: 12.20 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 74.57M (74569375) - RowsReturned: 74.57M (74569375) - RowsReturnedRate: 62.62 K/sec - StreamingTime: 28s776ms HASH_JOIN_NODE (id=4):(Total: 19m21s, non-child: 3s802ms, % non-child: 0.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.972ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 4.597ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 88.87M (88869414) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s568ms - RowsReturned: 88.87M (88869414) - RowsReturnedRate: 76.51 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 159.982us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 584.636us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 17.697us, non-child: 17.697us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.842us - DeserializeRowBatchTimer: 14.858us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 20.68 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m17s, non-child: 3m55s, % non-child: 20.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s030ms - BufferPoolAllocationBytes: 34.60 GB (37155241984) - BufferPoolAllocations: 16.70K (16695) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 542.00 MB (568328192) - BufferPoolReadIoOps: 271 (271) - BufferPoolReadIoWaitTime: 22s797ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolWriteIoBytes: 31.67 GB (34001125376) - BufferPoolWriteIoOps: 16.21K (16213) - BufferPoolWriteIoWaitTime: 50s226ms - BuildRows: 411.40M (411397332) - BuildTime: 1m30s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158084262) - ProbeRows: 789.97M (789966113) - ProbeRowsPartitioned: 49.37M (49368271) - ProbeTime: 2m - RowsReturned: 88.87M (88869414) - RowsReturnedRate: 76.76 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 1m27s - BuildRowsPartitioned: 411.40M (411397332) - HashBuckets: 134.22M (134217728) - HashCollisions: 11.44M (11442336) - HashTablesBuildTime: 10s261ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 5m52s, non-child: 15s339ms, % non-child: 4.35%) BytesReceived(32s000ms): 655.76 MB, 1.84 GB, 2.39 GB, 2.66 GB, 2.91 GB, 3.29 GB, 3.72 GB, 4.05 GB, 4.34 GB, 4.71 GB, 5.11 GB, 5.48 GB, 5.72 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6286228080) - ConvertRowBatchTime: 9s705ms - DeserializeRowBatchTimer: 26s465ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.40M (411397332) - RowsReturnedRate: 1.17 M/sec - SendersBlockedTimer: 32s645ms - SendersBlockedTotalTimer(*): 3m28s EXCHANGE_NODE (id=21):(Total: 9m30s, non-child: 38s980ms, % non-child: 6.84%) BytesReceived(32s000ms): 9.71 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.10 MB, 200.67 MB, 1.13 GB, 2.19 GB, 2.91 GB, 4.00 GB, 5.10 GB, 6.51 GB, 7.81 GB, 9.13 GB, 10.23 GB, 11.04 GB, 12.32 GB, 13.15 GB, 13.93 GB, 15.12 GB, 16.25 GB, 17.38 GB, 18.48 GB, 19.52 GB, 20.43 GB, 20.80 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22805991827) - ConvertRowBatchTime: 18s005ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 292.923ms - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789966113) - RowsReturnedRate: 1.39 M/sec - SendersBlockedTimer: 7m50s - SendersBlockedTotalTimer(*): 54m32s Instance e84a99bb0c926c46:9c59890200000011 (host=vd1311.halxg.cloudera.com:22000):(Total: 7m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 847.94 MB, 2.01 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.47 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.22 GB (3458203648) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.22 GB (3459778560) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 74.71M (74707018) - TotalNetworkReceiveTime: 15m21s - TotalNetworkSendTime: 1m6s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 18.68K (18679) - TotalThreadsTotalWallClockTime: 14m52s - TotalThreadsSysTime: 6s079ms - TotalThreadsUserTime: 39s733ms - TotalThreadsVoluntaryContextSwitches: 367.27K (367273) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m25s - OpenTime: 7m26s - ExecTreeOpenTime: 7m25s - PrepareTime: 29.261ms - ExecTreePrepareTime: 627.850us DataStreamSender (dst_id=24):(Total: 22s747ms, non-child: 22s747ms, % non-child: 100.00%) - BytesSent: 2.02 GB (2168593970) - NetworkThroughput(*): 337.67 MB/sec - OverallThroughput: 90.92 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 74.71M (74707018) - SerializeBatchTime: 16s579ms - TransmitDataRPCTime: 6s124ms - UncompressedRowBatchSize: 4.25 GB (4558113300) CodeGen:(Total: 422.160ms, non-child: 422.160ms, % non-child: 100.00%) - CodegenTime: 2.581ms - CompileTime: 140.047ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 263.860ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 17.827ms AGGREGATION_NODE (id=5):(Total: 19m51s, non-child: 30s027ms, % non-child: 2.52%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 41.222ms - BufferPoolAllocationBytes: 1.63 GB (1753219072) - BufferPoolAllocations: 450 (450) - BufferPoolPeakReservation: 1.18 GB (1264582656) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.18 GB (1264582656) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s311ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.18 GB (1264635008) - ReductionFactorEstimate: 27.30 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 74.71M (74707018) - RowsReturned: 74.71M (74707018) - RowsReturnedRate: 62.68 K/sec - StreamingTime: 29s589ms HASH_JOIN_NODE (id=4):(Total: 19m21s, non-child: 3s752ms, % non-child: 0.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 552.802us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 15.475ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 88.87M (88869871) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s556ms - RowsReturned: 88.87M (88869871) - RowsReturnedRate: 76.49 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.185ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 161.945us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 20.918us, non-child: 20.918us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.946us - DeserializeRowBatchTimer: 17.280us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 17.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m18s, non-child: 3m26s, % non-child: 17.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s097ms - BufferPoolAllocationBytes: 35.64 GB (38264635392) - BufferPoolAllocations: 16.71K (16713) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 578.00 MB (606076928) - BufferPoolReadIoOps: 289 (289) - BufferPoolReadIoWaitTime: 21s408ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolWriteIoBytes: 31.66 GB (33999028224) - BufferPoolWriteIoOps: 16.21K (16212) - BufferPoolWriteIoWaitTime: 27s932ms - BuildRows: 411.39M (411385166) - BuildTime: 1m7s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158080166) - ProbeRows: 789.97M (789971622) - ProbeRowsPartitioned: 49.37M (49369076) - ProbeTime: 1m57s - RowsReturned: 88.87M (88869871) - RowsReturnedRate: 76.74 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 1m5s - BuildRowsPartitioned: 411.39M (411385166) - HashBuckets: 134.22M (134217728) - HashCollisions: 11.45M (11449700) - HashTablesBuildTime: 10s199ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m16s, non-child: 15s661ms, % non-child: 4.16%) BytesReceived(32s000ms): 670.87 MB, 1.85 GB, 2.39 GB, 2.66 GB, 2.91 GB, 3.29 GB, 3.73 GB, 4.05 GB, 4.34 GB, 4.71 GB, 5.11 GB, 5.49 GB, 5.72 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6286038372) - ConvertRowBatchTime: 9s530ms - DeserializeRowBatchTimer: 27s136ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.39M (411385166) - RowsReturnedRate: 1.09 M/sec - SendersBlockedTimer: 12s510ms - SendersBlockedTotalTimer(*): 1m22s EXCHANGE_NODE (id=21):(Total: 9m35s, non-child: 38s301ms, % non-child: 6.66%) BytesReceived(32s000ms): 9.77 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 205.84 MB, 1.14 GB, 2.20 GB, 2.91 GB, 4.01 GB, 5.12 GB, 6.53 GB, 7.83 GB, 9.14 GB, 10.24 GB, 11.05 GB, 12.33 GB, 13.15 GB, 13.94 GB, 15.13 GB, 16.26 GB, 17.39 GB, 18.50 GB, 19.53 GB, 20.44 GB, 20.80 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22806071751) - ConvertRowBatchTime: 17s637ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 306.640ms - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789971622) - RowsReturnedRate: 1.37 M/sec - SendersBlockedTimer: 7m41s - SendersBlockedTotalTimer(*): 24m2s Instance e84a99bb0c926c46:9c59890200000015 (host=vd1310.halxg.cloudera.com:22000):(Total: 7m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 847.39 MB, 2.01 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.14 GB (2296381440) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.14 GB (2297690112) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 88.78M (88775741) - TotalNetworkReceiveTime: 15m29s - TotalNetworkSendTime: 1m8s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.11K (17109) - TotalThreadsTotalWallClockTime: 14m51s - TotalThreadsSysTime: 6s487ms - TotalThreadsUserTime: 41s513ms - TotalThreadsVoluntaryContextSwitches: 366.32K (366322) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m19s - OpenTime: 7m26s - ExecTreeOpenTime: 7m25s - PrepareTime: 36.681ms - ExecTreePrepareTime: 1.117ms DataStreamSender (dst_id=24):(Total: 25s595ms, non-child: 25s595ms, % non-child: 100.00%) - BytesSent: 2.40 GB (2575592373) - NetworkThroughput(*): 340.22 MB/sec - OverallThroughput: 95.97 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 88.78M (88775741) - SerializeBatchTime: 18s329ms - TransmitDataRPCTime: 7s219ms - UncompressedRowBatchSize: 5.04 GB (5416520031) CodeGen:(Total: 435.314ms, non-child: 435.314ms, % non-child: 100.00%) - CodegenTime: 2.080ms - CompileTime: 126.403ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 282.686ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 25.867ms AGGREGATION_NODE (id=5):(Total: 19m45s, non-child: 18s459ms, % non-child: 1.56%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 4.734ms - BufferPoolAllocationBytes: 114.00 MB (119537664) - BufferPoolAllocations: 57 (57) - BufferPoolPeakReservation: 98.00 MB (102760448) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 98.00 MB (102760448) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 612.475ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 98.05 MB (102812800) - ReductionFactorEstimate: 300.85 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 88.78M (88775741) - RowsReturned: 88.78M (88775741) - RowsReturnedRate: 74.89 K/sec - StreamingTime: 26s612ms HASH_JOIN_NODE (id=4):(Total: 19m26s, non-child: 3s783ms, % non-child: 0.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 803.235us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 2.879ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 89.96M (89956740) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s559ms - RowsReturned: 89.96M (89956740) - RowsReturnedRate: 77.09 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 177.827us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 108.728us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 21.224us, non-child: 21.224us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 10.354us - DeserializeRowBatchTimer: 13.184us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 17.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m23s, non-child: 3m22s, % non-child: 17.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s002ms - BufferPoolAllocationBytes: 35.71 GB (38344327168) - BufferPoolAllocations: 16.75K (16751) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 654.00 MB (685768704) - BufferPoolReadIoOps: 327 (327) - BufferPoolReadIoWaitTime: 20s872ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolWriteIoBytes: 31.66 GB (33999028224) - BufferPoolWriteIoOps: 16.21K (16212) - BufferPoolWriteIoWaitTime: 14s477ms - BuildRows: 411.42M (411422470) - BuildTime: 53s454ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158080166) - ProbeRows: 789.97M (789968773) - ProbeRowsPartitioned: 98.75M (98752549) - ProbeTime: 2m - RowsReturned: 89.96M (89956740) - RowsReturnedRate: 77.34 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 50s862ms - BuildRowsPartitioned: 411.42M (411422470) - HashBuckets: 201.33M (201326592) - HashCollisions: 11.46M (11462823) - HashTablesBuildTime: 19s816ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m30s, non-child: 14s641ms, % non-child: 3.75%) BytesReceived(32s000ms): 670.12 MB, 1.85 GB, 2.39 GB, 2.66 GB, 2.91 GB, 3.29 GB, 3.73 GB, 4.05 GB, 4.34 GB, 4.71 GB, 5.11 GB, 5.49 GB, 5.72 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6286617047) - ConvertRowBatchTime: 10s046ms - DeserializeRowBatchTimer: 22s421ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.42M (411422470) - RowsReturnedRate: 1.05 M/sec - SendersBlockedTimer: 7s794ms - SendersBlockedTotalTimer(*): 33s672ms EXCHANGE_NODE (id=21):(Total: 9m29s, non-child: 39s972ms, % non-child: 7.01%) BytesReceived(32s000ms): 9.79 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.08 MB, 205.89 MB, 1.14 GB, 2.20 GB, 2.91 GB, 4.01 GB, 5.12 GB, 6.53 GB, 7.83 GB, 9.14 GB, 10.24 GB, 11.05 GB, 12.33 GB, 13.15 GB, 13.94 GB, 15.13 GB, 16.26 GB, 17.39 GB, 18.49 GB, 19.53 GB, 20.44 GB, 20.80 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22805861854) - ConvertRowBatchTime: 18s316ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 293.169ms - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789968773) - RowsReturnedRate: 1.39 M/sec - SendersBlockedTimer: 7m28s - SendersBlockedTotalTimer(*): 44m47s Instance e84a99bb0c926c46:9c59890200000012 (host=vd1309.halxg.cloudera.com:22000):(Total: 7m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 847.11 MB, 2.01 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.10 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.95 GB (3166699520) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.95 GB (3168065536) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 76.69M (76690307) - TotalNetworkReceiveTime: 13m3s - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 22.43K (22429) - TotalThreadsTotalWallClockTime: 14m51s - TotalThreadsSysTime: 6s465ms - TotalThreadsUserTime: 42s088ms - TotalThreadsVoluntaryContextSwitches: 358.13K (358128) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m14s - OpenTime: 7m26s - ExecTreeOpenTime: 7m25s - PrepareTime: 43.145ms - ExecTreePrepareTime: 972.873us DataStreamSender (dst_id=24):(Total: 23s214ms, non-child: 23s214ms, % non-child: 100.00%) - BytesSent: 2.07 GB (2224959360) - NetworkThroughput(*): 338.12 MB/sec - OverallThroughput: 91.40 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 76.69M (76690307) - SerializeBatchTime: 16s898ms - TransmitDataRPCTime: 6s275ms - UncompressedRowBatchSize: 4.36 GB (4679114310) CodeGen:(Total: 498.496ms, non-child: 498.496ms, % non-child: 100.00%) - CodegenTime: 2.839ms - CompileTime: 139.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 333.374ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 24.690ms AGGREGATION_NODE (id=5):(Total: 19m40s, non-child: 20s497ms, % non-child: 1.74%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 59.778ms - BufferPoolAllocationBytes: 1.14 GB (1226833920) - BufferPoolAllocations: 409 (409) - BufferPoolPeakReservation: 928.00 MB (973078528) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 928.00 MB (973078528) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s001ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 928.05 MB (973130880) - ReductionFactorEstimate: 18.72 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 76.69M (76690307) - RowsReturned: 76.69M (76690307) - RowsReturnedRate: 64.97 K/sec - StreamingTime: 33s851ms HASH_JOIN_NODE (id=4):(Total: 19m19s, non-child: 3s927ms, % non-child: 0.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 971.399us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 3.788ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 88.86M (88863147) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s681ms - RowsReturned: 88.86M (88862123) - RowsReturnedRate: 76.62 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 197.104us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 162.727us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 33.316us, non-child: 33.316us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.722us - DeserializeRowBatchTimer: 14.399us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 10.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m15s, non-child: 5m42s, % non-child: 29.66%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s022ms - BufferPoolAllocationBytes: 35.69 GB (38317064192) - BufferPoolAllocations: 16.74K (16738) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 626.00 MB (656408576) - BufferPoolReadIoOps: 313 (313) - BufferPoolReadIoWaitTime: 17s472ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolWriteIoBytes: 31.67 GB (34001125376) - BufferPoolWriteIoOps: 16.21K (16213) - BufferPoolWriteIoWaitTime: 18s107ms - BuildRows: 411.41M (411405858) - BuildTime: 1m8s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158084262) - ProbeRows: 789.95M (789950432) - ProbeRowsPartitioned: 98.73M (98727918) - ProbeTime: 4m7s - RowsReturned: 88.86M (88863037) - RowsReturnedRate: 76.88 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 1m6s - BuildRowsPartitioned: 411.41M (411405858) - HashBuckets: 201.33M (201326592) - HashCollisions: 11.46M (11461177) - HashTablesBuildTime: 16s453ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m14s, non-child: 17s174ms, % non-child: 4.58%) BytesReceived(32s000ms): 669.91 MB, 1.85 GB, 2.39 GB, 2.66 GB, 2.91 GB, 3.29 GB, 3.73 GB, 4.05 GB, 4.34 GB, 4.71 GB, 5.11 GB, 5.49 GB, 5.72 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6286352642) - ConvertRowBatchTime: 9s559ms - DeserializeRowBatchTimer: 32s991ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.41M (411405858) - RowsReturnedRate: 1.10 M/sec - SendersBlockedTimer: 13s739ms - SendersBlockedTotalTimer(*): 1m34s EXCHANGE_NODE (id=21):(Total: 7m18s, non-child: 1m8s, % non-child: 15.60%) BytesReceived(32s000ms): 9.78 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 205.69 MB, 1.14 GB, 2.20 GB, 2.91 GB, 4.01 GB, 5.12 GB, 6.53 GB, 7.83 GB, 9.14 GB, 10.24 GB, 11.05 GB, 12.33 GB, 13.15 GB, 13.94 GB, 15.13 GB, 16.26 GB, 17.39 GB, 18.50 GB, 19.53 GB, 20.44 GB, 20.80 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22805433927) - ConvertRowBatchTime: 17s714ms - DeserializeRowBatchTimer: 4m10s - FirstBatchArrivalWaitTime: 213.564ms - PeakMemoryUsage: 0 - RowsReturned: 789.95M (789950432) - RowsReturnedRate: 1.80 M/sec - SendersBlockedTimer: 7m37s - SendersBlockedTotalTimer(*): 38m23s Instance e84a99bb0c926c46:9c59890200000010 (host=vd1316.halxg.cloudera.com:22000):(Total: 7m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 849.41 MB, 2.01 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.09 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.08 GB, 2.33 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.34 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.27 GB (3508535296) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.27 GB (3510110208) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 74.41M (74405373) - TotalNetworkReceiveTime: 15m37s - TotalNetworkSendTime: 1m7s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.15K (17152) - TotalThreadsTotalWallClockTime: 14m51s - TotalThreadsSysTime: 5s757ms - TotalThreadsUserTime: 40s999ms - TotalThreadsVoluntaryContextSwitches: 371.08K (371081) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 12m31s - OpenTime: 7m26s - ExecTreeOpenTime: 7m25s - PrepareTime: 40.518ms - ExecTreePrepareTime: 1.081ms DataStreamSender (dst_id=24):(Total: 22s939ms, non-child: 22s939ms, % non-child: 100.00%) - BytesSent: 2.01 GB (2159624271) - NetworkThroughput(*): 331.12 MB/sec - OverallThroughput: 89.78 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 74.40M (74404372) - SerializeBatchTime: 16s676ms - TransmitDataRPCTime: 6s219ms - UncompressedRowBatchSize: 4.23 GB (4539639195) CodeGen:(Total: 465.997ms, non-child: 465.997ms, % non-child: 100.00%) - CodegenTime: 2.611ms - CompileTime: 131.993ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 307.003ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 26.542ms AGGREGATION_NODE (id=5):(Total: 19m56s, non-child: 31s197ms, % non-child: 2.61%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 51.253ms - BufferPoolAllocationBytes: 1.71 GB (1837105152) - BufferPoolAllocations: 460 (460) - BufferPoolPeakReservation: 1.22 GB (1314914304) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.22 GB (1314914304) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s522ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.22 GB (1314966656) - ReductionFactorEstimate: 12.14 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 74.41M (74405373) - RowsReturned: 74.41M (74405373) - RowsReturnedRate: 62.16 K/sec - StreamingTime: 30s719ms HASH_JOIN_NODE (id=4):(Total: 19m25s, non-child: 3s800ms, % non-child: 0.33%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 243.959us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 2.981ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 88.87M (88869444) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s601ms - RowsReturned: 88.87M (88868420) - RowsReturnedRate: 76.23 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 231.199us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 116.313us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 26.537us, non-child: 26.537us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 17.587us - DeserializeRowBatchTimer: 15.563us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 13.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 19m21s, non-child: 3m14s, % non-child: 16.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s525ms - BufferPoolAllocationBytes: 35.57 GB (38195429376) - BufferPoolAllocations: 16.68K (16680) - BufferPoolPeakReservation: 2.01 GB (2157969408) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33996931072) - BufferPoolPeakUsedReservation: 2.01 GB (2157969408) - BufferPoolReadIoBytes: 514.00 MB (538968064) - BufferPoolReadIoOps: 257 (257) - BufferPoolReadIoWaitTime: 20s579ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33996931072) - BufferPoolWriteIoBytes: 31.66 GB (33996931072) - BufferPoolWriteIoOps: 16.21K (16211) - BufferPoolWriteIoWaitTime: 7s401ms - BuildRows: 411.38M (411382487) - BuildTime: 44s399ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.01 GB (2158080166) - ProbeRows: 789.98M (789983243) - ProbeRowsPartitioned: 98.75M (98747074) - ProbeTime: 2m1s - RowsReturned: 88.87M (88869129) - RowsReturnedRate: 76.48 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 41s917ms - BuildRowsPartitioned: 411.38M (411382487) - HashBuckets: 201.33M (201326592) - HashCollisions: 11.45M (11449916) - HashTablesBuildTime: 16s853ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 6m39s, non-child: 14s425ms, % non-child: 3.61%) BytesReceived(32s000ms): 671.86 MB, 1.85 GB, 2.39 GB, 2.66 GB, 2.91 GB, 3.29 GB, 3.73 GB, 4.05 GB, 4.34 GB, 4.71 GB, 5.11 GB, 5.49 GB, 5.72 GB, 5.82 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB, 5.85 GB - BytesReceived: 5.85 GB (6286010423) - ConvertRowBatchTime: 9s790ms - DeserializeRowBatchTimer: 19s979ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.38M (411382487) - RowsReturnedRate: 1.03 M/sec - SendersBlockedTimer: 3s640ms - SendersBlockedTotalTimer(*): 23s994ms EXCHANGE_NODE (id=21):(Total: 9m28s, non-child: 38s937ms, % non-child: 6.85%) BytesReceived(32s000ms): 9.77 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 10.05 MB, 206.27 MB, 1.14 GB, 2.20 GB, 2.91 GB, 4.01 GB, 5.12 GB, 6.53 GB, 7.83 GB, 9.15 GB, 10.24 GB, 11.05 GB, 12.33 GB, 13.15 GB, 13.94 GB, 15.13 GB, 16.26 GB, 17.40 GB, 18.50 GB, 19.53 GB, 20.44 GB, 20.80 GB, 20.82 GB, 20.82 GB, 20.97 GB, 21.17 GB, 21.24 GB - BytesReceived: 21.24 GB (22806285926) - ConvertRowBatchTime: 18s169ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 258.734ms - PeakMemoryUsage: 0 - RowsReturned: 789.98M (789983243) - RowsReturnedRate: 1.39 M/sec - SendersBlockedTimer: 7m23s - SendersBlockedTotalTimer(*): 22m10s Averaged Fragment F00:(Total: 18m46s, non-child: 11m44s, % non-child: 62.50%) split sizes: min: 197.46 GB, max: 197.66 GB, avg: 197.53 GB, stddev: 71.02 MB completion times: min:17m28s max:20m42s mean: 18m46s stddev:1m17s execution rates: min:162.80 MB/sec max:193.02 MB/sec mean:180.31 MB/sec stddev:12.16 MB/sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 80.28 MB (84178767) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 789.98M (789975808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 11m4s - TotalStorageWaitTime: 4m5s - TotalThreadsInvoluntaryContextSwitches: 53.50K (53504) - TotalThreadsTotalWallClockTime: 37m33s - TotalThreadsSysTime: 9s340ms - TotalThreadsUserTime: 5m41s - TotalThreadsVoluntaryContextSwitches: 354.46K (354464) Fragment Instance Lifecycle Timings: - ExecTime: 18m46s - ExecTreeExecTime: 4m21s - OpenTime: 26.601ms - ExecTreeOpenTime: 503.627us - PrepareTime: 42.758ms - ExecTreePrepareTime: 5.927ms DataStreamSender (dst_id=21):(Total: 2m41s, non-child: 2m41s, % non-child: 100.00%) - BytesSent: 21.24 GB (22806142063) - NetworkThroughput(*): 458.62 MB/sec - OverallThroughput: 134.90 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 789.98M (789975808) - SerializeBatchTime: 1m53s - TransmitDataRPCTime: 47s430ms - UncompressedRowBatchSize: 30.17 GB (32396157268) CodeGen:(Total: 43.997ms, non-child: 43.997ms, % non-child: 100.00%) - CodegenTime: 734.561us - CompileTime: 7.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.367ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 19.610ms HDFS_SCAN_NODE (id=0):(Total: 4m21s, non-child: 4m21s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.27 GB (9950729521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.27 GB (9950729521) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.27 GB (9950729521) - DecompressionTime: 43s639ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 166 (166) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.05 MB (82885491) - PerReadThreadRawHdfsThroughput: 36.80 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4m17s - RowBatchQueuePutWaitTime: 11m38s - RowsRead: 789.98M (789975808) - RowsReturned: 789.98M (789975808) - RowsReturnedRate: 3.13 M/sec - ScanRangesComplete: 856 (856) - ScannerThreadsInvoluntaryContextSwitches: 26.46K (26464) - ScannerThreadsTotalWallClockTime: 18m46s - MaterializeTupleTime(*): 1m57s - ScannerThreadsSysTime: 3s832ms - ScannerThreadsUserTime: 2m29s - ScannerThreadsVoluntaryContextSwitches: 331.78K (331783) - TotalRawHdfsReadTime(*): 4m20s - TotalReadThroughput: 8.46 MB/sec Filter 0 (1.00 MB): - Files processed: 856 (856) - Files rejected: 689 (689) - Files total: 856 (856) - RowGroups processed: 771.54K (771542) - RowGroups rejected: 0 (0) - RowGroups total: 771.54K (771542) - Rows processed: 2.73M (2729106) - Rows rejected: 0 (0) - Rows total: 789.98M (789975808) - Splits processed: 166 (166) - Splits rejected: 0 (0) - Splits total: 166 (166) Fragment F00: Instance e84a99bb0c926c46:9c59890200000003 (host=vd1309.halxg.cloudera.com:22000):(Total: 20m42s, non-child: 11m28s, % non-child: 55.45%) Hdfs split stats (:<# splits>/): 4:98/22.52 GB 2:93/21.82 GB 5:114/26.39 GB 3:109/24.99 GB 6:115/26.72 GB 1:104/24.36 GB 7:109/25.03 GB 0:110/25.63 GB Filter 0 arrival: 647ms MemoryUsage(32s000ms): 76.29 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 77.51 MB, 64.22 MB, 55.68 MB, 50.36 MB, 53.84 MB, 42.45 MB, 49.58 MB, 44.78 MB, 47.30 MB, 45.65 MB, 50.73 MB, 50.52 MB, 36.18 MB, 58.22 MB, 45.65 MB, 43.47 MB, 43.47 MB, 43.57 MB, 49.61 MB, 47.65 MB, 38.10 MB, 52.92 MB, 58.12 MB, 58.12 MB, 58.34 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 80.54 MB (84455937) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 786.04M (786044059) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m23s - TotalStorageWaitTime: 4m43s - TotalThreadsInvoluntaryContextSwitches: 69.14K (69136) - TotalThreadsTotalWallClockTime: 41m23s - TotalThreadsSysTime: 10s047ms - TotalThreadsUserTime: 5m48s - TotalThreadsVoluntaryContextSwitches: 360.26K (360261) Fragment Instance Lifecycle Timings: - ExecTime: 20m42s - ExecTreeExecTime: 6m29s - OpenTime: 24.677ms - ExecTreeOpenTime: 474.614us - PrepareTime: 26.618ms - ExecTreePrepareTime: 2.726ms DataStreamSender (dst_id=21):(Total: 2m44s, non-child: 2m44s, % non-child: 100.00%) - BytesSent: 21.14 GB (22695110009) - NetworkThroughput(*): 453.14 MB/sec - OverallThroughput: 131.84 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 786.04M (786044059) - SerializeBatchTime: 1m56s - TransmitDataRPCTime: 47s764ms - UncompressedRowBatchSize: 30.02 GB (32234919955) CodeGen:(Total: 40.025ms, non-child: 40.025ms, % non-child: 100.00%) - CodegenTime: 682.165us - CompileTime: 6.580ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.790ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 17.221ms HDFS_SCAN_NODE (id=0):(Total: 6m29s, non-child: 6m29s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:98/22.52 GB 2:93/21.82 GB 5:114/26.39 GB 3:109/24.99 GB 6:115/26.72 GB 1:104/24.36 GB 7:109/25.03 GB 0:110/25.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 164 out of 164 Runtime filters: All filters arrived. Waited 603ms Hdfs Read Thread Concurrency Bucket: 0:76.04% 1:23.96% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:688 PARQUET/SNAPPY:984 BytesRead(32s000ms): 60.11 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 61.06 MB, 135.59 MB, 456.75 MB, 836.82 MB, 1.13 GB, 1.57 GB, 1.96 GB, 2.42 GB, 2.96 GB, 3.52 GB, 4.01 GB, 4.26 GB, 4.66 GB, 4.97 GB, 5.27 GB, 5.72 GB, 6.16 GB, 6.59 GB, 7.12 GB, 7.58 GB, 8.04 GB, 8.38 GB, 8.41 GB, 8.41 GB, 8.58 GB - FooterProcessingTime: (Avg: 222.335ms ; Min: 1.139ms ; Max: 2s367ms ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.23 GB (9914213325) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.23 GB (9914213325) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.23 GB (9914213325) - DecompressionTime: 1m10s - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.30 MB (83152299) - PerReadThreadRawHdfsThroughput: 31.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6m15s - RowBatchQueuePutWaitTime: 10m51s - RowsRead: 786.04M (786044059) - RowsReturned: 786.04M (786044059) - RowsReturnedRate: 2.02 M/sec - ScanRangesComplete: 852 (852) - ScannerThreadsInvoluntaryContextSwitches: 33.27K (33274) - ScannerThreadsTotalWallClockTime: 20m41s - MaterializeTupleTime(*): 2m11s - ScannerThreadsSysTime: 4s289ms - ScannerThreadsUserTime: 2m31s - ScannerThreadsVoluntaryContextSwitches: 336.50K (336496) - TotalRawHdfsReadTime(*): 4m57s - TotalReadThroughput: 7.62 MB/sec Filter 0 (1.00 MB): - Files processed: 852 (852) - Files rejected: 688 (688) - Files total: 852 (852) - RowGroups processed: 767.70K (767700) - RowGroups rejected: 0 (0) - RowGroups total: 767.70K (767700) - Rows processed: 2.69M (2686976) - Rows rejected: 0 (0) - Rows total: 786.04M (786044059) - Splits processed: 164 (164) - Splits rejected: 0 (0) - Splits total: 164 (164) Instance e84a99bb0c926c46:9c59890200000005 (host=vd1313.halxg.cloudera.com:22000):(Total: 20m4s, non-child: 12m52s, % non-child: 64.09%) Hdfs split stats (:<# splits>/): 1:107/24.64 GB 3:94/21.75 GB 0:92/21.56 GB 5:112/25.79 GB 7:122/27.77 GB 4:102/22.91 GB 6:115/27.01 GB 2:114/26.05 GB Filter 0 arrival: 95ms MemoryUsage(32s000ms): 59.55 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.84 MB, 61.83 MB, 57.93 MB, 56.04 MB, 53.96 MB, 54.34 MB, 48.38 MB, 50.13 MB, 40.77 MB, 38.21 MB, 45.91 MB, 57.71 MB, 50.11 MB, 47.18 MB, 45.20 MB, 48.38 MB, 44.39 MB, 38.84 MB, 46.49 MB, 41.32 MB, 36.32 MB, 44.61 MB, 55.93 MB, 61.68 MB, 61.68 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 80.75 MB (84669008) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 794.71M (794709729) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m17s - TotalStorageWaitTime: 4m30s - TotalThreadsInvoluntaryContextSwitches: 47.62K (47624) - TotalThreadsTotalWallClockTime: 40m9s - TotalThreadsSysTime: 8s704ms - TotalThreadsUserTime: 5m40s - TotalThreadsVoluntaryContextSwitches: 360.93K (360926) Fragment Instance Lifecycle Timings: - ExecTime: 20m4s - ExecTreeExecTime: 4m31s - OpenTime: 44.437ms - ExecTreeOpenTime: 1.043ms - PrepareTime: 120.758ms - ExecTreePrepareTime: 24.547ms DataStreamSender (dst_id=21):(Total: 2m41s, non-child: 2m41s, % non-child: 100.00%) - BytesSent: 21.37 GB (22944621519) - NetworkThroughput(*): 455.08 MB/sec - OverallThroughput: 135.16 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 794.71M (794709729) - SerializeBatchTime: 1m53s - TransmitDataRPCTime: 48s083ms - UncompressedRowBatchSize: 30.35 GB (32590290849) CodeGen:(Total: 74.246ms, non-child: 74.246ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 13.679ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 25.683ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 34.274ms HDFS_SCAN_NODE (id=0):(Total: 4m30s, non-child: 4m30s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:107/24.64 GB 3:94/21.75 GB 0:92/21.56 GB 5:112/25.79 GB 7:122/27.77 GB 4:102/22.91 GB 6:115/27.01 GB 2:114/26.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 169 out of 169 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:76.7% 1:23.3% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:689 PARQUET/SNAPPY:1014 BytesRead(32s000ms): 42.07 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 43.81 MB, 104.29 MB, 536.73 MB, 982.46 MB, 1.23 GB, 1.70 GB, 2.18 GB, 2.83 GB, 3.38 GB, 3.91 GB, 4.40 GB, 4.74 GB, 5.39 GB, 5.81 GB, 6.11 GB, 6.51 GB, 6.90 GB, 7.43 GB, 7.83 GB, 8.17 GB, 8.69 GB, 9.12 GB, 9.15 GB, 9.15 GB - FooterProcessingTime: (Avg: 183.568ms ; Min: 1.096ms ; Max: 2s126ms ; Number of samples: 169) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.32 GB (10010851689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.32 GB (10010851689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.32 GB (10010851689) - DecompressionTime: 40s174ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 169 (169) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.52 MB (83381648) - PerReadThreadRawHdfsThroughput: 34.34 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4m28s - RowBatchQueuePutWaitTime: 12m49s - RowsRead: 794.71M (794709729) - RowsReturned: 794.71M (794709729) - RowsReturnedRate: 2.94 M/sec - ScanRangesComplete: 858 (858) - ScannerThreadsInvoluntaryContextSwitches: 23.55K (23551) - ScannerThreadsTotalWallClockTime: 20m4s - MaterializeTupleTime(*): 1m56s - ScannerThreadsSysTime: 3s447ms - ScannerThreadsUserTime: 2m29s - ScannerThreadsVoluntaryContextSwitches: 335.76K (335760) - TotalRawHdfsReadTime(*): 4m38s - TotalReadThroughput: 7.93 MB/sec Filter 0 (1.00 MB): - Files processed: 858 (858) - Files rejected: 689 (689) - Files total: 858 (858) - RowGroups processed: 776.17K (776168) - RowGroups rejected: 0 (0) - RowGroups total: 776.17K (776168) - Rows processed: 2.77M (2768896) - Rows rejected: 0 (0) - Rows total: 794.71M (794709729) - Splits processed: 169 (169) - Splits rejected: 0 (0) - Splits total: 169 (169) Instance e84a99bb0c926c46:9c59890200000006 (host=vd1310.halxg.cloudera.com:22000):(Total: 19m57s, non-child: 12m55s, % non-child: 64.75%) Hdfs split stats (:<# splits>/): 5:97/22.48 GB 7:121/28.35 GB 1:87/20.46 GB 6:105/24.30 GB 0:105/24.12 GB 4:115/26.29 GB 2:102/24.07 GB 3:123/27.39 GB Filter 0 arrival: 629ms MemoryUsage(32s000ms): 70.91 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.89 MB, 75.88 MB, 62.65 MB, 57.26 MB, 57.38 MB, 52.70 MB, 47.92 MB, 49.48 MB, 41.94 MB, 46.60 MB, 42.93 MB, 61.54 MB, 42.42 MB, 44.47 MB, 56.78 MB, 53.02 MB, 50.38 MB, 36.70 MB, 47.32 MB, 46.88 MB, 47.10 MB, 39.92 MB, 65.95 MB, 77.62 MB, 77.62 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 80.78 MB (84701770) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 792.21M (792205379) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12m16s - TotalStorageWaitTime: 4m20s - TotalThreadsInvoluntaryContextSwitches: 52.24K (52240) - TotalThreadsTotalWallClockTime: 39m53s - TotalThreadsSysTime: 9s900ms - TotalThreadsUserTime: 5m47s - TotalThreadsVoluntaryContextSwitches: 357.25K (357249) Fragment Instance Lifecycle Timings: - ExecTime: 19m57s - ExecTreeExecTime: 4m19s - OpenTime: 24.330ms - ExecTreeOpenTime: 313.044us - PrepareTime: 38.152ms - ExecTreePrepareTime: 2.249ms DataStreamSender (dst_id=21):(Total: 2m42s, non-child: 2m42s, % non-child: 100.00%) - BytesSent: 21.30 GB (22868421858) - NetworkThroughput(*): 459.23 MB/sec - OverallThroughput: 133.97 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 792.21M (792205379) - SerializeBatchTime: 1m55s - TransmitDataRPCTime: 47s490ms - UncompressedRowBatchSize: 30.26 GB (32487589835) CodeGen:(Total: 41.863ms, non-child: 41.863ms, % non-child: 100.00%) - CodegenTime: 728.985us - CompileTime: 5.842ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.274ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.164ms HDFS_SCAN_NODE (id=0):(Total: 4m19s, non-child: 4m19s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:97/22.48 GB 7:121/28.35 GB 1:87/20.46 GB 6:105/24.30 GB 0:105/24.12 GB 4:115/26.29 GB 2:102/24.07 GB 3:123/27.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: All filters arrived. Waited 582ms Hdfs Read Thread Concurrency Bucket: 0:75.97% 1:24.03% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:687 PARQUET/SNAPPY:1008 BytesRead(32s000ms): 56.36 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 60.91 MB, 96.55 MB, 474.80 MB, 992.94 MB, 1.27 GB, 1.73 GB, 2.20 GB, 2.76 GB, 3.32 GB, 3.90 GB, 4.37 GB, 4.72 GB, 5.22 GB, 5.63 GB, 5.98 GB, 6.53 GB, 7.04 GB, 7.48 GB, 7.94 GB, 8.38 GB, 8.85 GB, 9.15 GB, 9.17 GB, 9.17 GB - FooterProcessingTime: (Avg: 206.872ms ; Min: 1.141ms ; Max: 7s702ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.29 GB (9969783691) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.29 GB (9969783691) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.29 GB (9969783691) - DecompressionTime: 39s974ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.55 MB (83414474) - PerReadThreadRawHdfsThroughput: 33.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4m16s - RowBatchQueuePutWaitTime: 12m51s - RowsRead: 792.21M (792205379) - RowsReturned: 792.21M (792205379) - RowsReturnedRate: 3.06 M/sec - ScanRangesComplete: 855 (855) - ScannerThreadsInvoluntaryContextSwitches: 26.39K (26393) - ScannerThreadsTotalWallClockTime: 19m56s - MaterializeTupleTime(*): 1m57s - ScannerThreadsSysTime: 4s104ms - ScannerThreadsUserTime: 2m32s - ScannerThreadsVoluntaryContextSwitches: 333.93K (333930) - TotalRawHdfsReadTime(*): 4m41s - TotalReadThroughput: 7.95 MB/sec Filter 0 (1.00 MB): - Files processed: 855 (855) - Files rejected: 687 (687) - Files total: 855 (855) - RowGroups processed: 773.73K (773726) - RowGroups rejected: 0 (0) - RowGroups total: 773.73K (773726) - Rows processed: 2.75M (2752512) - Rows rejected: 0 (0) - Rows total: 792.21M (792205379) - Splits processed: 168 (168) - Splits rejected: 0 (0) - Splits total: 168 (168) Instance e84a99bb0c926c46:9c59890200000007 (host=vd1312.halxg.cloudera.com:22000):(Total: 17m55s, non-child: 11m15s, % non-child: 62.84%) Hdfs split stats (:<# splits>/): 0:109/25.03 GB 5:99/22.55 GB 6:118/27.04 GB 7:115/26.81 GB 1:108/25.07 GB 3:92/20.80 GB 2:112/25.75 GB 4:107/24.43 GB Filter 0 arrival: 640ms MemoryUsage(32s000ms): 65.55 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 69.11 MB, 67.19 MB, 62.27 MB, 50.84 MB, 55.59 MB, 48.55 MB, 57.52 MB, 49.04 MB, 45.21 MB, 41.06 MB, 57.64 MB, 54.75 MB, 44.72 MB, 67.22 MB, 47.67 MB, 45.73 MB, 40.27 MB, 44.67 MB, 45.84 MB, 50.07 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 80.78 MB (84702447) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 778.68M (778684564) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m39s - TotalStorageWaitTime: 3m57s - TotalThreadsInvoluntaryContextSwitches: 59.92K (59925) - TotalThreadsTotalWallClockTime: 35m49s - TotalThreadsSysTime: 9s335ms - TotalThreadsUserTime: 5m37s - TotalThreadsVoluntaryContextSwitches: 355.26K (355263) Fragment Instance Lifecycle Timings: - ExecTime: 17m55s - ExecTreeExecTime: 4m - OpenTime: 22.947ms - ExecTreeOpenTime: 430.848us - PrepareTime: 26.884ms - ExecTreePrepareTime: 3.247ms DataStreamSender (dst_id=21):(Total: 2m39s, non-child: 2m39s, % non-child: 100.00%) - BytesSent: 20.94 GB (22484693058) - NetworkThroughput(*): 460.71 MB/sec - OverallThroughput: 134.66 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 778.68M (778684564) - SerializeBatchTime: 1m52s - TransmitDataRPCTime: 46s543ms - UncompressedRowBatchSize: 29.74 GB (31933114052) CodeGen:(Total: 37.832ms, non-child: 37.832ms, % non-child: 100.00%) - CodegenTime: 701.346us - CompileTime: 6.251ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.818ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 16.348ms HDFS_SCAN_NODE (id=0):(Total: 4m, non-child: 4m, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:109/25.03 GB 5:99/22.55 GB 6:118/27.04 GB 7:115/26.81 GB 1:108/25.07 GB 3:92/20.80 GB 2:112/25.75 GB 4:107/24.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 164 out of 164 Runtime filters: All filters arrived. Waited 603ms Hdfs Read Thread Concurrency Bucket: 0:76.14% 1:23.86% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:696 PARQUET/SNAPPY:984 BytesRead(32s000ms): 51.74 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 54.84 MB, 143.16 MB, 580.65 MB, 966.57 MB, 1.26 GB, 1.79 GB, 2.28 GB, 3.01 GB, 3.59 GB, 4.12 GB, 4.51 GB, 4.87 GB, 5.43 GB, 5.83 GB, 6.17 GB, 6.70 GB, 7.24 GB, 7.73 GB, 8.18 GB, 8.58 GB - FooterProcessingTime: (Avg: 140.200ms ; Min: 1.127ms ; Max: 1s082ms ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.15 GB (9824571490) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.15 GB (9824571490) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.15 GB (9824571490) - DecompressionTime: 40s874ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.55 MB (83414467) - PerReadThreadRawHdfsThroughput: 36.25 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m57s - RowBatchQueuePutWaitTime: 11m13s - RowsRead: 778.68M (778684564) - RowsReturned: 778.68M (778684564) - RowsReturnedRate: 3.24 M/sec - ScanRangesComplete: 860 (860) - ScannerThreadsInvoluntaryContextSwitches: 28.83K (28826) - ScannerThreadsTotalWallClockTime: 17m54s - MaterializeTupleTime(*): 1m52s - ScannerThreadsSysTime: 3s817ms - ScannerThreadsUserTime: 2m27s - ScannerThreadsVoluntaryContextSwitches: 331.34K (331344) - TotalRawHdfsReadTime(*): 4m18s - TotalReadThroughput: 8.72 MB/sec Filter 0 (1.00 MB): - Files processed: 860 (860) - Files rejected: 696 (696) - Files total: 860 (860) - RowGroups processed: 760.51K (760509) - RowGroups rejected: 0 (0) - RowGroups total: 760.51K (760509) - Rows processed: 2.69M (2686976) - Rows rejected: 0 (0) - Rows total: 778.68M (778684564) - Splits processed: 164 (164) - Splits rejected: 0 (0) - Splits total: 164 (164) Instance e84a99bb0c926c46:9c59890200000001 (host=vd1316.halxg.cloudera.com:22000):(Total: 17m46s, non-child: 11m15s, % non-child: 63.32%) Hdfs split stats (:<# splits>/): 3:98/22.36 GB 2:116/26.47 GB 1:104/24.43 GB 6:103/23.93 GB 4:104/23.03 GB 0:125/28.32 GB 7:98/22.80 GB 5:111/26.22 GB Filter 0 arrival: 621ms MemoryUsage(32s000ms): 71.97 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 76.33 MB, 68.23 MB, 61.25 MB, 56.05 MB, 60.65 MB, 50.40 MB, 48.73 MB, 41.62 MB, 41.42 MB, 46.90 MB, 55.22 MB, 51.72 MB, 42.68 MB, 64.89 MB, 50.50 MB, 45.09 MB, 40.12 MB, 42.87 MB, 50.02 MB, 44.14 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 79.29 MB (83145061) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 793.26M (793261845) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m40s - TotalStorageWaitTime: 3m50s - TotalThreadsInvoluntaryContextSwitches: 49.91K (49910) - TotalThreadsTotalWallClockTime: 35m31s - TotalThreadsSysTime: 9s648ms - TotalThreadsUserTime: 5m39s - TotalThreadsVoluntaryContextSwitches: 347.37K (347373) Fragment Instance Lifecycle Timings: - ExecTime: 17m46s - ExecTreeExecTime: 3m49s - OpenTime: 22.025ms - ExecTreeOpenTime: 469.571us - PrepareTime: 38.376ms - ExecTreePrepareTime: 4.221ms DataStreamSender (dst_id=21):(Total: 2m41s, non-child: 2m41s, % non-child: 100.00%) - BytesSent: 21.32 GB (22896671666) - NetworkThroughput(*): 455.90 MB/sec - OverallThroughput: 135.18 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 793.26M (793261845) - SerializeBatchTime: 1m53s - TransmitDataRPCTime: 47s896ms - UncompressedRowBatchSize: 30.30 GB (32530914497) CodeGen:(Total: 38.640ms, non-child: 38.640ms, % non-child: 100.00%) - CodegenTime: 598.760us - CompileTime: 6.038ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.289ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 17.880ms HDFS_SCAN_NODE (id=0):(Total: 3m49s, non-child: 3m49s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:98/22.36 GB 2:116/26.47 GB 1:104/24.43 GB 6:103/23.93 GB 4:104/23.03 GB 0:125/28.32 GB 7:98/22.80 GB 5:111/26.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: All filters arrived. Waited 583ms Hdfs Read Thread Concurrency Bucket: 0:76.91% 1:23.09% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:691 PARQUET/SNAPPY:1008 BytesRead(32s000ms): 57.36 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 61.21 MB, 148.31 MB, 649.25 MB, 1.12 GB, 1.46 GB, 2.01 GB, 2.50 GB, 3.09 GB, 3.63 GB, 4.17 GB, 4.67 GB, 5.06 GB, 5.60 GB, 5.87 GB, 6.17 GB, 6.70 GB, 7.26 GB, 7.82 GB, 8.39 GB, 8.94 GB - FooterProcessingTime: (Avg: 193.123ms ; Min: 1.150ms ; Max: 2s452ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.29 GB (9977536815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.29 GB (9977536815) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.29 GB (9977536815) - DecompressionTime: 39s157ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.05 MB (81841816) - PerReadThreadRawHdfsThroughput: 38.77 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m46s - RowBatchQueuePutWaitTime: 11m14s - RowsRead: 793.26M (793261845) - RowsReturned: 793.26M (793261845) - RowsReturnedRate: 3.46 M/sec - ScanRangesComplete: 859 (859) - ScannerThreadsInvoluntaryContextSwitches: 25.20K (25201) - ScannerThreadsTotalWallClockTime: 17m45s - MaterializeTupleTime(*): 1m54s - ScannerThreadsSysTime: 3s987ms - ScannerThreadsUserTime: 2m29s - ScannerThreadsVoluntaryContextSwitches: 324.76K (324758) - TotalRawHdfsReadTime(*): 4m5s - TotalReadThroughput: 8.93 MB/sec Filter 0 (1.00 MB): - Files processed: 859 (859) - Files rejected: 691 (691) - Files total: 859 (859) - RowGroups processed: 774.75K (774746) - RowGroups rejected: 0 (0) - RowGroups total: 774.75K (774746) - Rows processed: 2.75M (2752512) - Rows rejected: 0 (0) - Rows total: 793.26M (793261845) - Splits processed: 168 (168) - Splits rejected: 0 (0) - Splits total: 168 (168) Instance e84a99bb0c926c46:9c59890200000002 (host=vd1311.halxg.cloudera.com:22000):(Total: 17m35s, non-child: 11m7s, % non-child: 63.20%) Hdfs split stats (:<# splits>/): 3:102/23.81 GB 5:109/25.05 GB 2:107/24.83 GB 0:116/26.85 GB 4:106/24.03 GB 7:102/23.72 GB 1:101/23.61 GB 6:112/25.76 GB Filter 0 arrival: 647ms MemoryUsage(32s000ms): 76.12 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 77.34 MB, 71.67 MB, 52.69 MB, 51.23 MB, 53.61 MB, 47.57 MB, 47.89 MB, 47.23 MB, 48.78 MB, 43.13 MB, 46.21 MB, 49.08 MB, 44.24 MB, 63.24 MB, 47.98 MB, 43.47 MB, 43.96 MB, 42.86 MB, 46.85 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 80.53 MB (84440299) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 787.40M (787398926) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m33s - TotalStorageWaitTime: 3m50s - TotalThreadsInvoluntaryContextSwitches: 47.78K (47778) - TotalThreadsTotalWallClockTime: 35m10s - TotalThreadsSysTime: 8s788ms - TotalThreadsUserTime: 5m33s - TotalThreadsVoluntaryContextSwitches: 350.31K (350306) Fragment Instance Lifecycle Timings: - ExecTime: 17m35s - ExecTreeExecTime: 3m51s - OpenTime: 24.104ms - ExecTreeOpenTime: 360.809us - PrepareTime: 23.523ms - ExecTreePrepareTime: 2.100ms DataStreamSender (dst_id=21):(Total: 2m37s, non-child: 2m37s, % non-child: 100.00%) - BytesSent: 21.17 GB (22731536298) - NetworkThroughput(*): 469.50 MB/sec - OverallThroughput: 137.47 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 787.40M (787398926) - SerializeBatchTime: 1m51s - TransmitDataRPCTime: 46s173ms - UncompressedRowBatchSize: 30.07 GB (32290481770) CodeGen:(Total: 37.156ms, non-child: 37.156ms, % non-child: 100.00%) - CodegenTime: 607.932us - CompileTime: 7.726ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.570ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 14.492ms HDFS_SCAN_NODE (id=0):(Total: 3m50s, non-child: 3m50s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:102/23.81 GB 5:109/25.05 GB 2:107/24.83 GB 0:116/26.85 GB 4:106/24.03 GB 7:102/23.72 GB 1:101/23.61 GB 6:112/25.76 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 165 out of 165 Runtime filters: All filters arrived. Waited 622ms Hdfs Read Thread Concurrency Bucket: 0:77.01% 1:22.99% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:690 PARQUET/SNAPPY:990 BytesRead(32s000ms): 60.11 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 61.07 MB, 159.92 MB, 567.39 MB, 1.06 GB, 1.39 GB, 1.80 GB, 2.28 GB, 2.94 GB, 3.54 GB, 4.15 GB, 4.56 GB, 4.97 GB, 5.59 GB, 6.01 GB, 6.37 GB, 6.92 GB, 7.41 GB, 8.00 GB, 8.49 GB - FooterProcessingTime: (Avg: 154.209ms ; Min: 985.974us ; Max: 3s271ms ; Number of samples: 165) - AverageHdfsReadThreadConcurrency: 0.23 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.24 GB (9917635607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.24 GB (9917635607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.24 GB (9917635607) - DecompressionTime: 36s852ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 165 (165) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 79.30 MB (83152319) - PerReadThreadRawHdfsThroughput: 39.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m47s - RowBatchQueuePutWaitTime: 11m9s - RowsRead: 787.40M (787398926) - RowsReturned: 787.40M (787398926) - RowsReturnedRate: 3.41 M/sec - ScanRangesComplete: 855 (855) - ScannerThreadsInvoluntaryContextSwitches: 23.80K (23802) - ScannerThreadsTotalWallClockTime: 17m34s - MaterializeTupleTime(*): 1m51s - ScannerThreadsSysTime: 3s575ms - ScannerThreadsUserTime: 2m26s - ScannerThreadsVoluntaryContextSwitches: 330.95K (330952) - TotalRawHdfsReadTime(*): 4m2s - TotalReadThroughput: 8.97 MB/sec Filter 0 (1.00 MB): - Files processed: 855 (855) - Files rejected: 690 (690) - Files total: 855 (855) - RowGroups processed: 769.02K (769023) - RowGroups rejected: 0 (0) - RowGroups total: 769.02K (769023) - Rows processed: 2.70M (2703360) - Rows rejected: 0 (0) - Rows total: 787.40M (787398926) - Splits processed: 165 (165) - Splits rejected: 0 (0) - Splits total: 165 (165) Instance e84a99bb0c926c46:9c59890200000004 (host=vd1314.halxg.cloudera.com:22000):(Total: 17m28s, non-child: 11m16s, % non-child: 64.58%) Hdfs split stats (:<# splits>/): 7:121/28.05 GB 2:106/24.27 GB 6:102/23.53 GB 5:102/23.72 GB 1:94/21.60 GB 4:120/27.73 GB 0:105/24.14 GB 3:105/24.53 GB Filter 0 arrival: 647ms MemoryUsage(32s000ms): 70.68 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.95 MB, 75.94 MB, 62.50 MB, 60.80 MB, 52.36 MB, 58.21 MB, 49.57 MB, 52.93 MB, 47.30 MB, 47.84 MB, 51.88 MB, 58.46 MB, 53.69 MB, 49.24 MB, 59.29 MB, 50.00 MB, 46.34 MB, 41.28 MB, 47.75 MB, 45.88 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 79.29 MB (83136852) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 797.53M (797526158) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10m42s - TotalStorageWaitTime: 3m29s - TotalThreadsInvoluntaryContextSwitches: 47.92K (47917) - TotalThreadsTotalWallClockTime: 34m55s - TotalThreadsSysTime: 8s955ms - TotalThreadsUserTime: 5m40s - TotalThreadsVoluntaryContextSwitches: 349.88K (349876) Fragment Instance Lifecycle Timings: - ExecTime: 17m28s - ExecTreeExecTime: 3m30s - OpenTime: 23.688ms - ExecTreeOpenTime: 433.115us - PrepareTime: 24.994ms - ExecTreePrepareTime: 2.401ms DataStreamSender (dst_id=21):(Total: 2m41s, non-child: 2m41s, % non-child: 100.00%) - BytesSent: 21.44 GB (23021940038) - NetworkThroughput(*): 456.82 MB/sec - OverallThroughput: 136.05 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 797.53M (797526158) - SerializeBatchTime: 1m53s - TransmitDataRPCTime: 48s061ms - UncompressedRowBatchSize: 30.46 GB (32705789922) CodeGen:(Total: 38.217ms, non-child: 38.217ms, % non-child: 100.00%) - CodegenTime: 659.944us - CompileTime: 6.776ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.146ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.889ms HDFS_SCAN_NODE (id=0):(Total: 3m29s, non-child: 3m29s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:121/28.05 GB 2:106/24.27 GB 6:102/23.53 GB 5:102/23.72 GB 1:94/21.60 GB 4:120/27.73 GB 0:105/24.14 GB 3:105/24.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: All filters arrived. Waited 622ms Hdfs Read Thread Concurrency Bucket: 0:79.76% 1:20.24% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:687 PARQUET/SNAPPY:1008 BytesRead(32s000ms): 56.36 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 60.97 MB, 120.91 MB, 496.35 MB, 1.03 GB, 1.35 GB, 1.78 GB, 2.39 GB, 3.01 GB, 3.60 GB, 4.28 GB, 4.92 GB, 5.32 GB, 5.92 GB, 6.29 GB, 6.66 GB, 7.28 GB, 7.78 GB, 8.26 GB, 8.72 GB - FooterProcessingTime: (Avg: 161.618ms ; Min: 1.094ms ; Max: 1s714ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 9.35 GB (10040514033) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.35 GB (10040514033) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.35 GB (10040514033) - DecompressionTime: 37s895ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 78.05 MB (81841417) - PerReadThreadRawHdfsThroughput: 43.64 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m27s - RowBatchQueuePutWaitTime: 11m17s - RowsRead: 797.53M (797526158) - RowsReturned: 797.53M (797526158) - RowsReturnedRate: 3.80 M/sec - ScanRangesComplete: 855 (855) - ScannerThreadsInvoluntaryContextSwitches: 24.21K (24206) - ScannerThreadsTotalWallClockTime: 17m27s - MaterializeTupleTime(*): 1m55s - ScannerThreadsSysTime: 3s604ms - ScannerThreadsUserTime: 2m30s - ScannerThreadsVoluntaryContextSwitches: 329.25K (329247) - TotalRawHdfsReadTime(*): 3m39s - TotalReadThroughput: 9.14 MB/sec Filter 0 (1.00 MB): - Files processed: 855 (855) - Files rejected: 687 (687) - Files total: 855 (855) - RowGroups processed: 778.93K (778926) - RowGroups rejected: 0 (0) - RowGroups total: 778.93K (778926) - Rows processed: 2.75M (2752512) - Rows rejected: 0 (0) - Rows total: 797.53M (797526158) - Splits processed: 168 (168) - Splits rejected: 0 (0) - Splits total: 168 (168) Averaged Fragment F01:(Total: 6m32s, non-child: 2m25s, % non-child: 37.09%) split sizes: min: 22.90 GB, max: 23.03 GB, avg: 22.95 GB, stddev: 43.26 MB completion times: min:5m55s max:7m23s mean: 6m32s stddev:25s900ms execution rates: min:53.15 MB/sec max:66.11 MB/sec mean:60.19 MB/sec stddev:3.78 MB/sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 64.84 MB (67990574) - PerHostPeakMemUsage: 8.25 GB (8862941342) - RowsProduced: 411.39M (411395000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m - TotalStorageWaitTime: 3m23s - TotalThreadsInvoluntaryContextSwitches: 19.90K (19897) - TotalThreadsTotalWallClockTime: 13m4s - TotalThreadsSysTime: 3s784ms - TotalThreadsUserTime: 1m38s - TotalThreadsVoluntaryContextSwitches: 287.93K (287928) Fragment Instance Lifecycle Timings: - ExecTime: 6m32s - ExecTreeExecTime: 3m19s - OpenTime: 14.699ms - ExecTreeOpenTime: 173.895us - PrepareTime: 43.792ms - ExecTreePrepareTime: 1.732ms DataStreamSender (dst_id=22):(Total: 47s540ms, non-child: 47s540ms, % non-child: 100.00%) - BytesSent: 5.85 GB (6286194714) - NetworkThroughput(*): 352.53 MB/sec - OverallThroughput: 126.11 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 411.39M (411395000) - SerializeBatchTime: 30s485ms - TransmitDataRPCTime: 17s005ms - UncompressedRowBatchSize: 8.05 GB (8641003828) CodeGen:(Total: 40.406ms, non-child: 40.406ms, % non-child: 100.00%) - CodegenTime: 290.552us - CompileTime: 4.659ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 6.665ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 28.591ms HDFS_SCAN_NODE (id=1):(Total: 3m19s, non-child: 3m19s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.18 GB (4487856523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 GB (4487856523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 GB (4487856523) - DecompressionTime: 16s874ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 288 (288) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 64.60 MB (67734168) - PerReadThreadRawHdfsThroughput: 40.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m17s - RowBatchQueuePutWaitTime: 2m35s - RowsRead: 411.39M (411395000) - RowsReturned: 411.39M (411395000) - RowsReturnedRate: 2.10 M/sec - ScanRangesComplete: 288 (288) - ScannerThreadsInvoluntaryContextSwitches: 9.28K (9281) - ScannerThreadsTotalWallClockTime: 6m32s - MaterializeTupleTime(*): 12s413ms - ScannerThreadsSysTime: 1s812ms - ScannerThreadsUserTime: 28s424ms - ScannerThreadsVoluntaryContextSwitches: 277.99K (277987) - TotalRawHdfsReadTime(*): 1m47s - TotalReadThroughput: 10.96 MB/sec Fragment F01: Instance e84a99bb0c926c46:9c5989020000000d (host=vd1309.halxg.cloudera.com:22000):(Total: 7m23s, non-child: 2m30s, % non-child: 33.93%) Hdfs split stats (:<# splits>/): 4:36/3.11 GB 5:35/3.03 GB 6:46/3.30 GB 0:36/2.94 GB 3:33/2.48 GB 2:32/2.64 GB 7:37/3.00 GB 1:31/2.55 GB MemoryUsage(8s000ms): 22.16 MB, 8.03 MB, 26.77 MB, 13.67 MB, 9.21 MB, 10.83 MB, 20.70 MB, 8.88 MB, 13.37 MB, 11.47 MB, 9.69 MB, 8.27 MB, 21.83 MB, 19.66 MB, 12.32 MB, 20.54 MB, 24.20 MB, 21.96 MB, 9.20 MB, 11.20 MB, 18.41 MB, 13.73 MB, 13.45 MB, 11.40 MB, 19.48 MB, 10.99 MB, 12.83 MB, 10.33 MB, 14.69 MB, 21.02 MB, 20.23 MB, 27.72 MB, 10.38 MB, 16.37 MB, 10.37 MB, 16.79 MB, 11.63 MB, 25.14 MB, 10.59 MB, 11.52 MB, 3.31 MB, 17.16 MB, 11.35 MB, 12.30 MB, 8.32 MB, 14.44 MB, 8.45 MB, 11.53 MB, 11.25 MB, 11.41 MB, 8.98 MB, 11.67 MB, 11.23 MB, 8.65 MB, 11.89 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 70.20 MB (73610627) - PerHostPeakMemUsage: 8.24 GB (8842656660) - RowsProduced: 415.65M (415650596) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m - TotalStorageWaitTime: 4m8s - TotalThreadsInvoluntaryContextSwitches: 27.84K (27840) - TotalThreadsTotalWallClockTime: 14m47s - TotalThreadsSysTime: 4s017ms - TotalThreadsUserTime: 1m39s - TotalThreadsVoluntaryContextSwitches: 292.64K (292640) Fragment Instance Lifecycle Timings: - ExecTime: 7m23s - ExecTreeExecTime: 4m4s - OpenTime: 12.742ms - ExecTreeOpenTime: 208.933us - PrepareTime: 37.071ms - ExecTreePrepareTime: 1.678ms DataStreamSender (dst_id=22):(Total: 48s662ms, non-child: 48s662ms, % non-child: 100.00%) - BytesSent: 5.91 GB (6340701931) - NetworkThroughput(*): 353.87 MB/sec - OverallThroughput: 124.26 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 415.65M (415650596) - SerializeBatchTime: 31s525ms - TransmitDataRPCTime: 17s087ms - UncompressedRowBatchSize: 8.13 GB (8730389016) CodeGen:(Total: 36.091ms, non-child: 36.091ms, % non-child: 100.00%) - CodegenTime: 277.429us - CompileTime: 3.999ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 6.614ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 24.982ms HDFS_SCAN_NODE (id=1):(Total: 4m4s, non-child: 4m4s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:36/3.11 GB 5:35/3.03 GB 6:46/3.30 GB 0:36/2.94 GB 3:33/2.48 GB 2:32/2.64 GB 7:37/3.00 GB 1:31/2.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 286 out of 286 Hdfs Read Thread Concurrency Bucket: 0:71.7% 1:28.3% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:572 BytesRead(8s000ms): 122.55 MB, 302.99 MB, 481.37 MB, 750.66 MB, 964.52 MB, 1.08 GB, 1.18 GB, 1.25 GB, 1.34 GB, 1.40 GB, 1.45 GB, 1.54 GB, 1.61 GB, 1.62 GB, 1.65 GB, 1.71 GB, 1.74 GB, 1.75 GB, 1.79 GB, 1.82 GB, 1.87 GB, 1.90 GB, 1.95 GB, 2.02 GB, 2.07 GB, 2.12 GB, 2.24 GB, 2.36 GB, 2.40 GB, 2.43 GB, 2.43 GB, 2.45 GB, 2.48 GB, 2.58 GB, 2.66 GB, 2.70 GB, 2.75 GB, 2.79 GB, 2.84 GB, 2.91 GB, 2.94 GB, 2.99 GB, 3.09 GB, 3.17 GB, 3.25 GB, 3.32 GB, 3.40 GB, 3.46 GB, 3.54 GB, 3.62 GB, 3.71 GB, 3.78 GB, 3.88 GB, 3.97 GB, 4.07 GB - FooterProcessingTime: (Avg: 276.243ms ; Min: 1.313ms ; Max: 2s551ms ; Number of samples: 286) - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.21 GB (4518787576) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.21 GB (4518787576) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.21 GB (4518787576) - DecompressionTime: 16s359ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 286 (286) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 69.90 MB (73297369) - PerReadThreadRawHdfsThroughput: 35.35 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4m2s - RowBatchQueuePutWaitTime: 2m38s - RowsRead: 415.65M (415650596) - RowsReturned: 415.65M (415650596) - RowsReturnedRate: 1.70 M/sec - ScanRangesComplete: 286 (286) - ScannerThreadsInvoluntaryContextSwitches: 11.51K (11508) - ScannerThreadsTotalWallClockTime: 7m23s - MaterializeTupleTime(*): 15s564ms - ScannerThreadsSysTime: 1s850ms - ScannerThreadsUserTime: 27s937ms - ScannerThreadsVoluntaryContextSwitches: 283.66K (283658) - TotalRawHdfsReadTime(*): 2m1s - TotalReadThroughput: 9.71 MB/sec Instance e84a99bb0c926c46:9c5989020000000c (host=vd1312.halxg.cloudera.com:22000):(Total: 6m41s, non-child: 2m27s, % non-child: 36.70%) Hdfs split stats (:<# splits>/): 3:40/3.52 GB 0:37/2.95 GB 4:39/3.07 GB 2:26/2.06 GB 6:30/2.43 GB 5:37/3.22 GB 7:34/2.56 GB 1:41/3.14 GB MemoryUsage(8s000ms): 17.11 MB, 11.69 MB, 18.89 MB, 11.44 MB, 8.58 MB, 8.56 MB, 18.36 MB, 13.11 MB, 13.01 MB, 25.34 MB, 12.12 MB, 8.28 MB, 18.62 MB, 21.49 MB, 14.72 MB, 17.16 MB, 21.24 MB, 20.29 MB, 8.74 MB, 8.23 MB, 18.55 MB, 13.68 MB, 13.60 MB, 13.88 MB, 19.03 MB, 12.97 MB, 12.38 MB, 7.90 MB, 19.46 MB, 20.17 MB, 16.96 MB, 21.62 MB, 18.08 MB, 11.31 MB, 12.93 MB, 21.74 MB, 9.39 MB, 11.53 MB, 19.39 MB, 7.37 MB, 12.64 MB, 6.38 MB, 10.55 MB, 10.28 MB, 12.84 MB, 14.35 MB, 9.21 MB, 10.43 MB, 12.68 MB, 13.53 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 71.78 MB (75266723) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 414.20M (414199417) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m4s - TotalStorageWaitTime: 3m31s - TotalThreadsInvoluntaryContextSwitches: 17.68K (17676) - TotalThreadsTotalWallClockTime: 13m23s - TotalThreadsSysTime: 3s641ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 287.17K (287166) Fragment Instance Lifecycle Timings: - ExecTime: 6m41s - ExecTreeExecTime: 3m26s - OpenTime: 10.332ms - ExecTreeOpenTime: 110.230us - PrepareTime: 32.892ms - ExecTreePrepareTime: 1.472ms DataStreamSender (dst_id=22):(Total: 47s655ms, non-child: 47s655ms, % non-child: 100.00%) - BytesSent: 5.89 GB (6320772496) - NetworkThroughput(*): 351.25 MB/sec - OverallThroughput: 126.49 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 414.20M (414199417) - SerializeBatchTime: 30s444ms - TransmitDataRPCTime: 17s161ms - UncompressedRowBatchSize: 8.10 GB (8699908221) CodeGen:(Total: 32.831ms, non-child: 32.831ms, % non-child: 100.00%) - CodegenTime: 204.261us - CompileTime: 3.622ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.364ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 23.480ms HDFS_SCAN_NODE (id=1):(Total: 3m26s, non-child: 3m26s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:40/3.52 GB 0:37/2.95 GB 4:39/3.07 GB 2:26/2.06 GB 6:30/2.43 GB 5:37/3.22 GB 7:34/2.56 GB 1:41/3.14 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 284 out of 284 Hdfs Read Thread Concurrency Bucket: 0:70.15% 1:29.85% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:568 BytesRead(8s000ms): 103.80 MB, 362.07 MB, 579.69 MB, 850.74 MB, 1.12 GB, 1.29 GB, 1.42 GB, 1.50 GB, 1.57 GB, 1.67 GB, 1.70 GB, 1.74 GB, 1.80 GB, 1.82 GB, 1.84 GB, 1.88 GB, 1.91 GB, 1.92 GB, 1.98 GB, 2.06 GB, 2.14 GB, 2.18 GB, 2.27 GB, 2.38 GB, 2.45 GB, 2.50 GB, 2.61 GB, 2.70 GB, 2.76 GB, 2.79 GB, 2.80 GB, 2.82 GB, 2.86 GB, 2.94 GB, 3.04 GB, 3.13 GB, 3.18 GB, 3.22 GB, 3.33 GB, 3.42 GB, 3.49 GB, 3.55 GB, 3.59 GB, 3.64 GB, 3.74 GB, 3.86 GB, 3.92 GB, 3.98 GB, 4.03 GB, 4.12 GB - FooterProcessingTime: (Avg: 203.049ms ; Min: 1.493ms ; Max: 1s295ms ; Number of samples: 284) - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.20 GB (4505301420) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.20 GB (4505301420) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.20 GB (4505301420) - DecompressionTime: 16s692ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 284 (284) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 71.55 MB (75025833) - PerReadThreadRawHdfsThroughput: 35.42 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m25s - RowBatchQueuePutWaitTime: 2m36s - RowsRead: 414.20M (414199417) - RowsReturned: 414.20M (414199417) - RowsReturnedRate: 2.00 M/sec - ScanRangesComplete: 284 (284) - ScannerThreadsInvoluntaryContextSwitches: 8.29K (8294) - ScannerThreadsTotalWallClockTime: 6m41s - MaterializeTupleTime(*): 13s191ms - ScannerThreadsSysTime: 1s694ms - ScannerThreadsUserTime: 28s866ms - ScannerThreadsVoluntaryContextSwitches: 278.22K (278221) - TotalRawHdfsReadTime(*): 2m1s - TotalReadThroughput: 10.69 MB/sec Instance e84a99bb0c926c46:9c59890200000009 (host=vd1313.halxg.cloudera.com:22000):(Total: 6m37s, non-child: 2m20s, % non-child: 35.39%) Hdfs split stats (:<# splits>/): 2:37/2.99 GB 1:31/2.41 GB 3:42/3.09 GB 4:41/3.24 GB 7:35/2.69 GB 0:43/3.32 GB 6:33/2.77 GB 5:33/2.51 GB MemoryUsage(8s000ms): 19.56 MB, 16.36 MB, 14.17 MB, 17.16 MB, 20.06 MB, 13.48 MB, 16.95 MB, 12.48 MB, 9.55 MB, 19.25 MB, 9.47 MB, 10.68 MB, 20.90 MB, 23.18 MB, 13.97 MB, 16.63 MB, 19.00 MB, 17.26 MB, 11.52 MB, 6.25 MB, 16.07 MB, 12.66 MB, 12.22 MB, 14.91 MB, 23.47 MB, 9.68 MB, 13.74 MB, 12.41 MB, 14.43 MB, 21.21 MB, 21.91 MB, 33.74 MB, 13.81 MB, 17.91 MB, 10.96 MB, 21.66 MB, 12.50 MB, 15.21 MB, 9.46 MB, 10.90 MB, 11.34 MB, 8.38 MB, 6.61 MB, 11.58 MB, 11.75 MB, 10.90 MB, 11.75 MB, 14.11 MB, 12.82 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 33.79 MB (35436498) - PerHostPeakMemUsage: 8.24 GB (8850074976) - RowsProduced: 406.56M (406563722) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m55s - TotalStorageWaitTime: 3m34s - TotalThreadsInvoluntaryContextSwitches: 20.61K (20614) - TotalThreadsTotalWallClockTime: 13m15s - TotalThreadsSysTime: 4s204ms - TotalThreadsUserTime: 1m39s - TotalThreadsVoluntaryContextSwitches: 282.18K (282178) Fragment Instance Lifecycle Timings: - ExecTime: 6m37s - ExecTreeExecTime: 3m29s - OpenTime: 28.821ms - ExecTreeOpenTime: 399.944us - PrepareTime: 130.415ms - ExecTreePrepareTime: 4.694ms DataStreamSender (dst_id=22):(Total: 47s768ms, non-child: 47s768ms, % non-child: 100.00%) - BytesSent: 5.80 GB (6230419024) - NetworkThroughput(*): 351.45 MB/sec - OverallThroughput: 124.39 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 406.56M (406563722) - SerializeBatchTime: 30s809ms - TransmitDataRPCTime: 16s906ms - UncompressedRowBatchSize: 7.95 GB (8539526914) CodeGen:(Total: 100.343ms, non-child: 100.343ms, % non-child: 100.00%) - CodegenTime: 606.579us - CompileTime: 9.738ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 11.572ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 78.149ms HDFS_SCAN_NODE (id=1):(Total: 3m29s, non-child: 3m29s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:37/2.99 GB 1:31/2.41 GB 3:42/3.09 GB 4:41/3.24 GB 7:35/2.69 GB 0:43/3.32 GB 6:33/2.77 GB 5:33/2.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 295 out of 295 Hdfs Read Thread Concurrency Bucket: 0:71.57% 1:28.43% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:590 BytesRead(8s000ms): 139.29 MB, 444.82 MB, 738.06 MB, 944.45 MB, 1.25 GB, 1.47 GB, 1.61 GB, 1.68 GB, 1.78 GB, 1.84 GB, 1.87 GB, 1.94 GB, 1.98 GB, 1.99 GB, 2.02 GB, 2.08 GB, 2.11 GB, 2.12 GB, 2.18 GB, 2.25 GB, 2.30 GB, 2.34 GB, 2.43 GB, 2.52 GB, 2.59 GB, 2.62 GB, 2.73 GB, 2.84 GB, 2.90 GB, 2.92 GB, 2.93 GB, 2.94 GB, 3.00 GB, 3.12 GB, 3.23 GB, 3.30 GB, 3.33 GB, 3.34 GB, 3.39 GB, 3.46 GB, 3.54 GB, 3.60 GB, 3.65 GB, 3.71 GB, 3.78 GB, 3.87 GB, 3.94 GB, 3.99 GB, 4.07 GB - FooterProcessingTime: (Avg: 217.157ms ; Min: 1.574ms ; Max: 1s856ms ; Number of samples: 295) - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.16 GB (4461963090) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.16 GB (4461963090) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.16 GB (4461963090) - DecompressionTime: 17s307ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 295 (295) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 33.56 MB (35189299) - PerReadThreadRawHdfsThroughput: 37.11 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m27s - RowBatchQueuePutWaitTime: 2m29s - RowsRead: 406.56M (406563722) - RowsReturned: 406.56M (406563722) - RowsReturnedRate: 1.94 M/sec - ScanRangesComplete: 295 (295) - ScannerThreadsInvoluntaryContextSwitches: 10.14K (10143) - ScannerThreadsTotalWallClockTime: 6m37s - MaterializeTupleTime(*): 11s910ms - ScannerThreadsSysTime: 2s013ms - ScannerThreadsUserTime: 28s647ms - ScannerThreadsVoluntaryContextSwitches: 272.99K (272990) - TotalRawHdfsReadTime(*): 1m54s - TotalReadThroughput: 10.69 MB/sec Instance e84a99bb0c926c46:9c5989020000000e (host=vd1311.halxg.cloudera.com:22000):(Total: 6m33s, non-child: 2m23s, % non-child: 36.43%) Hdfs split stats (:<# splits>/): 7:31/2.70 GB 4:39/3.12 GB 0:49/3.59 GB 3:31/2.34 GB 2:33/2.60 GB 6:25/2.24 GB 5:39/3.03 GB 1:42/3.27 GB MemoryUsage(8s000ms): 14.59 MB, 19.05 MB, 21.05 MB, 15.38 MB, 8.94 MB, 11.89 MB, 17.17 MB, 8.92 MB, 13.16 MB, 27.33 MB, 12.76 MB, 9.42 MB, 15.14 MB, 24.43 MB, 17.47 MB, 20.04 MB, 20.60 MB, 16.84 MB, 7.09 MB, 9.58 MB, 18.72 MB, 14.97 MB, 10.30 MB, 15.04 MB, 23.06 MB, 11.93 MB, 11.21 MB, 9.94 MB, 18.15 MB, 18.87 MB, 21.57 MB, 33.73 MB, 15.26 MB, 15.44 MB, 8.63 MB, 18.10 MB, 16.43 MB, 15.24 MB, 15.56 MB, 18.43 MB, 11.86 MB, 10.09 MB, 7.31 MB, 11.14 MB, 8.88 MB, 10.80 MB, 12.63 MB, 11.04 MB, 10.43 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 62.76 MB (65813155) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 410.04M (410037771) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m57s - TotalStorageWaitTime: 3m24s - TotalThreadsInvoluntaryContextSwitches: 18.65K (18647) - TotalThreadsTotalWallClockTime: 13m6s - TotalThreadsSysTime: 3s689ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 287.52K (287523) Fragment Instance Lifecycle Timings: - ExecTime: 6m33s - ExecTreeExecTime: 3m23s - OpenTime: 10.643ms - ExecTreeOpenTime: 101.359us - PrepareTime: 21.472ms - ExecTreePrepareTime: 783.074us DataStreamSender (dst_id=22):(Total: 47s011ms, non-child: 47s011ms, % non-child: 100.00%) - BytesSent: 5.84 GB (6266764820) - NetworkThroughput(*): 354.84 MB/sec - OverallThroughput: 127.13 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 410.04M (410037771) - SerializeBatchTime: 30s119ms - TransmitDataRPCTime: 16s842ms - UncompressedRowBatchSize: 8.02 GB (8612496371) CodeGen:(Total: 25.511ms, non-child: 25.511ms, % non-child: 100.00%) - CodegenTime: 215.956us - CompileTime: 3.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.847ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 15.957ms HDFS_SCAN_NODE (id=1):(Total: 3m23s, non-child: 3m23s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:31/2.70 GB 4:39/3.12 GB 0:49/3.59 GB 3:31/2.34 GB 2:33/2.60 GB 6:25/2.24 GB 5:39/3.03 GB 1:42/3.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 289 out of 289 Hdfs Read Thread Concurrency Bucket: 0:71.66% 1:28.34% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:578 BytesRead(8s000ms): 99.13 MB, 377.13 MB, 580.04 MB, 769.16 MB, 1010.71 MB, 1.16 GB, 1.31 GB, 1.41 GB, 1.49 GB, 1.59 GB, 1.63 GB, 1.72 GB, 1.77 GB, 1.78 GB, 1.83 GB, 1.90 GB, 1.94 GB, 1.95 GB, 2.01 GB, 2.10 GB, 2.20 GB, 2.25 GB, 2.34 GB, 2.44 GB, 2.50 GB, 2.55 GB, 2.66 GB, 2.76 GB, 2.82 GB, 2.86 GB, 2.87 GB, 2.89 GB, 2.94 GB, 3.04 GB, 3.12 GB, 3.18 GB, 3.23 GB, 3.25 GB, 3.31 GB, 3.42 GB, 3.53 GB, 3.62 GB, 3.68 GB, 3.74 GB, 3.81 GB, 3.90 GB, 3.97 GB, 4.04 GB, 4.12 GB - FooterProcessingTime: (Avg: 213.199ms ; Min: 1.099ms ; Max: 1s709ms ; Number of samples: 289) - AverageHdfsReadThreadConcurrency: 0.28 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.17 GB (4475888693) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.17 GB (4475888693) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.17 GB (4475888693) - DecompressionTime: 17s040ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 289 (289) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 62.53 MB (65563081) - PerReadThreadRawHdfsThroughput: 38.98 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m21s - RowBatchQueuePutWaitTime: 2m32s - RowsRead: 410.04M (410037771) - RowsReturned: 410.04M (410037771) - RowsReturnedRate: 2.02 M/sec - ScanRangesComplete: 289 (289) - ScannerThreadsInvoluntaryContextSwitches: 9.03K (9028) - ScannerThreadsTotalWallClockTime: 6m33s - MaterializeTupleTime(*): 13s216ms - ScannerThreadsSysTime: 1s763ms - ScannerThreadsUserTime: 28s261ms - ScannerThreadsVoluntaryContextSwitches: 276.51K (276512) - TotalRawHdfsReadTime(*): 1m49s - TotalReadThroughput: 10.85 MB/sec Instance e84a99bb0c926c46:9c5989020000000b (host=vd1316.halxg.cloudera.com:22000):(Total: 6m21s, non-child: 2m27s, % non-child: 38.64%) Hdfs split stats (:<# splits>/): 2:41/3.19 GB 0:28/2.35 GB 4:38/3.10 GB 5:41/3.26 GB 1:31/2.33 GB 3:42/2.96 GB 7:29/2.52 GB 6:40/3.22 GB MemoryUsage(8s000ms): 16.38 MB, 17.56 MB, 15.03 MB, 15.28 MB, 13.81 MB, 10.66 MB, 23.83 MB, 16.44 MB, 14.46 MB, 18.20 MB, 11.17 MB, 7.35 MB, 22.25 MB, 25.53 MB, 17.76 MB, 16.42 MB, 22.37 MB, 18.22 MB, 13.54 MB, 10.93 MB, 18.25 MB, 10.76 MB, 11.58 MB, 10.91 MB, 20.34 MB, 12.44 MB, 14.43 MB, 10.39 MB, 18.23 MB, 21.88 MB, 20.17 MB, 9.59 MB, 10.98 MB, 12.36 MB, 11.10 MB, 18.58 MB, 15.35 MB, 17.78 MB, 14.63 MB, 11.44 MB, 11.11 MB, 8.93 MB, 8.01 MB, 10.89 MB, 7.11 MB, 13.89 MB, 10.54 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 71.78 MB (75266723) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 411.04M (411038661) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m4s - TotalStorageWaitTime: 3m10s - TotalThreadsInvoluntaryContextSwitches: 17.88K (17881) - TotalThreadsTotalWallClockTime: 12m42s - TotalThreadsSysTime: 3s596ms - TotalThreadsUserTime: 1m36s - TotalThreadsVoluntaryContextSwitches: 287.22K (287224) Fragment Instance Lifecycle Timings: - ExecTime: 6m21s - ExecTreeExecTime: 3m6s - OpenTime: 14.471ms - ExecTreeOpenTime: 142.388us - PrepareTime: 35.791ms - ExecTreePrepareTime: 1.717ms DataStreamSender (dst_id=22):(Total: 47s398ms, non-child: 47s398ms, % non-child: 100.00%) - BytesSent: 5.85 GB (6280517030) - NetworkThroughput(*): 350.29 MB/sec - OverallThroughput: 126.37 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 411.04M (411038661) - SerializeBatchTime: 30s251ms - TransmitDataRPCTime: 17s098ms - UncompressedRowBatchSize: 8.04 GB (8633519225) CodeGen:(Total: 36.100ms, non-child: 36.100ms, % non-child: 100.00%) - CodegenTime: 250.439us - CompileTime: 4.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.915ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 25.562ms HDFS_SCAN_NODE (id=1):(Total: 3m6s, non-child: 3m6s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:41/3.19 GB 0:28/2.35 GB 4:38/3.10 GB 5:41/3.26 GB 1:31/2.33 GB 3:42/2.96 GB 7:29/2.52 GB 6:40/3.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 290 out of 290 Hdfs Read Thread Concurrency Bucket: 0:73.23% 1:26.77% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:580 BytesRead(8s000ms): 98.57 MB, 362.40 MB, 614.51 MB, 800.02 MB, 1.03 GB, 1.20 GB, 1.37 GB, 1.49 GB, 1.61 GB, 1.70 GB, 1.73 GB, 1.79 GB, 1.81 GB, 1.83 GB, 1.86 GB, 1.95 GB, 1.99 GB, 2.00 GB, 2.08 GB, 2.18 GB, 2.27 GB, 2.31 GB, 2.40 GB, 2.51 GB, 2.57 GB, 2.63 GB, 2.77 GB, 2.89 GB, 2.94 GB, 2.98 GB, 2.98 GB, 3.00 GB, 3.04 GB, 3.14 GB, 3.26 GB, 3.32 GB, 3.38 GB, 3.43 GB, 3.53 GB, 3.63 GB, 3.71 GB, 3.78 GB, 3.83 GB, 3.90 GB, 3.96 GB, 4.04 GB, 4.10 GB - FooterProcessingTime: (Avg: 199.296ms ; Min: 1.522ms ; Max: 1s635ms ; Number of samples: 290) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.18 GB (4483969606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 GB (4483969606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 GB (4483969606) - DecompressionTime: 16s860ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 290 (290) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 71.55 MB (75025855) - PerReadThreadRawHdfsThroughput: 42.39 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m5s - RowBatchQueuePutWaitTime: 2m39s - RowsRead: 411.04M (411038661) - RowsReturned: 411.04M (411038661) - RowsReturnedRate: 2.20 M/sec - ScanRangesComplete: 290 (290) - ScannerThreadsInvoluntaryContextSwitches: 8.37K (8373) - ScannerThreadsTotalWallClockTime: 6m21s - MaterializeTupleTime(*): 10s796ms - ScannerThreadsSysTime: 1s748ms - ScannerThreadsUserTime: 28s324ms - ScannerThreadsVoluntaryContextSwitches: 276.75K (276755) - TotalRawHdfsReadTime(*): 1m40s - TotalReadThroughput: 11.22 MB/sec Instance e84a99bb0c926c46:9c59890200000008 (host=vd1314.halxg.cloudera.com:22000):(Total: 6m11s, non-child: 2m22s, % non-child: 38.37%) Hdfs split stats (:<# splits>/): 7:34/2.93 GB 4:37/3.20 GB 2:35/3.05 GB 3:37/2.91 GB 1:31/2.55 GB 5:41/2.81 GB 6:34/2.69 GB 0:34/2.82 GB MemoryUsage(8s000ms): 17.09 MB, 13.85 MB, 19.67 MB, 21.43 MB, 14.62 MB, 13.86 MB, 18.62 MB, 8.43 MB, 11.60 MB, 13.35 MB, 13.84 MB, 10.70 MB, 25.18 MB, 28.62 MB, 27.20 MB, 18.13 MB, 16.43 MB, 16.20 MB, 13.68 MB, 8.89 MB, 25.86 MB, 13.49 MB, 11.07 MB, 11.87 MB, 14.43 MB, 11.28 MB, 12.03 MB, 10.19 MB, 22.00 MB, 26.39 MB, 23.75 MB, 21.72 MB, 14.40 MB, 13.10 MB, 15.40 MB, 50.21 MB, 21.50 MB, 23.52 MB, 7.92 MB, 7.61 MB, 12.09 MB, 7.76 MB, 10.36 MB, 12.91 MB, 10.32 MB, 8.66 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 71.79 MB (75273571) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 414.21M (414211639) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1m57s - TotalStorageWaitTime: 3m5s - TotalThreadsInvoluntaryContextSwitches: 18.27K (18273) - TotalThreadsTotalWallClockTime: 12m23s - TotalThreadsSysTime: 3s589ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 294.61K (294608) Fragment Instance Lifecycle Timings: - ExecTime: 6m11s - ExecTreeExecTime: 3m2s - OpenTime: 14.662ms - ExecTreeOpenTime: 117.353us - PrepareTime: 23.083ms - ExecTreePrepareTime: 827.420us DataStreamSender (dst_id=22):(Total: 47s066ms, non-child: 47s066ms, % non-child: 100.00%) - BytesSent: 5.89 GB (6320076099) - NetworkThroughput(*): 353.14 MB/sec - OverallThroughput: 128.06 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 414.21M (414211639) - SerializeBatchTime: 29s951ms - TransmitDataRPCTime: 17s067ms - UncompressedRowBatchSize: 8.10 GB (8700164939) CodeGen:(Total: 24.427ms, non-child: 24.427ms, % non-child: 100.00%) - CodegenTime: 279.604us - CompileTime: 3.767ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.596ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 14.614ms HDFS_SCAN_NODE (id=1):(Total: 3m1s, non-child: 3m1s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:34/2.93 GB 4:37/3.20 GB 2:35/3.05 GB 3:37/2.91 GB 1:31/2.55 GB 5:41/2.81 GB 6:34/2.69 GB 0:34/2.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 283 out of 283 Hdfs Read Thread Concurrency Bucket: 0:73.76% 1:26.24% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:566 BytesRead(8s000ms): 96.67 MB, 382.73 MB, 560.64 MB, 842.56 MB, 1.14 GB, 1.38 GB, 1.50 GB, 1.62 GB, 1.72 GB, 1.79 GB, 1.84 GB, 1.92 GB, 2.01 GB, 2.02 GB, 2.08 GB, 2.19 GB, 2.22 GB, 2.24 GB, 2.33 GB, 2.45 GB, 2.52 GB, 2.58 GB, 2.66 GB, 2.76 GB, 2.80 GB, 2.87 GB, 2.97 GB, 3.06 GB, 3.11 GB, 3.15 GB, 3.15 GB, 3.16 GB, 3.21 GB, 3.30 GB, 3.39 GB, 3.49 GB, 3.53 GB, 3.57 GB, 3.62 GB, 3.69 GB, 3.76 GB, 3.84 GB, 3.93 GB, 4.01 GB, 4.07 GB, 4.13 GB - FooterProcessingTime: (Avg: 214.453ms ; Min: 1.480ms ; Max: 1s957ms ; Number of samples: 283) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.20 GB (4504399539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.20 GB (4504399539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.20 GB (4504399539) - DecompressionTime: 17s684ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 283 (283) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 71.55 MB (75025899) - PerReadThreadRawHdfsThroughput: 44.63 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m - RowBatchQueuePutWaitTime: 2m32s - RowsRead: 414.21M (414211639) - RowsReturned: 414.21M (414211639) - RowsReturnedRate: 2.28 M/sec - ScanRangesComplete: 283 (283) - ScannerThreadsInvoluntaryContextSwitches: 8.47K (8470) - ScannerThreadsTotalWallClockTime: 6m11s - MaterializeTupleTime(*): 11s264ms - ScannerThreadsSysTime: 1s758ms - ScannerThreadsUserTime: 28s211ms - ScannerThreadsVoluntaryContextSwitches: 284.11K (284108) - TotalRawHdfsReadTime(*): 1m36s - TotalReadThroughput: 11.56 MB/sec Instance e84a99bb0c926c46:9c5989020000000a (host=vd1310.halxg.cloudera.com:22000):(Total: 5m55s, non-child: 2m25s, % non-child: 41.07%) Hdfs split stats (:<# splits>/): 7:29/2.42 GB 1:35/3.13 GB 3:42/3.40 GB 6:31/2.44 GB 0:38/2.94 GB 2:40/3.16 GB 5:37/2.80 GB 4:38/2.64 GB MemoryUsage(8s000ms): 14.87 MB, 18.01 MB, 17.88 MB, 12.68 MB, 11.50 MB, 13.40 MB, 18.38 MB, 12.02 MB, 11.53 MB, 23.68 MB, 13.70 MB, 9.36 MB, 53.11 MB, 46.80 MB, 13.61 MB, 19.85 MB, 17.19 MB, 16.06 MB, 9.63 MB, 10.25 MB, 22.49 MB, 12.79 MB, 13.97 MB, 16.37 MB, 17.77 MB, 11.37 MB, 10.24 MB, 10.04 MB, 18.31 MB, 21.72 MB, 20.62 MB, 26.71 MB, 14.36 MB, 11.81 MB, 7.58 MB, 33.56 MB, 16.00 MB, 18.77 MB, 11.48 MB, 15.41 MB, 12.27 MB, 7.94 MB, 8.40 MB, 13.70 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 71.78 MB (75266723) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 408.06M (408063197) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2m2s - TotalStorageWaitTime: 2m47s - TotalThreadsInvoluntaryContextSwitches: 18.35K (18351) - TotalThreadsTotalWallClockTime: 11m50s - TotalThreadsSysTime: 3s754ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 284.16K (284163) Fragment Instance Lifecycle Timings: - ExecTime: 5m55s - ExecTreeExecTime: 2m42s - OpenTime: 11.219ms - ExecTreeOpenTime: 137.061us - PrepareTime: 25.818ms - ExecTreePrepareTime: 955.121us DataStreamSender (dst_id=22):(Total: 47s218ms, non-child: 47s218ms, % non-child: 100.00%) - BytesSent: 5.82 GB (6244111604) - NetworkThroughput(*): 352.85 MB/sec - OverallThroughput: 126.11 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 408.06M (408063197) - SerializeBatchTime: 30s292ms - TransmitDataRPCTime: 16s876ms - UncompressedRowBatchSize: 7.98 GB (8571022113) CodeGen:(Total: 27.538ms, non-child: 27.538ms, % non-child: 100.00%) - CodegenTime: 199.598us - CompileTime: 3.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.748ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 17.395ms HDFS_SCAN_NODE (id=1):(Total: 2m41s, non-child: 2m41s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:29/2.42 GB 1:35/3.13 GB 3:42/3.40 GB 6:31/2.44 GB 0:38/2.94 GB 2:40/3.16 GB 5:37/2.80 GB 4:38/2.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 290 out of 290 Hdfs Read Thread Concurrency Bucket: 0:73.52% 1:26.48% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:580 BytesRead(8s000ms): 94.73 MB, 395.81 MB, 746.02 MB, 988.28 MB, 1.15 GB, 1.37 GB, 1.58 GB, 1.70 GB, 1.81 GB, 1.89 GB, 1.94 GB, 1.99 GB, 2.08 GB, 2.10 GB, 2.12 GB, 2.19 GB, 2.22 GB, 2.23 GB, 2.31 GB, 2.42 GB, 2.51 GB, 2.55 GB, 2.65 GB, 2.76 GB, 2.84 GB, 2.89 GB, 3.00 GB, 3.11 GB, 3.17 GB, 3.21 GB, 3.21 GB, 3.23 GB, 3.27 GB, 3.36 GB, 3.44 GB, 3.51 GB, 3.58 GB, 3.63 GB, 3.72 GB, 3.81 GB, 3.90 GB, 3.97 GB, 4.03 GB, 4.10 GB - FooterProcessingTime: (Avg: 181.145ms ; Min: 1.336ms ; Max: 1s796ms ; Number of samples: 290) - AverageHdfsReadThreadConcurrency: 0.26 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 4.16 GB (4464685742) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.16 GB (4464685742) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.16 GB (4464685742) - DecompressionTime: 16s175ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 290 (290) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 71.54 MB (75011841) - PerReadThreadRawHdfsThroughput: 47.26 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m40s - RowBatchQueuePutWaitTime: 2m36s - RowsRead: 408.06M (408063197) - RowsReturned: 408.06M (408063197) - RowsReturnedRate: 2.52 M/sec - ScanRangesComplete: 290 (290) - ScannerThreadsInvoluntaryContextSwitches: 9.16K (9156) - ScannerThreadsTotalWallClockTime: 5m55s - MaterializeTupleTime(*): 10s954ms - ScannerThreadsSysTime: 1s857ms - ScannerThreadsUserTime: 28s723ms - ScannerThreadsVoluntaryContextSwitches: 273.67K (273665) - TotalRawHdfsReadTime(*): 1m30s - TotalReadThroughput: 11.99 MB/sec Averaged Fragment F03:(Total: 263.625ms, non-child: 206.882ms, % non-child: 78.48%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:625.167ms max:625.167ms mean: 625.167ms stddev:0.000ns execution rates: min:3.44 MB/sec max:3.44 MB/sec mean:3.44 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 410.50 MB (430445611) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 195.895ms - TotalStorageWaitTime: 4.510ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 238.775ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 24.995ms - TotalThreadsVoluntaryContextSwitches: 35 (35) Fragment Instance Lifecycle Timings: - ExecTime: 207.955ms - ExecTreeExecTime: 10.735ms - OpenTime: 20.591ms - ExecTreeOpenTime: 34.469us - PrepareTime: 35.023ms - ExecTreePrepareTime: 176.493us DataStreamSender (dst_id=23):(Total: 143.077us, non-child: 143.077us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 287.82 MB/sec - OverallThroughput: 137.36 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 19.720us - TransmitDataRPCTime: 68.284us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 45.407ms, non-child: 45.407ms, % non-child: 100.00%) - CodegenTime: 485.153us - CompileTime: 6.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 13.401ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 25.325ms HDFS_SCAN_NODE (id=2):(Total: 11.191ms, non-child: 11.191ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 253.671us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 789.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.268ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 32.70 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 10.443ms - MaterializeTupleTime(*): 3.869ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 575.108us - TotalReadThroughput: 0.00 /sec Fragment F03: Instance e84a99bb0c926c46:9c5989020000000f (host=vd1316.halxg.cloudera.com:22000):(Total: 263.625ms, non-child: 206.882ms, % non-child: 78.48%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 410.50 MB (430445611) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 195.895ms - TotalStorageWaitTime: 4.510ms - TotalThreadsInvoluntaryContextSwitches: 10 (10) - TotalThreadsTotalWallClockTime: 238.775ms - TotalThreadsSysTime: 999.000us - TotalThreadsUserTime: 24.995ms - TotalThreadsVoluntaryContextSwitches: 35 (35) Fragment Instance Lifecycle Timings: - ExecTime: 207.955ms - ExecTreeExecTime: 10.735ms - OpenTime: 20.591ms - ExecTreeOpenTime: 34.469us - PrepareTime: 35.023ms - ExecTreePrepareTime: 176.493us DataStreamSender (dst_id=23):(Total: 143.077us, non-child: 143.077us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 287.82 MB/sec - OverallThroughput: 137.36 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 19.720us - TransmitDataRPCTime: 68.284us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 45.407ms, non-child: 45.407ms, % non-child: 100.00%) - CodegenTime: 485.153us - CompileTime: 6.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 13.401ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 25.325ms HDFS_SCAN_NODE (id=2):(Total: 11.191ms, non-child: 11.191ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 2.103ms ; Min: 2.103ms ; Max: 2.103ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 253.671us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 789.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.268ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 32.70 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 7 (7) - ScannerThreadsTotalWallClockTime: 10.443ms - MaterializeTupleTime(*): 3.869ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 575.108us - TotalReadThroughput: 0.00 /sec Averaged Fragment F09:(Total: 21m26s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21m36s max:21m36s mean: 21m36s stddev:83.018ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 204.00 MB (213909504) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 219.95 MB (230638938) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 146 (146) - TotalNetworkReceiveTime: 17m26s - TotalNetworkSendTime: 43.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.42K (15424) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s472ms - TotalThreadsUserTime: 34s313ms - TotalThreadsVoluntaryContextSwitches: 507.23K (507225) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 943.573ms - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 70.778ms - ExecTreePrepareTime: 2.175ms DataStreamSender (dst_id=31):(Total: 55.957us, non-child: 55.957us, % non-child: 100.00%) - BytesSent: 1.18 KB (1205) - NetworkThroughput(*): 24.05 MB/sec - OverallThroughput: 15.13 MB/sec - PeakMemoryUsage: 19.70 KB (20168) - RowsReturned: 0 (0) - SerializeBatchTime: 6.833us - TransmitDataRPCTime: 6.830us - UncompressedRowBatchSize: 2.44 KB (2501) CodeGen:(Total: 98.870ms, non-child: 98.870ms, % non-child: 100.00%) - CodegenTime: 2.509ms - CompileTime: 17.807ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 55.789ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 24.784ms AGGREGATION_NODE (id=30):(Total: 21m27s, non-child: 3m55s, % non-child: 18.31%) - BufferPoolAllocTime: 1s198ms - BufferPoolAllocationBytes: 10.44 GB (11211074998) - BufferPoolAllocations: 5.30K (5300) - BufferPoolPeakReservation: 204.00 MB (213909504) - BufferPoolPeakUnpinnedBytes: 9.94 GB (10671507748) - BufferPoolPeakUsedReservation: 204.00 MB (213909504) - BufferPoolReadIoBytes: 79.43 MB (83286893) - BufferPoolReadIoOps: 39 (39) - BufferPoolReadIoWaitTime: 2s881ms - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 10.09 GB (10833887232) - BufferPoolWriteIoBytes: 10.09 GB (10833887232) - BufferPoolWriteIoOps: 5.17K (5166) - BufferPoolWriteIoWaitTime: 2m52s - BuildTime: 3m53s - GetResultsTime: 38.898us - HTResizeTime: 140.828ms - HashBuckets: 149.80K (149796) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 204.08 MB (213998063) - RowsRepartitioned: 1.66M (1661138) - RowsReturned: 146 (146) - RowsReturnedRate: 0 - SpilledPartitions: 28 (28) EXCHANGE_NODE (id=29):(Total: 17m31s, non-child: 17m31s, % non-child: 100.00%) - BytesReceived: 5.08 GB (5459364287) - ConvertRowBatchTime: 4s467ms - DeserializeRowBatchTimer: 1m2s - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186110902) - RowsReturnedRate: 178.30 K/sec - SendersBlockedTimer: 36s280ms - SendersBlockedTotalTimer(*): 3m25s Fragment F09: Instance e84a99bb0c926c46:9c5989020000002f (host=vd1310.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.08 MB, 37.82 MB, 37.31 MB, 35.07 MB, 34.10 MB, 35.06 MB, 34.94 MB, 36.13 MB, 34.71 MB, 34.75 MB, 35.45 MB, 35.08 MB, 35.15 MB, 34.11 MB, 34.91 MB, 41.71 MB, 36.28 MB, 35.30 MB, 35.97 MB, 34.75 MB, 39.63 MB, 47.64 MB, 34.85 MB, 36.04 MB, 37.35 MB, 34.11 MB, 34.41 MB, 34.65 MB, 34.59 MB, 34.12 MB, 34.13 MB, 34.13 MB, 34.36 MB, 34.16 MB, 34.13 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 898.00 MB (941621248) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 898.08 MB (941707887) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 1.02K (1024) - TotalNetworkReceiveTime: 17m53s - TotalNetworkSendTime: 301.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.21K (15212) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s359ms - TotalThreadsUserTime: 34s203ms - TotalThreadsVoluntaryContextSwitches: 509.94K (509945) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6s605ms - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 30.508ms - ExecTreePrepareTime: 662.109us DataStreamSender (dst_id=31):(Total: 75.998us, non-child: 75.998us, % non-child: 100.00%) - BytesSent: 8.24 KB (8440) - NetworkThroughput(*): 168.34 MB/sec - OverallThroughput: 105.91 MB/sec - PeakMemoryUsage: 43.70 KB (44744) - RowsReturned: 0 (0) - SerializeBatchTime: 47.831us - TransmitDataRPCTime: 47.813us - UncompressedRowBatchSize: 17.10 KB (17511) CodeGen:(Total: 82.114ms, non-child: 82.114ms, % non-child: 100.00%) - CodegenTime: 1.866ms - CompileTime: 14.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 40.954ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 26.328ms AGGREGATION_NODE (id=30):(Total: 21m32s, non-child: 3m34s, % non-child: 16.60%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s014ms - BufferPoolAllocationBytes: 11.12 GB (11945377792) - BufferPoolAllocations: 5.52K (5520) - BufferPoolPeakReservation: 898.00 MB (941621248) - BufferPoolPeakUnpinnedBytes: 9.92 GB (10649337856) - BufferPoolPeakUsedReservation: 898.00 MB (941621248) - BufferPoolReadIoBytes: 96.00 MB (100663296) - BufferPoolReadIoOps: 48 (48) - BufferPoolReadIoWaitTime: 1s836ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 9.92 GB (10649337856) - BufferPoolWriteIoBytes: 9.92 GB (10649337856) - BufferPoolWriteIoOps: 5.08K (5078) - BufferPoolWriteIoWaitTime: 2m44s - BuildTime: 3m27s - GetResultsTime: 272.287us - HTResizeTime: 515.494ms - HashBuckets: 1.05M (1048576) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 898.04 MB (941661312) - RowsRepartitioned: 11.63M (11627969) - RowsReturned: 1.02K (1024) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=29):(Total: 17m58s, non-child: 13s250ms, % non-child: 1.23%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 9.63 MB, 75.48 MB, 118.05 MB, 145.01 MB, 187.09 MB, 296.43 MB, 407.30 MB, 536.69 MB, 651.88 MB, 705.78 MB, 787.71 MB, 884.53 MB, 936.19 MB, 967.25 MB, 1.04 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.92 GB, 2.11 GB, 2.23 GB, 2.38 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.42 GB, 3.68 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.09 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5458867124) - ConvertRowBatchTime: 4s488ms - DeserializeRowBatchTimer: 39s013ms - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.09M (186094134) - RowsReturnedRate: 172.56 K/sec - SendersBlockedTimer: 34s328ms - SendersBlockedTotalTimer(*): 3m8s Instance e84a99bb0c926c46:9c5989020000002d (host=vd1316.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 3.708ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.12 MB, 35.36 MB, 35.90 MB, 34.17 MB, 34.28 MB, 34.87 MB, 34.23 MB, 34.29 MB, 35.19 MB, 34.52 MB, 34.29 MB, 34.15 MB, 34.39 MB, 34.37 MB, 36.03 MB, 38.20 MB, 42.16 MB, 39.57 MB, 46.74 MB, 41.69 MB, 36.29 MB, 34.85 MB, 35.27 MB, 35.42 MB, 34.19 MB, 34.12 MB, 34.98 MB, 34.22 MB, 34.16 MB, 34.10 MB, 34.10 MB, 34.10 MB, 34.20 MB, 34.12 MB, 34.24 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.29 MB (59027309) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 18m16s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.63K (15626) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s836ms - TotalThreadsUserTime: 34s262ms - TotalThreadsVoluntaryContextSwitches: 531.65K (531653) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 21.675ms - ExecTreePrepareTime: 1.099ms DataStreamSender (dst_id=31):(Total: 23.587us, non-child: 23.587us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 79.832ms, non-child: 79.832ms, % non-child: 100.00%) - CodegenTime: 2.100ms - CompileTime: 19.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 42.381ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 17.360ms AGGREGATION_NODE (id=30):(Total: 21m26s, non-child: 3m4s, % non-child: 14.32%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s349ms - BufferPoolAllocationBytes: 10.21 GB (10966007808) - BufferPoolAllocations: 5.23K (5229) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.94 GB (10676600832) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 78.00 MB (81788928) - BufferPoolReadIoOps: 39 (39) - BufferPoolReadIoWaitTime: 2s474ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.10 GB (10846470144) - BufferPoolWriteIoBytes: 10.10 GB (10846470144) - BufferPoolWriteIoOps: 5.17K (5172) - BufferPoolWriteIoWaitTime: 2m21s - BuildTime: 3m3s - GetResultsTime: 0.000ns - HTResizeTime: 10.861ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35761180) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 18m22s, non-child: 12s120ms, % non-child: 1.10%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 9.70 MB, 75.68 MB, 118.20 MB, 145.19 MB, 187.33 MB, 296.79 MB, 407.65 MB, 537.01 MB, 652.04 MB, 705.94 MB, 787.95 MB, 884.77 MB, 936.31 MB, 967.34 MB, 1.04 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.93 GB, 2.11 GB, 2.23 GB, 2.38 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.42 GB, 3.68 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.09 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5459482630) - ConvertRowBatchTime: 4s527ms - DeserializeRowBatchTimer: 36s786ms - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.12M (186115149) - RowsReturnedRate: 168.85 K/sec - SendersBlockedTimer: 45s654ms - SendersBlockedTotalTimer(*): 4m30s Instance e84a99bb0c926c46:9c59890200000030 (host=vd1314.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 9.126ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 40.18 MB, 40.99 MB, 41.74 MB, 37.49 MB, 41.53 MB, 34.43 MB, 34.68 MB, 34.29 MB, 35.10 MB, 34.11 MB, 34.65 MB, 34.50 MB, 34.18 MB, 34.10 MB, 36.34 MB, 34.69 MB, 34.65 MB, 35.75 MB, 34.28 MB, 34.38 MB, 35.71 MB, 34.23 MB, 39.26 MB, 34.30 MB, 35.76 MB, 34.44 MB, 34.51 MB, 38.39 MB, 34.94 MB, 34.12 MB, 34.13 MB, 34.13 MB, 34.14 MB, 34.11 MB, 34.13 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.31 MB (59045964) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 18m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16.02K (16025) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s409ms - TotalThreadsUserTime: 34s773ms - TotalThreadsVoluntaryContextSwitches: 527.55K (527552) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 28.305ms - ExecTreePrepareTime: 704.246us DataStreamSender (dst_id=31):(Total: 28.886us, non-child: 28.886us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 87.995ms, non-child: 87.995ms, % non-child: 100.00%) - CodegenTime: 2.492ms - CompileTime: 15.374ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 48.131ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 24.024ms AGGREGATION_NODE (id=30):(Total: 21m26s, non-child: 3m19s, % non-child: 15.51%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s017ms - BufferPoolAllocationBytes: 10.43 GB (11196694528) - BufferPoolAllocations: 5.34K (5339) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10684989440) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 98.00 MB (102760448) - BufferPoolReadIoOps: 49 (49) - BufferPoolReadIoWaitTime: 6s783ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.30 GB (11056185344) - BufferPoolWriteIoBytes: 10.30 GB (11056185344) - BufferPoolWriteIoOps: 5.27K (5272) - BufferPoolWriteIoWaitTime: 2m34s - BuildTime: 3m18s - GetResultsTime: 0.000ns - HTResizeTime: 8.960ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35761180) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 18m6s, non-child: 11s852ms, % non-child: 1.09%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 9.86 MB, 75.89 MB, 118.30 MB, 145.28 MB, 187.50 MB, 297.01 MB, 407.89 MB, 537.34 MB, 652.13 MB, 706.00 MB, 788.11 MB, 884.97 MB, 936.30 MB, 967.27 MB, 1.04 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.93 GB, 2.11 GB, 2.23 GB, 2.38 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.43 GB, 3.68 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.09 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5459611073) - ConvertRowBatchTime: 4s502ms - DeserializeRowBatchTimer: 40s265ms - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.12M (186119123) - RowsReturnedRate: 171.24 K/sec - SendersBlockedTimer: 17s201ms - SendersBlockedTotalTimer(*): 1m35s Instance e84a99bb0c926c46:9c59890200000031 (host=vd1309.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 4.344ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.69 MB, 34.38 MB, 42.29 MB, 37.20 MB, 34.73 MB, 34.81 MB, 36.13 MB, 35.14 MB, 37.07 MB, 36.63 MB, 36.69 MB, 36.34 MB, 41.75 MB, 34.12 MB, 36.97 MB, 38.99 MB, 36.99 MB, 35.53 MB, 35.02 MB, 37.94 MB, 43.81 MB, 36.29 MB, 35.68 MB, 38.09 MB, 47.09 MB, 41.22 MB, 39.97 MB, 37.57 MB, 34.94 MB, 34.15 MB, 34.16 MB, 34.16 MB, 34.17 MB, 34.16 MB, 34.14 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 360.00 MB (377487360) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 360.06 MB (377553519) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 14m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 14.47K (14466) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s199ms - TotalThreadsUserTime: 34s820ms - TotalThreadsVoluntaryContextSwitches: 466.62K (466616) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 27.121ms - ExecTreePrepareTime: 417.838us DataStreamSender (dst_id=31):(Total: 17.101us, non-child: 17.101us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 100.257ms, non-child: 100.257ms, % non-child: 100.00%) - CodegenTime: 3.443ms - CompileTime: 17.465ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 58.592ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 23.571ms AGGREGATION_NODE (id=30):(Total: 21m26s, non-child: 7m8s, % non-child: 33.33%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s710ms - BufferPoolAllocationBytes: 10.81 GB (11603542016) - BufferPoolAllocations: 5.39K (5392) - BufferPoolPeakReservation: 360.00 MB (377487360) - BufferPoolPeakUnpinnedBytes: 9.92 GB (10649337856) - BufferPoolPeakUsedReservation: 360.00 MB (377487360) - BufferPoolReadIoBytes: 64.00 MB (67108864) - BufferPoolReadIoOps: 32 (32) - BufferPoolReadIoWaitTime: 1s177ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.12 GB (10861150208) - BufferPoolWriteIoBytes: 10.12 GB (10861150208) - BufferPoolWriteIoOps: 5.18K (5179) - BufferPoolWriteIoWaitTime: 4m14s - BuildTime: 7m7s - GetResultsTime: 0.000ns - HTResizeTime: 427.302ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 360.04 MB (377527424) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 24 (24) EXCHANGE_NODE (id=29):(Total: 14m17s, non-child: 15s130ms, % non-child: 1.76%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 9.64 MB, 75.59 MB, 118.17 MB, 145.16 MB, 187.20 MB, 296.54 MB, 407.46 MB, 536.79 MB, 651.99 MB, 705.89 MB, 787.82 MB, 884.54 MB, 936.21 MB, 967.29 MB, 1.04 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.92 GB, 2.11 GB, 2.23 GB, 2.38 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.42 GB, 3.68 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.09 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5459226098) - ConvertRowBatchTime: 4s436ms - DeserializeRowBatchTimer: 3m20s - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186108023) - RowsReturnedRate: 217.00 K/sec - SendersBlockedTimer: 57s285ms - SendersBlockedTotalTimer(*): 5m2s Instance e84a99bb0c926c46:9c59890200000032 (host=vd1311.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 5.219ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.11 MB, 34.68 MB, 41.76 MB, 34.48 MB, 34.51 MB, 34.43 MB, 38.42 MB, 38.36 MB, 36.55 MB, 34.16 MB, 34.45 MB, 35.26 MB, 34.80 MB, 34.12 MB, 42.09 MB, 38.14 MB, 37.92 MB, 41.33 MB, 37.28 MB, 36.43 MB, 36.07 MB, 34.18 MB, 34.60 MB, 37.15 MB, 36.52 MB, 35.59 MB, 36.15 MB, 38.58 MB, 34.95 MB, 34.15 MB, 34.13 MB, 34.13 MB, 34.12 MB, 34.12 MB, 34.27 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.31 MB (59045964) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m40s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.15K (15146) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s273ms - TotalThreadsUserTime: 33s408ms - TotalThreadsVoluntaryContextSwitches: 505.76K (505763) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 26.952ms - ExecTreePrepareTime: 4.198ms DataStreamSender (dst_id=31):(Total: 36.247us, non-child: 36.247us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 72.230ms, non-child: 72.230ms, % non-child: 100.00%) - CodegenTime: 2.333ms - CompileTime: 14.472ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 39.091ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 18.244ms AGGREGATION_NODE (id=30):(Total: 21m26s, non-child: 3m41s, % non-child: 17.20%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s183ms - BufferPoolAllocationBytes: 10.22 GB (10972299264) - BufferPoolAllocations: 5.23K (5232) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10682892288) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 78.00 MB (81788928) - BufferPoolReadIoOps: 39 (39) - BufferPoolReadIoWaitTime: 2s496ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.11 GB (10852761600) - BufferPoolWriteIoBytes: 10.11 GB (10852761600) - BufferPoolWriteIoOps: 5.17K (5175) - BufferPoolWriteIoWaitTime: 3m - BuildTime: 3m40s - GetResultsTime: 0.000ns - HTResizeTime: 7.224ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 17m45s, non-child: 11s860ms, % non-child: 1.11%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 9.67 MB, 75.51 MB, 118.05 MB, 145.03 MB, 187.08 MB, 296.41 MB, 407.25 MB, 536.56 MB, 651.69 MB, 705.61 MB, 787.62 MB, 884.55 MB, 936.25 MB, 967.31 MB, 1.04 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.92 GB, 2.11 GB, 2.23 GB, 2.38 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.42 GB, 3.68 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.09 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5459278134) - ConvertRowBatchTime: 4s297ms - DeserializeRowBatchTimer: 39s418ms - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186108157) - RowsReturnedRate: 174.72 K/sec - SendersBlockedTimer: 43s648ms - SendersBlockedTotalTimer(*): 4m9s Instance e84a99bb0c926c46:9c59890200000033 (host=vd1312.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 4.938ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.71 MB, 34.28 MB, 34.10 MB, 34.11 MB, 38.45 MB, 35.06 MB, 36.00 MB, 36.99 MB, 34.20 MB, 34.11 MB, 34.34 MB, 34.55 MB, 34.13 MB, 34.14 MB, 35.12 MB, 34.94 MB, 35.04 MB, 37.79 MB, 34.62 MB, 36.52 MB, 37.32 MB, 34.09 MB, 35.73 MB, 37.37 MB, 34.45 MB, 37.40 MB, 36.81 MB, 34.63 MB, 34.12 MB, 34.11 MB, 34.11 MB, 34.11 MB, 34.12 MB, 34.20 MB, 34.11 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.31 MB (59045964) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 18m50s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16.29K (16291) - TotalThreadsTotalWallClockTime: 21m26s - TotalThreadsSysTime: 6s586ms - TotalThreadsUserTime: 34s573ms - TotalThreadsVoluntaryContextSwitches: 526.33K (526331) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 21m26s - ExecTreeOpenTime: 21m26s - PrepareTime: 25.836ms - ExecTreePrepareTime: 745.307us DataStreamSender (dst_id=31):(Total: 25.883us, non-child: 25.883us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 76.601ms, non-child: 76.601ms, % non-child: 100.00%) - CodegenTime: 1.902ms - CompileTime: 13.782ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 40.946ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 21.473ms AGGREGATION_NODE (id=30):(Total: 21m26s, non-child: 2m30s, % non-child: 11.70%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s001ms - BufferPoolAllocationBytes: 10.11 GB (10854858752) - BufferPoolAllocations: 5.18K (5176) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.94 GB (10676600832) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 62.00 MB (65011712) - BufferPoolReadIoOps: 31 (31) - BufferPoolReadIoWaitTime: 2s813ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.02 GB (10754195456) - BufferPoolWriteIoBytes: 10.02 GB (10754195456) - BufferPoolWriteIoOps: 5.13K (5128) - BufferPoolWriteIoWaitTime: 1m43s - BuildTime: 2m29s - GetResultsTime: 0.000ns - HTResizeTime: 8.759ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35761180) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 18m55s, non-child: 11s927ms, % non-child: 1.05%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 9.39 MB, 75.23 MB, 117.99 MB, 144.92 MB, 186.76 MB, 295.86 MB, 406.90 MB, 535.97 MB, 651.61 MB, 705.41 MB, 787.31 MB, 884.06 MB, 936.06 MB, 967.19 MB, 1.04 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.92 GB, 2.11 GB, 2.23 GB, 2.37 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.42 GB, 3.68 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.09 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5459708657) - ConvertRowBatchTime: 4s507ms - DeserializeRowBatchTimer: 39s002ms - FirstBatchArrivalWaitTime: 2m52s - PeakMemoryUsage: 0 - RowsReturned: 186.12M (186122632) - RowsReturnedRate: 163.87 K/sec - SendersBlockedTimer: 13s019ms - SendersBlockedTotalTimer(*): 1m11s Instance e84a99bb0c926c46:9c5989020000002e (host=vd1313.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 286.556ms, % non-child: 0.02%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.47 MB, 34.68 MB, 37.43 MB, 38.47 MB, 34.82 MB, 36.90 MB, 35.94 MB, 37.90 MB, 43.99 MB, 36.91 MB, 38.21 MB, 38.73 MB, 34.86 MB, 34.10 MB, 37.14 MB, 40.15 MB, 38.41 MB, 36.65 MB, 36.14 MB, 35.53 MB, 34.88 MB, 34.81 MB, 40.39 MB, 36.68 MB, 37.47 MB, 35.03 MB, 37.22 MB, 35.12 MB, 34.31 MB, 34.25 MB, 34.11 MB, 34.11 MB, 34.10 MB, 34.12 MB, 34.13 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.31 MB (59045964) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.20K (15202) - TotalThreadsTotalWallClockTime: 21m25s - TotalThreadsSysTime: 6s643ms - TotalThreadsUserTime: 34s152ms - TotalThreadsVoluntaryContextSwitches: 482.72K (482718) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 21m25s - ExecTreeOpenTime: 21m25s - PrepareTime: 335.045ms - ExecTreePrepareTime: 7.400ms DataStreamSender (dst_id=31):(Total: 183.998us, non-child: 183.998us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 193.058ms, non-child: 193.058ms, % non-child: 100.00%) - CodegenTime: 3.428ms - CompileTime: 29.552ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 120.426ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 42.486ms AGGREGATION_NODE (id=30):(Total: 21m25s, non-child: 4m11s, % non-child: 19.53%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s111ms - BufferPoolAllocationBytes: 10.19 GB (10938744832) - BufferPoolAllocations: 5.22K (5216) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10680795136) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 80.00 MB (83886080) - BufferPoolReadIoOps: 40 (40) - BufferPoolReadIoWaitTime: 2s591ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.07 GB (10817110016) - BufferPoolWriteIoBytes: 10.07 GB (10817110016) - BufferPoolWriteIoOps: 5.16K (5158) - BufferPoolWriteIoWaitTime: 3m26s - BuildTime: 4m10s - GetResultsTime: 0.000ns - HTResizeTime: 7.196ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 17m14s, non-child: 11s808ms, % non-child: 1.14%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 10.09 MB, 76.20 MB, 118.40 MB, 145.40 MB, 187.91 MB, 297.72 MB, 408.50 MB, 538.06 MB, 652.46 MB, 706.34 MB, 788.50 MB, 885.51 MB, 936.44 MB, 967.34 MB, 1.05 GB, 1.28 GB, 1.45 GB, 1.63 GB, 1.80 GB, 1.93 GB, 2.11 GB, 2.23 GB, 2.38 GB, 2.58 GB, 2.77 GB, 2.94 GB, 3.19 GB, 3.43 GB, 3.69 GB, 3.94 GB, 3.95 GB, 3.95 GB, 4.10 GB, 4.44 GB, 4.89 GB - BytesReceived: 5.08 GB (5459376293) - ConvertRowBatchTime: 4s512ms - DeserializeRowBatchTimer: 40s596ms - FirstBatchArrivalWaitTime: 2m51s - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186109099) - RowsReturnedRate: 179.88 K/sec - SendersBlockedTimer: 42s825ms - SendersBlockedTotalTimer(*): 4m20s Averaged Fragment F07:(Total: 21m11s, non-child: 6m21s, % non-child: 30.02%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21m max:21m26s mean: 21m11s stddev:8s523ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.14 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 1.22 GB (1312820801) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 186.11M (186110902) - TotalNetworkReceiveTime: 7m - TotalNetworkSendTime: 6m11s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 40.32K (40316) - TotalThreadsTotalWallClockTime: 24m3s - TotalThreadsSysTime: 9s995ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 346.21K (346209) Fragment Instance Lifecycle Timings: - ExecTime: 18m18s - ExecTreeExecTime: 11m10s - OpenTime: 2m52s - ExecTreeOpenTime: 2m51s - PrepareTime: 91.869ms - ExecTreePrepareTime: 38.620ms DataStreamSender (dst_id=29):(Total: 47s071ms, non-child: 47s071ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5459364287) - NetworkThroughput(*): 360.77 MB/sec - OverallThroughput: 110.62 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.11M (186110902) - SerializeBatchTime: 32s551ms - TransmitDataRPCTime: 14s433ms - UncompressedRowBatchSize: 10.58 GB (11355358943) CodeGen:(Total: 501.722ms, non-child: 501.722ms, % non-child: 100.00%) - CodegenTime: 3.155ms - CompileTime: 148.449ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 321.042ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 30.741ms AGGREGATION_NODE (id=11):(Total: 14m2s, non-child: 42s099ms, % non-child: 5.00%) - BufferPoolAllocTime: 2.016ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.374ms - HTResizeTime: 971.591ms - HashBuckets: 118.20K (118198) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.39 MB (36064420) - ReductionFactorEstimate: 109.37 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.02M (186022253) - RowsReturned: 186.11M (186110902) - RowsReturnedRate: 221.72 K/sec - StreamingTime: 41s132ms HASH_JOIN_NODE (id=10):(Total: 13m20s, non-child: 6s005ms, % non-child: 0.75%) - BufferPoolAllocTime: 792.884us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 7.872ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.11M (186110903) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s653ms - RowsReturned: 186.11M (186110903) - RowsReturnedRate: 233.44 K/sec Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 4.179ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 242.675us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 23.393us, non-child: 23.393us, % non-child: 100.00%) - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 11.566us - DeserializeRowBatchTimer: 14.816us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 15.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 13m14s, non-child: 6m5s, % non-child: 46.08%) - BufferPoolAllocTime: 1s606ms - BufferPoolAllocationBytes: 14.45 GB (15510236598) - BufferPoolAllocations: 5.36K (5363) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.15 GB (7679770624) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 2.98 GB (3202051510) - BufferPoolReadIoOps: 1.53K (1526) - BufferPoolReadIoWaitTime: 4m10s - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 7.15 GB (7679770624) - BufferPoolWriteIoBytes: 7.15 GB (7679770624) - BufferPoolWriteIoOps: 3.66K (3662) - BufferPoolWriteIoWaitTime: 33s977ms - BuildRows: 102.86M (102860069) - BuildTime: 24s354ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208072065) - ProbeRows: 206.79M (206789234) - ProbeRowsPartitioned: 168.02M (168020603) - ProbeTime: 1m20s - RowsReturned: 186.11M (186110903) - RowsReturnedRate: 235.22 K/sec Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 20s820ms - BuildRowsPartitioned: 102.86M (102860069) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5934558) - HashTablesBuildTime: 1m19s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m27s, non-child: 2m27s, % non-child: 100.00%) - BytesReceived: 1.46 GB (1567178384) - ConvertRowBatchTime: 2s551ms - DeserializeRowBatchTimer: 8s483ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102860069) - RowsReturnedRate: 701.12 K/sec - SendersBlockedTimer: 2s160ms - SendersBlockedTotalTimer(*): 9s695ms EXCHANGE_NODE (id=26):(Total: 4m41s, non-child: 4m41s, % non-child: 100.00%) - BytesReceived: 5.57 GB (5981225651) - ConvertRowBatchTime: 4s598ms - DeserializeRowBatchTimer: 28s955ms - FirstBatchArrivalWaitTime: 140.476ms - PeakMemoryUsage: 0 - RowsReturned: 206.79M (206789234) - RowsReturnedRate: 739.55 K/sec - SendersBlockedTimer: 3m18s - SendersBlockedTotalTimer(*): 21m40s Fragment F07: Instance e84a99bb0c926c46:9c59890200000028 (host=vd1310.halxg.cloudera.com:22000):(Total: 21m26s, non-child: 6m36s, % non-child: 30.81%) MemoryUsage(32s000ms): 551.68 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.13 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1313046467) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 186.11M (186110951) - TotalNetworkReceiveTime: 7m3s - TotalNetworkSendTime: 6m25s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 36.40K (36397) - TotalThreadsTotalWallClockTime: 24m18s - TotalThreadsSysTime: 9s585ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 343.29K (343290) Fragment Instance Lifecycle Timings: - ExecTime: 18m33s - ExecTreeExecTime: 11m10s - OpenTime: 2m52s - ExecTreeOpenTime: 2m52s - PrepareTime: 31.076ms - ExecTreePrepareTime: 745.784us DataStreamSender (dst_id=29):(Total: 47s142ms, non-child: 47s142ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5459397120) - NetworkThroughput(*): 362.61 MB/sec - OverallThroughput: 110.44 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.11M (186110951) - SerializeBatchTime: 32s701ms - TransmitDataRPCTime: 14s358ms - UncompressedRowBatchSize: 10.58 GB (11355361907) CodeGen:(Total: 458.710ms, non-child: 458.710ms, % non-child: 100.00%) - CodegenTime: 2.724ms - CompileTime: 130.019ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 308.667ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 19.446ms AGGREGATION_NODE (id=11):(Total: 14m2s, non-child: 41s194ms, % non-child: 4.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 62.906us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.311ms - HTResizeTime: 976.101ms - HashBuckets: 110.59K (110592) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.46 MB (36137317) - ReductionFactorEstimate: 33.65 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.03M (186028007) - RowsReturned: 186.11M (186110951) - RowsReturnedRate: 220.91 K/sec - StreamingTime: 40s286ms HASH_JOIN_NODE (id=10):(Total: 13m21s, non-child: 6s029ms, % non-child: 0.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 136.293us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 3.176ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.11M (186110951) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s685ms - RowsReturned: 186.11M (186110951) - RowsReturnedRate: 232.26 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 153.591us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 162.674us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 18.372us, non-child: 18.372us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.425us - DeserializeRowBatchTimer: 16.615us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 19.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 13m15s, non-child: 6m4s, % non-child: 45.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s801ms - BufferPoolAllocationBytes: 14.64 GB (15716057088) - BufferPoolAllocations: 5.46K (5462) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.15 GB (7675576320) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 3.18 GB (3412066304) - BufferPoolReadIoOps: 1.63K (1627) - BufferPoolReadIoWaitTime: 4m23s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.15 GB (7675576320) - BufferPoolWriteIoBytes: 7.15 GB (7675576320) - BufferPoolWriteIoOps: 3.66K (3660) - BufferPoolWriteIoWaitTime: 24s562ms - BuildRows: 102.85M (102847660) - BuildTime: 18s436ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208070310) - ProbeRows: 206.78M (206784771) - ProbeRowsPartitioned: 168.01M (168012585) - ProbeTime: 1m12s - RowsReturned: 186.11M (186110951) - RowsReturnedRate: 234.02 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 14s571ms - BuildRowsPartitioned: 102.85M (102847660) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.94M (5935652) - HashTablesBuildTime: 1m15s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m33s, non-child: 3s671ms, % non-child: 2.39%) BytesReceived(32s000ms): 404.14 MB, 1.03 GB, 1.23 GB, 1.34 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1566984848) - ConvertRowBatchTime: 2s594ms - DeserializeRowBatchTimer: 5s560ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.85M (102847660) - RowsReturnedRate: 670.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 4m37s, non-child: 10s200ms, % non-child: 3.67%) BytesReceived(32s000ms): 9.90 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 69.65 MB, 458.43 MB, 707.91 MB, 865.43 MB, 1.08 GB, 1.71 GB, 2.34 GB, 3.08 GB, 3.74 GB, 4.05 GB, 4.52 GB, 5.07 GB, 5.36 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5981133666) - ConvertRowBatchTime: 4s682ms - DeserializeRowBatchTimer: 23s124ms - FirstBatchArrivalWaitTime: 165.124ms - PeakMemoryUsage: 0 - RowsReturned: 206.78M (206784771) - RowsReturnedRate: 744.49 K/sec - SendersBlockedTimer: 3m9s - SendersBlockedTotalTimer(*): 21m31s Instance e84a99bb0c926c46:9c5989020000002a (host=vd1309.halxg.cloudera.com:22000):(Total: 21m18s, non-child: 4m27s, % non-child: 20.91%) MemoryUsage(32s000ms): 551.96 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.13 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1311385292) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 186.12M (186121450) - TotalNetworkReceiveTime: 6m22s - TotalNetworkSendTime: 4m16s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 50.17K (50172) - TotalThreadsTotalWallClockTime: 24m8s - TotalThreadsSysTime: 10s649ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 339.33K (339332) Fragment Instance Lifecycle Timings: - ExecTime: 18m27s - ExecTreeExecTime: 13m13s - OpenTime: 2m50s - ExecTreeOpenTime: 2m50s - PrepareTime: 44.940ms - ExecTreePrepareTime: 1.332ms DataStreamSender (dst_id=29):(Total: 47s092ms, non-child: 47s092ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5459642205) - NetworkThroughput(*): 353.02 MB/sec - OverallThroughput: 110.56 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.12M (186121450) - SerializeBatchTime: 32s263ms - TransmitDataRPCTime: 14s749ms - UncompressedRowBatchSize: 10.58 GB (11356002494) CodeGen:(Total: 499.115ms, non-child: 499.115ms, % non-child: 100.00%) - CodegenTime: 2.835ms - CompileTime: 137.408ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 328.845ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 32.430ms AGGREGATION_NODE (id=11):(Total: 16m3s, non-child: 44s281ms, % non-child: 4.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 151.490us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.271ms - HTResizeTime: 960.040ms - HashBuckets: 126.98K (126976) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.41 MB (36084174) - ReductionFactorEstimate: 83.89 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.03M (186026218) - RowsReturned: 186.12M (186121450) - RowsReturnedRate: 193.14 K/sec - StreamingTime: 43s232ms HASH_JOIN_NODE (id=10):(Total: 15m19s, non-child: 5s970ms, % non-child: 0.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 394.767us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 4.389ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.12M (186121450) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s587ms - RowsReturned: 186.12M (186121450) - RowsReturnedRate: 202.44 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 285.120us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 270.423us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 27.870us, non-child: 27.870us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 17.443us - DeserializeRowBatchTimer: 18.955us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 13.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 15m13s, non-child: 8m43s, % non-child: 57.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2s939ms - BufferPoolAllocationBytes: 14.59 GB (15669919744) - BufferPoolAllocations: 5.44K (5440) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.16 GB (7683964928) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 3.13 GB (3357540352) - BufferPoolReadIoOps: 1.60K (1601) - BufferPoolReadIoWaitTime: 6m6s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.16 GB (7683964928) - BufferPoolWriteIoBytes: 7.16 GB (7683964928) - BufferPoolWriteIoOps: 3.66K (3664) - BufferPoolWriteIoWaitTime: 53s053ms - BuildRows: 102.86M (102863930) - BuildTime: 26s780ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208070310) - ProbeRows: 206.80M (206798353) - ProbeRowsPartitioned: 168.04M (168039357) - ProbeTime: 1m59s - RowsReturned: 186.12M (186121450) - RowsReturnedRate: 203.77 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 24s749ms - BuildRowsPartitioned: 102.86M (102863930) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5934370) - HashTablesBuildTime: 1m58s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m23s, non-child: 5s845ms, % non-child: 4.08%) BytesReceived(32s000ms): 404.08 MB, 1.03 GB, 1.23 GB, 1.34 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1567232390) - ConvertRowBatchTime: 2s496ms - DeserializeRowBatchTimer: 16s280ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102863930) - RowsReturnedRate: 718.61 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 4m7s, non-child: 29s895ms, % non-child: 12.09%) BytesReceived(32s000ms): 9.89 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 69.53 MB, 458.12 MB, 707.60 MB, 865.02 MB, 1.08 GB, 1.71 GB, 2.34 GB, 3.08 GB, 3.74 GB, 4.05 GB, 4.51 GB, 5.07 GB, 5.36 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5981490050) - ConvertRowBatchTime: 4s497ms - DeserializeRowBatchTimer: 57s396ms - FirstBatchArrivalWaitTime: 120.024ms - PeakMemoryUsage: 0 - RowsReturned: 206.80M (206798353) - RowsReturnedRate: 836.43 K/sec - SendersBlockedTimer: 3m39s - SendersBlockedTotalTimer(*): 24m29s Instance e84a99bb0c926c46:9c59890200000029 (host=vd1314.halxg.cloudera.com:22000):(Total: 21m15s, non-child: 6m40s, % non-child: 31.38%) MemoryUsage(32s000ms): 556.83 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1313929538) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 186.14M (186137304) - TotalNetworkReceiveTime: 6m30s - TotalNetworkSendTime: 6m29s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 39.06K (39064) - TotalThreadsTotalWallClockTime: 24m7s - TotalThreadsSysTime: 10s042ms - TotalThreadsUserTime: 2m51s - TotalThreadsVoluntaryContextSwitches: 350.70K (350700) Fragment Instance Lifecycle Timings: - ExecTime: 18m22s - ExecTreeExecTime: 10m56s - OpenTime: 2m52s - ExecTreeOpenTime: 2m52s - PrepareTime: 28.522ms - ExecTreePrepareTime: 752.966us DataStreamSender (dst_id=29):(Total: 46s592ms, non-child: 46s592ms, % non-child: 100.00%) - BytesSent: 5.09 GB (5460106879) - NetworkThroughput(*): 360.55 MB/sec - OverallThroughput: 111.76 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.14M (186137304) - SerializeBatchTime: 32s067ms - TransmitDataRPCTime: 14s442ms - UncompressedRowBatchSize: 10.58 GB (11356969804) CodeGen:(Total: 442.695ms, non-child: 442.695ms, % non-child: 100.00%) - CodegenTime: 2.433ms - CompileTime: 128.616ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 294.492ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 19.127ms AGGREGATION_NODE (id=11):(Total: 13m48s, non-child: 41s612ms, % non-child: 5.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 176.211us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.075ms - HTResizeTime: 947.982ms - HashBuckets: 122.88K (122880) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.32 MB (35981954) - ReductionFactorEstimate: 114.26 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.05M (186045144) - RowsReturned: 186.14M (186137304) - RowsReturnedRate: 224.79 K/sec - StreamingTime: 40s747ms HASH_JOIN_NODE (id=10):(Total: 13m6s, non-child: 5s896ms, % non-child: 0.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 500.634us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 3.399ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.14M (186137305) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s564ms - RowsReturned: 186.14M (186137305) - RowsReturnedRate: 236.69 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 182.634us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 160.259us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 25.583us, non-child: 25.583us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 16.358us - DeserializeRowBatchTimer: 9.955us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 14.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 13m, non-child: 6m22s, % non-child: 49.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s188ms - BufferPoolAllocationBytes: 14.35 GB (15407775744) - BufferPoolAllocations: 5.32K (5315) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.16 GB (7683964928) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 2.88 GB (3095396352) - BufferPoolReadIoOps: 1.48K (1476) - BufferPoolReadIoWaitTime: 3m58s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.16 GB (7683964928) - BufferPoolWriteIoBytes: 7.16 GB (7683964928) - BufferPoolWriteIoOps: 3.66K (3664) - BufferPoolWriteIoWaitTime: 1m6s - BuildRows: 102.84M (102839047) - BuildTime: 31s426ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208070310) - ProbeRows: 206.81M (206809006) - ProbeRowsPartitioned: 168.03M (168034891) - ProbeTime: 1m43s - RowsReturned: 186.14M (186137305) - RowsReturnedRate: 238.47 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 27s772ms - BuildRowsPartitioned: 102.84M (102839047) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5934187) - HashTablesBuildTime: 1m17s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m20s, non-child: 3s909ms, % non-child: 2.79%) BytesReceived(32s000ms): 407.97 MB, 1.04 GB, 1.23 GB, 1.34 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1566861773) - ConvertRowBatchTime: 2s538ms - DeserializeRowBatchTimer: 9s065ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.84M (102839047) - RowsReturnedRate: 733.31 K/sec - SendersBlockedTimer: 5s733ms - SendersBlockedTotalTimer(*): 33s616ms EXCHANGE_NODE (id=26):(Total: 4m17s, non-child: 11s539ms, % non-child: 4.48%) BytesReceived(32s000ms): 9.94 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 70.89 MB, 459.87 MB, 708.46 MB, 865.93 MB, 1.09 GB, 1.71 GB, 2.35 GB, 3.09 GB, 3.74 GB, 4.05 GB, 4.52 GB, 5.07 GB, 5.37 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5981751045) - ConvertRowBatchTime: 4s508ms - DeserializeRowBatchTimer: 26s385ms - FirstBatchArrivalWaitTime: 178.411ms - PeakMemoryUsage: 0 - RowsReturned: 206.81M (206809006) - RowsReturnedRate: 802.01 K/sec - SendersBlockedTimer: 3m40s - SendersBlockedTotalTimer(*): 25m2s Instance e84a99bb0c926c46:9c59890200000026 (host=vd1316.halxg.cloudera.com:22000):(Total: 21m9s, non-child: 6m36s, % non-child: 31.20%) MemoryUsage(32s000ms): 552.50 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1311148727) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 186.09M (186093311) - TotalNetworkReceiveTime: 7m32s - TotalNetworkSendTime: 6m25s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 37.67K (37668) - TotalThreadsTotalWallClockTime: 24m1s - TotalThreadsSysTime: 9s903ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 351.64K (351644) Fragment Instance Lifecycle Timings: - ExecTime: 18m16s - ExecTreeExecTime: 10m54s - OpenTime: 2m52s - ExecTreeOpenTime: 2m52s - PrepareTime: 39.033ms - ExecTreePrepareTime: 1.025ms DataStreamSender (dst_id=29):(Total: 46s907ms, non-child: 46s907ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5458816610) - NetworkThroughput(*): 363.52 MB/sec - OverallThroughput: 110.98 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.09M (186093311) - SerializeBatchTime: 32s493ms - TransmitDataRPCTime: 14s320ms - UncompressedRowBatchSize: 10.57 GB (11354285619) CodeGen:(Total: 466.630ms, non-child: 466.630ms, % non-child: 100.00%) - CodegenTime: 2.249ms - CompileTime: 131.443ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 308.150ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 26.576ms AGGREGATION_NODE (id=11):(Total: 13m45s, non-child: 42s622ms, % non-child: 5.16%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 91.306us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.193ms - HTResizeTime: 972.032ms - HashBuckets: 122.88K (122880) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.48 MB (36150193) - ReductionFactorEstimate: 116.80 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.00M (186001151) - RowsReturned: 186.09M (186093311) - RowsReturnedRate: 225.30 K/sec - StreamingTime: 41s431ms HASH_JOIN_NODE (id=10):(Total: 13m3s, non-child: 6s085ms, % non-child: 0.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 376.035us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 2.277ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.09M (186093315) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s717ms - RowsReturned: 186.09M (186093315) - RowsReturnedRate: 237.56 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 107.737us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 349.763us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 27.314us, non-child: 27.314us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 6.254us - DeserializeRowBatchTimer: 11.500us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 13.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 12m57s, non-child: 5m16s, % non-child: 40.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s366ms - BufferPoolAllocationBytes: 14.45 GB (15514730496) - BufferPoolAllocations: 5.37K (5366) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.15 GB (7677673472) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 2.99 GB (3208642560) - BufferPoolReadIoOps: 1.53K (1530) - BufferPoolReadIoWaitTime: 3m54s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.15 GB (7677673472) - BufferPoolWriteIoBytes: 7.15 GB (7677673472) - BufferPoolWriteIoOps: 3.66K (3661) - BufferPoolWriteIoWaitTime: 7s478ms - BuildRows: 102.86M (102863622) - BuildTime: 15s977ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208074406) - ProbeRows: 206.77M (206773703) - ProbeRowsPartitioned: 168.00M (168003868) - ProbeTime: 54s927ms - RowsReturned: 186.09M (186093315) - RowsReturnedRate: 239.42 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 12s322ms - BuildRowsPartitioned: 102.86M (102863622) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5932147) - HashTablesBuildTime: 1m9s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m35s, non-child: 4s103ms, % non-child: 2.64%) BytesReceived(32s000ms): 405.19 MB, 1.03 GB, 1.23 GB, 1.34 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1567242624) - ConvertRowBatchTime: 2s502ms - DeserializeRowBatchTimer: 5s473ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102863622) - RowsReturnedRate: 660.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 5m5s, non-child: 9s890ms, % non-child: 3.24%) BytesReceived(32s000ms): 9.92 MB, 10.07 MB, 10.07 MB, 10.07 MB, 10.07 MB, 70.00 MB, 458.80 MB, 708.00 MB, 865.42 MB, 1.09 GB, 1.71 GB, 2.34 GB, 3.08 GB, 3.74 GB, 4.05 GB, 4.52 GB, 5.07 GB, 5.36 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5980796987) - ConvertRowBatchTime: 4s612ms - DeserializeRowBatchTimer: 21s686ms - FirstBatchArrivalWaitTime: 158.948ms - PeakMemoryUsage: 0 - RowsReturned: 206.77M (206773703) - RowsReturnedRate: 677.70 K/sec - SendersBlockedTimer: 2m54s - SendersBlockedTotalTimer(*): 17m18s Instance e84a99bb0c926c46:9c5989020000002b (host=vd1311.halxg.cloudera.com:22000):(Total: 21m5s, non-child: 6m43s, % non-child: 31.93%) MemoryUsage(32s000ms): 552.21 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1313925313) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 186.10M (186097512) - TotalNetworkReceiveTime: 7m10s - TotalNetworkSendTime: 6m33s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 38.88K (38885) - TotalThreadsTotalWallClockTime: 23m56s - TotalThreadsSysTime: 9s961ms - TotalThreadsUserTime: 2m53s - TotalThreadsVoluntaryContextSwitches: 351.47K (351472) Fragment Instance Lifecycle Timings: - ExecTime: 18m12s - ExecTreeExecTime: 10m42s - OpenTime: 2m52s - ExecTreeOpenTime: 2m51s - PrepareTime: 37.814ms - ExecTreePrepareTime: 2.500ms DataStreamSender (dst_id=29):(Total: 46s502ms, non-child: 46s502ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5458980169) - NetworkThroughput(*): 365.37 MB/sec - OverallThroughput: 111.95 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.10M (186097512) - SerializeBatchTime: 32s157ms - TransmitDataRPCTime: 14s248ms - UncompressedRowBatchSize: 10.57 GB (11354541940) CodeGen:(Total: 431.619ms, non-child: 431.619ms, % non-child: 100.00%) - CodegenTime: 2.805ms - CompileTime: 117.007ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 289.811ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 24.427ms AGGREGATION_NODE (id=11):(Total: 13m34s, non-child: 41s556ms, % non-child: 5.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 1.342ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.112ms - HTResizeTime: 956.263ms - HashBuckets: 102.40K (102400) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.43 MB (36106237) - ReductionFactorEstimate: 162.13 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.02M (186020712) - RowsReturned: 186.10M (186097512) - RowsReturnedRate: 228.56 K/sec - StreamingTime: 40s701ms HASH_JOIN_NODE (id=10):(Total: 12m52s, non-child: 5s931ms, % non-child: 0.77%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 48.160us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 13.283ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.10M (186097513) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s584ms - RowsReturned: 186.10M (186097513) - RowsReturnedRate: 240.85 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.096ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 90.347us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 19.914us, non-child: 19.914us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 10.163us - DeserializeRowBatchTimer: 11.934us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 18.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 12m46s, non-child: 5m28s, % non-child: 42.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 768.659ms - BufferPoolAllocationBytes: 14.43 GB (15489564672) - BufferPoolAllocations: 5.35K (5354) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.15 GB (7677673472) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 2.96 GB (3183476736) - BufferPoolReadIoOps: 1.52K (1518) - BufferPoolReadIoWaitTime: 3m46s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.15 GB (7677673472) - BufferPoolWriteIoBytes: 7.15 GB (7677673472) - BufferPoolWriteIoOps: 3.66K (3661) - BufferPoolWriteIoWaitTime: 23s155ms - BuildRows: 102.87M (102866537) - BuildTime: 22s814ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208074406) - ProbeRows: 206.78M (206777716) - ProbeRowsPartitioned: 168.01M (168012600) - ProbeTime: 1m7s - RowsReturned: 186.10M (186097513) - RowsReturnedRate: 242.71 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 19s529ms - BuildRowsPartitioned: 102.87M (102866537) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5934518) - HashTablesBuildTime: 1m18s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m28s, non-child: 3s926ms, % non-child: 2.65%) BytesReceived(32s000ms): 404.61 MB, 1.03 GB, 1.23 GB, 1.34 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1567268559) - ConvertRowBatchTime: 2s563ms - DeserializeRowBatchTimer: 8s036ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.87M (102866537) - RowsReturnedRate: 693.15 K/sec - SendersBlockedTimer: 537.506ms - SendersBlockedTotalTimer(*): 1s159ms EXCHANGE_NODE (id=26):(Total: 4m50s, non-child: 13s079ms, % non-child: 4.51%) BytesReceived(32s000ms): 9.92 MB, 10.10 MB, 10.10 MB, 10.10 MB, 10.10 MB, 69.75 MB, 458.41 MB, 707.78 MB, 865.22 MB, 1.08 GB, 1.71 GB, 2.34 GB, 3.08 GB, 3.74 GB, 4.05 GB, 4.51 GB, 5.07 GB, 5.36 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5980889288) - ConvertRowBatchTime: 4s558ms - DeserializeRowBatchTimer: 24s997ms - FirstBatchArrivalWaitTime: 187.662ms - PeakMemoryUsage: 0 - RowsReturned: 206.78M (206777716) - RowsReturnedRate: 712.74 K/sec - SendersBlockedTimer: 3m11s - SendersBlockedTotalTimer(*): 21m37s Instance e84a99bb0c926c46:9c59890200000027 (host=vd1313.halxg.cloudera.com:22000):(Total: 21m4s, non-child: 6m41s, % non-child: 31.75%) MemoryUsage(32s000ms): 562.08 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.20 GB, 1.20 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.13 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1313909648) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 186.11M (186111132) - TotalNetworkReceiveTime: 6m50s - TotalNetworkSendTime: 6m30s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 38.36K (38363) - TotalThreadsTotalWallClockTime: 23m53s - TotalThreadsSysTime: 9s525ms - TotalThreadsUserTime: 2m56s - TotalThreadsVoluntaryContextSwitches: 339.49K (339488) Fragment Instance Lifecycle Timings: - ExecTime: 18m13s - ExecTreeExecTime: 10m44s - OpenTime: 2m50s - ExecTreeOpenTime: 2m49s - PrepareTime: 426.107ms - ExecTreePrepareTime: 262.933ms DataStreamSender (dst_id=29):(Total: 47s921ms, non-child: 47s921ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5459402588) - NetworkThroughput(*): 359.17 MB/sec - OverallThroughput: 108.65 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.11M (186111132) - SerializeBatchTime: 33s339ms - TransmitDataRPCTime: 14s496ms - UncompressedRowBatchSize: 10.58 GB (11355372952) CodeGen:(Total: 765.881ms, non-child: 765.881ms, % non-child: 100.00%) - CodegenTime: 6.607ms - CompileTime: 261.044ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 428.475ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 68.683ms AGGREGATION_NODE (id=11):(Total: 13m34s, non-child: 41s488ms, % non-child: 5.10%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 12.174ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 3.187ms - HTResizeTime: 1s008ms - HashBuckets: 122.88K (122880) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.32 MB (35981954) - ReductionFactorEstimate: 150.53 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.02M (186018972) - RowsReturned: 186.11M (186111132) - RowsReturnedRate: 228.56 K/sec - StreamingTime: 40s356ms HASH_JOIN_NODE (id=10):(Total: 12m52s, non-child: 6s153ms, % non-child: 0.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4.022ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 25.691ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.11M (186111133) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s766ms - RowsReturned: 186.11M (186111133) - RowsReturnedRate: 240.83 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 17.249ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 506.508us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 21.405us, non-child: 21.405us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.843us - DeserializeRowBatchTimer: 17.688us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 17.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 12m46s, non-child: 5m48s, % non-child: 45.42%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s126ms - BufferPoolAllocationBytes: 14.43 GB (15491661824) - BufferPoolAllocations: 5.36K (5355) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.15 GB (7681867776) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 2.96 GB (3181379584) - BufferPoolReadIoOps: 1.52K (1517) - BufferPoolReadIoWaitTime: 3m35s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.15 GB (7681867776) - BufferPoolWriteIoBytes: 7.15 GB (7681867776) - BufferPoolWriteIoOps: 3.66K (3663) - BufferPoolWriteIoWaitTime: 53s165ms - BuildRows: 102.88M (102876197) - BuildTime: 32s985ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208074406) - ProbeRows: 206.79M (206791645) - ProbeRowsPartitioned: 168.02M (168024446) - ProbeTime: 1m28s - RowsReturned: 186.11M (186111133) - RowsReturnedRate: 242.76 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 30s704ms - BuildRowsPartitioned: 102.88M (102876197) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.94M (5935488) - HashTablesBuildTime: 1m13s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m16s, non-child: 3s674ms, % non-child: 2.69%) BytesReceived(32s000ms): 412.59 MB, 1.04 GB, 1.23 GB, 1.34 GB, 1.44 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1567426847) - ConvertRowBatchTime: 2s561ms - DeserializeRowBatchTimer: 8s285ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.88M (102876197) - RowsReturnedRate: 754.35 K/sec - SendersBlockedTimer: 8s855ms - SendersBlockedTotalTimer(*): 33s089ms EXCHANGE_NODE (id=26):(Total: 4m42s, non-child: 11s145ms, % non-child: 3.95%) BytesReceived(32s000ms): 9.92 MB, 10.08 MB, 10.08 MB, 10.08 MB, 10.08 MB, 72.36 MB, 461.94 MB, 709.22 MB, 866.99 MB, 1.09 GB, 1.72 GB, 2.35 GB, 3.09 GB, 3.74 GB, 4.05 GB, 4.52 GB, 5.07 GB, 5.37 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5981273042) - ConvertRowBatchTime: 4s658ms - DeserializeRowBatchTimer: 23s350ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 206.79M (206791645) - RowsReturnedRate: 733.10 K/sec - SendersBlockedTimer: 3m31s - SendersBlockedTotalTimer(*): 20m55s Instance e84a99bb0c926c46:9c5989020000002c (host=vd1312.halxg.cloudera.com:22000):(Total: 21m, non-child: 6m46s, % non-child: 32.23%) MemoryUsage(32s000ms): 548.12 MB, 1.17 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.20 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB, 1.19 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.14 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 1.19 GB (1279262720) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.22 GB (1312400627) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 186.10M (186104657) - TotalNetworkReceiveTime: 7m32s - TotalNetworkSendTime: 6m35s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 41.67K (41669) - TotalThreadsTotalWallClockTime: 23m54s - TotalThreadsSysTime: 10s301ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 347.54K (347539) Fragment Instance Lifecycle Timings: - ExecTime: 18m5s - ExecTreeExecTime: 10m31s - OpenTime: 2m54s - ExecTreeOpenTime: 2m54s - PrepareTime: 35.594ms - ExecTreePrepareTime: 1.053ms DataStreamSender (dst_id=29):(Total: 47s338ms, non-child: 47s338ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5459204438) - NetworkThroughput(*): 361.16 MB/sec - OverallThroughput: 109.98 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.10M (186104657) - SerializeBatchTime: 32s837ms - TransmitDataRPCTime: 14s415ms - UncompressedRowBatchSize: 10.58 GB (11354977885) CodeGen:(Total: 447.402ms, non-child: 447.402ms, % non-child: 100.00%) - CodegenTime: 2.433ms - CompileTime: 133.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 288.855ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 24.496ms AGGREGATION_NODE (id=11):(Total: 13m26s, non-child: 41s942ms, % non-child: 5.20%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 117.848us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.467ms - HTResizeTime: 979.751ms - HashBuckets: 118.78K (118784) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.34 MB (36009112) - ReductionFactorEstimate: 104.30 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.02M (186015569) - RowsReturned: 186.10M (186104657) - RowsReturnedRate: 230.81 K/sec - StreamingTime: 41s171ms HASH_JOIN_NODE (id=10):(Total: 12m44s, non-child: 5s970ms, % non-child: 0.78%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 71.779us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 2.886ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.31 MB (35972866) - ProbeRows: 186.10M (186104658) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 5s665ms - RowsReturned: 186.10M (186104658) - RowsReturnedRate: 243.48 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 181.959us - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 158.753us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 23.294us, non-child: 23.294us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 11.476us - DeserializeRowBatchTimer: 17.066us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 15.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 12m38s, non-child: 4m58s, % non-child: 39.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2s052ms - BufferPoolAllocationBytes: 14.23 GB (15281946624) - BufferPoolAllocations: 5.25K (5255) - BufferPoolPeakReservation: 1.12 GB (1207959552) - BufferPoolPeakUnpinnedBytes: 7.15 GB (7677673472) - BufferPoolPeakUsedReservation: 1.12 GB (1207959552) - BufferPoolReadIoBytes: 2.77 GB (2975858688) - BufferPoolReadIoOps: 1.42K (1419) - BufferPoolReadIoWaitTime: 3m26s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 7.15 GB (7677673472) - BufferPoolWriteIoBytes: 7.15 GB (7677673472) - BufferPoolWriteIoOps: 3.66K (3661) - BufferPoolWriteIoWaitTime: 9s590ms - BuildRows: 102.86M (102863492) - BuildTime: 22s062ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.13 GB (1208070310) - ProbeRows: 206.79M (206789449) - ProbeRowsPartitioned: 168.02M (168016476) - ProbeTime: 58s646ms - RowsReturned: 186.10M (186104658) - RowsReturnedRate: 245.40 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 16s091ms - BuildRowsPartitioned: 102.86M (102863492) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.94M (5935544) - HashTablesBuildTime: 1m6s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 13 (13) EXCHANGE_NODE (id=27):(Total: 2m31s, non-child: 3s849ms, % non-child: 2.53%) BytesReceived(32s000ms): 400.35 MB, 1.03 GB, 1.23 GB, 1.33 GB, 1.43 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1567231652) - ConvertRowBatchTime: 2s602ms - DeserializeRowBatchTimer: 6s684ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102863492) - RowsReturnedRate: 677.30 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=26):(Total: 5m8s, non-child: 11s393ms, % non-child: 3.69%) BytesReceived(32s000ms): 9.77 MB, 10.09 MB, 10.09 MB, 10.09 MB, 10.09 MB, 68.22 MB, 456.53 MB, 707.05 MB, 864.18 MB, 1.08 GB, 1.70 GB, 2.34 GB, 3.08 GB, 3.74 GB, 4.05 GB, 4.51 GB, 5.07 GB, 5.36 GB, 5.54 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB, 5.57 GB - BytesReceived: 5.57 GB (5981245481) - ConvertRowBatchTime: 4s670ms - DeserializeRowBatchTimer: 25s743ms - FirstBatchArrivalWaitTime: 173.162ms - PeakMemoryUsage: 0 - RowsReturned: 206.79M (206789449) - RowsReturnedRate: 670.41 K/sec - SendersBlockedTimer: 2m59s - SendersBlockedTotalTimer(*): 20m51s Averaged Fragment F05:(Total: 9m21s, non-child: 6m30s, % non-child: 69.65%) split sizes: min: 72.42 GB, max: 72.83 GB, avg: 72.71 GB, stddev: 143.79 MB completion times: min:8m37s max:10m2s mean: 9m21s stddev:24s843ms execution rates: min:123.47 MB/sec max:143.99 MB/sec mean:132.90 MB/sec stddev:6.07 MB/sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 63.01 MB (66071284) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 206.79M (206789234) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m15s - TotalStorageWaitTime: 2m7s - TotalThreadsInvoluntaryContextSwitches: 18.68K (18677) - TotalThreadsTotalWallClockTime: 18m41s - TotalThreadsSysTime: 3s826ms - TotalThreadsUserTime: 1m33s - TotalThreadsVoluntaryContextSwitches: 126.01K (126008) Fragment Instance Lifecycle Timings: - ExecTime: 9m21s - ExecTreeExecTime: 2m5s - OpenTime: 27.234ms - ExecTreeOpenTime: 289.768us - PrepareTime: 42.613ms - ExecTreePrepareTime: 2.138ms DataStreamSender (dst_id=26):(Total: 45s082ms, non-child: 45s082ms, % non-child: 100.00%) - BytesSent: 5.57 GB (5981225651) - NetworkThroughput(*): 464.99 MB/sec - OverallThroughput: 126.54 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 206.79M (206789234) - SerializeBatchTime: 32s755ms - TransmitDataRPCTime: 12s270ms - UncompressedRowBatchSize: 7.90 GB (8480230032) CodeGen:(Total: 55.381ms, non-child: 55.381ms, % non-child: 100.00%) - CodegenTime: 906.468us - CompileTime: 6.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.782ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 30.281ms HDFS_SCAN_NODE (id=6):(Total: 2m5s, non-child: 2m5s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.43 GB (2605287396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.43 GB (2605287396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.43 GB (2605287396) - DecompressionTime: 11s029ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.78 MB (64776329) - PerReadThreadRawHdfsThroughput: 31.88 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m2s - RowBatchQueuePutWaitTime: 6m28s - RowsRead: 206.79M (206789234) - RowsReturned: 206.79M (206789234) - RowsReturnedRate: 1.71 M/sec - ScanRangesComplete: 414 (414) - ScannerThreadsInvoluntaryContextSwitches: 9.45K (9445) - ScannerThreadsTotalWallClockTime: 9m20s - MaterializeTupleTime(*): 29s441ms - ScannerThreadsSysTime: 1s715ms - ScannerThreadsUserTime: 37s363ms - ScannerThreadsVoluntaryContextSwitches: 116.09K (116090) - TotalRawHdfsReadTime(*): 1m18s - TotalReadThroughput: 4.44 MB/sec Filter 1 (1.00 MB): - Files processed: 414 (414) - Files rejected: 331 (331) - Files total: 414 (414) - RowGroups processed: 201.99K (201985) - RowGroups rejected: 0 (0) - RowGroups total: 201.99K (201985) - Rows processed: 1.36M (1362212) - Rows rejected: 0 (0) - Rows total: 206.79M (206789234) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Fragment F05: Instance e84a99bb0c926c46:9c5989020000001b (host=vd1309.halxg.cloudera.com:22000):(Total: 10m2s, non-child: 6m22s, % non-child: 63.53%) Hdfs split stats (:<# splits>/): 0:55/10.03 GB 1:50/9.13 GB 3:58/10.08 GB 5:49/8.56 GB 6:52/9.26 GB 7:48/8.79 GB 4:45/7.34 GB 2:58/9.45 GB Filter 1 arrival: 560ms MemoryUsage(16s000ms): 21.93 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.68 MB, 22.38 MB, 36.45 MB, 31.02 MB, 30.66 MB, 35.48 MB, 42.00 MB, 48.87 MB, 38.58 MB, 42.68 MB, 27.14 MB, 15.97 MB, 32.03 MB, 35.10 MB, 26.89 MB, 29.53 MB, 33.37 MB, 20.57 MB, 34.18 MB, 48.61 MB, 44.80 MB, 40.28 MB, 58.13 MB, 31.58 MB, 44.97 MB, 50.25 MB, 37.10 MB, 27.57 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 62.85 MB (65900171) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 206.30M (206296016) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m3s - TotalStorageWaitTime: 2m43s - TotalThreadsInvoluntaryContextSwitches: 22.78K (22777) - TotalThreadsTotalWallClockTime: 20m4s - TotalThreadsSysTime: 3s720ms - TotalThreadsUserTime: 1m31s - TotalThreadsVoluntaryContextSwitches: 130.31K (130313) Fragment Instance Lifecycle Timings: - ExecTime: 10m2s - ExecTreeExecTime: 2m55s - OpenTime: 23.861ms - ExecTreeOpenTime: 353.485us - PrepareTime: 39.219ms - ExecTreePrepareTime: 2.266ms DataStreamSender (dst_id=26):(Total: 44s621ms, non-child: 44s621ms, % non-child: 100.00%) - BytesSent: 5.55 GB (5963639275) - NetworkThroughput(*): 461.55 MB/sec - OverallThroughput: 127.46 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 206.30M (206296016) - SerializeBatchTime: 32s242ms - TransmitDataRPCTime: 12s322ms - UncompressedRowBatchSize: 7.88 GB (8460003604) CodeGen:(Total: 46.715ms, non-child: 46.715ms, % non-child: 100.00%) - CodegenTime: 772.642us - CompileTime: 5.570ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 15.351ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 25.322ms HDFS_SCAN_NODE (id=6):(Total: 2m55s, non-child: 2m55s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:55/10.03 GB 1:50/9.13 GB 3:58/10.08 GB 5:49/8.56 GB 6:52/9.26 GB 7:48/8.79 GB 4:45/7.34 GB 2:58/9.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 521ms Hdfs Read Thread Concurrency Bucket: 0:84.39% 1:15.61% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:332 PARQUET/SNAPPY:498 BytesRead(16s000ms): 10.00 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.32 MB, 10.85 MB, 57.72 MB, 132.88 MB, 176.00 MB, 212.79 MB, 241.68 MB, 264.71 MB, 297.50 MB, 332.17 MB, 373.62 MB, 444.26 MB, 561.83 MB, 716.42 MB, 862.03 MB, 1009.09 MB, 1.16 GB, 1.24 GB, 1.29 GB, 1.33 GB, 1.44 GB, 1.52 GB, 1.62 GB, 1.74 GB, 1.91 GB, 1.99 GB, 2.04 GB, 2.26 GB - FooterProcessingTime: (Avg: 351.937ms ; Min: 1.154ms ; Max: 2s154ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.41 GB (2591219508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2591219508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.41 GB (2591219508) - DecompressionTime: 10s405ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.57 MB (64563031) - PerReadThreadRawHdfsThroughput: 25.95 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m43s - RowBatchQueuePutWaitTime: 6m27s - RowsRead: 206.30M (206296016) - RowsReturned: 206.30M (206296016) - RowsReturnedRate: 1.18 M/sec - ScanRangesComplete: 415 (415) - ScannerThreadsInvoluntaryContextSwitches: 10.60K (10596) - ScannerThreadsTotalWallClockTime: 10m1s - MaterializeTupleTime(*): 32s281ms - ScannerThreadsSysTime: 1s673ms - ScannerThreadsUserTime: 36s059ms - ScannerThreadsVoluntaryContextSwitches: 119.23K (119226) - TotalRawHdfsReadTime(*): 1m35s - TotalReadThroughput: 4.10 MB/sec Filter 1 (1.00 MB): - Files processed: 415 (415) - Files rejected: 332 (332) - Files total: 415 (415) - RowGroups processed: 201.50K (201501) - RowGroups rejected: 0 (0) - RowGroups total: 201.50K (201501) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 206.30M (206296016) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance e84a99bb0c926c46:9c5989020000001c (host=vd1311.halxg.cloudera.com:22000):(Total: 9m36s, non-child: 6m40s, % non-child: 69.45%) Hdfs split stats (:<# splits>/): 5:41/7.08 GB 7:62/11.28 GB 3:54/8.52 GB 1:61/9.82 GB 6:53/9.09 GB 4:55/9.31 GB 2:54/9.73 GB 0:46/7.82 GB Filter 1 arrival: 550ms MemoryUsage(16s000ms): 45.67 MB, 47.14 MB, 47.14 MB, 47.14 MB, 47.14 MB, 47.14 MB, 47.14 MB, 47.14 MB, 47.14 MB, 47.14 MB, 45.73 MB, 35.15 MB, 42.88 MB, 44.50 MB, 57.29 MB, 46.99 MB, 40.22 MB, 52.82 MB, 50.23 MB, 44.24 MB, 16.69 MB, 27.79 MB, 30.45 MB, 30.76 MB, 30.97 MB, 28.85 MB, 34.23 MB, 42.94 MB, 52.35 MB, 37.53 MB, 26.87 MB, 51.57 MB, 24.73 MB, 45.22 MB, 49.32 MB, 36.74 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 62.76 MB (65808304) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 203.23M (203225532) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m25s - TotalStorageWaitTime: 2m11s - TotalThreadsInvoluntaryContextSwitches: 19.60K (19604) - TotalThreadsTotalWallClockTime: 19m11s - TotalThreadsSysTime: 4s238ms - TotalThreadsUserTime: 1m32s - TotalThreadsVoluntaryContextSwitches: 122.71K (122708) Fragment Instance Lifecycle Timings: - ExecTime: 9m35s - ExecTreeExecTime: 2m11s - OpenTime: 20.741ms - ExecTreeOpenTime: 209.487us - PrepareTime: 31.583ms - ExecTreePrepareTime: 2.198ms DataStreamSender (dst_id=26):(Total: 44s556ms, non-child: 44s556ms, % non-child: 100.00%) - BytesSent: 5.47 GB (5875988703) - NetworkThroughput(*): 477.39 MB/sec - OverallThroughput: 125.77 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 203.23M (203225532) - SerializeBatchTime: 32s761ms - TransmitDataRPCTime: 11s738ms - UncompressedRowBatchSize: 7.76 GB (8334085968) CodeGen:(Total: 41.717ms, non-child: 41.717ms, % non-child: 100.00%) - CodegenTime: 703.938us - CompileTime: 5.183ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.676ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 22.469ms HDFS_SCAN_NODE (id=6):(Total: 2m11s, non-child: 2m11s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:41/7.08 GB 7:62/11.28 GB 3:54/8.52 GB 1:61/9.82 GB 6:53/9.09 GB 4:55/9.31 GB 2:54/9.73 GB 0:46/7.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:85.59% 1:14.41% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:343 PARQUET/SNAPPY:498 BytesRead(16s000ms): 27.56 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.45 MB, 28.46 MB, 70.15 MB, 180.21 MB, 258.72 MB, 312.39 MB, 329.17 MB, 370.53 MB, 427.13 MB, 470.99 MB, 578.54 MB, 719.58 MB, 824.48 MB, 966.15 MB, 1.07 GB, 1.22 GB, 1.41 GB, 1.55 GB, 1.65 GB, 1.69 GB, 1.78 GB, 1.85 GB, 1.93 GB, 2.02 GB, 2.17 GB, 2.22 GB, 2.28 GB - FooterProcessingTime: (Avg: 260.988ms ; Min: 1.010ms ; Max: 1s703ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.38 GB (2552094186) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.38 GB (2552094186) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.38 GB (2552094186) - DecompressionTime: 11s184ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.53 MB (64520458) - PerReadThreadRawHdfsThroughput: 28.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m10s - RowBatchQueuePutWaitTime: 6m40s - RowsRead: 203.23M (203225532) - RowsReturned: 203.23M (203225532) - RowsReturnedRate: 1.55 M/sec - ScanRangesComplete: 426 (426) - ScannerThreadsInvoluntaryContextSwitches: 9.86K (9859) - ScannerThreadsTotalWallClockTime: 9m35s - MaterializeTupleTime(*): 28s702ms - ScannerThreadsSysTime: 1s852ms - ScannerThreadsUserTime: 36s645ms - ScannerThreadsVoluntaryContextSwitches: 113.84K (113840) - TotalRawHdfsReadTime(*): 1m26s - TotalReadThroughput: 4.23 MB/sec Filter 1 (1.00 MB): - Files processed: 426 (426) - Files rejected: 343 (343) - Files total: 426 (426) - RowGroups processed: 198.51K (198506) - RowGroups rejected: 0 (0) - RowGroups total: 198.51K (198506) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 203.23M (203225532) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance e84a99bb0c926c46:9c5989020000001d (host=vd1312.halxg.cloudera.com:22000):(Total: 9m29s, non-child: 6m46s, % non-child: 71.43%) Hdfs split stats (:<# splits>/): 1:51/8.93 GB 7:53/8.71 GB 3:56/10.00 GB 6:50/9.70 GB 5:62/10.39 GB 4:41/7.54 GB 2:44/8.26 GB 0:50/9.26 GB Filter 1 arrival: 551ms MemoryUsage(16s000ms): 40.97 MB, 43.03 MB, 43.03 MB, 43.03 MB, 43.03 MB, 43.03 MB, 43.03 MB, 43.03 MB, 43.03 MB, 43.03 MB, 41.77 MB, 31.14 MB, 36.84 MB, 40.75 MB, 57.90 MB, 42.93 MB, 33.66 MB, 35.52 MB, 57.18 MB, 31.71 MB, 27.96 MB, 40.84 MB, 39.01 MB, 35.45 MB, 16.17 MB, 26.58 MB, 33.26 MB, 46.44 MB, 55.75 MB, 42.64 MB, 30.96 MB, 37.63 MB, 26.20 MB, 30.81 MB, 42.62 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 63.28 MB (66349062) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 205.50M (205496499) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m29s - TotalStorageWaitTime: 2m4s - TotalThreadsInvoluntaryContextSwitches: 17.90K (17900) - TotalThreadsTotalWallClockTime: 18m57s - TotalThreadsSysTime: 3s822ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 127.14K (127140) Fragment Instance Lifecycle Timings: - ExecTime: 9m29s - ExecTreeExecTime: 1m57s - OpenTime: 21.825ms - ExecTreeOpenTime: 190.233us - PrepareTime: 21.971ms - ExecTreePrepareTime: 937.959us DataStreamSender (dst_id=26):(Total: 45s269ms, non-child: 45s269ms, % non-child: 100.00%) - BytesSent: 5.53 GB (5942691841) - NetworkThroughput(*): 461.50 MB/sec - OverallThroughput: 125.19 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 205.50M (205496499) - SerializeBatchTime: 32s932ms - TransmitDataRPCTime: 12s280ms - UncompressedRowBatchSize: 7.85 GB (8427216171) CodeGen:(Total: 35.532ms, non-child: 35.532ms, % non-child: 100.00%) - CodegenTime: 706.995us - CompileTime: 6.149ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.043ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 14.842ms HDFS_SCAN_NODE (id=6):(Total: 1m57s, non-child: 1m57s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:51/8.93 GB 7:53/8.71 GB 3:56/10.00 GB 6:50/9.70 GB 5:62/10.39 GB 4:41/7.54 GB 2:44/8.26 GB 0:50/9.26 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 522ms Hdfs Read Thread Concurrency Bucket: 0:87.71% 1:12.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:324 PARQUET/SNAPPY:498 BytesRead(16s000ms): 24.91 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 26.12 MB, 66.44 MB, 208.45 MB, 273.56 MB, 362.78 MB, 375.91 MB, 398.70 MB, 437.31 MB, 482.06 MB, 627.47 MB, 795.24 MB, 931.65 MB, 1.07 GB, 1.18 GB, 1.26 GB, 1.38 GB, 1.54 GB, 1.66 GB, 1.72 GB, 1.81 GB, 1.89 GB, 2.03 GB, 2.14 GB, 2.30 GB, 2.37 GB - FooterProcessingTime: (Avg: 301.936ms ; Min: 1.241ms ; Max: 2s905ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.41 GB (2584091713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2584091713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.41 GB (2584091713) - DecompressionTime: 11s221ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 62.03 MB (65044698) - PerReadThreadRawHdfsThroughput: 35.87 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m56s - RowBatchQueuePutWaitTime: 6m40s - RowsRead: 205.50M (205496499) - RowsReturned: 205.50M (205496499) - RowsReturnedRate: 1.75 M/sec - ScanRangesComplete: 407 (407) - ScannerThreadsInvoluntaryContextSwitches: 8.82K (8825) - ScannerThreadsTotalWallClockTime: 9m28s - MaterializeTupleTime(*): 29s779ms - ScannerThreadsSysTime: 1s727ms - ScannerThreadsUserTime: 37s716ms - ScannerThreadsVoluntaryContextSwitches: 116.64K (116638) - TotalRawHdfsReadTime(*): 1m8s - TotalReadThroughput: 4.33 MB/sec Filter 1 (1.00 MB): - Files processed: 407 (407) - Files rejected: 324 (324) - Files total: 407 (407) - RowGroups processed: 200.72K (200723) - RowGroups rejected: 0 (0) - RowGroups total: 200.72K (200723) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 205.50M (205496499) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance e84a99bb0c926c46:9c59890200000019 (host=vd1310.halxg.cloudera.com:22000):(Total: 9m22s, non-child: 6m39s, % non-child: 71.02%) Hdfs split stats (:<# splits>/): 7:56/9.23 GB 5:55/10.55 GB 6:60/10.80 GB 2:50/8.49 GB 4:47/8.74 GB 3:44/7.47 GB 1:45/7.93 GB 0:55/9.63 GB Filter 1 arrival: 582ms MemoryUsage(16s000ms): 46.41 MB, 47.93 MB, 47.93 MB, 47.93 MB, 47.93 MB, 47.93 MB, 47.93 MB, 47.93 MB, 47.93 MB, 47.93 MB, 46.35 MB, 32.84 MB, 39.82 MB, 34.03 MB, 43.09 MB, 55.28 MB, 50.84 MB, 55.27 MB, 48.04 MB, 36.40 MB, 30.55 MB, 36.15 MB, 33.24 MB, 46.58 MB, 30.03 MB, 31.50 MB, 31.37 MB, 45.14 MB, 46.54 MB, 47.66 MB, 43.38 MB, 56.35 MB, 22.88 MB, 31.58 MB, 51.30 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.99 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 62.77 MB (65816514) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 213.17M (213165999) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m25s - TotalStorageWaitTime: 1m57s - TotalThreadsInvoluntaryContextSwitches: 18.19K (18188) - TotalThreadsTotalWallClockTime: 18m40s - TotalThreadsSysTime: 3s976ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 127.98K (127980) Fragment Instance Lifecycle Timings: - ExecTime: 9m22s - ExecTreeExecTime: 1m56s - OpenTime: 21.596ms - ExecTreeOpenTime: 225.152us - PrepareTime: 23.059ms - ExecTreePrepareTime: 1.152ms DataStreamSender (dst_id=26):(Total: 46s580ms, non-child: 46s580ms, % non-child: 100.00%) - BytesSent: 5.75 GB (6168691476) - NetworkThroughput(*): 468.04 MB/sec - OverallThroughput: 126.30 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 213.17M (213165999) - SerializeBatchTime: 33s952ms - TransmitDataRPCTime: 12s569ms - UncompressedRowBatchSize: 8.14 GB (8741735075) CodeGen:(Total: 35.524ms, non-child: 35.524ms, % non-child: 100.00%) - CodegenTime: 607.322us - CompileTime: 5.285ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 14.555ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.319ms HDFS_SCAN_NODE (id=6):(Total: 1m56s, non-child: 1m56s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:56/9.23 GB 5:55/10.55 GB 6:60/10.80 GB 2:50/8.49 GB 4:47/8.74 GB 3:44/7.47 GB 1:45/7.93 GB 0:55/9.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 81 out of 81 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:85.5% 1:14.5% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:331 PARQUET/SNAPPY:486 BytesRead(16s000ms): 27.45 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.33 MB, 28.34 MB, 66.62 MB, 172.81 MB, 243.68 MB, 323.19 MB, 364.98 MB, 390.56 MB, 446.45 MB, 460.92 MB, 567.00 MB, 710.25 MB, 822.90 MB, 978.94 MB, 1.11 GB, 1.28 GB, 1.49 GB, 1.66 GB, 1.75 GB, 1.78 GB, 1.90 GB, 2.02 GB, 2.16 GB, 2.26 GB, 2.42 GB, 2.50 GB - FooterProcessingTime: (Avg: 241.698ms ; Min: 1.369ms ; Max: 2s043ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 2.51 GB (2693062917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.51 GB (2693062917) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.51 GB (2693062917) - DecompressionTime: 12s115ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.53 MB (64520542) - PerReadThreadRawHdfsThroughput: 32.68 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m54s - RowBatchQueuePutWaitTime: 6m36s - RowsRead: 213.17M (213165999) - RowsReturned: 213.17M (213165999) - RowsReturnedRate: 1.83 M/sec - ScanRangesComplete: 412 (412) - ScannerThreadsInvoluntaryContextSwitches: 9.25K (9253) - ScannerThreadsTotalWallClockTime: 9m18s - MaterializeTupleTime(*): 29s385ms - ScannerThreadsSysTime: 1s795ms - ScannerThreadsUserTime: 38s890ms - ScannerThreadsVoluntaryContextSwitches: 117.89K (117894) - TotalRawHdfsReadTime(*): 1m18s - TotalReadThroughput: 4.57 MB/sec Filter 1 (1.00 MB): - Files processed: 412 (412) - Files rejected: 331 (331) - Files total: 412 (412) - RowGroups processed: 208.21K (208213) - RowGroups rejected: 0 (0) - RowGroups total: 208.21K (208213) - Rows processed: 1.33M (1327104) - Rows rejected: 0 (0) - Rows total: 213.17M (213165999) - Splits processed: 81 (81) - Splits rejected: 0 (0) - Splits total: 81 (81) Instance e84a99bb0c926c46:9c59890200000018 (host=vd1313.halxg.cloudera.com:22000):(Total: 9m21s, non-child: 6m31s, % non-child: 69.71%) Hdfs split stats (:<# splits>/): 7:42/7.29 GB 3:46/7.81 GB 6:59/10.22 GB 5:57/10.53 GB 4:52/9.97 GB 2:48/8.90 GB 1:56/10.27 GB 0:44/7.43 GB Filter 1 arrival: 104ms MemoryUsage(16s000ms): 41.71 MB, 43.05 MB, 43.05 MB, 43.05 MB, 43.05 MB, 43.05 MB, 43.05 MB, 43.05 MB, 43.05 MB, 43.05 MB, 41.91 MB, 36.01 MB, 37.62 MB, 37.99 MB, 30.57 MB, 52.82 MB, 51.76 MB, 34.37 MB, 22.31 MB, 27.97 MB, 22.06 MB, 27.47 MB, 29.57 MB, 30.77 MB, 30.79 MB, 36.79 MB, 29.61 MB, 53.64 MB, 41.26 MB, 43.35 MB, 35.59 MB, 41.88 MB, 36.89 MB, 27.81 MB, 49.87 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 63.26 MB (66332752) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 206.75M (206748246) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m16s - TotalStorageWaitTime: 2m13s - TotalThreadsInvoluntaryContextSwitches: 17.95K (17947) - TotalThreadsTotalWallClockTime: 18m43s - TotalThreadsSysTime: 3s672ms - TotalThreadsUserTime: 1m34s - TotalThreadsVoluntaryContextSwitches: 128.17K (128168) Fragment Instance Lifecycle Timings: - ExecTime: 9m21s - ExecTreeExecTime: 2m4s - OpenTime: 48.685ms - ExecTreeOpenTime: 508.690us - PrepareTime: 117.057ms - ExecTreePrepareTime: 5.629ms DataStreamSender (dst_id=26):(Total: 45s191ms, non-child: 45s191ms, % non-child: 100.00%) - BytesSent: 5.57 GB (5984300889) - NetworkThroughput(*): 461.85 MB/sec - OverallThroughput: 126.29 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 206.75M (206748246) - SerializeBatchTime: 32s778ms - TransmitDataRPCTime: 12s356ms - UncompressedRowBatchSize: 7.90 GB (8478549126) CodeGen:(Total: 129.557ms, non-child: 129.557ms, % non-child: 100.00%) - CodegenTime: 1.666ms - CompileTime: 11.902ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 29.395ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 85.013ms HDFS_SCAN_NODE (id=6):(Total: 2m4s, non-child: 2m4s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:42/7.29 GB 3:46/7.81 GB 6:59/10.22 GB 5:57/10.53 GB 4:52/9.97 GB 2:48/8.90 GB 1:56/10.27 GB 0:44/7.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 84 out of 84 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:85.66% 1:14.34% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:320 PARQUET/SNAPPY:504 BytesRead(16s000ms): 25.68 MB, 26.51 MB, 26.51 MB, 26.51 MB, 26.51 MB, 26.51 MB, 26.51 MB, 26.51 MB, 26.51 MB, 26.51 MB, 27.20 MB, 93.20 MB, 208.53 MB, 284.62 MB, 363.87 MB, 412.88 MB, 436.13 MB, 460.51 MB, 479.22 MB, 602.38 MB, 737.40 MB, 872.94 MB, 978.49 MB, 1.08 GB, 1.24 GB, 1.51 GB, 1.67 GB, 1.76 GB, 1.78 GB, 1.89 GB, 1.99 GB, 2.07 GB, 2.21 GB, 2.36 GB, 2.43 GB - FooterProcessingTime: (Avg: 343.571ms ; Min: 1.234ms ; Max: 2s798ms ; Number of samples: 84) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.44 GB (2618863417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 GB (2618863417) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 GB (2618863417) - DecompressionTime: 10s542ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 84 (84) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 62.03 MB (65044772) - PerReadThreadRawHdfsThroughput: 31.41 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m4s - RowBatchQueuePutWaitTime: 6m26s - RowsRead: 206.75M (206748246) - RowsReturned: 206.75M (206748246) - RowsReturnedRate: 1.66 M/sec - ScanRangesComplete: 404 (404) - ScannerThreadsInvoluntaryContextSwitches: 9.24K (9241) - ScannerThreadsTotalWallClockTime: 9m21s - MaterializeTupleTime(*): 28s970ms - ScannerThreadsSysTime: 1s639ms - ScannerThreadsUserTime: 37s813ms - ScannerThreadsVoluntaryContextSwitches: 117.77K (117773) - TotalRawHdfsReadTime(*): 1m19s - TotalReadThroughput: 4.44 MB/sec Filter 1 (1.00 MB): - Files processed: 404 (404) - Files rejected: 320 (320) - Files total: 404 (404) - RowGroups processed: 201.95K (201947) - RowGroups rejected: 0 (0) - RowGroups total: 201.95K (201947) - Rows processed: 1.38M (1376256) - Rows rejected: 0 (0) - Rows total: 206.75M (206748246) - Splits processed: 84 (84) - Splits rejected: 0 (0) - Splits total: 84 (84) Instance e84a99bb0c926c46:9c5989020000001a (host=vd1314.halxg.cloudera.com:22000):(Total: 8m59s, non-child: 6m16s, % non-child: 69.71%) Hdfs split stats (:<# splits>/): 4:49/8.30 GB 6:60/10.40 GB 0:54/9.87 GB 7:44/7.16 GB 5:56/9.57 GB 3:50/8.49 GB 2:48/8.65 GB 1:58/10.37 GB Filter 1 arrival: 569ms MemoryUsage(16s000ms): 22.00 MB, 22.70 MB, 22.70 MB, 22.70 MB, 22.70 MB, 22.70 MB, 22.70 MB, 22.70 MB, 22.70 MB, 22.70 MB, 20.68 MB, 41.13 MB, 30.34 MB, 28.55 MB, 47.11 MB, 50.33 MB, 32.28 MB, 37.95 MB, 48.07 MB, 38.61 MB, 29.88 MB, 30.09 MB, 26.90 MB, 41.34 MB, 24.72 MB, 28.54 MB, 31.88 MB, 46.02 MB, 39.82 MB, 30.31 MB, 33.31 MB, 56.10 MB, 28.97 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 63.24 MB (66316213) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 202.00M (201999873) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m1s - TotalStorageWaitTime: 2m2s - TotalThreadsInvoluntaryContextSwitches: 15.93K (15929) - TotalThreadsTotalWallClockTime: 17m58s - TotalThreadsSysTime: 3s465ms - TotalThreadsUserTime: 1m30s - TotalThreadsVoluntaryContextSwitches: 120.55K (120547) Fragment Instance Lifecycle Timings: - ExecTime: 8m59s - ExecTreeExecTime: 2m - OpenTime: 21.481ms - ExecTreeOpenTime: 200.604us - PrepareTime: 23.726ms - ExecTreePrepareTime: 1.047ms DataStreamSender (dst_id=26):(Total: 43s427ms, non-child: 43s427ms, % non-child: 100.00%) - BytesSent: 5.44 GB (5842455712) - NetworkThroughput(*): 467.92 MB/sec - OverallThroughput: 128.30 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 202.00M (201999873) - SerializeBatchTime: 31s465ms - TransmitDataRPCTime: 11s907ms - UncompressedRowBatchSize: 7.71 GB (8283822861) CodeGen:(Total: 35.410ms, non-child: 35.410ms, % non-child: 100.00%) - CodegenTime: 640.705us - CompileTime: 5.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 13.973ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 15.598ms HDFS_SCAN_NODE (id=6):(Total: 2m, non-child: 2m, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:49/8.30 GB 6:60/10.40 GB 0:54/9.87 GB 7:44/7.16 GB 5:56/9.57 GB 3:50/8.49 GB 2:48/8.65 GB 1:58/10.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 542ms Hdfs Read Thread Concurrency Bucket: 0:86.28% 1:13.72% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:336 PARQUET/SNAPPY:498 BytesRead(16s000ms): 9.46 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 9.76 MB, 65.63 MB, 169.37 MB, 209.54 MB, 257.15 MB, 291.01 MB, 310.61 MB, 355.08 MB, 399.80 MB, 513.18 MB, 691.38 MB, 880.95 MB, 1019.79 MB, 1.14 GB, 1.35 GB, 1.54 GB, 1.68 GB, 1.78 GB, 1.82 GB, 1.91 GB, 2.01 GB, 2.17 GB, 2.27 GB - FooterProcessingTime: (Avg: 273.491ms ; Min: 905.940us ; Max: 1s947ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.37 GB (2544490094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.37 GB (2544490094) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.37 GB (2544490094) - DecompressionTime: 11s445ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 62.03 MB (65044617) - PerReadThreadRawHdfsThroughput: 33.33 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m58s - RowBatchQueuePutWaitTime: 6m13s - RowsRead: 202.00M (201999873) - RowsReturned: 202.00M (201999873) - RowsReturnedRate: 1.68 M/sec - ScanRangesComplete: 419 (419) - ScannerThreadsInvoluntaryContextSwitches: 8.25K (8247) - ScannerThreadsTotalWallClockTime: 8m59s - MaterializeTupleTime(*): 27s970ms - ScannerThreadsSysTime: 1s570ms - ScannerThreadsUserTime: 36s268ms - ScannerThreadsVoluntaryContextSwitches: 111.55K (111552) - TotalRawHdfsReadTime(*): 1m12s - TotalReadThroughput: 4.50 MB/sec Filter 1 (1.00 MB): - Files processed: 419 (419) - Files rejected: 336 (336) - Files total: 419 (419) - RowGroups processed: 197.31K (197309) - RowGroups rejected: 0 (0) - RowGroups total: 197.31K (197309) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 202.00M (201999873) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance e84a99bb0c926c46:9c59890200000017 (host=vd1316.halxg.cloudera.com:22000):(Total: 8m37s, non-child: 6m20s, % non-child: 73.44%) Hdfs split stats (:<# splits>/): 7:57/10.06 GB 6:53/8.25 GB 5:58/10.65 GB 1:48/7.97 GB 3:52/9.69 GB 4:50/8.51 GB 0:48/8.94 GB 2:51/8.78 GB Filter 1 arrival: 571ms MemoryUsage(16s000ms): 42.30 MB, 43.66 MB, 43.66 MB, 43.66 MB, 43.66 MB, 43.66 MB, 43.66 MB, 43.66 MB, 43.66 MB, 43.66 MB, 41.52 MB, 47.04 MB, 50.07 MB, 39.50 MB, 55.15 MB, 58.52 MB, 31.11 MB, 36.98 MB, 47.70 MB, 41.26 MB, 26.43 MB, 30.30 MB, 28.66 MB, 39.89 MB, 23.05 MB, 30.21 MB, 35.23 MB, 32.90 MB, 51.08 MB, 42.97 MB, 43.94 MB, 42.64 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 62.92 MB (65975974) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 210.59M (210592478) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m6s - TotalStorageWaitTime: 1m37s - TotalThreadsInvoluntaryContextSwitches: 18.40K (18398) - TotalThreadsTotalWallClockTime: 17m15s - TotalThreadsSysTime: 3s887ms - TotalThreadsUserTime: 1m35s - TotalThreadsVoluntaryContextSwitches: 125.20K (125203) Fragment Instance Lifecycle Timings: - ExecTime: 8m37s - ExecTreeExecTime: 1m31s - OpenTime: 32.452ms - ExecTreeOpenTime: 340.728us - PrepareTime: 41.673ms - ExecTreePrepareTime: 1.738ms DataStreamSender (dst_id=26):(Total: 45s932ms, non-child: 45s932ms, % non-child: 100.00%) - BytesSent: 5.67 GB (6090811663) - NetworkThroughput(*): 456.69 MB/sec - OverallThroughput: 126.46 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 210.59M (210592478) - SerializeBatchTime: 33s157ms - TransmitDataRPCTime: 12s719ms - UncompressedRowBatchSize: 8.04 GB (8636197422) CodeGen:(Total: 63.215ms, non-child: 63.215ms, % non-child: 100.00%) - CodegenTime: 1.247ms - CompileTime: 5.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.482ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 33.401ms HDFS_SCAN_NODE (id=6):(Total: 1m31s, non-child: 1m31s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:57/10.06 GB 6:53/8.25 GB 5:58/10.65 GB 1:48/7.97 GB 3:52/9.69 GB 4:50/8.51 GB 0:48/8.94 GB 2:51/8.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 85 out of 85 Runtime filters: All filters arrived. Waited 502ms Hdfs Read Thread Concurrency Bucket: 0:86.76% 1:13.24% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:332 PARQUET/SNAPPY:510 BytesRead(16s000ms): 26.54 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.40 MB, 27.57 MB, 86.78 MB, 208.86 MB, 296.37 MB, 380.46 MB, 412.71 MB, 432.56 MB, 460.99 MB, 507.97 MB, 648.80 MB, 825.59 MB, 1.02 GB, 1.16 GB, 1.30 GB, 1.48 GB, 1.66 GB, 1.86 GB, 1.94 GB, 1.98 GB, 2.09 GB, 2.22 GB, 2.34 GB - FooterProcessingTime: (Avg: 187.109ms ; Min: 1.210ms ; Max: 1s215ms ; Number of samples: 85) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 2.47 GB (2653189938) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.47 GB (2653189938) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.47 GB (2653189938) - DecompressionTime: 10s289ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 85 (85) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 61.70 MB (64696186) - PerReadThreadRawHdfsThroughput: 35.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m30s - RowBatchQueuePutWaitTime: 6m18s - RowsRead: 210.59M (210592478) - RowsReturned: 210.59M (210592478) - RowsReturnedRate: 2.30 M/sec - ScanRangesComplete: 417 (417) - ScannerThreadsInvoluntaryContextSwitches: 10.09K (10094) - ScannerThreadsTotalWallClockTime: 8m37s - MaterializeTupleTime(*): 29s002ms - ScannerThreadsSysTime: 1s747ms - ScannerThreadsUserTime: 38s151ms - ScannerThreadsVoluntaryContextSwitches: 115.71K (115713) - TotalRawHdfsReadTime(*): 1m10s - TotalReadThroughput: 4.89 MB/sec Filter 1 (1.00 MB): - Files processed: 417 (417) - Files rejected: 332 (332) - Files total: 417 (417) - RowGroups processed: 205.70K (205702) - RowGroups rejected: 0 (0) - RowGroups total: 205.70K (205702) - Rows processed: 1.39M (1392640) - Rows rejected: 0 (0) - Rows total: 210.59M (210592478) - Splits processed: 85 (85) - Splits rejected: 0 (0) - Splits total: 85 (85) Averaged Fragment F06:(Total: 1m54s, non-child: 33s115ms, % non-child: 28.88%) split sizes: min: 7.43 GB, max: 7.46 GB, avg: 7.44 GB, stddev: 7.03 MB completion times: min:57s585ms max:2m48s mean: 1m54s stddev:34s736ms execution rates: min:45.11 MB/sec max:132.43 MB/sec mean:74.41 MB/sec stddev:27.59 MB/sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 45.32 MB (47519406) - PerHostPeakMemUsage: 8.23 GB (8839623458) - RowsProduced: 102.86M (102860069) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26s062ms - TotalStorageWaitTime: 1m11s - TotalThreadsInvoluntaryContextSwitches: 4.97K (4975) - TotalThreadsTotalWallClockTime: 3m49s - TotalThreadsSysTime: 1s580ms - TotalThreadsUserTime: 25s465ms - TotalThreadsVoluntaryContextSwitches: 60.37K (60369) Fragment Instance Lifecycle Timings: - ExecTime: 1m54s - ExecTreeExecTime: 1m9s - OpenTime: 16.124ms - ExecTreeOpenTime: 204.934us - PrepareTime: 41.483ms - ExecTreePrepareTime: 7.012ms DataStreamSender (dst_id=27):(Total: 12s233ms, non-child: 12s233ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1567178384) - NetworkThroughput(*): 343.30 MB/sec - OverallThroughput: 122.18 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 102.86M (102860069) - SerializeBatchTime: 7s867ms - TransmitDataRPCTime: 4s353ms - UncompressedRowBatchSize: 2.01 GB (2160488717) CodeGen:(Total: 35.701ms, non-child: 35.701ms, % non-child: 100.00%) - CodegenTime: 306.223us - CompileTime: 5.564ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 8.065ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 21.426ms HDFS_SCAN_NODE (id=7):(Total: 1m9s, non-child: 1m9s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.08 GB (1161464993) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1161464993) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1161464993) - DecompressionTime: 4s102ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 312 (312) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 45.07 MB (47262762) - PerReadThreadRawHdfsThroughput: 294.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m8s - RowBatchQueuePutWaitTime: 32s415ms - RowsRead: 102.86M (102860069) - RowsReturned: 102.86M (102860069) - RowsReturnedRate: 1.78 M/sec - ScanRangesComplete: 312 (312) - ScannerThreadsInvoluntaryContextSwitches: 2.30K (2296) - ScannerThreadsTotalWallClockTime: 1m54s - MaterializeTupleTime(*): 3s400ms - ScannerThreadsSysTime: 1s051ms - ScannerThreadsUserTime: 7s493ms - ScannerThreadsVoluntaryContextSwitches: 57.11K (57112) - TotalRawHdfsReadTime(*): 10s635ms - TotalReadThroughput: 10.73 MB/sec Fragment F06: Instance e84a99bb0c926c46:9c59890200000022 (host=vd1309.halxg.cloudera.com:22000):(Total: 2m48s, non-child: 43s210ms, % non-child: 25.59%) Hdfs split stats (:<# splits>/): 7:45/1.02 GB 3:45/902.27 MB 0:47/1.01 GB 6:42/903.65 MB 5:41/874.25 MB 1:48/1.06 GB 4:37/876.44 MB 2:39/895.37 MB MemoryUsage(4s000ms): 6.58 MB, 5.51 MB, 4.75 MB, 641.04 KB, 8.51 MB, 3.96 MB, 2.43 MB, 3.69 MB, 992.97 KB, 2.94 MB, 2.02 MB, 1.90 MB, 4.76 MB, 11.73 MB, 1.81 MB, 5.83 MB, 4.25 MB, 3.29 MB, 9.38 MB, 9.59 MB, 5.93 MB, 4.90 MB, 2.51 MB, 2.45 MB, 1.79 MB, 5.18 MB, 9.41 MB, 11.75 MB, 6.68 MB, 2.59 MB, 4.12 MB, 5.07 MB, 1.06 MB, 4.46 MB, 7.22 MB, 4.85 MB, 2.43 MB, 3.47 MB, 762.92 KB, 3.10 MB, 3.38 MB, 2.52 MB ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 14.15 MB (14839179) - PerHostPeakMemUsage: 8.21 GB (8814313027) - RowsProduced: 100.54M (100544910) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31s584ms - TotalStorageWaitTime: 1m57s - TotalThreadsInvoluntaryContextSwitches: 6.87K (6869) - TotalThreadsTotalWallClockTime: 5m37s - TotalThreadsSysTime: 1s672ms - TotalThreadsUserTime: 25s968ms - TotalThreadsVoluntaryContextSwitches: 55.13K (55132) Fragment Instance Lifecycle Timings: - ExecTime: 2m48s - ExecTreeExecTime: 1m53s - OpenTime: 17.677ms - ExecTreeOpenTime: 310.577us - PrepareTime: 28.381ms - ExecTreePrepareTime: 2.084ms DataStreamSender (dst_id=27):(Total: 12s356ms, non-child: 12s356ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1538410533) - NetworkThroughput(*): 343.66 MB/sec - OverallThroughput: 118.73 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 100.54M (100544910) - SerializeBatchTime: 8s075ms - TransmitDataRPCTime: 4s269ms - UncompressedRowBatchSize: 1.97 GB (2111860754) CodeGen:(Total: 34.072ms, non-child: 34.072ms, % non-child: 100.00%) - CodegenTime: 251.763us - CompileTime: 5.110ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 10.094ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 18.388ms HDFS_SCAN_NODE (id=7):(Total: 1m53s, non-child: 1m53s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:45/1.02 GB 3:45/902.27 MB 0:47/1.01 GB 6:42/903.65 MB 5:41/874.25 MB 1:48/1.06 GB 4:37/876.44 MB 2:39/895.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 344 out of 344 Hdfs Read Thread Concurrency Bucket: 0:85.21% 1:14.79% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:688 BytesRead(4s000ms): 33.89 MB, 86.58 MB, 162.62 MB, 196.19 MB, 262.19 MB, 338.57 MB, 395.94 MB, 438.52 MB, 497.39 MB, 536.00 MB, 560.99 MB, 588.02 MB, 607.79 MB, 619.41 MB, 633.44 MB, 657.39 MB, 670.18 MB, 676.07 MB, 682.81 MB, 682.81 MB, 694.96 MB, 728.06 MB, 736.46 MB, 751.66 MB, 774.87 MB, 801.99 MB, 823.50 MB, 825.42 MB, 830.79 MB, 847.72 MB, 861.28 MB, 878.53 MB, 896.04 MB, 927.88 MB, 956.91 MB, 984.87 MB, 1005.13 MB, 1017.58 MB, 1.00 GB, 1.01 GB, 1.03 GB, 1.05 GB - FooterProcessingTime: (Avg: 158.254ms ; Min: 1.379ms ; Max: 1s716ms ; Number of samples: 344) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.07 GB (1151390440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1151390440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1151390440) - DecompressionTime: 4s951ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 344 (344) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.90 MB (14579066) - PerReadThreadRawHdfsThroughput: 43.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m52s - RowBatchQueuePutWaitTime: 39s881ms - RowsRead: 100.54M (100544910) - RowsReturned: 100.54M (100544910) - RowsReturnedRate: 887.99 K/sec - ScanRangesComplete: 344 (344) - ScannerThreadsInvoluntaryContextSwitches: 2.85K (2852) - ScannerThreadsTotalWallClockTime: 2m48s - MaterializeTupleTime(*): 3s087ms - ScannerThreadsSysTime: 1s136ms - ScannerThreadsUserTime: 7s480ms - ScannerThreadsVoluntaryContextSwitches: 52.17K (52170) - TotalRawHdfsReadTime(*): 25s182ms - TotalReadThroughput: 6.48 MB/sec Instance e84a99bb0c926c46:9c59890200000023 (host=vd1311.halxg.cloudera.com:22000):(Total: 2m15s, non-child: 39s889ms, % non-child: 29.53%) Hdfs split stats (:<# splits>/): 3:36/945.20 MB 1:48/1.17 GB 5:36/1.13 GB 2:38/946.59 MB 6:43/1006.10 MB 7:38/907.95 MB 0:32/752.71 MB 4:30/701.68 MB MemoryUsage(4s000ms): 5.17 MB, 7.39 MB, 5.06 MB, 2.46 MB, 10.82 MB, 2.75 MB, 2.30 MB, 7.18 MB, 3.85 MB, 2.34 MB, 2.67 MB, 11.76 MB, 4.61 MB, 9.26 MB, 4.36 MB, 4.72 MB, 7.30 MB, 7.54 MB, 13.72 MB, 13.72 MB, 5.83 MB, 1.25 MB, 1.30 MB, 3.26 MB, 2.34 MB, 1.36 MB, 10.30 MB, 13.47 MB, 6.81 MB, 3.19 MB, 5.56 MB, 4.86 MB, 3.63 MB ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 57.78 MB (60586659) - PerHostPeakMemUsage: 8.26 GB (8870566577) - RowsProduced: 103.40M (103399413) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32s682ms - TotalStorageWaitTime: 1m25s - TotalThreadsInvoluntaryContextSwitches: 5.10K (5097) - TotalThreadsTotalWallClockTime: 4m30s - TotalThreadsSysTime: 1s582ms - TotalThreadsUserTime: 25s611ms - TotalThreadsVoluntaryContextSwitches: 61.66K (61658) Fragment Instance Lifecycle Timings: - ExecTime: 2m15s - ExecTreeExecTime: 1m22s - OpenTime: 12.347ms - ExecTreeOpenTime: 200.451us - PrepareTime: 24.238ms - ExecTreePrepareTime: 1.382ms DataStreamSender (dst_id=27):(Total: 12s296ms, non-child: 12s296ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1573559580) - NetworkThroughput(*): 341.31 MB/sec - OverallThroughput: 122.04 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.40M (103399413) - SerializeBatchTime: 7s887ms - TransmitDataRPCTime: 4s396ms - UncompressedRowBatchSize: 2.02 GB (2171817177) CodeGen:(Total: 27.026ms, non-child: 27.026ms, % non-child: 100.00%) - CodegenTime: 247.703us - CompileTime: 4.214ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.998ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 15.661ms HDFS_SCAN_NODE (id=7):(Total: 1m22s, non-child: 1m22s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:36/945.20 MB 1:48/1.17 GB 5:36/1.13 GB 2:38/946.59 MB 6:43/1006.10 MB 7:38/907.95 MB 0:32/752.71 MB 4:30/701.68 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 301 out of 301 Hdfs Read Thread Concurrency Bucket: 0:91.85% 1:8.148% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:602 BytesRead(4s000ms): 24.75 MB, 72.75 MB, 180.91 MB, 222.37 MB, 275.01 MB, 327.08 MB, 344.01 MB, 412.56 MB, 497.07 MB, 549.12 MB, 577.37 MB, 642.19 MB, 702.28 MB, 726.83 MB, 740.33 MB, 762.41 MB, 779.23 MB, 799.60 MB, 807.54 MB, 807.54 MB, 812.84 MB, 843.27 MB, 854.96 MB, 876.24 MB, 892.90 MB, 909.92 MB, 924.47 MB, 926.21 MB, 934.79 MB, 955.27 MB, 977.09 MB, 1009.58 MB, 1.01 GB - FooterProcessingTime: (Avg: 120.443ms ; Min: 1.118ms ; Max: 2s123ms ; Number of samples: 301) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.08 GB (1163319149) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1163319149) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1163319149) - DecompressionTime: 4s098ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 301 (301) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 57.55 MB (60345725) - PerReadThreadRawHdfsThroughput: 82.59 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m22s - RowBatchQueuePutWaitTime: 39s476ms - RowsRead: 103.40M (103399413) - RowsReturned: 103.40M (103399413) - RowsReturnedRate: 1.25 M/sec - ScanRangesComplete: 301 (301) - ScannerThreadsInvoluntaryContextSwitches: 2.42K (2418) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 3s660ms - ScannerThreadsSysTime: 1s043ms - ScannerThreadsUserTime: 7s425ms - ScannerThreadsVoluntaryContextSwitches: 57.95K (57955) - TotalRawHdfsReadTime(*): 13s432ms - TotalReadThroughput: 8.08 MB/sec Instance e84a99bb0c926c46:9c59890200000021 (host=vd1312.halxg.cloudera.com:22000):(Total: 2m11s, non-child: 36s289ms, % non-child: 27.54%) Hdfs split stats (:<# splits>/): 7:40/950.38 MB 2:47/1.02 GB 0:46/1012.60 MB 1:48/1.05 GB 5:35/807.84 MB 4:45/950.47 MB 3:40/867.71 MB 6:49/921.90 MB MemoryUsage(4s000ms): 3.31 MB, 8.21 MB, 5.21 MB, 5.04 MB, 5.23 MB, 3.65 MB, 3.11 MB, 5.25 MB, 4.74 MB, 2.63 MB, 2.58 MB, 2.36 MB, 5.53 MB, 10.07 MB, 2.98 MB, 2.94 MB, 929.72 KB, 3.87 MB, 9.34 MB, 9.48 MB, 5.69 MB, 1.32 MB, 3.89 MB, 2.34 MB, 1.74 MB, 1.28 MB, 6.17 MB, 9.87 MB, 5.96 MB, 3.36 MB, 3.36 MB, 3.92 MB, 1.83 MB ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 14.19 MB (14879754) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 100.72M (100718649) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s231ms - TotalStorageWaitTime: 1m26s - TotalThreadsInvoluntaryContextSwitches: 4.36K (4363) - TotalThreadsTotalWallClockTime: 4m23s - TotalThreadsSysTime: 1s609ms - TotalThreadsUserTime: 25s058ms - TotalThreadsVoluntaryContextSwitches: 57.42K (57419) Fragment Instance Lifecycle Timings: - ExecTime: 2m11s - ExecTreeExecTime: 1m23s - OpenTime: 9.876ms - ExecTreeOpenTime: 113.651us - PrepareTime: 21.541ms - ExecTreePrepareTime: 962.042us DataStreamSender (dst_id=27):(Total: 12s097ms, non-child: 12s097ms, % non-child: 100.00%) - BytesSent: 1.44 GB (1540894249) - NetworkThroughput(*): 343.25 MB/sec - OverallThroughput: 121.47 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 100.72M (100718649) - SerializeBatchTime: 7s804ms - TransmitDataRPCTime: 4s281ms - UncompressedRowBatchSize: 1.97 GB (2115510001) CodeGen:(Total: 22.572ms, non-child: 22.572ms, % non-child: 100.00%) - CodegenTime: 197.392us - CompileTime: 3.432ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.093ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 13.669ms HDFS_SCAN_NODE (id=7):(Total: 1m23s, non-child: 1m23s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:40/950.38 MB 2:47/1.02 GB 0:46/1012.60 MB 1:48/1.05 GB 5:35/807.84 MB 4:45/950.47 MB 3:40/867.71 MB 6:49/921.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 350 out of 350 Hdfs Read Thread Concurrency Bucket: 0:92.42% 1:7.576% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:700 BytesRead(4s000ms): 26.85 MB, 112.40 MB, 237.50 MB, 290.38 MB, 331.36 MB, 395.26 MB, 452.11 MB, 512.24 MB, 628.35 MB, 689.00 MB, 725.04 MB, 771.14 MB, 793.65 MB, 813.27 MB, 837.05 MB, 856.44 MB, 870.31 MB, 884.58 MB, 891.20 MB, 891.20 MB, 896.08 MB, 909.26 MB, 922.84 MB, 933.95 MB, 954.57 MB, 970.33 MB, 996.68 MB, 1000.29 MB, 1008.53 MB, 1.01 GB, 1.02 GB, 1.04 GB, 1.06 GB - FooterProcessingTime: (Avg: 110.577ms ; Min: 1.304ms ; Max: 2s242ms ; Number of samples: 350) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.07 GB (1152818405) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1152818405) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1152818405) - DecompressionTime: 3s734ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 350 (350) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 13.91 MB (14582512) - PerReadThreadRawHdfsThroughput: 83.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m23s - RowBatchQueuePutWaitTime: 34s526ms - RowsRead: 100.72M (100718649) - RowsReturned: 100.72M (100718649) - RowsReturnedRate: 1.21 M/sec - ScanRangesComplete: 350 (350) - ScannerThreadsInvoluntaryContextSwitches: 2.08K (2077) - ScannerThreadsTotalWallClockTime: 2m11s - MaterializeTupleTime(*): 3s319ms - ScannerThreadsSysTime: 1s092ms - ScannerThreadsUserTime: 7s358ms - ScannerThreadsVoluntaryContextSwitches: 54.09K (54092) - TotalRawHdfsReadTime(*): 13s135ms - TotalReadThroughput: 8.31 MB/sec Instance e84a99bb0c926c46:9c59890200000024 (host=vd1316.halxg.cloudera.com:22000):(Total: 2m10s, non-child: 37s580ms, % non-child: 28.74%) Hdfs split stats (:<# splits>/): 2:39/1.26 GB 3:40/1.06 GB 1:34/805.56 MB 5:40/1.08 GB 7:37/871.84 MB 4:32/761.48 MB 6:31/782.25 MB 0:41/910.27 MB MemoryUsage(4s000ms): 3.35 MB, 6.49 MB, 6.12 MB, 1.94 MB, 8.93 MB, 2.19 MB, 2.16 MB, 7.13 MB, 4.83 MB, 2.19 MB, 4.10 MB, 3.63 MB, 3.83 MB, 11.37 MB, 5.47 MB, 5.18 MB, 4.21 MB, 5.11 MB, 11.46 MB, 11.58 MB, 6.96 MB, 2.40 MB, 1.32 MB, 165.92 KB, 1.64 MB, 2.05 MB, 8.88 MB, 11.74 MB, 4.63 MB, 5.41 MB, 4.39 MB, 17.87 MB ThreadUsage(4s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 57.78 MB (60586659) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 104.67M (104671698) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31s606ms - TotalStorageWaitTime: 1m23s - TotalThreadsInvoluntaryContextSwitches: 4.52K (4518) - TotalThreadsTotalWallClockTime: 4m21s - TotalThreadsSysTime: 1s497ms - TotalThreadsUserTime: 25s265ms - TotalThreadsVoluntaryContextSwitches: 63.42K (63420) Fragment Instance Lifecycle Timings: - ExecTime: 2m10s - ExecTreeExecTime: 1m20s - OpenTime: 16.830ms - ExecTreeOpenTime: 256.128us - PrepareTime: 50.039ms - ExecTreePrepareTime: 1.810ms DataStreamSender (dst_id=27):(Total: 12s249ms, non-child: 12s249ms, % non-child: 100.00%) - BytesSent: 1.48 GB (1589102589) - NetworkThroughput(*): 344.32 MB/sec - OverallThroughput: 123.72 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 104.67M (104671698) - SerializeBatchTime: 7s836ms - TransmitDataRPCTime: 4s401ms - UncompressedRowBatchSize: 2.05 GB (2198540446) CodeGen:(Total: 50.715ms, non-child: 50.715ms, % non-child: 100.00%) - CodegenTime: 369.163us - CompileTime: 6.657ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.771ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 35.756ms HDFS_SCAN_NODE (id=7):(Total: 1m20s, non-child: 1m20s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:39/1.26 GB 3:40/1.06 GB 1:34/805.56 MB 5:40/1.08 GB 7:37/871.84 MB 4:32/761.48 MB 6:31/782.25 MB 0:41/910.27 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 294 out of 294 Hdfs Read Thread Concurrency Bucket: 0:89.69% 1:10.31% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:588 BytesRead(4s000ms): 27.91 MB, 86.01 MB, 194.21 MB, 255.17 MB, 323.00 MB, 387.99 MB, 439.34 MB, 503.11 MB, 570.01 MB, 634.37 MB, 661.67 MB, 712.31 MB, 750.27 MB, 771.69 MB, 814.73 MB, 841.55 MB, 857.40 MB, 880.78 MB, 887.54 MB, 887.54 MB, 897.31 MB, 913.37 MB, 923.23 MB, 930.17 MB, 933.59 MB, 953.59 MB, 976.64 MB, 979.20 MB, 984.31 MB, 1001.40 MB, 1022.00 MB, 1.03 GB - FooterProcessingTime: (Avg: 111.752ms ; Min: 1.358ms ; Max: 2s250ms ; Number of samples: 294) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.09 GB (1169295665) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1169295665) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1169295665) - DecompressionTime: 3s785ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 294 (294) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 57.53 MB (60320291) - PerReadThreadRawHdfsThroughput: 78.97 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1m20s - RowBatchQueuePutWaitTime: 37s943ms - RowsRead: 104.67M (104671698) - RowsReturned: 104.67M (104671698) - RowsReturnedRate: 1.29 M/sec - ScanRangesComplete: 294 (294) - ScannerThreadsInvoluntaryContextSwitches: 2.16K (2161) - ScannerThreadsTotalWallClockTime: 2m10s - MaterializeTupleTime(*): 2s967ms - ScannerThreadsSysTime: 1s007ms - ScannerThreadsUserTime: 7s411ms - ScannerThreadsVoluntaryContextSwitches: 59.66K (59663) - TotalRawHdfsReadTime(*): 14s121ms - TotalReadThroughput: 8.51 MB/sec Instance e84a99bb0c926c46:9c5989020000001e (host=vd1314.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 29s386ms, % non-child: 32.83%) Hdfs split stats (:<# splits>/): 4:40/995.41 MB 0:39/963.32 MB 5:48/1.08 GB 3:44/1.10 GB 2:33/893.31 MB 6:34/836.60 MB 1:32/944.88 MB 7:35/772.51 MB MemoryUsage(2s000ms): 8.57 MB, 1.83 MB, 5.02 MB, 12.85 MB, 5.36 MB, 11.33 MB, 9.70 MB, 1.30 MB, 6.16 MB, 10.79 MB, 6.32 MB, 1.25 MB, 4.74 MB, 5.44 MB, 9.90 MB, 5.96 MB, 4.74 MB, 8.30 MB, 797.04 KB, 5.21 MB, 4.72 MB, 236.92 KB, 4.68 MB, 4.62 MB, 5.52 MB, 4.09 MB, 9.34 MB, 9.34 MB, 2.07 MB, 1.53 MB, 1.61 MB, 1.21 MB, 3.95 MB, 8.20 MB, 1.28 MB, 2.34 MB, 9.49 MB, 9.49 MB, 9.27 MB, 9.19 MB, 10.68 MB, 6.96 MB, 6.18 MB, 811.04 KB ThreadUsage(2s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 57.78 MB (60586659) - PerHostPeakMemUsage: 8.22 GB (8820876867) - RowsProduced: 103.60M (103599261) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 23s160ms - TotalStorageWaitTime: 49s174ms - TotalThreadsInvoluntaryContextSwitches: 4.78K (4776) - TotalThreadsTotalWallClockTime: 2m58s - TotalThreadsSysTime: 1s590ms - TotalThreadsUserTime: 25s369ms - TotalThreadsVoluntaryContextSwitches: 62.55K (62548) Fragment Instance Lifecycle Timings: - ExecTime: 1m29s - ExecTreeExecTime: 47s918ms - OpenTime: 10.337ms - ExecTreeOpenTime: 129.424us - PrepareTime: 19.883ms - ExecTreePrepareTime: 728.242us DataStreamSender (dst_id=27):(Total: 12s231ms, non-child: 12s231ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1576619675) - NetworkThroughput(*): 344.55 MB/sec - OverallThroughput: 122.92 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.60M (103599261) - SerializeBatchTime: 7s856ms - TransmitDataRPCTime: 4s363ms - UncompressedRowBatchSize: 2.03 GB (2176014813) CodeGen:(Total: 23.732ms, non-child: 23.732ms, % non-child: 100.00%) - CodegenTime: 305.839us - CompileTime: 3.554ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.359ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 14.404ms HDFS_SCAN_NODE (id=7):(Total: 47s881ms, non-child: 47s881ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:40/995.41 MB 0:39/963.32 MB 5:48/1.08 GB 3:44/1.10 GB 2:33/893.31 MB 6:34/836.60 MB 1:32/944.88 MB 7:35/772.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 305 out of 305 Hdfs Read Thread Concurrency Bucket: 0:97.21% 1:2.793% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:610 BytesRead(2s000ms): 12.97 MB, 34.72 MB, 66.05 MB, 109.53 MB, 186.74 MB, 252.82 MB, 299.27 MB, 309.78 MB, 335.45 MB, 344.80 MB, 415.24 MB, 438.34 MB, 462.25 MB, 535.90 MB, 579.50 MB, 622.31 MB, 674.75 MB, 764.16 MB, 800.86 MB, 828.95 MB, 861.95 MB, 886.01 MB, 898.54 MB, 911.84 MB, 922.85 MB, 928.24 MB, 931.80 MB, 931.80 MB, 958.00 MB, 977.66 MB, 985.28 MB, 993.68 MB, 997.56 MB, 1002.48 MB, 1011.52 MB, 1018.30 MB, 1022.45 MB, 1022.45 MB, 1022.45 MB, 1022.45 MB, 1.01 GB, 1.02 GB, 1.03 GB, 1.04 GB - FooterProcessingTime: (Avg: 69.991ms ; Min: 1.288ms ; Max: 1s000ms ; Number of samples: 305) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.09 GB (1165803073) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1165803073) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1165803073) - DecompressionTime: 4s446ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 305 (305) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 57.55 MB (60345824) - PerReadThreadRawHdfsThroughput: 367.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 46s400ms - RowBatchQueuePutWaitTime: 28s934ms - RowsRead: 103.60M (103599261) - RowsReturned: 103.60M (103599261) - RowsReturnedRate: 2.16 M/sec - ScanRangesComplete: 305 (305) - ScannerThreadsInvoluntaryContextSwitches: 2.14K (2143) - ScannerThreadsTotalWallClockTime: 1m29s - MaterializeTupleTime(*): 3s796ms - ScannerThreadsSysTime: 1s057ms - ScannerThreadsUserTime: 7s473ms - ScannerThreadsVoluntaryContextSwitches: 59.33K (59334) - TotalRawHdfsReadTime(*): 3s029ms - TotalReadThroughput: 12.37 MB/sec Instance e84a99bb0c926c46:9c59890200000020 (host=vd1313.halxg.cloudera.com:22000):(Total: 1m29s, non-child: 30s591ms, % non-child: 34.33%) Hdfs split stats (:<# splits>/): 0:36/913.21 MB 1:37/892.17 MB 7:35/906.95 MB 6:35/887.43 MB 4:37/927.52 MB 3:41/1.00 GB 5:36/1.06 GB 2:40/988.80 MB MemoryUsage(2s000ms): 8.20 MB, 2.35 MB, 7.28 MB, 9.63 MB, 4.64 MB, 214.92 KB, 21.00 MB, 5.82 MB, 4.24 MB, 10.47 MB, 3.65 MB, 4.55 MB, 4.61 MB, 7.97 MB, 12.26 MB, 214.92 KB, 9.50 MB, 8.23 MB, 4.63 MB, 4.64 MB, 2.52 MB, 809.04 KB, 1.01 MB, 5.13 MB, 4.67 MB, 9.03 MB, 13.73 MB, 12.53 MB, 2.60 MB, 5.72 MB, 1.73 MB, 1.26 MB, 4.03 MB, 7.37 MB, 1.30 MB, 7.36 MB, 9.74 MB, 9.74 MB, 9.72 MB, 9.72 MB, 5.50 MB, 1.19 MB, 2.30 MB, 2.27 MB ThreadUsage(2s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 1.99 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 57.76 MB (60570275) - PerHostPeakMemUsage: 8.20 GB (8809279960) - RowsProduced: 103.57M (103573478) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 24s134ms - TotalStorageWaitTime: 48s037ms - TotalThreadsInvoluntaryContextSwitches: 4.78K (4783) - TotalThreadsTotalWallClockTime: 2m57s - TotalThreadsSysTime: 1s599ms - TotalThreadsUserTime: 25s782ms - TotalThreadsVoluntaryContextSwitches: 62.35K (62352) Fragment Instance Lifecycle Timings: - ExecTime: 1m28s - ExecTreeExecTime: 46s083ms - OpenTime: 36.405ms - ExecTreeOpenTime: 309.976us - PrepareTime: 127.208ms - ExecTreePrepareTime: 41.300ms DataStreamSender (dst_id=27):(Total: 12s333ms, non-child: 12s333ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1576280347) - NetworkThroughput(*): 342.60 MB/sec - OverallThroughput: 121.89 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.57M (103573478) - SerializeBatchTime: 7s931ms - TransmitDataRPCTime: 4s387ms - UncompressedRowBatchSize: 2.03 GB (2175473262) CodeGen:(Total: 70.344ms, non-child: 70.344ms, % non-child: 100.00%) - CodegenTime: 580.071us - CompileTime: 12.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 17.132ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 39.033ms HDFS_SCAN_NODE (id=7):(Total: 46s124ms, non-child: 46s124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:36/913.21 MB 1:37/892.17 MB 7:35/906.95 MB 6:35/887.43 MB 4:37/927.52 MB 3:41/1.00 GB 5:36/1.06 GB 2:40/988.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 297 out of 297 Hdfs Read Thread Concurrency Bucket: 0:95.51% 1:4.494% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:594 BytesRead(2s000ms): 13.62 MB, 48.56 MB, 106.61 MB, 160.59 MB, 228.52 MB, 251.50 MB, 295.08 MB, 370.76 MB, 461.37 MB, 481.12 MB, 529.75 MB, 544.81 MB, 560.29 MB, 572.48 MB, 626.53 MB, 683.65 MB, 742.67 MB, 808.38 MB, 839.64 MB, 870.02 MB, 897.64 MB, 908.56 MB, 919.96 MB, 935.99 MB, 941.85 MB, 971.74 MB, 979.07 MB, 981.19 MB, 1016.65 MB, 1.01 GB, 1.01 GB, 1.02 GB, 1.03 GB, 1.03 GB, 1.04 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.06 GB, 1.07 GB - FooterProcessingTime: (Avg: 71.486ms ; Min: 1.360ms ; Max: 918.432ms ; Number of samples: 297) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 0.99 - BytesRead: 1.08 GB (1163671961) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1163671961) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1163671961) - DecompressionTime: 3s842ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 297 (297) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 57.55 MB (60345759) - PerReadThreadRawHdfsThroughput: 241.79 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 45s699ms - RowBatchQueuePutWaitTime: 30s669ms - RowsRead: 103.57M (103573478) - RowsReturned: 103.57M (103573478) - RowsReturnedRate: 2.25 M/sec - ScanRangesComplete: 297 (297) - ScannerThreadsInvoluntaryContextSwitches: 2.17K (2165) - ScannerThreadsTotalWallClockTime: 1m28s - MaterializeTupleTime(*): 3s854ms - ScannerThreadsSysTime: 1s015ms - ScannerThreadsUserTime: 7s654ms - ScannerThreadsVoluntaryContextSwitches: 59.30K (59302) - TotalRawHdfsReadTime(*): 4s589ms - TotalReadThroughput: 12.40 MB/sec Instance e84a99bb0c926c46:9c5989020000001f (host=vd1310.halxg.cloudera.com:22000):(Total: 57s583ms, non-child: 14s858ms, % non-child: 25.80%) Hdfs split stats (:<# splits>/): 5:36/925.27 MB 3:45/1.12 GB 1:40/1.07 GB 7:36/964.70 MB 2:36/1.01 GB 0:34/827.09 MB 4:33/800.56 MB 6:39/826.55 MB MemoryUsage(1s000ms): 5.23 MB, 3.71 MB, 172.91 KB, 5.89 MB, 2.89 MB, 11.96 MB, 9.89 MB, 6.91 MB, 10.21 MB, 192.92 KB, 1.34 MB, 11.71 MB, 9.73 MB, 196.92 KB, 4.94 MB, 11.70 MB, 212.92 KB, 1.34 MB, 6.15 MB, 11.94 MB, 212.91 KB, 2.37 MB, 9.59 MB, 196.91 KB, 7.05 MB, 8.60 MB, 1.39 MB, 196.92 KB, 6.66 MB, 1.37 MB, 2.36 MB, 196.92 KB, 164.91 KB, 172.92 KB, 6.06 MB, 4.29 MB, 204.92 KB, 1.37 MB, 5.93 MB, 164.92 KB, 26.74 MB, 9.87 MB, 5.95 MB, 2.32 MB, 4.48 MB, 5.05 MB, 6.96 MB, 2.33 MB, 6.06 MB, 13.73 MB, 5.88 MB, 6.00 MB, 11.69 MB, 11.69 MB, 11.69 MB, 11.69 MB, 216.91 KB ThreadUsage(1s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 57.78 MB (60586659) - PerHostPeakMemUsage: 8.23 GB (8833391925) - RowsProduced: 103.51M (103513076) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9s037ms - TotalStorageWaitTime: 32s266ms - TotalThreadsInvoluntaryContextSwitches: 4.42K (4419) - TotalThreadsTotalWallClockTime: 1m55s - TotalThreadsSysTime: 1s511ms - TotalThreadsUserTime: 25s203ms - TotalThreadsVoluntaryContextSwitches: 60.06K (60060) Fragment Instance Lifecycle Timings: - ExecTime: 57s555ms - ExecTreeExecTime: 30s676ms - OpenTime: 9.397ms - ExecTreeOpenTime: 114.334us - PrepareTime: 19.088ms - ExecTreePrepareTime: 821.415us DataStreamSender (dst_id=27):(Total: 12s066ms, non-child: 12s066ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1575381720) - NetworkThroughput(*): 343.42 MB/sec - OverallThroughput: 124.51 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.51M (103513076) - SerializeBatchTime: 7s679ms - TransmitDataRPCTime: 4s374ms - UncompressedRowBatchSize: 2.02 GB (2174204572) CodeGen:(Total: 21.444ms, non-child: 21.444ms, % non-child: 100.00%) - CodegenTime: 191.631us - CompileTime: 3.021ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 5.005ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 13.074ms HDFS_SCAN_NODE (id=7):(Total: 30s637ms, non-child: 30s637ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:36/925.27 MB 3:45/1.12 GB 1:40/1.07 GB 7:36/964.70 MB 2:36/1.01 GB 0:34/827.09 MB 4:33/800.56 MB 6:39/826.55 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 299 out of 299 Hdfs Read Thread Concurrency Bucket: 0:97.39% 1:2.609% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:598 BytesRead(1s000ms): 5.96 MB, 11.26 MB, 27.08 MB, 37.72 MB, 57.51 MB, 118.97 MB, 136.64 MB, 164.84 MB, 199.27 MB, 217.41 MB, 226.93 MB, 259.04 MB, 328.32 MB, 377.25 MB, 395.13 MB, 451.57 MB, 488.82 MB, 491.34 MB, 494.18 MB, 500.19 MB, 513.18 MB, 519.49 MB, 540.61 MB, 571.06 MB, 588.20 MB, 640.85 MB, 665.30 MB, 666.71 MB, 674.71 MB, 687.17 MB, 698.02 MB, 708.50 MB, 720.44 MB, 724.70 MB, 755.47 MB, 775.63 MB, 801.15 MB, 805.46 MB, 823.47 MB, 827.72 MB, 861.48 MB, 897.45 MB, 909.95 MB, 926.64 MB, 939.03 MB, 951.12 MB, 980.84 MB, 990.94 MB, 999.28 MB, 1012.33 MB, 1014.54 MB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.03 GB - FooterProcessingTime: (Avg: 49.842ms ; Min: 1.312ms ; Max: 640.998ms ; Number of samples: 299) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.08 GB (1163956258) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1163956258) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1163956258) - DecompressionTime: 3s861ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 299 (299) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 57.53 MB (60320159) - PerReadThreadRawHdfsThroughput: 1.13 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 30s313ms - RowBatchQueuePutWaitTime: 15s474ms - RowsRead: 103.51M (103513076) - RowsReturned: 103.51M (103513076) - RowsReturnedRate: 3.38 M/sec - ScanRangesComplete: 299 (299) - ScannerThreadsInvoluntaryContextSwitches: 2.26K (2260) - ScannerThreadsTotalWallClockTime: 57s534ms - MaterializeTupleTime(*): 3s114ms - ScannerThreadsSysTime: 1s007ms - ScannerThreadsUserTime: 7s647ms - ScannerThreadsVoluntaryContextSwitches: 57.27K (57274) - TotalRawHdfsReadTime(*): 956.651ms - TotalReadThroughput: 18.95 MB/sec Averaged Fragment F08:(Total: 108.250ms, non-child: 52.814ms, % non-child: 48.79%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:473.336ms max:473.336ms mean: 473.336ms stddev:0.000ns execution rates: min:4.54 MB/sec max:4.54 MB/sec mean:4.54 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 414.49 MB (434625698) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 47.484ms - TotalStorageWaitTime: 3.624ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 89.123ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 33 (33) Fragment Instance Lifecycle Timings: - ExecTime: 58.057ms - ExecTreeExecTime: 9.528ms - OpenTime: 22.001ms - ExecTreeOpenTime: 39.726us - PrepareTime: 28.126ms - ExecTreePrepareTime: 124.556us DataStreamSender (dst_id=28):(Total: 169.073us, non-child: 169.073us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 175.66 MB/sec - OverallThroughput: 116.24 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 14.701us - TransmitDataRPCTime: 111.880us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 45.371ms, non-child: 45.371ms, % non-child: 100.00%) - CodegenTime: 453.308us - CompileTime: 6.560ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 14.192ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 24.078ms HDFS_SCAN_NODE (id=8):(Total: 9.894ms, non-child: 9.894ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 124.638us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 1020.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.104ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 36.99 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 9.339ms - MaterializeTupleTime(*): 4.083ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 444.999us - TotalReadThroughput: 0.00 /sec Fragment F08: Instance e84a99bb0c926c46:9c59890200000025 (host=vd1316.halxg.cloudera.com:22000):(Total: 108.250ms, non-child: 52.814ms, % non-child: 48.79%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 414.49 MB (434625698) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 47.484ms - TotalStorageWaitTime: 3.624ms - TotalThreadsInvoluntaryContextSwitches: 8 (8) - TotalThreadsTotalWallClockTime: 89.123ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 24.996ms - TotalThreadsVoluntaryContextSwitches: 33 (33) Fragment Instance Lifecycle Timings: - ExecTime: 58.057ms - ExecTreeExecTime: 9.528ms - OpenTime: 22.001ms - ExecTreeOpenTime: 39.726us - PrepareTime: 28.126ms - ExecTreePrepareTime: 124.556us DataStreamSender (dst_id=28):(Total: 169.073us, non-child: 169.073us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 175.66 MB/sec - OverallThroughput: 116.24 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 14.701us - TransmitDataRPCTime: 111.880us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 45.371ms, non-child: 45.371ms, % non-child: 100.00%) - CodegenTime: 453.308us - CompileTime: 6.560ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 14.192ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 24.078ms HDFS_SCAN_NODE (id=8):(Total: 9.894ms, non-child: 9.894ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.378ms ; Min: 1.378ms ; Max: 1.378ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 124.638us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 1020.94 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 9.104ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 36.99 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 9.339ms - MaterializeTupleTime(*): 4.083ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 444.999us - TotalReadThroughput: 0.00 /sec Averaged Fragment F13:(Total: 73.834ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:21m36s max:21m36s mean: 21m36s stddev:33.607ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m1s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 73.659ms - ExecTreePrepareTime: 40.292ms DataStreamSender (dst_id=37):(Total: 30.540us, non-child: 30.540us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 99.620ms, non-child: 99.620ms, % non-child: 100.00%) - CodegenTime: 2.508ms - CompileTime: 20.049ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 50.591ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 28.361ms AGGREGATION_NODE (id=35):(Total: 40.291ms, non-child: 0.000ns, % non-child: 0.00%) - BufferPoolAllocTime: 945.369ms - BufferPoolAllocationBytes: 5.91 GB (6348977883) - BufferPoolAllocations: 3.03K (3027) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6313326299) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6313326299) - BufferPoolWriteIoBytes: 5.88 GB (6313326299) - BufferPoolWriteIoOps: 3.01K (3010) - BufferPoolWriteIoWaitTime: 55s584ms - BuildTime: 1m26s - GetResultsTime: 0.000ns - HTResizeTime: 8.888ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m4s, non-child: 20m4s, % non-child: 100.00%) - BytesReceived: 3.02 GB (3241370242) - ConvertRowBatchTime: 2s734ms - DeserializeRowBatchTimer: 41s834ms - FirstBatchArrivalWaitTime: 12m36s - PeakMemoryUsage: 0 - RowsReturned: 110.72M (110719574) - RowsReturnedRate: 91.94 K/sec - SendersBlockedTimer: 16s960ms - SendersBlockedTotalTimer(*): 1m24s Fragment F13: Instance e84a99bb0c926c46:9c5989020000004b (host=vd1313.halxg.cloudera.com:22000):(Total: 337.904ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 35.92 MB, 34.99 MB, 34.84 MB, 35.49 MB, 41.25 MB, 37.13 MB, 37.03 MB, 35.36 MB, 34.66 MB, 34.31 MB, 34.43 MB, 34.23 MB, 34.11 MB, 34.11 MB, 34.12 MB, 34.13 MB, 34.11 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 336.949ms - ExecTreePrepareTime: 269.841ms DataStreamSender (dst_id=37):(Total: 43.333us, non-child: 43.333us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 172.427ms, non-child: 172.427ms, % non-child: 100.00%) - CodegenTime: 5.215ms - CompileTime: 24.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 93.042ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 53.231ms AGGREGATION_NODE (id=35):(Total: 269.840ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s188ms - BufferPoolAllocationBytes: 5.91 GB (6348079104) - BufferPoolAllocations: 3.03K (3027) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolWriteIoBytes: 5.88 GB (6312427520) - BufferPoolWriteIoOps: 3.01K (3010) - BufferPoolWriteIoWaitTime: 57s649ms - BuildTime: 1m27s - GetResultsTime: 0.000ns - HTResizeTime: 8.581ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m3s, non-child: 7s242ms, % non-child: 0.60%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.04 MB, 97.38 MB, 284.35 MB, 417.31 MB, 575.73 MB, 772.84 MB, 958.03 MB, 1.11 GB, 1.30 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3241470091) - ConvertRowBatchTime: 2s749ms - DeserializeRowBatchTimer: 23s927ms - FirstBatchArrivalWaitTime: 12m35s - PeakMemoryUsage: 0 - RowsReturned: 110.72M (110723165) - RowsReturnedRate: 92.02 K/sec - SendersBlockedTimer: 12s451ms - SendersBlockedTotalTimer(*): 57s553ms Instance e84a99bb0c926c46:9c5989020000004c (host=vd1310.halxg.cloudera.com:22000):(Total: 33.820ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.81 MB, 34.49 MB, 40.30 MB, 48.75 MB, 34.77 MB, 37.71 MB, 37.44 MB, 34.53 MB, 34.15 MB, 34.19 MB, 34.30 MB, 34.11 MB, 34.11 MB, 34.11 MB, 34.41 MB, 34.11 MB, 34.17 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 33.770ms - ExecTreePrepareTime: 1.766ms DataStreamSender (dst_id=37):(Total: 25.171us, non-child: 25.171us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 91.188ms, non-child: 91.188ms, % non-child: 100.00%) - CodegenTime: 1.968ms - CompileTime: 19.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 42.319ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 28.988ms AGGREGATION_NODE (id=35):(Total: 1.765ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 579.400ms - BufferPoolAllocationBytes: 5.92 GB (6352273408) - BufferPoolAllocations: 3.03K (3029) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6316621824) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6316621824) - BufferPoolWriteIoBytes: 5.88 GB (6316621824) - BufferPoolWriteIoOps: 3.01K (3012) - BufferPoolWriteIoWaitTime: 1m3s - BuildTime: 1m30s - GetResultsTime: 0.000ns - HTResizeTime: 12.361ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m, non-child: 7s595ms, % non-child: 0.63%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.55 MB, 96.18 MB, 282.14 MB, 416.26 MB, 573.81 MB, 771.29 MB, 956.43 MB, 1.11 GB, 1.29 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3241462659) - ConvertRowBatchTime: 2s718ms - DeserializeRowBatchTimer: 21s943ms - FirstBatchArrivalWaitTime: 12m35s - PeakMemoryUsage: 0 - RowsReturned: 110.72M (110724887) - RowsReturnedRate: 92.24 K/sec - SendersBlockedTimer: 26s380ms - SendersBlockedTotalTimer(*): 2m52s Instance e84a99bb0c926c46:9c5989020000004f (host=vd1309.halxg.cloudera.com:22000):(Total: 33.012ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.21 MB, 38.35 MB, 44.79 MB, 36.30 MB, 36.93 MB, 39.12 MB, 46.82 MB, 42.19 MB, 35.94 MB, 35.48 MB, 34.46 MB, 34.14 MB, 34.15 MB, 34.15 MB, 34.13 MB, 34.15 MB, 34.13 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 19m4s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 32.958ms - ExecTreePrepareTime: 1.760ms DataStreamSender (dst_id=37):(Total: 27.062us, non-child: 27.062us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 106.046ms, non-child: 106.046ms, % non-child: 100.00%) - CodegenTime: 2.419ms - CompileTime: 21.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 57.034ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 27.090ms AGGREGATION_NODE (id=35):(Total: 1.758ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s256ms - BufferPoolAllocationBytes: 5.91 GB (6348079104) - BufferPoolAllocations: 3.03K (3027) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolWriteIoBytes: 5.88 GB (6312427520) - BufferPoolWriteIoOps: 3.01K (3010) - BufferPoolWriteIoWaitTime: 1m37s - BuildTime: 2m22s - GetResultsTime: 0.000ns - HTResizeTime: 7.244ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 19m7s, non-child: 6s954ms, % non-child: 0.61%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.57 MB, 96.22 MB, 282.24 MB, 416.44 MB, 573.99 MB, 771.45 MB, 956.68 MB, 1.11 GB, 1.29 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3241349141) - ConvertRowBatchTime: 2s758ms - DeserializeRowBatchTimer: 2m38s - FirstBatchArrivalWaitTime: 12m39s - PeakMemoryUsage: 0 - RowsReturned: 110.71M (110711808) - RowsReturnedRate: 96.46 K/sec - SendersBlockedTimer: 42s044ms - SendersBlockedTotalTimer(*): 3m14s Instance e84a99bb0c926c46:9c5989020000004d (host=vd1316.halxg.cloudera.com:22000):(Total: 32.008ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.18 MB, 41.89 MB, 36.75 MB, 35.48 MB, 35.69 MB, 36.15 MB, 34.99 MB, 34.12 MB, 34.20 MB, 34.17 MB, 34.46 MB, 34.11 MB, 34.09 MB, 34.10 MB, 34.37 MB, 34.11 MB, 34.12 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.971ms - ExecTreePrepareTime: 2.214ms DataStreamSender (dst_id=37):(Total: 29.485us, non-child: 29.485us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 89.291ms, non-child: 89.291ms, % non-child: 100.00%) - CodegenTime: 2.205ms - CompileTime: 18.969ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 43.676ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 26.148ms AGGREGATION_NODE (id=35):(Total: 2.213ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 731.495ms - BufferPoolAllocationBytes: 5.92 GB (6352273408) - BufferPoolAllocations: 3.03K (3029) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6316621824) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6316621824) - BufferPoolWriteIoBytes: 5.88 GB (6316621824) - BufferPoolWriteIoOps: 3.01K (3012) - BufferPoolWriteIoWaitTime: 38s109ms - BuildTime: 1m4s - GetResultsTime: 0.000ns - HTResizeTime: 7.764ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m26s, non-child: 7s921ms, % non-child: 0.65%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.61 MB, 96.30 MB, 282.44 MB, 416.50 MB, 574.12 MB, 771.44 MB, 956.65 MB, 1.11 GB, 1.29 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3241800040) - ConvertRowBatchTime: 2s774ms - DeserializeRowBatchTimer: 22s114ms - FirstBatchArrivalWaitTime: 12m35s - PeakMemoryUsage: 0 - RowsReturned: 110.74M (110736080) - RowsReturnedRate: 90.30 K/sec - SendersBlockedTimer: 12s176ms - SendersBlockedTotalTimer(*): 1m2s Instance e84a99bb0c926c46:9c5989020000004e (host=vd1312.halxg.cloudera.com:22000):(Total: 30.597ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.13 MB, 37.11 MB, 37.89 MB, 34.09 MB, 35.63 MB, 36.73 MB, 34.34 MB, 38.50 MB, 34.68 MB, 34.36 MB, 34.14 MB, 34.11 MB, 34.12 MB, 34.13 MB, 34.11 MB, 34.12 MB, 34.10 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m14s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 30.550ms - ExecTreePrepareTime: 2.679ms DataStreamSender (dst_id=37):(Total: 32.738us, non-child: 32.738us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 83.472ms, non-child: 83.472ms, % non-child: 100.00%) - CodegenTime: 1.715ms - CompileTime: 20.617ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 37.748ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 24.724ms AGGREGATION_NODE (id=35):(Total: 2.678ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 667.949ms - BufferPoolAllocationBytes: 5.91 GB (6348079104) - BufferPoolAllocations: 3.03K (3027) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolWriteIoBytes: 5.88 GB (6312427520) - BufferPoolWriteIoOps: 3.01K (3010) - BufferPoolWriteIoWaitTime: 45s337ms - BuildTime: 1m13s - GetResultsTime: 0.000ns - HTResizeTime: 8.599ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m17s, non-child: 6s637ms, % non-child: 0.55%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7.06 MB, 97.44 MB, 284.43 MB, 417.38 MB, 575.81 MB, 772.87 MB, 958.17 MB, 1.11 GB, 1.30 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3241418012) - ConvertRowBatchTime: 2s747ms - DeserializeRowBatchTimer: 22s049ms - FirstBatchArrivalWaitTime: 12m35s - PeakMemoryUsage: 0 - RowsReturned: 110.72M (110721443) - RowsReturnedRate: 90.95 K/sec - SendersBlockedTimer: 10s507ms - SendersBlockedTotalTimer(*): 44s096ms Instance e84a99bb0c926c46:9c59890200000050 (host=vd1311.halxg.cloudera.com:22000):(Total: 28.042ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 35.57 MB, 36.86 MB, 37.13 MB, 34.13 MB, 35.75 MB, 36.61 MB, 35.64 MB, 36.68 MB, 34.39 MB, 35.71 MB, 34.37 MB, 34.12 MB, 34.13 MB, 34.13 MB, 34.11 MB, 34.19 MB, 34.25 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m12s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 28.004ms - ExecTreePrepareTime: 1.847ms DataStreamSender (dst_id=37):(Total: 29.816us, non-child: 29.816us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 83.821ms, non-child: 83.821ms, % non-child: 100.00%) - CodegenTime: 1.830ms - CompileTime: 20.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 40.377ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 22.367ms AGGREGATION_NODE (id=35):(Total: 1.846ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s309ms - BufferPoolAllocationBytes: 5.91 GB (6345981952) - BufferPoolAllocations: 3.03K (3026) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6310330368) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6310330368) - BufferPoolWriteIoBytes: 5.88 GB (6310330368) - BufferPoolWriteIoOps: 3.01K (3009) - BufferPoolWriteIoWaitTime: 48s052ms - BuildTime: 1m14s - GetResultsTime: 0.000ns - HTResizeTime: 7.123ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m15s, non-child: 6s571ms, % non-child: 0.54%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.57 MB, 96.22 MB, 282.26 MB, 416.39 MB, 573.78 MB, 771.14 MB, 956.29 MB, 1.11 GB, 1.29 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3241185909) - ConvertRowBatchTime: 2s635ms - DeserializeRowBatchTimer: 21s740ms - FirstBatchArrivalWaitTime: 12m35s - PeakMemoryUsage: 0 - RowsReturned: 110.71M (110714842) - RowsReturnedRate: 91.05 K/sec - SendersBlockedTimer: 9s884ms - SendersBlockedTotalTimer(*): 34s678ms Instance e84a99bb0c926c46:9c5989020000004a (host=vd1314.halxg.cloudera.com:22000):(Total: 21.457ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.10 MB, 34.22 MB, 35.88 MB, 34.49 MB, 39.19 MB, 34.62 MB, 36.18 MB, 34.18 MB, 34.39 MB, 34.97 MB, 34.38 MB, 34.09 MB, 34.11 MB, 34.11 MB, 34.15 MB, 34.11 MB, 34.12 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.35 MB (59083274) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 20m19s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 21.414ms - ExecTreePrepareTime: 1.935ms DataStreamSender (dst_id=37):(Total: 26.180us, non-child: 26.180us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 71.095ms, non-child: 71.095ms, % non-child: 100.00%) - CodegenTime: 2.205ms - CompileTime: 14.684ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 39.940ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 15.980ms AGGREGATION_NODE (id=35):(Total: 1.934ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 883.585ms - BufferPoolAllocationBytes: 5.91 GB (6348079104) - BufferPoolAllocations: 3.03K (3027) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 5.88 GB (6312427520) - BufferPoolWriteIoBytes: 5.88 GB (6312427520) - BufferPoolWriteIoOps: 3.01K (3010) - BufferPoolWriteIoWaitTime: 38s777ms - BuildTime: 1m8s - GetResultsTime: 0.000ns - HTResizeTime: 10.542ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 20m22s, non-child: 7s002ms, % non-child: 0.57%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.78 MB, 96.78 MB, 283.38 MB, 416.91 MB, 574.96 MB, 771.95 MB, 957.14 MB, 1.11 GB, 1.29 GB, 1.41 GB, 1.59 GB, 1.90 GB, 1.92 GB, 1.92 GB, 2.06 GB, 2.35 GB, 2.74 GB - BytesReceived: 3.02 GB (3240905847) - ConvertRowBatchTime: 2s756ms - DeserializeRowBatchTimer: 22s392ms - FirstBatchArrivalWaitTime: 12m35s - PeakMemoryUsage: 0 - RowsReturned: 110.70M (110704797) - RowsReturnedRate: 90.56 K/sec - SendersBlockedTimer: 5s282ms - SendersBlockedTotalTimer(*): 27s016ms Averaged Fragment F10:(Total: 12m58s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 138.60 GB, max: 139.04 GB, avg: 138.85 GB, stddev: 138.35 MB completion times: min:21m35s max:21m36s mean: 21m35s stddev:112.268ms execution rates: min:109.51 MB/sec max:109.86 MB/sec mean:109.71 MB/sec stddev:113.60 KB/sec num instances: 7 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.72 GB (5065820452) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 4.76 GB (5110799925) - PerHostPeakMemUsage: 8.26 GB (8866464769) - RowsProduced: 110.72M (110722180) - TotalNetworkReceiveTime: 5m41s - TotalNetworkSendTime: 3m13s - TotalStorageWaitTime: 2m52s - TotalThreadsInvoluntaryContextSwitches: 51.42K (51419) - TotalThreadsTotalWallClockTime: 25m32s - TotalThreadsSysTime: 34s398ms - TotalThreadsUserTime: 3m23s - TotalThreadsVoluntaryContextSwitches: 954.14K (954143) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m46s - OpenTime: 12m58s - ExecTreeOpenTime: 12m57s - PrepareTime: 63.011ms - ExecTreePrepareTime: 5.427ms DataStreamSender (dst_id=34):(Total: 25s173ms, non-child: 25s173ms, % non-child: 100.00%) - BytesSent: 3.02 GB (3241373829) - NetworkThroughput(*): 352.08 MB/sec - OverallThroughput: 122.70 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 110.72M (110721595) - SerializeBatchTime: 16s354ms - TransmitDataRPCTime: 8s779ms - UncompressedRowBatchSize: 6.29 GB (6755508652) CodeGen:(Total: 612.220ms, non-child: 612.220ms, % non-child: 100.00%) - CodegenTime: 3.937ms - CompileTime: 238.905ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 336.716ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 35.881ms AGGREGATION_NODE (id=17):(Total: 17m43s, non-child: 20s010ms, % non-child: 1.88%) - BufferPoolAllocTime: 2.335ms - BufferPoolAllocationBytes: 51.71 MB (54226358) - BufferPoolAllocations: 25 (25) - BufferPoolPeakReservation: 51.71 MB (54226358) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 51.71 MB (54226358) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 463.764ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 54.40 MB (57040905) - ReductionFactorEstimate: 18.57 - ReductionFactorThresholdToExpand: 1.49 - RowsPassedThrough: 110.72M (110722180) - RowsReturned: 110.72M (110722180) - RowsReturnedRate: 104.18 K/sec - StreamingTime: 19s641ms HASH_JOIN_NODE (id=16):(Total: 17m23s, non-child: 7s611ms, % non-child: 0.73%) - BufferPoolAllocTime: 1.912ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 6.824ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.92 MB (45000654) - ProbeRows: 111.09M (111088083) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s317ms - RowsReturned: 111.09M (111087498) - RowsReturnedRate: 106.55 K/sec Hash Join Builder (join_node_id=16): - BuildRowsPartitionTime: 3.182ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 474.935us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 14.628us, non-child: 14.628us, % non-child: 100.00%) - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 8.282us - DeserializeRowBatchTimer: 37.908us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 27.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 17m15s, non-child: 7m49s, % non-child: 45.30%) - BufferPoolAllocTime: 7s136ms - BufferPoolAllocationBytes: 70.70 GB (75913906468) - BufferPoolAllocations: 25.68K (25675) - BufferPoolPeakReservation: 4.63 GB (4975942509) - BufferPoolPeakUnpinnedBytes: 38.46 GB (41295319625) - BufferPoolPeakUsedReservation: 4.63 GB (4975942509) - BufferPoolReadIoBytes: 3.05 GB (3276949796) - BufferPoolReadIoOps: 1.56K (1562) - BufferPoolReadIoWaitTime: 3m18s - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 48.27 GB (51824520630) - BufferPoolWriteIoBytes: 47.31 GB (50799312896) - BufferPoolWriteIoOps: 24.22K (24223) - BufferPoolWriteIoWaitTime: 33s344ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m23s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.64 GB (4976829403) - ProbeRows: 409.36M (409358519) - ProbeRowsPartitioned: 157.20M (157202970) - ProbeTime: 57s164ms - RowsReturned: 111.09M (111087991) - RowsReturnedRate: 107.33 K/sec Hash Join Builder (join_node_id=15): - BuildRowsPartitionTime: 2m43s - BuildRowsPartitioned: 1.92B (1915750780) - HashBuckets: 1.39B (1390112182) - HashCollisions: 6.85M (6853755) - HashTablesBuildTime: 3m20s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 100 (100) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m1s - SpilledPartitions: 31 (31) EXCHANGE_NODE (id=32):(Total: 6m15s, non-child: 6m15s, % non-child: 100.00%) - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 32s112ms - DeserializeRowBatchTimer: 1m3s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 3.85 M/sec - SendersBlockedTimer: 32s788ms - SendersBlockedTotalTimer(*): 3m16s HDFS_SCAN_NODE (id=12):(Total: 3m11s, non-child: 3m11s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 4.46 GB (4791184935) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.46 GB (4791184935) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.46 GB (4791184935) - DecompressionTime: 11s239ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 143 (143) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.85 MB (59610032) - PerReadThreadRawHdfsThroughput: 36.18 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m10s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 409.36M (409358519) - RowsReturned: 409.36M (409358519) - RowsReturnedRate: 2.18 M/sec - ScanRangesComplete: 722 (722) - ScannerThreadsInvoluntaryContextSwitches: 6.86K (6859) - ScannerThreadsTotalWallClockTime: 3m51s - MaterializeTupleTime(*): 42s863ms - ScannerThreadsSysTime: 9s750ms - ScannerThreadsUserTime: 39s820ms - ScannerThreadsVoluntaryContextSwitches: 24.67K (24672) - TotalRawHdfsReadTime(*): 2m9s - TotalReadThroughput: 6.05 MB/sec Filter 2 (1.00 MB): - Files processed: 722 (722) - Files rejected: 578 (578) - Files total: 722 (722) - RowGroups processed: 399.83K (399833) - RowGroups rejected: 0 (0) - RowGroups total: 399.83K (399833) - Rows processed: 2.36M (2356955) - Rows rejected: 0 (0) - Rows total: 409.36M (409358519) - Splits processed: 143 (143) - Splits rejected: 0 (0) - Splits total: 143 (143) Fragment F10: Instance e84a99bb0c926c46:9c59890200000046 (host=vd1316.halxg.cloudera.com:22000):(Total: 13m35s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:88/16.50 GB 5:78/15.13 GB 3:87/14.48 GB 0:107/21.52 GB 4:102/19.89 GB 1:89/15.86 GB 6:99/18.83 GB 2:92/16.71 GB Filter 2 arrival: 597ms MemoryUsage(32s000ms): 1.62 GB, 4.32 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.60 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.62 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.57 GB (4903141376) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.63 GB (4971658898) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 100.51M (100513218) - TotalNetworkReceiveTime: 6m11s - TotalNetworkSendTime: 3m18s - TotalStorageWaitTime: 3m34s - TotalThreadsInvoluntaryContextSwitches: 49.26K (49264) - TotalThreadsTotalWallClockTime: 26m54s - TotalThreadsSysTime: 36s144ms - TotalThreadsUserTime: 3m23s - TotalThreadsVoluntaryContextSwitches: 968.76K (968762) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m12s - OpenTime: 13m35s - ExecTreeOpenTime: 13m34s - PrepareTime: 37.695ms - ExecTreePrepareTime: 2.928ms DataStreamSender (dst_id=34):(Total: 22s718ms, non-child: 22s718ms, % non-child: 100.00%) - BytesSent: 2.74 GB (2942480199) - NetworkThroughput(*): 350.28 MB/sec - OverallThroughput: 123.52 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 100.51M (100512194) - SerializeBatchTime: 14s671ms - TransmitDataRPCTime: 8s011ms - UncompressedRowBatchSize: 5.71 GB (6132614865) CodeGen:(Total: 579.685ms, non-child: 579.685ms, % non-child: 100.00%) - CodegenTime: 3.315ms - CompileTime: 224.115ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 334.679ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 20.339ms AGGREGATION_NODE (id=17):(Total: 17m47s, non-child: 17s075ms, % non-child: 1.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 498.013us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 422.396ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 39.86 MB (41799372) - ReductionFactorEstimate: 39.55 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 100.51M (100513218) - RowsReturned: 100.51M (100513218) - RowsReturnedRate: 94.19 K/sec - StreamingTime: 16s654ms HASH_JOIN_NODE (id=16):(Total: 17m30s, non-child: 7s321ms, % non-child: 0.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.700ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 2.805ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.93 MB (45020581) - ProbeRows: 100.59M (100593369) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s063ms - RowsReturned: 100.59M (100592345) - RowsReturnedRate: 95.80 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 119.399us - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 113.296us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 10.824us, non-child: 10.824us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 5.541us - DeserializeRowBatchTimer: 77.328us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 33.81 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 17m22s, non-child: 6m44s, % non-child: 38.80%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 6s058ms - BufferPoolAllocationBytes: 68.60 GB (73658269696) - BufferPoolAllocations: 25.34K (25344) - BufferPoolPeakReservation: 4.50 GB (4831838208) - BufferPoolPeakUnpinnedBytes: 38.56 GB (41406169088) - BufferPoolPeakUsedReservation: 4.50 GB (4831838208) - BufferPoolReadIoBytes: 2.77 GB (2971664384) - BufferPoolReadIoOps: 1.42K (1417) - BufferPoolReadIoWaitTime: 2m45s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 47.88 GB (51405389824) - BufferPoolWriteIoBytes: 47.06 GB (50528780288) - BufferPoolWriteIoOps: 24.09K (24094) - BufferPoolWriteIoWaitTime: 6s557ms - BuildRows: 1.44B (1440033112) - BuildTime: 1m54s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.50 GB (4832859904) - ProbeRows: 412.03M (412026788) - ProbeRowsPartitioned: 148.07M (148066738) - ProbeTime: 56s643ms - RowsReturned: 100.59M (100593027) - RowsReturnedRate: 96.47 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m11s - BuildRowsPartitioned: 1.89B (1890038639) - HashBuckets: 1.29B (1291845632) - HashCollisions: 5.83M (5829628) - HashTablesBuildTime: 2m51s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 96 (96) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 57s837ms - SpilledPartitions: 31 (31) EXCHANGE_NODE (id=32):(Total: 6m45s, non-child: 53s419ms, % non-child: 13.18%) BytesReceived(32s000ms): 1.28 GB, 3.80 GB, 4.98 GB, 5.64 GB, 6.26 GB, 7.57 GB, 8.62 GB, 9.54 GB, 9.93 GB, 10.36 GB, 11.84 GB, 13.33 GB, 14.91 GB, 16.64 GB, 17.92 GB, 18.72 GB, 19.07 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 32s130ms - DeserializeRowBatchTimer: 55s951ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 3.55 M/sec - SendersBlockedTimer: 7s735ms - SendersBlockedTotalTimer(*): 41s401ms HDFS_SCAN_NODE (id=12):(Total: 3m52s, non-child: 3m52s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:88/16.50 GB 5:78/15.13 GB 3:87/14.48 GB 0:107/21.52 GB 4:102/19.89 GB 1:89/15.86 GB 6:99/18.83 GB 2:92/16.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:79.04% 1:20.96% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:586 PARQUET/SNAPPY:936 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 6.98 MB, 139.92 MB, 418.11 MB, 668.75 MB, 984.61 MB, 1.28 GB, 1.55 GB, 1.80 GB, 2.07 GB, 2.35 GB, 2.65 GB, 2.86 GB, 3.15 GB, 3.43 GB, 3.72 GB, 4.00 GB, 4.20 GB, 4.38 GB - FooterProcessingTime: (Avg: 248.150ms ; Min: 1.615ms ; Max: 2s368ms ; Number of samples: 156) - AverageHdfsReadThreadConcurrency: 0.21 - AverageScannerThreadConcurrency: 0.35 - BytesRead: 4.50 GB (4827403243) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.50 GB (4827403243) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.50 GB (4827403243) - DecompressionTime: 11s599ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 156 (156) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.16 MB (58892233) - PerReadThreadRawHdfsThroughput: 27.07 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m51s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 412.03M (412026788) - RowsReturned: 412.03M (412026788) - RowsReturnedRate: 1.77 M/sec - ScanRangesComplete: 742 (742) - ScannerThreadsInvoluntaryContextSwitches: 6.72K (6721) - ScannerThreadsTotalWallClockTime: 4m35s - MaterializeTupleTime(*): 46s681ms - ScannerThreadsSysTime: 10s059ms - ScannerThreadsUserTime: 40s750ms - ScannerThreadsVoluntaryContextSwitches: 26.93K (26930) - TotalRawHdfsReadTime(*): 2m50s - TotalReadThroughput: 5.75 MB/sec Filter 2 (1.00 MB): - Files processed: 742 (742) - Files rejected: 586 (586) - Files total: 742 (742) - RowGroups processed: 402.45K (402449) - RowGroups rejected: 0 (0) - RowGroups total: 402.45K (402449) - Rows processed: 2.56M (2555904) - Rows rejected: 0 (0) - Rows total: 412.03M (412026788) - Splits processed: 156 (156) - Splits rejected: 0 (0) - Splits total: 156 (156) Instance e84a99bb0c926c46:9c59890200000047 (host=vd1312.halxg.cloudera.com:22000):(Total: 13m6s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:85/16.75 GB 5:88/17.43 GB 6:87/17.06 GB 3:93/17.64 GB 0:86/17.00 GB 7:92/18.97 GB 2:91/16.68 GB 1:84/17.06 GB Filter 2 arrival: 560ms MemoryUsage(32s000ms): 1.65 GB, 4.33 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.60 GB, 4.60 GB, 4.59 GB, 4.60 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 5.16 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 5.53 GB (5941231616) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 5.53 GB (5942876815) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 113.27M (113267703) - TotalNetworkReceiveTime: 6m2s - TotalNetworkSendTime: 3m22s - TotalStorageWaitTime: 3m6s - TotalThreadsInvoluntaryContextSwitches: 48.49K (48492) - TotalThreadsTotalWallClockTime: 25m53s - TotalThreadsSysTime: 35s328ms - TotalThreadsUserTime: 3m20s - TotalThreadsVoluntaryContextSwitches: 949.88K (949879) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m22s - OpenTime: 13m5s - ExecTreeOpenTime: 13m5s - PrepareTime: 38.051ms - ExecTreePrepareTime: 2.727ms DataStreamSender (dst_id=34):(Total: 25s648ms, non-child: 25s648ms, % non-child: 100.00%) - BytesSent: 3.09 GB (3315334693) - NetworkThroughput(*): 345.89 MB/sec - OverallThroughput: 123.27 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 113.27M (113267703) - SerializeBatchTime: 16s467ms - TransmitDataRPCTime: 9s141ms - UncompressedRowBatchSize: 6.44 GB (6910856238) CodeGen:(Total: 543.463ms, non-child: 543.463ms, % non-child: 100.00%) - CodegenTime: 2.987ms - CompileTime: 236.127ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 288.410ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 18.317ms AGGREGATION_NODE (id=17):(Total: 17m28s, non-child: 20s059ms, % non-child: 1.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 2.113ms - BufferPoolAllocationBytes: 62.00 MB (65011712) - BufferPoolAllocations: 31 (31) - BufferPoolPeakReservation: 62.00 MB (65011712) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 62.00 MB (65011712) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 418.624ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 62.05 MB (65064064) - ReductionFactorEstimate: 1.67 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 113.27M (113267703) - RowsReturned: 113.27M (113267703) - RowsReturnedRate: 108.07 K/sec - StreamingTime: 19s857ms HASH_JOIN_NODE (id=16):(Total: 17m8s, non-child: 7s676ms, % non-child: 0.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.594ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 3.602ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.92 MB (45007687) - ProbeRows: 113.93M (113931328) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s321ms - RowsReturned: 113.93M (113931328) - RowsReturnedRate: 110.83 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 127.899us - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 680.131us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 10.696us, non-child: 10.696us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 5.124us - DeserializeRowBatchTimer: 43.884us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 34.22 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 17m, non-child: 6m59s, % non-child: 41.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s532ms - BufferPoolAllocationBytes: 69.09 GB (74182557696) - BufferPoolAllocations: 25.21K (25213) - BufferPoolPeakReservation: 5.44 GB (5840568320) - BufferPoolPeakUnpinnedBytes: 38.29 GB (41114664960) - BufferPoolPeakUsedReservation: 5.44 GB (5840568320) - BufferPoolReadIoBytes: 2.88 GB (3095396352) - BufferPoolReadIoOps: 1.48K (1476) - BufferPoolReadIoWaitTime: 3m3s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 47.23 GB (50717523968) - BufferPoolWriteIoBytes: 46.58 GB (50012880896) - BufferPoolWriteIoOps: 23.85K (23848) - BufferPoolWriteIoWaitTime: 16s032ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m2s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 5.44 GB (5840646400) - ProbeRows: 405.05M (405049258) - ProbeRowsPartitioned: 145.57M (145568629) - ProbeTime: 58s496ms - RowsReturned: 113.93M (113931328) - RowsReturnedRate: 111.66 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m18s - BuildRowsPartitioned: 1.89B (1890038639) - HashBuckets: 1.34B (1342177280) - HashCollisions: 7.24M (7241763) - HashTablesBuildTime: 3m22s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 96 (96) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 56s343ms - SpilledPartitions: 28 (28) EXCHANGE_NODE (id=32):(Total: 6m36s, non-child: 57s260ms, % non-child: 14.43%) BytesReceived(32s000ms): 1.31 GB, 3.82 GB, 4.98 GB, 5.64 GB, 6.28 GB, 7.58 GB, 8.63 GB, 9.54 GB, 9.93 GB, 10.37 GB, 11.86 GB, 13.34 GB, 14.92 GB, 16.66 GB, 17.92 GB, 18.72 GB, 19.07 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 32s688ms - DeserializeRowBatchTimer: 59s429ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 3.63 M/sec - SendersBlockedTimer: 19s730ms - SendersBlockedTotalTimer(*): 1m48s HDFS_SCAN_NODE (id=12):(Total: 3m24s, non-child: 3m24s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:85/16.75 GB 5:88/17.43 GB 6:87/17.06 GB 3:93/17.64 GB 0:86/17.00 GB 7:92/18.97 GB 2:91/16.68 GB 1:84/17.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 131 out of 131 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:82.87% 1:17.13% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:575 PARQUET/SNAPPY:786 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.84 MB, 176.31 MB, 498.15 MB, 839.83 MB, 1.16 GB, 1.38 GB, 1.71 GB, 2.00 GB, 2.29 GB, 2.60 GB, 2.88 GB, 3.17 GB, 3.48 GB, 3.68 GB, 3.91 GB, 4.23 GB - FooterProcessingTime: (Avg: 220.555ms ; Min: 1.666ms ; Max: 2s474ms ; Number of samples: 131) - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 0.32 - BytesRead: 4.41 GB (4734022007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.41 GB (4734022007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.41 GB (4734022007) - DecompressionTime: 12s890ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 131 (131) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.97 MB (59740698) - PerReadThreadRawHdfsThroughput: 33.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m23s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 405.05M (405049258) - RowsReturned: 405.05M (405049258) - RowsReturnedRate: 1.98 M/sec - ScanRangesComplete: 706 (706) - ScannerThreadsInvoluntaryContextSwitches: 6.77K (6770) - ScannerThreadsTotalWallClockTime: 4m4s - MaterializeTupleTime(*): 41s773ms - ScannerThreadsSysTime: 9s673ms - ScannerThreadsUserTime: 38s840ms - ScannerThreadsVoluntaryContextSwitches: 26.73K (26728) - TotalRawHdfsReadTime(*): 2m14s - TotalReadThroughput: 5.88 MB/sec Filter 2 (1.00 MB): - Files processed: 706 (706) - Files rejected: 575 (575) - Files total: 706 (706) - RowGroups processed: 395.62K (395617) - RowGroups rejected: 0 (0) - RowGroups total: 395.62K (395617) - Rows processed: 2.15M (2146304) - Rows rejected: 0 (0) - Rows total: 405.05M (405049258) - Splits processed: 131 (131) - Splits rejected: 0 (0) - Splits total: 131 (131) Instance e84a99bb0c926c46:9c59890200000049 (host=vd1311.halxg.cloudera.com:22000):(Total: 13m3s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:92/18.45 GB 5:84/15.18 GB 3:80/14.56 GB 4:95/19.16 GB 1:83/17.29 GB 2:88/17.78 GB 7:96/19.17 GB 6:86/17.45 GB Filter 2 arrival: 583ms MemoryUsage(32s000ms): 1.61 GB, 4.32 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.60 GB, 4.59 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.59 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.59 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.61 GB (4953473024) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.63 GB (4971442303) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 115.94M (115938108) - TotalNetworkReceiveTime: 5m56s - TotalNetworkSendTime: 3m22s - TotalStorageWaitTime: 3m9s - TotalThreadsInvoluntaryContextSwitches: 46.60K (46600) - TotalThreadsTotalWallClockTime: 25m49s - TotalThreadsSysTime: 31s738ms - TotalThreadsUserTime: 3m17s - TotalThreadsVoluntaryContextSwitches: 971.84K (971837) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m28s - OpenTime: 13m3s - ExecTreeOpenTime: 13m2s - PrepareTime: 33.473ms - ExecTreePrepareTime: 2.633ms DataStreamSender (dst_id=34):(Total: 26s109ms, non-child: 26s109ms, % non-child: 100.00%) - BytesSent: 3.16 GB (3394302389) - NetworkThroughput(*): 349.47 MB/sec - OverallThroughput: 123.98 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 115.94M (115938108) - SerializeBatchTime: 16s804ms - TransmitDataRPCTime: 9s262ms - UncompressedRowBatchSize: 6.59 GB (7073778582) CodeGen:(Total: 555.819ms, non-child: 555.819ms, % non-child: 100.00%) - CodegenTime: 2.971ms - CompileTime: 242.635ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 295.483ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 17.272ms AGGREGATION_NODE (id=17):(Total: 17m30s, non-child: 20s641ms, % non-child: 1.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 2.334ms - BufferPoolAllocationBytes: 82.00 MB (85983232) - BufferPoolAllocations: 41 (41) - BufferPoolPeakReservation: 82.00 MB (85983232) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 82.00 MB (85983232) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 429.640ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 82.05 MB (86035584) - ReductionFactorEstimate: 1.37 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 115.94M (115938108) - RowsReturned: 115.94M (115938108) - RowsReturnedRate: 110.33 K/sec - StreamingTime: 20s218ms HASH_JOIN_NODE (id=16):(Total: 17m10s, non-child: 7s356ms, % non-child: 0.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.244ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 12.444ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.90 MB (44980307) - ProbeRows: 116.73M (116725260) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s349ms - RowsReturned: 116.73M (116725260) - RowsReturnedRate: 113.30 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.225ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.372ms - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 13.076us, non-child: 13.076us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 6.936us - DeserializeRowBatchTimer: 31.306us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 27.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 17m2s, non-child: 7m4s, % non-child: 41.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s184ms - BufferPoolAllocationBytes: 70.27 GB (75447140352) - BufferPoolAllocations: 25.82K (25816) - BufferPoolPeakReservation: 4.50 GB (4831838208) - BufferPoolPeakUnpinnedBytes: 38.68 GB (41536192512) - BufferPoolPeakUsedReservation: 4.50 GB (4831838208) - BufferPoolReadIoBytes: 3.46 GB (3711959040) - BufferPoolReadIoOps: 1.77K (1770) - BufferPoolReadIoWaitTime: 3m9s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 48.11 GB (51654950912) - BufferPoolWriteIoBytes: 47.08 GB (50556043264) - BufferPoolWriteIoOps: 24.11K (24107) - BufferPoolWriteIoWaitTime: 24s627ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m8s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.50 GB (4832859904) - ProbeRows: 414.98M (414978745) - ProbeRowsPartitioned: 154.01M (154008905) - ProbeTime: 51s546ms - RowsReturned: 116.73M (116725260) - RowsReturnedRate: 114.12 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m22s - BuildRowsPartitioned: 1.89B (1890038639) - HashBuckets: 1.34B (1342177280) - HashCollisions: 7.31M (7305141) - HashTablesBuildTime: 2m32s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 96 (96) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 50s616ms - SpilledPartitions: 31 (31) EXCHANGE_NODE (id=32):(Total: 6m30s, non-child: 56s171ms, % non-child: 14.39%) BytesReceived(32s000ms): 1.28 GB, 3.80 GB, 4.98 GB, 5.64 GB, 6.26 GB, 7.57 GB, 8.62 GB, 9.54 GB, 9.93 GB, 10.36 GB, 11.84 GB, 13.33 GB, 14.91 GB, 16.64 GB, 17.92 GB, 18.71 GB, 19.07 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s915ms - DeserializeRowBatchTimer: 59s475ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 3.69 M/sec - SendersBlockedTimer: 22s641ms - SendersBlockedTotalTimer(*): 2m4s HDFS_SCAN_NODE (id=12):(Total: 3m28s, non-child: 3m28s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:92/18.45 GB 5:84/15.18 GB 3:80/14.56 GB 4:95/19.16 GB 1:83/17.29 GB 2:88/17.78 GB 7:96/19.17 GB 6:86/17.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:82.25% 1:17.75% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:563 PARQUET/SNAPPY:846 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.74 MB, 244.17 MB, 650.68 MB, 1.05 GB, 1.29 GB, 1.58 GB, 1.84 GB, 2.14 GB, 2.43 GB, 2.72 GB, 3.08 GB, 3.40 GB, 3.65 GB, 3.94 GB, 4.19 GB - FooterProcessingTime: (Avg: 239.839ms ; Min: 1.618ms ; Max: 2s985ms ; Number of samples: 141) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 0.32 - BytesRead: 4.52 GB (4852300925) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.52 GB (4852300925) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.52 GB (4852300925) - DecompressionTime: 10s272ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 141 (141) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 55.91 MB (58625557) - PerReadThreadRawHdfsThroughput: 34.56 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m27s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 414.98M (414978745) - RowsReturned: 414.98M (414978745) - RowsReturnedRate: 1.99 M/sec - ScanRangesComplete: 704 (704) - ScannerThreadsInvoluntaryContextSwitches: 5.87K (5871) - ScannerThreadsTotalWallClockTime: 4m2s - MaterializeTupleTime(*): 36s907ms - ScannerThreadsSysTime: 9s272ms - ScannerThreadsUserTime: 38s466ms - ScannerThreadsVoluntaryContextSwitches: 22.39K (22390) - TotalRawHdfsReadTime(*): 2m13s - TotalReadThroughput: 6.03 MB/sec Filter 2 (1.00 MB): - Files processed: 704 (704) - Files rejected: 563 (563) - Files total: 704 (704) - RowGroups processed: 405.32K (405323) - RowGroups rejected: 0 (0) - RowGroups total: 405.32K (405323) - Rows processed: 2.31M (2310144) - Rows rejected: 0 (0) - Rows total: 414.98M (414978745) - Splits processed: 141 (141) - Splits rejected: 0 (0) - Splits total: 141 (141) Instance e84a99bb0c926c46:9c59890200000048 (host=vd1309.halxg.cloudera.com:22000):(Total: 12m59s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:99/19.62 GB 6:75/14.33 GB 3:95/16.68 GB 2:89/17.92 GB 7:94/18.83 GB 5:97/18.14 GB 0:81/14.92 GB 4:98/18.36 GB Filter 2 arrival: 661ms MemoryUsage(32s000ms): 1.61 GB, 4.32 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.59 GB, 4.60 GB, 4.59 GB, 4.60 GB, 4.59 GB, 4.60 GB, 4.59 GB, 4.58 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.57 GB (4903141376) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.63 GB (4971852093) - PerHostPeakMemUsage: 8.25 GB (8855272648) - RowsProduced: 115.12M (115123105) - TotalNetworkReceiveTime: 5m21s - TotalNetworkSendTime: 1m45s - TotalStorageWaitTime: 2m37s - TotalThreadsInvoluntaryContextSwitches: 71.22K (71223) - TotalThreadsTotalWallClockTime: 25m29s - TotalThreadsSysTime: 35s102ms - TotalThreadsUserTime: 3m22s - TotalThreadsVoluntaryContextSwitches: 947.80K (947797) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 6m3s - OpenTime: 12m59s - ExecTreeOpenTime: 12m59s - PrepareTime: 58.817ms - ExecTreePrepareTime: 6.285ms DataStreamSender (dst_id=34):(Total: 26s098ms, non-child: 26s098ms, % non-child: 100.00%) - BytesSent: 3.14 GB (3370372423) - NetworkThroughput(*): 346.46 MB/sec - OverallThroughput: 123.16 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 115.12M (115123105) - SerializeBatchTime: 16s776ms - TransmitDataRPCTime: 9s277ms - UncompressedRowBatchSize: 6.54 GB (7024047342) CodeGen:(Total: 635.235ms, non-child: 635.235ms, % non-child: 100.00%) - CodegenTime: 3.260ms - CompileTime: 238.383ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 367.007ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 29.355ms AGGREGATION_NODE (id=17):(Total: 19m2s, non-child: 21s828ms, % non-child: 1.91%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 1.076ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 483.225ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 36.19 MB (37951992) - ReductionFactorEstimate: 15.40 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 115.12M (115123105) - RowsReturned: 115.12M (115123105) - RowsReturnedRate: 100.80 K/sec - StreamingTime: 21s392ms HASH_JOIN_NODE (id=16):(Total: 18m40s, non-child: 7s995ms, % non-child: 0.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 961.456us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 3.137ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.96 MB (45047205) - ProbeRows: 115.20M (115203341) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s353ms - RowsReturned: 115.20M (115203341) - RowsReturnedRate: 102.84 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 182.524us - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 217.703us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 16.504us, non-child: 16.504us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.465us - DeserializeRowBatchTimer: 15.298us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 22.18 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 18m32s, non-child: 9m35s, % non-child: 51.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 21s780ms - BufferPoolAllocationBytes: 69.46 GB (74587308032) - BufferPoolAllocations: 25.41K (25406) - BufferPoolPeakReservation: 4.50 GB (4831838208) - BufferPoolPeakUnpinnedBytes: 38.47 GB (41305505792) - BufferPoolPeakUsedReservation: 4.50 GB (4831838208) - BufferPoolReadIoBytes: 2.87 GB (3082813440) - BufferPoolReadIoOps: 1.47K (1470) - BufferPoolReadIoWaitTime: 4m20s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 47.89 GB (51424264192) - BufferPoolWriteIoBytes: 46.84 GB (50291802112) - BufferPoolWriteIoOps: 23.98K (23981) - BufferPoolWriteIoWaitTime: 35s932ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m44s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.50 GB (4832859904) - ProbeRows: 409.59M (409586881) - ProbeRowsPartitioned: 152.00M (152001266) - ProbeTime: 1m7s - RowsReturned: 115.20M (115203341) - RowsReturnedRate: 103.58 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 3m4s - BuildRowsPartitioned: 1.89B (1890038639) - HashBuckets: 1.34B (1342177280) - HashCollisions: 7.27M (7271476) - HashTablesBuildTime: 4m51s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 96 (96) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m15s - SpilledPartitions: 31 (31) EXCHANGE_NODE (id=32):(Total: 5m55s, non-child: 56s961ms, % non-child: 16.04%) BytesReceived(32s000ms): 1.32 GB, 3.83 GB, 4.99 GB, 5.65 GB, 6.28 GB, 7.59 GB, 8.63 GB, 9.55 GB, 9.93 GB, 10.37 GB, 11.86 GB, 13.35 GB, 14.93 GB, 16.67 GB, 17.93 GB, 18.72 GB, 19.08 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s577ms - DeserializeRowBatchTimer: 1m33s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 4.05 M/sec - SendersBlockedTimer: 36s028ms - SendersBlockedTotalTimer(*): 3m33s HDFS_SCAN_NODE (id=12):(Total: 3m1s, non-child: 3m1s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:99/19.62 GB 6:75/14.33 GB 3:95/16.68 GB 2:89/17.92 GB 7:94/18.83 GB 5:97/18.14 GB 0:81/14.92 GB 4:98/18.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 147 out of 147 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:83.79% 1:16.21% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:581 PARQUET/SNAPPY:882 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 13.99 MB, 233.81 MB, 654.17 MB, 1.02 GB, 1.39 GB, 1.60 GB, 1.89 GB, 2.30 GB, 2.57 GB, 2.83 GB, 3.05 GB, 3.36 GB, 3.72 GB, 4.10 GB - FooterProcessingTime: (Avg: 204.446ms ; Min: 1.808ms ; Max: 4s995ms ; Number of samples: 147) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 0.30 - BytesRead: 4.47 GB (4799560728) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.47 GB (4799560728) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.47 GB (4799560728) - DecompressionTime: 11s219ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 147 (147) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.53 MB (59278960) - PerReadThreadRawHdfsThroughput: 39.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m59s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 409.59M (409586881) - RowsReturned: 409.59M (409586881) - RowsReturnedRate: 2.26 M/sec - ScanRangesComplete: 728 (728) - ScannerThreadsInvoluntaryContextSwitches: 8.84K (8842) - ScannerThreadsTotalWallClockTime: 3m46s - MaterializeTupleTime(*): 49s562ms - ScannerThreadsSysTime: 10s188ms - ScannerThreadsUserTime: 40s611ms - ScannerThreadsVoluntaryContextSwitches: 25.46K (25457) - TotalRawHdfsReadTime(*): 1m56s - TotalReadThroughput: 6.10 MB/sec Filter 2 (1.00 MB): - Files processed: 728 (728) - Files rejected: 581 (581) - Files total: 728 (728) - RowGroups processed: 400.06K (400055) - RowGroups rejected: 0 (0) - RowGroups total: 400.06K (400055) - Rows processed: 2.41M (2408448) - Rows rejected: 0 (0) - Rows total: 409.59M (409586881) - Splits processed: 147 (147) - Splits rejected: 0 (0) - Splits total: 147 (147) Instance e84a99bb0c926c46:9c59890200000045 (host=vd1310.halxg.cloudera.com:22000):(Total: 12m46s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:90/17.76 GB 6:87/17.02 GB 4:95/17.75 GB 5:80/15.17 GB 2:88/16.63 GB 0:92/17.62 GB 1:102/19.84 GB 7:91/17.03 GB Filter 2 arrival: 538ms MemoryUsage(32s000ms): 1.61 GB, 4.32 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.59 GB, 4.60 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.61 GB (4953473024) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.63 GB (4971548005) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 94.36M (94363020) - TotalNetworkReceiveTime: 5m49s - TotalNetworkSendTime: 3m39s - TotalStorageWaitTime: 2m53s - TotalThreadsInvoluntaryContextSwitches: 45.67K (45669) - TotalThreadsTotalWallClockTime: 25m21s - TotalThreadsSysTime: 33s820ms - TotalThreadsUserTime: 3m26s - TotalThreadsVoluntaryContextSwitches: 947.84K (947839) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m38s - OpenTime: 12m46s - ExecTreeOpenTime: 12m46s - PrepareTime: 54.452ms - ExecTreePrepareTime: 8.103ms DataStreamSender (dst_id=34):(Total: 22s345ms, non-child: 22s345ms, % non-child: 100.00%) - BytesSent: 2.57 GB (2762480892) - NetworkThroughput(*): 350.31 MB/sec - OverallThroughput: 117.90 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 94.36M (94361996) - SerializeBatchTime: 14s789ms - TransmitDataRPCTime: 7s520ms - UncompressedRowBatchSize: 5.36 GB (5757354135) CodeGen:(Total: 515.311ms, non-child: 515.311ms, % non-child: 100.00%) - CodegenTime: 2.961ms - CompileTime: 210.515ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 277.229ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 27.063ms AGGREGATION_NODE (id=17):(Total: 17m24s, non-child: 18s128ms, % non-child: 1.74%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 6.189ms - BufferPoolAllocationBytes: 82.00 MB (85983232) - BufferPoolAllocations: 41 (41) - BufferPoolPeakReservation: 82.00 MB (85983232) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 82.00 MB (85983232) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 452.609ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 82.05 MB (86035584) - ReductionFactorEstimate: 1.43 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 94.36M (94363020) - RowsReturned: 94.36M (94363020) - RowsReturnedRate: 90.32 K/sec - StreamingTime: 17s764ms HASH_JOIN_NODE (id=16):(Total: 17m6s, non-child: 7s298ms, % non-child: 0.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 249.680us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 1.722ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.96 MB (45046601) - ProbeRows: 95.15M (95149780) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s167ms - RowsReturned: 95.15M (95148756) - RowsReturnedRate: 92.68 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 117.769us - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 129.555us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 14.819us, non-child: 14.819us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 7.846us - DeserializeRowBatchTimer: 47.336us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 24.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 16m59s, non-child: 7m23s, % non-child: 43.49%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 5s156ms - BufferPoolAllocationBytes: 68.64 GB (73698115584) - BufferPoolAllocations: 25.36K (25363) - BufferPoolPeakReservation: 4.50 GB (4831838208) - BufferPoolPeakUnpinnedBytes: 38.21 GB (41026584576) - BufferPoolPeakUsedReservation: 4.50 GB (4831838208) - BufferPoolReadIoBytes: 3.22 GB (3454009344) - BufferPoolReadIoOps: 1.65K (1647) - BufferPoolReadIoWaitTime: 3m6s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 47.46 GB (50962890752) - BufferPoolWriteIoBytes: 45.97 GB (49362763776) - BufferPoolWriteIoOps: 23.54K (23538) - BufferPoolWriteIoWaitTime: 25s938ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m15s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.50 GB (4832859904) - ProbeRows: 402.70M (402701541) - ProbeRowsPartitioned: 144.70M (144698672) - ProbeTime: 52s361ms - RowsReturned: 95.15M (95149680) - RowsReturnedRate: 93.35 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m34s - BuildRowsPartitioned: 1.89B (1890038639) - HashBuckets: 1.29B (1291845632) - HashCollisions: 5.78M (5780175) - HashTablesBuildTime: 2m31s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 96 (96) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 55s662ms - SpilledPartitions: 31 (31) EXCHANGE_NODE (id=32):(Total: 6m23s, non-child: 54s084ms, % non-child: 14.08%) BytesReceived(32s000ms): 1.28 GB, 3.80 GB, 4.98 GB, 5.64 GB, 6.26 GB, 7.57 GB, 8.62 GB, 9.54 GB, 9.93 GB, 10.36 GB, 11.84 GB, 13.32 GB, 14.91 GB, 16.64 GB, 17.92 GB, 18.71 GB, 19.07 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 32s485ms - DeserializeRowBatchTimer: 57s060ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 3.75 M/sec - SendersBlockedTimer: 23s227ms - SendersBlockedTotalTimer(*): 2m4s HDFS_SCAN_NODE (id=12):(Total: 3m11s, non-child: 3m11s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:90/17.76 GB 6:87/17.02 GB 4:95/17.75 GB 5:80/15.17 GB 2:88/16.63 GB 0:92/17.62 GB 1:102/19.84 GB 7:91/17.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 143 out of 143 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:82.04% 1:17.96% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:582 PARQUET/SNAPPY:858 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20.48 MB, 312.64 MB, 847.09 MB, 1.23 GB, 1.54 GB, 1.82 GB, 2.09 GB, 2.36 GB, 2.66 GB, 2.92 GB, 3.19 GB, 3.39 GB, 3.66 GB, 3.94 GB, 4.20 GB - FooterProcessingTime: (Avg: 216.053ms ; Min: 1.593ms ; Max: 1s995ms ; Number of samples: 143) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 0.31 - BytesRead: 4.39 GB (4714235576) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.39 GB (4714235576) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.39 GB (4714235576) - DecompressionTime: 10s857ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 143 (143) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.12 MB (58841930) - PerReadThreadRawHdfsThroughput: 33.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m10s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 402.70M (402701541) - RowsReturned: 402.70M (402701541) - RowsReturnedRate: 2.10 M/sec - ScanRangesComplete: 725 (725) - ScannerThreadsInvoluntaryContextSwitches: 6.14K (6138) - ScannerThreadsTotalWallClockTime: 3m50s - MaterializeTupleTime(*): 41s381ms - ScannerThreadsSysTime: 9s525ms - ScannerThreadsUserTime: 40s209ms - ScannerThreadsVoluntaryContextSwitches: 22.67K (22673) - TotalRawHdfsReadTime(*): 2m13s - TotalReadThroughput: 5.95 MB/sec Filter 2 (1.00 MB): - Files processed: 725 (725) - Files rejected: 582 (582) - Files total: 725 (725) - RowGroups processed: 393.33K (393331) - RowGroups rejected: 0 (0) - RowGroups total: 393.33K (393331) - Rows processed: 2.34M (2342912) - Rows rejected: 0 (0) - Rows total: 402.70M (402701541) - Splits processed: 143 (143) - Splits rejected: 0 (0) - Splits total: 143 (143) Instance e84a99bb0c926c46:9c59890200000044 (host=vd1313.halxg.cloudera.com:22000):(Total: 12m39s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:78/16.03 GB 6:86/17.57 GB 3:97/19.20 GB 4:89/19.14 GB 7:79/15.00 GB 1:95/18.93 GB 5:81/15.75 GB 0:91/17.36 GB Filter 2 arrival: 923ms MemoryUsage(32s000ms): 1.65 GB, 4.33 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.59 GB, 4.60 GB, 4.60 GB, 4.59 GB, 4.59 GB, 4.59 GB, 4.60 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.57 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.57 GB (4903141376) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.63 GB (4971716477) - PerHostPeakMemUsage: 8.25 GB (8862122973) - RowsProduced: 120.52M (120516198) - TotalNetworkReceiveTime: 5m28s - TotalNetworkSendTime: 3m28s - TotalStorageWaitTime: 2m31s - TotalThreadsInvoluntaryContextSwitches: 48.66K (48659) - TotalThreadsTotalWallClockTime: 24m51s - TotalThreadsSysTime: 34s073ms - TotalThreadsUserTime: 3m28s - TotalThreadsVoluntaryContextSwitches: 952.70K (952699) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m52s - OpenTime: 12m39s - ExecTreeOpenTime: 12m38s - PrepareTime: 167.751ms - ExecTreePrepareTime: 12.877ms DataStreamSender (dst_id=34):(Total: 27s109ms, non-child: 27s109ms, % non-child: 100.00%) - BytesSent: 3.29 GB (3528163908) - NetworkThroughput(*): 358.25 MB/sec - OverallThroughput: 124.12 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 120.52M (120515174) - SerializeBatchTime: 17s674ms - TransmitDataRPCTime: 9s392ms - UncompressedRowBatchSize: 6.85 GB (7353044010) CodeGen:(Total: 853.784ms, non-child: 853.784ms, % non-child: 100.00%) - CodegenTime: 7.517ms - CompileTime: 262.727ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 476.932ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 112.391ms AGGREGATION_NODE (id=17):(Total: 17m30s, non-child: 21s437ms, % non-child: 2.04%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 4.124ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 521.178ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 41.45 MB (43463190) - ReductionFactorEstimate: 31.71 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 120.52M (120516198) - RowsReturned: 120.52M (120516198) - RowsReturnedRate: 114.71 K/sec - StreamingTime: 21s070ms HASH_JOIN_NODE (id=16):(Total: 17m9s, non-child: 8s140ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 6.432ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 21.375ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.94 MB (45028758) - ProbeRows: 120.60M (120602533) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s479ms - RowsReturned: 120.60M (120601509) - RowsReturnedRate: 117.19 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 12.388ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 709.410us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 26.120us, non-child: 26.120us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 17.266us - DeserializeRowBatchTimer: 34.920us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 14.01 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 17m, non-child: 8m7s, % non-child: 47.71%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s773ms - BufferPoolAllocationBytes: 74.56 GB (80062971904) - BufferPoolAllocations: 26.37K (26366) - BufferPoolPeakReservation: 4.50 GB (4831838208) - BufferPoolPeakUnpinnedBytes: 38.62 GB (41473277952) - BufferPoolPeakUsedReservation: 4.50 GB (4831838208) - BufferPoolReadIoBytes: 3.08 GB (3311403008) - BufferPoolReadIoOps: 1.58K (1579) - BufferPoolReadIoWaitTime: 3m14s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 49.78 GB (53454307328) - BufferPoolWriteIoBytes: 48.76 GB (52351205376) - BufferPoolWriteIoOps: 24.96K (24963) - BufferPoolWriteIoWaitTime: 50s750ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m35s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.50 GB (4832859904) - ProbeRows: 413.93M (413925168) - ProbeRowsPartitioned: 179.48M (179475939) - ProbeTime: 55s256ms - RowsReturned: 120.60M (120602393) - RowsReturnedRate: 118.12 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m59s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.56B (1560281088) - HashCollisions: 7.29M (7294270) - HashTablesBuildTime: 3m38s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m8s - SpilledPartitions: 34 (34) EXCHANGE_NODE (id=32):(Total: 6m2s, non-child: 54s904ms, % non-child: 15.13%) BytesReceived(32s000ms): 1.31 GB, 3.82 GB, 4.98 GB, 5.64 GB, 6.28 GB, 7.58 GB, 8.63 GB, 9.54 GB, 9.93 GB, 10.37 GB, 11.86 GB, 13.34 GB, 14.92 GB, 16.66 GB, 17.92 GB, 18.72 GB, 19.07 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 32s613ms - DeserializeRowBatchTimer: 57s425ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 3.97 M/sec - SendersBlockedTimer: 42s683ms - SendersBlockedTotalTimer(*): 4m28s HDFS_SCAN_NODE (id=12):(Total: 2m51s, non-child: 2m51s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:78/16.03 GB 6:86/17.57 GB 3:97/19.20 GB 4:89/19.14 GB 7:79/15.00 GB 1:95/18.93 GB 5:81/15.75 GB 0:91/17.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 140 out of 140 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:84.85% 1:15.15% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:556 PARQUET/SNAPPY:840 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 23.20 MB, 308.87 MB, 775.34 MB, 1.10 GB, 1.42 GB, 1.71 GB, 2.07 GB, 2.41 GB, 2.76 GB, 3.00 GB, 3.38 GB, 3.70 GB, 3.99 GB - FooterProcessingTime: (Avg: 183.521ms ; Min: 1.536ms ; Max: 2s069ms ; Number of samples: 140) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 0.29 - BytesRead: 4.51 GB (4838169414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.51 GB (4838169414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.51 GB (4838169414) - DecompressionTime: 11s208ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 140 (140) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.24 MB (58976554) - PerReadThreadRawHdfsThroughput: 41.08 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m49s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 413.93M (413925168) - RowsReturned: 413.93M (413925168) - RowsReturnedRate: 2.42 M/sec - ScanRangesComplete: 696 (696) - ScannerThreadsInvoluntaryContextSwitches: 6.71K (6711) - ScannerThreadsTotalWallClockTime: 3m29s - MaterializeTupleTime(*): 42s701ms - ScannerThreadsSysTime: 9s964ms - ScannerThreadsUserTime: 40s746ms - ScannerThreadsVoluntaryContextSwitches: 25.51K (25510) - TotalRawHdfsReadTime(*): 1m52s - TotalReadThroughput: 6.29 MB/sec Filter 2 (1.00 MB): - Files processed: 696 (696) - Files rejected: 556 (556) - Files total: 696 (696) - RowGroups processed: 404.29K (404291) - RowGroups rejected: 0 (0) - RowGroups total: 404.29K (404291) - Rows processed: 2.29M (2293760) - Rows rejected: 0 (0) - Rows total: 413.93M (413925168) - Splits processed: 140 (140) - Splits rejected: 0 (0) - Splits total: 140 (140) Instance e84a99bb0c926c46:9c59890200000043 (host=vd1314.halxg.cloudera.com:22000):(Total: 12m35s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:93/16.47 GB 2:86/17.03 GB 4:82/14.27 GB 5:90/17.79 GB 3:96/18.19 GB 1:90/17.02 GB 6:114/19.95 GB 0:103/18.08 GB Filter 2 arrival: 624ms MemoryUsage(32s000ms): 1.63 GB, 4.32 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.58 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.58 GB, 4.60 GB, 4.60 GB, 4.59 GB, 4.59 GB, 4.60 GB, 4.58 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB, 4.57 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.57 GB (4903141376) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.63 GB (4974504885) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 115.33M (115333914) - TotalNetworkReceiveTime: 4m59s - TotalNetworkSendTime: 3m39s - TotalStorageWaitTime: 2m13s - TotalThreadsInvoluntaryContextSwitches: 50.03K (50032) - TotalThreadsTotalWallClockTime: 24m27s - TotalThreadsSysTime: 34s582ms - TotalThreadsUserTime: 3m23s - TotalThreadsVoluntaryContextSwitches: 940.19K (940189) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 4m45s - OpenTime: 12m35s - ExecTreeOpenTime: 12m35s - PrepareTime: 50.835ms - ExecTreePrepareTime: 2.438ms DataStreamSender (dst_id=34):(Total: 26s185ms, non-child: 26s185ms, % non-child: 100.00%) - BytesSent: 3.14 GB (3376482299) - NetworkThroughput(*): 363.92 MB/sec - OverallThroughput: 122.97 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 115.33M (115332890) - SerializeBatchTime: 17s294ms - TransmitDataRPCTime: 8s848ms - UncompressedRowBatchSize: 6.55 GB (7036865394) CodeGen:(Total: 602.240ms, non-child: 602.240ms, % non-child: 100.00%) - CodegenTime: 4.552ms - CompileTime: 257.833ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 317.274ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 26.427ms AGGREGATION_NODE (id=17):(Total: 17m20s, non-child: 20s900ms, % non-child: 2.01%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 14.950us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 518.679ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 37.13 MB (38936550) - ReductionFactorEstimate: 38.87 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 115.33M (115333914) - RowsReturned: 115.33M (115333914) - RowsReturnedRate: 110.84 K/sec - StreamingTime: 20s532ms HASH_JOIN_NODE (id=16):(Total: 16m59s, non-child: 7s494ms, % non-child: 0.74%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.202ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 2.681ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.79 MB (44873439) - ProbeRows: 115.41M (115410973) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s489ms - RowsReturned: 115.41M (115409949) - RowsReturnedRate: 113.19 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 114.781us - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 101.557us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 10.357us, non-child: 10.357us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 5.802us - DeserializeRowBatchTimer: 15.285us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 35.34 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 16m52s, non-child: 8m49s, % non-child: 52.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s469ms - BufferPoolAllocationBytes: 74.28 GB (79760982016) - BufferPoolAllocations: 26.22K (26222) - BufferPoolPeakReservation: 4.50 GB (4831838208) - BufferPoolPeakUnpinnedBytes: 38.38 GB (41204842496) - BufferPoolPeakUsedReservation: 4.50 GB (4831838208) - BufferPoolReadIoBytes: 3.08 GB (3311403008) - BufferPoolReadIoOps: 1.58K (1579) - BufferPoolReadIoWaitTime: 3m26s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 49.50 GB (53152317440) - BufferPoolWriteIoBytes: 48.89 GB (52491714560) - BufferPoolWriteIoOps: 25.03K (25030) - BufferPoolWriteIoWaitTime: 1m13s - BuildRows: 1.44B (1440033112) - BuildTime: 3m7s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.50 GB (4832859904) - ProbeRows: 407.24M (407241255) - ProbeRowsPartitioned: 176.60M (176600645) - ProbeTime: 58s267ms - RowsReturned: 115.41M (115410911) - RowsReturnedRate: 114.03 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 3m30s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.56B (1560281088) - HashCollisions: 7.25M (7253838) - HashTablesBuildTime: 3m38s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m4s - SpilledPartitions: 34 (34) EXCHANGE_NODE (id=32):(Total: 5m32s, non-child: 55s288ms, % non-child: 16.61%) BytesReceived(32s000ms): 1.29 GB, 3.81 GB, 4.98 GB, 5.64 GB, 6.27 GB, 7.57 GB, 8.62 GB, 9.54 GB, 9.93 GB, 10.36 GB, 11.85 GB, 13.33 GB, 14.91 GB, 16.65 GB, 17.92 GB, 18.72 GB, 19.07 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s378ms - DeserializeRowBatchTimer: 59s852ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 4.33 M/sec - SendersBlockedTimer: 1m17s - SendersBlockedTotalTimer(*): 8m18s HDFS_SCAN_NODE (id=12):(Total: 2m29s, non-child: 2m29s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:93/16.47 GB 2:86/17.03 GB 4:82/14.27 GB 5:90/17.79 GB 3:96/18.19 GB 1:90/17.02 GB 6:114/19.95 GB 0:103/18.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 149 out of 149 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:85.58% 1:14.42% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:605 PARQUET/SNAPPY:894 BytesRead(16s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18.41 MB, 370.71 MB, 740.26 MB, 1.18 GB, 1.55 GB, 1.84 GB, 2.13 GB, 2.51 GB, 2.84 GB, 3.11 GB, 3.49 GB, 3.90 GB - FooterProcessingTime: (Avg: 163.893ms ; Min: 1.440ms ; Max: 1s765ms ; Number of samples: 149) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 0.26 - BytesRead: 4.44 GB (4772602657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.44 GB (4772602657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.44 GB (4772602657) - DecompressionTime: 10s627ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 149 (149) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 60.00 MB (62914294) - PerReadThreadRawHdfsThroughput: 43.81 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m28s - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 407.24M (407241255) - RowsReturned: 407.24M (407241255) - RowsReturnedRate: 2.72 M/sec - ScanRangesComplete: 754 (754) - ScannerThreadsInvoluntaryContextSwitches: 6.96K (6963) - ScannerThreadsTotalWallClockTime: 3m7s - MaterializeTupleTime(*): 41s032ms - ScannerThreadsSysTime: 9s566ms - ScannerThreadsUserTime: 39s116ms - ScannerThreadsVoluntaryContextSwitches: 23.02K (23020) - TotalRawHdfsReadTime(*): 1m43s - TotalReadThroughput: 6.37 MB/sec Filter 2 (1.00 MB): - Files processed: 754 (754) - Files rejected: 605 (605) - Files total: 754 (754) - RowGroups processed: 397.77K (397770) - RowGroups rejected: 0 (0) - RowGroups total: 397.77K (397770) - Rows processed: 2.44M (2441216) - Rows rejected: 0 (0) - Rows total: 407.24M (407241255) - Splits processed: 149 (149) - Splits rejected: 0 (0) - Splits total: 149 (149) Averaged Fragment F11:(Total: 8m7s, non-child: 4m8s, % non-child: 51.10%) split sizes: min: 15.22 GB, max: 15.30 GB, avg: 15.25 GB, stddev: 28.27 MB completion times: min:7m24s max:8m44s mean: 8m7s stddev:25s585ms execution rates: min:29.74 MB/sec max:35.08 MB/sec mean:32.15 MB/sec stddev:1.72 MB/sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 22.39 MB (23480190) - PerHostPeakMemUsage: 8.25 GB (8862941342) - RowsProduced: 205.72M (205719016) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m31s - TotalStorageWaitTime: 3m7s - TotalThreadsInvoluntaryContextSwitches: 29.65K (29650) - TotalThreadsTotalWallClockTime: 16m14s - TotalThreadsSysTime: 6s749ms - TotalThreadsUserTime: 51s410ms - TotalThreadsVoluntaryContextSwitches: 586.12K (586115) Fragment Instance Lifecycle Timings: - ExecTime: 8m7s - ExecTreeExecTime: 2m58s - OpenTime: 20.276ms - ExecTreeOpenTime: 186.542us - PrepareTime: 41.293ms - ExecTreePrepareTime: 6.850ms DataStreamSender (dst_id=32):(Total: 59s562ms, non-child: 59s562ms, % non-child: 100.00%) - BytesSent: 19.10 GB (20503879049) - NetworkThroughput(*): 684.37 MB/sec - OverallThroughput: 328.35 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.72M (205719016) - SerializeBatchTime: 30s922ms - TransmitDataRPCTime: 28s588ms - UncompressedRowBatchSize: 28.17 GB (30246324760) CodeGen:(Total: 41.114ms, non-child: 41.114ms, % non-child: 100.00%) - CodegenTime: 610.290us - CompileTime: 5.125ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 12.965ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 22.518ms HDFS_SCAN_NODE (id=13):(Total: 2m58s, non-child: 2m58s, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.97 GB (2119754134) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2119754134) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2119754134) - DecompressionTime: 8s860ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 300 (300) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.30 MB (23386378) - PerReadThreadRawHdfsThroughput: 28.66 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m57s - RowBatchQueuePutWaitTime: 4m34s - RowsRead: 205.72M (205719016) - RowsReturned: 205.72M (205719016) - RowsReturnedRate: 1.17 M/sec - ScanRangesComplete: 300 (300) - ScannerThreadsInvoluntaryContextSwitches: 9.79K (9795) - ScannerThreadsTotalWallClockTime: 8m7s - MaterializeTupleTime(*): 7s706ms - ScannerThreadsSysTime: 1s625ms - ScannerThreadsUserTime: 17s006ms - ScannerThreadsVoluntaryContextSwitches: 172.03K (172035) - TotalRawHdfsReadTime(*): 1m11s - TotalReadThroughput: 4.16 MB/sec Fragment F11: Instance e84a99bb0c926c46:9c59890200000040 (host=vd1309.halxg.cloudera.com:22000):(Total: 8m44s, non-child: 3m58s, % non-child: 45.49%) Hdfs split stats (:<# splits>/): 4:33/1.57 GB 5:38/1.71 GB 0:41/2.09 GB 1:47/2.39 GB 2:39/1.94 GB 3:35/1.73 GB 7:39/1.94 GB 6:40/1.85 GB MemoryUsage(16s000ms): 12.15 MB, 16.68 MB, 9.46 MB, 11.83 MB, 13.12 MB, 9.54 MB, 13.10 MB, 13.05 MB, 18.57 MB, 6.21 MB, 12.93 MB, 13.00 MB, 11.44 MB, 8.30 MB, 10.14 MB, 12.73 MB, 19.65 MB, 21.83 MB, 17.45 MB, 6.12 MB, 11.99 MB, 12.08 MB, 10.20 MB, 10.53 MB, 6.43 MB, 8.12 MB, 4.70 MB, 11.80 MB, 10.81 MB, 9.25 MB, 8.25 MB, 16.89 MB ThreadUsage(16s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.51 MB (23602161) - PerHostPeakMemUsage: 8.24 GB (8842656660) - RowsProduced: 205.21M (205213362) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m22s - TotalStorageWaitTime: 3m32s - TotalThreadsInvoluntaryContextSwitches: 33.72K (33724) - TotalThreadsTotalWallClockTime: 17m27s - TotalThreadsSysTime: 6s858ms - TotalThreadsUserTime: 49s044ms - TotalThreadsVoluntaryContextSwitches: 583.50K (583505) Fragment Instance Lifecycle Timings: - ExecTime: 8m43s - ExecTreeExecTime: 3m46s - OpenTime: 15.652ms - ExecTreeOpenTime: 161.816us - PrepareTime: 34.374ms - ExecTreePrepareTime: 1.769ms DataStreamSender (dst_id=32):(Total: 59s540ms, non-child: 59s540ms, % non-child: 100.00%) - BytesSent: 19.05 GB (20452735674) - NetworkThroughput(*): 647.33 MB/sec - OverallThroughput: 327.60 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.21M (205213362) - SerializeBatchTime: 29s358ms - TransmitDataRPCTime: 30s131ms - UncompressedRowBatchSize: 28.10 GB (30171979922) CodeGen:(Total: 37.828ms, non-child: 37.828ms, % non-child: 100.00%) - CodegenTime: 497.899us - CompileTime: 3.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 9.999ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 23.486ms HDFS_SCAN_NODE (id=13):(Total: 3m46s, non-child: 3m46s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:33/1.57 GB 5:38/1.71 GB 0:41/2.09 GB 1:47/2.39 GB 2:39/1.94 GB 3:35/1.73 GB 7:39/1.94 GB 6:40/1.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 312 out of 312 Hdfs Read Thread Concurrency Bucket: 0:84.72% 1:15.28% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:624 BytesRead(16s000ms): 58.98 MB, 196.03 MB, 329.47 MB, 404.95 MB, 470.00 MB, 517.18 MB, 550.05 MB, 578.97 MB, 588.27 MB, 628.36 MB, 695.53 MB, 739.42 MB, 806.79 MB, 836.69 MB, 881.84 MB, 908.99 MB, 934.11 MB, 944.07 MB, 944.53 MB, 975.17 MB, 1.02 GB, 1.09 GB, 1.17 GB, 1.26 GB, 1.36 GB, 1.44 GB, 1.51 GB, 1.61 GB, 1.65 GB, 1.71 GB, 1.78 GB, 1.87 GB - FooterProcessingTime: (Avg: 267.133ms ; Min: 1.254ms ; Max: 2s366ms ; Number of samples: 312) - AverageHdfsReadThreadConcurrency: 0.15 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.97 GB (2116523395) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2116523395) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2116523395) - DecompressionTime: 8s420ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 312 (312) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.40 MB (23491158) - PerReadThreadRawHdfsThroughput: 25.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m44s - RowBatchQueuePutWaitTime: 4m22s - RowsRead: 205.21M (205213362) - RowsReturned: 205.21M (205213362) - RowsReturnedRate: 907.66 K/sec - ScanRangesComplete: 312 (312) - ScannerThreadsInvoluntaryContextSwitches: 11.05K (11047) - ScannerThreadsTotalWallClockTime: 8m43s - MaterializeTupleTime(*): 7s539ms - ScannerThreadsSysTime: 1s669ms - ScannerThreadsUserTime: 16s421ms - ScannerThreadsVoluntaryContextSwitches: 169.77K (169766) - TotalRawHdfsReadTime(*): 1m18s - TotalReadThroughput: 3.84 MB/sec Instance e84a99bb0c926c46:9c5989020000003b (host=vd1313.halxg.cloudera.com:22000):(Total: 8m36s, non-child: 4m17s, % non-child: 49.91%) Hdfs split stats (:<# splits>/): 2:49/2.68 GB 3:34/1.79 GB 5:32/1.69 GB 1:39/2.11 GB 6:36/1.79 GB 7:43/2.30 GB 0:34/1.56 GB 4:25/1.31 GB MemoryUsage(16s000ms): 14.41 MB, 11.29 MB, 10.23 MB, 13.52 MB, 16.96 MB, 10.93 MB, 16.50 MB, 16.12 MB, 21.60 MB, 6.71 MB, 8.83 MB, 15.38 MB, 13.32 MB, 11.41 MB, 13.17 MB, 19.86 MB, 21.01 MB, 21.05 MB, 12.46 MB, 6.70 MB, 7.50 MB, 12.20 MB, 6.03 MB, 6.32 MB, 7.02 MB, 10.80 MB, 8.68 MB, 8.53 MB, 11.42 MB, 14.15 MB, 8.72 MB, 11.35 MB ThreadUsage(16s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.28 MB (23364407) - PerHostPeakMemUsage: 8.24 GB (8850074976) - RowsProduced: 205.46M (205464137) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m40s - TotalStorageWaitTime: 3m29s - TotalThreadsInvoluntaryContextSwitches: 29.00K (29004) - TotalThreadsTotalWallClockTime: 17m12s - TotalThreadsSysTime: 6s708ms - TotalThreadsUserTime: 52s512ms - TotalThreadsVoluntaryContextSwitches: 580.64K (580642) Fragment Instance Lifecycle Timings: - ExecTime: 8m36s - ExecTreeExecTime: 3m19s - OpenTime: 53.268ms - ExecTreeOpenTime: 443.097us - PrepareTime: 127.455ms - ExecTreePrepareTime: 39.621ms DataStreamSender (dst_id=32):(Total: 59s583ms, non-child: 59s583ms, % non-child: 100.00%) - BytesSent: 19.07 GB (20476572977) - NetworkThroughput(*): 697.85 MB/sec - OverallThroughput: 327.74 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.46M (205464137) - SerializeBatchTime: 31s548ms - TransmitDataRPCTime: 27s983ms - UncompressedRowBatchSize: 28.13 GB (30208850315) CodeGen:(Total: 96.829ms, non-child: 96.829ms, % non-child: 100.00%) - CodegenTime: 1.865ms - CompileTime: 12.434ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 35.867ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 47.418ms HDFS_SCAN_NODE (id=13):(Total: 3m18s, non-child: 3m18s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:49/2.68 GB 3:34/1.79 GB 5:32/1.69 GB 1:39/2.11 GB 6:36/1.79 GB 7:43/2.30 GB 0:34/1.56 GB 4:25/1.31 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 292 out of 292 Hdfs Read Thread Concurrency Bucket: 0:83.82% 1:16.18% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:584 BytesRead(16s000ms): 76.58 MB, 198.17 MB, 331.10 MB, 412.73 MB, 477.54 MB, 521.94 MB, 561.95 MB, 595.51 MB, 609.90 MB, 662.78 MB, 734.44 MB, 773.41 MB, 836.86 MB, 871.73 MB, 944.43 MB, 971.76 MB, 993.75 MB, 1001.15 MB, 1010.96 MB, 1.05 GB, 1.13 GB, 1.19 GB, 1.26 GB, 1.31 GB, 1.39 GB, 1.47 GB, 1.55 GB, 1.65 GB, 1.70 GB, 1.75 GB, 1.83 GB, 1.91 GB - FooterProcessingTime: (Avg: 271.921ms ; Min: 1.151ms ; Max: 1s922ms ; Number of samples: 292) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.97 GB (2116228149) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2116228149) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2116228149) - DecompressionTime: 8s687ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 292 (292) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.20 MB (23283390) - PerReadThreadRawHdfsThroughput: 25.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3m17s - RowBatchQueuePutWaitTime: 4m46s - RowsRead: 205.46M (205464137) - RowsReturned: 205.46M (205464137) - RowsReturnedRate: 1.03 M/sec - ScanRangesComplete: 292 (292) - ScannerThreadsInvoluntaryContextSwitches: 9.52K (9516) - ScannerThreadsTotalWallClockTime: 8m36s - MaterializeTupleTime(*): 7s542ms - ScannerThreadsSysTime: 1s675ms - ScannerThreadsUserTime: 17s342ms - ScannerThreadsVoluntaryContextSwitches: 169.40K (169398) - TotalRawHdfsReadTime(*): 1m20s - TotalReadThroughput: 3.91 MB/sec Instance e84a99bb0c926c46:9c59890200000041 (host=vd1311.halxg.cloudera.com:22000):(Total: 8m12s, non-child: 4m15s, % non-child: 51.95%) Hdfs split stats (:<# splits>/): 6:33/1.56 GB 5:42/2.20 GB 1:41/2.12 GB 2:41/2.19 GB 4:35/1.75 GB 3:32/1.70 GB 7:33/1.70 GB 0:41/2.08 GB MemoryUsage(8s000ms): 14.52 MB, 12.00 MB, 13.18 MB, 10.37 MB, 12.61 MB, 8.83 MB, 11.84 MB, 9.42 MB, 8.55 MB, 21.59 MB, 13.03 MB, 5.90 MB, 13.59 MB, 16.18 MB, 9.42 MB, 11.17 MB, 12.52 MB, 15.06 MB, 8.71 MB, 14.70 MB, 16.84 MB, 14.99 MB, 13.26 MB, 10.01 MB, 9.88 MB, 15.36 MB, 17.78 MB, 7.01 MB, 18.10 MB, 18.90 MB, 18.45 MB, 16.52 MB, 14.32 MB, 17.50 MB, 19.04 MB, 21.46 MB, 21.59 MB, 16.24 MB, 7.25 MB, 8.87 MB, 7.47 MB, 6.11 MB, 12.11 MB, 5.17 MB, 8.17 MB, 8.51 MB, 9.18 MB, 10.98 MB, 6.60 MB, 6.88 MB, 7.98 MB, 9.09 MB, 7.32 MB, 8.87 MB, 9.03 MB, 13.70 MB, 16.51 MB, 12.19 MB, 11.19 MB, 19.50 MB, 12.29 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.38 MB (23470440) - PerHostPeakMemUsage: 8.27 GB (8875757525) - RowsProduced: 206.32M (206324495) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m37s - TotalStorageWaitTime: 3m13s - TotalThreadsInvoluntaryContextSwitches: 27.92K (27920) - TotalThreadsTotalWallClockTime: 16m24s - TotalThreadsSysTime: 6s722ms - TotalThreadsUserTime: 50s478ms - TotalThreadsVoluntaryContextSwitches: 599.47K (599465) Fragment Instance Lifecycle Timings: - ExecTime: 8m12s - ExecTreeExecTime: 2m58s - OpenTime: 14.412ms - ExecTreeOpenTime: 134.062us - PrepareTime: 21.275ms - ExecTreePrepareTime: 788.220us DataStreamSender (dst_id=32):(Total: 58s111ms, non-child: 58s111ms, % non-child: 100.00%) - BytesSent: 19.15 GB (20564914258) - NetworkThroughput(*): 697.31 MB/sec - OverallThroughput: 337.50 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 206.32M (206324495) - SerializeBatchTime: 29s937ms - TransmitDataRPCTime: 28s125ms - UncompressedRowBatchSize: 28.25 GB (30335346657) CodeGen:(Total: 27.154ms, non-child: 27.154ms, % non-child: 100.00%) - CodegenTime: 332.919us - CompileTime: 3.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 9.023ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 13.813ms HDFS_SCAN_NODE (id=13):(Total: 2m58s, non-child: 2m58s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:33/1.56 GB 5:42/2.20 GB 1:41/2.12 GB 2:41/2.19 GB 4:35/1.75 GB 3:32/1.70 GB 7:33/1.70 GB 0:41/2.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 298 out of 298 Hdfs Read Thread Concurrency Bucket: 0:85.77% 1:14.23% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:596 BytesRead(8s000ms): 43.44 MB, 107.32 MB, 165.51 MB, 221.31 MB, 296.48 MB, 373.44 MB, 408.92 MB, 434.37 MB, 474.90 MB, 498.54 MB, 508.95 MB, 550.78 MB, 564.84 MB, 568.12 MB, 592.92 MB, 609.99 MB, 615.54 MB, 618.79 MB, 660.50 MB, 752.82 MB, 810.91 MB, 828.45 MB, 849.28 MB, 884.87 MB, 925.21 MB, 948.68 MB, 957.02 MB, 983.65 MB, 1023.28 MB, 1.03 GB, 1.04 GB, 1.06 GB, 1.07 GB, 1.07 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.09 GB, 1.12 GB, 1.15 GB, 1.21 GB, 1.25 GB, 1.28 GB, 1.31 GB, 1.35 GB, 1.39 GB, 1.42 GB, 1.47 GB, 1.52 GB, 1.56 GB, 1.58 GB, 1.61 GB, 1.66 GB, 1.71 GB, 1.75 GB, 1.81 GB, 1.83 GB, 1.83 GB, 1.88 GB, 1.91 GB, 1.93 GB - FooterProcessingTime: (Avg: 256.905ms ; Min: 1.192ms ; Max: 1s464ms ; Number of samples: 298) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.98 GB (2125843334) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.98 GB (2125843334) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.98 GB (2125843334) - DecompressionTime: 8s977ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 298 (298) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.31 MB (23390615) - PerReadThreadRawHdfsThroughput: 29.71 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m57s - RowBatchQueuePutWaitTime: 4m36s - RowsRead: 206.32M (206324495) - RowsReturned: 206.32M (206324495) - RowsReturnedRate: 1.16 M/sec - ScanRangesComplete: 298 (298) - ScannerThreadsInvoluntaryContextSwitches: 9.61K (9614) - ScannerThreadsTotalWallClockTime: 8m12s - MaterializeTupleTime(*): 7s443ms - ScannerThreadsSysTime: 1s602ms - ScannerThreadsUserTime: 17s060ms - ScannerThreadsVoluntaryContextSwitches: 173.31K (173314) - TotalRawHdfsReadTime(*): 1m8s - TotalReadThroughput: 4.12 MB/sec Instance e84a99bb0c926c46:9c5989020000003d (host=vd1314.halxg.cloudera.com:22000):(Total: 8m8s, non-child: 4m17s, % non-child: 52.68%) Hdfs split stats (:<# splits>/): 4:40/2.11 GB 2:34/1.73 GB 5:29/1.49 GB 0:38/1.99 GB 3:35/1.94 GB 7:44/2.32 GB 1:33/1.70 GB 6:40/1.96 GB MemoryUsage(8s000ms): 19.37 MB, 10.78 MB, 13.61 MB, 15.13 MB, 13.14 MB, 9.59 MB, 18.59 MB, 8.71 MB, 16.08 MB, 13.59 MB, 7.66 MB, 10.60 MB, 21.20 MB, 20.22 MB, 12.98 MB, 16.61 MB, 17.59 MB, 14.60 MB, 6.38 MB, 9.07 MB, 14.83 MB, 13.17 MB, 14.91 MB, 11.13 MB, 16.98 MB, 9.37 MB, 13.90 MB, 3.06 MB, 12.91 MB, 19.10 MB, 17.33 MB, 12.98 MB, 11.54 MB, 16.95 MB, 21.59 MB, 20.25 MB, 11.41 MB, 12.82 MB, 4.18 MB, 8.88 MB, 11.15 MB, 7.65 MB, 9.64 MB, 6.19 MB, 3.98 MB, 10.89 MB, 7.56 MB, 10.81 MB, 9.91 MB, 6.37 MB, 11.95 MB, 5.41 MB, 6.01 MB, 8.74 MB, 11.04 MB, 13.63 MB, 17.03 MB, 11.25 MB, 9.56 MB, 13.59 MB, 11.88 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.36 MB (23444605) - PerHostPeakMemUsage: 8.27 GB (8874896664) - RowsProduced: 205.46M (205464339) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m39s - TotalStorageWaitTime: 3m3s - TotalThreadsInvoluntaryContextSwitches: 32.25K (32249) - TotalThreadsTotalWallClockTime: 16m16s - TotalThreadsSysTime: 6s821ms - TotalThreadsUserTime: 50s972ms - TotalThreadsVoluntaryContextSwitches: 582.36K (582364) Fragment Instance Lifecycle Timings: - ExecTime: 8m8s - ExecTreeExecTime: 2m52s - OpenTime: 14.503ms - ExecTreeOpenTime: 140.544us - PrepareTime: 30.645ms - ExecTreePrepareTime: 1.565ms DataStreamSender (dst_id=32):(Total: 59s280ms, non-child: 59s280ms, % non-child: 100.00%) - BytesSent: 19.07 GB (20479341792) - NetworkThroughput(*): 694.63 MB/sec - OverallThroughput: 329.46 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.46M (205464339) - SerializeBatchTime: 31s113ms - TransmitDataRPCTime: 28s116ms - UncompressedRowBatchSize: 28.13 GB (30208879925) CodeGen:(Total: 35.479ms, non-child: 35.479ms, % non-child: 100.00%) - CodegenTime: 408.780us - CompileTime: 4.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 8.893ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 22.121ms HDFS_SCAN_NODE (id=13):(Total: 2m51s, non-child: 2m51s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:40/2.11 GB 2:34/1.73 GB 5:29/1.49 GB 0:38/1.99 GB 3:35/1.94 GB 7:44/2.32 GB 1:33/1.70 GB 6:40/1.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 293 out of 293 Hdfs Read Thread Concurrency Bucket: 0:86.18% 1:13.82% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:586 BytesRead(8s000ms): 45.92 MB, 127.92 MB, 185.91 MB, 259.54 MB, 353.11 MB, 425.82 MB, 467.59 MB, 487.13 MB, 522.90 MB, 540.27 MB, 556.52 MB, 587.18 MB, 602.42 MB, 602.70 MB, 629.69 MB, 659.28 MB, 663.46 MB, 666.03 MB, 692.47 MB, 744.28 MB, 794.32 MB, 813.42 MB, 841.92 MB, 871.32 MB, 921.68 MB, 939.13 MB, 947.16 MB, 970.32 MB, 1000.71 MB, 1.01 GB, 1.01 GB, 1.03 GB, 1.04 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.06 GB, 1.10 GB, 1.14 GB, 1.20 GB, 1.24 GB, 1.27 GB, 1.30 GB, 1.34 GB, 1.37 GB, 1.41 GB, 1.46 GB, 1.50 GB, 1.54 GB, 1.57 GB, 1.62 GB, 1.66 GB, 1.69 GB, 1.76 GB, 1.81 GB, 1.83 GB, 1.83 GB, 1.89 GB, 1.91 GB, 1.94 GB - FooterProcessingTime: (Avg: 250.384ms ; Min: 218.286us ; Max: 2s197ms ; Number of samples: 293) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.97 GB (2115908001) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2115908001) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2115908001) - DecompressionTime: 9s087ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 293 (293) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.22 MB (23299236) - PerReadThreadRawHdfsThroughput: 28.57 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m50s - RowBatchQueuePutWaitTime: 4m43s - RowsRead: 205.46M (205464339) - RowsReturned: 205.46M (205464339) - RowsReturnedRate: 1.20 M/sec - ScanRangesComplete: 293 (293) - ScannerThreadsInvoluntaryContextSwitches: 10.31K (10306) - ScannerThreadsTotalWallClockTime: 8m8s - MaterializeTupleTime(*): 8s341ms - ScannerThreadsSysTime: 1s596ms - ScannerThreadsUserTime: 16s708ms - ScannerThreadsVoluntaryContextSwitches: 171.44K (171444) - TotalRawHdfsReadTime(*): 1m10s - TotalReadThroughput: 4.13 MB/sec Instance e84a99bb0c926c46:9c5989020000003f (host=vd1312.halxg.cloudera.com:22000):(Total: 8m, non-child: 4m13s, % non-child: 52.70%) Hdfs split stats (:<# splits>/): 5:37/1.79 GB 3:42/2.28 GB 1:32/1.52 GB 7:39/2.01 GB 2:42/1.90 GB 0:42/1.98 GB 4:37/1.94 GB 6:40/1.86 GB MemoryUsage(8s000ms): 15.53 MB, 11.29 MB, 11.95 MB, 16.60 MB, 14.12 MB, 7.28 MB, 19.62 MB, 14.56 MB, 8.46 MB, 13.09 MB, 9.38 MB, 8.51 MB, 21.20 MB, 19.46 MB, 12.86 MB, 20.55 MB, 21.59 MB, 15.07 MB, 3.86 MB, 10.55 MB, 16.07 MB, 16.53 MB, 13.46 MB, 14.15 MB, 15.97 MB, 17.95 MB, 13.58 MB, 7.66 MB, 10.33 MB, 11.54 MB, 12.04 MB, 15.48 MB, 13.06 MB, 12.95 MB, 21.33 MB, 21.53 MB, 21.59 MB, 15.34 MB, 10.27 MB, 5.45 MB, 5.25 MB, 11.16 MB, 5.77 MB, 5.12 MB, 8.23 MB, 8.15 MB, 5.41 MB, 5.88 MB, 11.54 MB, 6.63 MB, 8.15 MB, 9.45 MB, 6.48 MB, 13.62 MB, 13.55 MB, 13.66 MB, 16.53 MB, 16.28 MB, 9.49 MB, 12.96 MB ThreadUsage(8s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.31 MB (23395511) - PerHostPeakMemUsage: 8.23 GB (8839008722) - RowsProduced: 206.20M (206203160) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m35s - TotalStorageWaitTime: 2m59s - TotalThreadsInvoluntaryContextSwitches: 29.66K (29663) - TotalThreadsTotalWallClockTime: 15m59s - TotalThreadsSysTime: 6s780ms - TotalThreadsUserTime: 52s155ms - TotalThreadsVoluntaryContextSwitches: 585.66K (585662) Fragment Instance Lifecycle Timings: - ExecTime: 8m - ExecTreeExecTime: 2m47s - OpenTime: 13.575ms - ExecTreeOpenTime: 136.476us - PrepareTime: 23.443ms - ExecTreePrepareTime: 1.734ms DataStreamSender (dst_id=32):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesSent: 19.14 GB (20551005587) - NetworkThroughput(*): 685.25 MB/sec - OverallThroughput: 326.46 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 206.20M (206203160) - SerializeBatchTime: 31s379ms - TransmitDataRPCTime: 28s601ms - UncompressedRowBatchSize: 28.24 GB (30317507500) CodeGen:(Total: 26.578ms, non-child: 26.578ms, % non-child: 100.00%) - CodegenTime: 330.559us - CompileTime: 3.848ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 8.212ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 14.160ms HDFS_SCAN_NODE (id=13):(Total: 2m47s, non-child: 2m47s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:37/1.79 GB 3:42/2.28 GB 1:32/1.52 GB 7:39/2.01 GB 2:42/1.90 GB 0:42/1.98 GB 4:37/1.94 GB 6:40/1.86 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 311 out of 311 Hdfs Read Thread Concurrency Bucket: 0:87.29% 1:12.71% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:622 BytesRead(8s000ms): 34.34 MB, 116.02 MB, 183.50 MB, 258.55 MB, 347.61 MB, 429.42 MB, 469.57 MB, 499.16 MB, 528.33 MB, 543.94 MB, 552.58 MB, 578.09 MB, 598.52 MB, 598.53 MB, 621.06 MB, 639.19 MB, 641.31 MB, 643.81 MB, 679.35 MB, 724.20 MB, 769.49 MB, 790.43 MB, 805.01 MB, 833.38 MB, 898.66 MB, 925.77 MB, 939.84 MB, 981.22 MB, 1.00 GB, 1.02 GB, 1.03 GB, 1.05 GB, 1.06 GB, 1.06 GB, 1.07 GB, 1.07 GB, 1.07 GB, 1.08 GB, 1.13 GB, 1.17 GB, 1.21 GB, 1.26 GB, 1.29 GB, 1.31 GB, 1.35 GB, 1.40 GB, 1.44 GB, 1.47 GB, 1.50 GB, 1.54 GB, 1.58 GB, 1.63 GB, 1.69 GB, 1.74 GB, 1.81 GB, 1.87 GB, 1.89 GB, 1.90 GB, 1.95 GB, 1.98 GB - FooterProcessingTime: (Avg: 218.715ms ; Min: 961.625us ; Max: 3s557ms ; Number of samples: 311) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.98 GB (2124957413) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.98 GB (2124957413) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.98 GB (2124957413) - DecompressionTime: 9s763ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 311 (311) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.24 MB (23315686) - PerReadThreadRawHdfsThroughput: 29.28 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m45s - RowBatchQueuePutWaitTime: 4m38s - RowsRead: 206.20M (206203160) - RowsReturned: 206.20M (206203160) - RowsReturnedRate: 1.23 M/sec - ScanRangesComplete: 311 (311) - ScannerThreadsInvoluntaryContextSwitches: 9.85K (9850) - ScannerThreadsTotalWallClockTime: 7m59s - MaterializeTupleTime(*): 8s317ms - ScannerThreadsSysTime: 1s663ms - ScannerThreadsUserTime: 17s217ms - ScannerThreadsVoluntaryContextSwitches: 174.16K (174158) - TotalRawHdfsReadTime(*): 1m9s - TotalReadThroughput: 4.22 MB/sec Instance e84a99bb0c926c46:9c5989020000003c (host=vd1310.halxg.cloudera.com:22000):(Total: 7m44s, non-child: 4m5s, % non-child: 52.90%) Hdfs split stats (:<# splits>/): 0:42/2.31 GB 5:41/2.12 GB 3:29/1.45 GB 2:37/1.86 GB 1:40/2.14 GB 4:36/1.76 GB 6:37/1.91 GB 7:32/1.71 GB MemoryUsage(8s000ms): 10.34 MB, 15.38 MB, 16.00 MB, 12.02 MB, 10.72 MB, 15.99 MB, 14.30 MB, 11.98 MB, 8.93 MB, 13.11 MB, 11.67 MB, 10.04 MB, 11.54 MB, 12.95 MB, 7.22 MB, 10.13 MB, 20.10 MB, 20.45 MB, 7.89 MB, 7.48 MB, 16.05 MB, 14.64 MB, 13.56 MB, 9.87 MB, 18.30 MB, 16.92 MB, 19.91 MB, 7.68 MB, 16.72 MB, 19.19 MB, 21.26 MB, 11.06 MB, 13.19 MB, 13.74 MB, 13.22 MB, 13.53 MB, 21.06 MB, 17.20 MB, 10.88 MB, 5.66 MB, 9.59 MB, 6.03 MB, 14.41 MB, 10.49 MB, 10.95 MB, 8.13 MB, 8.93 MB, 7.04 MB, 11.20 MB, 2.87 MB, 8.08 MB, 10.85 MB, 7.78 MB, 12.20 MB, 6.96 MB, 10.10 MB, 20.26 MB, 18.45 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.47 MB (23560172) - PerHostPeakMemUsage: 8.26 GB (8868267721) - RowsProduced: 205.80M (205801355) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m28s - TotalStorageWaitTime: 2m51s - TotalThreadsInvoluntaryContextSwitches: 26.65K (26652) - TotalThreadsTotalWallClockTime: 15m29s - TotalThreadsSysTime: 6s827ms - TotalThreadsUserTime: 53s467ms - TotalThreadsVoluntaryContextSwitches: 583.06K (583064) Fragment Instance Lifecycle Timings: - ExecTime: 7m44s - ExecTreeExecTime: 2m38s - OpenTime: 14.424ms - ExecTreeOpenTime: 109.752us - PrepareTime: 19.999ms - ExecTreePrepareTime: 784.911us DataStreamSender (dst_id=32):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesSent: 19.10 GB (20512320136) - NetworkThroughput(*): 684.23 MB/sec - OverallThroughput: 321.39 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.80M (205801355) - SerializeBatchTime: 32s224ms - TransmitDataRPCTime: 28s589ms - UncompressedRowBatchSize: 28.18 GB (30258431021) CodeGen:(Total: 27.116ms, non-child: 27.116ms, % non-child: 100.00%) - CodegenTime: 378.160us - CompileTime: 4.018ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 9.067ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 13.692ms HDFS_SCAN_NODE (id=13):(Total: 2m38s, non-child: 2m38s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:42/2.31 GB 5:41/2.12 GB 3:29/1.45 GB 2:37/1.86 GB 1:40/2.14 GB 4:36/1.76 GB 6:37/1.91 GB 7:32/1.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 294 out of 294 Hdfs Read Thread Concurrency Bucket: 0:86.11% 1:13.89% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:588 BytesRead(8s000ms): 26.93 MB, 111.05 MB, 207.27 MB, 293.71 MB, 362.40 MB, 454.83 MB, 521.78 MB, 555.80 MB, 594.27 MB, 611.74 MB, 625.16 MB, 667.30 MB, 686.37 MB, 687.48 MB, 709.76 MB, 727.37 MB, 739.47 MB, 740.67 MB, 776.07 MB, 830.29 MB, 883.45 MB, 901.20 MB, 917.15 MB, 943.99 MB, 977.93 MB, 992.51 MB, 998.85 MB, 1.00 GB, 1.04 GB, 1.07 GB, 1.07 GB, 1.09 GB, 1.10 GB, 1.10 GB, 1.11 GB, 1.11 GB, 1.12 GB, 1.12 GB, 1.15 GB, 1.20 GB, 1.24 GB, 1.29 GB, 1.32 GB, 1.36 GB, 1.40 GB, 1.46 GB, 1.50 GB, 1.55 GB, 1.59 GB, 1.62 GB, 1.65 GB, 1.70 GB, 1.75 GB, 1.80 GB, 1.86 GB, 1.91 GB, 1.94 GB, 1.95 GB - FooterProcessingTime: (Avg: 226.854ms ; Min: 1.152ms ; Max: 3s573ms ; Number of samples: 294) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.97 GB (2119870087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2119870087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2119870087) - DecompressionTime: 8s632ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 294 (294) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.39 MB (23480347) - PerReadThreadRawHdfsThroughput: 29.61 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m36s - RowBatchQueuePutWaitTime: 4m31s - RowsRead: 205.80M (205801355) - RowsReturned: 205.80M (205801355) - RowsReturnedRate: 1.30 M/sec - ScanRangesComplete: 294 (294) - ScannerThreadsInvoluntaryContextSwitches: 8.91K (8908) - ScannerThreadsTotalWallClockTime: 7m44s - MaterializeTupleTime(*): 7s354ms - ScannerThreadsSysTime: 1s599ms - ScannerThreadsUserTime: 17s502ms - ScannerThreadsVoluntaryContextSwitches: 173.56K (173555) - TotalRawHdfsReadTime(*): 1m8s - TotalReadThroughput: 4.35 MB/sec Instance e84a99bb0c926c46:9c5989020000003e (host=vd1316.halxg.cloudera.com:22000):(Total: 7m24s, non-child: 3m54s, % non-child: 52.77%) Hdfs split stats (:<# splits>/): 2:39/1.87 GB 7:42/2.24 GB 6:41/2.02 GB 1:35/1.84 GB 3:38/1.90 GB 5:33/1.65 GB 4:43/2.12 GB 0:33/1.60 GB MemoryUsage(8s000ms): 9.68 MB, 9.78 MB, 14.19 MB, 12.93 MB, 8.66 MB, 9.26 MB, 19.35 MB, 14.79 MB, 15.55 MB, 21.59 MB, 13.28 MB, 1.98 MB, 12.73 MB, 13.26 MB, 15.29 MB, 20.74 MB, 20.85 MB, 20.45 MB, 12.10 MB, 9.11 MB, 10.13 MB, 8.46 MB, 13.58 MB, 13.47 MB, 10.23 MB, 15.67 MB, 18.95 MB, 7.44 MB, 19.66 MB, 11.60 MB, 15.35 MB, 21.26 MB, 10.56 MB, 13.57 MB, 21.59 MB, 21.59 MB, 21.59 MB, 18.01 MB, 11.08 MB, 7.09 MB, 6.81 MB, 7.52 MB, 14.55 MB, 6.49 MB, 8.13 MB, 9.63 MB, 5.85 MB, 10.25 MB, 8.63 MB, 11.79 MB, 14.24 MB, 6.87 MB, 7.20 MB, 7.22 MB, 14.90 MB ThreadUsage(8s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 22.43 MB (23524039) - PerHostPeakMemUsage: 8.28 GB (8889927132) - RowsProduced: 205.56M (205562264) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m17s - TotalStorageWaitTime: 2m43s - TotalThreadsInvoluntaryContextSwitches: 28.34K (28343) - TotalThreadsTotalWallClockTime: 14m49s - TotalThreadsSysTime: 6s526ms - TotalThreadsUserTime: 51s240ms - TotalThreadsVoluntaryContextSwitches: 588.11K (588107) Fragment Instance Lifecycle Timings: - ExecTime: 7m24s - ExecTreeExecTime: 2m30s - OpenTime: 16.098ms - ExecTreeOpenTime: 180.053us - PrepareTime: 31.858ms - ExecTreePrepareTime: 1.689ms DataStreamSender (dst_id=32):(Total: 59s522ms, non-child: 59s522ms, % non-child: 100.00%) - BytesSent: 19.08 GB (20490262919) - NetworkThroughput(*): 684.02 MB/sec - OverallThroughput: 328.30 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.56M (205562264) - SerializeBatchTime: 30s900ms - TransmitDataRPCTime: 28s568ms - UncompressedRowBatchSize: 28.15 GB (30223277980) CodeGen:(Total: 36.811ms, non-child: 36.811ms, % non-child: 100.00%) - CodegenTime: 458.240us - CompileTime: 3.751ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 9.691ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 22.934ms HDFS_SCAN_NODE (id=13):(Total: 2m30s, non-child: 2m30s, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:39/1.87 GB 7:42/2.24 GB 6:41/2.02 GB 1:35/1.84 GB 3:38/1.90 GB 5:33/1.65 GB 4:43/2.12 GB 0:33/1.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 304 out of 304 Hdfs Read Thread Concurrency Bucket: 0:86.73% 1:13.27% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:608 BytesRead(8s000ms): 23.77 MB, 86.70 MB, 154.64 MB, 237.01 MB, 315.42 MB, 375.76 MB, 423.10 MB, 449.27 MB, 468.45 MB, 479.50 MB, 495.85 MB, 521.55 MB, 528.91 MB, 529.54 MB, 557.64 MB, 580.10 MB, 591.10 MB, 591.67 MB, 633.19 MB, 705.07 MB, 758.33 MB, 775.71 MB, 789.96 MB, 824.71 MB, 877.60 MB, 900.45 MB, 910.57 MB, 944.75 MB, 996.28 MB, 1015.20 MB, 1021.79 MB, 1.02 GB, 1.03 GB, 1.04 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.13 GB, 1.19 GB, 1.24 GB, 1.29 GB, 1.31 GB, 1.35 GB, 1.40 GB, 1.45 GB, 1.49 GB, 1.53 GB, 1.59 GB, 1.62 GB, 1.66 GB, 1.70 GB, 1.75 GB, 1.80 GB, 1.88 GB - FooterProcessingTime: (Avg: 185.806ms ; Min: 1.047ms ; Max: 1s931ms ; Number of samples: 304) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.97 GB (2118948559) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2118948559) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2118948559) - DecompressionTime: 8s455ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 304 (304) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 22.36 MB (23444214) - PerReadThreadRawHdfsThroughput: 32.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2m29s - RowBatchQueuePutWaitTime: 4m21s - RowsRead: 205.56M (205562264) - RowsReturned: 205.56M (205562264) - RowsReturnedRate: 1.37 M/sec - ScanRangesComplete: 304 (304) - ScannerThreadsInvoluntaryContextSwitches: 9.33K (9329) - ScannerThreadsTotalWallClockTime: 7m24s - MaterializeTupleTime(*): 7s409ms - ScannerThreadsSysTime: 1s572ms - ScannerThreadsUserTime: 16s792ms - ScannerThreadsVoluntaryContextSwitches: 172.61K (172610) - TotalRawHdfsReadTime(*): 1m1s - TotalReadThroughput: 4.54 MB/sec Averaged Fragment F12:(Total: 304.268ms, non-child: 253.400ms, % non-child: 83.28%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:329.713ms max:329.713ms mean: 329.713ms stddev:0.000ns execution rates: min:6.52 MB/sec max:6.52 MB/sec mean:6.52 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 528.88 MB (554567885) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 248.817ms - TotalStorageWaitTime: 3.455ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 286.541ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 22.997ms - TotalThreadsVoluntaryContextSwitches: 27 (27) Fragment Instance Lifecycle Timings: - ExecTime: 258.751ms - ExecTreeExecTime: 8.679ms - OpenTime: 19.577ms - ExecTreeOpenTime: 35.914us - PrepareTime: 25.866ms - ExecTreePrepareTime: 119.533us DataStreamSender (dst_id=33):(Total: 171.359us, non-child: 171.359us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 224.56 MB/sec - OverallThroughput: 114.69 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 14.594us - TransmitDataRPCTime: 87.520us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 41.708ms, non-child: 41.708ms, % non-child: 100.00%) - CodegenTime: 374.666us - CompileTime: 6.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 12.423ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 22.821ms HDFS_SCAN_NODE (id=14):(Total: 8.988ms, non-child: 8.988ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 248.055us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.252ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 40.72 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 8.484ms - MaterializeTupleTime(*): 3.174ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 401.813us - TotalReadThroughput: 0.00 /sec Fragment F12: Instance e84a99bb0c926c46:9c59890200000042 (host=vd1316.halxg.cloudera.com:22000):(Total: 304.268ms, non-child: 253.400ms, % non-child: 83.28%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB MemoryUsage(500.000ms): 120.01 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 528.88 MB (554567885) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 248.817ms - TotalStorageWaitTime: 3.455ms - TotalThreadsInvoluntaryContextSwitches: 7 (7) - TotalThreadsTotalWallClockTime: 286.541ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 22.997ms - TotalThreadsVoluntaryContextSwitches: 27 (27) Fragment Instance Lifecycle Timings: - ExecTime: 258.751ms - ExecTreeExecTime: 8.679ms - OpenTime: 19.577ms - ExecTreeOpenTime: 35.914us - PrepareTime: 25.866ms - ExecTreePrepareTime: 119.533us DataStreamSender (dst_id=33):(Total: 171.359us, non-child: 171.359us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 224.56 MB/sec - OverallThroughput: 114.69 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 14.594us - TransmitDataRPCTime: 87.520us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 41.708ms, non-child: 41.708ms, % non-child: 100.00%) - CodegenTime: 374.666us - CompileTime: 6.079ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 12.423ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 22.821ms HDFS_SCAN_NODE (id=14):(Total: 8.988ms, non-child: 8.988ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.481ms ; Min: 1.481ms ; Max: 1.481ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 248.055us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.252ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 40.72 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 8.484ms - MaterializeTupleTime(*): 3.174ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 401.813us - TotalReadThroughput: 0.00 /sec