Query (id=8d463de3722df36f:a2dae93a00000000): Summary: Session ID: b54cda644686da93:f1c20afc188e0fa0 Session Type: BEESWAX Start Time: 2017-04-04 10:46:17.099246000 End Time: 2017-04-04 11:06:04.438426000 Query Type: QUERY Query State: EXCEPTION Query Status: Cannot perform aggregation at node with id 30. Repartitioning did not reduce the size of a spilled partition. Repartitioning level 7. Number of rows 1. Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 07021cc117c56e4bbc0744b342fee6f5a8cce964) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.234.19:45450 Default Db: tpcds_10000_parquet Sql Statement: with ws as (select d_year AS ws_sold_year, ws_item_sk, ws_bill_customer_sk ws_customer_sk, sum(ws_quantity) ws_qty, sum(ws_wholesale_cost) ws_wc, sum(ws_sales_price) ws_sp from web_sales left join web_returns on wr_order_number=ws_order_number and ws_item_sk=wr_item_sk join date_dim on ws_sold_date_sk = d_date_sk where wr_order_number is null group by d_year, ws_item_sk, ws_bill_customer_sk ), cs as (select d_year AS cs_sold_year, cs_item_sk, cs_bill_customer_sk cs_customer_sk, sum(cs_quantity) cs_qty, sum(cs_wholesale_cost) cs_wc, sum(cs_sales_price) cs_sp from catalog_sales left join catalog_returns on cr_order_number=cs_order_number and cs_item_sk=cr_item_sk join date_dim on cs_sold_date_sk = d_date_sk where cr_order_number is null group by d_year, cs_item_sk, cs_bill_customer_sk ), ss as (select d_year AS ss_sold_year, ss_item_sk, ss_customer_sk, sum(ss_quantity) ss_qty, sum(ss_wholesale_cost) ss_wc, sum(ss_sales_price) ss_sp from store_sales left join store_returns on sr_ticket_number=ss_ticket_number and ss_item_sk=sr_item_sk join date_dim on ss_sold_date_sk = d_date_sk where sr_ticket_number is null group by d_year, ss_item_sk, ss_customer_sk ) select ss_item_sk, round(ss_qty/(coalesce(ws_qty+cs_qty,1)),2) ratio, ss_qty store_qty, ss_wc store_wholesale_cost, ss_sp store_sales_price, coalesce(ws_qty,0)+coalesce(cs_qty,0) other_chan_qty, coalesce(ws_wc,0)+coalesce(cs_wc,0) other_chan_wholesale_cost, coalesce(ws_sp,0)+coalesce(cs_sp,0) other_chan_sales_price from ss left join ws on (ws_sold_year=ss_sold_year and ws_item_sk=ss_item_sk and ws_customer_sk=ss_customer_sk) left join cs on (cs_sold_year=ss_sold_year and cs_item_sk=cs_item_sk and cs_customer_sk=ss_customer_sk) where coalesce(ws_qty,0)>0 and coalesce(cs_qty, 0)>0 and ss_sold_year=2000 order by ss_item_sk, ss_qty desc, ss_wc desc, ss_sp desc, other_chan_qty, other_chan_wholesale_cost, other_chan_sales_price, round(ss_qty/(coalesce(ws_qty+cs_qty,1)),2) limit 100 Coordinator: vd1309.halxg.cloudera.com:22000 Query Options (non default): MEM_LIMIT=10737418240 Plan: ---------------- Estimated Per-Host Requirements: Memory=683.01GB VCores=4 PLAN-ROOT SINK | 38:MERGING-EXCHANGE [UNPARTITIONED] | order by: ss_item_sk ASC, ss_qty DESC, ss_wc DESC, ss_sp DESC, coalesce(ws_qty, 0) + coalesce(cs_qty, 0) ASC, coalesce(ws_wc, 0) + coalesce(cs_wc, 0) ASC, coalesce(ws_sp, 0) + coalesce(cs_sp, 0) ASC, round(ss_qty / (coalesce(ws_qty + cs_qty, 1)), 2) ASC | limit: 100 | hosts=7 per-host-mem=unavailable | tuple-ids=15 row-size=128B cardinality=100 | 20:TOP-N [LIMIT=100] | order by: ss_item_sk ASC, ss_qty DESC, ss_wc DESC, ss_sp DESC, coalesce(ws_qty, 0) + coalesce(cs_qty, 0) ASC, coalesce(ws_wc, 0) + coalesce(cs_wc, 0) ASC, coalesce(ws_sp, 0) + coalesce(cs_sp, 0) ASC, round(ss_qty / (coalesce(ws_qty + cs_qty, 1)), 2) ASC | hosts=7 per-host-mem=12.50KB | tuple-ids=15 row-size=128B cardinality=100 | 19:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | hash predicates: d_year = d_year, ss_customer_sk = cs_bill_customer_sk | other predicates: coalesce(sum(cs_quantity), 0) > 0 | hosts=7 per-host-mem=2.40GB | tuple-ids=3,8N,13N row-size=168B cardinality=5889461911 | |--37:EXCHANGE [HASH(d_year,cs_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 35:AGGREGATE [FINALIZE] | | output: sum:merge(cs_quantity), sum:merge(cs_wholesale_cost), sum:merge(cs_sales_price) | | group by: d_year, cs_item_sk, cs_bill_customer_sk | | having: coalesce(sum(cs_quantity), 0) > 0 | | hosts=7 per-host-mem=16.77GB | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 34:EXCHANGE [HASH(d_year,cs_item_sk,cs_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 17:AGGREGATE [STREAMING] | | output: sum(cs_quantity), sum(cs_wholesale_cost), sum(cs_sales_price) | | group by: d_year, cs_item_sk, cs_bill_customer_sk | | hosts=7 per-host-mem=16.77GB | | tuple-ids=13 row-size=56B cardinality=292389050 | | | 16:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: cs_sold_date_sk = d_date_sk | | runtime filters: RF002 <- d_date_sk | | hosts=7 per-host-mem=3.21KB | | tuple-ids=10,11N,12 row-size=64B cardinality=292389050 | | | |--33:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=12 row-size=8B cardinality=373 | | | | | 14:SCAN HDFS [tpcds_10000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | table stats: 73049 rows total | | column stats: all | | parquet statistics predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | parquet dictionary predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | hosts=1 per-host-mem=32.00MB | | tuple-ids=12 row-size=8B cardinality=373 | | | 15:HASH JOIN [LEFT OUTER JOIN, BROADCAST] | | hash predicates: cs_item_sk = cr_item_sk, cs_order_number = cr_order_number | | other predicates: cr_order_number IS NULL | | hosts=7 per-host-mem=2.36GB | | tuple-ids=10,11N row-size=56B cardinality=1439996471 | | | |--32:EXCHANGE [BROADCAST] | | | hosts=7 per-host-mem=0B | | | tuple-ids=11 row-size=16B cardinality=144003311 | | | | | 13:SCAN HDFS [tpcds_10000_parquet.catalog_returns, RANDOM] | | partitions=2104/2104 files=2104 size=106.77GB | | predicates: tpcds_10000_parquet.catalog_returns.cr_item_sk = tpcds_10000_parquet.catalog_returns.cr_item_sk | | table stats: 1440033112 rows total | | column stats: all | | parquet dictionary predicates: tpcds_10000_parquet.catalog_returns.cr_item_sk = tpcds_10000_parquet.catalog_returns.cr_item_sk | | hosts=7 per-host-mem=128.00MB | | tuple-ids=11 row-size=16B cardinality=144003311 | | | 12:SCAN HDFS [tpcds_10000_parquet.catalog_sales, RANDOM] | partitions=1837/1837 files=5055 size=971.94GB | predicates: tpcds_10000_parquet.catalog_sales.cs_item_sk = tpcds_10000_parquet.catalog_sales.cs_item_sk | runtime filters: RF002 -> cs_sold_date_sk | table stats: 14399964710 rows total | column stats: all | parquet dictionary predicates: tpcds_10000_parquet.catalog_sales.cs_item_sk = tpcds_10000_parquet.catalog_sales.cs_item_sk | hosts=7 per-host-mem=528.00MB | tuple-ids=10 row-size=40B cardinality=1439996471 | 36:EXCHANGE [HASH(d_year,ss_customer_sk)] | hosts=7 per-host-mem=0B | tuple-ids=3,8N row-size=112B cardinality=5889461911 | 18:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | hash predicates: d_year = d_year, ss_customer_sk = ws_bill_customer_sk, ss_item_sk = ws_item_sk | other predicates: coalesce(sum(ws_quantity), 0) > 0 | hosts=7 per-host-mem=12.07GB | tuple-ids=3,8N row-size=112B cardinality=5889461911 | |--31:EXCHANGE [HASH(d_year,ws_item_sk,ws_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 30:AGGREGATE [FINALIZE] | | output: sum:merge(ws_quantity), sum:merge(ws_wholesale_cost), sum:merge(ws_sales_price) | | group by: d_year, ws_item_sk, ws_bill_customer_sk | | having: coalesce(sum(ws_quantity), 0) > 0 | | hosts=7 per-host-mem=84.47GB | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 29:EXCHANGE [HASH(d_year,ws_item_sk,ws_bill_customer_sk)] | | hosts=7 per-host-mem=0B | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 11:AGGREGATE [STREAMING] | | output: sum(ws_quantity), sum(ws_wholesale_cost), sum(ws_sales_price) | | group by: d_year, ws_item_sk, ws_bill_customer_sk | | hosts=7 per-host-mem=84.47GB | | tuple-ids=8 row-size=56B cardinality=1472360921 | | | 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ws_sold_date_sk = d_date_sk | | runtime filters: RF001 <- d_date_sk | | hosts=7 per-host-mem=3.21KB | | tuple-ids=5,6N,7 row-size=60B cardinality=1472360921 | | | |--28:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=7 row-size=8B cardinality=373 | | | | | 08:SCAN HDFS [tpcds_10000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | table stats: 73049 rows total | | column stats: all | | parquet statistics predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | parquet dictionary predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | | hosts=1 per-host-mem=32.00MB | | tuple-ids=7 row-size=8B cardinality=373 | | | 09:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | | hash predicates: ws_item_sk = wr_item_sk, ws_order_number = wr_order_number | | other predicates: wr_order_number IS NULL | | hosts=7 per-host-mem=1.69GB | | tuple-ids=5,6N row-size=52B cardinality=7199963324 | | | |--27:EXCHANGE [HASH(wr_item_sk,wr_order_number)] | | | hosts=7 per-host-mem=0B | | | tuple-ids=6 row-size=16B cardinality=720020485 | | | | | 07:SCAN HDFS [tpcds_10000_parquet.web_returns, RANDOM] | | partitions=2185/2185 files=2190 size=52.11GB | | table stats: 720020485 rows total | | column stats: all | | hosts=7 per-host-mem=80.00MB | | tuple-ids=6 row-size=16B cardinality=720020485 | | | 26:EXCHANGE [HASH(ws_item_sk,ws_order_number)] | | hosts=7 per-host-mem=0B | | tuple-ids=5 row-size=36B cardinality=7199963324 | | | 06:SCAN HDFS [tpcds_10000_parquet.web_sales, RANDOM] | partitions=1824/1824 files=2900 size=508.98GB | runtime filters: RF001 -> ws_sold_date_sk | table stats: 7199963324 rows total | column stats: all | hosts=7 per-host-mem=528.00MB | tuple-ids=5 row-size=36B cardinality=7199963324 | 25:AGGREGATE [FINALIZE] | output: sum:merge(ss_quantity), sum:merge(ss_wholesale_cost), sum:merge(ss_sales_price) | group by: d_year, ss_item_sk, ss_customer_sk | having: d_year = 2000 | hosts=7 per-host-mem=337.88GB | tuple-ids=3 row-size=56B cardinality=5889461911 | 24:EXCHANGE [HASH(d_year,ss_item_sk,ss_customer_sk)] | hosts=7 per-host-mem=0B | tuple-ids=3 row-size=56B cardinality=5889461911 | 05:AGGREGATE [STREAMING] | output: sum(ss_quantity), sum(ss_wholesale_cost), sum(ss_sales_price) | group by: d_year, ss_item_sk, ss_customer_sk | hosts=7 per-host-mem=337.88GB | tuple-ids=3 row-size=56B cardinality=5889461911 | 04:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF000 <- d_date_sk | hosts=7 per-host-mem=3.21KB | tuple-ids=0,1N,2 row-size=60B cardinality=5889461911 | |--23:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=8B cardinality=373 | | | 02:SCAN HDFS [tpcds_10000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.15MB | predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | table stats: 73049 rows total | column stats: all | parquet statistics predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | parquet dictionary predicates: tpcds_10000_parquet.date_dim.d_year = 2000 | hosts=1 per-host-mem=32.00MB | tuple-ids=2 row-size=8B cardinality=373 | 03:HASH JOIN [LEFT OUTER JOIN, PARTITIONED] | hash predicates: ss_item_sk = sr_item_sk, ss_ticket_number = sr_ticket_number | other predicates: sr_ticket_number IS NULL | hosts=7 per-host-mem=6.74GB | tuple-ids=0,1N row-size=52B cardinality=28799942425 | |--22:EXCHANGE [HASH(sr_item_sk,sr_ticket_number)] | | hosts=7 per-host-mem=0B | | tuple-ids=1 row-size=16B cardinality=2879765003 | | | 01:SCAN HDFS [tpcds_10000_parquet.store_returns, RANDOM] | partitions=2004/2004 files=2017 size=160.68GB | table stats: 2879765003 rows total | column stats: all | hosts=7 per-host-mem=176.00MB | tuple-ids=1 row-size=16B cardinality=2879765003 | 21:EXCHANGE [HASH(ss_item_sk,ss_ticket_number)] | hosts=7 per-host-mem=0B | tuple-ids=0 row-size=36B cardinality=28799942425 | 00:SCAN HDFS [tpcds_10000_parquet.store_sales, RANDOM] partitions=1824/1824 files=5994 size=1.35TB runtime filters: RF000 -> ss_sold_date_sk table stats: 28799942425 rows total column stats: all hosts=7 per-host-mem=528.00MB tuple-ids=0 row-size=36B cardinality=28799942425 ---------------- Estimated Per-Host Mem: 733375883211 Estimated Per-Host VCores: 4 Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail -------------------------------------------------------------------------------------------------------------------------------- 38:MERGING-EXCHANGE 1 0.000ns 0.000ns 0 100 4.00 KB -1.00 B UNPARTITIONED 20:TOP-N 7 0.000ns 0.000ns 0 100 8.00 KB 12.50 KB 19:HASH JOIN 7 19m45s 19m45s 0 5.89B 34.05 MB 2.40 GB LEFT OUTER JOIN, PARTITIONED |--37:EXCHANGE 7 0.000ns 0.000ns 0 292.39M 0 0 HASH(d_year,cs_bill_custome... | 35:AGGREGATE 7 0.000ns 0.000ns 0 292.39M 34.10 MB 16.77 GB FINALIZE | 34:EXCHANGE 7 9s113ms 17s544ms 885.80M 292.39M 0 0 HASH(d_year,cs_item_sk,cs_b... | 17:AGGREGATE 7 23s662ms 27s058ms 885.63M 292.39M 82.05 MB 16.77 GB STREAMING | 16:HASH JOIN 7 7s433ms 7s771ms 888.54M 292.39M 42.95 MB 3.21 KB INNER JOIN, BROADCAST | |--33:EXCHANGE 7 17.726us 23.491us 366 373 0 0 BROADCAST | | 14:SCAN HDFS 1 10.873ms 10.873ms 366 373 1.54 MB 32.00 MB tpcds_10000_parquet.date_dim | 15:HASH JOIN 7 11m18s 12m9s 888.54M 1.44B 5.44 GB 2.36 GB LEFT OUTER JOIN, BROADCAST | |--32:EXCHANGE 7 58s056ms 58s775ms 1.44B 144.00M 0 0 BROADCAST | | 13:SCAN HDFS 7 2s101ms 2s395ms 1.44B 144.00M 125.11 MB 128.00 MB tpcds_10000_parquet.catalog... | 12:SCAN HDFS 7 9s187ms 20s076ms 2.87B 1.44B 297.82 MB 528.00 MB tpcds_10000_parquet.catalog... 36:EXCHANGE 7 0.000ns 0.000ns 0 5.89B 0 0 HASH(d_year,ss_customer_sk) 18:HASH JOIN 7 19m45s 19m45s 0 5.89B 34.06 MB 12.07 GB LEFT OUTER JOIN, PARTITIONED |--31:EXCHANGE 7 0.000ns 0.000ns 0 1.47B 0 0 HASH(d_year,ws_item_sk,ws_b... | 30:AGGREGATE 7 4m21s 5m9s 0 1.47B 482.04 MB 84.47 GB FINALIZE | 29:EXCHANGE 7 12s561ms 19s483ms 1.30B 1.47B 0 0 HASH(d_year,ws_item_sk,ws_b... | 11:AGGREGATE 7 45s515ms 46s215ms 1.30B 1.47B 34.27 MB 84.47 GB STREAMING | 10:HASH JOIN 7 7s071ms 7s358ms 1.30B 1.47B 34.16 MB 3.21 KB INNER JOIN, BROADCAST | |--28:EXCHANGE 7 17.335us 25.054us 366 373 0 0 BROADCAST | | 08:SCAN HDFS 1 7.601ms 7.601ms 366 373 1.54 MB 32.00 MB tpcds_10000_parquet.date_dim | 09:HASH JOIN 7 6m27s 7m53s 1.30B 7.20B 2.66 GB 1.69 GB LEFT OUTER JOIN, PARTITIONED | |--27:EXCHANGE 7 4s120ms 4s315ms 720.02M 720.02M 0 0 HASH(wr_item_sk,wr_order_nu... | | 07:SCAN HDFS 7 1s517ms 2s112ms 720.02M 720.02M 109.08 MB 80.00 MB tpcds_10000_parquet.web_ret... | 26:EXCHANGE 7 12s848ms 17s260ms 1.45B 7.20B 0 0 HASH(ws_item_sk,ws_order_nu... | 06:SCAN HDFS 7 2s673ms 5s847ms 1.45B 7.20B 376.46 MB 528.00 MB tpcds_10000_parquet.web_sales 25:AGGREGATE 7 0.000ns 0.000ns 0 5.89B 34.10 MB 337.88 GB FINALIZE 24:EXCHANGE 7 11s045ms 21s806ms 1.14B 5.89B 0 0 HASH(d_year,ss_item_sk,ss_c... 05:AGGREGATE 7 48s885ms 56s051ms 1.14B 5.89B 2.71 GB 337.88 GB STREAMING 04:HASH JOIN 7 7s149ms 7s456ms 1.26B 5.89B 34.81 MB 3.21 KB INNER JOIN, BROADCAST |--23:EXCHANGE 7 22.065us 28.348us 366 373 0 0 BROADCAST | 02:SCAN HDFS 1 17.025ms 17.025ms 366 373 1.54 MB 32.00 MB tpcds_10000_parquet.date_dim 03:HASH JOIN 7 8m13s 8m52s 1.26B 28.80B 2.07 GB 6.74 GB LEFT OUTER JOIN, PARTITIONED |--22:EXCHANGE 7 16s364ms 16s975ms 2.88B 2.88B 0 0 HASH(sr_item_sk,sr_ticket_n... | 01:SCAN HDFS 7 1s518ms 1s788ms 2.88B 2.88B 231.29 MB 176.00 MB tpcds_10000_parquet.store_r... 21:EXCHANGE 7 50s494ms 1m6s 5.53B 28.80B 0 0 HASH(ss_item_sk,ss_ticket_n... 00:SCAN HDFS 7 6s821ms 11s442ms 5.53B 28.80B 474.67 MB 528.00 MB tpcds_10000_parquet.store_s... Planner Timeline: 242.277ms - Analysis finished: 15.065ms (15.065ms) - Equivalence classes computed: 16.590ms (1.524ms) - Single node plan created: 200.806ms (184.216ms) - Runtime filters computed: 201.266ms (459.869us) - Distributed plan created: 204.792ms (3.526ms) - Lineage info computed: 205.588ms (795.946us) - Planning finished: 242.277ms (36.688ms) Query Timeline: 19m48s - Query submitted: 49.995us (49.995us) - Planning finished: 481.470ms (481.420ms) - Submit for admission: 648.866ms (167.395ms) - Completed admission: 649.808ms (942.278us) - Ready to start 88 fragment instances: 735.857ms (86.049ms) - All 88 fragment instances started: 1s107ms (371.404ms) - First dynamic filter received: 1s268ms (161.244ms) - Rows available: 19m46s (19m45s) - Unregister query: 19m47s (382.999ms) - ComputeScanRangeAssignmentTimer: 63.259ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile 8d463de3722df36f:a2dae93a00000000:(Total: 19m46s, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 3 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 2 16 12 7 LOCAL true 0 (7) N/A N/A true 1 10 6 7 REMOTE true 1 (3) N/A N/A true 0 4 0 7 REMOTE true 1 (3) N/A N/A true Fragment instance start latencies: Count: 88, min / max: 2ms / 59ms, 25th %-ile: 4ms, 50th %-ile: 16ms, 75th %-ile: 37ms, 90th %-ile: 45ms, 95th %-ile: 49ms, 99.9th %-ile: 59ms Per Node Peak Memory Usage: vd1310.halxg.cloudera.com:22000(9.08 GB) vd1313.halxg.cloudera.com:22000(9.10 GB) vd1312.halxg.cloudera.com:22000(9.07 GB) vd1311.halxg.cloudera.com:22000(9.06 GB) vd1314.halxg.cloudera.com:22000(9.12 GB) vd1316.halxg.cloudera.com:22000(9.11 GB) vd1309.halxg.cloudera.com:22000(8.97 GB) Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 2 16 12 7 LOCAL true 0 (7) N/A N/A true 1 10 6 7 REMOTE true 0 (3) 1s469ms 1s469ms false 0 4 0 7 REMOTE true 0 (3) 1s268ms 1s268ms false - FiltersReceived: 2 (2) - FinalizationTimer: 0.000ns Coordinator Fragment F15: Instance 8d463de3722df36f:a2dae93a00000000 (host=vd1309.halxg.cloudera.com:22000):(Total: 67.019ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 41.58 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB, 17.42 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.53 MB (1601536) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 66.861ms - ExecTreePrepareTime: 222.884us PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 261.696ms, non-child: 261.696ms, % non-child: 100.00%) - CodegenTime: 5.218ms - CompileTime: 72.249ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 115 (115) - NumInstructions: 3.11K (3112) - OptimizationTime: 131.869ms - PeakMemoryUsage: 1.52 MB (1593344) - PrepareTime: 55.993ms EXCHANGE_NODE (id=38): ExecOption: Codegen Enabled BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - MergeGetNext: 0.000ns - MergeGetNextBatch: 0.000ns - PeakMemoryUsage: 4.00 KB (4096) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F14:(Total: 48.440ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:19m46s max:19m46s mean: 19m46s stddev:3.062ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.368ms - ExecTreePrepareTime: 395.940us DataStreamSender (dst_id=38):(Total: 24.362us, non-child: 24.362us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 549.361ms, non-child: 549.361ms, % non-child: 100.00%) - CodegenTime: 4.838ms - CompileTime: 147.997ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 364.506ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 36.143ms SORT_NODE (id=20):(Total: 395.143us, non-child: 0.000ns, % non-child: 0.00%) - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 634.119us, non-child: 19m45s, % non-child: 100.00%) - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F14: Instance 8d463de3722df36f:a2dae93a00000053 (host=vd1309.halxg.cloudera.com:22000):(Total: 83.658ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 83.564ms - ExecTreePrepareTime: 1.077ms DataStreamSender (dst_id=38):(Total: 11.214us, non-child: 11.214us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 542.550ms, non-child: 542.550ms, % non-child: 100.00%) - CodegenTime: 5.820ms - CompileTime: 132.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 347.818ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 60.693ms SORT_NODE (id=20):(Total: 1.076ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 2.004ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 8d463de3722df36f:a2dae93a00000051 (host=vd1316.halxg.cloudera.com:22000):(Total: 53.149ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.076ms - ExecTreePrepareTime: 261.411us DataStreamSender (dst_id=38):(Total: 38.335us, non-child: 38.335us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 663.308ms, non-child: 663.308ms, % non-child: 100.00%) - CodegenTime: 6.483ms - CompileTime: 182.957ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 440.691ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 39.058ms SORT_NODE (id=20):(Total: 260.386us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 366.487us, non-child: 19m44s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 8d463de3722df36f:a2dae93a00000054 (host=vd1314.halxg.cloudera.com:22000):(Total: 48.508ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 48.457ms - ExecTreePrepareTime: 176.453us DataStreamSender (dst_id=38):(Total: 13.769us, non-child: 13.769us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 522.517ms, non-child: 522.517ms, % non-child: 100.00%) - CodegenTime: 4.464ms - CompileTime: 126.248ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 359.339ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 36.281ms SORT_NODE (id=20):(Total: 176.030us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 258.500us, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 8d463de3722df36f:a2dae93a00000052 (host=vd1311.halxg.cloudera.com:22000):(Total: 44.707ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 44.656ms - ExecTreePrepareTime: 380.280us DataStreamSender (dst_id=38):(Total: 39.595us, non-child: 39.595us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 647.091ms, non-child: 647.091ms, % non-child: 100.00%) - CodegenTime: 4.388ms - CompileTime: 204.189ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 408.757ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 33.474ms SORT_NODE (id=20):(Total: 379.297us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 508.401us, non-child: 19m44s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 8d463de3722df36f:a2dae93a00000056 (host=vd1310.halxg.cloudera.com:22000):(Total: 39.057ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 38.989ms - ExecTreePrepareTime: 298.341us DataStreamSender (dst_id=38):(Total: 36.281us, non-child: 36.281us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 489.152ms, non-child: 489.152ms, % non-child: 100.00%) - CodegenTime: 5.172ms - CompileTime: 124.539ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 334.413ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 29.670ms SORT_NODE (id=20):(Total: 297.472us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 406.530us, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 8d463de3722df36f:a2dae93a00000057 (host=vd1312.halxg.cloudera.com:22000):(Total: 38.223ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 38.116ms - ExecTreePrepareTime: 280.319us DataStreamSender (dst_id=38):(Total: 19.989us, non-child: 19.989us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 466.125ms, non-child: 466.125ms, % non-child: 100.00%) - CodegenTime: 3.991ms - CompileTime: 125.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 310.430ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 29.987ms SORT_NODE (id=20):(Total: 279.361us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 404.352us, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 8d463de3722df36f:a2dae93a00000055 (host=vd1313.halxg.cloudera.com:22000):(Total: 31.777ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB, 34.09 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 37.19 MB (38999280) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 31.721ms - ExecTreePrepareTime: 297.502us DataStreamSender (dst_id=38):(Total: 11.354us, non-child: 11.354us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 1008.00 B (1008) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 514.788ms, non-child: 514.788ms, % non-child: 100.00%) - CodegenTime: 3.545ms - CompileTime: 140.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 202 (202) - NumInstructions: 6.42K (6416) - OptimizationTime: 350.092ms - PeakMemoryUsage: 3.13 MB (3284992) - PrepareTime: 23.836ms SORT_NODE (id=20):(Total: 297.037us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - InsertBatchTime: 0.000ns - PeakMemoryUsage: 8.00 KB (8192) - RowsReturned: 0 (0) - RowsReturnedRate: 0 HASH_JOIN_NODE (id=19):(Total: 490.337us, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.05 MB (35709184) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=19): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.12 KB (14464) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=37): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=36): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 45.547ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:19m46s max:19m46s mean: 19m46s stddev:2.663ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 90.62 MB (95024486) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m37s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 45.460ms - ExecTreePrepareTime: 2.010ms DataStreamSender (dst_id=36):(Total: 158.399us, non-child: 158.399us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 378.510ms, non-child: 378.510ms, % non-child: 100.00%) - CodegenTime: 2.820ms - CompileTime: 113.264ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 232.644ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 31.894ms HASH_JOIN_NODE (id=18):(Total: 3.750ms, non-child: 19m45s, % non-child: 100.00%) - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.591ms, non-child: 0.000ns, % non-child: 0.00%) - BufferPoolAllocTime: 1s093ms - BufferPoolAllocationBytes: 8.67 GB (9308958134) - BufferPoolAllocations: 4.44K (4438) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.64 GB (9273306550) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 8.64 GB (9273306550) - BufferPoolWriteIoBytes: 8.64 GB (9273306550) - BufferPoolWriteIoOps: 4.42K (4421) - BufferPoolWriteIoWaitTime: 3m20s - BuildTime: 4m2s - GetResultsTime: 0.000ns - HTResizeTime: 8.799ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 15m41s, non-child: 15m41s, % non-child: 100.00%) - BytesReceived: 4.39 GB (4717172478) - ConvertRowBatchTime: 3s847ms - DeserializeRowBatchTimer: 40s744ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.56M (162558071) - RowsReturnedRate: 172.87 K/sec - SendersBlockedTimer: 45s222ms - SendersBlockedTotalTimer(*): 4m50s Fragment F04: Instance 8d463de3722df36f:a2dae93a00000036 (host=vd1309.halxg.cloudera.com:22000):(Total: 64.824ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.16 MB, 68.14 MB, 68.14 MB, 70.46 MB, 69.82 MB, 69.37 MB, 70.25 MB, 68.40 MB, 71.40 MB, 71.56 MB, 68.19 MB, 78.16 MB, 76.22 MB, 69.47 MB, 71.82 MB, 71.31 MB, 69.97 MB, 73.52 MB, 69.69 MB, 68.75 MB, 71.31 MB, 75.59 MB, 69.84 MB, 70.23 MB, 72.57 MB, 68.37 MB, 68.64 MB, 68.34 MB, 71.17 MB, 77.20 MB, 69.99 MB, 68.92 MB, 69.04 MB, 72.33 MB, 68.40 MB, 69.95 MB, 68.26 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024498) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 14m42s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 64.651ms - ExecTreePrepareTime: 4.179ms DataStreamSender (dst_id=36):(Total: 873.803us, non-child: 873.803us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 429.539ms, non-child: 429.539ms, % non-child: 100.00%) - CodegenTime: 3.378ms - CompileTime: 128.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 259.703ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 40.487ms HASH_JOIN_NODE (id=18):(Total: 7.879ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 3.514ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s350ms - BufferPoolAllocationBytes: 8.67 GB (9313452032) - BufferPoolAllocations: 4.44K (4441) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.64 GB (9277800448) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.64 GB (9277800448) - BufferPoolWriteIoBytes: 8.64 GB (9277800448) - BufferPoolWriteIoOps: 4.42K (4424) - BufferPoolWriteIoWaitTime: 3m53s - BuildTime: 4m56s - GetResultsTime: 0.000ns - HTResizeTime: 9.787ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 14m47s, non-child: 21s806ms, % non-child: 2.46%) BytesReceived(32s000ms): 0, 0, 0, 7.16 MB, 100.38 MB, 224.42 MB, 309.81 MB, 359.14 MB, 403.16 MB, 485.78 MB, 559.30 MB, 605.56 MB, 638.82 MB, 681.63 MB, 794.49 MB, 908.47 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.24 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.71 GB, 3.92 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4718057991) - ConvertRowBatchTime: 3s800ms - DeserializeRowBatchTimer: 1m19s - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.59M (162587796) - RowsReturnedRate: 183.22 K/sec - SendersBlockedTimer: 54s558ms - SendersBlockedTotalTimer(*): 5m48s Instance 8d463de3722df36f:a2dae93a00000037 (host=vd1314.halxg.cloudera.com:22000):(Total: 46.147ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.51 MB, 69.54 MB, 71.25 MB, 75.75 MB, 72.68 MB, 71.75 MB, 82.09 MB, 82.64 MB, 77.27 MB, 70.95 MB, 77.74 MB, 69.75 MB, 68.90 MB, 68.69 MB, 69.29 MB, 68.21 MB, 68.17 MB, 68.65 MB, 69.89 MB, 69.79 MB, 70.67 MB, 68.80 MB, 68.23 MB, 68.63 MB, 68.52 MB, 68.40 MB, 68.91 MB, 68.27 MB, 70.30 MB, 68.40 MB, 68.52 MB, 68.18 MB, 68.22 MB, 68.75 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m22s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.087ms - ExecTreePrepareTime: 2.619ms DataStreamSender (dst_id=36):(Total: 37.350us, non-child: 37.350us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 345.360ms, non-child: 345.360ms, % non-child: 100.00%) - CodegenTime: 3.840ms - CompileTime: 104.260ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 208.070ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 32.340ms HASH_JOIN_NODE (id=18):(Total: 4.632ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.854ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 947.556ms - BufferPoolAllocationBytes: 8.67 GB (9309257728) - BufferPoolAllocations: 4.44K (4439) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.64 GB (9273606144) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.64 GB (9273606144) - BufferPoolWriteIoBytes: 8.64 GB (9273606144) - BufferPoolWriteIoOps: 4.42K (4422) - BufferPoolWriteIoWaitTime: 3m40s - BuildTime: 4m17s - GetResultsTime: 0.000ns - HTResizeTime: 6.897ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 15m27s, non-child: 8s791ms, % non-child: 0.95%) BytesReceived(32s000ms): 0, 0, 0, 7.38 MB, 101.05 MB, 225.03 MB, 310.19 MB, 359.45 MB, 403.73 MB, 486.34 MB, 559.79 MB, 605.96 MB, 639.17 MB, 682.29 MB, 795.47 MB, 909.29 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.24 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.71 GB, 3.93 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4717853030) - ConvertRowBatchTime: 3s879ms - DeserializeRowBatchTimer: 34s577ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.58M (162584065) - RowsReturnedRate: 175.34 K/sec - SendersBlockedTimer: 1m5s - SendersBlockedTotalTimer(*): 7m30s Instance 8d463de3722df36f:a2dae93a0000003a (host=vd1312.halxg.cloudera.com:22000):(Total: 44.685ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 73.00 MB, 69.43 MB, 71.01 MB, 71.43 MB, 75.06 MB, 73.94 MB, 69.68 MB, 68.31 MB, 68.45 MB, 68.19 MB, 71.87 MB, 69.89 MB, 69.78 MB, 69.52 MB, 68.31 MB, 68.18 MB, 68.17 MB, 68.57 MB, 68.21 MB, 69.09 MB, 69.34 MB, 68.19 MB, 68.59 MB, 69.84 MB, 68.23 MB, 70.37 MB, 70.58 MB, 68.18 MB, 68.96 MB, 69.09 MB, 68.23 MB, 68.32 MB, 68.41 MB, 68.40 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 16m33s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 44.617ms - ExecTreePrepareTime: 1.463ms DataStreamSender (dst_id=36):(Total: 41.713us, non-child: 41.713us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 339.843ms, non-child: 339.843ms, % non-child: 100.00%) - CodegenTime: 2.443ms - CompileTime: 98.508ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 209.735ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 30.186ms HASH_JOIN_NODE (id=18):(Total: 2.593ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 972.465us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s211ms - BufferPoolAllocationBytes: 8.67 GB (9307160576) - BufferPoolAllocations: 4.44K (4438) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolWriteIoBytes: 8.63 GB (9271508992) - BufferPoolWriteIoOps: 4.42K (4421) - BufferPoolWriteIoWaitTime: 2m25s - BuildTime: 3m6s - GetResultsTime: 0.000ns - HTResizeTime: 8.534ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 16m37s, non-child: 9s590ms, % non-child: 0.96%) BytesReceived(32s000ms): 0, 0, 0, 7.61 MB, 101.75 MB, 225.65 MB, 310.54 MB, 359.66 MB, 404.09 MB, 486.68 MB, 560.00 MB, 605.94 MB, 639.12 MB, 682.61 MB, 796.02 MB, 909.74 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.25 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.71 GB, 3.93 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4716532915) - ConvertRowBatchTime: 3s883ms - DeserializeRowBatchTimer: 36s495ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.54M (162539580) - RowsReturnedRate: 162.92 K/sec - SendersBlockedTimer: 17s040ms - SendersBlockedTotalTimer(*): 1m52s Instance 8d463de3722df36f:a2dae93a00000034 (host=vd1316.halxg.cloudera.com:22000):(Total: 43.703ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.16 MB, 68.14 MB, 68.14 MB, 69.87 MB, 72.48 MB, 72.00 MB, 69.10 MB, 69.30 MB, 69.72 MB, 68.26 MB, 69.44 MB, 68.91 MB, 68.18 MB, 68.23 MB, 69.78 MB, 68.25 MB, 68.73 MB, 70.21 MB, 68.19 MB, 68.17 MB, 68.20 MB, 73.89 MB, 71.75 MB, 72.06 MB, 71.21 MB, 72.67 MB, 72.19 MB, 79.98 MB, 72.94 MB, 70.20 MB, 69.38 MB, 68.43 MB, 68.45 MB, 68.20 MB, 68.19 MB, 68.41 MB, 68.29 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 16m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 43.624ms - ExecTreePrepareTime: 1.657ms DataStreamSender (dst_id=36):(Total: 37.911us, non-child: 37.911us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 416.455ms, non-child: 416.455ms, % non-child: 100.00%) - CodegenTime: 2.583ms - CompileTime: 126.719ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 255.898ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 33.361ms HASH_JOIN_NODE (id=18):(Total: 3.156ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.367ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s101ms - BufferPoolAllocationBytes: 8.67 GB (9311354880) - BufferPoolAllocations: 4.44K (4440) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.64 GB (9275703296) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.64 GB (9275703296) - BufferPoolWriteIoBytes: 8.64 GB (9275703296) - BufferPoolWriteIoOps: 4.42K (4423) - BufferPoolWriteIoWaitTime: 2m52s - BuildTime: 3m30s - GetResultsTime: 0.000ns - HTResizeTime: 9.463ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 16m13s, non-child: 8s655ms, % non-child: 0.89%) BytesReceived(32s000ms): 0, 0, 0, 7.21 MB, 100.52 MB, 224.57 MB, 309.92 MB, 359.22 MB, 403.31 MB, 485.88 MB, 559.33 MB, 605.54 MB, 638.81 MB, 681.75 MB, 794.69 MB, 908.67 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.24 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.70 GB, 3.92 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4717026465) - ConvertRowBatchTime: 3s896ms - DeserializeRowBatchTimer: 29s933ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.55M (162554791) - RowsReturnedRate: 166.94 K/sec - SendersBlockedTimer: 44s779ms - SendersBlockedTotalTimer(*): 4m41s Instance 8d463de3722df36f:a2dae93a00000039 (host=vd1310.halxg.cloudera.com:22000):(Total: 41.266ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.16 MB, 68.14 MB, 68.14 MB, 68.31 MB, 69.58 MB, 68.70 MB, 72.96 MB, 81.18 MB, 68.79 MB, 68.71 MB, 71.55 MB, 73.33 MB, 70.81 MB, 68.21 MB, 72.77 MB, 69.45 MB, 70.11 MB, 68.54 MB, 68.77 MB, 68.17 MB, 68.42 MB, 74.91 MB, 69.76 MB, 68.44 MB, 72.63 MB, 68.63 MB, 68.43 MB, 69.44 MB, 68.47 MB, 72.91 MB, 82.14 MB, 68.19 MB, 68.42 MB, 68.70 MB, 68.20 MB, 68.50 MB, 68.25 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m46s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 41.203ms - ExecTreePrepareTime: 1.031ms DataStreamSender (dst_id=36):(Total: 27.136us, non-child: 27.136us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 410.073ms, non-child: 410.073ms, % non-child: 100.00%) - CodegenTime: 2.640ms - CompileTime: 131.752ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 246.681ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 31.071ms HASH_JOIN_NODE (id=18):(Total: 1.943ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 791.697us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 972.154ms - BufferPoolAllocationBytes: 8.67 GB (9307160576) - BufferPoolAllocations: 4.44K (4438) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolWriteIoBytes: 8.63 GB (9271508992) - BufferPoolWriteIoOps: 4.42K (4421) - BufferPoolWriteIoWaitTime: 3m14s - BuildTime: 3m53s - GetResultsTime: 0.000ns - HTResizeTime: 10.195ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 15m50s, non-child: 8s607ms, % non-child: 0.91%) BytesReceived(32s000ms): 0, 0, 0, 7.17 MB, 100.37 MB, 224.35 MB, 309.65 MB, 358.99 MB, 403.03 MB, 485.58 MB, 559.02 MB, 605.28 MB, 638.57 MB, 681.42 MB, 794.40 MB, 908.37 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.24 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.70 GB, 3.92 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4717303693) - ConvertRowBatchTime: 3s890ms - DeserializeRowBatchTimer: 30s855ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.56M (162561105) - RowsReturnedRate: 170.94 K/sec - SendersBlockedTimer: 39s405ms - SendersBlockedTotalTimer(*): 3m59s Instance 8d463de3722df36f:a2dae93a00000035 (host=vd1311.halxg.cloudera.com:22000):(Total: 39.437ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.16 MB, 68.14 MB, 68.14 MB, 68.63 MB, 70.24 MB, 69.93 MB, 70.49 MB, 81.05 MB, 70.80 MB, 68.57 MB, 68.78 MB, 74.00 MB, 69.53 MB, 68.19 MB, 68.82 MB, 73.48 MB, 70.16 MB, 73.18 MB, 68.18 MB, 68.17 MB, 68.45 MB, 72.66 MB, 73.49 MB, 72.24 MB, 71.80 MB, 68.38 MB, 71.74 MB, 69.96 MB, 69.26 MB, 69.17 MB, 68.33 MB, 68.24 MB, 68.77 MB, 68.98 MB, 68.20 MB, 68.20 MB, 68.90 MB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024498) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m43s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 39.378ms - ExecTreePrepareTime: 1.967ms DataStreamSender (dst_id=36):(Total: 61.328us, non-child: 61.328us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 372.274ms, non-child: 372.274ms, % non-child: 100.00%) - CodegenTime: 2.564ms - CompileTime: 112.420ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 231.191ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 28.086ms HASH_JOIN_NODE (id=18):(Total: 3.833ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 1.694ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 952.670ms - BufferPoolAllocationBytes: 8.67 GB (9307160576) - BufferPoolAllocations: 4.44K (4438) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolWriteIoBytes: 8.63 GB (9271508992) - BufferPoolWriteIoOps: 4.42K (4421) - BufferPoolWriteIoWaitTime: 3m21s - BuildTime: 3m56s - GetResultsTime: 0.000ns - HTResizeTime: 8.215ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 15m47s, non-child: 9s637ms, % non-child: 1.02%) BytesReceived(32s000ms): 0, 0, 0, 7.19 MB, 100.42 MB, 224.52 MB, 309.87 MB, 359.14 MB, 403.21 MB, 485.81 MB, 559.29 MB, 605.51 MB, 638.77 MB, 681.63 MB, 794.61 MB, 908.60 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.24 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.70 GB, 3.92 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4716405435) - ConvertRowBatchTime: 3s706ms - DeserializeRowBatchTimer: 35s110ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.53M (162527813) - RowsReturnedRate: 171.47 K/sec - SendersBlockedTimer: 39s653ms - SendersBlockedTotalTimer(*): 3m59s Instance 8d463de3722df36f:a2dae93a00000038 (host=vd1313.halxg.cloudera.com:22000):(Total: 38.765ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 68.14 MB, 68.14 MB, 68.14 MB, 68.26 MB, 70.40 MB, 69.48 MB, 69.26 MB, 73.16 MB, 83.95 MB, 70.76 MB, 68.30 MB, 72.68 MB, 79.58 MB, 68.97 MB, 70.57 MB, 70.90 MB, 72.83 MB, 75.42 MB, 70.27 MB, 68.19 MB, 72.35 MB, 71.19 MB, 69.13 MB, 69.97 MB, 71.66 MB, 69.37 MB, 69.36 MB, 68.63 MB, 69.67 MB, 69.11 MB, 68.74 MB, 70.64 MB, 70.77 MB, 69.73 MB, 68.19 MB, 68.34 MB, 68.22 MB ThreadUsage(32s000ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 68.00 MB (71303168) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 90.62 MB (95024482) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m2s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 38.659ms - ExecTreePrepareTime: 1.154ms DataStreamSender (dst_id=36):(Total: 29.552us, non-child: 29.552us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.64 KB (16016) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 336.026ms, non-child: 336.026ms, % non-child: 100.00%) - CodegenTime: 2.291ms - CompileTime: 90.579ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 87 (87) - NumInstructions: 3.49K (3488) - OptimizationTime: 217.229ms - PeakMemoryUsage: 1.70 MB (1785856) - PrepareTime: 27.732ms HASH_JOIN_NODE (id=18):(Total: 2.214ms, non-child: 19m45s, % non-child: 100.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 0.000ns - BufferPoolAllocationBytes: 0 - BufferPoolAllocations: 0 (0) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.06 MB (35719424) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=18): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 23.12 KB (23680) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=31): BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 941.462us, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s121ms - BufferPoolAllocationBytes: 8.67 GB (9307160576) - BufferPoolAllocations: 4.44K (4438) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 8.63 GB (9271508992) - BufferPoolWriteIoBytes: 8.63 GB (9271508992) - BufferPoolWriteIoOps: 4.42K (4421) - BufferPoolWriteIoWaitTime: 3m56s - BuildTime: 4m37s - GetResultsTime: 0.000ns - HTResizeTime: 8.500ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=24):(Total: 15m6s, non-child: 10s230ms, % non-child: 1.13%) BytesReceived(32s000ms): 0, 0, 0, 7.62 MB, 101.76 MB, 225.76 MB, 310.67 MB, 359.74 MB, 404.10 MB, 486.66 MB, 560.07 MB, 606.08 MB, 639.19 MB, 682.64 MB, 795.97 MB, 909.67 MB, 1.00 GB, 1.12 GB, 1.17 GB, 1.20 GB, 1.27 GB, 1.37 GB, 1.60 GB, 1.88 GB, 2.25 GB, 2.41 GB, 2.57 GB, 2.75 GB, 2.91 GB, 3.17 GB, 3.33 GB, 3.50 GB, 3.71 GB, 3.93 GB, 4.05 GB, 4.13 GB, 4.31 GB - BytesReceived: 4.39 GB (4717027820) - ConvertRowBatchTime: 3s878ms - DeserializeRowBatchTimer: 38s474ms - FirstBatchArrivalWaitTime: 1m55s - PeakMemoryUsage: 0 - RowsReturned: 162.55M (162551347) - RowsReturnedRate: 179.26 K/sec - SendersBlockedTimer: 55s537ms - SendersBlockedTotalTimer(*): 6m2s Averaged Fragment F02:(Total: 1m50s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:19m46s max:19m46s mean: 19m46s stddev:4.416ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.39 GB (3642753024) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 3.39 GB (3644298093) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 162.56M (162557799) - TotalNetworkReceiveTime: 3m11s - TotalNetworkSendTime: 5m47s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 12.04K (12035) - TotalThreadsTotalWallClockTime: 3m40s - TotalThreadsSysTime: 8s209ms - TotalThreadsUserTime: 37s299ms - TotalThreadsVoluntaryContextSwitches: 233.89K (233887) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11m3s - OpenTime: 1m50s - ExecTreeOpenTime: 1m49s - PrepareTime: 54.419ms - ExecTreePrepareTime: 2.545ms DataStreamSender (dst_id=24):(Total: 42s896ms, non-child: 42s896ms, % non-child: 100.00%) - BytesSent: 4.39 GB (4717134307) - NetworkThroughput(*): 371.58 MB/sec - OverallThroughput: 104.79 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 162.56M (162557657) - SerializeBatchTime: 30s700ms - TransmitDataRPCTime: 12s116ms - UncompressedRowBatchSize: 9.24 GB (9918227898) CodeGen:(Total: 568.891ms, non-child: 568.891ms, % non-child: 100.00%) - CodegenTime: 3.471ms - CompileTime: 166.599ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 365.317ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 36.242ms AGGREGATION_NODE (id=5):(Total: 12m53s, non-child: 48s885ms, % non-child: 6.32%) - BufferPoolAllocTime: 152.890ms - BufferPoolAllocationBytes: 1.69 GB (1818530377) - BufferPoolAllocations: 527 (527) - BufferPoolPeakReservation: 1.29 GB (1387415844) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.29 GB (1387415844) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s844ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.29 GB (1387468196) - ReductionFactorEstimate: 27.21 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 162.56M (162557799) - RowsReturned: 162.56M (162557799) - RowsReturnedRate: 210.35 K/sec - StreamingTime: 50s493ms HASH_JOIN_NODE (id=4):(Total: 12m4s, non-child: 7s149ms, % non-child: 0.99%) - BufferPoolAllocTime: 1.287ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 16.941ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.78 MB (36470494) - ProbeRows: 179.81M (179808008) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s758ms - RowsReturned: 179.81M (179807861) - RowsReturnedRate: 248.63 K/sec Hash Join Builder (join_node_id=4): - BuildRowsPartitionTime: 11.212ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 857.738us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 22.065us, non-child: 22.065us, % non-child: 100.00%) - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 11.489us - DeserializeRowBatchTimer: 75.869us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 17.10 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 11m56s, non-child: 8m13s, % non-child: 68.84%) - BufferPoolAllocTime: 3s103ms - BufferPoolAllocationBytes: 39.90 GB (42838224310) - BufferPoolAllocations: 18.09K (18090) - BufferPoolPeakReservation: 2.07 GB (2219685595) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33999327817) - BufferPoolPeakUsedReservation: 2.07 GB (2219685595) - BufferPoolReadIoBytes: 3.25 GB (3492057673) - BufferPoolReadIoOps: 1.67K (1665) - BufferPoolReadIoWaitTime: 5m8s - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33999327817) - BufferPoolWriteIoBytes: 31.66 GB (33999327817) - BufferPoolWriteIoOps: 16.21K (16212) - BufferPoolWriteIoWaitTime: 8s235ms - BuildRows: 411.39M (411395000) - BuildTime: 47s723ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.07 GB (2219797523) - ProbeRows: 789.98M (789975808) - ProbeRowsPartitioned: 169.27M (169270452) - ProbeTime: 2m11s - RowsReturned: 179.81M (179807999) - RowsReturnedRate: 251.12 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 42s872ms - BuildRowsPartitioned: 411.39M (411395000) - HashBuckets: 297.20M (297196397) - HashCollisions: 22.08M (22081024) - HashTablesBuildTime: 1m51s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesReceived: 5.86 GB (6295909221) - ConvertRowBatchTime: 10s202ms - DeserializeRowBatchTimer: 18s475ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.39M (411395000) - RowsReturnedRate: 6.78 M/sec - SendersBlockedTimer: 3s900ms - SendersBlockedTotalTimer(*): 25s732ms EXCHANGE_NODE (id=21):(Total: 2m42s, non-child: 2m42s, % non-child: 100.00%) - BytesReceived: 21.47 GB (23052395037) - ConvertRowBatchTime: 18s480ms - DeserializeRowBatchTimer: 1m18s - FirstBatchArrivalWaitTime: 47.273ms - PeakMemoryUsage: 0 - RowsReturned: 789.98M (789975808) - RowsReturnedRate: 4.87 M/sec - SendersBlockedTimer: 2m20s - SendersBlockedTotalTimer(*): 15m14s Fragment F02: Instance 8d463de3722df36f:a2dae93a00000015 (host=vd1310.halxg.cloudera.com:22000):(Total: 1m56s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.36 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.18 GB, 3.27 GB, 3.67 GB, 3.67 GB ThreadUsage(32s000ms): 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.10 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.66 GB (3934257152) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.67 GB (3935832064) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 167.90M (167904510) - TotalNetworkReceiveTime: 3m5s - TotalNetworkSendTime: 5m33s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 11.48K (11484) - TotalThreadsTotalWallClockTime: 3m51s - TotalThreadsSysTime: 8s446ms - TotalThreadsUserTime: 37s539ms - TotalThreadsVoluntaryContextSwitches: 246.33K (246328) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11m20s - OpenTime: 1m56s - ExecTreeOpenTime: 1m55s - PrepareTime: 37.427ms - ExecTreePrepareTime: 1.024ms DataStreamSender (dst_id=24):(Total: 44s087ms, non-child: 44s087ms, % non-child: 100.00%) - BytesSent: 4.54 GB (4872510395) - NetworkThroughput(*): 372.42 MB/sec - OverallThroughput: 105.40 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 167.90M (167904510) - SerializeBatchTime: 31s526ms - TransmitDataRPCTime: 12s477ms - UncompressedRowBatchSize: 9.54 GB (10244442819) CodeGen:(Total: 600.270ms, non-child: 600.270ms, % non-child: 100.00%) - CodegenTime: 3.474ms - CompileTime: 176.133ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 400.224ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 23.305ms AGGREGATION_NODE (id=5):(Total: 13m15s, non-child: 53s946ms, % non-child: 6.78%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 160.803ms - BufferPoolAllocationBytes: 2.05 GB (2199912448) - BufferPoolAllocations: 633 (633) - BufferPoolPeakReservation: 1.56 GB (1677721600) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.56 GB (1677721600) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s982ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.56 GB (1677773952) - ReductionFactorEstimate: 12.78 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 167.90M (167904510) - RowsReturned: 167.90M (167904510) - RowsReturnedRate: 210.97 K/sec - StreamingTime: 52s694ms HASH_JOIN_NODE (id=4):(Total: 12m21s, non-child: 7s374ms, % non-child: 0.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2.936ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 20.553ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.79 MB (36479840) - ProbeRows: 188.92M (188917447) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s970ms - RowsReturned: 188.92M (188917447) - RowsReturnedRate: 254.63 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 14.290ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 884.137us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 19.103us, non-child: 19.103us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.404us - DeserializeRowBatchTimer: 51.632us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 19.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 12m14s, non-child: 8m37s, % non-child: 70.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2s920ms - BufferPoolAllocationBytes: 40.44 GB (43417337856) - BufferPoolAllocations: 18.15K (18148) - BufferPoolPeakReservation: 2.07 GB (2220883968) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolPeakUsedReservation: 2.07 GB (2220883968) - BufferPoolReadIoBytes: 3.36 GB (3611295744) - BufferPoolReadIoOps: 1.72K (1722) - BufferPoolReadIoWaitTime: 5m21s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolWriteIoBytes: 31.66 GB (33999028224) - BufferPoolWriteIoOps: 16.21K (16212) - BufferPoolWriteIoWaitTime: 9s869ms - BuildRows: 411.42M (411422470) - BuildTime: 48s736ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.07 GB (2220994726) - ProbeRows: 789.97M (789968773) - ProbeRowsPartitioned: 197.49M (197485319) - ProbeTime: 2m13s - RowsReturned: 188.92M (188917447) - RowsReturnedRate: 257.18 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 38s373ms - BuildRowsPartitioned: 411.42M (411422470) - HashBuckets: 335.54M (335544320) - HashCollisions: 22.90M (22903386) - HashTablesBuildTime: 2m1s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 1m5s, non-child: 15s815ms, % non-child: 24.12%) BytesReceived(32s000ms): 1.16 GB, 3.20 GB, 4.69 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6296295937) - ConvertRowBatchTime: 10s108ms - DeserializeRowBatchTimer: 17s702ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.42M (411422470) - RowsReturnedRate: 6.27 M/sec - SendersBlockedTimer: 1s637ms - SendersBlockedTotalTimer(*): 8s829ms EXCHANGE_NODE (id=21):(Total: 2m31s, non-child: 46s807ms, % non-child: 30.99%) BytesReceived(32s000ms): 9.78 MB, 10.10 MB, 10.10 MB, 151.40 MB, 1.80 GB, 3.96 GB, 5.46 GB, 6.32 GB, 7.09 GB, 8.53 GB, 9.81 GB, 10.62 GB, 11.20 GB, 11.95 GB, 13.92 GB, 15.91 GB, 17.97 GB, 20.01 GB, 20.91 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23052144528) - ConvertRowBatchTime: 18s560ms - DeserializeRowBatchTimer: 1m13s - FirstBatchArrivalWaitTime: 21.103ms - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789968773) - RowsReturnedRate: 5.23 M/sec - SendersBlockedTimer: 2m47s - SendersBlockedTotalTimer(*): 19m29s Instance 8d463de3722df36f:a2dae93a00000010 (host=vd1316.halxg.cloudera.com:22000):(Total: 1m51s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.36 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.79 GB, 2.97 GB, 2.97 GB ThreadUsage(32s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.97 GB (3191865344) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.97 GB (3193440256) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 179.44M (179440795) - TotalNetworkReceiveTime: 3m6s - TotalNetworkSendTime: 5m49s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10.81K (10814) - TotalThreadsTotalWallClockTime: 3m42s - TotalThreadsSysTime: 7s995ms - TotalThreadsUserTime: 37s838ms - TotalThreadsVoluntaryContextSwitches: 225.70K (225700) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11m6s - OpenTime: 1m51s - ExecTreeOpenTime: 1m51s - PrepareTime: 56.874ms - ExecTreePrepareTime: 2.085ms DataStreamSender (dst_id=24):(Total: 46s831ms, non-child: 46s831ms, % non-child: 100.00%) - BytesSent: 4.85 GB (5207249164) - NetworkThroughput(*): 367.95 MB/sec - OverallThroughput: 106.04 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 179.44M (179439800) - SerializeBatchTime: 33s251ms - TransmitDataRPCTime: 13s496ms - UncompressedRowBatchSize: 10.20 GB (10948297464) CodeGen:(Total: 574.893ms, non-child: 574.893ms, % non-child: 100.00%) - CodegenTime: 3.767ms - CompileTime: 156.267ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 379.355ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 38.730ms AGGREGATION_NODE (id=5):(Total: 12m56s, non-child: 52s094ms, % non-child: 6.71%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 77.156ms - BufferPoolAllocationBytes: 1.11 GB (1193279488) - BufferPoolAllocations: 393 (393) - BufferPoolPeakReservation: 896.00 MB (939524096) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 896.00 MB (939524096) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s553ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 896.05 MB (939576448) - ReductionFactorEstimate: 22.25 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 179.44M (179440795) - RowsReturned: 179.44M (179440795) - RowsReturnedRate: 230.96 K/sec - StreamingTime: 51s011ms HASH_JOIN_NODE (id=4):(Total: 12m4s, non-child: 7s456ms, % non-child: 1.03%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3.072ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 21.708ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.81 MB (36496194) - ProbeRows: 191.88M (191875616) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 7s056ms - RowsReturned: 191.87M (191874592) - RowsReturnedRate: 264.71 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.148ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.253ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 20.200us, non-child: 20.200us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.876us - DeserializeRowBatchTimer: 44.747us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 18.12 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 11m57s, non-child: 8m19s, % non-child: 69.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s240ms - BufferPoolAllocationBytes: 40.56 GB (43549458432) - BufferPoolAllocations: 18.21K (18211) - BufferPoolPeakReservation: 2.06 GB (2216689664) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33996931072) - BufferPoolPeakUsedReservation: 2.06 GB (2216689664) - BufferPoolReadIoBytes: 3.49 GB (3745513472) - BufferPoolReadIoOps: 1.79K (1786) - BufferPoolReadIoWaitTime: 4m57s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33996931072) - BufferPoolWriteIoBytes: 31.66 GB (33996931072) - BufferPoolWriteIoOps: 16.21K (16211) - BufferPoolWriteIoWaitTime: 14s663ms - BuildRows: 411.38M (411382487) - BuildTime: 55s289ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.06 GB (2216800422) - ProbeRows: 789.98M (789983243) - ProbeRowsPartitioned: 197.49M (197487059) - ProbeTime: 2m12s - RowsReturned: 191.88M (191875556) - RowsReturnedRate: 267.46 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 49s322ms - BuildRowsPartitioned: 411.38M (411382487) - HashBuckets: 335.54M (335544320) - HashCollisions: 22.89M (22893446) - HashTablesBuildTime: 1m56s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 54s361ms, non-child: 16s659ms, % non-child: 30.65%) BytesReceived(32s000ms): 1.17 GB, 3.20 GB, 4.69 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6295737113) - ConvertRowBatchTime: 10s210ms - DeserializeRowBatchTimer: 18s721ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.38M (411382487) - RowsReturnedRate: 7.57 M/sec - SendersBlockedTimer: 9s114ms - SendersBlockedTotalTimer(*): 1m2s EXCHANGE_NODE (id=21):(Total: 2m43s, non-child: 45s173ms, % non-child: 27.63%) BytesReceived(32s000ms): 9.77 MB, 10.08 MB, 10.08 MB, 152.34 MB, 1.80 GB, 3.97 GB, 5.46 GB, 6.32 GB, 7.09 GB, 8.53 GB, 9.82 GB, 10.62 GB, 11.20 GB, 11.95 GB, 13.92 GB, 15.91 GB, 17.97 GB, 20.01 GB, 20.91 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23052564762) - ConvertRowBatchTime: 18s551ms - DeserializeRowBatchTimer: 1m11s - FirstBatchArrivalWaitTime: 37.682ms - PeakMemoryUsage: 0 - RowsReturned: 789.98M (789983243) - RowsReturnedRate: 4.83 M/sec - SendersBlockedTimer: 2m15s - SendersBlockedTotalTimer(*): 13m53s Instance 8d463de3722df36f:a2dae93a00000016 (host=vd1312.halxg.cloudera.com:22000):(Total: 1m49s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.39 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.60 GB, 3.54 GB, 4.54 GB, 4.81 GB ThreadUsage(32s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.81 GB (5161091072) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.81 GB (5162665984) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 144.11M (144111442) - TotalNetworkReceiveTime: 3m4s - TotalNetworkSendTime: 6m5s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 11.21K (11210) - TotalThreadsTotalWallClockTime: 3m38s - TotalThreadsSysTime: 7s983ms - TotalThreadsUserTime: 37s195ms - TotalThreadsVoluntaryContextSwitches: 224.69K (224694) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10m33s - OpenTime: 1m49s - ExecTreeOpenTime: 1m49s - PrepareTime: 55.316ms - ExecTreePrepareTime: 2.300ms DataStreamSender (dst_id=24):(Total: 39s066ms, non-child: 39s066ms, % non-child: 100.00%) - BytesSent: 3.89 GB (4181842555) - NetworkThroughput(*): 378.40 MB/sec - OverallThroughput: 102.09 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 144.11M (144111442) - SerializeBatchTime: 28s453ms - TransmitDataRPCTime: 10s539ms - UncompressedRowBatchSize: 8.19 GB (8792763408) CodeGen:(Total: 624.076ms, non-child: 624.076ms, % non-child: 100.00%) - CodegenTime: 2.911ms - CompileTime: 180.645ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 403.196ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 39.652ms AGGREGATION_NODE (id=5):(Total: 12m22s, non-child: 56s051ms, % non-child: 7.55%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 295.303ms - BufferPoolAllocationBytes: 3.70 GB (3967811584) - BufferPoolAllocations: 980 (980) - BufferPoolPeakReservation: 2.71 GB (2908749824) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 2.71 GB (2908749824) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 3s078ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.71 GB (2908802176) - ReductionFactorEstimate: 8.36 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 144.11M (144111442) - RowsReturned: 144.11M (144111442) - RowsReturnedRate: 194.08 K/sec - StreamingTime: 55s192ms HASH_JOIN_NODE (id=4):(Total: 11m26s, non-child: 7s137ms, % non-child: 1.04%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 782.962us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 13.781ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 177.75M (177749283) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s761ms - RowsReturned: 177.75M (177749283) - RowsReturnedRate: 258.93 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.784ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 197.648us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 28.348us, non-child: 28.348us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 14.132us - DeserializeRowBatchTimer: 26.815us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 12.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 11m19s, non-child: 7m43s, % non-child: 68.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2s915ms - BufferPoolAllocationBytes: 40.23 GB (43199234048) - BufferPoolAllocations: 18.04K (18044) - BufferPoolPeakReservation: 2.06 GB (2216689664) - BufferPoolPeakUnpinnedBytes: 31.67 GB (34003222528) - BufferPoolPeakUsedReservation: 2.06 GB (2216689664) - BufferPoolReadIoBytes: 3.16 GB (3388997632) - BufferPoolReadIoOps: 1.62K (1616) - BufferPoolReadIoWaitTime: 4m56s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.67 GB (34003222528) - BufferPoolWriteIoBytes: 31.67 GB (34003222528) - BufferPoolWriteIoOps: 16.21K (16214) - BufferPoolWriteIoWaitTime: 9s907ms - BuildRows: 411.39M (411391204) - BuildTime: 50s654ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.06 GB (2216800422) - ProbeRows: 790.02M (790021543) - ProbeRowsPartitioned: 148.12M (148122641) - ProbeTime: 2m10s - RowsReturned: 177.75M (177749283) - RowsReturnedRate: 261.65 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 46s611ms - BuildRowsPartitioned: 411.39M (411391204) - HashBuckets: 268.44M (268435456) - HashCollisions: 22.90M (22903377) - HashTablesBuildTime: 1m44s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 57s068ms, non-child: 16s468ms, % non-child: 28.86%) BytesReceived(32s000ms): 1.19 GB, 3.22 GB, 4.70 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6295865420) - ConvertRowBatchTime: 10s089ms - DeserializeRowBatchTimer: 19s057ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.39M (411391204) - RowsReturnedRate: 7.21 M/sec - SendersBlockedTimer: 5s014ms - SendersBlockedTotalTimer(*): 33s726ms EXCHANGE_NODE (id=21):(Total: 2m38s, non-child: 48s520ms, % non-child: 30.53%) BytesReceived(32s000ms): 9.87 MB, 10.09 MB, 10.09 MB, 159.85 MB, 1.82 GB, 3.99 GB, 5.47 GB, 6.33 GB, 7.10 GB, 8.54 GB, 9.83 GB, 10.63 GB, 11.21 GB, 11.97 GB, 13.94 GB, 15.93 GB, 17.99 GB, 20.03 GB, 20.92 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23053695682) - ConvertRowBatchTime: 18s686ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 790.02M (790021543) - RowsReturnedRate: 4.97 M/sec - SendersBlockedTimer: 2m6s - SendersBlockedTotalTimer(*): 14m41s Instance 8d463de3722df36f:a2dae93a00000013 (host=vd1314.halxg.cloudera.com:22000):(Total: 1m49s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.37 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.13 GB, 2.13 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.62 GB, 2.94 GB, 2.96 GB ThreadUsage(32s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.96 GB (3175088128) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.96 GB (3176663040) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 176.48M (176477426) - TotalNetworkReceiveTime: 3m18s - TotalNetworkSendTime: 5m53s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 11.22K (11216) - TotalThreadsTotalWallClockTime: 3m38s - TotalThreadsSysTime: 8s218ms - TotalThreadsUserTime: 38s149ms - TotalThreadsVoluntaryContextSwitches: 240.04K (240044) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11m5s - OpenTime: 1m49s - ExecTreeOpenTime: 1m48s - PrepareTime: 49.959ms - ExecTreePrepareTime: 3.179ms DataStreamSender (dst_id=24):(Total: 45s843ms, non-child: 45s843ms, % non-child: 100.00%) - BytesSent: 4.77 GB (5121117549) - NetworkThroughput(*): 371.63 MB/sec - OverallThroughput: 106.53 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 176.48M (176477426) - SerializeBatchTime: 32s617ms - TransmitDataRPCTime: 13s141ms - UncompressedRowBatchSize: 10.03 GB (10767531411) CodeGen:(Total: 624.939ms, non-child: 624.939ms, % non-child: 100.00%) - CodegenTime: 3.002ms - CompileTime: 195.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 396.451ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 32.907ms AGGREGATION_NODE (id=5):(Total: 12m54s, non-child: 52s068ms, % non-child: 6.73%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 286.161ms - BufferPoolAllocationBytes: 1.10 GB (1176502272) - BufferPoolAllocations: 385 (385) - BufferPoolPeakReservation: 880.00 MB (922746880) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 880.00 MB (922746880) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s743ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 880.05 MB (922799232) - ReductionFactorEstimate: 21.96 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 176.48M (176477426) - RowsReturned: 176.48M (176477426) - RowsReturnedRate: 228.00 K/sec - StreamingTime: 51s184ms HASH_JOIN_NODE (id=4):(Total: 12m1s, non-child: 7s286ms, % non-child: 1.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.045ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 15.483ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 188.50M (188499980) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s899ms - RowsReturned: 188.50M (188499980) - RowsReturnedRate: 261.10 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.043ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 929.010us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 19.375us, non-child: 19.375us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.495us - DeserializeRowBatchTimer: 15.332us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 18.89 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 11m54s, non-child: 8m4s, % non-child: 67.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 3s188ms - BufferPoolAllocationBytes: 40.52 GB (43505418240) - BufferPoolAllocations: 18.19K (18190) - BufferPoolPeakReservation: 2.06 GB (2216689664) - BufferPoolPeakUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolPeakUsedReservation: 2.06 GB (2216689664) - BufferPoolReadIoBytes: 3.44 GB (3697278976) - BufferPoolReadIoOps: 1.76K (1763) - BufferPoolReadIoWaitTime: 4m51s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolWriteIoBytes: 31.67 GB (34001125376) - BufferPoolWriteIoOps: 16.21K (16213) - BufferPoolWriteIoWaitTime: 7s307ms - BuildRows: 411.40M (411397332) - BuildTime: 45s460ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.06 GB (2216804518) - ProbeRows: 789.97M (789966113) - ProbeRowsPartitioned: 197.48M (197483622) - ProbeTime: 2m13s - RowsReturned: 188.50M (188499980) - RowsReturnedRate: 263.76 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 41s725ms - BuildRowsPartitioned: 411.40M (411397332) - HashBuckets: 335.54M (335544320) - HashCollisions: 22.89M (22890464) - HashTablesBuildTime: 1m46s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 1m2s, non-child: 15s886ms, % non-child: 25.60%) BytesReceived(32s000ms): 1.18 GB, 3.21 GB, 4.69 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6295942755) - ConvertRowBatchTime: 10s295ms - DeserializeRowBatchTimer: 17s495ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.40M (411397332) - RowsReturnedRate: 6.63 M/sec - SendersBlockedTimer: 4s505ms - SendersBlockedTotalTimer(*): 31s393ms EXCHANGE_NODE (id=21):(Total: 2m47s, non-child: 48s801ms, % non-child: 29.11%) BytesReceived(32s000ms): 9.81 MB, 10.08 MB, 10.08 MB, 155.07 MB, 1.81 GB, 3.97 GB, 5.46 GB, 6.32 GB, 7.10 GB, 8.54 GB, 9.82 GB, 10.63 GB, 11.21 GB, 11.96 GB, 13.93 GB, 15.92 GB, 17.98 GB, 20.02 GB, 20.91 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23052239271) - ConvertRowBatchTime: 18s488ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789966113) - RowsReturnedRate: 4.71 M/sec - SendersBlockedTimer: 1m58s - SendersBlockedTotalTimer(*): 11m57s Instance 8d463de3722df36f:a2dae93a00000011 (host=vd1311.halxg.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.36 GB, 2.16 GB, 2.16 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.15 GB, 2.69 GB, 3.69 GB, 4.08 GB ThreadUsage(32s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.07 GB (4374659072) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.08 GB (4376233984) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 150.65M (150645406) - TotalNetworkReceiveTime: 3m22s - TotalNetworkSendTime: 5m34s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10.90K (10897) - TotalThreadsTotalWallClockTime: 3m37s - TotalThreadsSysTime: 7s941ms - TotalThreadsUserTime: 36s701ms - TotalThreadsVoluntaryContextSwitches: 231.31K (231306) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11m7s - OpenTime: 1m48s - ExecTreeOpenTime: 1m48s - PrepareTime: 41.786ms - ExecTreePrepareTime: 1.175ms DataStreamSender (dst_id=24):(Total: 39s847ms, non-child: 39s847ms, % non-child: 100.00%) - BytesSent: 4.07 GB (4371846743) - NetworkThroughput(*): 381.46 MB/sec - OverallThroughput: 104.63 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 150.65M (150645406) - SerializeBatchTime: 28s845ms - TransmitDataRPCTime: 10s929ms - UncompressedRowBatchSize: 8.56 GB (9191418834) CodeGen:(Total: 500.672ms, non-child: 500.672ms, % non-child: 100.00%) - CodegenTime: 2.736ms - CompileTime: 155.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 316.752ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 27.571ms AGGREGATION_NODE (id=5):(Total: 12m55s, non-child: 54s565ms, % non-child: 7.03%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 149.526ms - BufferPoolAllocationBytes: 2.55 GB (2736783360) - BufferPoolAllocations: 796 (796) - BufferPoolPeakReservation: 1.97 GB (2113929216) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 1.97 GB (2113929216) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 2s158ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.97 GB (2113981568) - ReductionFactorEstimate: 11.71 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 150.65M (150645406) - RowsReturned: 150.65M (150645406) - RowsReturnedRate: 194.16 K/sec - StreamingTime: 53s575ms HASH_JOIN_NODE (id=4):(Total: 12m1s, non-child: 7s099ms, % non-child: 0.98%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 247.792us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 13.563ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 177.74M (177736169) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s699ms - RowsReturned: 177.74M (177736169) - RowsReturnedRate: 246.41 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.875ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 213.138us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 21.649us, non-child: 21.649us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 10.608us - DeserializeRowBatchTimer: 364.179us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 16.91 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 11m54s, non-child: 7m59s, % non-child: 67.19%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2s772ms - BufferPoolAllocationBytes: 39.20 GB (42085646336) - BufferPoolAllocations: 18.02K (18024) - BufferPoolPeakReservation: 2.07 GB (2225078272) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolPeakUsedReservation: 2.07 GB (2225078272) - BufferPoolReadIoBytes: 3.12 GB (3353346048) - BufferPoolReadIoOps: 1.60K (1599) - BufferPoolReadIoWaitTime: 5m13s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33999028224) - BufferPoolWriteIoBytes: 31.66 GB (33999028224) - BufferPoolWriteIoOps: 16.21K (16212) - BufferPoolWriteIoWaitTime: 7s914ms - BuildRows: 411.39M (411385166) - BuildTime: 47s560ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.07 GB (2225189030) - ProbeRows: 789.97M (789971622) - ProbeRowsPartitioned: 148.11M (148108567) - ProbeTime: 2m8s - RowsReturned: 177.74M (177736169) - RowsReturnedRate: 248.86 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 44s244ms - BuildRowsPartitioned: 411.39M (411385166) - HashBuckets: 268.44M (268435456) - HashCollisions: 22.89M (22894810) - HashTablesBuildTime: 1m54s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 59s615ms, non-child: 16s617ms, % non-child: 27.87%) BytesReceived(32s000ms): 1.17 GB, 3.20 GB, 4.69 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6295749566) - ConvertRowBatchTime: 10s297ms - DeserializeRowBatchTimer: 19s326ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.39M (411385166) - RowsReturnedRate: 6.90 M/sec - SendersBlockedTimer: 4s731ms - SendersBlockedTotalTimer(*): 30s686ms EXCHANGE_NODE (id=21):(Total: 2m54s, non-child: 48s843ms, % non-child: 27.95%) BytesReceived(32s000ms): 9.76 MB, 10.08 MB, 10.08 MB, 151.76 MB, 1.80 GB, 3.96 GB, 5.46 GB, 6.32 GB, 7.09 GB, 8.53 GB, 9.82 GB, 10.62 GB, 11.20 GB, 11.95 GB, 13.92 GB, 15.91 GB, 17.97 GB, 20.01 GB, 20.91 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23052292872) - ConvertRowBatchTime: 18s499ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 121.097ms - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789971622) - RowsReturnedRate: 4.52 M/sec - SendersBlockedTimer: 2m5s - SendersBlockedTotalTimer(*): 12m27s Instance 8d463de3722df36f:a2dae93a00000014 (host=vd1313.halxg.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.38 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.13 GB, 2.13 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.14 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.13 GB, 2.47 GB ThreadUsage(32s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.95 GB (3162505216) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.95 GB (3163871232) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 166.29M (166287552) - TotalNetworkReceiveTime: 3m20s - TotalNetworkSendTime: 6m2s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 10.92K (10917) - TotalThreadsTotalWallClockTime: 3m37s - TotalThreadsSysTime: 7s952ms - TotalThreadsUserTime: 36s816ms - TotalThreadsVoluntaryContextSwitches: 244.10K (244104) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 10m37s - OpenTime: 1m48s - ExecTreeOpenTime: 1m48s - PrepareTime: 39.531ms - ExecTreePrepareTime: 1.557ms DataStreamSender (dst_id=24):(Total: 43s968ms, non-child: 43s968ms, % non-child: 100.00%) - BytesSent: 4.49 GB (4824836836) - NetworkThroughput(*): 367.47 MB/sec - OverallThroughput: 104.65 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 166.29M (166287552) - SerializeBatchTime: 31s368ms - TransmitDataRPCTime: 12s521ms - UncompressedRowBatchSize: 9.45 GB (10145803356) CodeGen:(Total: 486.913ms, non-child: 486.913ms, % non-child: 100.00%) - CodegenTime: 2.366ms - CompileTime: 149.698ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 310.916ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 25.772ms AGGREGATION_NODE (id=5):(Total: 12m25s, non-child: 28s997ms, % non-child: 3.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 80.392ms - BufferPoolAllocationBytes: 1.08 GB (1163919360) - BufferPoolAllocations: 379 (379) - BufferPoolPeakReservation: 868.00 MB (910163968) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 868.00 MB (910163968) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 1s426ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 868.05 MB (910216320) - ReductionFactorEstimate: 21.50 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 166.29M (166287552) - RowsReturned: 166.29M (166287552) - RowsReturnedRate: 222.98 K/sec - StreamingTime: 46s542ms HASH_JOIN_NODE (id=4):(Total: 11m56s, non-child: 7s145ms, % non-child: 1.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 206.298us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 14.641ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 177.73M (177725746) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s755ms - RowsReturned: 177.73M (177725746) - RowsReturnedRate: 247.96 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.475ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 209.067us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 28.067us, non-child: 28.067us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 16.922us - DeserializeRowBatchTimer: 14.156us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 13.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 11m49s, non-child: 7m56s, % non-child: 67.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2s646ms - BufferPoolAllocationBytes: 39.21 GB (42100326400) - BufferPoolAllocations: 18.03K (18031) - BufferPoolPeakReservation: 2.06 GB (2216689664) - BufferPoolPeakUnpinnedBytes: 31.66 GB (33994833920) - BufferPoolPeakUsedReservation: 2.06 GB (2216689664) - BufferPoolReadIoBytes: 3.14 GB (3372220416) - BufferPoolReadIoOps: 1.61K (1608) - BufferPoolReadIoWaitTime: 4m58s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.66 GB (33994833920) - BufferPoolWriteIoBytes: 31.66 GB (33994833920) - BufferPoolWriteIoOps: 16.21K (16210) - BufferPoolWriteIoWaitTime: 6s517ms - BuildRows: 411.38M (411380486) - BuildTime: 42s574ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.06 GB (2216800422) - ProbeRows: 789.97M (789968934) - ProbeRowsPartitioned: 148.11M (148106612) - ProbeTime: 2m6s - RowsReturned: 177.73M (177725746) - RowsReturnedRate: 250.46 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 39s307ms - BuildRowsPartitioned: 411.38M (411380486) - HashBuckets: 268.44M (268435456) - HashCollisions: 22.90M (22897219) - HashTablesBuildTime: 1m34s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 1m4s, non-child: 16s125ms, % non-child: 24.94%) BytesReceived(32s000ms): 1.19 GB, 3.22 GB, 4.70 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6295684968) - ConvertRowBatchTime: 10s383ms - DeserializeRowBatchTimer: 17s873ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.38M (411380486) - RowsReturnedRate: 6.36 M/sec - SendersBlockedTimer: 1s760ms - SendersBlockedTotalTimer(*): 9s246ms EXCHANGE_NODE (id=21):(Total: 2m48s, non-child: 48s830ms, % non-child: 29.04%) BytesReceived(32s000ms): 9.87 MB, 10.09 MB, 10.09 MB, 159.66 MB, 1.82 GB, 3.98 GB, 5.47 GB, 6.33 GB, 7.10 GB, 8.54 GB, 9.83 GB, 10.63 GB, 11.21 GB, 11.97 GB, 13.94 GB, 15.93 GB, 17.99 GB, 20.03 GB, 20.91 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23052209088) - ConvertRowBatchTime: 18s928ms - DeserializeRowBatchTimer: 1m17s - FirstBatchArrivalWaitTime: 137.029ms - PeakMemoryUsage: 0 - RowsReturned: 789.97M (789968934) - RowsReturnedRate: 4.70 M/sec - SendersBlockedTimer: 2m4s - SendersBlockedTotalTimer(*): 14m31s Instance 8d463de3722df36f:a2dae93a00000012 (host=vd1309.halxg.cloudera.com:22000):(Total: 1m48s, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 1.36 GB, 2.16 GB, 2.16 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.15 GB, 2.14 GB, 2.15 GB, 2.14 GB, 2.15 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.14 GB, 2.28 GB ThreadUsage(32s000ms): 1, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.09 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.33 GB (2499805184) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.33 GB (2501380096) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 153.04M (153037464) - TotalNetworkReceiveTime: 3m5s - TotalNetworkSendTime: 5m31s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.71K (17713) - TotalThreadsTotalWallClockTime: 3m37s - TotalThreadsSysTime: 8s926ms - TotalThreadsUserTime: 36s855ms - TotalThreadsVoluntaryContextSwitches: 225.04K (225037) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 11m31s - OpenTime: 1m48s - ExecTreeOpenTime: 1m48s - PrepareTime: 100.042ms - ExecTreePrepareTime: 6.498ms DataStreamSender (dst_id=24):(Total: 40s632ms, non-child: 40s632ms, % non-child: 100.00%) - BytesSent: 4.14 GB (4440536912) - NetworkThroughput(*): 361.72 MB/sec - OverallThroughput: 104.22 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 153.04M (153037464) - SerializeBatchTime: 28s838ms - TransmitDataRPCTime: 11s707ms - UncompressedRowBatchSize: 8.70 GB (9337337997) CodeGen:(Total: 570.471ms, non-child: 570.471ms, % non-child: 100.00%) - CodegenTime: 6.043ms - CompileTime: 152.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 350.324ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 65.755ms AGGREGATION_NODE (id=5):(Total: 13m20s, non-child: 44s470ms, % non-child: 5.56%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 20.887ms - BufferPoolAllocationBytes: 278.00 MB (291504128) - BufferPoolAllocations: 123 (123) - BufferPoolPeakReservation: 228.00 MB (239075328) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 228.00 MB (239075328) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 970.121ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 228.05 MB (239127680) - ReductionFactorEstimate: 91.92 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 153.04M (153037464) - RowsReturned: 153.04M (153037464) - RowsReturnedRate: 191.28 K/sec - StreamingTime: 43s252ms HASH_JOIN_NODE (id=4):(Total: 12m35s, non-child: 6s550ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 723.062us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 18.856ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.77 MB (36463486) - ProbeRows: 156.15M (156151815) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s166ms - RowsReturned: 156.15M (156151815) - RowsReturnedRate: 206.66 K/sec Hash Join Builder (join_node_id=4): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.869ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.317ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=23):(Total: 17.716us, non-child: 17.716us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.991us - DeserializeRowBatchTimer: 14.222us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 20.66 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=3):(Total: 12m29s, non-child: 8m52s, % non-child: 71.09%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s039ms - BufferPoolAllocationBytes: 39.12 GB (42010148864) - BufferPoolAllocations: 17.99K (17988) - BufferPoolPeakReservation: 2.07 GB (2225078272) - BufferPoolPeakUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolPeakUsedReservation: 2.07 GB (2225078272) - BufferPoolReadIoBytes: 3.05 GB (3275751424) - BufferPoolReadIoOps: 1.56K (1562) - BufferPoolReadIoWaitTime: 5m39s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 31.67 GB (34001125376) - BufferPoolWriteIoBytes: 31.67 GB (34001125376) - BufferPoolWriteIoOps: 16.21K (16213) - BufferPoolWriteIoWaitTime: 1s469ms - BuildRows: 411.41M (411405858) - BuildTime: 43s785ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.07 GB (2225193126) - ProbeRows: 789.95M (789950432) - ProbeRowsPartitioned: 148.10M (148099345) - ProbeTime: 2m17s - RowsReturned: 156.15M (156151815) - RowsReturnedRate: 208.47 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 40s522ms - BuildRowsPartitioned: 411.41M (411405858) - HashBuckets: 268.44M (268435456) - HashCollisions: 17.18M (17184468) - HashTablesBuildTime: 2m4s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 15 (15) EXCHANGE_NODE (id=22):(Total: 1m3s, non-child: 16s975ms, % non-child: 26.85%) BytesReceived(32s000ms): 1.16 GB, 3.20 GB, 4.69 GB, 5.83 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB, 5.86 GB - BytesReceived: 5.86 GB (6296088793) - ConvertRowBatchTime: 10s032ms - DeserializeRowBatchTimer: 19s152ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 411.41M (411405858) - RowsReturnedRate: 6.51 M/sec - SendersBlockedTimer: 540.007ms - SendersBlockedTotalTimer(*): 3s652ms EXCHANGE_NODE (id=21):(Total: 2m33s, non-child: 1m6s, % non-child: 43.38%) BytesReceived(32s000ms): 9.76 MB, 10.08 MB, 10.08 MB, 151.19 MB, 1.80 GB, 3.96 GB, 5.46 GB, 6.32 GB, 7.09 GB, 8.53 GB, 9.81 GB, 10.62 GB, 11.20 GB, 11.95 GB, 13.92 GB, 15.91 GB, 17.96 GB, 20.01 GB, 20.90 GB, 21.45 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB, 21.47 GB - BytesReceived: 21.47 GB (23051619058) - ConvertRowBatchTime: 17s648ms - DeserializeRowBatchTimer: 1m31s - FirstBatchArrivalWaitTime: 14.001ms - PeakMemoryUsage: 0 - RowsReturned: 789.95M (789950432) - RowsReturnedRate: 5.15 M/sec - SendersBlockedTimer: 3m5s - SendersBlockedTotalTimer(*): 19m35s Averaged Fragment F00:(Total: 10m4s, non-child: 7m6s, % non-child: 70.68%) split sizes: min: 197.46 GB, max: 197.66 GB, avg: 197.53 GB, stddev: 71.02 MB completion times: min:9m54s max:10m17s mean: 10m4s stddev:9s279ms execution rates: min:327.32 MB/sec max:340.14 MB/sec mean:334.89 MB/sec stddev:5.16 MB/sec num instances: 7 - AverageThreadTokens: 6.43 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 455.35 MB (477465040) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 789.98M (789975808) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m22s - TotalStorageWaitTime: 4m58s - TotalThreadsInvoluntaryContextSwitches: 99.97K (99966) - TotalThreadsTotalWallClockTime: 1h4m - TotalThreadsSysTime: 15s809ms - TotalThreadsUserTime: 6m16s - TotalThreadsVoluntaryContextSwitches: 1.08M (1078606) Fragment Instance Lifecycle Timings: - ExecTime: 10m4s - ExecTreeExecTime: 7s160ms - OpenTime: 40.048ms - ExecTreeOpenTime: 852.739us - PrepareTime: 62.231ms - ExecTreePrepareTime: 7.869ms DataStreamSender (dst_id=21):(Total: 2m50s, non-child: 2m50s, % non-child: 100.00%) - BytesSent: 21.47 GB (23052395037) - NetworkThroughput(*): 460.07 MB/sec - OverallThroughput: 129.15 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 789.98M (789975808) - SerializeBatchTime: 2m2s - TransmitDataRPCTime: 47s787ms - UncompressedRowBatchSize: 30.17 GB (32396157268) CodeGen:(Total: 74.741ms, non-child: 74.741ms, % non-child: 100.00%) - CodegenTime: 1.274ms - CompileTime: 10.261ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 25.264ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 38.330ms HDFS_SCAN_NODE (id=0):(Total: 6s821ms, non-child: 6s821ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.37 - AverageScannerThreadConcurrency: 5.43 - BytesRead: 9.27 GB (9950729521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.27 GB (9950729521) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.27 GB (9950729521) - DecompressionTime: 39s403ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 166 (166) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 454.13 MB (476191934) - PerReadThreadRawHdfsThroughput: 42.02 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s351ms - RowBatchQueuePutWaitTime: 46m40s - RowsRead: 789.98M (789975808) - RowsReturned: 789.98M (789975808) - RowsReturnedRate: 133.72 M/sec - ScanRangesComplete: 856 (856) - ScannerThreadsInvoluntaryContextSwitches: 67.71K (67708) - ScannerThreadsTotalWallClockTime: 54m41s - MaterializeTupleTime(*): 2m1s - ScannerThreadsSysTime: 8s672ms - ScannerThreadsUserTime: 2m48s - ScannerThreadsVoluntaryContextSwitches: 1.04M (1042137) - TotalRawHdfsReadTime(*): 3m47s - TotalReadThroughput: 15.72 MB/sec Filter 0 (1.00 MB): - Files processed: 856 (856) - Files rejected: 689 (689) - Files total: 856 (856) - RowGroups processed: 771.54K (771542) - RowGroups rejected: 0 (0) - RowGroups total: 771.54K (771542) - Rows processed: 2.73M (2729106) - Rows rejected: 0 (0) - Rows total: 789.98M (789975808) - Splits processed: 166 (166) - Splits rejected: 0 (0) - Splits total: 166 (166) Fragment F00: Instance 8d463de3722df36f:a2dae93a00000003 (host=vd1309.halxg.cloudera.com:22000):(Total: 10m17s, non-child: 7m14s, % non-child: 70.30%) Hdfs split stats (:<# splits>/): 4:98/22.52 GB 2:93/21.82 GB 5:114/26.39 GB 3:109/24.99 GB 6:115/26.72 GB 1:104/24.36 GB 7:109/25.03 GB 0:110/25.63 GB Filter 0 arrival: 426ms MemoryUsage(16s000ms): 343.76 MB, 421.94 MB, 421.94 MB, 421.94 MB, 421.94 MB, 421.94 MB, 421.94 MB, 394.46 MB, 268.78 MB, 275.47 MB, 277.41 MB, 293.19 MB, 285.72 MB, 257.80 MB, 290.12 MB, 278.42 MB, 309.78 MB, 217.59 MB, 288.93 MB, 258.75 MB, 286.51 MB, 262.80 MB, 313.89 MB, 253.22 MB, 297.69 MB, 291.16 MB, 281.84 MB, 259.78 MB, 257.11 MB, 254.47 MB, 266.01 MB, 269.46 MB, 259.42 MB, 275.04 MB, 232.80 MB, 315.62 MB, 276.37 MB, 249.04 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.21 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 422.94 MB (443480159) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 786.04M (786044059) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m27s - TotalStorageWaitTime: 5m49s - TotalThreadsInvoluntaryContextSwitches: 121.72K (121720) - TotalThreadsTotalWallClockTime: 1h3m - TotalThreadsSysTime: 19s255ms - TotalThreadsUserTime: 6m17s - TotalThreadsVoluntaryContextSwitches: 1.34M (1336420) Fragment Instance Lifecycle Timings: - ExecTime: 10m17s - ExecTreeExecTime: 11s816ms - OpenTime: 44.889ms - ExecTreeOpenTime: 1.163ms - PrepareTime: 72.607ms - ExecTreePrepareTime: 11.917ms DataStreamSender (dst_id=21):(Total: 2m51s, non-child: 2m51s, % non-child: 100.00%) - BytesSent: 21.36 GB (22935738086) - NetworkThroughput(*): 453.46 MB/sec - OverallThroughput: 127.20 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 786.04M (786044059) - SerializeBatchTime: 2m3s - TransmitDataRPCTime: 48s235ms - UncompressedRowBatchSize: 30.02 GB (32234919955) CodeGen:(Total: 77.378ms, non-child: 77.378ms, % non-child: 100.00%) - CodegenTime: 1.364ms - CompileTime: 10.268ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 26.554ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 39.563ms HDFS_SCAN_NODE (id=0):(Total: 11s442ms, non-child: 11s442ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:98/22.52 GB 2:93/21.82 GB 5:114/26.39 GB 3:109/24.99 GB 6:115/26.72 GB 1:104/24.36 GB 7:109/25.03 GB 0:110/25.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 164 out of 164 Runtime filters: All filters arrived. Waited 341ms Hdfs Read Thread Concurrency Bucket: 0:72.12% 1:18.07% 2:5.835% 3:2.512% 4:1.216% 5:0.2431% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:688 PARQUET/SNAPPY:984 BytesRead(16s000ms): 294.46 MB, 366.50 MB, 366.50 MB, 366.50 MB, 366.50 MB, 366.50 MB, 366.50 MB, 366.50 MB, 649.90 MB, 1.10 GB, 1.60 GB, 2.01 GB, 2.35 GB, 2.51 GB, 2.72 GB, 2.88 GB, 3.02 GB, 3.21 GB, 3.61 GB, 3.83 GB, 4.20 GB, 4.30 GB, 4.53 GB, 4.56 GB, 4.79 GB, 4.85 GB, 5.00 GB, 5.27 GB, 5.69 GB, 6.21 GB, 6.61 GB, 6.98 GB, 7.41 GB, 7.95 GB, 8.38 GB, 8.70 GB, 8.74 GB, 9.01 GB - FooterProcessingTime: (Avg: 279.583ms ; Min: 1.201ms ; Max: 3s110ms ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 5.21 - BytesRead: 9.23 GB (9914213325) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.23 GB (9914213325) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.23 GB (9914213325) - DecompressionTime: 37s988ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 421.74 MB (442224947) - PerReadThreadRawHdfsThroughput: 36.40 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 7s588ms - RowBatchQueuePutWaitTime: 44m45s - RowsRead: 786.04M (786044059) - RowsReturned: 786.04M (786044059) - RowsReturnedRate: 68.70 M/sec - ScanRangesComplete: 852 (852) - ScannerThreadsInvoluntaryContextSwitches: 72.77K (72769) - ScannerThreadsTotalWallClockTime: 53m36s - MaterializeTupleTime(*): 1m58s - ScannerThreadsSysTime: 11s749ms - ScannerThreadsUserTime: 2m45s - ScannerThreadsVoluntaryContextSwitches: 1.30M (1301727) - TotalRawHdfsReadTime(*): 4m19s - TotalReadThroughput: 15.31 MB/sec Filter 0 (1.00 MB): - Files processed: 852 (852) - Files rejected: 688 (688) - Files total: 852 (852) - RowGroups processed: 767.70K (767700) - RowGroups rejected: 0 (0) - RowGroups total: 767.70K (767700) - Rows processed: 2.69M (2686976) - Rows rejected: 0 (0) - Rows total: 786.04M (786044059) - Splits processed: 164 (164) - Splits rejected: 0 (0) - Splits total: 164 (164) Instance 8d463de3722df36f:a2dae93a00000004 (host=vd1314.halxg.cloudera.com:22000):(Total: 10m13s, non-child: 7m11s, % non-child: 70.38%) Hdfs split stats (:<# splits>/): 7:121/28.05 GB 2:106/24.27 GB 6:102/23.53 GB 5:102/23.72 GB 1:94/21.60 GB 4:120/27.73 GB 0:105/24.14 GB 3:105/24.53 GB Filter 0 arrival: 461ms MemoryUsage(16s000ms): 426.37 MB, 467.86 MB, 467.86 MB, 467.86 MB, 467.86 MB, 467.86 MB, 467.84 MB, 443.17 MB, 278.15 MB, 292.08 MB, 250.70 MB, 290.73 MB, 255.08 MB, 261.67 MB, 294.39 MB, 289.51 MB, 325.02 MB, 255.54 MB, 272.68 MB, 302.57 MB, 272.96 MB, 267.75 MB, 293.78 MB, 267.40 MB, 292.99 MB, 281.48 MB, 248.24 MB, 249.88 MB, 258.85 MB, 243.68 MB, 244.55 MB, 279.17 MB, 239.26 MB, 257.99 MB, 293.12 MB, 270.91 MB, 310.73 MB, 188.31 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.42 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 470.05 MB (492886969) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 797.53M (797526158) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m26s - TotalStorageWaitTime: 5m12s - TotalThreadsInvoluntaryContextSwitches: 99.68K (99680) - TotalThreadsTotalWallClockTime: 1h5m - TotalThreadsSysTime: 15s005ms - TotalThreadsUserTime: 6m32s - TotalThreadsVoluntaryContextSwitches: 975.21K (975206) Fragment Instance Lifecycle Timings: - ExecTime: 10m13s - ExecTreeExecTime: 10s753ms - OpenTime: 43.056ms - ExecTreeOpenTime: 665.880us - PrepareTime: 59.303ms - ExecTreePrepareTime: 6.645ms DataStreamSender (dst_id=21):(Total: 2m51s, non-child: 2m51s, % non-child: 100.00%) - BytesSent: 21.67 GB (23268932696) - NetworkThroughput(*): 463.75 MB/sec - OverallThroughput: 129.64 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 797.53M (797526158) - SerializeBatchTime: 2m3s - TransmitDataRPCTime: 47s851ms - UncompressedRowBatchSize: 30.46 GB (32705789922) CodeGen:(Total: 82.011ms, non-child: 82.011ms, % non-child: 100.00%) - CodegenTime: 1.732ms - CompileTime: 7.467ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 31.393ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 41.684ms HDFS_SCAN_NODE (id=0):(Total: 10s412ms, non-child: 10s412ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:121/28.05 GB 2:106/24.27 GB 6:102/23.53 GB 5:102/23.72 GB 1:94/21.60 GB 4:120/27.73 GB 0:105/24.14 GB 3:105/24.53 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: All filters arrived. Waited 381ms Hdfs Read Thread Concurrency Bucket: 0:74.63% 1:17.94% 2:5.383% 3:1.631% 4:0.4078% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:687 PARQUET/SNAPPY:1008 BytesRead(16s000ms): 364.00 MB, 402.33 MB, 402.33 MB, 402.33 MB, 402.33 MB, 402.33 MB, 402.33 MB, 404.24 MB, 665.19 MB, 1.15 GB, 1.59 GB, 2.05 GB, 2.39 GB, 2.60 GB, 2.79 GB, 2.95 GB, 3.09 GB, 3.31 GB, 3.69 GB, 3.99 GB, 4.31 GB, 4.48 GB, 4.69 GB, 4.76 GB, 4.96 GB, 5.02 GB, 5.14 GB, 5.46 GB, 5.90 GB, 6.44 GB, 6.83 GB, 7.23 GB, 7.62 GB, 8.16 GB, 8.68 GB, 8.91 GB, 9.10 GB, 9.25 GB - FooterProcessingTime: (Avg: 305.102ms ; Min: 1.199ms ; Max: 3s576ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.35 - AverageScannerThreadConcurrency: 5.42 - BytesRead: 9.35 GB (10040514033) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.35 GB (10040514033) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.35 GB (10040514033) - DecompressionTime: 41s017ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 468.80 MB (491573238) - PerReadThreadRawHdfsThroughput: 42.91 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6s875ms - RowBatchQueuePutWaitTime: 46m51s - RowsRead: 797.53M (797526158) - RowsReturned: 797.53M (797526158) - RowsReturnedRate: 76.59 M/sec - ScanRangesComplete: 855 (855) - ScannerThreadsInvoluntaryContextSwitches: 70.09K (70092) - ScannerThreadsTotalWallClockTime: 55m24s - MaterializeTupleTime(*): 2m5s - ScannerThreadsSysTime: 7s825ms - ScannerThreadsUserTime: 3m2s - ScannerThreadsVoluntaryContextSwitches: 937.84K (937838) - TotalRawHdfsReadTime(*): 3m43s - TotalReadThroughput: 15.62 MB/sec Filter 0 (1.00 MB): - Files processed: 855 (855) - Files rejected: 687 (687) - Files total: 855 (855) - RowGroups processed: 778.93K (778926) - RowGroups rejected: 0 (0) - RowGroups total: 778.93K (778926) - Rows processed: 2.75M (2752512) - Rows rejected: 0 (0) - Rows total: 797.53M (797526158) - Splits processed: 168 (168) - Splits rejected: 0 (0) - Splits total: 168 (168) Instance 8d463de3722df36f:a2dae93a00000005 (host=vd1313.halxg.cloudera.com:22000):(Total: 10m12s, non-child: 7m15s, % non-child: 71.09%) Hdfs split stats (:<# splits>/): 1:107/24.64 GB 3:94/21.75 GB 0:92/21.56 GB 5:112/25.79 GB 7:122/27.77 GB 4:102/22.91 GB 6:115/27.01 GB 2:114/26.05 GB Filter 0 arrival: 432ms MemoryUsage(16s000ms): 402.28 MB, 448.23 MB, 448.23 MB, 448.23 MB, 448.23 MB, 448.23 MB, 448.23 MB, 413.97 MB, 312.84 MB, 270.85 MB, 273.91 MB, 275.28 MB, 278.36 MB, 254.79 MB, 277.74 MB, 296.24 MB, 283.32 MB, 244.38 MB, 279.96 MB, 272.83 MB, 282.62 MB, 276.42 MB, 258.51 MB, 265.06 MB, 308.35 MB, 308.84 MB, 295.62 MB, 230.79 MB, 226.52 MB, 238.34 MB, 250.59 MB, 259.14 MB, 244.03 MB, 311.59 MB, 305.18 MB, 340.14 MB, 306.62 MB, 327.93 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 7, 7, 7, 7 - AverageThreadTokens: 6.56 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 448.23 MB (470000740) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 794.71M (794709729) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m29s - TotalStorageWaitTime: 5m34s - TotalThreadsInvoluntaryContextSwitches: 99.34K (99345) - TotalThreadsTotalWallClockTime: 1h6m - TotalThreadsSysTime: 15s992ms - TotalThreadsUserTime: 6m20s - TotalThreadsVoluntaryContextSwitches: 1.06M (1059082) Fragment Instance Lifecycle Timings: - ExecTime: 10m12s - ExecTreeExecTime: 4s593ms - OpenTime: 59.342ms - ExecTreeOpenTime: 796.982us - PrepareTime: 65.898ms - ExecTreePrepareTime: 10.115ms DataStreamSender (dst_id=21):(Total: 2m52s, non-child: 2m52s, % non-child: 100.00%) - BytesSent: 21.60 GB (23194122163) - NetworkThroughput(*): 458.83 MB/sec - OverallThroughput: 128.00 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 794.71M (794709729) - SerializeBatchTime: 2m4s - TransmitDataRPCTime: 48s209ms - UncompressedRowBatchSize: 30.35 GB (32590290849) CodeGen:(Total: 92.577ms, non-child: 92.577ms, % non-child: 100.00%) - CodegenTime: 1.863ms - CompileTime: 17.673ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 37.893ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 36.054ms HDFS_SCAN_NODE (id=0):(Total: 4s244ms, non-child: 4s244ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:107/24.64 GB 3:94/21.75 GB 0:92/21.56 GB 5:112/25.79 GB 7:122/27.77 GB 4:102/22.91 GB 6:115/27.01 GB 2:114/26.05 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 169 out of 169 Runtime filters: All filters arrived. Waited 321ms Hdfs Read Thread Concurrency Bucket: 0:70.53% 1:21.06% 2:6.776% 3:1.551% 4:0.08163% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:689 PARQUET/SNAPPY:1014 BytesRead(16s000ms): 331.99 MB, 373.89 MB, 373.89 MB, 373.89 MB, 373.89 MB, 373.89 MB, 373.89 MB, 388.26 MB, 739.38 MB, 1.17 GB, 1.64 GB, 2.04 GB, 2.38 GB, 2.54 GB, 2.74 GB, 2.90 GB, 3.01 GB, 3.25 GB, 3.67 GB, 3.88 GB, 4.26 GB, 4.43 GB, 4.61 GB, 4.73 GB, 4.91 GB, 5.03 GB, 5.14 GB, 5.41 GB, 5.82 GB, 6.36 GB, 6.75 GB, 7.11 GB, 7.52 GB, 8.12 GB, 8.58 GB, 8.83 GB, 8.93 GB, 9.27 GB - FooterProcessingTime: (Avg: 312.871ms ; Min: 1.063ms ; Max: 3s218ms ; Number of samples: 169) - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 5.56 - BytesRead: 9.32 GB (10010851689) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.32 GB (10010851689) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.32 GB (10010851689) - DecompressionTime: 40s873ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 169 (169) - NumScannerThreadsStarted: 8 (8) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 447.04 MB (468753720) - PerReadThreadRawHdfsThroughput: 39.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 716.887ms - RowBatchQueuePutWaitTime: 48m6s - RowsRead: 794.71M (794709729) - RowsReturned: 794.71M (794709729) - RowsReturnedRate: 187.23 M/sec - ScanRangesComplete: 858 (858) - ScannerThreadsInvoluntaryContextSwitches: 68.01K (68007) - ScannerThreadsTotalWallClockTime: 56m44s - MaterializeTupleTime(*): 2m5s - ScannerThreadsSysTime: 8s466ms - ScannerThreadsUserTime: 2m47s - ScannerThreadsVoluntaryContextSwitches: 1.02M (1023009) - TotalRawHdfsReadTime(*): 4m3s - TotalReadThroughput: 15.59 MB/sec Filter 0 (1.00 MB): - Files processed: 858 (858) - Files rejected: 689 (689) - Files total: 858 (858) - RowGroups processed: 776.17K (776168) - RowGroups rejected: 0 (0) - RowGroups total: 776.17K (776168) - Rows processed: 2.77M (2768896) - Rows rejected: 0 (0) - Rows total: 794.71M (794709729) - Splits processed: 169 (169) - Splits rejected: 0 (0) - Splits total: 169 (169) Instance 8d463de3722df36f:a2dae93a00000001 (host=vd1316.halxg.cloudera.com:22000):(Total: 9m58s, non-child: 7m2s, % non-child: 70.58%) Hdfs split stats (:<# splits>/): 3:98/22.36 GB 2:116/26.47 GB 1:104/24.43 GB 6:103/23.93 GB 4:104/23.03 GB 0:125/28.32 GB 7:98/22.80 GB 5:111/26.22 GB Filter 0 arrival: 450ms MemoryUsage(16s000ms): 415.00 MB, 456.35 MB, 456.35 MB, 456.35 MB, 456.35 MB, 456.35 MB, 456.35 MB, 432.64 MB, 284.45 MB, 270.16 MB, 264.68 MB, 278.72 MB, 254.48 MB, 236.86 MB, 283.07 MB, 281.01 MB, 316.24 MB, 258.27 MB, 274.39 MB, 272.49 MB, 283.64 MB, 290.63 MB, 278.48 MB, 272.21 MB, 295.78 MB, 285.36 MB, 301.62 MB, 268.72 MB, 281.90 MB, 256.40 MB, 265.85 MB, 277.92 MB, 261.88 MB, 267.45 MB, 251.69 MB, 291.46 MB, 305.03 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.43 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 458.51 MB (480778564) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 793.26M (793261845) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m20s - TotalStorageWaitTime: 4m1s - TotalThreadsInvoluntaryContextSwitches: 95.49K (95492) - TotalThreadsTotalWallClockTime: 1h4m - TotalThreadsSysTime: 16s731ms - TotalThreadsUserTime: 6m16s - TotalThreadsVoluntaryContextSwitches: 1.18M (1176388) Fragment Instance Lifecycle Timings: - ExecTime: 9m58s - ExecTreeExecTime: 5s408ms - OpenTime: 27.142ms - ExecTreeOpenTime: 580.988us - PrepareTime: 68.193ms - ExecTreePrepareTime: 9.666ms DataStreamSender (dst_id=21):(Total: 2m50s, non-child: 2m50s, % non-child: 100.00%) - BytesSent: 21.56 GB (23146523481) - NetworkThroughput(*): 456.71 MB/sec - OverallThroughput: 129.11 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 793.26M (793261845) - SerializeBatchTime: 2m2s - TransmitDataRPCTime: 48s333ms - UncompressedRowBatchSize: 30.30 GB (32530914497) CodeGen:(Total: 66.793ms, non-child: 66.793ms, % non-child: 100.00%) - CodegenTime: 890.607us - CompileTime: 7.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.004ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 41.915ms HDFS_SCAN_NODE (id=0):(Total: 5s086ms, non-child: 5s086ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:98/22.36 GB 2:116/26.47 GB 1:104/24.43 GB 6:103/23.93 GB 4:104/23.03 GB 0:125/28.32 GB 7:98/22.80 GB 5:111/26.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: All filters arrived. Waited 381ms Hdfs Read Thread Concurrency Bucket: 0:76.02% 1:17.54% 2:4.511% 3:1.42% 4:0.4177% 5:0.08354% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:691 PARQUET/SNAPPY:1008 BytesRead(16s000ms): 356.24 MB, 395.16 MB, 395.16 MB, 395.16 MB, 395.16 MB, 395.16 MB, 395.16 MB, 396.84 MB, 673.75 MB, 1.16 GB, 1.66 GB, 2.10 GB, 2.43 GB, 2.62 GB, 2.90 GB, 2.99 GB, 3.18 GB, 3.37 GB, 3.74 GB, 4.03 GB, 4.37 GB, 4.54 GB, 4.71 GB, 4.83 GB, 5.00 GB, 5.07 GB, 5.25 GB, 5.51 GB, 5.94 GB, 6.45 GB, 6.86 GB, 7.25 GB, 7.66 GB, 8.23 GB, 8.68 GB, 8.95 GB, 9.09 GB - FooterProcessingTime: (Avg: 205.891ms ; Min: 1.016ms ; Max: 2s576ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 5.43 - BytesRead: 9.29 GB (9977536815) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.29 GB (9977536815) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.29 GB (9977536815) - DecompressionTime: 38s065ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 457.32 MB (479531544) - PerReadThreadRawHdfsThroughput: 48.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s684ms - RowBatchQueuePutWaitTime: 47m9s - RowsRead: 793.26M (793261845) - RowsReturned: 793.26M (793261845) - RowsReturnedRate: 155.94 M/sec - ScanRangesComplete: 859 (859) - ScannerThreadsInvoluntaryContextSwitches: 65.69K (65686) - ScannerThreadsTotalWallClockTime: 54m10s - MaterializeTupleTime(*): 2m1s - ScannerThreadsSysTime: 9s365ms - ScannerThreadsUserTime: 2m49s - ScannerThreadsVoluntaryContextSwitches: 1.14M (1138611) - TotalRawHdfsReadTime(*): 3m17s - TotalReadThroughput: 15.90 MB/sec Filter 0 (1.00 MB): - Files processed: 859 (859) - Files rejected: 691 (691) - Files total: 859 (859) - RowGroups processed: 774.75K (774746) - RowGroups rejected: 0 (0) - RowGroups total: 774.75K (774746) - Rows processed: 2.75M (2752512) - Rows rejected: 0 (0) - Rows total: 793.26M (793261845) - Splits processed: 168 (168) - Splits rejected: 0 (0) - Splits total: 168 (168) Instance 8d463de3722df36f:a2dae93a00000006 (host=vd1310.halxg.cloudera.com:22000):(Total: 9m56s, non-child: 7m2s, % non-child: 70.82%) Hdfs split stats (:<# splits>/): 5:97/22.48 GB 7:121/28.35 GB 1:87/20.46 GB 6:105/24.30 GB 0:105/24.12 GB 4:115/26.29 GB 2:102/24.07 GB 3:123/27.39 GB Filter 0 arrival: 416ms MemoryUsage(16s000ms): 410.87 MB, 456.35 MB, 456.35 MB, 456.35 MB, 456.35 MB, 456.35 MB, 456.34 MB, 433.60 MB, 292.02 MB, 267.18 MB, 276.08 MB, 269.28 MB, 278.66 MB, 254.37 MB, 265.08 MB, 257.63 MB, 302.51 MB, 263.53 MB, 279.62 MB, 279.98 MB, 268.76 MB, 288.95 MB, 280.54 MB, 282.53 MB, 272.20 MB, 263.51 MB, 284.99 MB, 257.57 MB, 239.97 MB, 234.56 MB, 271.94 MB, 269.40 MB, 266.08 MB, 268.83 MB, 245.32 MB, 281.60 MB, 279.68 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.43 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 458.42 MB (480687703) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 792.21M (792205379) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m20s - TotalStorageWaitTime: 4m29s - TotalThreadsInvoluntaryContextSwitches: 94.22K (94217) - TotalThreadsTotalWallClockTime: 1h3m - TotalThreadsSysTime: 14s920ms - TotalThreadsUserTime: 6m15s - TotalThreadsVoluntaryContextSwitches: 1.03M (1030903) Fragment Instance Lifecycle Timings: - ExecTime: 9m56s - ExecTreeExecTime: 4s424ms - OpenTime: 31.541ms - ExecTreeOpenTime: 1.062ms - PrepareTime: 44.645ms - ExecTreePrepareTime: 6.055ms DataStreamSender (dst_id=21):(Total: 2m49s, non-child: 2m49s, % non-child: 100.00%) - BytesSent: 21.53 GB (23115234746) - NetworkThroughput(*): 462.64 MB/sec - OverallThroughput: 129.79 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 792.21M (792205379) - SerializeBatchTime: 2m2s - TransmitDataRPCTime: 47s649ms - UncompressedRowBatchSize: 30.26 GB (32487589835) CodeGen:(Total: 50.350ms, non-child: 50.350ms, % non-child: 100.00%) - CodegenTime: 962.738us - CompileTime: 8.759ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 19.919ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 21.085ms HDFS_SCAN_NODE (id=0):(Total: 4s086ms, non-child: 4s086ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:97/22.48 GB 7:121/28.35 GB 1:87/20.46 GB 6:105/24.30 GB 0:105/24.12 GB 4:115/26.29 GB 2:102/24.07 GB 3:123/27.39 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 168 out of 168 Runtime filters: All filters arrived. Waited 361ms Hdfs Read Thread Concurrency Bucket: 0:74.66% 1:18.46% 2:5.453% 3:0.9228% 4:0.4195% 5:0.08389% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:687 PARQUET/SNAPPY:1008 BytesRead(16s000ms): 351.09 MB, 394.19 MB, 394.19 MB, 394.19 MB, 394.19 MB, 394.19 MB, 394.19 MB, 396.08 MB, 684.75 MB, 1.15 GB, 1.66 GB, 2.05 GB, 2.42 GB, 2.58 GB, 2.82 GB, 2.92 GB, 3.12 GB, 3.33 GB, 3.72 GB, 3.96 GB, 4.29 GB, 4.49 GB, 4.68 GB, 4.77 GB, 4.94 GB, 5.03 GB, 5.17 GB, 5.46 GB, 5.87 GB, 6.44 GB, 6.90 GB, 7.27 GB, 7.71 GB, 8.29 GB, 8.78 GB, 9.04 GB, 9.16 GB - FooterProcessingTime: (Avg: 240.118ms ; Min: 915.806us ; Max: 4s448ms ; Number of samples: 168) - AverageHdfsReadThreadConcurrency: 0.34 - AverageScannerThreadConcurrency: 5.44 - BytesRead: 9.29 GB (9969783691) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.29 GB (9969783691) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.29 GB (9969783691) - DecompressionTime: 37s892ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 168 (168) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 457.20 MB (479406712) - PerReadThreadRawHdfsThroughput: 45.53 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 838.524ms - RowBatchQueuePutWaitTime: 46m30s - RowsRead: 792.21M (792205379) - RowsReturned: 792.21M (792205379) - RowsReturnedRate: 193.86 M/sec - ScanRangesComplete: 855 (855) - ScannerThreadsInvoluntaryContextSwitches: 65.78K (65779) - ScannerThreadsTotalWallClockTime: 53m58s - MaterializeTupleTime(*): 2m - ScannerThreadsSysTime: 7s974ms - ScannerThreadsUserTime: 2m48s - ScannerThreadsVoluntaryContextSwitches: 995.56K (995563) - TotalRawHdfsReadTime(*): 3m28s - TotalReadThroughput: 15.94 MB/sec Filter 0 (1.00 MB): - Files processed: 855 (855) - Files rejected: 687 (687) - Files total: 855 (855) - RowGroups processed: 773.73K (773726) - RowGroups rejected: 0 (0) - RowGroups total: 773.73K (773726) - Rows processed: 2.75M (2752512) - Rows rejected: 0 (0) - Rows total: 792.21M (792205379) - Splits processed: 168 (168) - Splits rejected: 0 (0) - Splits total: 168 (168) Instance 8d463de3722df36f:a2dae93a00000002 (host=vd1311.halxg.cloudera.com:22000):(Total: 9m55s, non-child: 7m1s, % non-child: 70.80%) Hdfs split stats (:<# splits>/): 3:102/23.81 GB 5:109/25.05 GB 2:107/24.83 GB 0:116/26.85 GB 4:106/24.03 GB 7:102/23.72 GB 1:101/23.61 GB 6:112/25.76 GB Filter 0 arrival: 446ms MemoryUsage(16s000ms): 418.36 MB, 473.67 MB, 473.67 MB, 473.67 MB, 473.67 MB, 473.67 MB, 473.67 MB, 447.46 MB, 268.33 MB, 246.34 MB, 271.36 MB, 273.21 MB, 284.26 MB, 269.44 MB, 271.14 MB, 299.53 MB, 293.79 MB, 250.82 MB, 275.96 MB, 288.06 MB, 264.23 MB, 249.08 MB, 308.78 MB, 266.92 MB, 312.09 MB, 285.17 MB, 292.07 MB, 268.89 MB, 261.69 MB, 245.30 MB, 254.23 MB, 256.06 MB, 265.47 MB, 325.17 MB, 327.73 MB, 336.20 MB, 388.07 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 7, 7, 7, 7 - AverageThreadTokens: 6.55 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 475.91 MB (499024971) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 787.40M (787398926) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m17s - TotalStorageWaitTime: 4m41s - TotalThreadsInvoluntaryContextSwitches: 94.98K (94977) - TotalThreadsTotalWallClockTime: 1h4m - TotalThreadsSysTime: 13s773ms - TotalThreadsUserTime: 6m6s - TotalThreadsVoluntaryContextSwitches: 936.46K (936462) Fragment Instance Lifecycle Timings: - ExecTime: 9m54s - ExecTreeExecTime: 5s935ms - OpenTime: 39.132ms - ExecTreeOpenTime: 824.724us - PrepareTime: 55.551ms - ExecTreePrepareTime: 4.769ms DataStreamSender (dst_id=21):(Total: 2m48s, non-child: 2m48s, % non-child: 100.00%) - BytesSent: 21.40 GB (22977061233) - NetworkThroughput(*): 464.65 MB/sec - OverallThroughput: 130.39 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 787.40M (787398926) - SerializeBatchTime: 2m - TransmitDataRPCTime: 47s159ms - UncompressedRowBatchSize: 30.07 GB (32290481770) CodeGen:(Total: 71.418ms, non-child: 71.418ms, % non-child: 100.00%) - CodegenTime: 1.380ms - CompileTime: 12.420ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 21.390ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 36.420ms HDFS_SCAN_NODE (id=0):(Total: 5s615ms, non-child: 5s615ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:102/23.81 GB 5:109/25.05 GB 2:107/24.83 GB 0:116/26.85 GB 4:106/24.03 GB 7:102/23.72 GB 1:101/23.61 GB 6:112/25.76 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 165 out of 165 Runtime filters: All filters arrived. Waited 362ms Hdfs Read Thread Concurrency Bucket: 0:73.93% 1:17.66% 2:5.971% 3:1.682% 4:0.6728% 5:0.0841% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:690 PARQUET/SNAPPY:990 BytesRead(16s000ms): 360.78 MB, 411.27 MB, 411.27 MB, 411.27 MB, 411.27 MB, 411.27 MB, 411.27 MB, 411.52 MB, 682.06 MB, 1.17 GB, 1.67 GB, 2.07 GB, 2.45 GB, 2.61 GB, 2.89 GB, 2.98 GB, 3.09 GB, 3.36 GB, 3.73 GB, 3.98 GB, 4.32 GB, 4.46 GB, 4.74 GB, 4.78 GB, 5.01 GB, 5.06 GB, 5.22 GB, 5.50 GB, 5.92 GB, 6.46 GB, 6.88 GB, 7.27 GB, 7.70 GB, 8.30 GB, 8.78 GB, 9.06 GB, 9.24 GB - FooterProcessingTime: (Avg: 255.027ms ; Min: 1.129ms ; Max: 2s839ms ; Number of samples: 165) - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 5.55 - BytesRead: 9.24 GB (9917635607) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.24 GB (9917635607) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.24 GB (9917635607) - DecompressionTime: 38s783ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 165 (165) - NumScannerThreadsStarted: 8 (8) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 474.67 MB (497728799) - PerReadThreadRawHdfsThroughput: 40.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 2s163ms - RowBatchQueuePutWaitTime: 47m24s - RowsRead: 787.40M (787398926) - RowsReturned: 787.40M (787398926) - RowsReturnedRate: 140.21 M/sec - ScanRangesComplete: 855 (855) - ScannerThreadsInvoluntaryContextSwitches: 66.09K (66091) - ScannerThreadsTotalWallClockTime: 55m - MaterializeTupleTime(*): 1m59s - ScannerThreadsSysTime: 7s098ms - ScannerThreadsUserTime: 2m40s - ScannerThreadsVoluntaryContextSwitches: 899.37K (899370) - TotalRawHdfsReadTime(*): 3m51s - TotalReadThroughput: 15.90 MB/sec Filter 0 (1.00 MB): - Files processed: 855 (855) - Files rejected: 690 (690) - Files total: 855 (855) - RowGroups processed: 769.02K (769023) - RowGroups rejected: 0 (0) - RowGroups total: 769.02K (769023) - Rows processed: 2.70M (2703360) - Rows rejected: 0 (0) - Rows total: 787.40M (787398926) - Splits processed: 165 (165) - Splits rejected: 0 (0) - Splits total: 165 (165) Instance 8d463de3722df36f:a2dae93a00000007 (host=vd1312.halxg.cloudera.com:22000):(Total: 9m54s, non-child: 7m1s, % non-child: 70.79%) Hdfs split stats (:<# splits>/): 0:109/25.03 GB 5:99/22.55 GB 6:118/27.04 GB 7:115/26.81 GB 1:108/25.07 GB 3:92/20.80 GB 2:112/25.75 GB 4:107/24.43 GB Filter 0 arrival: 441ms MemoryUsage(16s000ms): 399.74 MB, 450.99 MB, 450.99 MB, 450.99 MB, 450.99 MB, 450.99 MB, 450.99 MB, 421.57 MB, 283.69 MB, 281.07 MB, 270.60 MB, 275.68 MB, 271.95 MB, 253.80 MB, 306.08 MB, 251.05 MB, 320.44 MB, 238.80 MB, 301.94 MB, 290.06 MB, 278.35 MB, 263.96 MB, 292.78 MB, 240.02 MB, 347.90 MB, 314.44 MB, 268.67 MB, 253.80 MB, 274.69 MB, 203.88 MB, 272.26 MB, 247.76 MB, 244.44 MB, 266.14 MB, 266.95 MB, 297.12 MB, 298.42 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.43 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 453.37 MB (475396180) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 778.68M (778684564) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 6m17s - TotalStorageWaitTime: 5m - TotalThreadsInvoluntaryContextSwitches: 94.33K (94335) - TotalThreadsTotalWallClockTime: 1h3m - TotalThreadsSysTime: 14s984ms - TotalThreadsUserTime: 6m9s - TotalThreadsVoluntaryContextSwitches: 1.04M (1035784) Fragment Instance Lifecycle Timings: - ExecTime: 9m54s - ExecTreeExecTime: 7s192ms - OpenTime: 35.233ms - ExecTreeOpenTime: 874.684us - PrepareTime: 69.422ms - ExecTreePrepareTime: 5.916ms DataStreamSender (dst_id=21):(Total: 2m46s, non-child: 2m46s, % non-child: 100.00%) - BytesSent: 21.17 GB (22729152856) - NetworkThroughput(*): 460.48 MB/sec - OverallThroughput: 129.92 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 778.68M (778684564) - SerializeBatchTime: 1m59s - TransmitDataRPCTime: 47s072ms - UncompressedRowBatchSize: 29.74 GB (31933114052) CodeGen:(Total: 82.660ms, non-child: 82.660ms, % non-child: 100.00%) - CodegenTime: 724.290us - CompileTime: 7.891ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 22.694ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 51.593ms HDFS_SCAN_NODE (id=0):(Total: 6s861ms, non-child: 6s861ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:109/25.03 GB 5:99/22.55 GB 6:118/27.04 GB 7:115/26.81 GB 1:108/25.07 GB 3:92/20.80 GB 2:112/25.75 GB 4:107/24.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 164 out of 164 Runtime filters: All filters arrived. Waited 361ms Hdfs Read Thread Concurrency Bucket: 0:73.93% 1:17.33% 2:5.803% 3:2.019% 4:0.9251% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:696 PARQUET/SNAPPY:984 BytesRead(16s000ms): 339.90 MB, 387.13 MB, 387.13 MB, 387.13 MB, 387.13 MB, 387.13 MB, 387.13 MB, 389.48 MB, 708.47 MB, 1.17 GB, 1.64 GB, 2.07 GB, 2.40 GB, 2.60 GB, 2.84 GB, 2.91 GB, 3.13 GB, 3.34 GB, 3.77 GB, 3.98 GB, 4.34 GB, 4.52 GB, 4.74 GB, 4.77 GB, 5.05 GB, 5.05 GB, 5.18 GB, 5.47 GB, 5.91 GB, 6.42 GB, 6.85 GB, 7.19 GB, 7.63 GB, 8.21 GB, 8.71 GB, 8.96 GB, 9.08 GB - FooterProcessingTime: (Avg: 261.233ms ; Min: 1.084ms ; Max: 3s218ms ; Number of samples: 164) - AverageHdfsReadThreadConcurrency: 0.39 - AverageScannerThreadConcurrency: 5.43 - BytesRead: 9.15 GB (9824571490) - BytesReadDataNodeCache: 0 - BytesReadLocal: 9.15 GB (9824571490) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 9.15 GB (9824571490) - DecompressionTime: 41s204ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 164 (164) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 452.16 MB (474124584) - PerReadThreadRawHdfsThroughput: 41.13 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s589ms - RowBatchQueuePutWaitTime: 45m52s - RowsRead: 778.68M (778684564) - RowsReturned: 778.68M (778684564) - RowsReturnedRate: 113.49 M/sec - ScanRangesComplete: 860 (860) - ScannerThreadsInvoluntaryContextSwitches: 65.54K (65538) - ScannerThreadsTotalWallClockTime: 53m52s - MaterializeTupleTime(*): 2m - ScannerThreadsSysTime: 8s228ms - ScannerThreadsUserTime: 2m45s - ScannerThreadsVoluntaryContextSwitches: 998.84K (998841) - TotalRawHdfsReadTime(*): 3m47s - TotalReadThroughput: 15.76 MB/sec Filter 0 (1.00 MB): - Files processed: 860 (860) - Files rejected: 696 (696) - Files total: 860 (860) - RowGroups processed: 760.51K (760509) - RowGroups rejected: 0 (0) - RowGroups total: 760.51K (760509) - Rows processed: 2.69M (2686976) - Rows rejected: 0 (0) - Rows total: 778.68M (778684564) - Splits processed: 164 (164) - Splits rejected: 0 (0) - Splits total: 164 (164) Averaged Fragment F01:(Total: 1m40s, non-child: 52s575ms, % non-child: 52.19%) split sizes: min: 22.90 GB, max: 23.03 GB, avg: 22.95 GB, stddev: 43.26 MB completion times: min:1m35s max:1m45s mean: 1m40s stddev:3s026ms execution rates: min:223.29 MB/sec max:245.95 MB/sec mean:233.50 MB/sec stddev:6.93 MB/sec num instances: 7 - AverageThreadTokens: 7.82 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 199.79 MB (209491072) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 411.39M (411395000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s841ms - TotalStorageWaitTime: 35s755ms - TotalThreadsInvoluntaryContextSwitches: 19.13K (19132) - TotalThreadsTotalWallClockTime: 13m8s - TotalThreadsSysTime: 4s516ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 418.50K (418499) Fragment Instance Lifecycle Timings: - ExecTime: 1m40s - ExecTreeExecTime: 1s670ms - OpenTime: 21.322ms - ExecTreeOpenTime: 270.448us - PrepareTime: 45.614ms - ExecTreePrepareTime: 1.747ms DataStreamSender (dst_id=22):(Total: 46s606ms, non-child: 46s606ms, % non-child: 100.00%) - BytesSent: 5.86 GB (6295909221) - NetworkThroughput(*): 352.29 MB/sec - OverallThroughput: 128.87 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 411.39M (411395000) - SerializeBatchTime: 29s514ms - TransmitDataRPCTime: 17s045ms - UncompressedRowBatchSize: 8.05 GB (8641003828) CodeGen:(Total: 48.208ms, non-child: 48.208ms, % non-child: 100.00%) - CodegenTime: 382.825us - CompileTime: 6.125ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 10.539ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 30.788ms HDFS_SCAN_NODE (id=1):(Total: 1s518ms, non-child: 1s518ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 6.84 - BytesRead: 4.18 GB (4487856523) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 GB (4487856523) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 GB (4487856523) - DecompressionTime: 16s112ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 288 (288) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 199.55 MB (209238821) - PerReadThreadRawHdfsThroughput: 590.14 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.301ms - RowBatchQueuePutWaitTime: 10m17s - RowsRead: 411.39M (411395000) - RowsReturned: 411.39M (411395000) - RowsReturnedRate: 273.13 M/sec - ScanRangesComplete: 288 (288) - ScannerThreadsInvoluntaryContextSwitches: 9.36K (9361) - ScannerThreadsTotalWallClockTime: 11m27s - MaterializeTupleTime(*): 12s873ms - ScannerThreadsSysTime: 2s391ms - ScannerThreadsUserTime: 30s596ms - ScannerThreadsVoluntaryContextSwitches: 412.58K (412577) - TotalRawHdfsReadTime(*): 8s131ms - TotalReadThroughput: 42.56 MB/sec Fragment F01: Instance 8d463de3722df36f:a2dae93a0000000d (host=vd1309.halxg.cloudera.com:22000):(Total: 1m45s, non-child: 55s337ms, % non-child: 52.41%) Hdfs split stats (:<# splits>/): 4:36/3.11 GB 5:35/3.03 GB 6:46/3.30 GB 0:36/2.94 GB 3:33/2.48 GB 2:32/2.64 GB 7:37/3.00 GB 1:31/2.55 GB MemoryUsage(2s000ms): 115.23 MB, 121.99 MB, 102.23 MB, 109.75 MB, 116.42 MB, 106.90 MB, 106.45 MB, 117.47 MB, 132.60 MB, 126.07 MB, 117.14 MB, 117.91 MB, 109.91 MB, 118.53 MB, 117.71 MB, 113.43 MB, 112.90 MB, 96.95 MB, 111.46 MB, 117.54 MB, 117.76 MB, 123.91 MB, 129.51 MB, 123.64 MB, 104.71 MB, 114.49 MB, 120.58 MB, 117.94 MB, 154.96 MB, 140.71 MB, 169.96 MB, 160.68 MB, 154.48 MB, 154.53 MB, 136.44 MB, 129.70 MB, 114.53 MB, 90.46 MB, 108.17 MB, 102.75 MB, 115.18 MB, 109.37 MB, 119.00 MB, 119.37 MB, 110.71 MB, 109.84 MB, 89.80 MB, 96.21 MB, 103.39 MB, 109.14 MB, 98.02 MB, 93.23 MB ThreadUsage(2s000ms): 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 6.96 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 170.48 MB (178765477) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 415.65M (415650596) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31s921ms - TotalStorageWaitTime: 37s933ms - TotalThreadsInvoluntaryContextSwitches: 26.74K (26740) - TotalThreadsTotalWallClockTime: 12m15s - TotalThreadsSysTime: 4s987ms - TotalThreadsUserTime: 1m40s - TotalThreadsVoluntaryContextSwitches: 422.44K (422443) Fragment Instance Lifecycle Timings: - ExecTime: 1m45s - ExecTreeExecTime: 1s955ms - OpenTime: 28.532ms - ExecTreeOpenTime: 241.840us - PrepareTime: 52.251ms - ExecTreePrepareTime: 2.313ms DataStreamSender (dst_id=22):(Total: 48s413ms, non-child: 48s413ms, % non-child: 100.00%) - BytesSent: 5.92 GB (6351432018) - NetworkThroughput(*): 348.23 MB/sec - OverallThroughput: 125.11 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 415.65M (415650596) - SerializeBatchTime: 30s971ms - TransmitDataRPCTime: 17s394ms - UncompressedRowBatchSize: 8.13 GB (8730389016) CodeGen:(Total: 53.626ms, non-child: 53.626ms, % non-child: 100.00%) - CodegenTime: 325.582us - CompileTime: 7.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 11.580ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 33.534ms HDFS_SCAN_NODE (id=1):(Total: 1s788ms, non-child: 1s788ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:36/3.11 GB 5:35/3.03 GB 6:46/3.30 GB 0:36/2.94 GB 3:33/2.48 GB 2:32/2.64 GB 7:37/3.00 GB 1:31/2.55 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 286 out of 286 Hdfs Read Thread Concurrency Bucket: 0:90.52% 1:9.479% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:572 BytesRead(2s000ms): 104.07 MB, 239.73 MB, 321.29 MB, 447.51 MB, 561.66 MB, 675.51 MB, 794.35 MB, 900.93 MB, 1011.86 MB, 1.10 GB, 1.18 GB, 1.30 GB, 1.33 GB, 1.37 GB, 1.42 GB, 1.47 GB, 1.59 GB, 1.66 GB, 1.74 GB, 1.80 GB, 1.91 GB, 2.02 GB, 2.10 GB, 2.19 GB, 2.28 GB, 2.40 GB, 2.50 GB, 2.56 GB, 2.70 GB, 2.75 GB, 2.84 GB, 2.84 GB, 2.87 GB, 2.87 GB, 2.87 GB, 2.89 GB, 2.97 GB, 3.03 GB, 3.15 GB, 3.20 GB, 3.22 GB, 3.29 GB, 3.35 GB, 3.36 GB, 3.41 GB, 3.52 GB, 3.63 GB, 3.75 GB, 3.83 GB, 3.95 GB, 4.04 GB, 4.14 GB - FooterProcessingTime: (Avg: 56.317ms ; Min: 1.024ms ; Max: 782.831ms ; Number of samples: 286) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 5.96 - BytesRead: 4.21 GB (4518787576) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.21 GB (4518787576) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.21 GB (4518787576) - DecompressionTime: 16s192ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 286 (286) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 170.24 MB (178510595) - PerReadThreadRawHdfsThroughput: 546.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.598ms - RowBatchQueuePutWaitTime: 9m17s - RowsRead: 415.65M (415650596) - RowsReturned: 415.65M (415650596) - RowsReturnedRate: 232.37 M/sec - ScanRangesComplete: 286 (286) - ScannerThreadsInvoluntaryContextSwitches: 10.56K (10557) - ScannerThreadsTotalWallClockTime: 10m29s - MaterializeTupleTime(*): 12s979ms - ScannerThreadsSysTime: 2s440ms - ScannerThreadsUserTime: 30s376ms - ScannerThreadsVoluntaryContextSwitches: 417.19K (417192) - TotalRawHdfsReadTime(*): 7s892ms - TotalReadThroughput: 40.85 MB/sec Instance 8d463de3722df36f:a2dae93a00000008 (host=vd1314.halxg.cloudera.com:22000):(Total: 1m44s, non-child: 54s890ms, % non-child: 52.68%) Hdfs split stats (:<# splits>/): 7:34/2.93 GB 4:37/3.20 GB 2:35/3.05 GB 3:37/2.91 GB 1:31/2.55 GB 5:41/2.81 GB 6:34/2.69 GB 0:34/2.82 GB MemoryUsage(2s000ms): 129.49 MB, 124.73 MB, 120.79 MB, 125.20 MB, 119.25 MB, 134.55 MB, 143.03 MB, 116.67 MB, 122.41 MB, 129.53 MB, 122.13 MB, 144.25 MB, 138.56 MB, 138.20 MB, 135.81 MB, 133.28 MB, 144.60 MB, 140.96 MB, 149.70 MB, 126.33 MB, 114.62 MB, 140.25 MB, 149.88 MB, 129.87 MB, 137.52 MB, 125.85 MB, 171.15 MB, 193.21 MB, 162.40 MB, 155.18 MB, 163.50 MB, 159.86 MB, 141.43 MB, 138.34 MB, 134.49 MB, 127.77 MB, 127.36 MB, 136.49 MB, 130.72 MB, 134.55 MB, 142.36 MB, 132.85 MB, 143.34 MB, 157.78 MB, 136.58 MB, 164.34 MB, 220.09 MB, 170.43 MB, 171.53 MB, 130.88 MB, 93.32 MB, 99.94 MB ThreadUsage(2s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 7.97 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 227.66 MB (238720243) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 414.21M (414211639) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31s531ms - TotalStorageWaitTime: 28s557ms - TotalThreadsInvoluntaryContextSwitches: 17.42K (17419) - TotalThreadsTotalWallClockTime: 13m48s - TotalThreadsSysTime: 5s545ms - TotalThreadsUserTime: 1m42s - TotalThreadsVoluntaryContextSwitches: 419.25K (419247) Fragment Instance Lifecycle Timings: - ExecTime: 1m44s - ExecTreeExecTime: 1s801ms - OpenTime: 25.269ms - ExecTreeOpenTime: 361.836us - PrepareTime: 56.400ms - ExecTreePrepareTime: 1.943ms DataStreamSender (dst_id=22):(Total: 47s598ms, non-child: 47s598ms, % non-child: 100.00%) - BytesSent: 5.90 GB (6330846273) - NetworkThroughput(*): 357.02 MB/sec - OverallThroughput: 126.84 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 414.21M (414211639) - SerializeBatchTime: 30s638ms - TransmitDataRPCTime: 16s911ms - UncompressedRowBatchSize: 8.10 GB (8700164939) CodeGen:(Total: 65.262ms, non-child: 65.262ms, % non-child: 100.00%) - CodegenTime: 387.390us - CompileTime: 5.917ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 13.803ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 44.771ms HDFS_SCAN_NODE (id=1):(Total: 1s635ms, non-child: 1s635ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:34/2.93 GB 4:37/3.20 GB 2:35/3.05 GB 3:37/2.91 GB 1:31/2.55 GB 5:41/2.81 GB 6:34/2.69 GB 0:34/2.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 283 out of 283 Hdfs Read Thread Concurrency Bucket: 0:95.19% 1:4.327% 2:0.4808% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:566 BytesRead(2s000ms): 97.02 MB, 197.19 MB, 308.87 MB, 437.28 MB, 524.95 MB, 640.30 MB, 752.26 MB, 857.09 MB, 953.34 MB, 1.05 GB, 1.16 GB, 1.29 GB, 1.32 GB, 1.39 GB, 1.44 GB, 1.48 GB, 1.60 GB, 1.71 GB, 1.78 GB, 1.83 GB, 1.94 GB, 2.08 GB, 2.18 GB, 2.26 GB, 2.36 GB, 2.46 GB, 2.63 GB, 2.71 GB, 2.78 GB, 2.86 GB, 2.90 GB, 2.91 GB, 2.97 GB, 2.98 GB, 2.98 GB, 2.99 GB, 3.09 GB, 3.17 GB, 3.27 GB, 3.32 GB, 3.35 GB, 3.39 GB, 3.47 GB, 3.49 GB, 3.50 GB, 3.65 GB, 3.81 GB, 3.87 GB, 3.93 GB, 3.99 GB, 4.09 GB, 4.19 GB - FooterProcessingTime: (Avg: 43.544ms ; Min: 1.073ms ; Max: 993.354ms ; Number of samples: 283) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 6.97 - BytesRead: 4.20 GB (4504399539) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.20 GB (4504399539) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.20 GB (4504399539) - DecompressionTime: 17s115ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 283 (283) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 227.41 MB (238456137) - PerReadThreadRawHdfsThroughput: 792.00 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.585ms - RowBatchQueuePutWaitTime: 10m59s - RowsRead: 414.21M (414211639) - RowsReturned: 414.21M (414211639) - RowsReturnedRate: 253.31 M/sec - ScanRangesComplete: 283 (283) - ScannerThreadsInvoluntaryContextSwitches: 7.01K (7006) - ScannerThreadsTotalWallClockTime: 12m4s - MaterializeTupleTime(*): 14s431ms - ScannerThreadsSysTime: 2s799ms - ScannerThreadsUserTime: 32s608ms - ScannerThreadsVoluntaryContextSwitches: 413.91K (413914) - TotalRawHdfsReadTime(*): 5s423ms - TotalReadThroughput: 41.31 MB/sec Instance 8d463de3722df36f:a2dae93a0000000c (host=vd1312.halxg.cloudera.com:22000):(Total: 1m40s, non-child: 52s632ms, % non-child: 52.19%) Hdfs split stats (:<# splits>/): 3:40/3.52 GB 0:37/2.95 GB 4:39/3.07 GB 2:26/2.06 GB 6:30/2.43 GB 5:37/3.22 GB 7:34/2.56 GB 1:41/3.14 GB MemoryUsage(2s000ms): 139.56 MB, 115.43 MB, 118.14 MB, 136.67 MB, 107.43 MB, 122.04 MB, 95.65 MB, 119.67 MB, 168.40 MB, 158.52 MB, 138.32 MB, 115.48 MB, 136.42 MB, 145.08 MB, 150.09 MB, 154.10 MB, 127.76 MB, 143.18 MB, 135.65 MB, 135.67 MB, 126.28 MB, 137.80 MB, 127.65 MB, 138.96 MB, 134.07 MB, 153.55 MB, 126.96 MB, 144.80 MB, 136.66 MB, 122.14 MB, 123.29 MB, 120.88 MB, 134.98 MB, 135.07 MB, 129.37 MB, 129.95 MB, 138.10 MB, 146.99 MB, 121.83 MB, 115.42 MB, 190.78 MB, 182.78 MB, 153.41 MB, 154.41 MB, 204.25 MB, 192.83 MB, 153.63 MB, 127.81 MB, 132.17 MB, 126.79 MB ThreadUsage(2s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 7.98 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 231.53 MB (242776667) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 414.20M (414199417) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 31s011ms - TotalStorageWaitTime: 32s951ms - TotalThreadsInvoluntaryContextSwitches: 18.14K (18138) - TotalThreadsTotalWallClockTime: 13m22s - TotalThreadsSysTime: 4s367ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 422.68K (422681) Fragment Instance Lifecycle Timings: - ExecTime: 1m40s - ExecTreeExecTime: 1s600ms - OpenTime: 14.687ms - ExecTreeOpenTime: 229.261us - PrepareTime: 44.936ms - ExecTreePrepareTime: 2.235ms DataStreamSender (dst_id=22):(Total: 46s735ms, non-child: 46s735ms, % non-child: 100.00%) - BytesSent: 5.90 GB (6331732864) - NetworkThroughput(*): 347.02 MB/sec - OverallThroughput: 129.20 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 414.20M (414199417) - SerializeBatchTime: 29s287ms - TransmitDataRPCTime: 17s400ms - UncompressedRowBatchSize: 8.10 GB (8699908221) CodeGen:(Total: 36.669ms, non-child: 36.669ms, % non-child: 100.00%) - CodegenTime: 342.506us - CompileTime: 4.283ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.132ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 24.528ms HDFS_SCAN_NODE (id=1):(Total: 1s448ms, non-child: 1s448ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:40/3.52 GB 0:37/2.95 GB 4:39/3.07 GB 2:26/2.06 GB 6:30/2.43 GB 5:37/3.22 GB 7:34/2.56 GB 1:41/3.14 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 284 out of 284 Hdfs Read Thread Concurrency Bucket: 0:90.05% 1:8.955% 2:0.4975% 3:0.4975% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:568 BytesRead(2s000ms): 111.10 MB, 213.04 MB, 316.26 MB, 447.72 MB, 527.05 MB, 639.99 MB, 741.58 MB, 863.42 MB, 1017.76 MB, 1.10 GB, 1.19 GB, 1.30 GB, 1.35 GB, 1.40 GB, 1.45 GB, 1.51 GB, 1.60 GB, 1.72 GB, 1.76 GB, 1.85 GB, 1.97 GB, 2.09 GB, 2.18 GB, 2.30 GB, 2.40 GB, 2.52 GB, 2.63 GB, 2.71 GB, 2.81 GB, 2.89 GB, 2.95 GB, 2.97 GB, 3.05 GB, 3.05 GB, 3.06 GB, 3.08 GB, 3.19 GB, 3.30 GB, 3.37 GB, 3.42 GB, 3.53 GB, 3.55 GB, 3.60 GB, 3.62 GB, 3.71 GB, 3.81 GB, 3.89 GB, 3.99 GB, 4.05 GB, 4.15 GB - FooterProcessingTime: (Avg: 43.309ms ; Min: 1.026ms ; Max: 762.253ms ; Number of samples: 284) - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 6.98 - BytesRead: 4.20 GB (4505301420) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.20 GB (4505301420) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.20 GB (4505301420) - DecompressionTime: 16s197ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 284 (284) - NumScannerThreadsStarted: 8 (8) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 231.29 MB (242528953) - PerReadThreadRawHdfsThroughput: 379.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.994ms - RowBatchQueuePutWaitTime: 10m35s - RowsRead: 414.20M (414199417) - RowsReturned: 414.20M (414199417) - RowsReturnedRate: 286.00 M/sec - ScanRangesComplete: 284 (284) - ScannerThreadsInvoluntaryContextSwitches: 9.31K (9312) - ScannerThreadsTotalWallClockTime: 11m42s - MaterializeTupleTime(*): 13s324ms - ScannerThreadsSysTime: 2s369ms - ScannerThreadsUserTime: 30s278ms - ScannerThreadsVoluntaryContextSwitches: 416.33K (416331) - TotalRawHdfsReadTime(*): 11s315ms - TotalReadThroughput: 42.75 MB/sec Instance 8d463de3722df36f:a2dae93a0000000b (host=vd1316.halxg.cloudera.com:22000):(Total: 1m39s, non-child: 51s848ms, % non-child: 51.97%) Hdfs split stats (:<# splits>/): 2:41/3.19 GB 0:28/2.35 GB 4:38/3.10 GB 5:41/3.26 GB 1:31/2.33 GB 3:42/2.96 GB 7:29/2.52 GB 6:40/3.22 GB MemoryUsage(2s000ms): 87.19 MB, 102.62 MB, 106.15 MB, 110.49 MB, 158.34 MB, 124.20 MB, 127.44 MB, 125.70 MB, 140.39 MB, 180.89 MB, 160.91 MB, 152.50 MB, 134.73 MB, 137.52 MB, 128.82 MB, 139.66 MB, 133.39 MB, 115.96 MB, 136.24 MB, 125.09 MB, 140.31 MB, 133.71 MB, 176.82 MB, 154.25 MB, 135.07 MB, 138.81 MB, 142.05 MB, 142.81 MB, 126.53 MB, 139.01 MB, 161.19 MB, 155.30 MB, 124.15 MB, 136.02 MB, 137.15 MB, 139.60 MB, 131.32 MB, 128.23 MB, 118.66 MB, 118.11 MB, 123.32 MB, 124.46 MB, 139.57 MB, 155.33 MB, 145.13 MB, 130.58 MB, 137.33 MB, 113.69 MB, 135.07 MB, 103.84 MB ThreadUsage(2s000ms): 6, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7 - AverageThreadTokens: 7.95 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 206.05 MB (216061841) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 411.04M (411038661) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s420ms - TotalStorageWaitTime: 34s979ms - TotalThreadsInvoluntaryContextSwitches: 17.95K (17948) - TotalThreadsTotalWallClockTime: 13m16s - TotalThreadsSysTime: 4s356ms - TotalThreadsUserTime: 1m37s - TotalThreadsVoluntaryContextSwitches: 421.27K (421272) Fragment Instance Lifecycle Timings: - ExecTime: 1m39s - ExecTreeExecTime: 1s690ms - OpenTime: 16.060ms - ExecTreeOpenTime: 196.693us - PrepareTime: 48.791ms - ExecTreePrepareTime: 1.408ms DataStreamSender (dst_id=22):(Total: 46s323ms, non-child: 46s323ms, % non-child: 100.00%) - BytesSent: 5.86 GB (6290390462) - NetworkThroughput(*): 353.77 MB/sec - OverallThroughput: 129.50 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 411.04M (411038661) - SerializeBatchTime: 29s320ms - TransmitDataRPCTime: 16s957ms - UncompressedRowBatchSize: 8.04 GB (8633519225) CodeGen:(Total: 48.993ms, non-child: 48.993ms, % non-child: 100.00%) - CodegenTime: 287.602us - CompileTime: 5.638ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.678ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 35.147ms HDFS_SCAN_NODE (id=1):(Total: 1s544ms, non-child: 1s544ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:41/3.19 GB 0:28/2.35 GB 4:38/3.10 GB 5:41/3.26 GB 1:31/2.33 GB 3:42/2.96 GB 7:29/2.52 GB 6:40/3.22 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 290 out of 290 Hdfs Read Thread Concurrency Bucket: 0:95.48% 1:4.523% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:580 BytesRead(2s000ms): 68.78 MB, 185.04 MB, 307.02 MB, 443.17 MB, 593.03 MB, 688.92 MB, 808.44 MB, 925.96 MB, 1.01 GB, 1.17 GB, 1.27 GB, 1.39 GB, 1.43 GB, 1.46 GB, 1.53 GB, 1.57 GB, 1.68 GB, 1.77 GB, 1.86 GB, 1.91 GB, 2.04 GB, 2.17 GB, 2.30 GB, 2.40 GB, 2.49 GB, 2.58 GB, 2.70 GB, 2.75 GB, 2.85 GB, 2.94 GB, 3.01 GB, 3.01 GB, 3.06 GB, 3.09 GB, 3.09 GB, 3.10 GB, 3.18 GB, 3.27 GB, 3.36 GB, 3.44 GB, 3.45 GB, 3.48 GB, 3.57 GB, 3.61 GB, 3.62 GB, 3.74 GB, 3.86 GB, 3.99 GB, 4.08 GB, 4.16 GB - FooterProcessingTime: (Avg: 54.300ms ; Min: 1.020ms ; Max: 1s020ms ; Number of samples: 290) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 6.98 - BytesRead: 4.18 GB (4483969606) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.18 GB (4483969606) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.18 GB (4483969606) - DecompressionTime: 16s191ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 290 (290) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 205.79 MB (215781359) - PerReadThreadRawHdfsThroughput: 929.04 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.424ms - RowBatchQueuePutWaitTime: 10m28s - RowsRead: 411.04M (411038661) - RowsReturned: 411.04M (411038661) - RowsReturnedRate: 266.12 M/sec - ScanRangesComplete: 290 (290) - ScannerThreadsInvoluntaryContextSwitches: 9.57K (9567) - ScannerThreadsTotalWallClockTime: 11m36s - MaterializeTupleTime(*): 12s537ms - ScannerThreadsSysTime: 2s375ms - ScannerThreadsUserTime: 30s608ms - ScannerThreadsVoluntaryContextSwitches: 414.82K (414821) - TotalRawHdfsReadTime(*): 4s602ms - TotalReadThroughput: 42.76 MB/sec Instance 8d463de3722df36f:a2dae93a0000000e (host=vd1311.halxg.cloudera.com:22000):(Total: 1m39s, non-child: 52s054ms, % non-child: 52.27%) Hdfs split stats (:<# splits>/): 7:31/2.70 GB 4:39/3.12 GB 0:49/3.59 GB 3:31/2.34 GB 2:33/2.60 GB 6:25/2.24 GB 5:39/3.03 GB 1:42/3.27 GB MemoryUsage(2s000ms): 113.05 MB, 112.28 MB, 162.76 MB, 117.63 MB, 147.50 MB, 99.50 MB, 105.45 MB, 108.35 MB, 104.89 MB, 122.67 MB, 133.88 MB, 145.76 MB, 138.40 MB, 148.68 MB, 135.58 MB, 128.99 MB, 142.05 MB, 150.36 MB, 123.32 MB, 123.98 MB, 130.54 MB, 137.87 MB, 115.16 MB, 127.29 MB, 168.14 MB, 179.70 MB, 148.08 MB, 169.07 MB, 134.82 MB, 143.09 MB, 150.33 MB, 141.39 MB, 115.25 MB, 116.03 MB, 123.25 MB, 126.52 MB, 135.57 MB, 127.01 MB, 119.26 MB, 125.37 MB, 108.63 MB, 128.91 MB, 121.50 MB, 113.05 MB, 128.30 MB, 113.92 MB, 140.60 MB, 140.45 MB, 92.33 MB, 100.61 MB ThreadUsage(2s000ms): 6, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6 - AverageThreadTokens: 7.93 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 199.20 MB (208879993) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 410.04M (410037771) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s502ms - TotalStorageWaitTime: 41s459ms - TotalThreadsInvoluntaryContextSwitches: 18.44K (18443) - TotalThreadsTotalWallClockTime: 13m14s - TotalThreadsSysTime: 3s980ms - TotalThreadsUserTime: 1m36s - TotalThreadsVoluntaryContextSwitches: 418.37K (418367) Fragment Instance Lifecycle Timings: - ExecTime: 1m39s - ExecTreeExecTime: 1s606ms - OpenTime: 27.153ms - ExecTreeOpenTime: 377.606us - PrepareTime: 30.220ms - ExecTreePrepareTime: 1.296ms DataStreamSender (dst_id=22):(Total: 46s033ms, non-child: 46s033ms, % non-child: 100.00%) - BytesSent: 5.85 GB (6276345242) - NetworkThroughput(*): 356.65 MB/sec - OverallThroughput: 130.03 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 410.04M (410037771) - SerializeBatchTime: 29s206ms - TransmitDataRPCTime: 16s782ms - UncompressedRowBatchSize: 8.02 GB (8612496371) CodeGen:(Total: 46.773ms, non-child: 46.773ms, % non-child: 100.00%) - CodegenTime: 298.829us - CompileTime: 9.607ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 14.315ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 22.314ms HDFS_SCAN_NODE (id=1):(Total: 1s454ms, non-child: 1s454ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:31/2.70 GB 4:39/3.12 GB 0:49/3.59 GB 3:31/2.34 GB 2:33/2.60 GB 6:25/2.24 GB 5:39/3.03 GB 1:42/3.27 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 289 out of 289 Hdfs Read Thread Concurrency Bucket: 0:88.94% 1:10.55% 2:0.5025% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:578 BytesRead(2s000ms): 120.10 MB, 230.67 MB, 346.14 MB, 486.12 MB, 589.38 MB, 690.96 MB, 823.50 MB, 926.08 MB, 1.00 GB, 1.14 GB, 1.28 GB, 1.40 GB, 1.44 GB, 1.50 GB, 1.50 GB, 1.57 GB, 1.69 GB, 1.77 GB, 1.82 GB, 1.90 GB, 2.03 GB, 2.15 GB, 2.23 GB, 2.35 GB, 2.51 GB, 2.61 GB, 2.72 GB, 2.77 GB, 2.86 GB, 2.94 GB, 2.97 GB, 2.99 GB, 3.05 GB, 3.05 GB, 3.07 GB, 3.09 GB, 3.21 GB, 3.27 GB, 3.39 GB, 3.42 GB, 3.45 GB, 3.53 GB, 3.56 GB, 3.58 GB, 3.66 GB, 3.78 GB, 3.89 GB, 4.02 GB, 4.08 GB - FooterProcessingTime: (Avg: 58.660ms ; Min: 1.059ms ; Max: 1s004ms ; Number of samples: 289) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 6.96 - BytesRead: 4.17 GB (4475888693) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.17 GB (4475888693) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.17 GB (4475888693) - DecompressionTime: 16s109ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 289 (289) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 198.97 MB (208632279) - PerReadThreadRawHdfsThroughput: 415.67 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.696ms - RowBatchQueuePutWaitTime: 10m19s - RowsRead: 410.04M (410037771) - RowsReturned: 410.04M (410037771) - RowsReturnedRate: 281.87 M/sec - ScanRangesComplete: 289 (289) - ScannerThreadsInvoluntaryContextSwitches: 9.97K (9970) - ScannerThreadsTotalWallClockTime: 11m34s - MaterializeTupleTime(*): 12s256ms - ScannerThreadsSysTime: 2s130ms - ScannerThreadsUserTime: 30s291ms - ScannerThreadsVoluntaryContextSwitches: 412.40K (412402) - TotalRawHdfsReadTime(*): 10s269ms - TotalReadThroughput: 42.90 MB/sec Instance 8d463de3722df36f:a2dae93a0000000a (host=vd1310.halxg.cloudera.com:22000):(Total: 1m39s, non-child: 51s922ms, % non-child: 52.19%) Hdfs split stats (:<# splits>/): 7:29/2.42 GB 1:35/3.13 GB 3:42/3.40 GB 6:31/2.44 GB 0:38/2.94 GB 2:40/3.16 GB 5:37/2.80 GB 4:38/2.64 GB MemoryUsage(2s000ms): 110.80 MB, 113.82 MB, 120.06 MB, 148.27 MB, 164.92 MB, 147.87 MB, 138.73 MB, 106.62 MB, 124.62 MB, 113.20 MB, 136.23 MB, 116.96 MB, 113.12 MB, 137.15 MB, 144.82 MB, 138.16 MB, 136.73 MB, 135.86 MB, 154.13 MB, 139.56 MB, 130.26 MB, 121.90 MB, 116.89 MB, 116.96 MB, 132.80 MB, 136.91 MB, 122.94 MB, 145.54 MB, 144.11 MB, 143.59 MB, 126.42 MB, 117.18 MB, 125.12 MB, 140.76 MB, 138.86 MB, 131.66 MB, 136.08 MB, 139.95 MB, 143.53 MB, 154.30 MB, 134.92 MB, 133.70 MB, 143.63 MB, 142.41 MB, 134.42 MB, 126.74 MB, 152.62 MB, 144.78 MB, 145.60 MB ThreadUsage(2s000ms): 6, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 7.95 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 192.22 MB (201553859) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 408.06M (408063197) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30s805ms - TotalStorageWaitTime: 26s601ms - TotalThreadsInvoluntaryContextSwitches: 17.26K (17264) - TotalThreadsTotalWallClockTime: 13m13s - TotalThreadsSysTime: 4s488ms - TotalThreadsUserTime: 1m36s - TotalThreadsVoluntaryContextSwitches: 414.11K (414110) Fragment Instance Lifecycle Timings: - ExecTime: 1m39s - ExecTreeExecTime: 1s588ms - OpenTime: 23.134ms - ExecTreeOpenTime: 265.385us - PrepareTime: 35.720ms - ExecTreePrepareTime: 979.397us DataStreamSender (dst_id=22):(Total: 46s081ms, non-child: 46s081ms, % non-child: 100.00%) - BytesSent: 5.82 GB (6252842472) - NetworkThroughput(*): 352.87 MB/sec - OverallThroughput: 129.40 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 408.06M (408063197) - SerializeBatchTime: 29s138ms - TransmitDataRPCTime: 16s898ms - UncompressedRowBatchSize: 7.98 GB (8571022113) CodeGen:(Total: 41.830ms, non-child: 41.830ms, % non-child: 100.00%) - CodegenTime: 744.335us - CompileTime: 4.648ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 12.460ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 23.230ms HDFS_SCAN_NODE (id=1):(Total: 1s437ms, non-child: 1s437ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:29/2.42 GB 1:35/3.13 GB 3:42/3.40 GB 6:31/2.44 GB 0:38/2.94 GB 2:40/3.16 GB 5:37/2.80 GB 4:38/2.64 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 290 out of 290 Hdfs Read Thread Concurrency Bucket: 0:95.96% 1:3.535% 2:0.5051% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:580 BytesRead(2s000ms): 85.11 MB, 175.67 MB, 298.68 MB, 444.03 MB, 571.64 MB, 640.99 MB, 757.57 MB, 854.01 MB, 976.78 MB, 1.05 GB, 1.20 GB, 1.31 GB, 1.37 GB, 1.43 GB, 1.48 GB, 1.52 GB, 1.62 GB, 1.73 GB, 1.82 GB, 1.87 GB, 1.98 GB, 2.09 GB, 2.17 GB, 2.26 GB, 2.39 GB, 2.51 GB, 2.62 GB, 2.70 GB, 2.82 GB, 2.90 GB, 2.95 GB, 2.95 GB, 3.04 GB, 3.06 GB, 3.06 GB, 3.07 GB, 3.18 GB, 3.28 GB, 3.38 GB, 3.45 GB, 3.46 GB, 3.51 GB, 3.58 GB, 3.59 GB, 3.63 GB, 3.74 GB, 3.89 GB, 4.01 GB, 4.09 GB - FooterProcessingTime: (Avg: 40.936ms ; Min: 877.997us ; Max: 1s077ms ; Number of samples: 290) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 6.99 - BytesRead: 4.16 GB (4464685742) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.16 GB (4464685742) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.16 GB (4464685742) - DecompressionTime: 15s767ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 290 (290) - NumScannerThreadsStarted: 8 (8) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 191.99 MB (201314329) - PerReadThreadRawHdfsThroughput: 690.31 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.892ms - RowBatchQueuePutWaitTime: 10m35s - RowsRead: 408.06M (408063197) - RowsReturned: 408.06M (408063197) - RowsReturnedRate: 283.84 M/sec - ScanRangesComplete: 290 (290) - ScannerThreadsInvoluntaryContextSwitches: 8.67K (8673) - ScannerThreadsTotalWallClockTime: 11m34s - MaterializeTupleTime(*): 12s026ms - ScannerThreadsSysTime: 2s380ms - ScannerThreadsUserTime: 30s380ms - ScannerThreadsVoluntaryContextSwitches: 408.04K (408039) - TotalRawHdfsReadTime(*): 6s168ms - TotalReadThroughput: 42.79 MB/sec Instance 8d463de3722df36f:a2dae93a00000009 (host=vd1313.halxg.cloudera.com:22000):(Total: 1m35s, non-child: 49s345ms, % non-child: 51.53%) Hdfs split stats (:<# splits>/): 2:37/2.99 GB 1:31/2.41 GB 3:42/3.09 GB 4:41/3.24 GB 7:35/2.69 GB 0:43/3.32 GB 6:33/2.77 GB 5:33/2.51 GB MemoryUsage(2s000ms): 148.02 MB, 103.09 MB, 112.48 MB, 108.27 MB, 135.82 MB, 129.09 MB, 89.94 MB, 126.85 MB, 110.29 MB, 112.48 MB, 96.38 MB, 117.64 MB, 144.05 MB, 134.13 MB, 105.47 MB, 139.67 MB, 127.96 MB, 130.34 MB, 129.89 MB, 133.06 MB, 122.72 MB, 149.36 MB, 121.87 MB, 134.52 MB, 139.18 MB, 131.24 MB, 142.59 MB, 123.02 MB, 131.14 MB, 153.25 MB, 138.14 MB, 133.03 MB, 161.26 MB, 168.32 MB, 168.63 MB, 166.87 MB, 146.80 MB, 141.14 MB, 138.65 MB, 141.47 MB, 158.06 MB, 138.29 MB, 125.37 MB, 140.19 MB, 119.76 MB, 111.57 MB, 116.02 MB ThreadUsage(2s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 8.01 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 171.36 MB (179679430) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 406.56M (406563722) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 29s700ms - TotalStorageWaitTime: 47s808ms - TotalThreadsInvoluntaryContextSwitches: 17.97K (17973) - TotalThreadsTotalWallClockTime: 12m45s - TotalThreadsSysTime: 3s892ms - TotalThreadsUserTime: 1m33s - TotalThreadsVoluntaryContextSwitches: 411.37K (411373) Fragment Instance Lifecycle Timings: - ExecTime: 1m35s - ExecTreeExecTime: 1s453ms - OpenTime: 14.416ms - ExecTreeOpenTime: 220.515us - PrepareTime: 50.977ms - ExecTreePrepareTime: 2.058ms DataStreamSender (dst_id=22):(Total: 45s056ms, non-child: 45s056ms, % non-child: 100.00%) - BytesSent: 5.81 GB (6237775221) - NetworkThroughput(*): 350.45 MB/sec - OverallThroughput: 132.03 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 406.56M (406563722) - SerializeBatchTime: 28s040ms - TransmitDataRPCTime: 16s974ms - UncompressedRowBatchSize: 7.95 GB (8539526914) CodeGen:(Total: 44.303ms, non-child: 44.303ms, % non-child: 100.00%) - CodegenTime: 293.537us - CompileTime: 4.955ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 6.802ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 31.991ms HDFS_SCAN_NODE (id=1):(Total: 1s318ms, non-child: 1s318ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:37/2.99 GB 1:31/2.41 GB 3:42/3.09 GB 4:41/3.24 GB 7:35/2.69 GB 0:43/3.32 GB 6:33/2.77 GB 5:33/2.51 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 295 out of 295 Hdfs Read Thread Concurrency Bucket: 0:89.53% 1:9.424% 2:1.047% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:590 BytesRead(2s000ms): 120.12 MB, 219.21 MB, 352.58 MB, 473.33 MB, 608.85 MB, 719.90 MB, 830.88 MB, 962.62 MB, 1.02 GB, 1.16 GB, 1.28 GB, 1.42 GB, 1.48 GB, 1.50 GB, 1.53 GB, 1.61 GB, 1.70 GB, 1.82 GB, 1.88 GB, 1.96 GB, 2.07 GB, 2.21 GB, 2.29 GB, 2.42 GB, 2.54 GB, 2.64 GB, 2.77 GB, 2.84 GB, 2.96 GB, 3.05 GB, 3.09 GB, 3.11 GB, 3.22 GB, 3.23 GB, 3.23 GB, 3.24 GB, 3.34 GB, 3.43 GB, 3.53 GB, 3.59 GB, 3.64 GB, 3.66 GB, 3.73 GB, 3.76 GB, 3.78 GB, 3.91 GB, 4.03 GB - FooterProcessingTime: (Avg: 61.680ms ; Min: 1.124ms ; Max: 983.532ms ; Number of samples: 295) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 7.01 - BytesRead: 4.16 GB (4461963090) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.16 GB (4461963090) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.16 GB (4461963090) - DecompressionTime: 15s216ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 295 (295) - NumScannerThreadsStarted: 8 (8) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 171.14 MB (179448100) - PerReadThreadRawHdfsThroughput: 378.27 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.915ms - RowBatchQueuePutWaitTime: 9m50s - RowsRead: 406.56M (406563722) - RowsReturned: 406.56M (406563722) - RowsReturnedRate: 308.39 M/sec - ScanRangesComplete: 295 (295) - ScannerThreadsInvoluntaryContextSwitches: 10.45K (10447) - ScannerThreadsTotalWallClockTime: 11m10s - MaterializeTupleTime(*): 12s557ms - ScannerThreadsSysTime: 2s240ms - ScannerThreadsUserTime: 29s629ms - ScannerThreadsVoluntaryContextSwitches: 405.35K (405345) - TotalRawHdfsReadTime(*): 11s249ms - TotalReadThroughput: 44.56 MB/sec Averaged Fragment F03:(Total: 101.597ms, non-child: 15.717ms, % non-child: 15.47%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:266.562ms max:266.562ms mean: 266.562ms stddev:0.000ns execution rates: min:8.06 MB/sec max:8.06 MB/sec mean:8.06 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 474.42 MB (497470364) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.462us - TotalStorageWaitTime: 4.994ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 61.359ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 27.996ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Fragment Instance Lifecycle Timings: - ExecTime: 17.814ms - ExecTreeExecTime: 16.713ms - OpenTime: 27.292ms - ExecTreeOpenTime: 61.872us - PrepareTime: 56.436ms - ExecTreePrepareTime: 111.456us DataStreamSender (dst_id=23):(Total: 325.227us, non-child: 325.227us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 298.01 MB/sec - OverallThroughput: 60.43 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 19.359us - TransmitDataRPCTime: 65.949us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 68.529ms, non-child: 68.529ms, % non-child: 100.00%) - CodegenTime: 654.914us - CompileTime: 8.003ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 17.416ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 42.530ms HDFS_SCAN_NODE (id=2):(Total: 17.025ms, non-child: 17.025ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 185.711us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 707.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.088ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 21.50 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 16.468ms - MaterializeTupleTime(*): 5.399ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 642.390us - TotalReadThroughput: 0.00 /sec Fragment F03: Instance 8d463de3722df36f:a2dae93a0000000f (host=vd1316.halxg.cloudera.com:22000):(Total: 101.597ms, non-child: 15.717ms, % non-child: 15.47%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB MemoryUsage(500.000ms): 107.53 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 474.42 MB (497470364) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 3.462us - TotalStorageWaitTime: 4.994ms - TotalThreadsInvoluntaryContextSwitches: 21 (21) - TotalThreadsTotalWallClockTime: 61.359ms - TotalThreadsSysTime: 3.999ms - TotalThreadsUserTime: 27.996ms - TotalThreadsVoluntaryContextSwitches: 61 (61) Fragment Instance Lifecycle Timings: - ExecTime: 17.814ms - ExecTreeExecTime: 16.713ms - OpenTime: 27.292ms - ExecTreeOpenTime: 61.872us - PrepareTime: 56.436ms - ExecTreePrepareTime: 111.456us DataStreamSender (dst_id=23):(Total: 325.227us, non-child: 325.227us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 298.01 MB/sec - OverallThroughput: 60.43 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 19.359us - TransmitDataRPCTime: 65.949us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 68.529ms, non-child: 68.529ms, % non-child: 100.00%) - CodegenTime: 654.914us - CompileTime: 8.003ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 17.416ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 42.530ms HDFS_SCAN_NODE (id=2):(Total: 17.025ms, non-child: 17.025ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 2.177ms ; Min: 2.177ms ; Max: 2.177ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 185.711us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 707.23 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.088ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 21.50 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 4 (4) - ScannerThreadsTotalWallClockTime: 16.468ms - MaterializeTupleTime(*): 5.399ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 25 (25) - TotalRawHdfsReadTime(*): 642.390us - TotalReadThroughput: 0.00 /sec Averaged Fragment F09:(Total: 19m24s, non-child: 9.906ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:19m46s max:19m46s mean: 19m46s stddev:3.227ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 98.00 MB (102760448) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 117.18 MB (122870195) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 14m57s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.18K (17178) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s624ms - TotalThreadsUserTime: 33s744ms - TotalThreadsVoluntaryContextSwitches: 495.29K (495291) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m24s - PrepareTime: 54.392ms - ExecTreePrepareTime: 2.670ms DataStreamSender (dst_id=31):(Total: 37.964us, non-child: 37.964us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 135.622ms, non-child: 135.622ms, % non-child: 100.00%) - CodegenTime: 2.804ms - CompileTime: 26.056ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 64.320ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 44.449ms AGGREGATION_NODE (id=30):(Total: 19m24s, non-child: 4m21s, % non-child: 22.43%) - BufferPoolAllocTime: 1s699ms - BufferPoolAllocationBytes: 10.66 GB (11448652361) - BufferPoolAllocations: 5.45K (5450) - BufferPoolPeakReservation: 98.00 MB (102760448) - BufferPoolPeakUnpinnedBytes: 9.99 GB (10726932480) - BufferPoolPeakUsedReservation: 98.00 MB (102760448) - BufferPoolReadIoBytes: 229.14 MB (240273700) - BufferPoolReadIoOps: 114 (114) - BufferPoolReadIoWaitTime: 17s287ms - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 10.32 GB (11083747913) - BufferPoolWriteIoBytes: 10.32 GB (11083747913) - BufferPoolWriteIoOps: 5.29K (5285) - BufferPoolWriteIoWaitTime: 3m32s - BuildTime: 4m20s - GetResultsTime: 0.000ns - HTResizeTime: 41.095ms - HashBuckets: 0 (0) - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 2 (2) - NumRepartitions: 2 (2) - PartitionsCreated: 48 (48) - PeakMemoryUsage: 98.09 MB (102859455) - RowsRepartitioned: 3.44M (3435145) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 44 (44) EXCHANGE_NODE (id=29):(Total: 15m2s, non-child: 15m2s, % non-child: 100.00%) - BytesReceived: 5.08 GB (5453375455) - ConvertRowBatchTime: 4s519ms - DeserializeRowBatchTimer: 52s300ms - FirstBatchArrivalWaitTime: 24s749ms - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186110902) - RowsReturnedRate: 206.40 K/sec - SendersBlockedTimer: 1m9s - SendersBlockedTotalTimer(*): 7m30s Fragment F09: Instance 8d463de3722df36f:a2dae93a0000002e (host=vd1313.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 11.077ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.07 MB, 36.80 MB, 37.09 MB, 37.72 MB, 38.09 MB, 38.02 MB, 36.16 MB, 42.77 MB, 51.07 MB, 37.53 MB, 34.61 MB, 44.43 MB, 46.18 MB, 36.63 MB, 39.13 MB, 38.21 MB, 39.35 MB, 41.70 MB, 36.97 MB, 36.23 MB, 39.02 MB, 37.07 MB, 35.45 MB, 34.51 MB, 35.93 MB, 35.54 MB, 35.56 MB, 34.54 MB, 34.84 MB, 34.74 MB, 34.92 MB, 36.74 MB, 36.23 MB, 35.44 MB, 34.11 MB, 34.11 MB, 142.36 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 482.00 MB (505413632) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 482.06 MB (505479791) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 14m14s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.88K (15875) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s715ms - TotalThreadsUserTime: 33s235ms - TotalThreadsVoluntaryContextSwitches: 470.56K (470565) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m23s - PrepareTime: 52.642ms - ExecTreePrepareTime: 1.480ms DataStreamSender (dst_id=31):(Total: 37.462us, non-child: 37.462us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 151.751ms, non-child: 151.751ms, % non-child: 100.00%) - CodegenTime: 2.712ms - CompileTime: 25.769ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 80.921ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 44.472ms AGGREGATION_NODE (id=30):(Total: 19m23s, non-child: 5m4s, % non-child: 26.15%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s330ms - BufferPoolAllocationBytes: 10.71 GB (11502878720) - BufferPoolAllocations: 5.42K (5421) - BufferPoolPeakReservation: 482.00 MB (505413632) - BufferPoolPeakUnpinnedBytes: 9.92 GB (10649337856) - BufferPoolPeakUsedReservation: 482.00 MB (505413632) - BufferPoolReadIoBytes: 218.00 MB (228589568) - BufferPoolReadIoOps: 109 (109) - BufferPoolReadIoWaitTime: 17s713ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 9.92 GB (10649337856) - BufferPoolWriteIoBytes: 9.92 GB (10649337856) - BufferPoolWriteIoOps: 5.08K (5078) - BufferPoolWriteIoWaitTime: 4m18s - BuildTime: 5m3s - GetResultsTime: 0.000ns - HTResizeTime: 229.374ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 482.04 MB (505453696) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=29):(Total: 14m19s, non-child: 12s482ms, % non-child: 1.45%) BytesReceived(32s000ms): 2.63 MB, 226.09 MB, 461.18 MB, 657.04 MB, 848.41 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.51 GB, 2.66 GB, 2.76 GB, 2.94 GB, 3.11 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.17 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.84 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5453374944) - ConvertRowBatchTime: 4s538ms - DeserializeRowBatchTimer: 44s744ms - FirstBatchArrivalWaitTime: 24s737ms - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186109102) - RowsReturnedRate: 216.51 K/sec - SendersBlockedTimer: 1m25s - SendersBlockedTotalTimer(*): 9m15s Instance 8d463de3722df36f:a2dae93a00000030 (host=vd1314.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 10.362ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.07 MB, 38.95 MB, 39.79 MB, 36.79 MB, 37.76 MB, 38.82 MB, 41.23 MB, 40.49 MB, 35.66 MB, 50.23 MB, 49.57 MB, 45.54 MB, 39.38 MB, 45.15 MB, 34.65 MB, 34.43 MB, 35.97 MB, 34.59 MB, 34.16 MB, 35.32 MB, 34.80 MB, 35.63 MB, 34.78 MB, 35.17 MB, 34.68 MB, 34.23 MB, 35.21 MB, 34.47 MB, 34.26 MB, 34.35 MB, 34.19 MB, 34.89 MB, 34.50 MB, 34.47 MB, 34.12 MB, 34.11 MB, 34.08 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.36 MB (59101929) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 14m56s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.88K (17877) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s541ms - TotalThreadsUserTime: 33s983ms - TotalThreadsVoluntaryContextSwitches: 512.69K (512691) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m24s - PrepareTime: 45.789ms - ExecTreePrepareTime: 1.516ms DataStreamSender (dst_id=31):(Total: 36.090us, non-child: 36.090us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 119.918ms, non-child: 119.918ms, % non-child: 100.00%) - CodegenTime: 2.650ms - CompileTime: 24.866ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 54.339ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 40.212ms AGGREGATION_NODE (id=30):(Total: 19m24s, non-child: 4m21s, % non-child: 22.51%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s501ms - BufferPoolAllocationBytes: 10.42 GB (11184111616) - BufferPoolAllocations: 5.33K (5333) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10682892288) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 184.00 MB (192937984) - BufferPoolReadIoOps: 92 (92) - BufferPoolReadIoWaitTime: 18s981ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.20 GB (10953424896) - BufferPoolWriteIoBytes: 10.20 GB (10953424896) - BufferPoolWriteIoOps: 5.22K (5223) - BufferPoolWriteIoWaitTime: 3m37s - BuildTime: 4m21s - GetResultsTime: 0.000ns - HTResizeTime: 9.714ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 15m2s, non-child: 12s479ms, % non-child: 1.38%) BytesReceived(32s000ms): 2.42 MB, 224.17 MB, 460.37 MB, 656.18 MB, 847.66 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.50 GB, 2.66 GB, 2.76 GB, 2.94 GB, 3.11 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.17 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.84 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5453634377) - ConvertRowBatchTime: 4s576ms - DeserializeRowBatchTimer: 42s155ms - FirstBatchArrivalWaitTime: 24s768ms - PeakMemoryUsage: 0 - RowsReturned: 186.12M (186119125) - RowsReturnedRate: 206.32 K/sec - SendersBlockedTimer: 1m32s - SendersBlockedTotalTimer(*): 10m41s Instance 8d463de3722df36f:a2dae93a0000002d (host=vd1316.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 11.440ms, % non-child: 0.00%) MemoryUsage(32s000ms): 36.53 MB, 37.48 MB, 42.90 MB, 39.64 MB, 41.35 MB, 40.06 MB, 36.38 MB, 40.38 MB, 36.39 MB, 35.41 MB, 35.90 MB, 37.31 MB, 34.24 MB, 34.97 MB, 37.76 MB, 35.14 MB, 34.69 MB, 36.93 MB, 34.44 MB, 34.25 MB, 34.38 MB, 39.69 MB, 36.78 MB, 35.92 MB, 35.02 MB, 40.72 MB, 37.60 MB, 45.73 MB, 37.85 MB, 35.85 MB, 35.73 MB, 34.29 MB, 34.33 MB, 34.10 MB, 34.11 MB, 34.11 MB, 34.08 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.36 MB (59101929) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 15.90K (15899) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s605ms - TotalThreadsUserTime: 33s791ms - TotalThreadsVoluntaryContextSwitches: 493.09K (493088) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m24s - PrepareTime: 58.489ms - ExecTreePrepareTime: 4.737ms DataStreamSender (dst_id=31):(Total: 60.697us, non-child: 60.697us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 117.511ms, non-child: 117.511ms, % non-child: 100.00%) - CodegenTime: 2.861ms - CompileTime: 17.395ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 56.106ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 43.312ms AGGREGATION_NODE (id=30):(Total: 19m24s, non-child: 4m18s, % non-child: 22.20%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s774ms - BufferPoolAllocationBytes: 10.50 GB (11270094848) - BufferPoolAllocations: 5.37K (5374) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10682892288) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 234.00 MB (245366784) - BufferPoolReadIoOps: 117 (117) - BufferPoolReadIoWaitTime: 18s575ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.23 GB (10986979328) - BufferPoolWriteIoBytes: 10.23 GB (10986979328) - BufferPoolWriteIoOps: 5.24K (5239) - BufferPoolWriteIoWaitTime: 3m34s - BuildTime: 4m17s - GetResultsTime: 0.000ns - HTResizeTime: 11.285ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.10 MB (35761180) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 15m5s, non-child: 10s068ms, % non-child: 1.11%) BytesReceived(32s000ms): 2.32 MB, 222.89 MB, 459.81 MB, 655.50 MB, 847.03 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.50 GB, 2.66 GB, 2.76 GB, 2.93 GB, 3.10 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.17 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.83 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5453446959) - ConvertRowBatchTime: 4s511ms - DeserializeRowBatchTimer: 35s794ms - FirstBatchArrivalWaitTime: 24s766ms - PeakMemoryUsage: 0 - RowsReturned: 186.12M (186115148) - RowsReturnedRate: 205.51 K/sec - SendersBlockedTimer: 1m19s - SendersBlockedTotalTimer(*): 7m50s Instance 8d463de3722df36f:a2dae93a0000002f (host=vd1310.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 8.551ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.07 MB, 35.46 MB, 37.57 MB, 40.69 MB, 40.16 MB, 36.37 MB, 38.56 MB, 39.72 MB, 34.92 MB, 36.05 MB, 38.26 MB, 40.26 MB, 37.11 MB, 34.12 MB, 39.25 MB, 35.82 MB, 35.93 MB, 34.92 MB, 35.42 MB, 36.04 MB, 34.15 MB, 40.27 MB, 34.28 MB, 34.20 MB, 34.92 MB, 34.48 MB, 34.36 MB, 34.49 MB, 34.36 MB, 36.87 MB, 46.98 MB, 34.14 MB, 34.49 MB, 34.78 MB, 34.19 MB, 34.13 MB, 34.08 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.36 MB (59101929) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16.41K (16407) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s656ms - TotalThreadsUserTime: 34s010ms - TotalThreadsVoluntaryContextSwitches: 509.32K (509324) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m24s - PrepareTime: 55.191ms - ExecTreePrepareTime: 1.745ms DataStreamSender (dst_id=31):(Total: 47.132us, non-child: 47.132us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 143.647ms, non-child: 143.647ms, % non-child: 100.00%) - CodegenTime: 2.454ms - CompileTime: 23.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 72.032ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 46.770ms AGGREGATION_NODE (id=30):(Total: 19m24s, non-child: 4m3s, % non-child: 20.89%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s799ms - BufferPoolAllocationBytes: 10.59 GB (11372855296) - BufferPoolAllocations: 5.42K (5423) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10680795136) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 270.00 MB (283115520) - BufferPoolReadIoOps: 135 (135) - BufferPoolReadIoWaitTime: 17s383ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.29 GB (11051991040) - BufferPoolWriteIoBytes: 10.29 GB (11051991040) - BufferPoolWriteIoOps: 5.27K (5270) - BufferPoolWriteIoWaitTime: 3m18s - BuildTime: 4m2s - GetResultsTime: 0.000ns - HTResizeTime: 9.869ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.11 MB (35762385) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 15m20s, non-child: 11s054ms, % non-child: 1.20%) BytesReceived(32s000ms): 2.28 MB, 222.24 MB, 459.34 MB, 654.91 MB, 846.37 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.50 GB, 2.66 GB, 2.76 GB, 2.93 GB, 3.10 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.16 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.83 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5452916943) - ConvertRowBatchTime: 4s586ms - DeserializeRowBatchTimer: 38s330ms - FirstBatchArrivalWaitTime: 24s744ms - PeakMemoryUsage: 0 - RowsReturned: 186.09M (186094132) - RowsReturnedRate: 202.09 K/sec - SendersBlockedTimer: 53s493ms - SendersBlockedTotalTimer(*): 5m43s Instance 8d463de3722df36f:a2dae93a00000032 (host=vd1311.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 5.661ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.13 MB, 34.64 MB, 39.04 MB, 38.90 MB, 38.57 MB, 39.75 MB, 40.13 MB, 45.46 MB, 38.62 MB, 34.85 MB, 34.57 MB, 38.01 MB, 35.96 MB, 35.08 MB, 35.64 MB, 39.97 MB, 34.90 MB, 37.09 MB, 34.10 MB, 34.28 MB, 35.01 MB, 38.42 MB, 36.99 MB, 38.13 MB, 36.99 MB, 34.54 MB, 38.43 MB, 35.36 MB, 34.73 MB, 34.43 MB, 34.23 MB, 34.42 MB, 35.34 MB, 35.00 MB, 34.11 MB, 34.10 MB, 34.08 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.36 MB (59101929) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m18s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 16.65K (16650) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s494ms - TotalThreadsUserTime: 32s952ms - TotalThreadsVoluntaryContextSwitches: 501.80K (501796) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m24s - PrepareTime: 46.994ms - ExecTreePrepareTime: 1.256ms DataStreamSender (dst_id=31):(Total: 32.839us, non-child: 32.839us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 129.772ms, non-child: 129.772ms, % non-child: 100.00%) - CodegenTime: 2.392ms - CompileTime: 26.173ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 61.434ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 41.634ms AGGREGATION_NODE (id=30):(Total: 19m24s, non-child: 4m, % non-child: 20.67%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s222ms - BufferPoolAllocationBytes: 10.28 GB (11033116672) - BufferPoolAllocations: 5.26K (5261) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.95 GB (10684989440) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 146.00 MB (153092096) - BufferPoolReadIoOps: 73 (73) - BufferPoolReadIoWaitTime: 17s062ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.10 GB (10844372992) - BufferPoolWriteIoBytes: 10.10 GB (10844372992) - BufferPoolWriteIoOps: 5.17K (5171) - BufferPoolWriteIoWaitTime: 3m18s - BuildTime: 3m59s - GetResultsTime: 0.000ns - HTResizeTime: 10.434ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 34.11 MB (35763582) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 32 (32) EXCHANGE_NODE (id=29):(Total: 15m23s, non-child: 10s984ms, % non-child: 1.19%) BytesReceived(32s000ms): 2.30 MB, 222.44 MB, 459.44 MB, 655.00 MB, 846.47 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.50 GB, 2.66 GB, 2.76 GB, 2.93 GB, 3.10 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.17 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.83 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5453280211) - ConvertRowBatchTime: 4s409ms - DeserializeRowBatchTimer: 43s971ms - FirstBatchArrivalWaitTime: 24s760ms - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186108155) - RowsReturnedRate: 201.54 K/sec - SendersBlockedTimer: 45s054ms - SendersBlockedTotalTimer(*): 4m42s Instance 8d463de3722df36f:a2dae93a00000031 (host=vd1309.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 12.971ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.07 MB, 34.42 MB, 35.72 MB, 39.35 MB, 39.64 MB, 36.52 MB, 38.11 MB, 34.17 MB, 35.36 MB, 39.53 MB, 34.31 MB, 44.26 MB, 41.97 MB, 38.20 MB, 40.85 MB, 37.95 MB, 37.37 MB, 39.80 MB, 37.14 MB, 38.67 MB, 38.35 MB, 41.33 MB, 35.40 MB, 35.66 MB, 35.69 MB, 35.30 MB, 34.94 MB, 34.10 MB, 35.13 MB, 40.75 MB, 35.81 MB, 34.74 MB, 35.35 MB, 37.11 MB, 34.14 MB, 34.14 MB, 34.09 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.36 MB (59101929) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 14m9s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 19.79K (19789) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s713ms - TotalThreadsUserTime: 34s137ms - TotalThreadsVoluntaryContextSwitches: 477.92K (477924) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m23s - PrepareTime: 71.323ms - ExecTreePrepareTime: 4.911ms DataStreamSender (dst_id=31):(Total: 20.603us, non-child: 20.603us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 175.554ms, non-child: 175.554ms, % non-child: 100.00%) - CodegenTime: 3.187ms - CompileTime: 45.643ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 73.583ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 54.808ms AGGREGATION_NODE (id=30):(Total: 19m23s, non-child: 5m9s, % non-child: 26.57%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 2s383ms - BufferPoolAllocationBytes: 10.88 GB (11679039488) - BufferPoolAllocations: 5.57K (5569) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 9.98 GB (10714349568) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 248.00 MB (260046848) - BufferPoolReadIoOps: 124 (124) - BufferPoolReadIoWaitTime: 14s156ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.60 GB (11381243904) - BufferPoolWriteIoBytes: 10.60 GB (11381243904) - BufferPoolWriteIoOps: 5.43K (5427) - BufferPoolWriteIoWaitTime: 3m59s - BuildTime: 5m8s - GetResultsTime: 0.000ns - HTResizeTime: 6.354ms - HashBuckets: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 2 (2) - NumRepartitions: 2 (2) - PartitionsCreated: 48 (48) - PeakMemoryUsage: 34.10 MB (35761180) - RowsRepartitioned: 11.63M (11631129) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 48 (48) EXCHANGE_NODE (id=29):(Total: 14m14s, non-child: 19s483ms, % non-child: 2.28%) BytesReceived(32s000ms): 2.27 MB, 222.19 MB, 459.33 MB, 654.91 MB, 846.55 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.50 GB, 2.66 GB, 2.76 GB, 2.93 GB, 3.10 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.17 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.83 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5453266163) - ConvertRowBatchTime: 4s423ms - DeserializeRowBatchTimer: 1m58s - FirstBatchArrivalWaitTime: 24s699ms - PeakMemoryUsage: 0 - RowsReturned: 186.11M (186108020) - RowsReturnedRate: 217.74 K/sec - SendersBlockedTimer: 1m27s - SendersBlockedTotalTimer(*): 9m30s Instance 8d463de3722df36f:a2dae93a00000033 (host=vd1312.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 9.279ms, % non-child: 0.00%) MemoryUsage(32s000ms): 34.07 MB, 37.69 MB, 37.28 MB, 41.54 MB, 38.52 MB, 38.16 MB, 39.11 MB, 41.87 MB, 38.13 MB, 37.28 MB, 35.03 MB, 34.93 MB, 34.16 MB, 39.64 MB, 36.87 MB, 36.18 MB, 38.21 MB, 34.19 MB, 34.10 MB, 34.62 MB, 34.24 MB, 34.13 MB, 34.42 MB, 34.26 MB, 34.18 MB, 35.01 MB, 34.96 MB, 34.16 MB, 37.00 MB, 35.35 MB, 34.10 MB, 34.72 MB, 36.51 MB, 34.18 MB, 34.10 MB, 34.13 MB, 34.17 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.36 MB (59101929) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 15m48s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 17.75K (17753) - TotalThreadsTotalWallClockTime: 19m24s - TotalThreadsSysTime: 7s644ms - TotalThreadsUserTime: 34s099ms - TotalThreadsVoluntaryContextSwitches: 501.65K (501650) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 0.000ns - OpenTime: 19m24s - ExecTreeOpenTime: 19m24s - PrepareTime: 50.315ms - ExecTreePrepareTime: 3.042ms DataStreamSender (dst_id=31):(Total: 30.925us, non-child: 30.925us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 111.201ms, non-child: 111.201ms, % non-child: 100.00%) - CodegenTime: 3.372ms - CompileTime: 18.838ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 51.821ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 39.937ms AGGREGATION_NODE (id=30):(Total: 19m24s, non-child: 3m29s, % non-child: 18.02%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s883ms - BufferPoolAllocationBytes: 11.27 GB (12098469888) - BufferPoolAllocations: 5.77K (5769) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 10.24 GB (10993270784) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 304.00 MB (318767104) - BufferPoolReadIoOps: 152 (152) - BufferPoolReadIoWaitTime: 17s140ms - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 10.91 GB (11718885376) - BufferPoolWriteIoBytes: 10.91 GB (11718885376) - BufferPoolWriteIoOps: 5.59K (5588) - BufferPoolWriteIoWaitTime: 2m39s - BuildTime: 3m28s - GetResultsTime: 0.000ns - HTResizeTime: 10.638ms - HashBuckets: 0 (0) - LargestPartitionPercent: 18 (18) - MaxPartitionLevel: 7 (7) - NumRepartitions: 7 (7) - PartitionsCreated: 128 (128) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 12.41M (12414889) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 116 (116) EXCHANGE_NODE (id=29):(Total: 15m54s, non-child: 11s377ms, % non-child: 1.19%) BytesReceived(32s000ms): 2.63 MB, 226.22 MB, 461.23 MB, 657.29 MB, 848.72 MB, 1.01 GB, 1.13 GB, 1.20 GB, 1.25 GB, 1.36 GB, 1.49 GB, 1.55 GB, 1.59 GB, 1.65 GB, 1.85 GB, 2.01 GB, 2.18 GB, 2.26 GB, 2.35 GB, 2.51 GB, 2.66 GB, 2.76 GB, 2.94 GB, 3.11 GB, 3.32 GB, 3.50 GB, 3.68 GB, 3.84 GB, 3.98 GB, 4.17 GB, 4.28 GB, 4.43 GB, 4.64 GB, 4.84 GB, 4.97 GB, 5.02 GB - BytesReceived: 5.08 GB (5453708591) - ConvertRowBatchTime: 4s586ms - DeserializeRowBatchTimer: 42s955ms - FirstBatchArrivalWaitTime: 24s767ms - PeakMemoryUsage: 0 - RowsReturned: 186.12M (186122633) - RowsReturnedRate: 195.04 K/sec - SendersBlockedTimer: 42s409ms - SendersBlockedTotalTimer(*): 4m47s Averaged Fragment F07:(Total: 18m23s, non-child: 9m11s, % non-child: 50.03%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:17m40s max:19m24s mean: 18m23s stddev:37s657ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 2.74 GB (2941419383) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 186.11M (186110902) - TotalNetworkReceiveTime: 53s268ms - TotalNetworkSendTime: 8m57s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 36.54K (36540) - TotalThreadsTotalWallClockTime: 18m48s - TotalThreadsSysTime: 10s107ms - TotalThreadsUserTime: 2m54s - TotalThreadsVoluntaryContextSwitches: 217.42K (217424) Fragment Instance Lifecycle Timings: - ExecTime: 17m57s - ExecTreeExecTime: 7m55s - OpenTime: 25s865ms - ExecTreeOpenTime: 25s273ms - PrepareTime: 60.540ms - ExecTreePrepareTime: 2.007ms DataStreamSender (dst_id=29):(Total: 49s976ms, non-child: 49s976ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5453375455) - NetworkThroughput(*): 375.77 MB/sec - OverallThroughput: 104.07 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.11M (186110902) - SerializeBatchTime: 36s039ms - TransmitDataRPCTime: 13s841ms - UncompressedRowBatchSize: 10.58 GB (11355358925) CodeGen:(Total: 629.339ms, non-child: 629.339ms, % non-child: 100.00%) - CodegenTime: 4.539ms - CompileTime: 208.585ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 379.187ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 40.652ms AGGREGATION_NODE (id=11):(Total: 8m20s, non-child: 45s515ms, % non-child: 9.09%) - BufferPoolAllocTime: 743.432us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.842ms - HTResizeTime: 1s086ms - HashBuckets: 116.44K (116443) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.22 MB (35884018) - ReductionFactorEstimate: 83.78 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.02M (186023569) - RowsReturned: 186.11M (186110902) - RowsReturnedRate: 374.24 K/sec - StreamingTime: 44s504ms HASH_JOIN_NODE (id=10):(Total: 7m35s, non-child: 7s071ms, % non-child: 1.55%) - BufferPoolAllocTime: 1.288ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 13.676ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.16 MB (35816474) - ProbeRows: 186.11M (186110903) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s673ms - RowsReturned: 186.11M (186110903) - RowsReturnedRate: 412.22 K/sec Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 9.288ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 415.821us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 17.335us, non-child: 17.335us, % non-child: 100.00%) - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.465us - DeserializeRowBatchTimer: 25.918us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 22.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 7m28s, non-child: 6m27s, % non-child: 86.43%) - BufferPoolAllocTime: 1s055ms - BufferPoolAllocationBytes: 12.75 GB (13691107035) - BufferPoolAllocations: 4.50K (4496) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5314782354) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 3.08 GB (3303313993) - BufferPoolReadIoOps: 1.57K (1575) - BufferPoolReadIoWaitTime: 5m16s - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5314782354) - BufferPoolWriteIoBytes: 4.95 GB (5314782354) - BufferPoolWriteIoOps: 2.53K (2534) - BufferPoolWriteIoWaitTime: 1s081ms - BuildRows: 102.86M (102860069) - BuildTime: 13s455ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852238648) - ProbeRows: 206.79M (206789234) - ProbeRowsPartitioned: 116.31M (116314511) - ProbeTime: 49s991ms - RowsReturned: 186.11M (186110903) - RowsReturnedRate: 418.82 K/sec Hash Join Builder (join_node_id=9): - BuildRowsPartitionTime: 9s346ms - BuildRowsPartitioned: 102.86M (102860069) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5925336) - HashTablesBuildTime: 1m47s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 11s536ms, non-child: 11s536ms, % non-child: 100.00%) - BytesReceived: 1.46 GB (1568905068) - ConvertRowBatchTime: 2s551ms - DeserializeRowBatchTimer: 4s534ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102860069) - RowsReturnedRate: 8.93 M/sec - SendersBlockedTimer: 312.856ms - SendersBlockedTotalTimer(*): 2s052ms EXCHANGE_NODE (id=26):(Total: 49s278ms, non-child: 49s278ms, % non-child: 100.00%) - BytesReceived: 5.64 GB (6051225579) - ConvertRowBatchTime: 4s273ms - DeserializeRowBatchTimer: 25s530ms - FirstBatchArrivalWaitTime: 27.893ms - PeakMemoryUsage: 0 - RowsReturned: 206.79M (206789234) - RowsReturnedRate: 4.29 M/sec - SendersBlockedTimer: 1m27s - SendersBlockedTotalTimer(*): 9m19s Fragment F07: Instance 8d463de3722df36f:a2dae93a00000027 (host=vd1313.halxg.cloudera.com:22000):(Total: 19m24s, non-child: 9m29s, % non-child: 48.89%) MemoryUsage(32s000ms): 1.50 GB, 2.72 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.74 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941424156) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 186.11M (186111131) - TotalNetworkReceiveTime: 59s848ms - TotalNetworkSendTime: 9m13s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34.03K (34032) - TotalThreadsTotalWallClockTime: 19m49s - TotalThreadsSysTime: 10s209ms - TotalThreadsUserTime: 2m56s - TotalThreadsVoluntaryContextSwitches: 216.34K (216342) Fragment Instance Lifecycle Timings: - ExecTime: 18m58s - ExecTreeExecTime: 8m38s - OpenTime: 25s886ms - ExecTreeOpenTime: 25s324ms - PrepareTime: 67.583ms - ExecTreePrepareTime: 1.724ms DataStreamSender (dst_id=29):(Total: 50s513ms, non-child: 50s513ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5453392464) - NetworkThroughput(*): 373.61 MB/sec - OverallThroughput: 102.96 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.11M (186111131) - SerializeBatchTime: 36s500ms - TransmitDataRPCTime: 13s920ms - UncompressedRowBatchSize: 10.58 GB (11355372891) CodeGen:(Total: 608.420ms, non-child: 608.420ms, % non-child: 100.00%) - CodegenTime: 3.610ms - CompileTime: 175.150ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 382.074ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 50.595ms AGGREGATION_NODE (id=11):(Total: 9m3s, non-child: 45s532ms, % non-child: 8.37%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 603.021us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.184ms - HTResizeTime: 1s104ms - HashBuckets: 106.50K (106496) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.27 MB (35936988) - ReductionFactorEstimate: 131.80 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.03M (186031259) - RowsReturned: 186.11M (186111131) - RowsReturnedRate: 342.22 K/sec - StreamingTime: 44s681ms HASH_JOIN_NODE (id=10):(Total: 8m18s, non-child: 7s176ms, % non-child: 1.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 149.437us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 14.156ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.15 MB (35813422) - ProbeRows: 186.11M (186111133) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s795ms - RowsReturned: 186.11M (186111133) - RowsReturnedRate: 373.50 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.064ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 193.840us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 16.938us, non-child: 16.938us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.863us - DeserializeRowBatchTimer: 110.418us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 21.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 8m11s, non-child: 7m3s, % non-child: 86.24%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 769.562ms - BufferPoolAllocationBytes: 13.09 GB (14057209856) - BufferPoolAllocations: 4.67K (4671) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5314183168) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 3.42 GB (3670016000) - BufferPoolReadIoOps: 1.75K (1750) - BufferPoolReadIoWaitTime: 5m55s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5314183168) - BufferPoolWriteIoBytes: 4.95 GB (5314183168) - BufferPoolWriteIoOps: 2.53K (2534) - BufferPoolWriteIoWaitTime: 1s186ms - BuildRows: 102.88M (102876197) - BuildTime: 12s860ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852241574) - ProbeRows: 206.79M (206791645) - ProbeRowsPartitioned: 116.30M (116304351) - ProbeTime: 48s436ms - RowsReturned: 186.11M (186111133) - RowsReturnedRate: 378.95 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 8s723ms - BuildRowsPartitioned: 102.88M (102876197) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5925945) - HashTablesBuildTime: 1m43s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 12s197ms, non-child: 4s315ms, % non-child: 35.38%) BytesReceived(32s000ms): 1008.95 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1569160313) - ConvertRowBatchTime: 2s652ms - DeserializeRowBatchTimer: 4s578ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.88M (102876197) - RowsReturnedRate: 8.43 M/sec - SendersBlockedTimer: 285.602ms - SendersBlockedTotalTimer(*): 1s687ms EXCHANGE_NODE (id=26):(Total: 55s381ms, non-child: 11s871ms, % non-child: 21.44%) BytesReceived(32s000ms): 16.17 MB, 583.36 MB, 1.15 GB, 1.64 GB, 2.12 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6051267792) - ConvertRowBatchTime: 4s356ms - DeserializeRowBatchTimer: 23s357ms - FirstBatchArrivalWaitTime: 34.483ms - PeakMemoryUsage: 0 - RowsReturned: 206.79M (206791645) - RowsReturnedRate: 3.73 M/sec - SendersBlockedTimer: 1m39s - SendersBlockedTotalTimer(*): 9m59s Instance 8d463de3722df36f:a2dae93a0000002a (host=vd1309.halxg.cloudera.com:22000):(Total: 19m17s, non-child: 8m52s, % non-child: 46.00%) MemoryUsage(32s000ms): 1.47 GB, 2.73 GB, 2.73 GB, 2.74 GB, 2.74 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.74 GB, 2.73 GB, 2.73 GB, 2.74 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941448181) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 186.12M (186121448) - TotalNetworkReceiveTime: 39s644ms - TotalNetworkSendTime: 8m38s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 53.06K (53056) - TotalThreadsTotalWallClockTime: 19m42s - TotalThreadsSysTime: 11s375ms - TotalThreadsUserTime: 2m55s - TotalThreadsVoluntaryContextSwitches: 233.58K (233581) Fragment Instance Lifecycle Timings: - ExecTime: 18m51s - ExecTreeExecTime: 9m8s - OpenTime: 25s743ms - ExecTreeOpenTime: 25s199ms - PrepareTime: 67.027ms - ExecTreePrepareTime: 5.709ms DataStreamSender (dst_id=29):(Total: 50s403ms, non-child: 50s403ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5453615368) - NetworkThroughput(*): 370.18 MB/sec - OverallThroughput: 103.19 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.12M (186121448) - SerializeBatchTime: 36s262ms - TransmitDataRPCTime: 14s049ms - UncompressedRowBatchSize: 10.58 GB (11356002372) CodeGen:(Total: 578.955ms, non-child: 578.955ms, % non-child: 100.00%) - CodegenTime: 4.801ms - CompileTime: 182.756ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 353.287ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 40.601ms AGGREGATION_NODE (id=11):(Total: 9m33s, non-child: 45s808ms, % non-child: 7.98%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 2.968ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 4.260ms - HTResizeTime: 1s098ms - HashBuckets: 114.69K (114688) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.22 MB (35877577) - ReductionFactorEstimate: 19.75 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.04M (186035432) - RowsReturned: 186.12M (186121448) - RowsReturnedRate: 324.30 K/sec - StreamingTime: 44s378ms HASH_JOIN_NODE (id=10):(Total: 8m48s, non-child: 7s129ms, % non-child: 1.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 917.803us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 11.190ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.15 MB (35813422) - ProbeRows: 186.12M (186121450) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s679ms - RowsReturned: 186.12M (186121450) - RowsReturnedRate: 352.43 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.889ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 838.531us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 19.558us, non-child: 19.558us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 10.531us - DeserializeRowBatchTimer: 17.106us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 18.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 8m40s, non-child: 7m53s, % non-child: 90.93%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s570ms - BufferPoolAllocationBytes: 12.81 GB (13757317120) - BufferPoolAllocations: 4.53K (4528) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5314183168) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 3.14 GB (3370123264) - BufferPoolReadIoOps: 1.61K (1607) - BufferPoolReadIoWaitTime: 6m32s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5314183168) - BufferPoolWriteIoBytes: 4.95 GB (5314183168) - BufferPoolWriteIoOps: 2.53K (2534) - BufferPoolWriteIoWaitTime: 1s151ms - BuildRows: 102.86M (102863930) - BuildTime: 13s714ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852241574) - ProbeRows: 206.80M (206798353) - ProbeRowsPartitioned: 116.32M (116316200) - ProbeTime: 59s677ms - RowsReturned: 186.12M (186121450) - RowsReturnedRate: 357.25 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 9s719ms - BuildRowsPartitioned: 102.86M (102863930) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5925059) - HashTablesBuildTime: 2m23s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 11s178ms, non-child: 4s232ms, % non-child: 37.87%) BytesReceived(32s000ms): 992.30 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568957167) - ConvertRowBatchTime: 2s478ms - DeserializeRowBatchTimer: 4s671ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102863930) - RowsReturnedRate: 9.20 M/sec - SendersBlockedTimer: 275.039ms - SendersBlockedTotalTimer(*): 1s351ms EXCHANGE_NODE (id=26):(Total: 36s057ms, non-child: 17s260ms, % non-child: 47.87%) BytesReceived(32s000ms): 15.18 MB, 573.43 MB, 1.15 GB, 1.63 GB, 2.11 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6051485630) - ConvertRowBatchTime: 4s348ms - DeserializeRowBatchTimer: 33s173ms - FirstBatchArrivalWaitTime: 45.839ms - PeakMemoryUsage: 0 - RowsReturned: 206.80M (206798353) - RowsReturnedRate: 5.74 M/sec - SendersBlockedTimer: 2m32s - SendersBlockedTotalTimer(*): 16m46s Instance 8d463de3722df36f:a2dae93a00000029 (host=vd1314.halxg.cloudera.com:22000):(Total: 18m12s, non-child: 9m18s, % non-child: 51.10%) MemoryUsage(32s000ms): 1.48 GB, 2.72 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941364486) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 186.14M (186137302) - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 9m3s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 34.05K (34047) - TotalThreadsTotalWallClockTime: 18m37s - TotalThreadsSysTime: 9s861ms - TotalThreadsUserTime: 2m53s - TotalThreadsVoluntaryContextSwitches: 208.47K (208466) Fragment Instance Lifecycle Timings: - ExecTime: 17m46s - ExecTreeExecTime: 7m38s - OpenTime: 25s500ms - ExecTreeOpenTime: 24s915ms - PrepareTime: 57.083ms - ExecTreePrepareTime: 1.879ms DataStreamSender (dst_id=29):(Total: 50s005ms, non-child: 50s005ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5454187644) - NetworkThroughput(*): 375.28 MB/sec - OverallThroughput: 104.02 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.14M (186137302) - SerializeBatchTime: 36s041ms - TransmitDataRPCTime: 13s860ms - UncompressedRowBatchSize: 10.58 GB (11356969682) CodeGen:(Total: 622.368ms, non-child: 622.368ms, % non-child: 100.00%) - CodegenTime: 4.011ms - CompileTime: 211.209ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 370.898ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 39.577ms AGGREGATION_NODE (id=11):(Total: 8m3s, non-child: 44s559ms, % non-child: 9.22%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 657.734us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 3.278ms - HTResizeTime: 1s077ms - HashBuckets: 122.88K (122880) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.24 MB (35898741) - ReductionFactorEstimate: 75.86 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.05M (186045142) - RowsReturned: 186.14M (186137302) - RowsReturnedRate: 384.96 K/sec - StreamingTime: 43s459ms HASH_JOIN_NODE (id=10):(Total: 7m18s, non-child: 6s957ms, % non-child: 1.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.894ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 11.252ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.16 MB (35822387) - ProbeRows: 186.14M (186137305) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s576ms - RowsReturned: 186.14M (186137305) - RowsReturnedRate: 424.04 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.591ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 108.800us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 12.992us, non-child: 12.992us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 5.672us - DeserializeRowBatchTimer: 7.665us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 28.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 7m12s, non-child: 6m2s, % non-child: 84.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 846.628ms - BufferPoolAllocationBytes: 12.79 GB (13727956992) - BufferPoolAllocations: 4.51K (4514) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.96 GB (5320474624) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 3.11 GB (3334471680) - BufferPoolReadIoOps: 1.59K (1590) - BufferPoolReadIoWaitTime: 4m54s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.96 GB (5320474624) - BufferPoolWriteIoBytes: 4.96 GB (5320474624) - BufferPoolWriteIoOps: 2.54K (2537) - BufferPoolWriteIoWaitTime: 680.578ms - BuildRows: 102.84M (102839047) - BuildTime: 12s884ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852237478) - ProbeRows: 206.81M (206809006) - ProbeRowsPartitioned: 116.32M (116321653) - ProbeTime: 47s953ms - RowsReturned: 186.14M (186137305) - RowsReturnedRate: 430.87 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 9s143ms - BuildRowsPartitioned: 102.84M (102839047) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.92M (5924699) - HashTablesBuildTime: 1m37s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 11s773ms, non-child: 4s006ms, % non-child: 34.03%) BytesReceived(32s000ms): 1000.40 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568592045) - ConvertRowBatchTime: 2s574ms - DeserializeRowBatchTimer: 4s481ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.84M (102839047) - RowsReturnedRate: 8.73 M/sec - SendersBlockedTimer: 298.630ms - SendersBlockedTotalTimer(*): 2s079ms EXCHANGE_NODE (id=26):(Total: 57s317ms, non-child: 13s005ms, % non-child: 22.69%) BytesReceived(32s000ms): 15.51 MB, 578.46 MB, 1.15 GB, 1.64 GB, 2.11 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6051801868) - ConvertRowBatchTime: 4s223ms - DeserializeRowBatchTimer: 25s869ms - FirstBatchArrivalWaitTime: 20.016ms - PeakMemoryUsage: 0 - RowsReturned: 206.81M (206809006) - RowsReturnedRate: 3.61 M/sec - SendersBlockedTimer: 52s595ms - SendersBlockedTotalTimer(*): 6m3s Instance 8d463de3722df36f:a2dae93a00000026 (host=vd1316.halxg.cloudera.com:22000):(Total: 18m8s, non-child: 9m10s, % non-child: 50.64%) MemoryUsage(32s000ms): 1.47 GB, 2.74 GB, 2.74 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941420620) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 186.09M (186093313) - TotalNetworkReceiveTime: 51s154ms - TotalNetworkSendTime: 8m56s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 33.35K (33354) - TotalThreadsTotalWallClockTime: 18m34s - TotalThreadsSysTime: 10s031ms - TotalThreadsUserTime: 2m56s - TotalThreadsVoluntaryContextSwitches: 226.03K (226035) Fragment Instance Lifecycle Timings: - ExecTime: 17m41s - ExecTreeExecTime: 7m40s - OpenTime: 26s813ms - ExecTreeOpenTime: 26s110ms - PrepareTime: 65.778ms - ExecTreePrepareTime: 1.534ms DataStreamSender (dst_id=29):(Total: 50s205ms, non-child: 50s205ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5452857219) - NetworkThroughput(*): 376.00 MB/sec - OverallThroughput: 103.58 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.09M (186093313) - SerializeBatchTime: 36s268ms - TransmitDataRPCTime: 13s830ms - UncompressedRowBatchSize: 10.57 GB (11354285745) CodeGen:(Total: 742.656ms, non-child: 742.656ms, % non-child: 100.00%) - CodegenTime: 6.019ms - CompileTime: 247.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 448.914ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 45.166ms AGGREGATION_NODE (id=11):(Total: 8m6s, non-child: 46s215ms, % non-child: 9.51%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 251.063us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.413ms - HTResizeTime: 1s107ms - HashBuckets: 110.59K (110592) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.17 MB (35834472) - ReductionFactorEstimate: 180.45 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.01M (186010369) - RowsReturned: 186.09M (186093313) - RowsReturnedRate: 382.80 K/sec - StreamingTime: 45s162ms HASH_JOIN_NODE (id=10):(Total: 7m19s, non-child: 7s358ms, % non-child: 1.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2.720ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 19.469ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.15 MB (35809326) - ProbeRows: 186.09M (186093315) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s956ms - RowsReturned: 186.09M (186093315) - RowsReturnedRate: 423.01 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.351ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 183.716us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 25.054us, non-child: 25.054us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 16.059us - DeserializeRowBatchTimer: 7.996us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 14.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 7m12s, non-child: 6m13s, % non-child: 86.43%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s171ms - BufferPoolAllocationBytes: 12.70 GB (13633585152) - BufferPoolAllocations: 4.47K (4469) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5316280320) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 3.02 GB (3244294144) - BufferPoolReadIoOps: 1.55K (1547) - BufferPoolReadIoWaitTime: 5m3s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5316280320) - BufferPoolWriteIoBytes: 4.95 GB (5316280320) - BufferPoolWriteIoOps: 2.54K (2535) - BufferPoolWriteIoWaitTime: 1s871ms - BuildRows: 102.86M (102863622) - BuildTime: 14s681ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852237478) - ProbeRows: 206.77M (206773703) - ProbeRowsPartitioned: 116.32M (116320111) - ProbeTime: 47s982ms - RowsReturned: 186.09M (186093315) - RowsReturnedRate: 430.20 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 9s619ms - BuildRowsPartitioned: 102.86M (102863622) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.92M (5923210) - HashTablesBuildTime: 1m45s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 11s136ms, non-child: 4s147ms, % non-child: 37.24%) BytesReceived(32s000ms): 994.90 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568965389) - ConvertRowBatchTime: 2s553ms - DeserializeRowBatchTimer: 4s586ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102863622) - RowsReturnedRate: 9.24 M/sec - SendersBlockedTimer: 435.131ms - SendersBlockedTotalTimer(*): 3s027ms EXCHANGE_NODE (id=26):(Total: 47s573ms, non-child: 11s453ms, % non-child: 24.07%) BytesReceived(32s000ms): 15.26 MB, 574.96 MB, 1.15 GB, 1.63 GB, 2.11 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6050782372) - ConvertRowBatchTime: 4s275ms - DeserializeRowBatchTimer: 21s047ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 206.77M (206773703) - RowsReturnedRate: 4.35 M/sec - SendersBlockedTimer: 1m15s - SendersBlockedTotalTimer(*): 8m8s Instance 8d463de3722df36f:a2dae93a0000002b (host=vd1311.halxg.cloudera.com:22000):(Total: 18m2s, non-child: 9m1s, % non-child: 50.06%) MemoryUsage(32s000ms): 1.47 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.74 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941437004) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 186.10M (186097513) - TotalNetworkReceiveTime: 55s631ms - TotalNetworkSendTime: 8m47s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 33.86K (33858) - TotalThreadsTotalWallClockTime: 18m26s - TotalThreadsSysTime: 9s866ms - TotalThreadsUserTime: 2m53s - TotalThreadsVoluntaryContextSwitches: 209.96K (209955) Fragment Instance Lifecycle Timings: - ExecTime: 17m37s - ExecTreeExecTime: 7m46s - OpenTime: 24s793ms - ExecTreeOpenTime: 24s147ms - PrepareTime: 45.418ms - ExecTreePrepareTime: 1.037ms DataStreamSender (dst_id=29):(Total: 49s330ms, non-child: 49s330ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5453002687) - NetworkThroughput(*): 383.13 MB/sec - OverallThroughput: 105.42 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.10M (186097513) - SerializeBatchTime: 35s657ms - TransmitDataRPCTime: 13s573ms - UncompressedRowBatchSize: 10.57 GB (11354542001) CodeGen:(Total: 676.221ms, non-child: 676.221ms, % non-child: 100.00%) - CodegenTime: 2.582ms - CompileTime: 245.796ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 398.498ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 31.348ms AGGREGATION_NODE (id=11):(Total: 8m10s, non-child: 45s592ms, % non-child: 9.29%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 78.813us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.411ms - HTResizeTime: 1s071ms - HashBuckets: 114.69K (114688) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.24 MB (35907843) - ReductionFactorEstimate: 88.46 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.01M (186011497) - RowsReturned: 186.10M (186097513) - RowsReturnedRate: 379.34 K/sec - StreamingTime: 44s725ms HASH_JOIN_NODE (id=10):(Total: 7m24s, non-child: 6s988ms, % non-child: 1.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.293ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 14.088ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.16 MB (35819131) - ProbeRows: 186.10M (186097513) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s580ms - RowsReturned: 186.10M (186097513) - RowsReturnedRate: 418.21 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.275ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 200.693us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 10.398us, non-child: 10.398us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 5.079us - DeserializeRowBatchTimer: 8.339us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 35.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 7m18s, non-child: 6m14s, % non-child: 85.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1s185ms - BufferPoolAllocationBytes: 12.78 GB (13723762688) - BufferPoolAllocations: 4.51K (4512) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5309988864) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 3.11 GB (3340763136) - BufferPoolReadIoOps: 1.59K (1593) - BufferPoolReadIoWaitTime: 5m5s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5309988864) - BufferPoolWriteIoBytes: 4.95 GB (5309988864) - BufferPoolWriteIoOps: 2.53K (2532) - BufferPoolWriteIoWaitTime: 172.672ms - BuildRows: 102.87M (102866537) - BuildTime: 12s900ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852237478) - ProbeRows: 206.78M (206777716) - ProbeRowsPartitioned: 116.30M (116303925) - ProbeTime: 49s402ms - RowsReturned: 186.10M (186097513) - RowsReturnedRate: 424.88 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 9s881ms - BuildRowsPartitioned: 102.87M (102866537) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5925371) - HashTablesBuildTime: 1m42s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 10s929ms, non-child: 4s245ms, % non-child: 38.84%) BytesReceived(32s000ms): 993.78 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568991832) - ConvertRowBatchTime: 2s662ms - DeserializeRowBatchTimer: 4s599ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.87M (102866537) - RowsReturnedRate: 9.41 M/sec - SendersBlockedTimer: 349.853ms - SendersBlockedTotalTimer(*): 2s441ms EXCHANGE_NODE (id=26):(Total: 52s281ms, non-child: 13s672ms, % non-child: 26.15%) BytesReceived(32s000ms): 15.21 MB, 574.12 MB, 1.15 GB, 1.63 GB, 2.11 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6050920249) - ConvertRowBatchTime: 4s197ms - DeserializeRowBatchTimer: 28s021ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 206.78M (206777716) - RowsReturnedRate: 3.96 M/sec - SendersBlockedTimer: 1m53s - SendersBlockedTotalTimer(*): 11m34s Instance 8d463de3722df36f:a2dae93a00000028 (host=vd1310.halxg.cloudera.com:22000):(Total: 17m57s, non-child: 8m58s, % non-child: 50.01%) MemoryUsage(32s000ms): 1.47 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.74 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941404236) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 186.11M (186110951) - TotalNetworkReceiveTime: 56s518ms - TotalNetworkSendTime: 8m44s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 31.75K (31745) - TotalThreadsTotalWallClockTime: 18m21s - TotalThreadsSysTime: 10s068ms - TotalThreadsUserTime: 2m53s - TotalThreadsVoluntaryContextSwitches: 216.50K (216498) Fragment Instance Lifecycle Timings: - ExecTime: 17m31s - ExecTreeExecTime: 7m43s - OpenTime: 25s410ms - ExecTreeOpenTime: 24s809ms - PrepareTime: 40.412ms - ExecTreePrepareTime: 666.098us DataStreamSender (dst_id=29):(Total: 49s846ms, non-child: 49s846ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5453355410) - NetworkThroughput(*): 374.71 MB/sec - OverallThroughput: 104.34 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.11M (186110951) - SerializeBatchTime: 35s877ms - TransmitDataRPCTime: 13s879ms - UncompressedRowBatchSize: 10.58 GB (11355361907) CodeGen:(Total: 626.028ms, non-child: 626.028ms, % non-child: 100.00%) - CodegenTime: 2.936ms - CompileTime: 212.644ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 385.852ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 27.012ms AGGREGATION_NODE (id=11):(Total: 8m7s, non-child: 45s514ms, % non-child: 9.33%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 109.431us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.763ms - HTResizeTime: 1s077ms - HashBuckets: 122.88K (122880) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.18 MB (35843130) - ReductionFactorEstimate: 35.60 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.02M (186018791) - RowsReturned: 186.11M (186110951) - RowsReturnedRate: 381.47 K/sec - StreamingTime: 44s693ms HASH_JOIN_NODE (id=10):(Total: 7m22s, non-child: 6s965ms, % non-child: 1.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.275ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 11.035ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.16 MB (35817503) - ProbeRows: 186.11M (186110951) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s587ms - RowsReturned: 186.11M (186110951) - RowsReturnedRate: 420.72 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 7.839ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 202.783us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 17.881us, non-child: 17.881us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.480us - DeserializeRowBatchTimer: 14.737us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 20.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 7m15s, non-child: 6m11s, % non-child: 85.31%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 963.985ms - BufferPoolAllocationBytes: 12.65 GB (13585350656) - BufferPoolAllocations: 4.45K (4446) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5316280320) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 2.98 GB (3196059648) - BufferPoolReadIoOps: 1.52K (1524) - BufferPoolReadIoWaitTime: 5m6s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5316280320) - BufferPoolWriteIoBytes: 4.95 GB (5316280320) - BufferPoolWriteIoOps: 2.54K (2535) - BufferPoolWriteIoWaitTime: 328.820ms - BuildRows: 102.85M (102847660) - BuildTime: 12s276ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852237478) - ProbeRows: 206.78M (206784771) - ProbeRowsPartitioned: 116.33M (116329157) - ProbeTime: 45s528ms - RowsReturned: 186.11M (186110951) - RowsReturnedRate: 427.45 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 8s646ms - BuildRowsPartitioned: 102.85M (102847660) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5926680) - HashTablesBuildTime: 1m36s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 12s285ms, non-child: 3s800ms, % non-child: 30.94%) BytesReceived(32s000ms): 992.76 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568702726) - ConvertRowBatchTime: 2s439ms - DeserializeRowBatchTimer: 4s175ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.85M (102847660) - RowsReturnedRate: 8.37 M/sec - SendersBlockedTimer: 296.804ms - SendersBlockedTotalTimer(*): 2s062ms EXCHANGE_NODE (id=26):(Total: 51s691ms, non-child: 11s445ms, % non-child: 22.14%) BytesReceived(32s000ms): 15.20 MB, 573.75 MB, 1.15 GB, 1.63 GB, 2.11 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6051069747) - ConvertRowBatchTime: 4s307ms - DeserializeRowBatchTimer: 21s409ms - FirstBatchArrivalWaitTime: 23.584ms - PeakMemoryUsage: 0 - RowsReturned: 206.78M (206784771) - RowsReturnedRate: 4.00 M/sec - SendersBlockedTimer: 59s240ms - SendersBlockedTotalTimer(*): 6m9s Instance 8d463de3722df36f:a2dae93a0000002c (host=vd1312.halxg.cloudera.com:22000):(Total: 17m40s, non-child: 9m32s, % non-child: 53.95%) MemoryUsage(32s000ms): 1.50 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.73 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB, 2.72 GB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.02 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.72 GB (2923429888) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 2.74 GB (2941437004) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 186.10M (186104657) - TotalNetworkReceiveTime: 48s493ms - TotalNetworkSendTime: 9m18s - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 35.69K (35689) - TotalThreadsTotalWallClockTime: 18m6s - TotalThreadsSysTime: 9s336ms - TotalThreadsUserTime: 2m52s - TotalThreadsVoluntaryContextSwitches: 211.09K (211092) Fragment Instance Lifecycle Timings: - ExecTime: 17m13s - ExecTreeExecTime: 6m52s - OpenTime: 26s912ms - ExecTreeOpenTime: 26s407ms - PrepareTime: 80.479ms - ExecTreePrepareTime: 1.497ms DataStreamSender (dst_id=29):(Total: 49s533ms, non-child: 49s533ms, % non-child: 100.00%) - BytesSent: 5.08 GB (5453217396) - NetworkThroughput(*): 377.46 MB/sec - OverallThroughput: 104.99 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 186.10M (186104657) - SerializeBatchTime: 35s666ms - TransmitDataRPCTime: 13s777ms - UncompressedRowBatchSize: 10.58 GB (11354977881) CodeGen:(Total: 550.722ms, non-child: 550.722ms, % non-child: 100.00%) - CodegenTime: 7.812ms - CompileTime: 184.629ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 112 (112) - NumInstructions: 5.83K (5830) - OptimizationTime: 314.785ms - PeakMemoryUsage: 2.85 MB (2984960) - PrepareTime: 50.265ms AGGREGATION_NODE (id=11):(Total: 7m18s, non-child: 45s383ms, % non-child: 10.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 535.759us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 2.587ms - HTResizeTime: 1s068ms - HashBuckets: 122.88K (122880) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.23 MB (35889380) - ReductionFactorEstimate: 54.56 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 186.01M (186012497) - RowsReturned: 186.10M (186104657) - RowsReturnedRate: 424.61 K/sec - StreamingTime: 44s435ms HASH_JOIN_NODE (id=10):(Total: 6m32s, non-child: 6s927ms, % non-child: 1.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 765.962us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 14.539ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 34.16 MB (35820130) - ProbeRows: 186.10M (186104658) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6s541ms - RowsReturned: 186.10M (186104658) - RowsReturnedRate: 473.66 K/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.006ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.182ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.12 KB (17536) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=28):(Total: 18.529us, non-child: 18.529us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.572us - DeserializeRowBatchTimer: 15.168us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 19.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=9):(Total: 6m25s, non-child: 5m30s, % non-child: 85.53%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 883.762ms - BufferPoolAllocationBytes: 12.44 GB (13352566784) - BufferPoolAllocations: 4.33K (4335) - BufferPoolPeakReservation: 2.66 GB (2852126720) - BufferPoolPeakUnpinnedBytes: 4.95 GB (5312086016) - BufferPoolPeakUsedReservation: 2.66 GB (2852126720) - BufferPoolReadIoBytes: 2.76 GB (2967470080) - BufferPoolReadIoOps: 1.42K (1415) - BufferPoolReadIoWaitTime: 4m17s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 4.95 GB (5312086016) - BufferPoolWriteIoBytes: 4.95 GB (5312086016) - BufferPoolWriteIoOps: 2.53K (2533) - BufferPoolWriteIoWaitTime: 2s176ms - BuildRows: 102.86M (102863492) - BuildTime: 14s867ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.66 GB (2852237478) - ProbeRows: 206.79M (206789449) - ProbeRowsPartitioned: 116.31M (116306185) - ProbeTime: 50s957ms - RowsReturned: 186.10M (186104658) - RowsReturnedRate: 482.16 K/sec Hash Join Builder (join_node_id=9): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 9s692ms - BuildRowsPartitioned: 102.86M (102863492) - HashBuckets: 268.44M (268435456) - HashCollisions: 5.93M (5926392) - HashTablesBuildTime: 1m44s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 30.12 KB (30848) - RepartitionTime: 0.000ns - SpilledPartitions: 9 (9) EXCHANGE_NODE (id=27):(Total: 11s249ms, non-child: 4s096ms, % non-child: 36.41%) BytesReceived(32s000ms): 1009.16 MB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB, 1.46 GB - BytesReceived: 1.46 GB (1568966010) - ConvertRowBatchTime: 2s500ms - DeserializeRowBatchTimer: 4s651ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 102.86M (102863492) - RowsReturnedRate: 9.14 M/sec - SendersBlockedTimer: 248.931ms - SendersBlockedTotalTimer(*): 1s716ms EXCHANGE_NODE (id=26):(Total: 44s645ms, non-child: 11s232ms, % non-child: 25.16%) BytesReceived(32s000ms): 16.22 MB, 583.56 MB, 1.15 GB, 1.64 GB, 2.12 GB, 2.57 GB, 2.89 GB, 3.05 GB, 3.19 GB, 3.46 GB, 3.79 GB, 3.95 GB, 4.05 GB, 4.21 GB, 4.70 GB, 5.11 GB, 5.54 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB, 5.64 GB - BytesReceived: 5.64 GB (6051251396) - ConvertRowBatchTime: 4s206ms - DeserializeRowBatchTimer: 25s835ms - FirstBatchArrivalWaitTime: 71.328ms - PeakMemoryUsage: 0 - RowsReturned: 206.79M (206789449) - RowsReturnedRate: 4.63 M/sec - SendersBlockedTimer: 1m2s - SendersBlockedTotalTimer(*): 6m35s Averaged Fragment F05:(Total: 8m48s, non-child: 7m43s, % non-child: 87.68%) split sizes: min: 72.42 GB, max: 72.83 GB, avg: 72.71 GB, stddev: 143.79 MB completion times: min:8m45s max:8m52s mean: 8m48s stddev:2s439ms execution rates: min:140.13 MB/sec max:141.98 MB/sec mean:140.94 MB/sec stddev:671.36 KB/sec num instances: 7 - AverageThreadTokens: 6.46 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 336.33 MB (352670367) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 206.79M (206789234) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m16s - TotalStorageWaitTime: 1m28s - TotalThreadsInvoluntaryContextSwitches: 32.41K (32415) - TotalThreadsTotalWallClockTime: 56m51s - TotalThreadsSysTime: 8s903ms - TotalThreadsUserTime: 2m18s - TotalThreadsVoluntaryContextSwitches: 554.43K (554428) Fragment Instance Lifecycle Timings: - ExecTime: 8m48s - ExecTreeExecTime: 2s840ms - OpenTime: 32.485ms - ExecTreeOpenTime: 505.934us - PrepareTime: 59.689ms - ExecTreePrepareTime: 3.119ms DataStreamSender (dst_id=26):(Total: 1m2s, non-child: 1m2s, % non-child: 100.00%) - BytesSent: 5.64 GB (6051225579) - NetworkThroughput(*): 450.28 MB/sec - OverallThroughput: 92.57 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 206.79M (206789234) - SerializeBatchTime: 49s431ms - TransmitDataRPCTime: 12s817ms - UncompressedRowBatchSize: 7.90 GB (8480230032) CodeGen:(Total: 65.525ms, non-child: 65.525ms, % non-child: 100.00%) - CodegenTime: 1.162ms - CompileTime: 7.884ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 20.826ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 36.031ms HDFS_SCAN_NODE (id=6):(Total: 2s673ms, non-child: 2s673ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 5.46 - BytesRead: 2.43 GB (2605287396) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.43 GB (2605287396) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.43 GB (2605287396) - DecompressionTime: 13s085ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 335.12 MB (351397599) - PerReadThreadRawHdfsThroughput: 63.43 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 255.164ms - RowBatchQueuePutWaitTime: 45m27s - RowsRead: 206.79M (206789234) - RowsReturned: 206.79M (206789234) - RowsReturnedRate: 89.02 M/sec - ScanRangesComplete: 414 (414) - ScannerThreadsInvoluntaryContextSwitches: 10.79K (10795) - ScannerThreadsTotalWallClockTime: 48m3s - MaterializeTupleTime(*): 34s593ms - ScannerThreadsSysTime: 5s341ms - ScannerThreadsUserTime: 54s080ms - ScannerThreadsVoluntaryContextSwitches: 516.29K (516290) - TotalRawHdfsReadTime(*): 39s403ms - TotalReadThroughput: 4.71 MB/sec Filter 1 (1.00 MB): - Files processed: 414 (414) - Files rejected: 331 (331) - Files total: 414 (414) - RowGroups processed: 201.99K (201985) - RowGroups rejected: 0 (0) - RowGroups total: 201.99K (201985) - Rows processed: 1.36M (1362212) - Rows rejected: 0 (0) - Rows total: 206.79M (206789234) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Fragment F05: Instance 8d463de3722df36f:a2dae93a00000019 (host=vd1310.halxg.cloudera.com:22000):(Total: 8m52s, non-child: 7m45s, % non-child: 87.49%) Hdfs split stats (:<# splits>/): 7:56/9.23 GB 5:55/10.55 GB 6:60/10.80 GB 2:50/8.49 GB 4:47/8.74 GB 3:44/7.47 GB 1:45/7.93 GB 0:55/9.63 GB Filter 1 arrival: 532ms MemoryUsage(16s000ms): 257.42 MB, 284.35 MB, 296.41 MB, 324.54 MB, 318.21 MB, 324.57 MB, 326.57 MB, 304.93 MB, 255.39 MB, 221.25 MB, 198.71 MB, 208.36 MB, 221.31 MB, 193.85 MB, 193.69 MB, 186.56 MB, 187.52 MB, 174.83 MB, 173.80 MB, 162.74 MB, 204.88 MB, 244.99 MB, 267.59 MB, 267.69 MB, 246.93 MB, 233.73 MB, 233.06 MB, 202.31 MB, 198.75 MB, 216.28 MB, 210.79 MB, 228.54 MB, 200.09 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.51 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 349.64 MB (366628756) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 213.17M (213165999) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m19s - TotalStorageWaitTime: 1m31s - TotalThreadsInvoluntaryContextSwitches: 29.95K (29948) - TotalThreadsTotalWallClockTime: 57m42s - TotalThreadsSysTime: 10s984ms - TotalThreadsUserTime: 2m17s - TotalThreadsVoluntaryContextSwitches: 615.58K (615582) Fragment Instance Lifecycle Timings: - ExecTime: 8m52s - ExecTreeExecTime: 2s335ms - OpenTime: 34.452ms - ExecTreeOpenTime: 474.692us - PrepareTime: 53.787ms - ExecTreePrepareTime: 2.732ms DataStreamSender (dst_id=26):(Total: 1m4s, non-child: 1m4s, % non-child: 100.00%) - BytesSent: 5.81 GB (6241126380) - NetworkThroughput(*): 450.32 MB/sec - OverallThroughput: 92.52 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 213.17M (213165999) - SerializeBatchTime: 51s017ms - TransmitDataRPCTime: 13s217ms - UncompressedRowBatchSize: 8.14 GB (8741735075) CodeGen:(Total: 60.648ms, non-child: 60.648ms, % non-child: 100.00%) - CodegenTime: 920.242us - CompileTime: 7.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 23.071ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 29.206ms HDFS_SCAN_NODE (id=6):(Total: 2s159ms, non-child: 2s159ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:56/9.23 GB 5:55/10.55 GB 6:60/10.80 GB 2:50/8.49 GB 4:47/8.74 GB 3:44/7.47 GB 1:45/7.93 GB 0:55/9.63 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 81 out of 81 Runtime filters: All filters arrived. Waited 461ms Hdfs Read Thread Concurrency Bucket: 0:93.7% 1:5.733% 2:0.5639% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:331 PARQUET/SNAPPY:486 BytesRead(16s000ms): 189.62 MB, 210.96 MB, 273.95 MB, 492.98 MB, 585.89 MB, 688.61 MB, 816.53 MB, 869.27 MB, 966.38 MB, 1.05 GB, 1.14 GB, 1.25 GB, 1.31 GB, 1.35 GB, 1.39 GB, 1.41 GB, 1.42 GB, 1.48 GB, 1.53 GB, 1.60 GB, 1.71 GB, 1.80 GB, 1.84 GB, 1.84 GB, 1.86 GB, 1.87 GB, 1.87 GB, 1.95 GB, 2.07 GB, 2.18 GB, 2.24 GB, 2.35 GB, 2.44 GB - FooterProcessingTime: (Avg: 228.331ms ; Min: 1.202ms ; Max: 1s771ms ; Number of samples: 81) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 5.51 - BytesRead: 2.51 GB (2693062917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.51 GB (2693062917) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.51 GB (2693062917) - DecompressionTime: 11s153ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 81 (81) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 348.46 MB (365389928) - PerReadThreadRawHdfsThroughput: 66.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 335.168ms - RowBatchQueuePutWaitTime: 46m18s - RowsRead: 213.17M (213165999) - RowsReturned: 213.17M (213165999) - RowsReturnedRate: 98.72 M/sec - ScanRangesComplete: 412 (412) - ScannerThreadsInvoluntaryContextSwitches: 10.34K (10343) - ScannerThreadsTotalWallClockTime: 48m50s - MaterializeTupleTime(*): 34s790ms - ScannerThreadsSysTime: 7s437ms - ScannerThreadsUserTime: 50s443ms - ScannerThreadsVoluntaryContextSwitches: 577.34K (577336) - TotalRawHdfsReadTime(*): 38s434ms - TotalReadThroughput: 4.83 MB/sec Filter 1 (1.00 MB): - Files processed: 412 (412) - Files rejected: 331 (331) - Files total: 412 (412) - RowGroups processed: 208.21K (208213) - RowGroups rejected: 0 (0) - RowGroups total: 208.21K (208213) - Rows processed: 1.33M (1327104) - Rows rejected: 0 (0) - Rows total: 213.17M (213165999) - Splits processed: 81 (81) - Splits rejected: 0 (0) - Splits total: 81 (81) Instance 8d463de3722df36f:a2dae93a00000017 (host=vd1316.halxg.cloudera.com:22000):(Total: 8m49s, non-child: 7m44s, % non-child: 87.67%) Hdfs split stats (:<# splits>/): 7:57/10.06 GB 6:53/8.25 GB 5:58/10.65 GB 1:48/7.97 GB 3:52/9.69 GB 4:50/8.51 GB 0:48/8.94 GB 2:51/8.78 GB Filter 1 arrival: 537ms MemoryUsage(16s000ms): 275.16 MB, 337.77 MB, 329.88 MB, 297.50 MB, 297.07 MB, 276.95 MB, 290.84 MB, 284.53 MB, 230.73 MB, 224.41 MB, 205.21 MB, 220.37 MB, 209.58 MB, 208.16 MB, 212.97 MB, 218.50 MB, 233.69 MB, 220.53 MB, 214.15 MB, 191.23 MB, 190.12 MB, 179.51 MB, 164.21 MB, 170.51 MB, 206.67 MB, 210.17 MB, 211.29 MB, 202.80 MB, 168.99 MB, 212.15 MB, 204.53 MB, 209.98 MB, 195.85 MB ThreadUsage(16s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.50 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 339.76 MB (356268540) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 210.59M (210592478) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m18s - TotalStorageWaitTime: 1m28s - TotalThreadsInvoluntaryContextSwitches: 30.86K (30857) - TotalThreadsTotalWallClockTime: 57m23s - TotalThreadsSysTime: 7s119ms - TotalThreadsUserTime: 2m11s - TotalThreadsVoluntaryContextSwitches: 346.69K (346686) Fragment Instance Lifecycle Timings: - ExecTime: 8m49s - ExecTreeExecTime: 2s665ms - OpenTime: 26.697ms - ExecTreeOpenTime: 668.259us - PrepareTime: 61.680ms - ExecTreePrepareTime: 2.885ms DataStreamSender (dst_id=26):(Total: 1m2s, non-child: 1m2s, % non-child: 100.00%) - BytesSent: 5.74 GB (6162458971) - NetworkThroughput(*): 450.24 MB/sec - OverallThroughput: 93.65 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 210.59M (210592478) - SerializeBatchTime: 49s607ms - TransmitDataRPCTime: 13s052ms - UncompressedRowBatchSize: 8.04 GB (8636197422) CodeGen:(Total: 60.907ms, non-child: 60.907ms, % non-child: 100.00%) - CodegenTime: 896.021us - CompileTime: 6.506ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 17.589ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 36.330ms HDFS_SCAN_NODE (id=6):(Total: 2s504ms, non-child: 2s504ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:57/10.06 GB 6:53/8.25 GB 5:58/10.65 GB 1:48/7.97 GB 3:52/9.69 GB 4:50/8.51 GB 0:48/8.94 GB 2:51/8.78 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 85 out of 85 Runtime filters: All filters arrived. Waited 482ms Hdfs Read Thread Concurrency Bucket: 0:93.86% 1:5.571% 2:0.5666% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:332 PARQUET/SNAPPY:510 BytesRead(16s000ms): 208.27 MB, 259.55 MB, 287.02 MB, 512.32 MB, 607.20 MB, 678.71 MB, 822.59 MB, 910.94 MB, 995.41 MB, 1.08 GB, 1.16 GB, 1.27 GB, 1.34 GB, 1.38 GB, 1.41 GB, 1.43 GB, 1.46 GB, 1.51 GB, 1.57 GB, 1.61 GB, 1.70 GB, 1.74 GB, 1.75 GB, 1.78 GB, 1.86 GB, 1.89 GB, 1.89 GB, 1.94 GB, 2.05 GB, 2.20 GB, 2.25 GB, 2.36 GB, 2.44 GB - FooterProcessingTime: (Avg: 169.672ms ; Min: 1.178ms ; Max: 2s001ms ; Number of samples: 85) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 5.50 - BytesRead: 2.47 GB (2653189938) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.47 GB (2653189938) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.47 GB (2653189938) - DecompressionTime: 11s168ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 85 (85) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 338.55 MB (354996944) - PerReadThreadRawHdfsThroughput: 70.75 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 692.039ms - RowBatchQueuePutWaitTime: 46m10s - RowsRead: 210.59M (210592478) - RowsReturned: 210.59M (210592478) - RowsReturnedRate: 84.07 M/sec - ScanRangesComplete: 417 (417) - ScannerThreadsInvoluntaryContextSwitches: 10.26K (10259) - ScannerThreadsTotalWallClockTime: 48m33s - MaterializeTupleTime(*): 34s093ms - ScannerThreadsSysTime: 3s567ms - ScannerThreadsUserTime: 46s812ms - ScannerThreadsVoluntaryContextSwitches: 308.31K (308312) - TotalRawHdfsReadTime(*): 35s765ms - TotalReadThroughput: 4.78 MB/sec Filter 1 (1.00 MB): - Files processed: 417 (417) - Files rejected: 332 (332) - Files total: 417 (417) - RowGroups processed: 205.70K (205702) - RowGroups rejected: 0 (0) - RowGroups total: 205.70K (205702) - Rows processed: 1.39M (1392640) - Rows rejected: 0 (0) - Rows total: 210.59M (210592478) - Splits processed: 85 (85) - Splits rejected: 0 (0) - Splits total: 85 (85) Instance 8d463de3722df36f:a2dae93a0000001d (host=vd1312.halxg.cloudera.com:22000):(Total: 8m49s, non-child: 7m45s, % non-child: 87.90%) Hdfs split stats (:<# splits>/): 1:51/8.93 GB 7:53/8.71 GB 3:56/10.00 GB 6:50/9.70 GB 5:62/10.39 GB 4:41/7.54 GB 2:44/8.26 GB 0:50/9.26 GB Filter 1 arrival: 530ms MemoryUsage(16s000ms): 294.67 MB, 308.68 MB, 315.67 MB, 282.00 MB, 268.28 MB, 298.85 MB, 286.40 MB, 288.92 MB, 271.79 MB, 232.72 MB, 242.09 MB, 207.33 MB, 196.02 MB, 166.01 MB, 180.35 MB, 180.62 MB, 188.65 MB, 162.79 MB, 176.54 MB, 226.62 MB, 200.53 MB, 195.33 MB, 194.15 MB, 195.07 MB, 195.62 MB, 195.62 MB, 194.46 MB, 185.15 MB, 180.16 MB, 191.16 MB, 240.53 MB, 217.05 MB, 147.98 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.52 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 343.53 MB (360219606) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 205.50M (205496499) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m17s - TotalStorageWaitTime: 1m20s - TotalThreadsInvoluntaryContextSwitches: 30.59K (30585) - TotalThreadsTotalWallClockTime: 57m31s - TotalThreadsSysTime: 6s550ms - TotalThreadsUserTime: 2m12s - TotalThreadsVoluntaryContextSwitches: 282.84K (282836) Fragment Instance Lifecycle Timings: - ExecTime: 8m49s - ExecTreeExecTime: 2s068ms - OpenTime: 34.873ms - ExecTreeOpenTime: 397.966us - PrepareTime: 50.123ms - ExecTreePrepareTime: 3.847ms DataStreamSender (dst_id=26):(Total: 1m2s, non-child: 1m2s, % non-child: 100.00%) - BytesSent: 5.60 GB (6011766358) - NetworkThroughput(*): 449.91 MB/sec - OverallThroughput: 92.34 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 205.50M (205496499) - SerializeBatchTime: 49s251ms - TransmitDataRPCTime: 12s743ms - UncompressedRowBatchSize: 7.85 GB (8427216171) CodeGen:(Total: 64.927ms, non-child: 64.927ms, % non-child: 100.00%) - CodegenTime: 1.161ms - CompileTime: 7.312ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 24.792ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 32.282ms HDFS_SCAN_NODE (id=6):(Total: 1s921ms, non-child: 1s921ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:51/8.93 GB 7:53/8.71 GB 3:56/10.00 GB 6:50/9.70 GB 5:62/10.39 GB 4:41/7.54 GB 2:44/8.26 GB 0:50/9.26 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 462ms Hdfs Read Thread Concurrency Bucket: 0:94.23% 1:4.82% 2:0.8507% 3:0.09452% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:324 PARQUET/SNAPPY:498 BytesRead(16s000ms): 225.92 MB, 237.10 MB, 282.05 MB, 452.04 MB, 548.93 MB, 685.63 MB, 766.90 MB, 872.20 MB, 973.65 MB, 1.04 GB, 1.14 GB, 1.19 GB, 1.26 GB, 1.31 GB, 1.36 GB, 1.36 GB, 1.38 GB, 1.43 GB, 1.50 GB, 1.61 GB, 1.64 GB, 1.68 GB, 1.76 GB, 1.79 GB, 1.79 GB, 1.79 GB, 1.79 GB, 1.92 GB, 2.00 GB, 2.13 GB, 2.23 GB, 2.28 GB, 2.38 GB - FooterProcessingTime: (Avg: 206.822ms ; Min: 1.316ms ; Max: 2s862ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 5.52 - BytesRead: 2.41 GB (2584091713) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2584091713) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.41 GB (2584091713) - DecompressionTime: 12s763ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 342.33 MB (358956202) - PerReadThreadRawHdfsThroughput: 67.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 32.590ms - RowBatchQueuePutWaitTime: 46m25s - RowsRead: 205.50M (205496499) - RowsReturned: 205.50M (205496499) - RowsReturnedRate: 106.94 M/sec - ScanRangesComplete: 407 (407) - ScannerThreadsInvoluntaryContextSwitches: 9.71K (9710) - ScannerThreadsTotalWallClockTime: 48m42s - MaterializeTupleTime(*): 34s687ms - ScannerThreadsSysTime: 2s843ms - ScannerThreadsUserTime: 46s483ms - ScannerThreadsVoluntaryContextSwitches: 245.56K (245557) - TotalRawHdfsReadTime(*): 36s728ms - TotalReadThroughput: 4.66 MB/sec Filter 1 (1.00 MB): - Files processed: 407 (407) - Files rejected: 324 (324) - Files total: 407 (407) - RowGroups processed: 200.72K (200723) - RowGroups rejected: 0 (0) - RowGroups total: 200.72K (200723) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 205.50M (205496499) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance 8d463de3722df36f:a2dae93a00000018 (host=vd1313.halxg.cloudera.com:22000):(Total: 8m49s, non-child: 7m44s, % non-child: 87.78%) Hdfs split stats (:<# splits>/): 7:42/7.29 GB 3:46/7.81 GB 6:59/10.22 GB 5:57/10.53 GB 4:52/9.97 GB 2:48/8.90 GB 1:56/10.27 GB 0:44/7.43 GB Filter 1 arrival: 541ms MemoryUsage(16s000ms): 248.51 MB, 262.27 MB, 274.85 MB, 300.66 MB, 344.26 MB, 339.78 MB, 316.04 MB, 285.60 MB, 217.22 MB, 205.29 MB, 218.73 MB, 196.65 MB, 205.19 MB, 199.98 MB, 197.88 MB, 173.78 MB, 181.29 MB, 203.82 MB, 209.61 MB, 188.72 MB, 201.11 MB, 240.34 MB, 236.46 MB, 236.41 MB, 214.61 MB, 204.54 MB, 210.01 MB, 184.72 MB, 244.84 MB, 215.46 MB, 211.82 MB, 228.91 MB, 179.09 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.51 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 377.65 MB (395997927) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 206.75M (206748246) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m19s - TotalStorageWaitTime: 1m29s - TotalThreadsInvoluntaryContextSwitches: 29.62K (29618) - TotalThreadsTotalWallClockTime: 57m23s - TotalThreadsSysTime: 9s277ms - TotalThreadsUserTime: 2m15s - TotalThreadsVoluntaryContextSwitches: 721.03K (721032) Fragment Instance Lifecycle Timings: - ExecTime: 8m49s - ExecTreeExecTime: 2s057ms - OpenTime: 26.781ms - ExecTreeOpenTime: 409.351us - PrepareTime: 58.971ms - ExecTreePrepareTime: 4.320ms DataStreamSender (dst_id=26):(Total: 1m2s, non-child: 1m2s, % non-child: 100.00%) - BytesSent: 5.64 GB (6055413541) - NetworkThroughput(*): 448.46 MB/sec - OverallThroughput: 92.07 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 206.75M (206748246) - SerializeBatchTime: 49s753ms - TransmitDataRPCTime: 12s877ms - UncompressedRowBatchSize: 7.90 GB (8478549126) CodeGen:(Total: 53.188ms, non-child: 53.188ms, % non-child: 100.00%) - CodegenTime: 829.937us - CompileTime: 7.518ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.884ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 28.190ms HDFS_SCAN_NODE (id=6):(Total: 1s891ms, non-child: 1s891ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:42/7.29 GB 3:46/7.81 GB 6:59/10.22 GB 5:57/10.53 GB 4:52/9.97 GB 2:48/8.90 GB 1:56/10.27 GB 0:44/7.43 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 84 out of 84 Runtime filters: All filters arrived. Waited 482ms Hdfs Read Thread Concurrency Bucket: 0:93.57% 1:5.198% 2:0.9452% 3:0.2836% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:320 PARQUET/SNAPPY:504 BytesRead(16s000ms): 183.38 MB, 194.36 MB, 263.21 MB, 484.50 MB, 623.87 MB, 697.73 MB, 781.52 MB, 875.66 MB, 931.82 MB, 1.06 GB, 1.13 GB, 1.23 GB, 1.30 GB, 1.34 GB, 1.36 GB, 1.36 GB, 1.40 GB, 1.49 GB, 1.53 GB, 1.57 GB, 1.70 GB, 1.80 GB, 1.80 GB, 1.80 GB, 1.80 GB, 1.80 GB, 1.87 GB, 1.92 GB, 2.07 GB, 2.17 GB, 2.23 GB, 2.36 GB, 2.40 GB - FooterProcessingTime: (Avg: 223.410ms ; Min: 1.332ms ; Max: 3s286ms ; Number of samples: 84) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 5.51 - BytesRead: 2.44 GB (2618863417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.44 GB (2618863417) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.44 GB (2618863417) - DecompressionTime: 11s691ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 84 (84) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 376.46 MB (394742715) - PerReadThreadRawHdfsThroughput: 55.38 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 41.104ms - RowBatchQueuePutWaitTime: 46m5s - RowsRead: 206.75M (206748246) - RowsReturned: 206.75M (206748246) - RowsReturnedRate: 109.33 M/sec - ScanRangesComplete: 404 (404) - ScannerThreadsInvoluntaryContextSwitches: 9.64K (9638) - ScannerThreadsTotalWallClockTime: 48m34s - MaterializeTupleTime(*): 33s710ms - ScannerThreadsSysTime: 5s744ms - ScannerThreadsUserTime: 50s433ms - ScannerThreadsVoluntaryContextSwitches: 682.85K (682854) - TotalRawHdfsReadTime(*): 45s097ms - TotalReadThroughput: 4.72 MB/sec Filter 1 (1.00 MB): - Files processed: 404 (404) - Files rejected: 320 (320) - Files total: 404 (404) - RowGroups processed: 201.95K (201947) - RowGroups rejected: 0 (0) - RowGroups total: 201.95K (201947) - Rows processed: 1.38M (1376256) - Rows rejected: 0 (0) - Rows total: 206.75M (206748246) - Splits processed: 84 (84) - Splits rejected: 0 (0) - Splits total: 84 (84) Instance 8d463de3722df36f:a2dae93a0000001c (host=vd1311.halxg.cloudera.com:22000):(Total: 8m47s, non-child: 7m42s, % non-child: 87.83%) Hdfs split stats (:<# splits>/): 5:41/7.08 GB 7:62/11.28 GB 3:54/8.52 GB 1:61/9.82 GB 6:53/9.09 GB 4:55/9.31 GB 2:54/9.73 GB 0:46/7.82 GB Filter 1 arrival: 551ms MemoryUsage(16s000ms): 290.51 MB, 309.95 MB, 288.74 MB, 269.97 MB, 264.01 MB, 270.89 MB, 311.31 MB, 268.57 MB, 230.40 MB, 211.16 MB, 214.81 MB, 202.54 MB, 186.56 MB, 183.11 MB, 211.45 MB, 228.06 MB, 228.33 MB, 210.11 MB, 207.54 MB, 180.79 MB, 238.53 MB, 220.87 MB, 230.72 MB, 226.43 MB, 259.64 MB, 271.99 MB, 265.03 MB, 228.11 MB, 196.20 MB, 183.69 MB, 189.71 MB, 191.24 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 8, 8, 8, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.51 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 323.23 MB (338935190) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 203.23M (203225532) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m15s - TotalStorageWaitTime: 1m13s - TotalThreadsInvoluntaryContextSwitches: 30.90K (30898) - TotalThreadsTotalWallClockTime: 57m11s - TotalThreadsSysTime: 11s068ms - TotalThreadsUserTime: 2m24s - TotalThreadsVoluntaryContextSwitches: 752.56K (752558) Fragment Instance Lifecycle Timings: - ExecTime: 8m46s - ExecTreeExecTime: 2s689ms - OpenTime: 35.108ms - ExecTreeOpenTime: 380.567us - PrepareTime: 66.209ms - ExecTreePrepareTime: 2.923ms DataStreamSender (dst_id=26):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - BytesSent: 5.54 GB (5944404875) - NetworkThroughput(*): 454.54 MB/sec - OverallThroughput: 92.10 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 203.23M (203225532) - SerializeBatchTime: 48s992ms - TransmitDataRPCTime: 12s472ms - UncompressedRowBatchSize: 7.76 GB (8334085968) CodeGen:(Total: 80.734ms, non-child: 80.734ms, % non-child: 100.00%) - CodegenTime: 1.527ms - CompileTime: 12.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 18.782ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 48.529ms HDFS_SCAN_NODE (id=6):(Total: 2s529ms, non-child: 2s529ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:41/7.08 GB 7:62/11.28 GB 3:54/8.52 GB 1:61/9.82 GB 6:53/9.09 GB 4:55/9.31 GB 2:54/9.73 GB 0:46/7.82 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 462ms Hdfs Read Thread Concurrency Bucket: 0:93.45% 1:5.888% 2:0.5698% 3:0.09497% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:343 PARQUET/SNAPPY:498 BytesRead(16s000ms): 214.48 MB, 229.59 MB, 255.22 MB, 470.97 MB, 570.29 MB, 647.09 MB, 795.75 MB, 868.30 MB, 953.19 MB, 1.05 GB, 1.13 GB, 1.23 GB, 1.28 GB, 1.33 GB, 1.42 GB, 1.45 GB, 1.45 GB, 1.48 GB, 1.51 GB, 1.58 GB, 1.70 GB, 1.71 GB, 1.74 GB, 1.76 GB, 1.86 GB, 1.90 GB, 1.90 GB, 1.90 GB, 2.04 GB, 2.12 GB, 2.23 GB, 2.30 GB - FooterProcessingTime: (Avg: 153.458ms ; Min: 1.048ms ; Max: 933.269ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.07 - AverageScannerThreadConcurrency: 5.51 - BytesRead: 2.38 GB (2552094186) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.38 GB (2552094186) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.38 GB (2552094186) - DecompressionTime: 15s568ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 322.01 MB (337647202) - PerReadThreadRawHdfsThroughput: 65.10 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 631.834ms - RowBatchQueuePutWaitTime: 45m50s - RowsRead: 203.23M (203225532) - RowsReturned: 203.23M (203225532) - RowsReturnedRate: 80.34 M/sec - ScanRangesComplete: 426 (426) - ScannerThreadsInvoluntaryContextSwitches: 10.81K (10813) - ScannerThreadsTotalWallClockTime: 48m24s - MaterializeTupleTime(*): 34s869ms - ScannerThreadsSysTime: 7s498ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 714.08K (714082) - TotalRawHdfsReadTime(*): 37s388ms - TotalReadThroughput: 4.62 MB/sec Filter 1 (1.00 MB): - Files processed: 426 (426) - Files rejected: 343 (343) - Files total: 426 (426) - RowGroups processed: 198.51K (198506) - RowGroups rejected: 0 (0) - RowGroups total: 198.51K (198506) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 203.23M (203225532) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance 8d463de3722df36f:a2dae93a0000001a (host=vd1314.halxg.cloudera.com:22000):(Total: 8m45s, non-child: 7m41s, % non-child: 87.85%) Hdfs split stats (:<# splits>/): 4:49/8.30 GB 6:60/10.40 GB 0:54/9.87 GB 7:44/7.16 GB 5:56/9.57 GB 3:50/8.49 GB 2:48/8.65 GB 1:58/10.37 GB Filter 1 arrival: 561ms MemoryUsage(16s000ms): 304.53 MB, 328.72 MB, 311.07 MB, 310.48 MB, 286.27 MB, 260.98 MB, 244.78 MB, 255.30 MB, 228.54 MB, 205.34 MB, 193.72 MB, 212.41 MB, 190.10 MB, 205.21 MB, 225.96 MB, 214.62 MB, 188.07 MB, 224.19 MB, 216.83 MB, 180.37 MB, 171.96 MB, 208.92 MB, 199.40 MB, 205.43 MB, 198.66 MB, 190.37 MB, 171.80 MB, 169.36 MB, 169.89 MB, 193.94 MB, 216.16 MB, 254.69 MB ThreadUsage(16s000ms): 7, 8, 8, 8, 8, 7, 7, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.42 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 330.31 MB (346355943) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 202.00M (201999873) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m13s - TotalStorageWaitTime: 1m33s - TotalThreadsInvoluntaryContextSwitches: 32.67K (32666) - TotalThreadsTotalWallClockTime: 56m9s - TotalThreadsSysTime: 9s592ms - TotalThreadsUserTime: 2m25s - TotalThreadsVoluntaryContextSwitches: 698.39K (698391) Fragment Instance Lifecycle Timings: - ExecTime: 8m45s - ExecTreeExecTime: 2s050ms - OpenTime: 26.475ms - ExecTreeOpenTime: 429.524us - PrepareTime: 50.771ms - ExecTreePrepareTime: 2.521ms DataStreamSender (dst_id=26):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - BytesSent: 5.50 GB (5910824883) - NetworkThroughput(*): 452.31 MB/sec - OverallThroughput: 91.13 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 202.00M (201999873) - SerializeBatchTime: 49s299ms - TransmitDataRPCTime: 12s462ms - UncompressedRowBatchSize: 7.71 GB (8283822861) CodeGen:(Total: 61.591ms, non-child: 61.591ms, % non-child: 100.00%) - CodegenTime: 939.292us - CompileTime: 6.810ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 16.994ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 37.252ms HDFS_SCAN_NODE (id=6):(Total: 1s862ms, non-child: 1s862ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:49/8.30 GB 6:60/10.40 GB 0:54/9.87 GB 7:44/7.16 GB 5:56/9.57 GB 3:50/8.49 GB 2:48/8.65 GB 1:58/10.37 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 502ms Hdfs Read Thread Concurrency Bucket: 0:92.38% 1:6.857% 2:0.5714% 3:0.1905% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:336 PARQUET/SNAPPY:498 BytesRead(16s000ms): 228.45 MB, 247.89 MB, 272.80 MB, 494.15 MB, 555.02 MB, 639.27 MB, 795.40 MB, 860.07 MB, 955.13 MB, 1.04 GB, 1.12 GB, 1.24 GB, 1.29 GB, 1.33 GB, 1.39 GB, 1.42 GB, 1.43 GB, 1.48 GB, 1.50 GB, 1.56 GB, 1.66 GB, 1.72 GB, 1.76 GB, 1.79 GB, 1.80 GB, 1.80 GB, 1.81 GB, 1.91 GB, 2.03 GB, 2.16 GB, 2.24 GB, 2.36 GB - FooterProcessingTime: (Avg: 186.829ms ; Min: 1.225ms ; Max: 1s156ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 5.42 - BytesRead: 2.37 GB (2544490094) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.37 GB (2544490094) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.37 GB (2544490094) - DecompressionTime: 10s530ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 329.05 MB (345035187) - PerReadThreadRawHdfsThroughput: 58.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 23.999ms - RowBatchQueuePutWaitTime: 44m32s - RowsRead: 202.00M (201999873) - RowsReturned: 202.00M (201999873) - RowsReturnedRate: 108.46 M/sec - ScanRangesComplete: 419 (419) - ScannerThreadsInvoluntaryContextSwitches: 11.40K (11401) - ScannerThreadsTotalWallClockTime: 47m24s - MaterializeTupleTime(*): 36s568ms - ScannerThreadsSysTime: 5s892ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 661.05K (661046) - TotalRawHdfsReadTime(*): 41s226ms - TotalReadThroughput: 4.62 MB/sec Filter 1 (1.00 MB): - Files processed: 419 (419) - Files rejected: 336 (336) - Files total: 419 (419) - RowGroups processed: 197.31K (197309) - RowGroups rejected: 0 (0) - RowGroups total: 197.31K (197309) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 202.00M (201999873) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Instance 8d463de3722df36f:a2dae93a0000001b (host=vd1309.halxg.cloudera.com:22000):(Total: 8m45s, non-child: 7m38s, % non-child: 87.24%) Hdfs split stats (:<# splits>/): 0:55/10.03 GB 1:50/9.13 GB 3:58/10.08 GB 5:49/8.56 GB 6:52/9.26 GB 7:48/8.79 GB 4:45/7.34 GB 2:58/9.45 GB Filter 1 arrival: 535ms MemoryUsage(16s000ms): 184.05 MB, 197.84 MB, 234.52 MB, 254.62 MB, 256.76 MB, 260.55 MB, 246.18 MB, 240.91 MB, 211.65 MB, 194.78 MB, 187.91 MB, 183.11 MB, 196.36 MB, 198.46 MB, 218.21 MB, 191.13 MB, 187.87 MB, 189.99 MB, 224.67 MB, 223.82 MB, 203.79 MB, 206.02 MB, 206.30 MB, 202.25 MB, 194.68 MB, 214.41 MB, 210.09 MB, 193.10 MB, 221.04 MB, 211.76 MB, 215.03 MB, 185.80 MB ThreadUsage(16s000ms): 6, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.24 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 290.19 MB (304286612) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 206.30M (206296016) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 7m11s - TotalStorageWaitTime: 1m42s - TotalThreadsInvoluntaryContextSwitches: 42.33K (42333) - TotalThreadsTotalWallClockTime: 54m36s - TotalThreadsSysTime: 7s728ms - TotalThreadsUserTime: 2m24s - TotalThreadsVoluntaryContextSwitches: 463.91K (463912) Fragment Instance Lifecycle Timings: - ExecTime: 8m44s - ExecTreeExecTime: 6s019ms - OpenTime: 43.010ms - ExecTreeOpenTime: 781.183us - PrepareTime: 76.282ms - ExecTreePrepareTime: 2.602ms DataStreamSender (dst_id=26):(Total: 1m1s, non-child: 1m1s, % non-child: 100.00%) - BytesSent: 5.62 GB (6032584046) - NetworkThroughput(*): 446.14 MB/sec - OverallThroughput: 94.19 MB/sec - PeakMemoryUsage: 220.17 KB (225456) - RowsReturned: 206.30M (206296016) - SerializeBatchTime: 48s100ms - TransmitDataRPCTime: 12s895ms - UncompressedRowBatchSize: 7.88 GB (8460003604) CodeGen:(Total: 76.683ms, non-child: 76.683ms, % non-child: 100.00%) - CodegenTime: 1.865ms - CompileTime: 6.916ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 29 (29) - NumInstructions: 460 (460) - OptimizationTime: 27.671ms - PeakMemoryUsage: 230.00 KB (235520) - PrepareTime: 40.425ms HDFS_SCAN_NODE (id=6):(Total: 5s847ms, non-child: 5s847ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:55/10.03 GB 1:50/9.13 GB 3:58/10.08 GB 5:49/8.56 GB 6:52/9.26 GB 7:48/8.79 GB 4:45/7.34 GB 2:58/9.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 83 out of 83 Runtime filters: All filters arrived. Waited 441ms Hdfs Read Thread Concurrency Bucket: 0:93.61% 1:5.052% 2:1.239% 3:0.09533% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:332 PARQUET/SNAPPY:498 BytesRead(16s000ms): 134.97 MB, 146.02 MB, 248.28 MB, 483.09 MB, 563.29 MB, 671.27 MB, 774.06 MB, 896.81 MB, 983.59 MB, 1.08 GB, 1.17 GB, 1.26 GB, 1.34 GB, 1.38 GB, 1.43 GB, 1.44 GB, 1.45 GB, 1.52 GB, 1.62 GB, 1.66 GB, 1.72 GB, 1.83 GB, 1.83 GB, 1.83 GB, 1.83 GB, 1.90 GB, 1.90 GB, 1.99 GB, 2.10 GB, 2.21 GB, 2.28 GB, 2.37 GB - FooterProcessingTime: (Avg: 247.855ms ; Min: 1.202ms ; Max: 1s514ms ; Number of samples: 83) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 5.24 - BytesRead: 2.41 GB (2591219508) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2591219508) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.41 GB (2591219508) - DecompressionTime: 18s717ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 83 (83) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 288.98 MB (303015016) - PerReadThreadRawHdfsThroughput: 60.01 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 29.417ms - RowBatchQueuePutWaitTime: 42m51s - RowsRead: 206.30M (206296016) - RowsReturned: 206.30M (206296016) - RowsReturnedRate: 35.28 M/sec - ScanRangesComplete: 415 (415) - ScannerThreadsInvoluntaryContextSwitches: 13.41K (13406) - ScannerThreadsTotalWallClockTime: 45m51s - MaterializeTupleTime(*): 33s438ms - ScannerThreadsSysTime: 4s407ms - ScannerThreadsUserTime: 1m1s - ScannerThreadsVoluntaryContextSwitches: 424.85K (424848) - TotalRawHdfsReadTime(*): 41s180ms - TotalReadThroughput: 4.71 MB/sec Filter 1 (1.00 MB): - Files processed: 415 (415) - Files rejected: 332 (332) - Files total: 415 (415) - RowGroups processed: 201.50K (201501) - RowGroups rejected: 0 (0) - RowGroups total: 201.50K (201501) - Rows processed: 1.36M (1359872) - Rows rejected: 0 (0) - Rows total: 206.30M (206296016) - Splits processed: 83 (83) - Splits rejected: 0 (0) - Splits total: 83 (83) Averaged Fragment F06:(Total: 20s418ms, non-child: 7s217ms, % non-child: 35.35%) split sizes: min: 7.43 GB, max: 7.46 GB, avg: 7.44 GB, stddev: 7.03 MB completion times: min:18s703ms max:21s730ms mean: 20s420ms stddev:941.036ms execution rates: min:350.99 MB/sec max:408.16 MB/sec mean:374.13 MB/sec stddev:18.00 MB/sec num instances: 7 - AverageThreadTokens: 7.66 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 86.51 MB (90709156) - PerHostPeakMemUsage: 7.28 GB (7819412438) - RowsProduced: 102.86M (102860069) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s503ms - TotalStorageWaitTime: 54s656ms - TotalThreadsInvoluntaryContextSwitches: 6.01K (6007) - TotalThreadsTotalWallClockTime: 2m35s - TotalThreadsSysTime: 1s599ms - TotalThreadsUserTime: 24s763ms - TotalThreadsVoluntaryContextSwitches: 102.61K (102615) Fragment Instance Lifecycle Timings: - ExecTime: 20s348ms - ExecTreeExecTime: 1s552ms - OpenTime: 21.684ms - ExecTreeOpenTime: 306.619us - PrepareTime: 47.695ms - ExecTreePrepareTime: 2.141ms DataStreamSender (dst_id=27):(Total: 11s631ms, non-child: 11s631ms, % non-child: 100.00%) - BytesSent: 1.46 GB (1568905068) - NetworkThroughput(*): 352.03 MB/sec - OverallThroughput: 128.69 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 102.86M (102860069) - SerializeBatchTime: 7s369ms - TransmitDataRPCTime: 4s250ms - UncompressedRowBatchSize: 2.01 GB (2160488717) CodeGen:(Total: 51.841ms, non-child: 51.841ms, % non-child: 100.00%) - CodegenTime: 355.854us - CompileTime: 7.043ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 10.914ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 33.179ms HDFS_SCAN_NODE (id=7):(Total: 1s517ms, non-child: 1s517ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 6.66 - BytesRead: 1.08 GB (1161464993) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1161464993) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1161464993) - DecompressionTime: 3s620ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 312 (312) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 86.26 MB (90452077) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s125ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 102.86M (102860069) - RowsReturned: 102.86M (102860069) - RowsReturnedRate: 87.74 M/sec - ScanRangesComplete: 312 (312) - ScannerThreadsInvoluntaryContextSwitches: 3.36K (3363) - ScannerThreadsTotalWallClockTime: 2m15s - MaterializeTupleTime(*): 3s272ms - ScannerThreadsSysTime: 994.560ms - ScannerThreadsUserTime: 7s766ms - ScannerThreadsVoluntaryContextSwitches: 100.93K (100932) - TotalRawHdfsReadTime(*): 794.106ms - TotalReadThroughput: 54.17 MB/sec Fragment F06: Instance 8d463de3722df36f:a2dae93a00000020 (host=vd1313.halxg.cloudera.com:22000):(Total: 21s728ms, non-child: 7s545ms, % non-child: 34.72%) Hdfs split stats (:<# splits>/): 0:36/913.21 MB 1:37/892.17 MB 7:35/906.95 MB 6:35/887.43 MB 4:37/927.52 MB 3:41/1.00 GB 5:36/1.06 GB 2:40/988.80 MB MemoryUsage(500.000ms): 45.44 MB, 49.04 MB, 41.14 MB, 40.82 MB, 41.40 MB, 25.98 MB, 18.34 MB, 44.15 MB, 22.57 MB, 18.80 MB, 15.41 MB, 22.73 MB, 11.79 MB, 9.69 MB, 35.12 MB, 17.12 MB, 43.06 MB, 49.73 MB, 40.02 MB, 48.94 MB, 18.93 MB, 27.79 MB, 35.67 MB, 32.17 MB, 16.40 MB, 28.91 MB, 22.66 MB, 29.04 MB, 44.13 MB, 58.22 MB, 40.88 MB, 54.29 MB, 55.47 MB, 42.14 MB, 88.41 MB, 90.14 MB, 78.93 MB, 75.56 MB, 47.02 MB, 52.39 MB, 30.11 MB, 20.35 MB, 2.60 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 8.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 96.20 MB (100870470) - PerHostPeakMemUsage: 7.79 GB (8368915896) - RowsProduced: 103.57M (103573478) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s445ms - TotalStorageWaitTime: 1m8s - TotalThreadsInvoluntaryContextSwitches: 6.21K (6211) - TotalThreadsTotalWallClockTime: 2m52s - TotalThreadsSysTime: 1s915ms - TotalThreadsUserTime: 26s429ms - TotalThreadsVoluntaryContextSwitches: 102.19K (102192) Fragment Instance Lifecycle Timings: - ExecTime: 21s666ms - ExecTreeExecTime: 2s011ms - OpenTime: 18.590ms - ExecTreeOpenTime: 214.471us - PrepareTime: 43.481ms - ExecTreePrepareTime: 2.436ms DataStreamSender (dst_id=27):(Total: 12s164ms, non-child: 12s164ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1577966926) - NetworkThroughput(*): 349.04 MB/sec - OverallThroughput: 123.71 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.57M (103573478) - SerializeBatchTime: 7s840ms - TransmitDataRPCTime: 4s311ms - UncompressedRowBatchSize: 2.03 GB (2175473262) CodeGen:(Total: 45.911ms, non-child: 45.911ms, % non-child: 100.00%) - CodegenTime: 420.758us - CompileTime: 5.746ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 9.293ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 30.054ms HDFS_SCAN_NODE (id=7):(Total: 1s973ms, non-child: 1s973ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:36/913.21 MB 1:37/892.17 MB 7:35/906.95 MB 6:35/887.43 MB 4:37/927.52 MB 3:41/1.00 GB 5:36/1.06 GB 2:40/988.80 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 297 out of 297 Hdfs Read Thread Concurrency Bucket: 0:97.67% 1:2.326% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:594 BytesRead(500.000ms): 23.43 MB, 27.51 MB, 54.37 MB, 78.65 MB, 105.19 MB, 135.05 MB, 161.43 MB, 192.49 MB, 220.76 MB, 246.51 MB, 264.46 MB, 281.30 MB, 306.64 MB, 317.55 MB, 340.15 MB, 361.11 MB, 391.28 MB, 402.68 MB, 422.74 MB, 457.38 MB, 486.10 MB, 524.42 MB, 560.78 MB, 590.75 MB, 622.25 MB, 659.36 MB, 684.95 MB, 716.82 MB, 750.54 MB, 768.76 MB, 779.08 MB, 811.98 MB, 844.99 MB, 866.59 MB, 945.59 MB, 968.48 MB, 989.21 MB, 1013.97 MB, 1.00 GB, 1.02 GB, 1.03 GB, 1.05 GB, 1.06 GB - FooterProcessingTime: (Avg: 125.108ms ; Min: 782.219us ; Max: 2s373ms ; Number of samples: 297) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 1.08 GB (1163671961) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1163671961) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1163671961) - DecompressionTime: 4s037ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 297 (297) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 95.95 MB (100606372) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s540ms - RowBatchQueuePutWaitTime: 1m10s - RowsRead: 103.57M (103573478) - RowsReturned: 103.57M (103573478) - RowsReturnedRate: 52.49 M/sec - ScanRangesComplete: 297 (297) - ScannerThreadsInvoluntaryContextSwitches: 3.62K (3619) - ScannerThreadsTotalWallClockTime: 2m31s - MaterializeTupleTime(*): 4s173ms - ScannerThreadsSysTime: 1s134ms - ScannerThreadsUserTime: 8s626ms - ScannerThreadsVoluntaryContextSwitches: 100.69K (100688) - TotalRawHdfsReadTime(*): 797.986ms - TotalReadThroughput: 50.31 MB/sec Instance 8d463de3722df36f:a2dae93a00000024 (host=vd1316.halxg.cloudera.com:22000):(Total: 20s922ms, non-child: 7s283ms, % non-child: 34.81%) Hdfs split stats (:<# splits>/): 2:39/1.26 GB 3:40/1.06 GB 1:34/805.56 MB 5:40/1.08 GB 7:37/871.84 MB 4:32/761.48 MB 6:31/782.25 MB 0:41/910.27 MB MemoryUsage(500.000ms): 49.16 MB, 37.89 MB, 11.16 MB, 21.31 MB, 16.84 MB, 19.54 MB, 5.15 MB, 8.83 MB, 27.82 MB, 5.56 MB, 12.36 MB, 13.57 MB, 42.95 MB, 49.89 MB, 19.25 MB, 8.36 MB, 25.50 MB, 42.92 MB, 53.15 MB, 39.00 MB, 38.39 MB, 46.89 MB, 25.45 MB, 37.06 MB, 17.21 MB, 80.77 MB, 85.01 MB, 65.38 MB, 66.63 MB, 72.59 MB, 62.04 MB, 47.12 MB, 41.98 MB, 34.56 MB, 40.04 MB, 55.17 MB, 43.26 MB, 38.09 MB, 14.85 MB, 47.09 MB, 224.92 KB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 7.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 96.16 MB (100829237) - PerHostPeakMemUsage: 7.50 GB (8049762371) - RowsProduced: 104.67M (104671698) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s495ms - TotalStorageWaitTime: 53s256ms - TotalThreadsInvoluntaryContextSwitches: 6.05K (6050) - TotalThreadsTotalWallClockTime: 2m25s - TotalThreadsSysTime: 1s483ms - TotalThreadsUserTime: 25s170ms - TotalThreadsVoluntaryContextSwitches: 100.84K (100837) Fragment Instance Lifecycle Timings: - ExecTime: 20s864ms - ExecTreeExecTime: 1s735ms - OpenTime: 15.084ms - ExecTreeOpenTime: 227.261us - PrepareTime: 42.621ms - ExecTreePrepareTime: 2.264ms DataStreamSender (dst_id=27):(Total: 11s893ms, non-child: 11s893ms, % non-child: 100.00%) - BytesSent: 1.48 GB (1591153146) - NetworkThroughput(*): 354.83 MB/sec - OverallThroughput: 127.58 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 104.67M (104671698) - SerializeBatchTime: 7s605ms - TransmitDataRPCTime: 4s276ms - UncompressedRowBatchSize: 2.05 GB (2198540446) CodeGen:(Total: 42.793ms, non-child: 42.793ms, % non-child: 100.00%) - CodegenTime: 289.679us - CompileTime: 5.089ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.788ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 29.279ms HDFS_SCAN_NODE (id=7):(Total: 1s702ms, non-child: 1s702ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:39/1.26 GB 3:40/1.06 GB 1:34/805.56 MB 5:40/1.08 GB 7:37/871.84 MB 4:32/761.48 MB 6:31/782.25 MB 0:41/910.27 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 294 out of 294 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:588 BytesRead(500.000ms): 25.02 MB, 25.02 MB, 50.77 MB, 80.84 MB, 97.47 MB, 124.25 MB, 131.56 MB, 156.80 MB, 192.47 MB, 220.15 MB, 252.21 MB, 282.86 MB, 326.21 MB, 339.93 MB, 359.85 MB, 392.53 MB, 412.82 MB, 447.85 MB, 473.63 MB, 499.19 MB, 535.40 MB, 562.11 MB, 596.93 MB, 636.18 MB, 655.41 MB, 733.00 MB, 752.06 MB, 776.68 MB, 793.96 MB, 808.99 MB, 827.49 MB, 847.01 MB, 872.27 MB, 902.01 MB, 934.23 MB, 963.27 MB, 990.64 MB, 1016.36 MB, 1.02 GB, 1.05 GB, 1.07 GB - FooterProcessingTime: (Avg: 95.629ms ; Min: 1.287ms ; Max: 1s621ms ; Number of samples: 294) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 1.09 GB (1169295665) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1169295665) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1169295665) - DecompressionTime: 3s779ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 294 (294) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 95.91 MB (100565131) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s321ms - RowBatchQueuePutWaitTime: 1m1s - RowsRead: 104.67M (104671698) - RowsReturned: 104.67M (104671698) - RowsReturnedRate: 61.47 M/sec - ScanRangesComplete: 294 (294) - ScannerThreadsInvoluntaryContextSwitches: 3.39K (3393) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 3s205ms - ScannerThreadsSysTime: 931.855ms - ScannerThreadsUserTime: 7s811ms - ScannerThreadsVoluntaryContextSwitches: 99.14K (99135) - TotalRawHdfsReadTime(*): 792.834ms - TotalReadThroughput: 53.56 MB/sec Instance 8d463de3722df36f:a2dae93a00000022 (host=vd1309.halxg.cloudera.com:22000):(Total: 20s884ms, non-child: 7s240ms, % non-child: 34.67%) Hdfs split stats (:<# splits>/): 7:45/1.02 GB 3:45/902.27 MB 0:47/1.01 GB 6:42/903.65 MB 5:41/874.25 MB 1:48/1.06 GB 4:37/876.44 MB 2:39/895.37 MB MemoryUsage(500.000ms): 47.12 MB, 38.01 MB, 16.97 MB, 248.94 KB, 13.05 MB, 26.80 MB, 10.08 MB, 13.15 MB, 10.84 MB, 18.99 MB, 14.88 MB, 18.03 MB, 18.75 MB, 25.66 MB, 30.47 MB, 27.47 MB, 31.24 MB, 28.96 MB, 29.07 MB, 46.41 MB, 26.33 MB, 32.67 MB, 45.64 MB, 26.79 MB, 44.01 MB, 17.84 MB, 31.29 MB, 33.61 MB, 28.06 MB, 29.03 MB, 41.74 MB, 46.00 MB, 38.06 MB, 42.65 MB, 20.64 MB, 8.96 MB, 23.61 MB, 4.62 MB, 28.54 MB, 12.83 MB, 43.87 MB ThreadUsage(500.000ms): 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7 - AverageThreadTokens: 7.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.83 MB (59593505) - PerHostPeakMemUsage: 7.24 GB (7779171287) - RowsProduced: 100.54M (100544910) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s462ms - TotalStorageWaitTime: 59s732ms - TotalThreadsInvoluntaryContextSwitches: 7.75K (7745) - TotalThreadsTotalWallClockTime: 2m24s - TotalThreadsSysTime: 1s604ms - TotalThreadsUserTime: 23s891ms - TotalThreadsVoluntaryContextSwitches: 97.41K (97408) Fragment Instance Lifecycle Timings: - ExecTime: 20s777ms - ExecTreeExecTime: 2s064ms - OpenTime: 33.050ms - ExecTreeOpenTime: 549.434us - PrepareTime: 73.428ms - ExecTreePrepareTime: 3.537ms DataStreamSender (dst_id=27):(Total: 11s544ms, non-child: 11s544ms, % non-child: 100.00%) - BytesSent: 1.43 GB (1539376289) - NetworkThroughput(*): 344.07 MB/sec - OverallThroughput: 127.17 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 100.54M (100544910) - SerializeBatchTime: 7s266ms - TransmitDataRPCTime: 4s266ms - UncompressedRowBatchSize: 1.97 GB (2111860754) CodeGen:(Total: 72.074ms, non-child: 72.074ms, % non-child: 100.00%) - CodegenTime: 330.409us - CompileTime: 8.526ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 16.063ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 46.941ms HDFS_SCAN_NODE (id=7):(Total: 2s028ms, non-child: 2s028ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:45/1.02 GB 3:45/902.27 MB 0:47/1.01 GB 6:42/903.65 MB 5:41/874.25 MB 1:48/1.06 GB 4:37/876.44 MB 2:39/895.37 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 344 out of 344 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:688 BytesRead(500.000ms): 23.92 MB, 23.98 MB, 58.47 MB, 79.15 MB, 104.18 MB, 143.85 MB, 172.17 MB, 186.55 MB, 204.42 MB, 231.86 MB, 260.75 MB, 290.18 MB, 323.67 MB, 360.93 MB, 396.48 MB, 422.89 MB, 442.07 MB, 465.54 MB, 497.21 MB, 532.05 MB, 556.37 MB, 588.60 MB, 616.41 MB, 643.32 MB, 674.72 MB, 692.85 MB, 728.85 MB, 763.50 MB, 793.71 MB, 800.76 MB, 829.02 MB, 850.20 MB, 874.51 MB, 902.19 MB, 930.25 MB, 953.14 MB, 982.64 MB, 1008.14 MB, 1.00 GB, 1.03 GB, 1.05 GB - FooterProcessingTime: (Avg: 87.011ms ; Min: 977.156us ; Max: 1s194ms ; Number of samples: 344) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 1.07 GB (1151390440) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1151390440) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1151390440) - DecompressionTime: 3s221ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 344 (344) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 56.64 MB (59394943) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s573ms - RowBatchQueuePutWaitTime: 55s308ms - RowsRead: 100.54M (100544910) - RowsReturned: 100.54M (100544910) - RowsReturnedRate: 49.58 M/sec - ScanRangesComplete: 344 (344) - ScannerThreadsInvoluntaryContextSwitches: 3.40K (3402) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 2s820ms - ScannerThreadsSysTime: 954.852ms - ScannerThreadsUserTime: 7s017ms - ScannerThreadsVoluntaryContextSwitches: 95.80K (95804) - TotalRawHdfsReadTime(*): 775.038ms - TotalReadThroughput: 52.67 MB/sec Instance 8d463de3722df36f:a2dae93a00000023 (host=vd1311.halxg.cloudera.com:22000):(Total: 20s755ms, non-child: 7s264ms, % non-child: 35.00%) Hdfs split stats (:<# splits>/): 3:36/945.20 MB 1:48/1.17 GB 5:36/1.13 GB 2:38/946.59 MB 6:43/1006.10 MB 7:38/907.95 MB 0:32/752.71 MB 4:30/701.68 MB MemoryUsage(500.000ms): 48.33 MB, 38.91 MB, 47.05 MB, 44.33 MB, 30.38 MB, 49.06 MB, 37.35 MB, 50.81 MB, 36.86 MB, 88.37 MB, 73.94 MB, 65.36 MB, 74.05 MB, 75.11 MB, 73.03 MB, 65.29 MB, 54.90 MB, 70.19 MB, 66.22 MB, 31.51 MB, 40.09 MB, 30.84 MB, 21.49 MB, 14.73 MB, 308.57 KB, 232.96 KB, 4.56 MB, 18.12 MB, 8.44 MB, 30.07 MB, 50.86 MB, 44.80 MB, 44.72 MB, 42.49 MB, 48.93 MB, 47.25 MB, 43.16 MB, 28.81 MB, 48.77 MB, 48.17 MB, 2.52 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 4 - AverageThreadTokens: 7.90 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 91.30 MB (95731351) - PerHostPeakMemUsage: 7.37 GB (7918187001) - RowsProduced: 103.40M (103399413) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s506ms - TotalStorageWaitTime: 52s510ms - TotalThreadsInvoluntaryContextSwitches: 5.37K (5370) - TotalThreadsTotalWallClockTime: 2m42s - TotalThreadsSysTime: 1s353ms - TotalThreadsUserTime: 24s741ms - TotalThreadsVoluntaryContextSwitches: 105.56K (105562) Fragment Instance Lifecycle Timings: - ExecTime: 20s696ms - ExecTreeExecTime: 2s145ms - OpenTime: 12.442ms - ExecTreeOpenTime: 220.909us - PrepareTime: 46.815ms - ExecTreePrepareTime: 1.354ms DataStreamSender (dst_id=27):(Total: 11s334ms, non-child: 11s334ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1575642326) - NetworkThroughput(*): 359.61 MB/sec - OverallThroughput: 132.57 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.40M (103399413) - SerializeBatchTime: 7s145ms - TransmitDataRPCTime: 4s178ms - UncompressedRowBatchSize: 2.02 GB (2171817177) CodeGen:(Total: 44.203ms, non-child: 44.203ms, % non-child: 100.00%) - CodegenTime: 342.610us - CompileTime: 4.326ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 6.169ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 33.059ms HDFS_SCAN_NODE (id=7):(Total: 2s112ms, non-child: 2s112ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:36/945.20 MB 1:48/1.17 GB 5:36/1.13 GB 2:38/946.59 MB 6:43/1006.10 MB 7:38/907.95 MB 0:32/752.71 MB 4:30/701.68 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 301 out of 301 Hdfs Read Thread Concurrency Bucket: 0:95.12% 1:4.878% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:602 BytesRead(500.000ms): 26.59 MB, 26.59 MB, 65.81 MB, 93.69 MB, 123.87 MB, 163.72 MB, 191.54 MB, 230.89 MB, 255.88 MB, 334.94 MB, 352.82 MB, 374.29 MB, 404.28 MB, 435.83 MB, 460.14 MB, 484.18 MB, 496.44 MB, 524.55 MB, 551.70 MB, 574.83 MB, 606.75 MB, 634.27 MB, 662.24 MB, 692.64 MB, 707.96 MB, 724.73 MB, 727.17 MB, 754.55 MB, 763.62 MB, 783.06 MB, 822.48 MB, 847.11 MB, 875.08 MB, 900.78 MB, 934.31 MB, 962.75 MB, 997.63 MB, 1.00 GB, 1.04 GB, 1.07 GB, 1.07 GB - FooterProcessingTime: (Avg: 91.988ms ; Min: 941.555us ; Max: 1s781ms ; Number of samples: 301) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 6.90 - BytesRead: 1.08 GB (1163319149) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1163319149) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1163319149) - DecompressionTime: 3s653ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 301 (301) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 91.03 MB (95450869) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1s747ms - RowBatchQueuePutWaitTime: 1m20s - RowsRead: 103.40M (103399413) - RowsReturned: 103.40M (103399413) - RowsReturnedRate: 48.95 M/sec - ScanRangesComplete: 301 (301) - ScannerThreadsInvoluntaryContextSwitches: 3.38K (3378) - ScannerThreadsTotalWallClockTime: 2m22s - MaterializeTupleTime(*): 3s166ms - ScannerThreadsSysTime: 917.857ms - ScannerThreadsUserTime: 7s866ms - ScannerThreadsVoluntaryContextSwitches: 103.75K (103751) - TotalRawHdfsReadTime(*): 822.970ms - TotalReadThroughput: 53.68 MB/sec Instance 8d463de3722df36f:a2dae93a00000021 (host=vd1312.halxg.cloudera.com:22000):(Total: 20s488ms, non-child: 7s561ms, % non-child: 36.91%) Hdfs split stats (:<# splits>/): 7:40/950.38 MB 2:47/1.02 GB 0:46/1012.60 MB 1:48/1.05 GB 5:35/807.84 MB 4:45/950.47 MB 3:40/867.71 MB 6:49/921.90 MB MemoryUsage(500.000ms): 42.27 MB, 44.16 MB, 25.94 MB, 39.14 MB, 27.08 MB, 21.85 MB, 28.76 MB, 11.79 MB, 34.82 MB, 38.72 MB, 46.47 MB, 23.62 MB, 31.41 MB, 45.66 MB, 32.84 MB, 24.81 MB, 27.86 MB, 31.29 MB, 21.36 MB, 420.47 KB, 436.58 KB, 43.05 MB, 41.83 MB, 26.89 MB, 14.08 MB, 2.56 MB, 5.24 MB, 45.14 MB, 55.90 MB, 49.51 MB, 45.05 MB, 31.88 MB, 31.90 MB, 45.12 MB, 45.99 MB, 20.93 MB, 26.85 MB, 32.26 MB, 25.98 MB, 34.68 MB, 52.15 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8 - AverageThreadTokens: 8.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 59.30 MB (62179438) - PerHostPeakMemUsage: 7.31 GB (7844389030) - RowsProduced: 100.72M (100718649) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s491ms - TotalStorageWaitTime: 1m5s - TotalThreadsInvoluntaryContextSwitches: 6.41K (6411) - TotalThreadsTotalWallClockTime: 2m42s - TotalThreadsSysTime: 1s869ms - TotalThreadsUserTime: 24s718ms - TotalThreadsVoluntaryContextSwitches: 100.87K (100866) Fragment Instance Lifecycle Timings: - ExecTime: 20s411ms - ExecTreeExecTime: 1s336ms - OpenTime: 31.375ms - ExecTreeOpenTime: 368.788us - PrepareTime: 45.095ms - ExecTreePrepareTime: 1.215ms DataStreamSender (dst_id=27):(Total: 11s570ms, non-child: 11s570ms, % non-child: 100.00%) - BytesSent: 1.44 GB (1542103082) - NetworkThroughput(*): 349.90 MB/sec - OverallThroughput: 127.11 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 100.72M (100718649) - SerializeBatchTime: 7s354ms - TransmitDataRPCTime: 4s203ms - UncompressedRowBatchSize: 1.97 GB (2115510001) CodeGen:(Total: 58.604ms, non-child: 58.604ms, % non-child: 100.00%) - CodegenTime: 462.003us - CompileTime: 11.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 15.830ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 30.680ms HDFS_SCAN_NODE (id=7):(Total: 1s298ms, non-child: 1s298ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:40/950.38 MB 2:47/1.02 GB 0:46/1012.60 MB 1:48/1.05 GB 5:35/807.84 MB 4:45/950.47 MB 3:40/867.71 MB 6:49/921.90 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 350 out of 350 Hdfs Read Thread Concurrency Bucket: 0:97.56% 1:2.439% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:700 BytesRead(500.000ms): 24.50 MB, 25.88 MB, 43.47 MB, 79.34 MB, 97.35 MB, 126.45 MB, 154.21 MB, 178.67 MB, 214.16 MB, 244.96 MB, 278.67 MB, 296.45 MB, 335.73 MB, 371.56 MB, 395.72 MB, 423.79 MB, 450.15 MB, 470.26 MB, 495.29 MB, 512.70 MB, 534.78 MB, 570.73 MB, 601.90 MB, 628.85 MB, 655.23 MB, 676.37 MB, 702.41 MB, 743.03 MB, 773.41 MB, 791.33 MB, 800.92 MB, 828.58 MB, 852.62 MB, 888.84 MB, 918.61 MB, 938.53 MB, 972.00 MB, 996.07 MB, 1.00 GB, 1.04 GB, 1.07 GB - FooterProcessingTime: (Avg: 103.982ms ; Min: 1.081ms ; Max: 1s761ms ; Number of samples: 350) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 7.00 - BytesRead: 1.07 GB (1152818405) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.07 GB (1152818405) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.07 GB (1152818405) - DecompressionTime: 3s553ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 350 (350) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 59.01 MB (61874372) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 898.112ms - RowBatchQueuePutWaitTime: 1m8s - RowsRead: 100.72M (100718649) - RowsReturned: 100.72M (100718649) - RowsReturnedRate: 77.59 M/sec - ScanRangesComplete: 350 (350) - ScannerThreadsInvoluntaryContextSwitches: 3.52K (3520) - ScannerThreadsTotalWallClockTime: 2m22s - MaterializeTupleTime(*): 3s170ms - ScannerThreadsSysTime: 1s091ms - ScannerThreadsUserTime: 7s628ms - ScannerThreadsVoluntaryContextSwitches: 99.11K (99109) - TotalRawHdfsReadTime(*): 776.905ms - TotalReadThroughput: 53.50 MB/sec Instance 8d463de3722df36f:a2dae93a0000001f (host=vd1310.halxg.cloudera.com:22000):(Total: 19s447ms, non-child: 6s890ms, % non-child: 35.43%) Hdfs split stats (:<# splits>/): 5:36/925.27 MB 3:45/1.12 GB 1:40/1.07 GB 7:36/964.70 MB 2:36/1.01 GB 0:34/827.09 MB 4:33/800.56 MB 6:39/826.55 MB MemoryUsage(500.000ms): 49.05 MB, 43.04 MB, 13.53 MB, 27.65 MB, 49.28 MB, 41.53 MB, 29.00 MB, 22.69 MB, 40.84 MB, 25.75 MB, 42.18 MB, 41.13 MB, 33.12 MB, 21.72 MB, 527.05 KB, 14.68 MB, 51.40 MB, 31.63 MB, 48.11 MB, 42.55 MB, 44.10 MB, 31.35 MB, 8.82 MB, 40.02 MB, 54.19 MB, 49.09 MB, 35.84 MB, 44.03 MB, 42.44 MB, 102.69 MB, 105.94 MB, 87.38 MB, 104.22 MB, 75.86 MB, 73.05 MB, 65.97 MB, 47.13 MB, 47.05 MB, 13.51 MB ThreadUsage(500.000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 2 - AverageThreadTokens: 7.85 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 109.33 MB (114637263) - PerHostPeakMemUsage: 6.98 GB (7491342696) - RowsProduced: 103.51M (103513076) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s539ms - TotalStorageWaitTime: 46s495ms - TotalThreadsInvoluntaryContextSwitches: 5.02K (5021) - TotalThreadsTotalWallClockTime: 2m33s - TotalThreadsSysTime: 1s481ms - TotalThreadsUserTime: 24s212ms - TotalThreadsVoluntaryContextSwitches: 105.22K (105215) Fragment Instance Lifecycle Timings: - ExecTime: 19s403ms - ExecTreeExecTime: 1s086ms - OpenTime: 13.677ms - ExecTreeOpenTime: 188.205us - PrepareTime: 30.203ms - ExecTreePrepareTime: 1.027ms DataStreamSender (dst_id=27):(Total: 11s472ms, non-child: 11s472ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1577351413) - NetworkThroughput(*): 352.41 MB/sec - OverallThroughput: 131.12 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.51M (103513076) - SerializeBatchTime: 7s193ms - TransmitDataRPCTime: 4s268ms - UncompressedRowBatchSize: 2.02 GB (2174204572) CodeGen:(Total: 32.532ms, non-child: 32.532ms, % non-child: 100.00%) - CodegenTime: 316.217us - CompileTime: 4.386ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 6.918ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 20.742ms HDFS_SCAN_NODE (id=7):(Total: 1s051ms, non-child: 1s051ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:36/925.27 MB 3:45/1.12 GB 1:40/1.07 GB 7:36/964.70 MB 2:36/1.01 GB 0:34/827.09 MB 4:33/800.56 MB 6:39/826.55 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 299 out of 299 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:598 BytesRead(500.000ms): 27.19 MB, 32.91 MB, 62.58 MB, 95.01 MB, 136.71 MB, 171.19 MB, 192.41 MB, 226.61 MB, 259.04 MB, 293.89 MB, 329.61 MB, 367.74 MB, 393.67 MB, 424.73 MB, 445.44 MB, 454.96 MB, 485.12 MB, 501.24 MB, 528.83 MB, 555.09 MB, 590.29 MB, 622.25 MB, 651.36 MB, 685.90 MB, 715.13 MB, 743.93 MB, 784.92 MB, 810.03 MB, 836.80 MB, 911.06 MB, 928.39 MB, 949.04 MB, 979.71 MB, 1001.50 MB, 1.00 GB, 1.03 GB, 1.05 GB, 1.07 GB, 1.08 GB - FooterProcessingTime: (Avg: 79.458ms ; Min: 1.248ms ; Max: 1s410ms ; Number of samples: 299) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.85 - BytesRead: 1.08 GB (1163956258) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.08 GB (1163956258) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.08 GB (1163956258) - DecompressionTime: 3s486ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 299 (299) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 109.08 MB (114381357) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 700.210ms - RowBatchQueuePutWaitTime: 1m19s - RowsRead: 103.51M (103513076) - RowsReturned: 103.51M (103513076) - RowsReturnedRate: 98.49 M/sec - ScanRangesComplete: 299 (299) - ScannerThreadsInvoluntaryContextSwitches: 3.05K (3047) - ScannerThreadsTotalWallClockTime: 2m14s - MaterializeTupleTime(*): 3s031ms - ScannerThreadsSysTime: 967.849ms - ScannerThreadsUserTime: 7s613ms - ScannerThreadsVoluntaryContextSwitches: 103.49K (103494) - TotalRawHdfsReadTime(*): 790.316ms - TotalReadThroughput: 56.92 MB/sec Instance 8d463de3722df36f:a2dae93a0000001e (host=vd1314.halxg.cloudera.com:22000):(Total: 18s701ms, non-child: 6s735ms, % non-child: 36.01%) Hdfs split stats (:<# splits>/): 4:40/995.41 MB 0:39/963.32 MB 5:48/1.08 GB 3:44/1.10 GB 2:33/893.31 MB 6:34/836.60 MB 1:32/944.88 MB 7:35/772.51 MB MemoryUsage(500.000ms): 60.91 KB, 50.26 MB, 21.38 MB, 92.60 MB, 95.14 MB, 75.82 MB, 79.85 MB, 82.37 MB, 77.22 MB, 63.96 MB, 34.77 MB, 36.70 MB, 22.31 MB, 18.96 MB, 44.00 MB, 23.47 MB, 14.67 MB, 57.03 MB, 46.90 MB, 51.88 MB, 42.13 MB, 35.02 MB, 45.18 MB, 51.29 MB, 47.19 MB, 41.16 MB, 44.31 MB, 21.23 MB, 23.15 MB, 28.27 MB, 30.05 MB, 28.72 MB, 50.17 MB, 52.04 MB, 41.46 MB, 52.74 MB, 48.02 MB, 35.93 MB ThreadUsage(500.000ms): 5, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 5 - AverageThreadTokens: 7.84 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 96.44 MB (101122830) - PerHostPeakMemUsage: 6.78 GB (7284118788) - RowsProduced: 103.60M (103599261) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1s580ms - TotalStorageWaitTime: 36s630ms - TotalThreadsInvoluntaryContextSwitches: 5.25K (5247) - TotalThreadsTotalWallClockTime: 2m28s - TotalThreadsSysTime: 1s483ms - TotalThreadsUserTime: 24s180ms - TotalThreadsVoluntaryContextSwitches: 106.23K (106228) Fragment Instance Lifecycle Timings: - ExecTime: 18s621ms - ExecTreeExecTime: 490.555ms - OpenTime: 27.573ms - ExecTreeOpenTime: 377.271us - PrepareTime: 52.219ms - ExecTreePrepareTime: 3.156ms DataStreamSender (dst_id=27):(Total: 11s440ms, non-child: 11s440ms, % non-child: 100.00%) - BytesSent: 1.47 GB (1578742300) - NetworkThroughput(*): 354.31 MB/sec - OverallThroughput: 131.60 MB/sec - PeakMemoryUsage: 248.66 KB (254632) - RowsReturned: 103.60M (103599261) - SerializeBatchTime: 7s180ms - TransmitDataRPCTime: 4s249ms - UncompressedRowBatchSize: 2.03 GB (2176014813) CodeGen:(Total: 66.768ms, non-child: 66.768ms, % non-child: 100.00%) - CodegenTime: 329.308us - CompileTime: 9.670ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 14.335ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 41.500ms HDFS_SCAN_NODE (id=7):(Total: 459.265ms, non-child: 459.265ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:40/995.41 MB 0:39/963.32 MB 5:48/1.08 GB 3:44/1.10 GB 2:33/893.31 MB 6:34/836.60 MB 1:32/944.88 MB 7:35/772.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 305 out of 305 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:610 BytesRead(500.000ms): 0, 26.51 MB, 37.50 MB, 112.30 MB, 132.95 MB, 165.08 MB, 193.18 MB, 217.21 MB, 239.90 MB, 260.97 MB, 283.21 MB, 309.30 MB, 337.81 MB, 374.44 MB, 412.84 MB, 441.14 MB, 465.19 MB, 497.37 MB, 519.68 MB, 553.27 MB, 583.94 MB, 615.97 MB, 649.05 MB, 682.10 MB, 714.36 MB, 742.59 MB, 785.75 MB, 811.95 MB, 842.86 MB, 873.19 MB, 882.10 MB, 915.04 MB, 955.62 MB, 986.65 MB, 1011.98 MB, 1.03 GB, 1.06 GB, 1.09 GB - FooterProcessingTime: (Avg: 63.877ms ; Min: 1.142ms ; Max: 1s349ms ; Number of samples: 305) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.84 - BytesRead: 1.09 GB (1165803073) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.09 GB (1165803073) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.09 GB (1165803073) - DecompressionTime: 3s611ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 305 (305) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 96.22 MB (100891500) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 94.451ms - RowBatchQueuePutWaitTime: 1m23s - RowsRead: 103.60M (103599261) - RowsReturned: 103.60M (103599261) - RowsReturnedRate: 225.58 M/sec - ScanRangesComplete: 305 (305) - ScannerThreadsInvoluntaryContextSwitches: 3.18K (3183) - ScannerThreadsTotalWallClockTime: 2m9s - MaterializeTupleTime(*): 3s342ms - ScannerThreadsSysTime: 962.851ms - ScannerThreadsUserTime: 7s801ms - ScannerThreadsVoluntaryContextSwitches: 104.55K (104549) - TotalRawHdfsReadTime(*): 802.692ms - TotalReadThroughput: 58.52 MB/sec Averaged Fragment F08:(Total: 87.119ms, non-child: 8.504ms, % non-child: 9.76%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:179.108ms max:179.108ms mean: 179.108ms stddev:0.000ns execution rates: min:12.00 MB/sec max:12.00 MB/sec mean:12.00 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 619.56 MB (649660371) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 117.558us - TotalStorageWaitTime: 3.883ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 39.799ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.995ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 8.246ms - ExecTreeExecTime: 7.055ms - OpenTime: 26.008ms - ExecTreeOpenTime: 42.775us - PrepareTime: 52.790ms - ExecTreePrepareTime: 214.745us DataStreamSender (dst_id=28):(Total: 173.211us, non-child: 173.211us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 211.64 MB/sec - OverallThroughput: 113.46 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 18.983us - TransmitDataRPCTime: 92.864us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 70.839ms, non-child: 70.839ms, % non-child: 100.00%) - CodegenTime: 565.303us - CompileTime: 6.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 16.519ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 47.067ms HDFS_SCAN_NODE (id=8):(Total: 7.601ms, non-child: 7.601ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 102.335us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 817.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.585ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 48.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 6.757ms - MaterializeTupleTime(*): 1.632ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 555.975us - TotalReadThroughput: 0.00 /sec Fragment F08: Instance 8d463de3722df36f:a2dae93a00000025 (host=vd1316.halxg.cloudera.com:22000):(Total: 87.119ms, non-child: 8.504ms, % non-child: 9.76%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 619.56 MB (649660371) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 117.558us - TotalStorageWaitTime: 3.883ms - TotalThreadsInvoluntaryContextSwitches: 23 (23) - TotalThreadsTotalWallClockTime: 39.799ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 25.995ms - TotalThreadsVoluntaryContextSwitches: 46 (46) Fragment Instance Lifecycle Timings: - ExecTime: 8.246ms - ExecTreeExecTime: 7.055ms - OpenTime: 26.008ms - ExecTreeOpenTime: 42.775us - PrepareTime: 52.790ms - ExecTreePrepareTime: 214.745us DataStreamSender (dst_id=28):(Total: 173.211us, non-child: 173.211us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 211.64 MB/sec - OverallThroughput: 113.46 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 18.983us - TransmitDataRPCTime: 92.864us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 70.839ms, non-child: 70.839ms, % non-child: 100.00%) - CodegenTime: 565.303us - CompileTime: 6.709ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 16.519ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 47.067ms HDFS_SCAN_NODE (id=8):(Total: 7.601ms, non-child: 7.601ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.600ms ; Min: 1.600ms ; Max: 1.600ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 102.335us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 817.16 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.585ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 48.15 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 6 (6) - ScannerThreadsTotalWallClockTime: 6.757ms - MaterializeTupleTime(*): 1.632ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 555.975us - TotalReadThroughput: 0.00 /sec Averaged Fragment F13:(Total: 46.887ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:19m45s max:19m46s mean: 19m46s stddev:5.353ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m15s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 46.681ms - ExecTreePrepareTime: 2.971ms DataStreamSender (dst_id=37):(Total: 43.019us, non-child: 43.019us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 118.567ms, non-child: 118.567ms, % non-child: 100.00%) - CodegenTime: 3.480ms - CompileTime: 22.271ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 59.287ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 35.877ms AGGREGATION_NODE (id=35):(Total: 2.970ms, non-child: 0.000ns, % non-child: 0.00%) - BufferPoolAllocTime: 939.219ms - BufferPoolAllocationBytes: 6.75 GB (7248955684) - BufferPoolAllocations: 3.46K (3456) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7213304100) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7213304100) - BufferPoolWriteIoBytes: 6.72 GB (7213304100) - BufferPoolWriteIoOps: 3.44K (3439) - BufferPoolWriteIoWaitTime: 1m52s - BuildTime: 2m26s - GetResultsTime: 0.000ns - HTResizeTime: 8.213ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 17m18s, non-child: 17m18s, % non-child: 100.00%) - BytesReceived: 3.45 GB (3709178169) - ConvertRowBatchTime: 2s987ms - DeserializeRowBatchTimer: 38s429ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.54M (126542605) - RowsReturnedRate: 121.92 K/sec - SendersBlockedTimer: 30s816ms - SendersBlockedTotalTimer(*): 2m23s Fragment F13: Instance 8d463de3722df36f:a2dae93a00000050 (host=vd1311.halxg.cloudera.com:22000):(Total: 53.914ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.91 MB, 35.48 MB, 34.96 MB, 37.24 MB, 39.62 MB, 37.96 MB, 41.19 MB, 34.49 MB, 34.60 MB, 34.76 MB, 38.76 MB, 39.78 MB, 35.02 MB, 34.34 MB, 34.55 MB, 39.02 MB, 35.34 MB, 34.11 MB, 34.64 MB, 34.21 MB, 34.40 MB, 34.27 MB, 35.53 MB, 34.11 MB, 34.42 MB, 34.95 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m18s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 53.501ms - ExecTreePrepareTime: 3.292ms DataStreamSender (dst_id=37):(Total: 44.436us, non-child: 44.436us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 108.049ms, non-child: 108.049ms, % non-child: 100.00%) - CodegenTime: 3.132ms - CompileTime: 22.843ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 49.150ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 35.369ms AGGREGATION_NODE (id=35):(Total: 3.291ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 730.171ms - BufferPoolAllocationBytes: 6.75 GB (7249854464) - BufferPoolAllocations: 3.46K (3457) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolWriteIoBytes: 6.72 GB (7214202880) - BufferPoolWriteIoOps: 3.44K (3440) - BufferPoolWriteIoWaitTime: 1m54s - BuildTime: 2m22s - GetResultsTime: 0.000ns - HTResizeTime: 8.656ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 17m21s, non-child: 7s196ms, % non-child: 0.69%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 475.86 KB, 20.32 MB, 93.28 MB, 305.00 MB, 506.52 MB, 687.23 MB, 855.12 MB, 962.11 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.49 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.11 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.69 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.22 GB, 3.37 GB - BytesReceived: 3.45 GB (3708046018) - ConvertRowBatchTime: 2s873ms - DeserializeRowBatchTimer: 27s428ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.51M (126505008) - RowsReturnedRate: 121.43 K/sec - SendersBlockedTimer: 27s727ms - SendersBlockedTotalTimer(*): 2m12s Instance 8d463de3722df36f:a2dae93a0000004f (host=vd1309.halxg.cloudera.com:22000):(Total: 52.294ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.76 MB, 43.05 MB, 37.95 MB, 40.86 MB, 38.40 MB, 36.50 MB, 41.56 MB, 38.31 MB, 38.56 MB, 34.45 MB, 34.44 MB, 36.32 MB, 36.64 MB, 34.20 MB, 35.15 MB, 35.09 MB, 34.13 MB, 34.52 MB, 36.87 MB, 34.18 MB, 34.97 MB, 34.49 MB, 35.25 MB, 34.33 MB, 36.25 MB, 34.64 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 16m13s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.233ms - ExecTreePrepareTime: 2.374ms DataStreamSender (dst_id=37):(Total: 35.424us, non-child: 35.424us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 153.908ms, non-child: 153.908ms, % non-child: 100.00%) - CodegenTime: 4.306ms - CompileTime: 29.050ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 79.984ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 41.283ms AGGREGATION_NODE (id=35):(Total: 2.372ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s362ms - BufferPoolAllocationBytes: 6.75 GB (7247757312) - BufferPoolAllocations: 3.46K (3456) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7212105728) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7212105728) - BufferPoolWriteIoBytes: 6.72 GB (7212105728) - BufferPoolWriteIoOps: 3.44K (3439) - BufferPoolWriteIoWaitTime: 2m35s - BuildTime: 3m28s - GetResultsTime: 0.000ns - HTResizeTime: 6.821ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 16m16s, non-child: 17s544ms, % non-child: 1.80%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 464.10 KB, 20.29 MB, 93.11 MB, 304.87 MB, 506.53 MB, 687.27 MB, 855.32 MB, 962.35 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.49 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.11 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.69 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.22 GB, 3.37 GB - BytesReceived: 3.45 GB (3709460677) - ConvertRowBatchTime: 2s944ms - DeserializeRowBatchTimer: 1m33s - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.55M (126552076) - RowsReturnedRate: 129.57 K/sec - SendersBlockedTimer: 46s068ms - SendersBlockedTotalTimer(*): 3m55s Instance 8d463de3722df36f:a2dae93a0000004a (host=vd1314.halxg.cloudera.com:22000):(Total: 52.219ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.66 MB, 38.17 MB, 45.79 MB, 34.93 MB, 35.07 MB, 35.26 MB, 36.65 MB, 34.73 MB, 35.15 MB, 34.11 MB, 35.27 MB, 36.02 MB, 34.70 MB, 34.13 MB, 34.11 MB, 35.76 MB, 34.36 MB, 34.10 MB, 34.34 MB, 34.14 MB, 36.96 MB, 34.45 MB, 34.27 MB, 34.11 MB, 34.17 MB, 34.41 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m38s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 52.133ms - ExecTreePrepareTime: 1.707ms DataStreamSender (dst_id=37):(Total: 35.064us, non-child: 35.064us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 120.162ms, non-child: 120.162ms, % non-child: 100.00%) - CodegenTime: 5.581ms - CompileTime: 17.495ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 56.351ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 44.796ms AGGREGATION_NODE (id=35):(Total: 1.706ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 860.688ms - BufferPoolAllocationBytes: 6.75 GB (7247757312) - BufferPoolAllocations: 3.46K (3456) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7212105728) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7212105728) - BufferPoolWriteIoBytes: 6.72 GB (7212105728) - BufferPoolWriteIoOps: 3.44K (3439) - BufferPoolWriteIoWaitTime: 1m32s - BuildTime: 2m3s - GetResultsTime: 0.000ns - HTResizeTime: 10.114ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 17m41s, non-child: 7s968ms, % non-child: 0.75%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 355.69 KB, 20.11 MB, 91.55 MB, 302.52 MB, 504.54 MB, 685.17 MB, 853.89 MB, 960.36 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.48 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.10 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.68 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.21 GB, 3.37 GB - BytesReceived: 3.45 GB (3708748225) - ConvertRowBatchTime: 3s020ms - DeserializeRowBatchTimer: 29s255ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.53M (126527968) - RowsReturnedRate: 119.18 K/sec - SendersBlockedTimer: 18s141ms - SendersBlockedTotalTimer(*): 1m27s Instance 8d463de3722df36f:a2dae93a0000004b (host=vd1313.halxg.cloudera.com:22000):(Total: 45.059ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.62 MB, 45.68 MB, 36.95 MB, 37.58 MB, 38.19 MB, 42.33 MB, 43.17 MB, 37.55 MB, 36.51 MB, 34.21 MB, 34.46 MB, 34.70 MB, 34.30 MB, 35.05 MB, 34.43 MB, 36.15 MB, 34.87 MB, 34.55 MB, 34.19 MB, 34.33 MB, 36.47 MB, 34.38 MB, 35.59 MB, 34.12 MB, 34.18 MB, 34.15 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 16m55s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 45.013ms - ExecTreePrepareTime: 5.787ms DataStreamSender (dst_id=37):(Total: 108.904us, non-child: 108.904us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 111.139ms, non-child: 111.139ms, % non-child: 100.00%) - CodegenTime: 2.810ms - CompileTime: 23.080ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 56.032ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 31.497ms AGGREGATION_NODE (id=35):(Total: 5.786ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 787.952ms - BufferPoolAllocationBytes: 6.75 GB (7247757312) - BufferPoolAllocations: 3.46K (3456) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7212105728) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7212105728) - BufferPoolWriteIoBytes: 6.72 GB (7212105728) - BufferPoolWriteIoOps: 3.44K (3439) - BufferPoolWriteIoWaitTime: 2m12s - BuildTime: 2m45s - GetResultsTime: 0.000ns - HTResizeTime: 6.909ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 16m59s, non-child: 8s407ms, % non-child: 0.82%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 412.32 KB, 20.18 MB, 92.28 MB, 303.67 MB, 505.56 MB, 686.20 MB, 854.45 MB, 961.26 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.49 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.10 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.68 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.21 GB, 3.37 GB - BytesReceived: 3.45 GB (3709260187) - ConvertRowBatchTime: 3s033ms - DeserializeRowBatchTimer: 32s255ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.54M (126544614) - RowsReturnedRate: 124.11 K/sec - SendersBlockedTimer: 44s862ms - SendersBlockedTotalTimer(*): 3m44s Instance 8d463de3722df36f:a2dae93a0000004c (host=vd1310.halxg.cloudera.com:22000):(Total: 42.222ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.71 MB, 38.96 MB, 34.44 MB, 39.72 MB, 36.00 MB, 38.04 MB, 36.45 MB, 36.10 MB, 36.58 MB, 34.21 MB, 35.84 MB, 34.96 MB, 34.13 MB, 34.81 MB, 35.43 MB, 34.56 MB, 34.33 MB, 34.20 MB, 35.29 MB, 45.23 MB, 35.09 MB, 34.25 MB, 35.04 MB, 34.23 MB, 34.36 MB, 34.11 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m11s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 42.134ms - ExecTreePrepareTime: 3.996ms DataStreamSender (dst_id=37):(Total: 28.566us, non-child: 28.566us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 103.661ms, non-child: 103.661ms, % non-child: 100.00%) - CodegenTime: 2.692ms - CompileTime: 17.298ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 53.008ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 32.795ms AGGREGATION_NODE (id=35):(Total: 3.995ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 1s065ms - BufferPoolAllocationBytes: 6.75 GB (7249854464) - BufferPoolAllocations: 3.46K (3457) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolWriteIoBytes: 6.72 GB (7214202880) - BufferPoolWriteIoOps: 3.44K (3440) - BufferPoolWriteIoWaitTime: 1m58s - BuildTime: 2m30s - GetResultsTime: 0.000ns - HTResizeTime: 7.665ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 17m14s, non-child: 8s200ms, % non-child: 0.79%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 469.69 KB, 20.30 MB, 93.18 MB, 304.86 MB, 506.42 MB, 687.33 MB, 855.28 MB, 962.28 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.49 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.11 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.69 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.22 GB, 3.37 GB - BytesReceived: 3.45 GB (3709508809) - ConvertRowBatchTime: 3s020ms - DeserializeRowBatchTimer: 29s762ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.56M (126555233) - RowsReturnedRate: 122.30 K/sec - SendersBlockedTimer: 28s347ms - SendersBlockedTotalTimer(*): 1m49s Instance 8d463de3722df36f:a2dae93a0000004e (host=vd1312.halxg.cloudera.com:22000):(Total: 41.577ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.11 MB, 39.49 MB, 35.72 MB, 36.48 MB, 34.98 MB, 34.85 MB, 34.12 MB, 34.14 MB, 34.11 MB, 34.19 MB, 35.37 MB, 34.10 MB, 34.11 MB, 35.05 MB, 36.27 MB, 34.13 MB, 34.29 MB, 34.41 MB, 34.10 MB, 35.88 MB, 36.25 MB, 34.11 MB, 34.12 MB, 34.35 MB, 34.22 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 18m7s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 40.877ms - ExecTreePrepareTime: 1.915ms DataStreamSender (dst_id=37):(Total: 17.332us, non-child: 17.332us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 120.423ms, non-child: 120.423ms, % non-child: 100.00%) - CodegenTime: 2.716ms - CompileTime: 20.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 64.944ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 34.618ms AGGREGATION_NODE (id=35):(Total: 1.914ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 840.637ms - BufferPoolAllocationBytes: 6.75 GB (7249854464) - BufferPoolAllocations: 3.46K (3457) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolWriteIoBytes: 6.72 GB (7214202880) - BufferPoolWriteIoOps: 3.44K (3440) - BufferPoolWriteIoWaitTime: 1m2s - BuildTime: 1m33s - GetResultsTime: 0.000ns - HTResizeTime: 8.897ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 18m11s, non-child: 7s320ms, % non-child: 0.67%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 415.23 KB, 20.24 MB, 92.30 MB, 303.73 MB, 505.54 MB, 686.19 MB, 854.53 MB, 961.36 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.49 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.10 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.69 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.21 GB, 3.37 GB - BytesReceived: 3.45 GB (3709570670) - ConvertRowBatchTime: 3s010ms - DeserializeRowBatchTimer: 29s442ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.55M (126553798) - RowsReturnedRate: 115.98 K/sec - SendersBlockedTimer: 11s561ms - SendersBlockedTotalTimer(*): 1m10s Instance 8d463de3722df36f:a2dae93a0000004d (host=vd1316.halxg.cloudera.com:22000):(Total: 40.921ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(32s000ms): 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.06 MB, 34.10 MB, 35.44 MB, 39.28 MB, 35.28 MB, 34.57 MB, 38.85 MB, 35.43 MB, 34.61 MB, 34.09 MB, 35.55 MB, 37.85 MB, 34.49 MB, 34.40 MB, 39.94 MB, 37.75 MB, 46.43 MB, 35.67 MB, 34.93 MB, 34.49 MB, 35.14 MB, 34.64 MB, 34.14 MB, 34.10 MB, 34.13 MB, 34.23 MB ThreadUsage(32s000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 56.33 MB (59064619) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 17m23s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 40.873ms - ExecTreePrepareTime: 1.725ms DataStreamSender (dst_id=37):(Total: 31.412us, non-child: 31.412us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 15.70 KB (16072) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 112.628ms, non-child: 112.628ms, % non-child: 100.00%) - CodegenTime: 3.121ms - CompileTime: 25.781ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 48 (48) - NumInstructions: 917 (917) - OptimizationTime: 55.536ms - PeakMemoryUsage: 458.50 KB (469504) - PrepareTime: 30.781ms AGGREGATION_NODE (id=35):(Total: 1.724ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled, Spilled - BufferPoolAllocTime: 926.820ms - BufferPoolAllocationBytes: 6.75 GB (7249854464) - BufferPoolAllocations: 3.46K (3457) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 6.72 GB (7214202880) - BufferPoolWriteIoBytes: 6.72 GB (7214202880) - BufferPoolWriteIoOps: 3.44K (3440) - BufferPoolWriteIoWaitTime: 1m48s - BuildTime: 2m17s - GetResultsTime: 0.000ns - HTResizeTime: 8.429ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.10 MB (35757084) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 16 (16) EXCHANGE_NODE (id=34):(Total: 17m27s, non-child: 7s154ms, % non-child: 0.68%) BytesReceived(32s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 485.25 KB, 20.35 MB, 93.41 MB, 305.22 MB, 506.78 MB, 687.48 MB, 855.26 MB, 962.37 MB, 1.12 GB, 1.24 GB, 1.27 GB, 1.49 GB, 1.70 GB, 1.79 GB, 1.90 GB, 2.11 GB, 2.28 GB, 2.36 GB, 2.46 GB, 2.55 GB, 2.69 GB, 2.91 GB, 3.06 GB, 3.13 GB, 3.22 GB, 3.37 GB - BytesReceived: 3.45 GB (3709652601) - ConvertRowBatchTime: 3s010ms - DeserializeRowBatchTimer: 27s742ms - FirstBatchArrivalWaitTime: 6m21s - PeakMemoryUsage: 0 - RowsReturned: 126.56M (126559538) - RowsReturnedRate: 120.86 K/sec - SendersBlockedTimer: 39s008ms - SendersBlockedTotalTimer(*): 2m26s Averaged Fragment F10:(Total: 6m47s, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 138.60 GB, max: 139.04 GB, avg: 138.85 GB, stddev: 138.35 MB completion times: min:19m45s max:19m45s mean: 19m45s stddev:12.729ms execution rates: min:119.67 MB/sec max:120.05 MB/sec mean:119.89 MB/sec stddev:118.92 KB/sec num instances: 7 - AverageThreadTokens: 1.54 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.17 GB (4476221147) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 4.25 GB (4561169762) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 126.52M (126518386) - TotalNetworkReceiveTime: 2m49s - TotalNetworkSendTime: 3m31s - TotalStorageWaitTime: 1m52s - TotalThreadsInvoluntaryContextSwitches: 44.61K (44612) - TotalThreadsTotalWallClockTime: 17m30s - TotalThreadsSysTime: 43s067ms - TotalThreadsUserTime: 3m13s - TotalThreadsVoluntaryContextSwitches: 1.17M (1174059) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8m34s - OpenTime: 6m47s - ExecTreeOpenTime: 6m46s - PrepareTime: 69.431ms - ExecTreePrepareTime: 7.561ms DataStreamSender (dst_id=34):(Total: 28s709ms, non-child: 28s709ms, % non-child: 100.00%) - BytesSent: 3.45 GB (3708442416) - NetworkThroughput(*): 379.68 MB/sec - OverallThroughput: 123.08 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 126.52M (126518386) - SerializeBatchTime: 19s351ms - TransmitDataRPCTime: 9s307ms - UncompressedRowBatchSize: 7.19 GB (7719329101) CodeGen:(Total: 638.302ms, non-child: 638.302ms, % non-child: 100.00%) - CodegenTime: 4.415ms - CompileTime: 217.747ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 382.046ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 37.690ms AGGREGATION_NODE (id=17):(Total: 15m21s, non-child: 23s662ms, % non-child: 2.57%) - BufferPoolAllocTime: 2.938ms - BufferPoolAllocationBytes: 53.43 MB (56023917) - BufferPoolAllocations: 26 (26) - BufferPoolPeakReservation: 53.43 MB (56023917) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 53.43 MB (56023917) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 546.256ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 54.23 MB (56869367) - ReductionFactorEstimate: 4.76 - ReductionFactorThresholdToExpand: 1.74 - RowsPassedThrough: 126.52M (126518386) - RowsReturned: 126.52M (126518386) - RowsReturnedRate: 137.84 K/sec - StreamingTime: 23s204ms HASH_JOIN_NODE (id=16):(Total: 14m57s, non-child: 7s433ms, % non-child: 0.83%) - BufferPoolAllocTime: 1.613ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 15.412ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.93 MB (45013286) - ProbeRows: 126.93M (126933959) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s810ms - RowsReturned: 126.93M (126933959) - RowsReturnedRate: 142.03 K/sec Hash Join Builder (join_node_id=16): - BuildRowsPartitionTime: 11.158ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 576.956us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 17.726us, non-child: 17.726us, % non-child: 100.00%) - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.361us - DeserializeRowBatchTimer: 18.353us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 21.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 14m50s, non-child: 11m18s, % non-child: 76.25%) - BufferPoolAllocTime: 5s726ms - BufferPoolAllocationBytes: 77.49 GB (83209299090) - BufferPoolAllocations: 28.05K (28047) - BufferPoolPeakReservation: 4.08 GB (4384545645) - BufferPoolPeakUnpinnedBytes: 38.46 GB (41295319625) - BufferPoolPeakUsedReservation: 4.08 GB (4384545645) - BufferPoolReadIoBytes: 4.92 GB (5284523446) - BufferPoolReadIoOps: 2.52K (2519) - BufferPoolReadIoWaitTime: 6m52s - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - BufferPoolTotalUnpinnedBytes: 53.49 GB (57437997348) - BufferPoolWriteIoBytes: 51.81 GB (55635045814) - BufferPoolWriteIoOps: 26.53K (26528) - BufferPoolWriteIoWaitTime: 55s702ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m16s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.08 GB (4384890989) - ProbeRows: 409.36M (409358519) - ProbeRowsPartitioned: 215.20M (215195390) - ProbeTime: 1m6s - RowsReturned: 126.93M (126933959) - RowsReturnedRate: 143.22 K/sec Hash Join Builder (join_node_id=15): - BuildRowsPartitionTime: 2m34s - BuildRowsPartitioned: 1.98B (1980033455) - HashBuckets: 1.53B (1533916891) - HashCollisions: 7.68M (7676890) - HashTablesBuildTime: 6m6s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 57s370ms - SpilledPartitions: 59 (59) EXCHANGE_NODE (id=32):(Total: 3m22s, non-child: 3m22s, % non-child: 100.00%) - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 30s986ms - DeserializeRowBatchTimer: 59s590ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 7.14 M/sec - SendersBlockedTimer: 41s890ms - SendersBlockedTotalTimer(*): 4m4s HDFS_SCAN_NODE (id=12):(Total: 9s187ms, non-child: 9s187ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 0.76 - BytesRead: 4.46 GB (4791184935) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.46 GB (4791184935) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.46 GB (4791184935) - DecompressionTime: 13s308ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 143 (143) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 284.78 MB (298618689) - PerReadThreadRawHdfsThroughput: 101.83 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s223ms - RowBatchQueuePutWaitTime: 1m51s - RowsRead: 409.36M (409358519) - RowsReturned: 409.36M (409358519) - RowsReturnedRate: 53.68 M/sec - ScanRangesComplete: 722 (722) - ScannerThreadsInvoluntaryContextSwitches: 10.84K (10839) - ScannerThreadsTotalWallClockTime: 5m - MaterializeTupleTime(*): 48s571ms - ScannerThreadsSysTime: 16s987ms - ScannerThreadsUserTime: 54s719ms - ScannerThreadsVoluntaryContextSwitches: 585.50K (585498) - TotalRawHdfsReadTime(*): 51s631ms - TotalReadThroughput: 11.60 MB/sec Filter 2 (1.00 MB): - Files processed: 722 (722) - Files rejected: 578 (578) - Files total: 722 (722) - RowGroups processed: 399.83K (399833) - RowGroups rejected: 0 (0) - RowGroups total: 399.83K (399833) - Rows processed: 2.36M (2356955) - Rows rejected: 0 (0) - Rows total: 409.36M (409358519) - Splits processed: 143 (143) - Splits rejected: 0 (0) - Splits total: 143 (143) Fragment F10: Instance 8d463de3722df36f:a2dae93a00000043 (host=vd1314.halxg.cloudera.com:22000):(Total: 7m9s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:93/16.47 GB 2:86/17.03 GB 4:82/14.27 GB 5:90/17.79 GB 3:96/18.19 GB 1:90/17.02 GB 6:114/19.95 GB 0:103/18.08 GB Filter 2 arrival: 601ms MemoryUsage(32s000ms): 1.86 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.98 GB, 2.99 GB, 2.98 GB, 2.99 GB, 2.99 GB, 3.04 GB, 3.21 GB, 3.09 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 4.16 GB, 4.88 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 7, 4, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.88 GB (5236588544) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.88 GB (5238233743) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 130.79M (130794446) - TotalNetworkReceiveTime: 2m26s - TotalNetworkSendTime: 3m49s - TotalStorageWaitTime: 1m50s - TotalThreadsInvoluntaryContextSwitches: 41.75K (41752) - TotalThreadsTotalWallClockTime: 19m3s - TotalThreadsSysTime: 40s827ms - TotalThreadsUserTime: 3m10s - TotalThreadsVoluntaryContextSwitches: 998.43K (998432) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8m9s - OpenTime: 7m9s - ExecTreeOpenTime: 7m9s - PrepareTime: 73.937ms - ExecTreePrepareTime: 8.397ms DataStreamSender (dst_id=34):(Total: 29s902ms, non-child: 29s902ms, % non-child: 100.00%) - BytesSent: 3.57 GB (3833410102) - NetworkThroughput(*): 383.25 MB/sec - OverallThroughput: 122.26 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 130.79M (130794446) - SerializeBatchTime: 20s306ms - TransmitDataRPCTime: 9s538ms - UncompressedRowBatchSize: 7.43 GB (7980253008) CodeGen:(Total: 565.546ms, non-child: 565.546ms, % non-child: 100.00%) - CodegenTime: 3.409ms - CompileTime: 188.914ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 332.321ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 43.778ms AGGREGATION_NODE (id=17):(Total: 15m18s, non-child: 25s214ms, % non-child: 2.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 954.622us - BufferPoolAllocationBytes: 82.00 MB (85983232) - BufferPoolAllocations: 41 (41) - BufferPoolPeakReservation: 82.00 MB (85983232) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 82.00 MB (85983232) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 531.208ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 82.05 MB (86035584) - ReductionFactorEstimate: 1.24 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 130.79M (130794446) - RowsReturned: 130.79M (130794446) - RowsReturnedRate: 142.42 K/sec - StreamingTime: 24s750ms HASH_JOIN_NODE (id=16):(Total: 14m53s, non-child: 7s771ms, % non-child: 0.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.040ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 11.271ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.95 MB (45034265) - ProbeRows: 131.58M (131581583) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s958ms - RowsReturned: 131.58M (131581583) - RowsReturnedRate: 147.32 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.722ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 167.552us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 23.491us, non-child: 23.491us, % non-child: 100.00%) BytesReceived(32s000ms): 2.83 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 11.744us - DeserializeRowBatchTimer: 15.666us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 15.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 14m45s, non-child: 11m36s, % non-child: 78.65%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 5s696ms - BufferPoolAllocationBytes: 77.93 GB (83672170496) - BufferPoolAllocations: 27.96K (27960) - BufferPoolPeakReservation: 4.76 GB (5114953728) - BufferPoolPeakUnpinnedBytes: 38.38 GB (41204842496) - BufferPoolPeakUsedReservation: 4.76 GB (5114953728) - BufferPoolReadIoBytes: 4.82 GB (5175771136) - BufferPoolReadIoOps: 2.47K (2468) - BufferPoolReadIoWaitTime: 6m3s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 53.32 GB (57248055296) - BufferPoolWriteIoBytes: 51.63 GB (55442407424) - BufferPoolWriteIoOps: 26.44K (26437) - BufferPoolWriteIoWaitTime: 1m45s - BuildRows: 1.44B (1440033112) - BuildTime: 2m39s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.76 GB (5115023616) - ProbeRows: 407.24M (407241255) - ProbeRowsPartitioned: 216.38M (216375381) - ProbeTime: 1m21s - RowsReturned: 131.58M (131581583) - RowsReturnedRate: 148.62 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m55s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.58B (1577058304) - HashCollisions: 7.25M (7247156) - HashTablesBuildTime: 5m36s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m8s - SpilledPartitions: 58 (58) EXCHANGE_NODE (id=32):(Total: 2m59s, non-child: 58s665ms, % non-child: 32.66%) BytesReceived(32s000ms): 1.52 GB, 3.95 GB, 5.90 GB, 7.83 GB, 9.75 GB, 12.01 GB, 13.07 GB, 14.83 GB, 16.14 GB, 17.83 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s086ms - DeserializeRowBatchTimer: 59s185ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 8.02 M/sec - SendersBlockedTimer: 1m - SendersBlockedTotalTimer(*): 5m59s HDFS_SCAN_NODE (id=12):(Total: 9s399ms, non-child: 9s399ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:93/16.47 GB 2:86/17.03 GB 4:82/14.27 GB 5:90/17.79 GB 3:96/18.19 GB 1:90/17.02 GB 6:114/19.95 GB 0:103/18.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 149 out of 149 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:92.82% 1:2.97% 2:1.98% 3:1.733% 4:0.3713% 5:0.1238% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:605 PARQUET/SNAPPY:894 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 14.22 MB, 448.82 MB, 867.80 MB, 1.05 GB, 2.31 GB, 2.89 GB, 3.26 GB, 4.20 GB - FooterProcessingTime: (Avg: 220.342ms ; Min: 1.116ms ; Max: 3s742ms ; Number of samples: 149) - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 0.92 - BytesRead: 4.44 GB (4772602657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.44 GB (4772602657) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.44 GB (4772602657) - DecompressionTime: 13s051ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 149 (149) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 295.14 MB (309479762) - PerReadThreadRawHdfsThroughput: 85.69 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s360ms - RowBatchQueuePutWaitTime: 3m7s - RowsRead: 407.24M (407241255) - RowsReturned: 407.24M (407241255) - RowsReturnedRate: 43.33 M/sec - ScanRangesComplete: 754 (754) - ScannerThreadsInvoluntaryContextSwitches: 10.79K (10785) - ScannerThreadsTotalWallClockTime: 6m11s - MaterializeTupleTime(*): 49s375ms - ScannerThreadsSysTime: 15s505ms - ScannerThreadsUserTime: 51s441ms - ScannerThreadsVoluntaryContextSwitches: 397.38K (397376) - TotalRawHdfsReadTime(*): 53s118ms - TotalReadThroughput: 11.23 MB/sec Filter 2 (1.00 MB): - Files processed: 754 (754) - Files rejected: 605 (605) - Files total: 754 (754) - RowGroups processed: 397.77K (397770) - RowGroups rejected: 0 (0) - RowGroups total: 397.77K (397770) - Rows processed: 2.44M (2441216) - Rows rejected: 0 (0) - Rows total: 407.24M (407241255) - Splits processed: 149 (149) - Splits rejected: 0 (0) - Splits total: 149 (149) Instance 8d463de3722df36f:a2dae93a00000044 (host=vd1313.halxg.cloudera.com:22000):(Total: 7m5s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:78/16.03 GB 6:86/17.57 GB 3:97/19.20 GB 4:89/19.14 GB 7:79/15.00 GB 1:95/18.93 GB 5:81/15.75 GB 0:91/17.36 GB Filter 2 arrival: 745ms MemoryUsage(32s000ms): 1.88 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.98 GB, 3.00 GB, 2.99 GB, 3.02 GB, 3.21 GB, 3.12 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 7, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 2.98 GB (3200253952) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.28 GB (3522107697) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 139.62M (139616818) - TotalNetworkReceiveTime: 2m44s - TotalNetworkSendTime: 3m1s - TotalStorageWaitTime: 2m9s - TotalThreadsInvoluntaryContextSwitches: 45.82K (45822) - TotalThreadsTotalWallClockTime: 20m14s - TotalThreadsSysTime: 1m1s - TotalThreadsUserTime: 3m32s - TotalThreadsVoluntaryContextSwitches: 2.97M (2970086) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 7m36s - OpenTime: 7m5s - ExecTreeOpenTime: 7m4s - PrepareTime: 80.021ms - ExecTreePrepareTime: 5.158ms DataStreamSender (dst_id=34):(Total: 31s119ms, non-child: 31s119ms, % non-child: 100.00%) - BytesSent: 3.81 GB (4092938286) - NetworkThroughput(*): 382.55 MB/sec - OverallThroughput: 125.43 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 139.62M (139616818) - SerializeBatchTime: 20s858ms - TransmitDataRPCTime: 10s203ms - UncompressedRowBatchSize: 7.93 GB (8518506126) CodeGen:(Total: 700.704ms, non-child: 700.704ms, % non-child: 100.00%) - CodegenTime: 4.484ms - CompileTime: 225.059ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 423.185ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 51.043ms AGGREGATION_NODE (id=17):(Total: 14m40s, non-child: 24s604ms, % non-child: 2.79%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 864.421us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 602.964ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 34.05 MB (35708032) - ReductionFactorEstimate: 15.14 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 139.62M (139616818) - RowsReturned: 139.62M (139616818) - RowsReturnedRate: 158.53 K/sec - StreamingTime: 24s143ms HASH_JOIN_NODE (id=16):(Total: 14m16s, non-child: 7s732ms, % non-child: 0.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4.232ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 21.346ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.95 MB (45035253) - ProbeRows: 139.70M (139700148) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s990ms - RowsReturned: 139.70M (139700148) - RowsReturnedRate: 163.19 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 11.021ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 672.083us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 22.720us, non-child: 22.720us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 12.409us - DeserializeRowBatchTimer: 28.137us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 16.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 14m8s, non-child: 10m41s, % non-child: 75.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s399ms - BufferPoolAllocationBytes: 80.98 GB (86950019072) - BufferPoolAllocations: 29.14K (29142) - BufferPoolPeakReservation: 2.91 GB (3128950784) - BufferPoolPeakUnpinnedBytes: 38.62 GB (41473277952) - BufferPoolPeakUsedReservation: 2.91 GB (3128950784) - BufferPoolReadIoBytes: 5.04 GB (5412749312) - BufferPoolReadIoOps: 2.58K (2581) - BufferPoolReadIoWaitTime: 6m57s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 55.93 GB (60056141824) - BufferPoolWriteIoBytes: 53.39 GB (57327747072) - BufferPoolWriteIoOps: 27.34K (27336) - BufferPoolWriteIoWaitTime: 1m23s - BuildRows: 1.44B (1440033112) - BuildTime: 2m20s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.92 GB (3129972480) - ProbeRows: 413.93M (413925168) - ProbeRowsPartitioned: 232.84M (232838953) - ProbeTime: 1m29s - RowsReturned: 139.70M (139700148) - RowsReturnedRate: 164.67 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m40s - BuildRowsPartitioned: 2.07B (2070039871) - HashBuckets: 1.61B (1610612736) - HashCollisions: 8.75M (8745562) - HashTablesBuildTime: 6m44s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 7 (7) - PartitionsCreated: 128 (128) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 48s855ms - SpilledPartitions: 64 (64) EXCHANGE_NODE (id=32):(Total: 3m17s, non-child: 57s694ms, % non-child: 29.17%) BytesReceived(32s000ms): 1.53 GB, 3.96 GB, 5.91 GB, 7.84 GB, 9.76 GB, 12.02 GB, 13.07 GB, 14.84 GB, 16.15 GB, 17.84 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s413ms - DeserializeRowBatchTimer: 59s027ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 7.28 M/sec - SendersBlockedTimer: 42s976ms - SendersBlockedTotalTimer(*): 4m26s HDFS_SCAN_NODE (id=12):(Total: 9s315ms, non-child: 9s315ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:78/16.03 GB 6:86/17.57 GB 3:97/19.20 GB 4:89/19.14 GB 7:79/15.00 GB 1:95/18.93 GB 5:81/15.75 GB 0:91/17.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 140 out of 140 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:91.59% 1:4.207% 2:1.562% 3:1.683% 4:0.7212% 5:0.2404% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:556 PARQUET/SNAPPY:840 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 31.33 MB, 655.19 MB, 1.54 GB, 1.98 GB, 2.47 GB, 2.93 GB, 3.32 GB, 3.61 GB, 4.35 GB, 4.51 GB - FooterProcessingTime: (Avg: 213.114ms ; Min: 1.052ms ; Max: 4s717ms ; Number of samples: 140) - AverageHdfsReadThreadConcurrency: 0.16 - AverageScannerThreadConcurrency: 1.07 - BytesRead: 4.51 GB (4838169414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.51 GB (4838169414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.51 GB (4838169414) - DecompressionTime: 12s649ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 140 (140) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 297.82 MB (312288436) - PerReadThreadRawHdfsThroughput: 68.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8s428ms - RowBatchQueuePutWaitTime: 3m21s - RowsRead: 413.93M (413925168) - RowsReturned: 413.93M (413925168) - RowsReturnedRate: 44.43 M/sec - ScanRangesComplete: 696 (696) - ScannerThreadsInvoluntaryContextSwitches: 14.46K (14465) - ScannerThreadsTotalWallClockTime: 7m26s - MaterializeTupleTime(*): 47s007ms - ScannerThreadsSysTime: 36s742ms - ScannerThreadsUserTime: 1m11s - ScannerThreadsVoluntaryContextSwitches: 2.37M (2365143) - TotalRawHdfsReadTime(*): 1m7s - TotalReadThroughput: 11.06 MB/sec Filter 2 (1.00 MB): - Files processed: 696 (696) - Files rejected: 556 (556) - Files total: 696 (696) - RowGroups processed: 404.29K (404291) - RowGroups rejected: 0 (0) - RowGroups total: 404.29K (404291) - Rows processed: 2.29M (2293760) - Rows rejected: 0 (0) - Rows total: 413.93M (413925168) - Splits processed: 140 (140) - Splits rejected: 0 (0) - Splits total: 140 (140) Instance 8d463de3722df36f:a2dae93a00000048 (host=vd1309.halxg.cloudera.com:22000):(Total: 6m57s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:99/19.62 GB 6:75/14.33 GB 3:95/16.68 GB 2:89/17.92 GB 7:94/18.83 GB 5:97/18.14 GB 0:81/14.92 GB 4:98/18.36 GB Filter 2 arrival: 852ms MemoryUsage(32s000ms): 1.89 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 3.01 GB, 3.10 GB, 3.08 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 4.85 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 6, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.58 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 5.51 GB (5911871488) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 5.51 GB (5913516687) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 100.09M (100093797) - TotalNetworkReceiveTime: 2m52s - TotalNetworkSendTime: 2m57s - TotalStorageWaitTime: 3m7s - TotalThreadsInvoluntaryContextSwitches: 62.33K (62333) - TotalThreadsTotalWallClockTime: 18m20s - TotalThreadsSysTime: 38s429ms - TotalThreadsUserTime: 3m8s - TotalThreadsVoluntaryContextSwitches: 746.39K (746391) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9m22s - OpenTime: 6m57s - ExecTreeOpenTime: 6m57s - PrepareTime: 85.456ms - ExecTreePrepareTime: 10.122ms DataStreamSender (dst_id=34):(Total: 23s196ms, non-child: 23s196ms, % non-child: 100.00%) - BytesSent: 2.73 GB (2933716970) - NetworkThroughput(*): 370.19 MB/sec - OverallThroughput: 120.61 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 100.09M (100093797) - SerializeBatchTime: 15s594ms - TransmitDataRPCTime: 7s557ms - UncompressedRowBatchSize: 5.69 GB (6107066316) CodeGen:(Total: 801.379ms, non-child: 801.379ms, % non-child: 100.00%) - CodegenTime: 6.388ms - CompileTime: 280.661ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 476.261ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 43.671ms AGGREGATION_NODE (id=17):(Total: 16m19s, non-child: 18s513ms, % non-child: 1.89%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 2.441ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 455.375ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 39.34 MB (41251525) - ReductionFactorEstimate: 9.27 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 100.09M (100093797) - RowsReturned: 100.09M (100093797) - RowsReturnedRate: 102.17 K/sec - StreamingTime: 18s163ms HASH_JOIN_NODE (id=16):(Total: 16m1s, non-child: 7s023ms, % non-child: 0.73%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 1.403ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 19.097ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.89 MB (44974654) - ProbeRows: 100.18M (100177007) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s236ms - RowsReturned: 100.18M (100177007) - RowsReturnedRate: 104.22 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 16.314ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 169.636us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 18.369us, non-child: 18.369us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.344us - DeserializeRowBatchTimer: 7.756us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 19.92 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 15m54s, non-child: 12m9s, % non-child: 76.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 9s685ms - BufferPoolAllocationBytes: 71.87 GB (77170999296) - BufferPoolAllocations: 26.64K (26638) - BufferPoolPeakReservation: 5.44 GB (5840568320) - BufferPoolPeakUnpinnedBytes: 38.47 GB (41305505792) - BufferPoolPeakUsedReservation: 5.44 GB (5840568320) - BufferPoolReadIoBytes: 4.21 GB (4525654016) - BufferPoolReadIoOps: 2.16K (2158) - BufferPoolReadIoWaitTime: 7m28s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 50.48 GB (54205087744) - BufferPoolWriteIoBytes: 47.87 GB (51401195520) - BufferPoolWriteIoOps: 24.51K (24510) - BufferPoolWriteIoWaitTime: 45s808ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m13s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 5.44 GB (5840646400) - ProbeRows: 409.59M (409586881) - ProbeRowsPartitioned: 179.20M (179200005) - ProbeTime: 1m5s - RowsReturned: 100.18M (100177007) - RowsReturnedRate: 104.99 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m28s - BuildRowsPartitioned: 1.89B (1890038639) - HashBuckets: 1.34B (1342177280) - HashCollisions: 5.81M (5811823) - HashTablesBuildTime: 7m16s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 5 (5) - PartitionsCreated: 96 (96) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m2s - SpilledPartitions: 48 (48) EXCHANGE_NODE (id=32):(Total: 3m24s, non-child: 58s775ms, % non-child: 28.71%) BytesReceived(32s000ms): 1.55 GB, 3.97 GB, 5.92 GB, 7.85 GB, 9.77 GB, 12.03 GB, 13.08 GB, 14.84 GB, 16.16 GB, 17.84 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 30s183ms - DeserializeRowBatchTimer: 1m7s - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 7.03 M/sec - SendersBlockedTimer: 49s032ms - SendersBlockedTotalTimer(*): 4m20s HDFS_SCAN_NODE (id=12):(Total: 20s076ms, non-child: 20s076ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:99/19.62 GB 6:75/14.33 GB 3:95/16.68 GB 2:89/17.92 GB 7:94/18.83 GB 5:97/18.14 GB 0:81/14.92 GB 4:98/18.36 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 147 out of 147 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:3.419% 2:4.64% 3:2.686% 4:0.3663% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:581 PARQUET/SNAPPY:882 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 29.82 MB, 517.72 MB, 1.21 GB, 1.96 GB, 2.30 GB, 2.84 GB, 3.48 GB, 3.60 GB, 4.14 GB - FooterProcessingTime: (Avg: 275.596ms ; Min: 814.950us ; Max: 3s526ms ; Number of samples: 147) - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 0.83 - BytesRead: 4.47 GB (4799560728) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.47 GB (4799560728) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.47 GB (4799560728) - DecompressionTime: 10s982ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 147 (147) - NumScannerThreadsStarted: 5 (5) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 244.11 MB (255965111) - PerReadThreadRawHdfsThroughput: 49.24 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19s005ms - RowBatchQueuePutWaitTime: 1m36s - RowsRead: 409.59M (409586881) - RowsReturned: 409.59M (409586881) - RowsReturnedRate: 20.40 M/sec - ScanRangesComplete: 728 (728) - ScannerThreadsInvoluntaryContextSwitches: 10.24K (10242) - ScannerThreadsTotalWallClockTime: 5m40s - MaterializeTupleTime(*): 40s105ms - ScannerThreadsSysTime: 10s483ms - ScannerThreadsUserTime: 45s007ms - ScannerThreadsVoluntaryContextSwitches: 147.25K (147251) - TotalRawHdfsReadTime(*): 1m32s - TotalReadThroughput: 11.14 MB/sec Filter 2 (1.00 MB): - Files processed: 728 (728) - Files rejected: 581 (581) - Files total: 728 (728) - RowGroups processed: 400.06K (400055) - RowGroups rejected: 0 (0) - RowGroups total: 400.06K (400055) - Rows processed: 2.41M (2408448) - Rows rejected: 0 (0) - Rows total: 409.59M (409586881) - Splits processed: 147 (147) - Splits rejected: 0 (0) - Splits total: 147 (147) Instance 8d463de3722df36f:a2dae93a00000049 (host=vd1311.halxg.cloudera.com:22000):(Total: 6m45s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:92/18.45 GB 5:84/15.18 GB 3:80/14.56 GB 4:95/19.16 GB 1:83/17.29 GB 2:88/17.78 GB 7:96/19.17 GB 6:86/17.45 GB Filter 2 arrival: 680ms MemoryUsage(32s000ms): 1.89 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 3.01 GB, 3.21 GB, 3.02 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 3.25 GB, 3.76 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 7, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.55 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.76 GB (4037017600) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.76 GB (4038662799) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 125.73M (125725943) - TotalNetworkReceiveTime: 2m52s - TotalNetworkSendTime: 3m15s - TotalStorageWaitTime: 1m39s - TotalThreadsInvoluntaryContextSwitches: 40.93K (40931) - TotalThreadsTotalWallClockTime: 17m37s - TotalThreadsSysTime: 41s894ms - TotalThreadsUserTime: 3m15s - TotalThreadsVoluntaryContextSwitches: 919.63K (919634) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 9m10s - OpenTime: 6m45s - ExecTreeOpenTime: 6m45s - PrepareTime: 65.887ms - ExecTreePrepareTime: 6.572ms DataStreamSender (dst_id=34):(Total: 28s072ms, non-child: 28s072ms, % non-child: 100.00%) - BytesSent: 3.43 GB (3685458732) - NetworkThroughput(*): 388.75 MB/sec - OverallThroughput: 125.20 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 125.73M (125725943) - SerializeBatchTime: 18s984ms - TransmitDataRPCTime: 9s041ms - UncompressedRowBatchSize: 7.14 GB (7670973726) CodeGen:(Total: 641.448ms, non-child: 641.448ms, % non-child: 100.00%) - CodegenTime: 4.070ms - CompileTime: 234.618ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 368.602ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 37.479ms AGGREGATION_NODE (id=17):(Total: 15m55s, non-child: 23s092ms, % non-child: 2.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 1.210ms - BufferPoolAllocationBytes: 38.00 MB (39845888) - BufferPoolAllocations: 19 (19) - BufferPoolPeakReservation: 38.00 MB (39845888) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 38.00 MB (39845888) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 556.470ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 38.05 MB (39898240) - ReductionFactorEstimate: 2.69 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 125.73M (125725943) - RowsReturned: 125.73M (125725943) - RowsReturnedRate: 131.55 K/sec - StreamingTime: 22s532ms HASH_JOIN_NODE (id=16):(Total: 15m32s, non-child: 7s397ms, % non-child: 0.79%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 810.579us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 14.177ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.92 MB (45008169) - ProbeRows: 125.96M (125959773) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s768ms - RowsReturned: 125.96M (125959773) - RowsReturnedRate: 135.06 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.834ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 384.350us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 17.784us, non-child: 17.784us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.765us - DeserializeRowBatchTimer: 35.826us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 20.58 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 15m25s, non-child: 11m52s, % non-child: 77.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s350ms - BufferPoolAllocationBytes: 77.47 GB (83187728384) - BufferPoolAllocations: 28.24K (28237) - BufferPoolPeakReservation: 3.69 GB (3961520128) - BufferPoolPeakUnpinnedBytes: 38.68 GB (41536192512) - BufferPoolPeakUsedReservation: 3.69 GB (3961520128) - BufferPoolReadIoBytes: 4.92 GB (5282725888) - BufferPoolReadIoOps: 2.52K (2519) - BufferPoolReadIoWaitTime: 7m12s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 54.12 GB (58107887616) - BufferPoolWriteIoBytes: 52.84 GB (56736350208) - BufferPoolWriteIoOps: 27.05K (27054) - BufferPoolWriteIoWaitTime: 44s408ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m13s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 3.69 GB (3961598208) - ProbeRows: 414.98M (414978745) - ProbeRowsPartitioned: 220.48M (220476804) - ProbeTime: 1m10s - RowsReturned: 125.96M (125959773) - RowsReturnedRate: 136.14 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m33s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.51B (1509949440) - HashCollisions: 7.30M (7298482) - HashTablesBuildTime: 6m7s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 52s882ms - SpilledPartitions: 62 (62) EXCHANGE_NODE (id=32):(Total: 3m25s, non-child: 57s852ms, % non-child: 28.13%) BytesReceived(32s000ms): 1.55 GB, 3.97 GB, 5.92 GB, 7.85 GB, 9.77 GB, 12.04 GB, 13.08 GB, 14.84 GB, 16.16 GB, 17.84 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 30s691ms - DeserializeRowBatchTimer: 59s993ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 7.00 M/sec - SendersBlockedTimer: 41s340ms - SendersBlockedTotalTimer(*): 4m HDFS_SCAN_NODE (id=12):(Total: 7s105ms, non-child: 7s105ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:92/18.45 GB 5:84/15.18 GB 3:80/14.56 GB 4:95/19.16 GB 1:83/17.29 GB 2:88/17.78 GB 7:96/19.17 GB 6:86/17.45 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:94.04% 1:3.046% 2:1.904% 3:0.5076% 4:0.5076% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:563 PARQUET/SNAPPY:846 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 23.01 MB, 650.45 MB, 1.69 GB, 3.12 GB, 3.52 GB, 3.52 GB, 3.83 GB - FooterProcessingTime: (Avg: 199.577ms ; Min: 1.047ms ; Max: 5s237ms ; Number of samples: 141) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 0.78 - BytesRead: 4.52 GB (4852300925) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.52 GB (4852300925) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.52 GB (4852300925) - DecompressionTime: 14s378ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 141 (141) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 293.39 MB (307643968) - PerReadThreadRawHdfsThroughput: 109.86 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6s099ms - RowBatchQueuePutWaitTime: 2m14s - RowsRead: 414.98M (414978745) - RowsReturned: 414.98M (414978745) - RowsReturnedRate: 58.40 M/sec - ScanRangesComplete: 704 (704) - ScannerThreadsInvoluntaryContextSwitches: 10.61K (10612) - ScannerThreadsTotalWallClockTime: 5m9s - MaterializeTupleTime(*): 51s849ms - ScannerThreadsSysTime: 15s173ms - ScannerThreadsUserTime: 55s263ms - ScannerThreadsVoluntaryContextSwitches: 337.51K (337513) - TotalRawHdfsReadTime(*): 42s120ms - TotalReadThroughput: 11.73 MB/sec Filter 2 (1.00 MB): - Files processed: 704 (704) - Files rejected: 563 (563) - Files total: 704 (704) - RowGroups processed: 405.32K (405323) - RowGroups rejected: 0 (0) - RowGroups total: 405.32K (405323) - Rows processed: 2.31M (2310144) - Rows rejected: 0 (0) - Rows total: 414.98M (414978745) - Splits processed: 141 (141) - Splits rejected: 0 (0) - Splits total: 141 (141) Instance 8d463de3722df36f:a2dae93a00000045 (host=vd1310.halxg.cloudera.com:22000):(Total: 6m41s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:90/17.76 GB 6:87/17.02 GB 4:95/17.75 GB 5:80/15.17 GB 2:88/16.63 GB 0:92/17.62 GB 1:102/19.84 GB 7:91/17.03 GB Filter 2 arrival: 606ms MemoryUsage(32s000ms): 1.89 GB, 2.98 GB, 2.98 GB, 2.99 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 3.04 GB, 3.16 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 3.15 GB, 4.17 GB, 4.17 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 7, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.17 GB (4477419520) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.17 GB (4479064719) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 135.64M (135638178) - TotalNetworkReceiveTime: 2m59s - TotalNetworkSendTime: 3m16s - TotalStorageWaitTime: 1m41s - TotalThreadsInvoluntaryContextSwitches: 39.40K (39395) - TotalThreadsTotalWallClockTime: 16m36s - TotalThreadsSysTime: 37s510ms - TotalThreadsUserTime: 3m8s - TotalThreadsVoluntaryContextSwitches: 792.30K (792302) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8m51s - OpenTime: 6m41s - ExecTreeOpenTime: 6m41s - PrepareTime: 65.765ms - ExecTreePrepareTime: 8.323ms DataStreamSender (dst_id=34):(Total: 30s330ms, non-child: 30s330ms, % non-child: 100.00%) - BytesSent: 3.70 GB (3975633960) - NetworkThroughput(*): 380.10 MB/sec - OverallThroughput: 125.01 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 135.64M (135638178) - SerializeBatchTime: 20s306ms - TransmitDataRPCTime: 9s974ms - UncompressedRowBatchSize: 7.71 GB (8275768644) CodeGen:(Total: 563.256ms, non-child: 563.256ms, % non-child: 100.00%) - CodegenTime: 5.022ms - CompileTime: 183.568ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 350.292ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 28.620ms AGGREGATION_NODE (id=17):(Total: 15m33s, non-child: 25s047ms, % non-child: 2.68%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 1.327ms - BufferPoolAllocationBytes: 38.00 MB (39845888) - BufferPoolAllocations: 19 (19) - BufferPoolPeakReservation: 38.00 MB (39845888) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 38.00 MB (39845888) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 586.406ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 38.05 MB (39898240) - ReductionFactorEstimate: 2.47 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 135.64M (135638178) - RowsReturned: 135.64M (135638178) - RowsReturnedRate: 145.36 K/sec - StreamingTime: 24s597ms HASH_JOIN_NODE (id=16):(Total: 15m8s, non-child: 6s900ms, % non-child: 0.76%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 826.977us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 12.628ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.93 MB (45019444) - ProbeRows: 135.88M (135884463) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s924ms - RowsReturned: 135.88M (135884463) - RowsReturnedRate: 149.64 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.191ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.525ms - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 15.796us, non-child: 15.796us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 9.184us - DeserializeRowBatchTimer: 12.823us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 23.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 15m1s, non-child: 11m21s, % non-child: 75.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 5s263ms - BufferPoolAllocationBytes: 78.28 GB (84049657856) - BufferPoolAllocations: 27.89K (27886) - BufferPoolPeakReservation: 4.10 GB (4401922048) - BufferPoolPeakUnpinnedBytes: 38.21 GB (41026584576) - BufferPoolPeakUsedReservation: 4.10 GB (4401922048) - BufferPoolReadIoBytes: 4.78 GB (5131730944) - BufferPoolReadIoOps: 2.45K (2447) - BufferPoolReadIoWaitTime: 7m17s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 53.39 GB (57329844224) - BufferPoolWriteIoBytes: 52.39 GB (56254005248) - BufferPoolWriteIoOps: 26.82K (26824) - BufferPoolWriteIoWaitTime: 37s544ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m5s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.10 GB (4402000128) - ProbeRows: 402.70M (402701541) - ProbeRowsPartitioned: 220.19M (220194563) - ProbeTime: 1m - RowsReturned: 135.88M (135884463) - RowsReturnedRate: 150.78 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m25s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.61B (1610612736) - HashCollisions: 8.66M (8663020) - HashTablesBuildTime: 6m2s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 53s220ms - SpilledPartitions: 60 (60) EXCHANGE_NODE (id=32):(Total: 3m33s, non-child: 58s364ms, % non-child: 27.38%) BytesReceived(32s000ms): 1.55 GB, 3.97 GB, 5.92 GB, 7.85 GB, 9.77 GB, 12.04 GB, 13.08 GB, 14.84 GB, 16.16 GB, 17.84 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s526ms - DeserializeRowBatchTimer: 57s200ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 6.76 M/sec - SendersBlockedTimer: 26s828ms - SendersBlockedTotalTimer(*): 2m38s HDFS_SCAN_NODE (id=12):(Total: 6s733ms, non-child: 6s733ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:90/17.76 GB 6:87/17.02 GB 4:95/17.75 GB 5:80/15.17 GB 2:88/16.63 GB 0:92/17.62 GB 1:102/19.84 GB 7:91/17.03 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 143 out of 143 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:93.23% 1:3.255% 2:2.214% 3:1.172% 4:0.1302% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:582 PARQUET/SNAPPY:858 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 36.67 MB, 640.45 MB, 1.72 GB, 2.90 GB, 3.59 GB, 4.21 GB - FooterProcessingTime: (Avg: 160.937ms ; Min: 1.000ms ; Max: 2s010ms ; Number of samples: 143) - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 0.66 - BytesRead: 4.39 GB (4714235576) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.39 GB (4714235576) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.39 GB (4714235576) - DecompressionTime: 12s860ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 143 (143) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 293.20 MB (307447362) - PerReadThreadRawHdfsThroughput: 107.82 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5s874ms - RowBatchQueuePutWaitTime: 1m26s - RowsRead: 402.70M (402701541) - RowsReturned: 402.70M (402701541) - RowsReturnedRate: 59.81 M/sec - ScanRangesComplete: 725 (725) - ScannerThreadsInvoluntaryContextSwitches: 9.43K (9428) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 46s070ms - ScannerThreadsSysTime: 11s909ms - ScannerThreadsUserTime: 50s625ms - ScannerThreadsVoluntaryContextSwitches: 217.95K (217950) - TotalRawHdfsReadTime(*): 41s696ms - TotalReadThroughput: 11.68 MB/sec Filter 2 (1.00 MB): - Files processed: 725 (725) - Files rejected: 582 (582) - Files total: 725 (725) - RowGroups processed: 393.33K (393331) - RowGroups rejected: 0 (0) - RowGroups total: 393.33K (393331) - Rows processed: 2.34M (2342912) - Rows rejected: 0 (0) - Rows total: 402.70M (402701541) - Splits processed: 143 (143) - Splits rejected: 0 (0) - Splits total: 143 (143) Instance 8d463de3722df36f:a2dae93a00000046 (host=vd1316.halxg.cloudera.com:22000):(Total: 6m29s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:88/16.50 GB 5:78/15.13 GB 3:87/14.48 GB 0:107/21.52 GB 4:102/19.89 GB 1:89/15.86 GB 6:99/18.83 GB 2:92/16.71 GB Filter 2 arrival: 547ms MemoryUsage(32s000ms): 1.90 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.98 GB, 2.98 GB, 2.99 GB, 2.98 GB, 3.04 GB, 3.11 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 3.91 GB, 4.86 GB, 4.86 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.46 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 4.86 GB (5219811328) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 4.86 GB (5221456527) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 138.36M (138358575) - TotalNetworkReceiveTime: 2m57s - TotalNetworkSendTime: 4m - TotalStorageWaitTime: 1m10s - TotalThreadsInvoluntaryContextSwitches: 40.96K (40962) - TotalThreadsTotalWallClockTime: 15m31s - TotalThreadsSysTime: 39s814ms - TotalThreadsUserTime: 3m11s - TotalThreadsVoluntaryContextSwitches: 880.60K (880598) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8m17s - OpenTime: 6m29s - ExecTreeOpenTime: 6m28s - PrepareTime: 43.720ms - ExecTreePrepareTime: 3.803ms DataStreamSender (dst_id=34):(Total: 31s673ms, non-child: 31s673ms, % non-child: 100.00%) - BytesSent: 3.78 GB (4054945273) - NetworkThroughput(*): 377.51 MB/sec - OverallThroughput: 122.09 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 138.36M (138358575) - SerializeBatchTime: 21s374ms - TransmitDataRPCTime: 10s243ms - UncompressedRowBatchSize: 7.86 GB (8441737902) CodeGen:(Total: 515.164ms, non-child: 515.164ms, % non-child: 100.00%) - CodegenTime: 3.649ms - CompileTime: 165.482ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 325.783ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 23.241ms AGGREGATION_NODE (id=17):(Total: 14m46s, non-child: 27s058ms, % non-child: 3.05%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 7.309ms - BufferPoolAllocationBytes: 66.00 MB (69206016) - BufferPoolAllocations: 33 (33) - BufferPoolPeakReservation: 66.00 MB (69206016) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 66.00 MB (69206016) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 570.878ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 66.05 MB (69258368) - ReductionFactorEstimate: 1.28 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 138.36M (138358575) - RowsReturned: 138.36M (138358575) - RowsReturnedRate: 156.10 K/sec - StreamingTime: 26s552ms HASH_JOIN_NODE (id=16):(Total: 14m19s, non-child: 7s520ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 912.073us - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 11.242ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.95 MB (45034772) - ProbeRows: 139.05M (139046912) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s115ms - RowsReturned: 139.05M (139046912) - RowsReturnedRate: 161.82 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.835ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 123.353us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 15.417us, non-child: 15.417us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 7.484us - DeserializeRowBatchTimer: 11.521us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 23.74 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 14m11s, non-child: 10m37s, % non-child: 74.84%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 6s280ms - BufferPoolAllocationBytes: 78.85 GB (84664123392) - BufferPoolAllocations: 28.18K (28179) - BufferPoolPeakReservation: 4.76 GB (5114953728) - BufferPoolPeakUnpinnedBytes: 38.56 GB (41406169088) - BufferPoolPeakUsedReservation: 4.76 GB (5114953728) - BufferPoolReadIoBytes: 5.04 GB (5408555008) - BufferPoolReadIoOps: 2.58K (2579) - BufferPoolReadIoWaitTime: 6m21s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 53.53 GB (57474547712) - BufferPoolWriteIoBytes: 52.22 GB (56075747328) - BufferPoolWriteIoOps: 26.74K (26739) - BufferPoolWriteIoWaitTime: 43s625ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m8s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 4.76 GB (5115023616) - ProbeRows: 412.03M (412026788) - ProbeRowsPartitioned: 222.09M (222086685) - ProbeTime: 55s532ms - RowsReturned: 139.05M (139046912) - RowsReturnedRate: 163.25 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m27s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.61B (1610612736) - HashCollisions: 8.74M (8736897) - HashTablesBuildTime: 5m35s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 1m7s - SpilledPartitions: 58 (58) EXCHANGE_NODE (id=32):(Total: 3m29s, non-child: 56s642ms, % non-child: 26.99%) BytesReceived(32s000ms): 1.55 GB, 3.98 GB, 5.92 GB, 7.85 GB, 9.77 GB, 12.04 GB, 13.08 GB, 14.84 GB, 16.16 GB, 17.85 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 30s718ms - DeserializeRowBatchTimer: 56s487ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 6.86 M/sec - SendersBlockedTimer: 33s930ms - SendersBlockedTotalTimer(*): 3m18s HDFS_SCAN_NODE (id=12):(Total: 4s390ms, non-child: 4s390ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:88/16.50 GB 5:78/15.13 GB 3:87/14.48 GB 0:107/21.52 GB 4:102/19.89 GB 1:89/15.86 GB 6:99/18.83 GB 2:92/16.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 156 out of 156 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:95.34% 1:2.397% 2:1.731% 3:0.2663% 4:0.2663% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:586 PARQUET/SNAPPY:936 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 45.59 MB, 982.41 MB, 2.26 GB, 3.39 GB, 4.16 GB - FooterProcessingTime: (Avg: 139.666ms ; Min: 1.026ms ; Max: 3s588ms ; Number of samples: 156) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 0.54 - BytesRead: 4.50 GB (4827403243) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.50 GB (4827403243) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.50 GB (4827403243) - DecompressionTime: 13s872ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 156 (156) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 278.56 MB (292089845) - PerReadThreadRawHdfsThroughput: 170.36 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3s514ms - RowBatchQueuePutWaitTime: 58s772ms - RowsRead: 412.03M (412026788) - RowsReturned: 412.03M (412026788) - RowsReturnedRate: 93.85 M/sec - ScanRangesComplete: 742 (742) - ScannerThreadsInvoluntaryContextSwitches: 9.97K (9972) - ScannerThreadsTotalWallClockTime: 3m20s - MaterializeTupleTime(*): 49s677ms - ScannerThreadsSysTime: 13s765ms - ScannerThreadsUserTime: 54s812ms - ScannerThreadsVoluntaryContextSwitches: 298.55K (298545) - TotalRawHdfsReadTime(*): 27s023ms - TotalReadThroughput: 12.24 MB/sec Filter 2 (1.00 MB): - Files processed: 742 (742) - Files rejected: 586 (586) - Files total: 742 (742) - RowGroups processed: 402.45K (402449) - RowGroups rejected: 0 (0) - RowGroups total: 402.45K (402449) - Rows processed: 2.56M (2555904) - Rows rejected: 0 (0) - Rows total: 412.03M (412026788) - Splits processed: 156 (156) - Splits rejected: 0 (0) - Splits total: 156 (156) Instance 8d463de3722df36f:a2dae93a00000047 (host=vd1312.halxg.cloudera.com:22000):(Total: 6m21s, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:85/16.75 GB 5:88/17.43 GB 6:87/17.06 GB 3:93/17.64 GB 0:86/17.00 GB 7:92/18.97 GB 2:91/16.68 GB 1:84/17.06 GB Filter 2 arrival: 723ms MemoryUsage(32s000ms): 1.88 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 2.99 GB, 3.02 GB, 3.10 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 3.02 GB, 3.03 GB, 3.03 GB, 3.03 GB ThreadUsage(32s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 3, 5, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.45 - BloomFilterBytes: 1.00 MB (1048576) - BufferPoolPeakReservation: 3.03 GB (3250585600) - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 3.27 GB (3515146165) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 115.40M (115400951) - TotalNetworkReceiveTime: 2m51s - TotalNetworkSendTime: 4m16s - TotalStorageWaitTime: 1m27s - TotalThreadsInvoluntaryContextSwitches: 41.09K (41089) - TotalThreadsTotalWallClockTime: 15m7s - TotalThreadsSysTime: 41s371ms - TotalThreadsUserTime: 3m10s - TotalThreadsVoluntaryContextSwitches: 910.98K (910975) Fragment Instance Lifecycle Timings: - ExecTime: 0.000ns - ExecTreeExecTime: 8m35s - OpenTime: 6m21s - ExecTreeOpenTime: 6m20s - PrepareTime: 71.233ms - ExecTreePrepareTime: 10.555ms DataStreamSender (dst_id=34):(Total: 26s672ms, non-child: 26s672ms, % non-child: 100.00%) - BytesSent: 3.15 GB (3382993594) - NetworkThroughput(*): 375.44 MB/sec - OverallThroughput: 120.96 MB/sec - PeakMemoryUsage: 211.70 KB (216776) - RowsReturned: 115.40M (115400951) - SerializeBatchTime: 18s032ms - TransmitDataRPCTime: 8s593ms - UncompressedRowBatchSize: 6.56 GB (7040997990) CodeGen:(Total: 680.616ms, non-child: 680.616ms, % non-child: 100.00%) - CodegenTime: 3.885ms - CompileTime: 245.924ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 146 (146) - NumInstructions: 6.37K (6365) - OptimizationTime: 397.874ms - PeakMemoryUsage: 3.11 MB (3258880) - PrepareTime: 35.997ms AGGREGATION_NODE (id=17):(Total: 14m56s, non-child: 22s102ms, % non-child: 2.47%) ExecOption: Streaming Preaggregation, Codegen Enabled - BufferPoolAllocTime: 6.464ms - BufferPoolAllocationBytes: 82.00 MB (85983232) - BufferPoolAllocations: 41 (41) - BufferPoolPeakReservation: 82.00 MB (85983232) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 82.00 MB (85983232) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 520.492ms - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 82.05 MB (86035584) - ReductionFactorEstimate: 1.22 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 115.40M (115400951) - RowsReturned: 115.40M (115400951) - RowsReturnedRate: 128.78 K/sec - StreamingTime: 21s694ms HASH_JOIN_NODE (id=16):(Total: 14m33s, non-child: 7s690ms, % non-child: 0.88%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 2.067ms - BufferPoolAllocationBytes: 34.00 MB (35651584) - BufferPoolAllocations: 17 (17) - BufferPoolPeakReservation: 34.00 MB (35651584) - BufferPoolPeakUnpinnedBytes: 0 - BufferPoolPeakUsedReservation: 34.00 MB (35651584) - BufferPoolReadIoBytes: 0 - BufferPoolReadIoOps: 0 (0) - BufferPoolReadIoWaitTime: 0.000ns - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 0 - BufferPoolWriteIoBytes: 0 - BufferPoolWriteIoOps: 0 (0) - BufferPoolWriteIoWaitTime: 0.000ns - BuildRows: 366 (366) - BuildTime: 18.121ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 42.90 MB (44986451) - ProbeRows: 116.19M (116187830) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s678ms - RowsReturned: 116.19M (116187830) - RowsReturnedRate: 132.94 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 13.188ms - BuildRowsPartitioned: 366 (366) - HashBuckets: 768 (768) - HashCollisions: 0 (0) - HashTablesBuildTime: 996.701us - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 21.12 KB (21632) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=33):(Total: 10.508us, non-child: 10.508us, % non-child: 100.00%) BytesReceived(32s000ms): 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB, 2.88 KB - BytesReceived: 2.88 KB (2944) - ConvertRowBatchTime: 5.603us - DeserializeRowBatchTimer: 16.742us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 34.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=15):(Total: 14m26s, non-child: 10m54s, % non-child: 75.51%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BufferPoolAllocTime: 4s409ms - BufferPoolAllocationBytes: 77.09 GB (82770395136) - BufferPoolAllocations: 28.29K (28292) - BufferPoolPeakReservation: 2.91 GB (3128950784) - BufferPoolPeakUnpinnedBytes: 38.29 GB (41114664960) - BufferPoolPeakUsedReservation: 2.91 GB (3128950784) - BufferPoolReadIoBytes: 5.64 GB (6054477824) - BufferPoolReadIoOps: 2.89K (2887) - BufferPoolReadIoWaitTime: 6m44s - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - BufferPoolTotalUnpinnedBytes: 53.69 GB (57644417024) - BufferPoolWriteIoBytes: 52.35 GB (56207867904) - BufferPoolWriteIoOps: 26.80K (26802) - BufferPoolWriteIoWaitTime: 29s360ms - BuildRows: 1.44B (1440033112) - BuildTime: 2m13s - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 2.92 GB (3129972480) - ProbeRows: 405.05M (405049258) - ProbeRowsPartitioned: 215.20M (215195344) - ProbeTime: 45s171ms - RowsReturned: 116.19M (116187830) - RowsReturnedRate: 134.12 K/sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled, Spilled - BuildRowsPartitionTime: 2m30s - BuildRowsPartitioned: 1.98B (1980031135) - HashBuckets: 1.48B (1476395008) - HashCollisions: 7.24M (7235296) - HashTablesBuildTime: 5m23s - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 6 (6) - PartitionsCreated: 112 (112) - PeakMemoryUsage: 38.12 KB (39040) - RepartitionTime: 48s229ms - SpilledPartitions: 64 (64) EXCHANGE_NODE (id=32):(Total: 3m24s, non-child: 58s397ms, % non-child: 28.50%) BytesReceived(32s000ms): 1.53 GB, 3.96 GB, 5.91 GB, 7.84 GB, 9.76 GB, 12.03 GB, 13.07 GB, 14.84 GB, 16.15 GB, 17.84 GB, 18.98 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB, 19.10 GB - BytesReceived: 19.10 GB (20503879049) - ConvertRowBatchTime: 31s286ms - DeserializeRowBatchTimer: 57s964ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.44B (1440033112) - RowsReturnedRate: 7.03 M/sec - SendersBlockedTimer: 38s731ms - SendersBlockedTotalTimer(*): 3m49s HDFS_SCAN_NODE (id=12):(Total: 7s293ms, non-child: 7s293ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:85/16.75 GB 5:88/17.43 GB 6:87/17.06 GB 3:93/17.64 GB 0:86/17.00 GB 7:92/18.97 GB 2:91/16.68 GB 1:84/17.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 131 out of 131 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:93.96% 1:3.221% 2:2.282% 3:0.2685% 4:0% 5:0.1342% 6:0.1342% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:575 PARQUET/SNAPPY:786 BytesRead(8s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 34.44 MB, 875.41 MB, 1.93 GB, 2.90 GB - FooterProcessingTime: (Avg: 183.407ms ; Min: 1.210ms ; Max: 2s906ms ; Number of samples: 131) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 0.50 - BytesRead: 4.41 GB (4734022007) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.41 GB (4734022007) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.41 GB (4734022007) - DecompressionTime: 15s367ms - MaxCompressedTextFileLength: 0 - NumColumns: 6 (6) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 131 (131) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 291.27 MB (305416340) - PerReadThreadRawHdfsThroughput: 121.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6s279ms - RowBatchQueuePutWaitTime: 16s185ms - RowsRead: 405.05M (405049258) - RowsReturned: 405.05M (405049258) - RowsReturnedRate: 55.54 M/sec - ScanRangesComplete: 706 (706) - ScannerThreadsInvoluntaryContextSwitches: 10.37K (10370) - ScannerThreadsTotalWallClockTime: 3m4s - MaterializeTupleTime(*): 55s912ms - ScannerThreadsSysTime: 15s331ms - ScannerThreadsUserTime: 54s547ms - ScannerThreadsVoluntaryContextSwitches: 334.71K (334708) - TotalRawHdfsReadTime(*): 37s251ms - TotalReadThroughput: 12.09 MB/sec Filter 2 (1.00 MB): - Files processed: 706 (706) - Files rejected: 575 (575) - Files total: 706 (706) - RowGroups processed: 395.62K (395617) - RowGroups rejected: 0 (0) - RowGroups total: 395.62K (395617) - Rows processed: 2.15M (2146304) - Rows rejected: 0 (0) - Rows total: 405.05M (405049258) - Splits processed: 131 (131) - Splits rejected: 0 (0) - Splits total: 131 (131) Averaged Fragment F11:(Total: 5m37s, non-child: 4m35s, % non-child: 81.70%) split sizes: min: 15.22 GB, max: 15.30 GB, avg: 15.25 GB, stddev: 28.27 MB completion times: min:5m29s max:5m42s mean: 5m37s stddev:5s928ms execution rates: min:45.52 MB/sec max:47.37 MB/sec mean:46.31 MB/sec stddev:839.48 KB/sec num instances: 7 - AverageThreadTokens: 6.63 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 1227133513.14 GB (1317624576693539400) - PeakMemoryUsage: 116.27 MB (121921764) - PerHostPeakMemUsage: 9.08 GB (9744955523) - RowsProduced: 205.72M (205719016) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m58s - TotalStorageWaitTime: 1m49s - TotalThreadsInvoluntaryContextSwitches: 25.50K (25498) - TotalThreadsTotalWallClockTime: 37m16s - TotalThreadsSysTime: 7s299ms - TotalThreadsUserTime: 53s981ms - TotalThreadsVoluntaryContextSwitches: 497.03K (497034) Fragment Instance Lifecycle Timings: - ExecTime: 5m37s - ExecTreeExecTime: 2s361ms - OpenTime: 24.177ms - ExecTreeOpenTime: 274.068us - PrepareTime: 46.175ms - ExecTreePrepareTime: 1.991ms DataStreamSender (dst_id=32):(Total: 59s582ms, non-child: 59s582ms, % non-child: 100.00%) - BytesSent: 19.10 GB (20503879049) - NetworkThroughput(*): 691.89 MB/sec - OverallThroughput: 328.21 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.72M (205719016) - SerializeBatchTime: 31s242ms - TransmitDataRPCTime: 28s282ms - UncompressedRowBatchSize: 28.17 GB (30246324760) CodeGen:(Total: 51.352ms, non-child: 51.352ms, % non-child: 100.00%) - CodegenTime: 669.826us - CompileTime: 6.975ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 13.611ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 30.082ms HDFS_SCAN_NODE (id=13):(Total: 2s101ms, non-child: 2s101ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 5.63 - BytesRead: 1.97 GB (2119754134) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2119754134) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2119754134) - DecompressionTime: 8s994ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 300 (300) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 116.19 MB (121832576) - PerReadThreadRawHdfsThroughput: 70.60 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 302.815ms - RowBatchQueuePutWaitTime: 29m27s - RowsRead: 205.72M (205719016) - RowsReturned: 205.72M (205719016) - RowsReturnedRate: 98.51 M/sec - ScanRangesComplete: 300 (300) - ScannerThreadsInvoluntaryContextSwitches: 1.76K (1756) - ScannerThreadsTotalWallClockTime: 31m39s - MaterializeTupleTime(*): 8s863ms - ScannerThreadsSysTime: 1s975ms - ScannerThreadsUserTime: 19s358ms - ScannerThreadsVoluntaryContextSwitches: 208.72K (208722) - TotalRawHdfsReadTime(*): 28s720ms - TotalReadThroughput: 6.00 MB/sec Fragment F11: Instance 8d463de3722df36f:a2dae93a0000003b (host=vd1313.halxg.cloudera.com:22000):(Total: 5m42s, non-child: 4m41s, % non-child: 82.03%) Hdfs split stats (:<# splits>/): 2:49/2.68 GB 3:34/1.79 GB 5:32/1.69 GB 1:39/2.11 GB 6:36/1.79 GB 7:43/2.30 GB 0:34/1.56 GB 4:25/1.31 GB MemoryUsage(8s000ms): 87.07 MB, 82.06 MB, 95.00 MB, 109.13 MB, 102.13 MB, 113.61 MB, 89.42 MB, 99.97 MB, 107.38 MB, 100.41 MB, 98.87 MB, 94.99 MB, 93.39 MB, 88.70 MB, 92.78 MB, 92.44 MB, 62.55 MB, 64.27 MB, 59.72 MB, 76.18 MB, 68.04 MB, 58.13 MB, 83.92 MB, 71.76 MB, 66.07 MB, 65.88 MB, 60.75 MB, 58.85 MB, 72.76 MB, 74.00 MB, 64.22 MB, 65.58 MB, 65.40 MB, 67.97 MB, 56.11 MB, 48.64 MB, 54.84 MB, 54.72 MB, 81.90 MB, 71.51 MB, 65.66 MB, 39.99 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 6.66 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 125.19 MB (131271741) - PerHostPeakMemUsage: 9.10 GB (9776160944) - RowsProduced: 205.46M (205464137) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m2s - TotalStorageWaitTime: 2m2s - TotalThreadsInvoluntaryContextSwitches: 25.25K (25248) - TotalThreadsTotalWallClockTime: 37m59s - TotalThreadsSysTime: 7s487ms - TotalThreadsUserTime: 54s668ms - TotalThreadsVoluntaryContextSwitches: 495.79K (495791) Fragment Instance Lifecycle Timings: - ExecTime: 5m42s - ExecTreeExecTime: 2s509ms - OpenTime: 19.906ms - ExecTreeOpenTime: 279.357us - PrepareTime: 40.003ms - ExecTreePrepareTime: 1.723ms DataStreamSender (dst_id=32):(Total: 59s277ms, non-child: 59s277ms, % non-child: 100.00%) - BytesSent: 19.07 GB (20476572977) - NetworkThroughput(*): 710.26 MB/sec - OverallThroughput: 329.43 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.46M (205464137) - SerializeBatchTime: 31s721ms - TransmitDataRPCTime: 27s494ms - UncompressedRowBatchSize: 28.13 GB (30208850315) CodeGen:(Total: 42.151ms, non-child: 42.151ms, % non-child: 100.00%) - CodegenTime: 524.643us - CompileTime: 5.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 11.302ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 24.903ms HDFS_SCAN_NODE (id=13):(Total: 2s253ms, non-child: 2s253ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:49/2.68 GB 3:34/1.79 GB 5:32/1.69 GB 1:39/2.11 GB 6:36/1.79 GB 7:43/2.30 GB 0:34/1.56 GB 4:25/1.31 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 292 out of 292 Hdfs Read Thread Concurrency Bucket: 0:91.68% 1:7.007% 2:1.022% 3:0.146% 4:0.146% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:584 BytesRead(8s000ms): 66.07 MB, 150.35 MB, 240.88 MB, 294.73 MB, 345.54 MB, 405.46 MB, 477.41 MB, 543.95 MB, 571.80 MB, 619.01 MB, 667.71 MB, 710.49 MB, 776.25 MB, 833.55 MB, 853.46 MB, 926.24 MB, 978.77 MB, 1.00 GB, 1.02 GB, 1.09 GB, 1.16 GB, 1.23 GB, 1.29 GB, 1.31 GB, 1.34 GB, 1.34 GB, 1.35 GB, 1.41 GB, 1.48 GB, 1.51 GB, 1.55 GB, 1.60 GB, 1.63 GB, 1.64 GB, 1.68 GB, 1.74 GB, 1.80 GB, 1.83 GB, 1.88 GB, 1.90 GB, 1.95 GB, 1.96 GB - FooterProcessingTime: (Avg: 148.821ms ; Min: 1.121ms ; Max: 1s402ms ; Number of samples: 292) - AverageHdfsReadThreadConcurrency: 0.10 - AverageScannerThreadConcurrency: 5.66 - BytesRead: 1.97 GB (2116228149) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2116228149) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2116228149) - DecompressionTime: 8s857ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 292 (292) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 125.11 MB (131191916) - PerReadThreadRawHdfsThroughput: 63.44 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 503.610ms - RowBatchQueuePutWaitTime: 29m52s - RowsRead: 205.46M (205464137) - RowsReturned: 205.46M (205464137) - RowsReturnedRate: 91.17 M/sec - ScanRangesComplete: 292 (292) - ScannerThreadsInvoluntaryContextSwitches: 2.36K (2362) - ScannerThreadsTotalWallClockTime: 32m17s - MaterializeTupleTime(*): 9s099ms - ScannerThreadsSysTime: 2s030ms - ScannerThreadsUserTime: 19s558ms - ScannerThreadsVoluntaryContextSwitches: 207.70K (207703) - TotalRawHdfsReadTime(*): 31s812ms - TotalReadThroughput: 5.89 MB/sec Instance 8d463de3722df36f:a2dae93a0000003f (host=vd1312.halxg.cloudera.com:22000):(Total: 5m42s, non-child: 4m39s, % non-child: 81.75%) Hdfs split stats (:<# splits>/): 5:37/1.79 GB 3:42/2.28 GB 1:32/1.52 GB 7:39/2.01 GB 2:42/1.90 GB 0:42/1.98 GB 4:37/1.94 GB 6:40/1.86 GB MemoryUsage(8s000ms): 88.19 MB, 96.48 MB, 88.90 MB, 99.60 MB, 98.88 MB, 107.42 MB, 104.25 MB, 99.44 MB, 108.27 MB, 103.65 MB, 84.69 MB, 87.86 MB, 106.54 MB, 96.22 MB, 87.97 MB, 88.80 MB, 90.53 MB, 59.59 MB, 56.18 MB, 64.06 MB, 56.90 MB, 71.74 MB, 61.01 MB, 60.04 MB, 57.94 MB, 57.96 MB, 51.02 MB, 57.85 MB, 56.09 MB, 49.50 MB, 70.35 MB, 65.87 MB, 68.76 MB, 73.91 MB, 55.79 MB, 54.12 MB, 64.14 MB, 64.69 MB, 58.18 MB, 59.29 MB, 73.01 MB, 41.73 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 6.63 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 125.16 MB (131243629) - PerHostPeakMemUsage: 9.07 GB (9743335246) - RowsProduced: 206.20M (206203160) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m3s - TotalStorageWaitTime: 1m49s - TotalThreadsInvoluntaryContextSwitches: 25.26K (25256) - TotalThreadsTotalWallClockTime: 37m48s - TotalThreadsSysTime: 7s232ms - TotalThreadsUserTime: 53s898ms - TotalThreadsVoluntaryContextSwitches: 498.03K (498034) Fragment Instance Lifecycle Timings: - ExecTime: 5m42s - ExecTreeExecTime: 2s446ms - OpenTime: 29.674ms - ExecTreeOpenTime: 256.272us - PrepareTime: 54.792ms - ExecTreePrepareTime: 1.664ms DataStreamSender (dst_id=32):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesSent: 19.14 GB (20551005587) - NetworkThroughput(*): 677.04 MB/sec - OverallThroughput: 325.29 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 206.20M (206203160) - SerializeBatchTime: 31s248ms - TransmitDataRPCTime: 28s947ms - UncompressedRowBatchSize: 28.24 GB (30317507500) CodeGen:(Total: 69.011ms, non-child: 69.011ms, % non-child: 100.00%) - CodegenTime: 1.159ms - CompileTime: 4.615ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 21.462ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 41.858ms HDFS_SCAN_NODE (id=13):(Total: 2s190ms, non-child: 2s190ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:37/1.79 GB 3:42/2.28 GB 1:32/1.52 GB 7:39/2.01 GB 2:42/1.90 GB 0:42/1.98 GB 4:37/1.94 GB 6:40/1.86 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 311 out of 311 Hdfs Read Thread Concurrency Bucket: 0:92.55% 1:6.277% 2:1.168% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:622 BytesRead(8s000ms): 66.74 MB, 149.68 MB, 246.23 MB, 302.10 MB, 353.61 MB, 411.00 MB, 492.34 MB, 540.74 MB, 590.21 MB, 627.81 MB, 677.55 MB, 720.12 MB, 790.68 MB, 841.97 MB, 864.89 MB, 938.53 MB, 991.86 MB, 1.01 GB, 1.03 GB, 1.10 GB, 1.17 GB, 1.25 GB, 1.30 GB, 1.33 GB, 1.34 GB, 1.34 GB, 1.36 GB, 1.42 GB, 1.50 GB, 1.53 GB, 1.57 GB, 1.61 GB, 1.65 GB, 1.66 GB, 1.69 GB, 1.75 GB, 1.81 GB, 1.84 GB, 1.88 GB, 1.91 GB, 1.97 GB, 1.97 GB - FooterProcessingTime: (Avg: 141.218ms ; Min: 975.554us ; Max: 1s336ms ; Number of samples: 311) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 5.63 - BytesRead: 1.98 GB (2124957413) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.98 GB (2124957413) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.98 GB (2124957413) - DecompressionTime: 8s970ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 311 (311) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 125.09 MB (131163804) - PerReadThreadRawHdfsThroughput: 66.93 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 393.440ms - RowBatchQueuePutWaitTime: 29m54s - RowsRead: 206.20M (206203160) - RowsReturned: 206.20M (206203160) - RowsReturnedRate: 94.12 M/sec - ScanRangesComplete: 311 (311) - ScannerThreadsInvoluntaryContextSwitches: 1.55K (1554) - ScannerThreadsTotalWallClockTime: 32m6s - MaterializeTupleTime(*): 8s810ms - ScannerThreadsSysTime: 1s889ms - ScannerThreadsUserTime: 19s361ms - ScannerThreadsVoluntaryContextSwitches: 209.54K (209536) - TotalRawHdfsReadTime(*): 30s280ms - TotalReadThroughput: 5.92 MB/sec Instance 8d463de3722df36f:a2dae93a0000003c (host=vd1310.halxg.cloudera.com:22000):(Total: 5m42s, non-child: 4m40s, % non-child: 81.82%) Hdfs split stats (:<# splits>/): 0:42/2.31 GB 5:41/2.12 GB 3:29/1.45 GB 2:37/1.86 GB 1:40/2.14 GB 4:36/1.76 GB 6:37/1.91 GB 7:32/1.71 GB MemoryUsage(8s000ms): 105.97 MB, 88.82 MB, 102.80 MB, 99.48 MB, 99.45 MB, 102.52 MB, 97.10 MB, 107.21 MB, 100.27 MB, 89.37 MB, 92.90 MB, 88.19 MB, 83.21 MB, 90.15 MB, 91.55 MB, 103.31 MB, 78.90 MB, 72.14 MB, 68.17 MB, 59.80 MB, 65.69 MB, 72.12 MB, 61.30 MB, 70.70 MB, 81.97 MB, 81.96 MB, 70.79 MB, 57.81 MB, 65.68 MB, 69.91 MB, 73.22 MB, 79.65 MB, 59.12 MB, 49.92 MB, 43.44 MB, 57.73 MB, 79.95 MB, 72.59 MB, 66.17 MB, 64.20 MB, 63.64 MB, 47.86 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 4 - AverageThreadTokens: 6.66 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 121.73 MB (127640837) - PerHostPeakMemUsage: 9.08 GB (9748341710) - RowsProduced: 205.80M (205801355) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m2s - TotalStorageWaitTime: 1m35s - TotalThreadsInvoluntaryContextSwitches: 24.32K (24325) - TotalThreadsTotalWallClockTime: 38m - TotalThreadsSysTime: 7s266ms - TotalThreadsUserTime: 55s003ms - TotalThreadsVoluntaryContextSwitches: 494.46K (494464) Fragment Instance Lifecycle Timings: - ExecTime: 5m42s - ExecTreeExecTime: 2s260ms - OpenTime: 25.243ms - ExecTreeOpenTime: 251.208us - PrepareTime: 44.173ms - ExecTreePrepareTime: 2.613ms DataStreamSender (dst_id=32):(Total: 1m, non-child: 1m, % non-child: 100.00%) - BytesSent: 19.10 GB (20512320136) - NetworkThroughput(*): 695.00 MB/sec - OverallThroughput: 324.90 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.80M (205801355) - SerializeBatchTime: 32s006ms - TransmitDataRPCTime: 28s146ms - UncompressedRowBatchSize: 28.18 GB (30258431021) CodeGen:(Total: 49.725ms, non-child: 49.725ms, % non-child: 100.00%) - CodegenTime: 551.953us - CompileTime: 6.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 14.105ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 27.971ms HDFS_SCAN_NODE (id=13):(Total: 1s998ms, non-child: 1s998ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:42/2.31 GB 5:41/2.12 GB 3:29/1.45 GB 2:37/1.86 GB 1:40/2.14 GB 4:36/1.76 GB 6:37/1.91 GB 7:32/1.71 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 294 out of 294 Hdfs Read Thread Concurrency Bucket: 0:92.84% 1:6.725% 2:0.4386% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:588 BytesRead(8s000ms): 73.82 MB, 153.55 MB, 242.44 MB, 301.66 MB, 345.40 MB, 409.18 MB, 484.60 MB, 541.73 MB, 575.42 MB, 620.17 MB, 676.91 MB, 712.32 MB, 781.06 MB, 833.76 MB, 857.24 MB, 936.89 MB, 986.89 MB, 1.01 GB, 1.03 GB, 1.09 GB, 1.16 GB, 1.25 GB, 1.29 GB, 1.33 GB, 1.34 GB, 1.34 GB, 1.35 GB, 1.41 GB, 1.49 GB, 1.52 GB, 1.56 GB, 1.61 GB, 1.63 GB, 1.63 GB, 1.69 GB, 1.75 GB, 1.81 GB, 1.84 GB, 1.88 GB, 1.90 GB, 1.96 GB, 1.97 GB - FooterProcessingTime: (Avg: 115.057ms ; Min: 1.019ms ; Max: 1s580ms ; Number of samples: 294) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 5.66 - BytesRead: 1.97 GB (2119870087) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2119870087) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2119870087) - DecompressionTime: 9s165ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 294 (294) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 121.59 MB (127495468) - PerReadThreadRawHdfsThroughput: 75.22 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 220.720ms - RowBatchQueuePutWaitTime: 30m20s - RowsRead: 205.80M (205801355) - RowsReturned: 205.80M (205801355) - RowsReturnedRate: 102.97 M/sec - ScanRangesComplete: 294 (294) - ScannerThreadsInvoluntaryContextSwitches: 1.33K (1330) - ScannerThreadsTotalWallClockTime: 32m18s - MaterializeTupleTime(*): 9s007ms - ScannerThreadsSysTime: 1s890ms - ScannerThreadsUserTime: 19s670ms - ScannerThreadsVoluntaryContextSwitches: 208.28K (208275) - TotalRawHdfsReadTime(*): 26s878ms - TotalReadThroughput: 5.91 MB/sec Instance 8d463de3722df36f:a2dae93a0000003d (host=vd1314.halxg.cloudera.com:22000):(Total: 5m42s, non-child: 4m41s, % non-child: 82.24%) Hdfs split stats (:<# splits>/): 4:40/2.11 GB 2:34/1.73 GB 5:29/1.49 GB 0:38/1.99 GB 3:35/1.94 GB 7:44/2.32 GB 1:33/1.70 GB 6:40/1.96 GB MemoryUsage(8s000ms): 94.34 MB, 94.45 MB, 93.13 MB, 94.23 MB, 88.22 MB, 93.39 MB, 89.71 MB, 80.71 MB, 100.23 MB, 90.11 MB, 96.52 MB, 98.53 MB, 107.50 MB, 89.53 MB, 79.79 MB, 86.68 MB, 78.44 MB, 72.93 MB, 62.21 MB, 53.32 MB, 64.43 MB, 63.12 MB, 76.01 MB, 71.09 MB, 62.93 MB, 65.84 MB, 70.88 MB, 56.17 MB, 62.73 MB, 73.53 MB, 67.56 MB, 75.02 MB, 86.22 MB, 89.91 MB, 54.45 MB, 59.99 MB, 66.48 MB, 63.36 MB, 65.46 MB, 61.90 MB, 78.57 MB, 46.27 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 3 - AverageThreadTokens: 6.64 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 117.12 MB (122810685) - PerHostPeakMemUsage: 9.12 GB (9792785240) - RowsProduced: 205.46M (205464339) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 5m2s - TotalStorageWaitTime: 1m31s - TotalThreadsInvoluntaryContextSwitches: 26.48K (26484) - TotalThreadsTotalWallClockTime: 37m51s - TotalThreadsSysTime: 7s342ms - TotalThreadsUserTime: 53s883ms - TotalThreadsVoluntaryContextSwitches: 494.70K (494696) Fragment Instance Lifecycle Timings: - ExecTime: 5m42s - ExecTreeExecTime: 2s157ms - OpenTime: 17.850ms - ExecTreeOpenTime: 266.691us - PrepareTime: 41.707ms - ExecTreePrepareTime: 2.157ms DataStreamSender (dst_id=32):(Total: 58s854ms, non-child: 58s854ms, % non-child: 100.00%) - BytesSent: 19.07 GB (20479341792) - NetworkThroughput(*): 712.72 MB/sec - OverallThroughput: 331.84 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.46M (205464339) - SerializeBatchTime: 31s396ms - TransmitDataRPCTime: 27s403ms - UncompressedRowBatchSize: 28.13 GB (30208879925) CodeGen:(Total: 40.915ms, non-child: 40.915ms, % non-child: 100.00%) - CodegenTime: 541.043us - CompileTime: 4.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 10.652ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 24.998ms HDFS_SCAN_NODE (id=13):(Total: 1s888ms, non-child: 1s888ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:40/2.11 GB 2:34/1.73 GB 5:29/1.49 GB 0:38/1.99 GB 3:35/1.94 GB 7:44/2.32 GB 1:33/1.70 GB 6:40/1.96 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 293 out of 293 Hdfs Read Thread Concurrency Bucket: 0:92.69% 1:6.725% 2:0.5848% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:586 BytesRead(8s000ms): 69.51 MB, 154.90 MB, 241.96 MB, 291.85 MB, 345.83 MB, 405.60 MB, 483.23 MB, 538.87 MB, 586.74 MB, 626.18 MB, 683.26 MB, 720.83 MB, 788.18 MB, 827.77 MB, 853.83 MB, 933.20 MB, 989.33 MB, 1.00 GB, 1.02 GB, 1.09 GB, 1.16 GB, 1.24 GB, 1.30 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.35 GB, 1.41 GB, 1.48 GB, 1.52 GB, 1.56 GB, 1.60 GB, 1.64 GB, 1.64 GB, 1.68 GB, 1.74 GB, 1.80 GB, 1.82 GB, 1.87 GB, 1.90 GB, 1.95 GB, 1.97 GB - FooterProcessingTime: (Avg: 120.220ms ; Min: 764.306us ; Max: 953.786ms ; Number of samples: 293) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 5.64 - BytesRead: 1.97 GB (2115908001) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2115908001) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2115908001) - DecompressionTime: 9s561ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 293 (293) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 117.05 MB (122730860) - PerReadThreadRawHdfsThroughput: 73.55 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.190ms - RowBatchQueuePutWaitTime: 30m15s - RowsRead: 205.46M (205464339) - RowsReturned: 205.46M (205464339) - RowsReturnedRate: 108.82 M/sec - ScanRangesComplete: 293 (293) - ScannerThreadsInvoluntaryContextSwitches: 1.67K (1666) - ScannerThreadsTotalWallClockTime: 32m9s - MaterializeTupleTime(*): 8s706ms - ScannerThreadsSysTime: 1s976ms - ScannerThreadsUserTime: 19s290ms - ScannerThreadsVoluntaryContextSwitches: 208.21K (208213) - TotalRawHdfsReadTime(*): 27s434ms - TotalReadThroughput: 5.90 MB/sec Instance 8d463de3722df36f:a2dae93a0000003e (host=vd1316.halxg.cloudera.com:22000):(Total: 5m31s, non-child: 4m29s, % non-child: 81.43%) Hdfs split stats (:<# splits>/): 2:39/1.87 GB 7:42/2.24 GB 6:41/2.02 GB 1:35/1.84 GB 3:38/1.90 GB 5:33/1.65 GB 4:43/2.12 GB 0:33/1.60 GB MemoryUsage(8s000ms): 91.46 MB, 90.18 MB, 102.17 MB, 91.00 MB, 91.91 MB, 93.79 MB, 84.06 MB, 82.88 MB, 84.32 MB, 96.15 MB, 103.20 MB, 94.00 MB, 87.01 MB, 99.73 MB, 81.60 MB, 91.62 MB, 69.15 MB, 71.12 MB, 75.48 MB, 68.74 MB, 63.88 MB, 61.97 MB, 69.22 MB, 66.80 MB, 65.39 MB, 65.92 MB, 67.29 MB, 54.28 MB, 72.72 MB, 72.99 MB, 73.46 MB, 72.64 MB, 54.88 MB, 53.49 MB, 64.29 MB, 61.52 MB, 70.93 MB, 73.87 MB, 61.18 MB, 64.08 MB, 65.87 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.77 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 109.13 MB (114427541) - PerHostPeakMemUsage: 9.11 GB (9785807636) - RowsProduced: 205.56M (205562264) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m52s - TotalStorageWaitTime: 1m44s - TotalThreadsInvoluntaryContextSwitches: 23.68K (23685) - TotalThreadsTotalWallClockTime: 37m23s - TotalThreadsSysTime: 7s311ms - TotalThreadsUserTime: 53s390ms - TotalThreadsVoluntaryContextSwitches: 497.93K (497928) Fragment Instance Lifecycle Timings: - ExecTime: 5m31s - ExecTreeExecTime: 2s185ms - OpenTime: 20.308ms - ExecTreeOpenTime: 266.874us - PrepareTime: 34.487ms - ExecTreePrepareTime: 958.242us DataStreamSender (dst_id=32):(Total: 59s536ms, non-child: 59s536ms, % non-child: 100.00%) - BytesSent: 19.08 GB (20490262919) - NetworkThroughput(*): 681.21 MB/sec - OverallThroughput: 328.22 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.56M (205562264) - SerializeBatchTime: 30s788ms - TransmitDataRPCTime: 28s685ms - UncompressedRowBatchSize: 28.15 GB (30223277980) CodeGen:(Total: 41.912ms, non-child: 41.912ms, % non-child: 100.00%) - CodegenTime: 532.348us - CompileTime: 4.799ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 12.784ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 23.845ms HDFS_SCAN_NODE (id=13):(Total: 1s930ms, non-child: 1s930ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:39/1.87 GB 7:42/2.24 GB 6:41/2.02 GB 1:35/1.84 GB 3:38/1.90 GB 5:33/1.65 GB 4:43/2.12 GB 0:33/1.60 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 304 out of 304 Hdfs Read Thread Concurrency Bucket: 0:93.05% 1:6.193% 2:0.6042% 3:0.1511% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:608 BytesRead(8s000ms): 73.14 MB, 159.69 MB, 252.96 MB, 310.90 MB, 357.44 MB, 418.09 MB, 498.45 MB, 550.62 MB, 594.83 MB, 642.28 MB, 699.18 MB, 729.35 MB, 801.80 MB, 847.17 MB, 874.86 MB, 957.87 MB, 1005.19 MB, 1.03 GB, 1.05 GB, 1.12 GB, 1.19 GB, 1.26 GB, 1.32 GB, 1.34 GB, 1.35 GB, 1.35 GB, 1.37 GB, 1.43 GB, 1.51 GB, 1.54 GB, 1.58 GB, 1.62 GB, 1.65 GB, 1.66 GB, 1.71 GB, 1.77 GB, 1.82 GB, 1.85 GB, 1.89 GB, 1.92 GB, 1.96 GB - FooterProcessingTime: (Avg: 128.043ms ; Min: 903.889us ; Max: 2s495ms ; Number of samples: 304) - AverageHdfsReadThreadConcurrency: 0.08 - AverageScannerThreadConcurrency: 5.77 - BytesRead: 1.97 GB (2118948559) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2118948559) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2118948559) - DecompressionTime: 8s753ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 304 (304) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 109.05 MB (114347716) - PerReadThreadRawHdfsThroughput: 71.20 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 176.969ms - RowBatchQueuePutWaitTime: 29m47s - RowsRead: 205.56M (205562264) - RowsReturned: 205.56M (205562264) - RowsReturnedRate: 106.46 M/sec - ScanRangesComplete: 304 (304) - ScannerThreadsInvoluntaryContextSwitches: 1.75K (1752) - ScannerThreadsTotalWallClockTime: 31m52s - MaterializeTupleTime(*): 8s497ms - ScannerThreadsSysTime: 2s094ms - ScannerThreadsUserTime: 19s092ms - ScannerThreadsVoluntaryContextSwitches: 209.31K (209307) - TotalRawHdfsReadTime(*): 28s379ms - TotalReadThroughput: 6.11 MB/sec Instance 8d463de3722df36f:a2dae93a00000041 (host=vd1311.halxg.cloudera.com:22000):(Total: 5m31s, non-child: 4m30s, % non-child: 81.56%) Hdfs split stats (:<# splits>/): 6:33/1.56 GB 5:42/2.20 GB 1:41/2.12 GB 2:41/2.19 GB 4:35/1.75 GB 3:32/1.70 GB 7:33/1.70 GB 0:41/2.08 GB MemoryUsage(8s000ms): 85.53 MB, 84.50 MB, 86.03 MB, 98.45 MB, 91.67 MB, 100.04 MB, 101.87 MB, 98.44 MB, 93.64 MB, 86.68 MB, 83.50 MB, 89.94 MB, 88.10 MB, 73.30 MB, 86.19 MB, 93.33 MB, 78.50 MB, 78.18 MB, 65.59 MB, 65.44 MB, 62.18 MB, 66.30 MB, 70.83 MB, 77.10 MB, 89.95 MB, 89.98 MB, 79.16 MB, 58.77 MB, 58.19 MB, 61.40 MB, 58.53 MB, 69.12 MB, 78.89 MB, 77.58 MB, 53.36 MB, 68.11 MB, 65.26 MB, 58.46 MB, 62.33 MB, 75.11 MB, 79.64 MB ThreadUsage(8s000ms): 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6 - AverageThreadTokens: 6.77 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 112.80 MB (118279908) - PerHostPeakMemUsage: 9.06 GB (9732674901) - RowsProduced: 206.32M (206324495) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m52s - TotalStorageWaitTime: 1m55s - TotalThreadsInvoluntaryContextSwitches: 24.51K (24512) - TotalThreadsTotalWallClockTime: 37m21s - TotalThreadsSysTime: 7s206ms - TotalThreadsUserTime: 54s352ms - TotalThreadsVoluntaryContextSwitches: 500.03K (500033) Fragment Instance Lifecycle Timings: - ExecTime: 5m31s - ExecTreeExecTime: 2s299ms - OpenTime: 19.738ms - ExecTreeOpenTime: 288.652us - PrepareTime: 43.813ms - ExecTreePrepareTime: 2.566ms DataStreamSender (dst_id=32):(Total: 58s976ms, non-child: 58s976ms, % non-child: 100.00%) - BytesSent: 19.15 GB (20564914258) - NetworkThroughput(*): 708.67 MB/sec - OverallThroughput: 332.55 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 206.32M (206324495) - SerializeBatchTime: 31s248ms - TransmitDataRPCTime: 27s674ms - UncompressedRowBatchSize: 28.25 GB (30335346657) CodeGen:(Total: 43.792ms, non-child: 43.792ms, % non-child: 100.00%) - CodegenTime: 679.594us - CompileTime: 5.077ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 12.531ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 25.652ms HDFS_SCAN_NODE (id=13):(Total: 2s056ms, non-child: 2s056ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:33/1.56 GB 5:42/2.20 GB 1:41/2.12 GB 2:41/2.19 GB 4:35/1.75 GB 3:32/1.70 GB 7:33/1.70 GB 0:41/2.08 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 298 out of 298 Hdfs Read Thread Concurrency Bucket: 0:91.99% 1:7.1% 2:0.7553% 3:0.1511% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:596 BytesRead(8s000ms): 69.44 MB, 154.68 MB, 245.97 MB, 302.49 MB, 352.85 MB, 417.25 MB, 493.14 MB, 550.54 MB, 592.54 MB, 631.88 MB, 688.90 MB, 725.43 MB, 797.83 MB, 845.26 MB, 872.51 MB, 947.15 MB, 998.03 MB, 1.02 GB, 1.04 GB, 1.11 GB, 1.18 GB, 1.26 GB, 1.32 GB, 1.34 GB, 1.37 GB, 1.37 GB, 1.38 GB, 1.43 GB, 1.51 GB, 1.54 GB, 1.58 GB, 1.63 GB, 1.66 GB, 1.67 GB, 1.71 GB, 1.78 GB, 1.83 GB, 1.86 GB, 1.91 GB, 1.93 GB, 1.98 GB - FooterProcessingTime: (Avg: 147.637ms ; Min: 971.472us ; Max: 1s420ms ; Number of samples: 298) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 5.77 - BytesRead: 1.98 GB (2125843334) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.98 GB (2125843334) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.98 GB (2125843334) - DecompressionTime: 8s926ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 298 (298) - NumScannerThreadsStarted: 7 (7) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 112.72 MB (118200083) - PerReadThreadRawHdfsThroughput: 73.17 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 287.752ms - RowBatchQueuePutWaitTime: 29m30s - RowsRead: 206.32M (206324495) - RowsReturned: 206.32M (206324495) - RowsReturnedRate: 100.35 M/sec - ScanRangesComplete: 298 (298) - ScannerThreadsInvoluntaryContextSwitches: 1.83K (1835) - ScannerThreadsTotalWallClockTime: 31m50s - MaterializeTupleTime(*): 8s995ms - ScannerThreadsSysTime: 1s997ms - ScannerThreadsUserTime: 19s571ms - ScannerThreadsVoluntaryContextSwitches: 210.01K (210006) - TotalRawHdfsReadTime(*): 27s706ms - TotalReadThroughput: 6.12 MB/sec Instance 8d463de3722df36f:a2dae93a00000040 (host=vd1309.halxg.cloudera.com:22000):(Total: 5m29s, non-child: 4m26s, % non-child: 81.03%) Hdfs split stats (:<# splits>/): 4:33/1.57 GB 5:38/1.71 GB 0:41/2.09 GB 1:47/2.39 GB 2:39/1.94 GB 3:35/1.73 GB 7:39/1.94 GB 6:40/1.85 GB MemoryUsage(8s000ms): 72.52 MB, 90.75 MB, 79.70 MB, 78.26 MB, 74.44 MB, 78.79 MB, 88.89 MB, 86.07 MB, 66.40 MB, 67.65 MB, 73.61 MB, 80.06 MB, 86.43 MB, 84.08 MB, 71.19 MB, 83.96 MB, 66.85 MB, 66.86 MB, 75.84 MB, 53.42 MB, 67.29 MB, 59.60 MB, 64.53 MB, 60.67 MB, 73.93 MB, 73.90 MB, 73.69 MB, 60.15 MB, 56.15 MB, 64.45 MB, 65.06 MB, 49.04 MB, 72.73 MB, 74.00 MB, 60.95 MB, 61.62 MB, 63.77 MB, 66.04 MB, 59.39 MB, 53.83 MB, 22.16 MB ThreadUsage(8s000ms): 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 6, 2 - AverageThreadTokens: 6.28 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 102.79 MB (107778013) - PerHostPeakMemUsage: 8.97 GB (9635582988) - RowsProduced: 205.21M (205213362) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 4m50s - TotalStorageWaitTime: 2m7s - TotalThreadsInvoluntaryContextSwitches: 28.98K (28976) - TotalThreadsTotalWallClockTime: 34m27s - TotalThreadsSysTime: 7s247ms - TotalThreadsUserTime: 52s670ms - TotalThreadsVoluntaryContextSwitches: 498.30K (498298) Fragment Instance Lifecycle Timings: - ExecTime: 5m28s - ExecTreeExecTime: 2s673ms - OpenTime: 36.518ms - ExecTreeOpenTime: 309.424us - PrepareTime: 64.252ms - ExecTreePrepareTime: 2.257ms DataStreamSender (dst_id=32):(Total: 59s970ms, non-child: 59s970ms, % non-child: 100.00%) - BytesSent: 19.05 GB (20452735674) - NetworkThroughput(*): 658.34 MB/sec - OverallThroughput: 325.25 MB/sec - PeakMemoryUsage: 52.66 KB (53928) - RowsReturned: 205.21M (205213362) - SerializeBatchTime: 30s285ms - TransmitDataRPCTime: 29s627ms - UncompressedRowBatchSize: 28.10 GB (30171979922) CodeGen:(Total: 71.957ms, non-child: 71.957ms, % non-child: 100.00%) - CodegenTime: 700.055us - CompileTime: 17.437ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 9 (9) - NumInstructions: 179 (179) - OptimizationTime: 12.440ms - PeakMemoryUsage: 89.50 KB (91648) - PrepareTime: 41.346ms HDFS_SCAN_NODE (id=13):(Total: 2s395ms, non-child: 2s395ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:33/1.57 GB 5:38/1.71 GB 0:41/2.09 GB 1:47/2.39 GB 2:39/1.94 GB 3:35/1.73 GB 7:39/1.94 GB 6:40/1.85 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 312 out of 312 Hdfs Read Thread Concurrency Bucket: 0:91.79% 1:7.143% 2:0.9119% 3:0.152% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:624 BytesRead(8s000ms): 63.70 MB, 154.72 MB, 240.45 MB, 300.23 MB, 346.77 MB, 412.00 MB, 492.09 MB, 553.03 MB, 583.91 MB, 630.22 MB, 686.09 MB, 728.68 MB, 799.51 MB, 846.23 MB, 869.64 MB, 949.55 MB, 1006.62 MB, 1.03 GB, 1.05 GB, 1.11 GB, 1.19 GB, 1.27 GB, 1.32 GB, 1.35 GB, 1.37 GB, 1.37 GB, 1.38 GB, 1.45 GB, 1.52 GB, 1.55 GB, 1.59 GB, 1.64 GB, 1.68 GB, 1.68 GB, 1.72 GB, 1.79 GB, 1.84 GB, 1.87 GB, 1.91 GB, 1.94 GB, 1.97 GB - FooterProcessingTime: (Avg: 158.255ms ; Min: 1.153ms ; Max: 2s819ms ; Number of samples: 312) - AverageHdfsReadThreadConcurrency: 0.09 - AverageScannerThreadConcurrency: 5.28 - BytesRead: 1.97 GB (2116523395) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.97 GB (2116523395) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.97 GB (2116523395) - DecompressionTime: 8s726ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 8 (8) - NumRowGroups: 312 (312) - NumScannerThreadsStarted: 6 (6) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 102.71 MB (107698188) - PerReadThreadRawHdfsThroughput: 70.70 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 521.020ms - RowBatchQueuePutWaitTime: 26m29s - RowsRead: 205.21M (205213362) - RowsReturned: 205.21M (205213362) - RowsReturnedRate: 85.68 M/sec - ScanRangesComplete: 312 (312) - ScannerThreadsInvoluntaryContextSwitches: 1.80K (1796) - ScannerThreadsTotalWallClockTime: 28m58s - MaterializeTupleTime(*): 8s927ms - ScannerThreadsSysTime: 1s951ms - ScannerThreadsUserTime: 18s969ms - ScannerThreadsVoluntaryContextSwitches: 208.01K (208014) - TotalRawHdfsReadTime(*): 28s549ms - TotalReadThroughput: 6.14 MB/sec Averaged Fragment F12:(Total: 67.702ms, non-child: 5.321ms, % non-child: 7.86%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:89.085ms max:89.085ms mean: 89.085ms stddev:0.000ns execution rates: min:24.13 MB/sec max:24.13 MB/sec mean:24.13 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 680.17 MB (713209475) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.530us - TotalStorageWaitTime: 4.360ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 53.337ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 31 (31) Fragment Instance Lifecycle Timings: - ExecTime: 12.042ms - ExecTreeExecTime: 10.613ms - OpenTime: 31.177ms - ExecTreeOpenTime: 62.497us - PrepareTime: 24.431ms - ExecTreePrepareTime: 87.952us DataStreamSender (dst_id=33):(Total: 193.788us, non-child: 193.788us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 206.09 MB/sec - OverallThroughput: 101.42 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 36.726us - TransmitDataRPCTime: 95.361us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 51.313ms, non-child: 51.313ms, % non-child: 100.00%) - CodegenTime: 550.988us - CompileTime: 8.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 20.779ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 21.400ms HDFS_SCAN_NODE (id=14):(Total: 10.873ms, non-child: 10.873ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 145.191us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 632.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.246ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 33.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 10.552ms - MaterializeTupleTime(*): 4.255ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 718.637us - TotalReadThroughput: 0.00 /sec Fragment F12: Instance 8d463de3722df36f:a2dae93a00000042 (host=vd1316.halxg.cloudera.com:22000):(Total: 67.702ms, non-child: 5.321ms, % non-child: 7.86%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - BufferPoolPeakReservation: 0 - BufferPoolPeakUsedReservation: 0 - BufferPoolReservationLimit: 8589934592.00 GB (9223372036854775807) - PeakMemoryUsage: 1.65 MB (1729038) - PerHostPeakMemUsage: 680.17 MB (713209475) - RowsProduced: 366 (366) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.530us - TotalStorageWaitTime: 4.360ms - TotalThreadsInvoluntaryContextSwitches: 13 (13) - TotalThreadsTotalWallClockTime: 53.337ms - TotalThreadsSysTime: 2.000ms - TotalThreadsUserTime: 34.995ms - TotalThreadsVoluntaryContextSwitches: 31 (31) Fragment Instance Lifecycle Timings: - ExecTime: 12.042ms - ExecTreeExecTime: 10.613ms - OpenTime: 31.177ms - ExecTreeOpenTime: 62.497us - PrepareTime: 24.431ms - ExecTreePrepareTime: 87.952us DataStreamSender (dst_id=33):(Total: 193.788us, non-child: 193.788us, % non-child: 100.00%) - BytesSent: 20.12 KB (20608) - NetworkThroughput(*): 206.09 MB/sec - OverallThroughput: 101.42 MB/sec - PeakMemoryUsage: 99.53 KB (101920) - RowsReturned: 366 (366) - SerializeBatchTime: 36.726us - TransmitDataRPCTime: 95.361us - UncompressedRowBatchSize: 32.55 KB (33334) CodeGen:(Total: 51.313ms, non-child: 51.313ms, % non-child: 100.00%) - CodegenTime: 550.988us - CompileTime: 8.603ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.97 MB (2069388) - NumFunctions: 18 (18) - NumInstructions: 312 (312) - OptimizationTime: 20.779ms - PeakMemoryUsage: 156.00 KB (159744) - PrepareTime: 21.400ms HDFS_SCAN_NODE (id=14):(Total: 10.873ms, non-child: 10.873ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 1.668ms ; Min: 1.668ms ; Max: 1.668ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 145.191us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.54 MB (1618436) - PerReadThreadRawHdfsThroughput: 632.19 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.246ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 33.66 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 10.552ms - MaterializeTupleTime(*): 4.255ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 718.637us - TotalReadThroughput: 0.00 /sec