Query (id=24449bb4dc430956:ca0f6ca2e0cb4992): Summary: Session ID: 6a4c7a692eb1966f:2aa0560aa22d4bb Session Type: BEESWAX Start Time: 2015-06-24 15:43:32.673650000 End Time: 2015-06-24 15:44:12.144012000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.3.0-cdh5-INTERNAL RELEASE (build b0bf3606fe9dd51eef7a67744be2cf6246394a90) User: mj Connected User: mj Delegated User: Network Address: 172.20.86.18:37150 Default Db: tpcds_3000_parquet Sql Statement: select c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, amt, profit from (select ss_ticket_number, ss_customer_sk, ca_city bought_city, sum(ss_coupon_amt) amt, sum(ss_net_profit) profit from store_sales join store on (store_sales.ss_store_sk = store.s_store_sk) join household_demographics on (store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk) join date_dim on (store_sales.ss_sold_date_sk = date_dim.d_date_sk) join customer_address on (store_sales.ss_addr_sk = customer_address.ca_address_sk) where store.s_city in ('Midway', 'Concord', 'Spring Hill', 'Brownsville', 'Greenville') and (household_demographics.hd_dep_count = 5 or household_demographics.hd_vehicle_count = 3) and date_dim.d_dow in (6, 0) and date_dim.d_year in (1999, 1999 + 1, 1999 + 2) -- and ss_date between '1999-01-01' and '2001-12-31' -- and ss_sold_date_sk between 2451180 and 2452275 -- partition key filter and ss_sold_date_sk in (2451181, 2451182, 2451188, 2451189, 2451195, 2451196, 2451202, 2451203, 2451209, 2451210, 2451216, 2451217, 2451223, 2451224, 2451230, 2451231, 2451237, 2451238, 2451244, 2451245, 2451251, 2451252, 2451258, 2451259, 2451265, 2451266, 2451272, 2451273, 2451279, 2451280, 2451286, 2451287, 2451293, 2451294, 2451300, 2451301, 2451307, 2451308, 2451314, 2451315, 2451321, 2451322, 2451328, 2451329, 2451335, 2451336, 2451342, 2451343, 2451349, 2451350, 2451356, 2451357, 2451363, 2451364, 2451370, 2451371, 2451377, 2451378, 2451384, 2451385, 2451391, 2451392, 2451398, 2451399, 2451405, 2451406, 2451412, 2451413, 2451419, 2451420, 2451426, 2451427, 2451433, 2451434, 2451440, 2451441, 2451447, 2451448, 2451454, 2451455, 2451461, 2451462, 2451468, 2451469, 2451475, 2451476, 2451482, 2451483, 2451489, 2451490, 2451496, 2451497, 2451503, 2451504, 2451510, 2451511, 2451517, 2451518, 2451524, 2451525, 2451531, 2451532, 2451538, 2451539, 2451545, 2451546, 2451552, 2451553, 2451559, 2451560, 2451566, 2451567, 2451573, 2451574, 2451580, 2451581, 2451587, 2451588, 2451594, 2451595, 2451601, 2451602, 2451608, 2451609, 2451615, 2451616, 2451622, 2451623, 2451629, 2451630, 2451636, 2451637, 2451643, 2451644, 2451650, 2451651, 2451657, 2451658, 2451664, 2451665, 2451671, 2451672, 2451678, 2451679, 2451685, 2451686, 2451692, 2451693, 2451699, 2451700, 2451706, 2451707, 2451713, 2451714, 2451720, 2451721, 2451727, 2451728, 2451734, 2451735, 2451741, 2451742, 2451748, 2451749, 2451755, 2451756, 2451762, 2451763, 2451769, 2451770, 2451776, 2451777, 2451783, 2451784, 2451790, 2451791, 2451797, 2451798, 2451804, 2451805, 2451811, 2451812, 2451818, 2451819, 2451825, 2451826, 2451832, 2451833, 2451839, 2451840, 2451846, 2451847, 2451853, 2451854, 2451860, 2451861, 2451867, 2451868, 2451874, 2451875, 2451881, 2451882, 2451888, 2451889, 2451895, 2451896, 2451902, 2451903, 2451909, 2451910, 2451916, 2451917, 2451923, 2451924, 2451930, 2451931, 2451937, 2451938, 2451944, 2451945, 2451951, 2451952, 2451958, 2451959, 2451965, 2451966, 2451972, 2451973, 2451979, 2451980, 2451986, 2451987, 2451993, 2451994, 2452000, 2452001, 2452007, 2452008, 2452014, 2452015, 2452021, 2452022, 2452028, 2452029, 2452035, 2452036, 2452042, 2452043, 2452049, 2452050, 2452056, 2452057, 2452063, 2452064, 2452070, 2452071, 2452077, 2452078, 2452084, 2452085, 2452091, 2452092, 2452098, 2452099, 2452105, 2452106, 2452112, 2452113, 2452119, 2452120, 2452126, 2452127, 2452133, 2452134, 2452140, 2452141, 2452147, 2452148, 2452154, 2452155, 2452161, 2452162, 2452168, 2452169, 2452175, 2452176, 2452182, 2452183, 2452189, 2452190, 2452196, 2452197, 2452203, 2452204, 2452210, 2452211, 2452217, 2452218, 2452224, 2452225, 2452231, 2452232, 2452238, 2452239, 2452245, 2452246, 2452252, 2452253, 2452259, 2452260, 2452266, 2452267, 2452273, 2452274) group by ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city ) dn join customer on (dn.ss_customer_sk = customer.c_customer_sk) join customer_address current_addr on (customer.c_current_addr_sk = current_addr.ca_address_sk) where current_addr.ca_city <> bought_city order by c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number limit 100 Coordinator: c2110.hal.cloudera.com:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=155.06GB VCores=5 F08:PLAN FRAGMENT [UNPARTITIONED] 23:MERGING-EXCHANGE [UNPARTITIONED] order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC limit: 100 hosts=6 per-host-mem=unavailable tuple-ids=9 row-size=113B cardinality=100 F05:PLAN FRAGMENT [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] DATASTREAM SINK [FRAGMENT=F08, EXCHANGE=23, UNPARTITIONED] 14:TOP-N [LIMIT=100] | order by: c_last_name ASC, c_first_name ASC, ca_city ASC, bought_city ASC, ss_ticket_number ASC | hosts=6 per-host-mem=11.03KB | tuple-ids=9 row-size=113B cardinality=100 | 13:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: customer.c_current_addr_sk = current_addr.ca_address_sk | other predicates: current_addr.ca_city != ca_city | hosts=6 per-host-mem=451.35MB | tuple-ids=5,7,8 row-size=133B cardinality=1436530988 | |--22:EXCHANGE [BROADCAST] | hosts=6 per-host-mem=0B | tuple-ids=8 row-size=29B cardinality=15000000 | 12:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_customer_sk = customer.c_customer_sk | hosts=6 per-host-mem=1.58GB | tuple-ids=5,7 row-size=104B cardinality=1436530988 | |--21:EXCHANGE [BROADCAST] | hosts=6 per-host-mem=0B | tuple-ids=7 row-size=52B cardinality=30000000 | 20:AGGREGATE [FINALIZE] | output: sum:merge(ss_coupon_amt), sum:merge(ss_net_profit) | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | hosts=6 per-host-mem=77.53GB | tuple-ids=5 row-size=53B cardinality=1436530988 | 19:EXCHANGE [HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] hosts=6 per-host-mem=0B tuple-ids=5 row-size=53B cardinality=1436530988 F07:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=22, BROADCAST] 11:SCAN HDFS [tpcds_3000_parquet.customer_address current_addr, RANDOM] partitions=1/1 files=6 size=276.07MB table stats: 15000000 rows total column stats: all hosts=6 per-host-mem=112.00MB tuple-ids=8 row-size=29B cardinality=15000000 F06:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=21, BROADCAST] 10:SCAN HDFS [tpcds_3000_parquet.customer, RANDOM] partitions=1/1 files=12 size=1.50GB table stats: 30000000 rows total column stats: all hosts=6 per-host-mem=352.00MB tuple-ids=7 row-size=52B cardinality=30000000 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=19, HASH(ss_ticket_number,ss_customer_sk,ss_addr_sk,ca_city)] 09:AGGREGATE | output: sum(ss_coupon_amt), sum(ss_net_profit) | group by: ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city | hosts=6 per-host-mem=77.53GB | tuple-ids=5 row-size=53B cardinality=1436530988 | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_addr_sk = customer_address.ca_address_sk | hosts=6 per-host-mem=451.35MB | tuple-ids=0,1,2,3,4 row-size=122B cardinality=1436530988 | |--18:EXCHANGE [BROADCAST] | hosts=6 per-host-mem=0B | tuple-ids=4 row-size=29B cardinality=15000000 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | hosts=6 per-host-mem=14B | tuple-ids=0,1,2,3 row-size=93B cardinality=1436530988 | |--17:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=3 row-size=12B cardinality=1 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk | hosts=6 per-host-mem=23.20KB | tuple-ids=0,1,2 row-size=81B cardinality=1436530988 | |--16:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=2 row-size=12B cardinality=1800 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_store_sk = store.s_store_sk | hosts=6 per-host-mem=2.37KB | tuple-ids=0,1 row-size=69B cardinality=1436530988 | |--15:EXCHANGE [BROADCAST] | hosts=1 per-host-mem=0B | tuple-ids=1 row-size=29B cardinality=76 | 00:SCAN HDFS [tpcds_3000_parquet.store_sales, RANDOM] partitions=314/1823 files=502 size=80.89GB table stats: 8251124389 rows total column stats: all hosts=6 per-host-mem=616.00MB tuple-ids=0 row-size=40B cardinality=1436530988 F04:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=18, BROADCAST] 04:SCAN HDFS [tpcds_3000_parquet.customer_address, RANDOM] partitions=1/1 files=6 size=276.07MB table stats: 15000000 rows total column stats: all hosts=6 per-host-mem=112.00MB tuple-ids=4 row-size=29B cardinality=15000000 F03:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=17, BROADCAST] 03:SCAN HDFS [tpcds_3000_parquet.date_dim, RANDOM] partitions=1/1 files=1 size=2.17MB predicates: date_dim.d_dow IN (6, 0), date_dim.d_year IN (1999, 1999 + 1, 1999 + 2), tpcds_3000_parquet.date_dim.d_date_sk IN (2451181, 2451182, 2451188, 2451189, 2451195, 2451196, 2451202, 2451203, 2451209, 2451210, 2451216, 2451217, 2451223, 2451224, 2451230, 2451231, 2451237, 2451238, 2451244, 2451245, 2451251, 2451252, 2451258, 2451259, 2451265, 2451266, 2451272, 2451273, 2451279, 2451280, 2451286, 2451287, 2451293, 2451294, 2451300, 2451301, 2451307, 2451308, 2451314, 2451315, 2451321, 2451322, 2451328, 2451329, 2451335, 2451336, 2451342, 2451343, 2451349, 2451350, 2451356, 2451357, 2451363, 2451364, 2451370, 2451371, 2451377, 2451378, 2451384, 2451385, 2451391, 2451392, 2451398, 2451399, 2451405, 2451406, 2451412, 2451413, 2451419, 2451420, 2451426, 2451427, 2451433, 2451434, 2451440, 2451441, 2451447, 2451448, 2451454, 2451455, 2451461, 2451462, 2451468, 2451469, 2451475, 2451476, 2451482, 2451483, 2451489, 2451490, 2451496, 2451497, 2451503, 2451504, 2451510, 2451511, 2451517, 2451518, 2451524, 2451525, 2451531, 2451532, 2451538, 2451539, 2451545, 2451546, 2451552, 2451553, 2451559, 2451560, 2451566, 2451567, 2451573, 2451574, 2451580, 2451581, 2451587, 2451588, 2451594, 2451595, 2451601, 2451602, 2451608, 2451609, 2451615, 2451616, 2451622, 2451623, 2451629, 2451630, 2451636, 2451637, 2451643, 2451644, 2451650, 2451651, 2451657, 2451658, 2451664, 2451665, 2451671, 2451672, 2451678, 2451679, 2451685, 2451686, 2451692, 2451693, 2451699, 2451700, 2451706, 2451707, 2451713, 2451714, 2451720, 2451721, 2451727, 2451728, 2451734, 2451735, 2451741, 2451742, 2451748, 2451749, 2451755, 2451756, 2451762, 2451763, 2451769, 2451770, 2451776, 2451777, 2451783, 2451784, 2451790, 2451791, 2451797, 2451798, 2451804, 2451805, 2451811, 2451812, 2451818, 2451819, 2451825, 2451826, 2451832, 2451833, 2451839, 2451840, 2451846, 2451847, 2451853, 2451854, 2451860, 2451861, 2451867, 2451868, 2451874, 2451875, 2451881, 2451882, 2451888, 2451889, 2451895, 2451896, 2451902, 2451903, 2451909, 2451910, 2451916, 2451917, 2451923, 2451924, 2451930, 2451931, 2451937, 2451938, 2451944, 2451945, 2451951, 2451952, 2451958, 2451959, 2451965, 2451966, 2451972, 2451973, 2451979, 2451980, 2451986, 2451987, 2451993, 2451994, 2452000, 2452001, 2452007, 2452008, 2452014, 2452015, 2452021, 2452022, 2452028, 2452029, 2452035, 2452036, 2452042, 2452043, 2452049, 2452050, 2452056, 2452057, 2452063, 2452064, 2452070, 2452071, 2452077, 2452078, 2452084, 2452085, 2452091, 2452092, 2452098, 2452099, 2452105, 2452106, 2452112, 2452113, 2452119, 2452120, 2452126, 2452127, 2452133, 2452134, 2452140, 2452141, 2452147, 2452148, 2452154, 2452155, 2452161, 2452162, 2452168, 2452169, 2452175, 2452176, 2452182, 2452183, 2452189, 2452190, 2452196, 2452197, 2452203, 2452204, 2452210, 2452211, 2452217, 2452218, 2452224, 2452225, 2452231, 2452232, 2452238, 2452239, 2452245, 2452246, 2452252, 2452253, 2452259, 2452260, 2452266, 2452267, 2452273, 2452274) table stats: 73049 rows total column stats: all hosts=1 per-host-mem=48.00MB tuple-ids=3 row-size=12B cardinality=1 F02:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=16, BROADCAST] 02:SCAN HDFS [tpcds_3000_parquet.household_demographics, RANDOM] partitions=1/1 files=1 size=41.08KB predicates: (household_demographics.hd_dep_count = 5 OR household_demographics.hd_vehicle_count = 3) table stats: 7200 rows total column stats: all hosts=1 per-host-mem=48.00MB tuple-ids=2 row-size=12B cardinality=1800 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=15, BROADCAST] 01:SCAN HDFS [tpcds_3000_parquet.store, RANDOM] partitions=1/1 files=1 size=117.39KB predicates: store.s_city IN ('Midway', 'Concord', 'Spring Hill', 'Brownsville', 'Greenville') table stats: 1350 rows total column stats: all hosts=1 per-host-mem=32.00MB tuple-ids=1 row-size=29B cardinality=76 ---------------- Estimated Per-Host Mem: 166499563928 Estimated Per-Host VCores: 5 Request Pool: root.mj ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------- 23:MERGING-EXCHANGE 1 861.297us 861.297us 600 100 0 -1.00 B UNPARTITIONED 14:TOP-N 6 97.269ms 135.340ms 600 100 156.00 KB 11.03 KB 13:HASH JOIN 6 5s976ms 6s341ms 1.61M 1.44B 1.14 GB 451.35 MB INNER JOIN, BROADCAST |--22:EXCHANGE 6 678.724ms 689.715ms 15.00M 15.00M 0 0 BROADCAST | 11:SCAN HDFS 5 304.87ms 467.210ms 15.00M 15.00M 34.45 MB 112.00 MB tpcds_3000_parquet.customer... 12:HASH JOIN 6 14s765ms 15s547ms 1.63M 1.44B 2.89 GB 1.58 GB INNER JOIN, BROADCAST |--21:EXCHANGE 6 1s990ms 2s118ms 30.00M 30.00M 0 0 BROADCAST | 10:SCAN HDFS 6 186.679ms 264.72ms 30.00M 30.00M 67.51 MB 352.00 MB tpcds_3000_parquet.customer 20:AGGREGATE 6 196.126ms 234.583ms 1.68M 1.44B 274.76 MB 77.53 GB FINALIZE 19:EXCHANGE 6 14.557ms 16.176ms 1.68M 1.44B 0 0 HASH(ss_ticket_number,ss_cu... 09:AGGREGATE 6 1s067ms 1s097ms 1.68M 1.44B 287.22 MB 77.53 GB 08:HASH JOIN 6 25s213ms 25s799ms 17.86M 1.44B 1.14 GB 451.35 MB INNER JOIN, BROADCAST |--18:EXCHANGE 6 685.953ms 704.364ms 15.00M 15.00M 0 0 BROADCAST | 04:SCAN HDFS 5 60.45ms 78.980ms 15.00M 15.00M 34.45 MB 112.00 MB tpcds_3000_parquet.customer... 07:HASH JOIN 6 283.251ms 317.558ms 17.97M 1.44B 10.43 MB 14.00 B INNER JOIN, BROADCAST |--17:EXCHANGE 6 18.977us 21.797us 314 1 0 0 BROADCAST | 03:SCAN HDFS 1 42.873ms 42.873ms 314 1 1.22 MB 48.00 MB tpcds_3000_parquet.date_dim 06:HASH JOIN 6 469.674ms 528.619ms 17.97M 1.44B 8.47 MB 23.20 KB INNER JOIN, BROADCAST |--16:EXCHANGE 6 76.337us 95.537us 1.80K 1.80K 0 0 BROADCAST | 02:SCAN HDFS 1 8.849ms 8.849ms 1.80K 1.80K 217.83 KB 48.00 MB tpcds_3000_parquet.househol... 05:HASH JOIN 6 796.189ms 866.103ms 38.09M 1.44B 5.21 MB 2.37 KB INNER JOIN, BROADCAST |--15:EXCHANGE 6 14.321us 20.705us 76 76 0 0 BROADCAST | 01:SCAN HDFS 1 9.268ms 9.268ms 76 76 195.82 KB 32.00 MB tpcds_3000_parquet.store 00:SCAN HDFS 6 11s419ms 13s929ms 77.93M 1.44B 625.07 MB 616.00 MB tpcds_3000_parquet.store_sales Planner Timeline: 640.989ms - Analysis finished: 164.467ms (164.467ms) - Equivalence classes computed: 217.194ms (52.726ms) - Single node plan created: 322.415ms (105.221ms) - Distributed plan created: 348.369ms (25.954ms) - Lineage info computed: 382.566ms (34.197ms) - Planning finished: 640.989ms (258.422ms) Query Timeline: 39s494ms - Start execution: 57.417us (57.417us) - Planning finished: 704.218ms (704.160ms) - Ready to start remote fragments: 721.689ms (17.471ms) - Remote fragments started: 1s798ms (1s077ms) - Rows available: 39s132ms (37s333ms) - First row fetched: 39s409ms (277.11ms) - Unregister query: 39s470ms (61.339ms) ImpalaServer: - ClientFetchWaitTimer: 331.757ms - RowMaterializationTimer: 780.203us Execution Profile 24449bb4dc430956:ca0f6ca2e0cb4992:(Total: 38s417ms, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 31, last: 0.030103ns, min: 0.009207ns, max: 0.506450ns, mean: 0.143479ns, stddev: 0.150260ns Per Node Peak Memory Usage: c2114.hal.cloudera.com:22000(5.56 GB) c2106.hal.cloudera.com:22000(5.58 GB) c2104.hal.cloudera.com:22000(5.97 GB) c2108.hal.cloudera.com:22000(5.57 GB) c2112.hal.cloudera.com:22000(5.81 GB) c2110.hal.cloudera.com:22000(5.72 GB) - FinalizationTimer: 0ns Coordinator Fragment F08:(Total: 37s333ms, non-child: 953.691us, % non-child: 0.00%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB ThreadUsage(500.0ms): 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 92.78 KB (95008) - PerHostPeakMemUsage: 0 - PrepareTime: 35.436us - RowsProduced: 100 (100) - TotalCpuTime: 38s690ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 784 (784) - BlocksRecycled: 241 (241) - BufferedPins: 4 (4) - BytesWritten: 8.00 MB (8388534) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385830912) - PeakMemoryUsage: 5.43 GB (5826491328) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 9.268ms EXCHANGE_NODE (id=23):(Total: 37s332ms, non-child: 861.297us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 24.00 KB (24574) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 148.768us - FirstBatchArrivalWaitTime: 37s331ms - MergeGetNext: 792.724us - MergeGetNextBatch: 18.943us - PeakMemoryUsage: 0 - RowsReturned: 600 (600) - RowsReturnedRate: 16.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F05:(Total: 37s721ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:37s973ms max:38s134ms mean: 38s025ms stddev:52.697351.697.350838ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 6 - AverageThreadTokens: 2.19 - PeakMemoryUsage: 4.04 GB (4335680818) - PerHostPeakMemUsage: 5.70 GB (6120827080) - PrepareTime: 269.231ms - RowsProduced: 100 (100) - TotalCpuTime: 45s489ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 468.99us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 773 (773) - BlocksRecycled: 251 (251) - BufferedPins: 4 (4) - BytesWritten: 6.40 MB (6710848) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385780531) - PeakMemoryUsage: 5.26 GB (5643894924) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 5.602ms CodeGen:(Total: 824.31ms, non-child: 824.31ms, % non-child: 100.00%) - CodegenTime: 6.327ms - CompileTime: 143.97ms - LoadTime: 78.539us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 428.491ms - PrepareTime: 250.493ms DataStreamSender (dst_id=23):(Total: 83.124us, non-child: 83.124us, % non-child: 100.00%) - BytesSent: 4.00 KB (4095) - NetworkThroughput(*): 12.08 MB/sec - OverallThroughput: 47.11 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 54.704us - ThriftTransmitTime(*): 324.446us - UncompressedRowBatchSize: 9.85 KB (10091) SORT_NODE (id=14):(Total: 37s720ms, non-child: 97.269ms, % non-child: 0.26%) - PeakMemoryUsage: 152.00 KB (155648) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s622ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 2s310ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s370ms - GetNewBlockTime: 9.635ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 270.87K (270874) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.892ms - RowsReturned: 268.71K (268711) - RowsReturnedRate: 7.14 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.269us EXCHANGE_NODE (id=22):(Total: 14s244ms, non-child: 14s244ms, % non-child: 100.00%) - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 458.237ms - DeserializeRowBatchTimer: 1s343ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.05 M/sec - SendersBlockedTimer: 65.451ms - SendersBlockedTotalTimer(*): 294.106ms HASH_JOIN_NODE (id=12):(Total: 37s224ms, non-child: 0ns, % non-child: 0.00%) - BuildPartitionTime: 6s649ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 5s532ms - GetNewBlockTime: 4.915ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 279.93K (279925) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 132.932ms - RowsReturned: 270.87K (270874) - RowsReturnedRate: 7.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.168us EXCHANGE_NODE (id=21):(Total: 11s053ms, non-child: 11s053ms, % non-child: 100.00%) - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 867.310ms - DeserializeRowBatchTimer: 4s429ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.72 M/sec - SendersBlockedTimer: 142.472ms - SendersBlockedTotalTimer(*): 587.454ms AGGREGATION_NODE (id=20):(Total: 37s073ms, non-child: 196.126ms, % non-child: 0.53%) - BuildTime: 159.718ms - GetNewBlockTime: 531.218us - GetResultsTime: 16.732ms - HTResizeTime: 18.818ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288109180) - PinTime: 2.361us - RowsRepartitioned: 17.55K (17555) - RowsReturned: 279.93K (279925) - RowsReturnedRate: 7.55 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 12.249us EXCHANGE_NODE (id=19):(Total: 36s877ms, non-child: 36s877ms, % non-child: 100.00%) - BytesReceived: 11.19 MB (11734875) - ConvertRowBatchTime: 8.388ms - DeserializeRowBatchTimer: 35.830ms - FirstBatchArrivalWaitTime: 31s566ms - PeakMemoryUsage: 0 - RowsReturned: 279.93K (279928) - RowsReturnedRate: 7.59 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F07:(Total: 10s499ms, non-child: 22.569ms, % non-child: 0.21%) split sizes: min: 46.01 MB, max: 91.93 MB, avg: 55.21 MB, stddev: 18.36 MB completion times: min:8s673ms max:17s116ms mean: 10s488ms stddev:3s315ms execution rates: min:5.11 MB/sec max:5.37 MB/sec mean:5.24 MB/sec stddev:91.69 KB/sec num instances: 5 - AverageThreadTokens: 2.14 - PeakMemoryUsage: 22.81 MB (23918643) - PerHostPeakMemUsage: 2.66 GB (2853941652) - PrepareTime: 28.485ms - RowsProduced: 3.00M (3000000) - TotalCpuTime: 14s389ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s163ms - TotalStorageWaitTime: 272.632ms DataStreamSender (dst_id=22):(Total: 10s172ms, non-child: 10s172ms, % non-child: 100.00%) - BytesSent: 357.46 MB (374825671) - NetworkThroughput(*): 7.90 MB/sec - OverallThroughput: 35.10 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 862.707ms - ThriftTransmitTime(*): 45s060ms - UncompressedRowBatchSize: 629.78 MB (660374878) HDFS_SCAN_NODE (id=11):(Total: 304.87ms, non-child: 304.87ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 1.14 - BytesRead: 15.25 MB (15994771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 15.25 MB (15994771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15.25 MB (15994771) - DecompressionTime: 7.285ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 22.74 MB (23848129) - PerReadThreadRawHdfsThroughput: 682.23 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 3.00M (3000000) - RowsReturned: 3.00M (3000000) - RowsReturnedRate: 10.34 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 197 (197) - ScannerThreadsTotalWallClockTime: 13s292ms - MaterializeTupleTime(*): 13s001ms - ScannerThreadsSysTime: 31.194ms - ScannerThreadsUserTime: 479.726ms - ScannerThreadsVoluntaryContextSwitches: 2.89K (2890) - TotalRawHdfsReadTime(*): 52.618ms - TotalReadThroughput: 1.43 MB/sec Averaged Fragment F06:(Total: 16s736ms, non-child: 19.594ms, % non-child: 0.12%) split sizes: min: 253.43 MB, max: 261.21 MB, avg: 256.06 MB, stddev: 2.59 MB completion times: min:14s532ms max:18s173ms mean: 16s760ms stddev:1s184ms execution rates: min:14.09 MB/sec max:17.97 MB/sec mean:15.37 MB/sec stddev:1.28 MB/sec num instances: 6 - AverageThreadTokens: 1.98 - PeakMemoryUsage: 66.61 MB (69844457) - PerHostPeakMemUsage: 3.57 GB (3833402802) - PrepareTime: 5.296ms - RowsProduced: 5.00M (5000000) - TotalCpuTime: 19s510ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 13s536ms - TotalStorageWaitTime: 283.857ms DataStreamSender (dst_id=21):(Total: 16s529ms, non-child: 16s529ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1135897936) - NetworkThroughput(*): 15.22 MB/sec - OverallThroughput: 65.95 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s798ms - ThriftTransmitTime(*): 1m11s - UncompressedRowBatchSize: 1.78 GB (1906577795) HDFS_SCAN_NODE (id=10):(Total: 186.679ms, non-child: 186.679ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.98 - BytesRead: 54.30 MB (56932680) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.30 MB (56932680) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.30 MB (56932680) - DecompressionTime: 24.621ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 66.51 MB (69740337) - PerReadThreadRawHdfsThroughput: 943.35 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.00M (5000000) - RowsReturned: 5.00M (5000000) - RowsReturnedRate: 28.83 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 832 (832) - ScannerThreadsTotalWallClockTime: 16s557ms - MaterializeTupleTime(*): 16s231ms - ScannerThreadsSysTime: 62.989ms - ScannerThreadsUserTime: 1s547ms - ScannerThreadsVoluntaryContextSwitches: 4.81K (4810) - TotalRawHdfsReadTime(*): 58.429ms - TotalReadThroughput: 3.25 MB/sec Averaged Fragment F00:(Total: 34s042ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 13.41 GB, max: 13.58 GB, avg: 13.48 GB, stddev: 54.18 MB completion times: min:31s875ms max:36s929ms mean: 34s441ms stddev:1s745ms execution rates: min:376.63 MB/sec max:433.70 MB/sec mean:401.81 MB/sec stddev:19.61 MB/sec num instances: 6 - AverageThreadTokens: 9.61 - PeakMemoryUsage: 1.66 GB (1786127596) - PerHostPeakMemUsage: 5.70 GB (6120827080) - PrepareTime: 351.105ms - RowsProduced: 279.93K (279928) - TotalCpuTime: 5m4s - TotalNetworkReceiveTime: 13s604ms - TotalNetworkSendTime: 16.720ms - TotalStorageWaitTime: 13s774ms CodeGen:(Total: 1s067ms, non-child: 1s067ms, % non-child: 100.00%) - CodegenTime: 7.156ms - CompileTime: 217.457ms - LoadTime: 76.227us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 528.281ms - PrepareTime: 319.355ms DataStreamSender (dst_id=19):(Total: 198.46ms, non-child: 198.46ms, % non-child: 100.00%) - BytesSent: 11.19 MB (11734875) - NetworkThroughput(*): 16.97 MB/sec - OverallThroughput: 56.64 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 95.691ms - ThriftTransmitTime(*): 662.44ms - UncompressedRowBatchSize: 16.20 MB (16990420) AGGREGATION_NODE (id=9):(Total: 33s837ms, non-child: 1s067ms, % non-child: 3.15%) - BuildTime: 670.577ms - GetNewBlockTime: 22.509ms - GetResultsTime: 16.888ms - HTResizeTime: 21.53ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 285.35 MB (299207065) - PinTime: 6.221ms - RowsRepartitioned: 87.23K (87231) - RowsReturned: 279.93K (279928) - RowsReturnedRate: 8.29 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 12.843us HASH_JOIN_NODE (id=8):(Total: 32s769ms, non-child: 5s696ms, % non-child: 17.38%) - BuildPartitionTime: 2s352ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s188ms - GetNewBlockTime: 4.528ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 2.99M (2994263) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 339.359ms - RowsReturned: 2.98M (2976011) - RowsReturnedRate: 91.08 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.502us EXCHANGE_NODE (id=18):(Total: 14s109ms, non-child: 14s109ms, % non-child: 100.00%) - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 460.860ms - DeserializeRowBatchTimer: 1s360ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 234.50ms - SendersBlockedTotalTimer(*): 1s017ms HASH_JOIN_NODE (id=7):(Total: 12s964ms, non-child: 281.904ms, % non-child: 2.17%) - BuildPartitionTime: 29.467us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 103.67us - GetNewBlockTime: 491.625us - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.33 MB (9787784) - PinTime: 0ns - ProbeRows: 2.99M (2994263) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 260.67ms - RowsReturned: 2.99M (2994263) - RowsReturnedRate: 235.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.599us EXCHANGE_NODE (id=17):(Total: 18.977us, non-child: 18.977us, % non-child: 100.00%) - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 8.989us - DeserializeRowBatchTimer: 15.276us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 16.64 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s682ms, non-child: 467.980ms, % non-child: 3.69%) - BuildPartitionTime: 184.486us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 325.571us - GetNewBlockTime: 440.331us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 7.35 MB (7708468) - PinTime: 0ns - ProbeRows: 6.35M (6347533) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 428.277ms - RowsReturned: 2.99M (2994263) - RowsReturnedRate: 240.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.758us EXCHANGE_NODE (id=16):(Total: 76.337us, non-child: 76.337us, % non-child: 100.00%) - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 59.606us - DeserializeRowBatchTimer: 57.882us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 24.13 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s214ms, non-child: 795.177ms, % non-child: 6.51%) - BuildPartitionTime: 17.51us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 55.388us - GetNewBlockTime: 338.927us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.14 MB (5391552) - PinTime: 0ns - ProbeRows: 12.99M (12987590) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 734.462ms - RowsReturned: 6.35M (6347533) - RowsReturnedRate: 531.73 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.294us EXCHANGE_NODE (id=15):(Total: 14.321us, non-child: 14.321us, % non-child: 100.00%) - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 3.380us - DeserializeRowBatchTimer: 13.492us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 5.56 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 11s419ms, non-child: 11s419ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 8.40 - BytesRead: 2.43 GB (2605882504) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.43 GB (2605882504) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.43 GB (2605882504) - DecompressionTime: 9s700ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 410.23 MB (430158034) - PerReadThreadRawHdfsThroughput: 173.35 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 239.42M (239421831) - RowsReturned: 12.99M (12987590) - RowsReturnedRate: 1.17 M/sec - ScanRangesComplete: 83 (83) - ScannerThreadsInvoluntaryContextSwitches: 12.53K (12531) - ScannerThreadsTotalWallClockTime: 4m37s - MaterializeTupleTime(*): 4m10s - ScannerThreadsSysTime: 254.623ms - ScannerThreadsUserTime: 1m36s - ScannerThreadsVoluntaryContextSwitches: 1.45K (1446) - TotalRawHdfsReadTime(*): 14s881ms - TotalReadThroughput: 72.91 MB/sec Averaged Fragment F04:(Total: 10s629ms, non-child: 11.358ms, % non-child: 0.11%) split sizes: min: 46.01 MB, max: 91.93 MB, avg: 55.21 MB, stddev: 18.36 MB completion times: min:8s977ms max:17s073ms mean: 10s653ms stddev:3s210ms execution rates: min:5.02 MB/sec max:5.38 MB/sec mean:5.15 MB/sec stddev:127.89 KB/sec num instances: 5 - AverageThreadTokens: 2.15 - PeakMemoryUsage: 22.81 MB (23915272) - PerHostPeakMemUsage: 2.81 GB (3017114136) - PrepareTime: 119.561us - RowsProduced: 3.00M (3000000) - TotalCpuTime: 14s698ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 9s513ms - TotalStorageWaitTime: 18.357ms DataStreamSender (dst_id=18):(Total: 10s558ms, non-child: 10s558ms, % non-child: 100.00%) - BytesSent: 374.04 MB (392212074) - NetworkThroughput(*): 8.03 MB/sec - OverallThroughput: 35.45 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 906.109ms - ThriftTransmitTime(*): 46s584ms - UncompressedRowBatchSize: 629.78 MB (660374878) HDFS_SCAN_NODE (id=4):(Total: 60.45ms, non-child: 60.45ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.15 - BytesRead: 15.25 MB (15994771) - BytesReadDataNodeCache: 0 - BytesReadLocal: 15.25 MB (15994771) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 15.25 MB (15994771) - DecompressionTime: 7.506ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 22.74 MB (23848120) - PerReadThreadRawHdfsThroughput: 770.83 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 3.00M (3000000) - RowsReturned: 3.00M (3000000) - RowsReturnedRate: 49.43 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 207 (207) - ScannerThreadsTotalWallClockTime: 13s572ms - MaterializeTupleTime(*): 13s538ms - ScannerThreadsSysTime: 29.994ms - ScannerThreadsUserTime: 485.325ms - ScannerThreadsVoluntaryContextSwitches: 2.90K (2895) - TotalRawHdfsReadTime(*): 20.175ms - TotalReadThroughput: 1.43 MB/sec Averaged Fragment F03:(Total: 46.908ms, non-child: 3.903ms, % non-child: 8.32%) split sizes: min: 2.17 MB, max: 2.17 MB, avg: 2.17 MB, stddev: 0 completion times: min:63.250ms max:63.250ms mean: 63.250145.250.145000ms stddev:0.000000ns execution rates: min:34.28 MB/sec max:34.28 MB/sec mean:34.28 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - PeakMemoryUsage: 1.28 MB (1341336) - PerHostPeakMemUsage: 648.41 MB (679905352) - PrepareTime: 404.844us - RowsProduced: 314 (314) - TotalCpuTime: 93.759ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.14ms - TotalStorageWaitTime: 9.561ms DataStreamSender (dst_id=17):(Total: 132.377us, non-child: 132.377us, % non-child: 100.00%) - BytesSent: 19.66 KB (20130) - NetworkThroughput(*): 1.11 MB/sec - OverallThroughput: 145.02 MB/sec - PeakMemoryUsage: 48.00 KB (49152) - SerializeBatchTime: 66.360us - ThriftTransmitTime(*): 17.269ms - UncompressedRowBatchSize: 36.82 KB (37704) HDFS_SCAN_NODE (id=3):(Total: 42.873ms, non-child: 42.873ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 466.62 KB (477816) - BytesReadDataNodeCache: 0 - BytesReadLocal: 466.62 KB (477816) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 466.62 KB (477816) - DecompressionTime: 425.906us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.22 MB (1283992) - PerReadThreadRawHdfsThroughput: 145.79 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 314 (314) - RowsReturnedRate: 7.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 42.150ms - MaterializeTupleTime(*): 30.672ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 3.125ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 18.382ms, non-child: 3.883ms, % non-child: 21.13%) split sizes: min: 41.08 KB, max: 41.08 KB, avg: 41.08 KB, stddev: 0 completion times: min:32.855ms max:32.855ms mean: 32.855458.855.458000ms stddev:0.000000ns execution rates: min:1.22 MB/sec max:1.22 MB/sec mean:1.22 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - PeakMemoryUsage: 273.83 KB (280400) - PerHostPeakMemUsage: 647.96 MB (679439464) - PrepareTime: 139.683us - RowsProduced: 1.80K (1800) - TotalCpuTime: 30.237ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.636ms - TotalStorageWaitTime: 6.383ms DataStreamSender (dst_id=16):(Total: 5.648ms, non-child: 5.648ms, % non-child: 100.00%) - BytesSent: 98.51 KB (100872) - NetworkThroughput(*): 4.06 MB/sec - OverallThroughput: 17.03 MB/sec - PeakMemoryUsage: 48.00 KB (49152) - SerializeBatchTime: 305.103us - ThriftTransmitTime(*): 23.712ms - UncompressedRowBatchSize: 210.98 KB (216048) HDFS_SCAN_NODE (id=2):(Total: 8.849ms, non-child: 8.849ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 80.91 KB (82848) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.91 KB (82848) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.91 KB (82848) - DecompressionTime: 9.209us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 217.83 KB (223056) - PerReadThreadRawHdfsThroughput: 73.14 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.20K (7200) - RowsReturned: 1.80K (1800) - RowsReturnedRate: 203.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 8.668ms - MaterializeTupleTime(*): 1.816ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 999.0us - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 1.80ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 13.358ms, non-child: 3.382ms, % non-child: 25.32%) split sizes: min: 117.39 KB, max: 117.39 KB, avg: 117.39 KB, stddev: 0 completion times: min:29.519ms max:29.519ms mean: 29.519887.519.887000ms stddev:0.000000ns execution rates: min:3.88 MB/sec max:3.88 MB/sec mean:3.88 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - PeakMemoryUsage: 235.79 KB (241448) - PerHostPeakMemUsage: 649.61 MB (681169352) - PrepareTime: 209.564us - RowsProduced: 76 (76) - TotalCpuTime: 32.365ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 3.67ms - TotalStorageWaitTime: 7.467ms DataStreamSender (dst_id=15):(Total: 707.805us, non-child: 707.805us, % non-child: 100.00%) - BytesSent: 10.86 KB (11118) - NetworkThroughput(*): 770.02 KB/sec - OverallThroughput: 14.98 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 55.382us - ThriftTransmitTime(*): 14.100ms - UncompressedRowBatchSize: 16.32 KB (16716) HDFS_SCAN_NODE (id=1):(Total: 9.268ms, non-child: 9.268ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 109.21 KB (111826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 109.21 KB (111826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 109.21 KB (111826) - DecompressionTime: 3.510us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 195.82 KB (200520) - PerReadThreadRawHdfsThroughput: 149.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.35K (1350) - RowsReturned: 76 (76) - RowsReturnedRate: 8.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 8.392ms - MaterializeTupleTime(*): 431.16us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 711.295us - TotalReadThroughput: 0.00 /sec Fragment F05: Instance 24449bb4dc430956:ca0f6ca2e0cb4994 (host=c2112.hal.cloudera.com:22000):(Total: 37s803ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(1s000ms): 9.14 MB, 535.47 MB, 663.48 MB, 791.46 MB, 919.51 MB, 1.02 GB, 1.15 GB, 1.27 GB, 1.40 GB, 1.59 GB, 1.71 GB, 1.84 GB, 1.96 GB, 2.09 GB, 2.15 GB, 2.27 GB, 2.40 GB, 2.41 GB, 2.73 GB, 3.01 GB, 3.27 GB, 3.30 GB, 3.40 GB, 3.49 GB, 3.62 GB, 3.68 GB, 3.80 GB, 3.84 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.78 GB, 3.78 GB, 3.78 GB, 4.04 GB, 4.04 GB, 4.04 GB ThreadUsage(1s000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.21 - PeakMemoryUsage: 4.04 GB (4335698528) - PerHostPeakMemUsage: 5.81 GB (6236361296) - PrepareTime: 260.487ms - RowsProduced: 100 (100) - TotalCpuTime: 46s485ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 453.991us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 783 (783) - BlocksRecycled: 242 (242) - BufferedPins: 4 (4) - BytesWritten: 8.00 MB (8388595) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385830912) - PeakMemoryUsage: 5.44 GB (5837501376) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 7.57ms CodeGen:(Total: 834.905ms, non-child: 834.905ms, % non-child: 100.00%) - CodegenTime: 6.251ms - CompileTime: 143.550ms - LoadTime: 68.266us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 446.823ms - PrepareTime: 242.669ms DataStreamSender (dst_id=23):(Total: 75.566us, non-child: 75.566us, % non-child: 100.00%) - BytesSent: 4.00 KB (4097) - NetworkThroughput(*): 12.34 MB/sec - OverallThroughput: 51.71 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 52.291us - ThriftTransmitTime(*): 316.613us - UncompressedRowBatchSize: 9.87 KB (10109) SORT_NODE (id=14):(Total: 37s801ms, non-child: 135.340ms, % non-child: 0.36%) - PeakMemoryUsage: 132.00 KB (135168) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s666ms, non-child: 5s893ms, % non-child: 15.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s180ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s383ms - GetNewBlockTime: 2.536ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 311.44K (311441) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 168.129ms - RowsReturned: 308.04K (308044) - RowsReturnedRate: 8.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.388us EXCHANGE_NODE (id=22):(Total: 14s372ms, non-child: 665.969ms, % non-child: 4.63%) BytesReceived(1s000ms): 10.67 MB, 41.52 MB, 69.85 MB, 98.33 MB, 126.66 MB, 155.12 MB, 183.54 MB, 211.94 MB, 240.13 MB, 252.85 MB, 258.85 MB, 264.72 MB, 270.70 MB, 276.58 MB, 282.52 MB, 288.54 MB, 294.58 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 449.80ms - DeserializeRowBatchTimer: 1s248ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.04 M/sec - SendersBlockedTimer: 74.262ms - SendersBlockedTotalTimer(*): 350.588ms HASH_JOIN_NODE (id=12):(Total: 37s241ms, non-child: 15s102ms, % non-child: 40.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 5s981ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 6s275ms - GetNewBlockTime: 3.194ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 321.81K (321810) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 160.386ms - RowsReturned: 311.44K (311441) - RowsReturnedRate: 8.36 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.110us EXCHANGE_NODE (id=21):(Total: 11s716ms, non-child: 1s762ms, % non-child: 15.04%) BytesReceived(1s000ms): 14.71 MB, 72.57 MB, 131.01 MB, 189.86 MB, 248.86 MB, 307.91 MB, 366.60 MB, 425.42 MB, 484.50 MB, 547.94 MB, 621.07 MB, 693.99 MB, 766.70 MB, 839.42 MB, 910.45 MB, 971.23 MB, 1.00 GB, 1.04 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 784.898ms - DeserializeRowBatchTimer: 4s121ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.56 M/sec - SendersBlockedTimer: 151.420ms - SendersBlockedTotalTimer(*): 500.814ms AGGREGATION_NODE (id=20):(Total: 37s067ms, non-child: 234.583ms, % non-child: 0.63%) ExecOption: Codegen Enabled, Spilled - BuildTime: 192.111ms - GetNewBlockTime: 502.437us - GetResultsTime: 21.195ms - HTResizeTime: 16.600ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288108032) - PinTime: 2.482us - RowsRepartitioned: 20.04K (20044) - RowsReturned: 321.81K (321810) - RowsReturnedRate: 8.68 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 10.702us EXCHANGE_NODE (id=19):(Total: 36s833ms, non-child: 16.176ms, % non-child: 0.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2.05 MB, 3.17 MB, 6.57 MB, 8.43 MB, 9.43 MB - BytesReceived: 12.69 MB (13305789) - ConvertRowBatchTime: 9.668ms - DeserializeRowBatchTimer: 43.29ms - FirstBatchArrivalWaitTime: 31s556ms - PeakMemoryUsage: 0 - RowsReturned: 321.81K (321815) - RowsReturnedRate: 8.74 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 24449bb4dc430956:ca0f6ca2e0cb4996 (host=c2104.hal.cloudera.com:22000):(Total: 37s735ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(1s000ms): 17.44 MB, 535.49 MB, 663.48 MB, 791.49 MB, 919.51 MB, 1.02 GB, 1.15 GB, 1.34 GB, 1.40 GB, 1.59 GB, 1.71 GB, 1.84 GB, 1.96 GB, 2.09 GB, 2.21 GB, 2.27 GB, 2.40 GB, 2.43 GB, 2.74 GB, 3.02 GB, 3.27 GB, 3.30 GB, 3.43 GB, 3.55 GB, 3.65 GB, 3.74 GB, 3.87 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.78 GB, 3.78 GB, 3.78 GB, 4.04 GB, 4.04 GB, 4.04 GB ThreadUsage(1s000ms): 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.19 - PeakMemoryUsage: 4.04 GB (4335677272) - PerHostPeakMemUsage: 5.97 GB (6405433768) - PrepareTime: 274.564ms - RowsProduced: 100 (100) - TotalCpuTime: 46s123ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 453.162us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 772 (772) - BlocksRecycled: 253 (253) - BufferedPins: 5 (5) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385579008) - PeakMemoryUsage: 5.30 GB (5687555008) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 804.967ms, non-child: 804.967ms, % non-child: 100.00%) - CodegenTime: 6.62ms - CompileTime: 136.674ms - LoadTime: 72.166us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 411.26ms - PrepareTime: 255.380ms DataStreamSender (dst_id=23):(Total: 83.209us, non-child: 83.209us, % non-child: 100.00%) - BytesSent: 4.02 KB (4118) - NetworkThroughput(*): 12.60 MB/sec - OverallThroughput: 47.20 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 55.134us - ThriftTransmitTime(*): 311.804us - UncompressedRowBatchSize: 9.85 KB (10082) SORT_NODE (id=14):(Total: 37s734ms, non-child: 89.278ms, % non-child: 0.24%) - PeakMemoryUsage: 156.00 KB (159744) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s644ms, non-child: 6s013ms, % non-child: 15.97%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s241ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s516ms - GetNewBlockTime: 1.833ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 263.45K (263446) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 133.884ms - RowsReturned: 261.45K (261453) - RowsReturnedRate: 6.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.117us EXCHANGE_NODE (id=22):(Total: 14s331ms, non-child: 659.28ms, % non-child: 4.60%) BytesReceived(1s000ms): 13.92 MB, 44.48 MB, 72.73 MB, 101.19 MB, 129.52 MB, 158.09 MB, 186.48 MB, 214.84 MB, 242.33 MB, 253.44 MB, 259.47 MB, 265.38 MB, 271.32 MB, 277.19 MB, 283.15 MB, 289.16 MB, 295.21 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 448.56ms - DeserializeRowBatchTimer: 1s370ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.05 M/sec - SendersBlockedTimer: 49.275ms - SendersBlockedTotalTimer(*): 225.656ms HASH_JOIN_NODE (id=12):(Total: 37s240ms, non-child: 15s252ms, % non-child: 40.96%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 6s637ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 5s880ms - GetNewBlockTime: 4.938ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 272.47K (272466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 139.678ms - RowsReturned: 263.45K (263446) - RowsReturnedRate: 7.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.156us EXCHANGE_NODE (id=21):(Total: 11s082ms, non-child: 1s889ms, % non-child: 17.05%) BytesReceived(1s000ms): 20.30 MB, 78.48 MB, 137.01 MB, 195.72 MB, 254.95 MB, 313.97 MB, 372.67 MB, 431.54 MB, 490.81 MB, 555.23 MB, 628.53 MB, 701.32 MB, 774.14 MB, 846.52 MB, 917.02 MB, 977.30 MB, 1.01 GB, 1.04 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 861.149ms - DeserializeRowBatchTimer: 4s541ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.71 M/sec - SendersBlockedTimer: 125.774ms - SendersBlockedTotalTimer(*): 374.973ms AGGREGATION_NODE (id=20):(Total: 37s088ms, non-child: 178.112ms, % non-child: 0.48%) ExecOption: Codegen Enabled, Spilled - BuildTime: 143.24ms - GetNewBlockTime: 257.166us - GetResultsTime: 15.820ms - HTResizeTime: 13.918ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288109416) - PinTime: 2.329us - RowsRepartitioned: 17.05K (17046) - RowsReturned: 272.47K (272466) - RowsReturnedRate: 7.35 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 12.940us EXCHANGE_NODE (id=19):(Total: 36s909ms, non-child: 14.597ms, % non-child: 0.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.83 MB, 2.84 MB, 6.26 MB, 7.28 MB, 8.19 MB - BytesReceived: 10.93 MB (11457044) - ConvertRowBatchTime: 7.921ms - DeserializeRowBatchTimer: 34.739ms - FirstBatchArrivalWaitTime: 31s582ms - PeakMemoryUsage: 0 - RowsReturned: 272.47K (272467) - RowsReturnedRate: 7.38 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 24449bb4dc430956:ca0f6ca2e0cb4995 (host=c2108.hal.cloudera.com:22000):(Total: 37s734ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(1s000ms): 276.16 MB, 535.55 MB, 663.46 MB, 791.59 MB, 983.51 MB, 1.02 GB, 1.27 GB, 1.34 GB, 1.40 GB, 1.61 GB, 1.77 GB, 1.90 GB, 1.96 GB, 2.09 GB, 2.21 GB, 2.27 GB, 2.40 GB, 2.44 GB, 2.76 GB, 3.04 GB, 3.23 GB, 3.30 GB, 3.43 GB, 3.55 GB, 3.68 GB, 3.80 GB, 3.84 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.78 GB, 3.78 GB, 3.91 GB, 4.04 GB, 4.04 GB, 4.03 GB ThreadUsage(1s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.21 - PeakMemoryUsage: 4.04 GB (4335677320) - PerHostPeakMemUsage: 5.57 GB (5978501520) - PrepareTime: 266.602ms - RowsProduced: 100 (100) - TotalCpuTime: 46s030ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 447.102us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 773 (773) - BlocksRecycled: 252 (252) - BufferedPins: 4 (4) - BytesWritten: 8.00 MB (8388590) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385830912) - PeakMemoryUsage: 5.18 GB (5565526976) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 6.650ms CodeGen:(Total: 819.741ms, non-child: 819.741ms, % non-child: 100.00%) - CodegenTime: 6.76ms - CompileTime: 148.998ms - LoadTime: 95.68us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 420.308ms - PrepareTime: 248.410ms DataStreamSender (dst_id=23):(Total: 83.779us, non-child: 83.779us, % non-child: 100.00%) - BytesSent: 3.94 KB (4039) - NetworkThroughput(*): 11.30 MB/sec - OverallThroughput: 45.98 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 54.382us - ThriftTransmitTime(*): 340.863us - UncompressedRowBatchSize: 9.86 KB (10100) SORT_NODE (id=14):(Total: 37s732ms, non-child: 91.538ms, % non-child: 0.24%) - PeakMemoryUsage: 156.00 KB (159744) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s641ms, non-child: 6s341ms, % non-child: 16.85%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s535ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s480ms - GetNewBlockTime: 2.526ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 262.64K (262638) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 126.886ms - RowsReturned: 260.77K (260767) - RowsReturnedRate: 6.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.277us EXCHANGE_NODE (id=22):(Total: 14s027ms, non-child: 689.715ms, % non-child: 4.92%) BytesReceived(1s000ms): 5.29 MB, 34.19 MB, 63.53 MB, 91.91 MB, 120.22 MB, 148.73 MB, 177.23 MB, 205.66 MB, 234.27 MB, 251.53 MB, 257.49 MB, 263.45 MB, 269.40 MB, 275.32 MB, 281.19 MB, 287.21 MB, 293.22 MB, 297.81 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 463.996ms - DeserializeRowBatchTimer: 1s340ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.07 M/sec - SendersBlockedTimer: 59.74ms - SendersBlockedTotalTimer(*): 274.844ms HASH_JOIN_NODE (id=12):(Total: 37s251ms, non-child: 15s547ms, % non-child: 41.74%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 7s027ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 5s846ms - GetNewBlockTime: 8.90ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 271.15K (271155) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 129.700ms - RowsReturned: 262.64K (262638) - RowsReturnedRate: 7.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.301us EXCHANGE_NODE (id=21):(Total: 10s678ms, non-child: 2s017ms, % non-child: 18.89%) BytesReceived(1s000ms): 5.55 MB, 58.05 MB, 117.86 MB, 176.72 MB, 235.60 MB, 294.73 MB, 353.59 MB, 412.40 MB, 471.34 MB, 533.55 MB, 604.70 MB, 677.89 MB, 750.52 MB, 823.05 MB, 895.46 MB, 958.40 MB, 1016.19 MB, 1.03 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 886.336ms - DeserializeRowBatchTimer: 4s370ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.81 M/sec - SendersBlockedTimer: 137.53ms - SendersBlockedTotalTimer(*): 550.619ms AGGREGATION_NODE (id=20):(Total: 37s076ms, non-child: 173.823ms, % non-child: 0.47%) ExecOption: Codegen Enabled, Spilled - BuildTime: 138.499ms - GetNewBlockTime: 259.75us - GetResultsTime: 16.285ms - HTResizeTime: 12.668ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288109408) - PinTime: 2.229us - RowsRepartitioned: 17.05K (17047) - RowsReturned: 271.15K (271155) - RowsReturnedRate: 7.31 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 11.653us EXCHANGE_NODE (id=19):(Total: 36s902ms, non-child: 13.687ms, % non-child: 0.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 930.32 KB, 2.63 MB, 5.37 MB, 7.24 MB, 7.31 MB - BytesReceived: 10.88 MB (11405537) - ConvertRowBatchTime: 7.286ms - DeserializeRowBatchTimer: 36.852ms - FirstBatchArrivalWaitTime: 31s573ms - PeakMemoryUsage: 0 - RowsReturned: 271.16K (271162) - RowsReturnedRate: 7.35 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 24449bb4dc430956:ca0f6ca2e0cb4997 (host=c2110.hal.cloudera.com:22000):(Total: 37s705ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(1s000ms): 269.41 MB, 535.46 MB, 663.61 MB, 855.57 MB, 983.64 MB, 1.02 GB, 1.27 GB, 1.34 GB, 1.40 GB, 1.65 GB, 1.77 GB, 1.90 GB, 2.02 GB, 2.09 GB, 2.21 GB, 2.27 GB, 2.40 GB, 2.52 GB, 2.77 GB, 3.02 GB, 3.27 GB, 3.30 GB, 3.43 GB, 3.55 GB, 3.68 GB, 3.80 GB, 3.84 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.78 GB, 3.78 GB, 3.91 GB, 4.03 GB, 4.04 GB, 4.00 GB ThreadUsage(1s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.22 - PeakMemoryUsage: 4.04 GB (4335677240) - PerHostPeakMemUsage: 5.72 GB (6143469040) - PrepareTime: 275.31ms - RowsProduced: 100 (100) - TotalCpuTime: 46s074ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 508.25us - TotalStorageWaitTime: 0ns CodeGen:(Total: 799.375ms, non-child: 799.375ms, % non-child: 100.00%) - CodegenTime: 6.536ms - CompileTime: 138.513ms - LoadTime: 73.397us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 403.231ms - PrepareTime: 255.540ms DataStreamSender (dst_id=23):(Total: 88.571us, non-child: 88.571us, % non-child: 100.00%) - BytesSent: 4.00 KB (4094) - NetworkThroughput(*): 12.88 MB/sec - OverallThroughput: 44.08 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 54.18us - ThriftTransmitTime(*): 303.48us - UncompressedRowBatchSize: 9.83 KB (10067) SORT_NODE (id=14):(Total: 37s704ms, non-child: 88.11ms, % non-child: 0.23%) - PeakMemoryUsage: 156.00 KB (159744) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s616ms, non-child: 6s275ms, % non-child: 16.68%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s293ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s620ms - GetNewBlockTime: 47.398ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 262.73K (262727) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 120.685ms - RowsReturned: 260.83K (260835) - RowsReturnedRate: 6.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.543us EXCHANGE_NODE (id=22):(Total: 14s282ms, non-child: 686.958ms, % non-child: 4.81%) BytesReceived(1s000ms): 6.65 MB, 36.66 MB, 65.70 MB, 94.19 MB, 122.45 MB, 150.92 MB, 179.39 MB, 207.83 MB, 236.46 MB, 251.97 MB, 257.97 MB, 263.88 MB, 269.85 MB, 275.76 MB, 281.67 MB, 287.67 MB, 293.67 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 466.128ms - DeserializeRowBatchTimer: 1s384ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.05 M/sec - SendersBlockedTimer: 39.583ms - SendersBlockedTotalTimer(*): 176.640ms HASH_JOIN_NODE (id=12):(Total: 37s224ms, non-child: 15s107ms, % non-child: 40.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 6s802ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 5s742ms - GetNewBlockTime: 4.248ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 271.53K (271528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 112.483ms - RowsReturned: 262.73K (262727) - RowsReturnedRate: 7.06 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.389us EXCHANGE_NODE (id=21):(Total: 10s926ms, non-child: 2s072ms, % non-child: 18.97%) BytesReceived(1s000ms): 8.19 MB, 63.18 MB, 122.46 MB, 181.28 MB, 240.17 MB, 299.32 MB, 358.04 MB, 416.83 MB, 475.81 MB, 537.62 MB, 610.42 MB, 683.23 MB, 756.13 MB, 828.63 MB, 900.94 MB, 962.65 MB, 1020.27 MB, 1.03 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 885.269ms - DeserializeRowBatchTimer: 4s513ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.75 M/sec - SendersBlockedTimer: 115.935ms - SendersBlockedTotalTimer(*): 573.946ms AGGREGATION_NODE (id=20):(Total: 37s098ms, non-child: 193.353ms, % non-child: 0.52%) ExecOption: Codegen Enabled, Spilled - BuildTime: 158.485ms - GetNewBlockTime: 1.555ms - GetResultsTime: 15.818ms - HTResizeTime: 13.541ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288109456) - PinTime: 2.237us - RowsRepartitioned: 17.05K (17046) - RowsReturned: 271.53K (271528) - RowsReturnedRate: 7.32 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 12.222us EXCHANGE_NODE (id=19):(Total: 36s905ms, non-child: 14.427ms, % non-child: 0.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.25 MB, 2.71 MB, 5.42 MB, 7.23 MB, 7.63 MB - BytesReceived: 10.89 MB (11419313) - ConvertRowBatchTime: 8.588ms - DeserializeRowBatchTimer: 34.43ms - FirstBatchArrivalWaitTime: 31s593ms - PeakMemoryUsage: 0 - RowsReturned: 271.53K (271531) - RowsReturnedRate: 7.36 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 24449bb4dc430956:ca0f6ca2e0cb4999 (host=c2114.hal.cloudera.com:22000):(Total: 37s683ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(1s000ms): 271.00 MB, 535.55 MB, 663.54 MB, 791.51 MB, 983.58 MB, 1.02 GB, 1.27 GB, 1.34 GB, 1.40 GB, 1.65 GB, 1.77 GB, 1.90 GB, 1.96 GB, 2.09 GB, 2.21 GB, 2.27 GB, 2.40 GB, 2.51 GB, 2.79 GB, 3.13 GB, 3.24 GB, 3.40 GB, 3.55 GB, 3.71 GB, 3.87 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.78 GB, 3.78 GB, 3.91 GB, 4.04 GB, 4.04 GB, 4.02 GB ThreadUsage(1s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.16 - PeakMemoryUsage: 4.04 GB (4335677216) - PerHostPeakMemUsage: 5.56 GB (5966618400) - PrepareTime: 265.414ms - RowsProduced: 100 (100) - TotalCpuTime: 43s975ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 485.187us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 769 (769) - BlocksRecycled: 256 (256) - BufferedPins: 4 (4) - BytesWritten: 8.00 MB (8388580) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385830912) - PeakMemoryUsage: 5.18 GB (5565526976) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 7.519ms CodeGen:(Total: 819.706ms, non-child: 819.706ms, % non-child: 100.00%) - CodegenTime: 6.421ms - CompileTime: 145.636ms - LoadTime: 79.879us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 425.67ms - PrepareTime: 247.88ms DataStreamSender (dst_id=23):(Total: 81.329us, non-child: 81.329us, % non-child: 100.00%) - BytesSent: 4.02 KB (4112) - NetworkThroughput(*): 12.49 MB/sec - OverallThroughput: 48.22 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53.630us - ThriftTransmitTime(*): 314.64us - UncompressedRowBatchSize: 9.87 KB (10102) SORT_NODE (id=14):(Total: 37s681ms, non-child: 90.624ms, % non-child: 0.24%) - PeakMemoryUsage: 156.00 KB (159744) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s591ms, non-child: 5s597ms, % non-child: 14.89%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s289ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s084ms - GetNewBlockTime: 1.922ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 262.77K (262766) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 110.928ms - RowsReturned: 260.87K (260868) - RowsReturnedRate: 6.94 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.72us EXCHANGE_NODE (id=22):(Total: 14s269ms, non-child: 681.808ms, % non-child: 4.78%) BytesReceived(1s000ms): 5.48 MB, 34.54 MB, 63.84 MB, 92.22 MB, 120.53 MB, 149.04 MB, 177.55 MB, 205.95 MB, 234.59 MB, 251.59 MB, 257.55 MB, 263.51 MB, 269.46 MB, 275.38 MB, 281.27 MB, 287.28 MB, 293.29 MB, 297.85 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 460.31ms - DeserializeRowBatchTimer: 1s358ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.05 M/sec - SendersBlockedTimer: 62.74ms - SendersBlockedTotalTimer(*): 289.29ms HASH_JOIN_NODE (id=12):(Total: 37s218ms, non-child: 13s589ms, % non-child: 36.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 6s676ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 4s601ms - GetNewBlockTime: 3.879ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 271.50K (271498) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.958ms - RowsReturned: 262.77K (262766) - RowsReturnedRate: 7.06 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.18us EXCHANGE_NODE (id=21):(Total: 11s032ms, non-child: 2s082ms, % non-child: 18.88%) BytesReceived(1s000ms): 5.95 MB, 58.86 MB, 118.60 MB, 177.41 MB, 236.36 MB, 295.47 MB, 354.21 MB, 413.05 MB, 472.01 MB, 533.94 MB, 605.57 MB, 678.61 MB, 751.44 MB, 823.86 MB, 896.24 MB, 959.02 MB, 1016.77 MB, 1.03 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 881.202ms - DeserializeRowBatchTimer: 4s501ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.72 M/sec - SendersBlockedTimer: 139.557ms - SendersBlockedTotalTimer(*): 575.617ms AGGREGATION_NODE (id=20):(Total: 37s078ms, non-child: 209.775ms, % non-child: 0.57%) ExecOption: Codegen Enabled, Spilled - BuildTime: 174.758ms - GetNewBlockTime: 264.704us - GetResultsTime: 15.631ms - HTResizeTime: 42.508ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288109344) - PinTime: 2.387us - RowsRepartitioned: 17.08K (17080) - RowsReturned: 271.50K (271498) - RowsReturnedRate: 7.32 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 12.580us EXCHANGE_NODE (id=19):(Total: 36s868ms, non-child: 14.96ms, % non-child: 0.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 966.38 KB, 2.66 MB, 5.37 MB, 7.24 MB, 7.36 MB - BytesReceived: 10.89 MB (11418850) - ConvertRowBatchTime: 8.380ms - DeserializeRowBatchTimer: 31.932ms - FirstBatchArrivalWaitTime: 31s569ms - PeakMemoryUsage: 0 - RowsReturned: 271.50K (271501) - RowsReturnedRate: 7.36 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 24449bb4dc430956:ca0f6ca2e0cb4998 (host=c2106.hal.cloudera.com:22000):(Total: 37s667ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(1s000ms): 26.82 MB, 535.49 MB, 663.52 MB, 791.61 MB, 983.52 MB, 1.02 GB, 1.27 GB, 1.34 GB, 1.40 GB, 1.65 GB, 1.77 GB, 1.90 GB, 1.96 GB, 2.09 GB, 2.21 GB, 2.27 GB, 2.40 GB, 2.52 GB, 2.77 GB, 3.10 GB, 3.24 GB, 3.40 GB, 3.55 GB, 3.68 GB, 3.80 GB, 3.84 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.77 GB, 3.78 GB, 3.78 GB, 3.91 GB, 4.04 GB, 4.04 GB, 4.01 GB ThreadUsage(1s000ms): 2, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 2.17 - PeakMemoryUsage: 4.04 GB (4335677336) - PerHostPeakMemUsage: 5.58 GB (5994578456) - PrepareTime: 273.287ms - RowsProduced: 100 (100) - TotalCpuTime: 44s250ms - TotalNetworkReceiveTime: 1m - TotalNetworkSendTime: 461.129us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 770 (770) - BlocksRecycled: 255 (255) - BufferedPins: 4 (4) - BytesWritten: 8.00 MB (8388478) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 30.16 GB (32385830912) - PeakMemoryUsage: 5.18 GB (5563364288) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 6.785ms CodeGen:(Total: 865.490ms, non-child: 865.490ms, % non-child: 100.00%) - CodegenTime: 6.614ms - CompileTime: 145.213ms - LoadTime: 82.458us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 464.488ms - PrepareTime: 253.872ms DataStreamSender (dst_id=23):(Total: 86.290us, non-child: 86.290us, % non-child: 100.00%) - BytesSent: 4.02 KB (4114) - NetworkThroughput(*): 10.89 MB/sec - OverallThroughput: 45.47 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 58.770us - ThriftTransmitTime(*): 360.284us - UncompressedRowBatchSize: 9.85 KB (10089) SORT_NODE (id=14):(Total: 37s666ms, non-child: 88.825ms, % non-child: 0.24%) - PeakMemoryUsage: 156.00 KB (159744) - RowsReturned: 100 (100) - RowsReturnedRate: 2.00 /sec HASH_JOIN_NODE (id=13):(Total: 37s577ms, non-child: 5s737ms, % non-child: 15.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s320ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s137ms - GetNewBlockTime: 1.597ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219526656) - PinTime: 0ns - ProbeRows: 262.23K (262229) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 136.840ms - RowsReturned: 260.30K (260304) - RowsReturnedRate: 6.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.222us EXCHANGE_NODE (id=22):(Total: 14s185ms, non-child: 688.864ms, % non-child: 4.86%) BytesReceived(1s000ms): 5.90 MB, 35.23 MB, 64.48 MB, 92.91 MB, 121.20 MB, 149.67 MB, 178.19 MB, 206.63 MB, 235.26 MB, 251.74 MB, 257.74 MB, 263.65 MB, 269.62 MB, 275.53 MB, 281.43 MB, 287.44 MB, 293.43 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB, 297.88 MB - BytesReceived: 297.88 MB (312354726) - ConvertRowBatchTime: 462.130ms - DeserializeRowBatchTimer: 1s355ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 108.440ms - SendersBlockedTotalTimer(*): 447.881ms HASH_JOIN_NODE (id=12):(Total: 37s171ms, non-child: 13s991ms, % non-child: 37.64%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 6s772ms - BuildRows: 30.00M (30000000) - BuildRowsPartitioned: 30.00M (30000000) - BuildTime: 4s849ms - GetNewBlockTime: 5.141ms - HashBuckets: 67.11M (67108864) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.89 GB (3098566656) - PinTime: 0ns - ProbeRows: 271.09K (271093) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 127.389ms - RowsReturned: 262.23K (262229) - RowsReturnedRate: 7.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.37us EXCHANGE_NODE (id=21):(Total: 10s882ms, non-child: 2s118ms, % non-child: 19.46%) BytesReceived(1s000ms): 6.74 MB, 60.39 MB, 119.97 MB, 178.74 MB, 237.61 MB, 296.80 MB, 355.58 MB, 414.31 MB, 473.30 MB, 534.89 MB, 607.23 MB, 680.22 MB, 753.07 MB, 825.38 MB, 897.85 MB, 960.27 MB, 1017.98 MB, 1.03 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB, 1.06 GB - BytesReceived: 1.06 GB (1135897936) - ConvertRowBatchTime: 905.8ms - DeserializeRowBatchTimer: 4s531ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 30.00M (30000000) - RowsReturnedRate: 2.76 M/sec - SendersBlockedTimer: 185.91ms - SendersBlockedTotalTimer(*): 948.757ms AGGREGATION_NODE (id=20):(Total: 37s030ms, non-child: 187.112ms, % non-child: 0.51%) ExecOption: Codegen Enabled, Spilled - BuildTime: 151.429ms - GetNewBlockTime: 347.964us - GetResultsTime: 15.645ms - HTResizeTime: 13.672ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 274.76 MB (288109424) - PinTime: 2.503us - RowsRepartitioned: 17.07K (17067) - RowsReturned: 271.09K (271093) - RowsReturnedRate: 7.32 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 13.399us EXCHANGE_NODE (id=19):(Total: 36s843ms, non-child: 14.357ms, % non-child: 0.04%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1.05 MB, 2.67 MB, 5.38 MB, 7.24 MB, 7.46 MB - BytesReceived: 10.87 MB (11402719) - ConvertRowBatchTime: 8.485ms - DeserializeRowBatchTimer: 34.382ms - FirstBatchArrivalWaitTime: 31s523ms - PeakMemoryUsage: 0 - RowsReturned: 271.10K (271095) - RowsReturnedRate: 7.36 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F07: Instance 24449bb4dc430956:ca0f6ca2e0cb499b (host=c2106.hal.cloudera.com:22000):(Total: 17s104ms, non-child: 14.769ms, % non-child: 0.09%) Hdfs split stats (:<# splits>/): 10:1/45.93 MB 0:1/46.00 MB MemoryUsage(500.0ms): 359.97 KB, 34.36 MB, 34.36 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.33 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.30 MB, 34.36 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.36 MB, 34.42 MB, 18.58 MB, 18.58 MB, 18.58 MB, 18.58 MB, 18.52 MB, 12.31 MB ThreadUsage(500.0ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2 - AverageThreadTokens: 2.97 - PeakMemoryUsage: 34.50 MB (36177744) - PerHostPeakMemUsage: 3.51 GB (3764005872) - PrepareTime: 28.641ms - RowsProduced: 5.00M (4995000) - TotalCpuTime: 34s796ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 15s123ms - TotalStorageWaitTime: 441.95ms DataStreamSender (dst_id=22):(Total: 16s773ms, non-child: 16s773ms, % non-child: 100.00%) - BytesSent: 593.21 MB (622024572) - NetworkThroughput(*): 8.08 MB/sec - OverallThroughput: 35.37 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 1s439ms - ThriftTransmitTime(*): 1m13s - UncompressedRowBatchSize: 1.02 GB (1099548138) HDFS_SCAN_NODE (id=11):(Total: 316.696ms, non-child: 316.696ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/45.93 MB 0:1/46.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 BytesRead(500.0ms): 0, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.97 - BytesRead: 25.40 MB (26631659) - BytesReadDataNodeCache: 0 - BytesReadLocal: 25.40 MB (26631659) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 25.40 MB (26631659) - DecompressionTime: 11.617ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 34.45 MB (36119960) - PerReadThreadRawHdfsThroughput: 648.38 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.00M (4995000) - RowsReturned: 5.00M (4995000) - RowsReturnedRate: 15.77 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 358 (358) - ScannerThreadsTotalWallClockTime: 33s216ms - MaterializeTupleTime(*): 32s744ms - ScannerThreadsSysTime: 52.991ms - ScannerThreadsUserTime: 833.872ms - ScannerThreadsVoluntaryContextSwitches: 4.90K (4900) - TotalRawHdfsReadTime(*): 39.171ms - TotalReadThroughput: 1.49 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb499d (host=c2112.hal.cloudera.com:22000):(Total: 9s071ms, non-child: 71.207ms, % non-child: 0.78%) Hdfs split stats (:<# splits>/): 6:1/46.10 MB MemoryUsage(500.0ms): 199.97 KB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.75 MB, 19.78 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 11.89 MB, 11.89 MB, 11.89 MB, 3.39 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.94 - PeakMemoryUsage: 19.89 MB (20853872) - PerHostPeakMemUsage: 2.54 GB (2732327736) - PrepareTime: 27.880ms - RowsProduced: 2.50M (2505000) - TotalCpuTime: 9s484ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7s752ms - TotalStorageWaitTime: 386.958ms DataStreamSender (dst_id=22):(Total: 8s532ms, non-child: 8s532ms, % non-child: 100.00%) - BytesSent: 278.41 MB (291939246) - NetworkThroughput(*): 7.40 MB/sec - OverallThroughput: 32.63 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 660.160ms - ThriftTransmitTime(*): 37s642ms - UncompressedRowBatchSize: 525.86 MB (551408364) HDFS_SCAN_NODE (id=11):(Total: 467.210ms, non-child: 467.210ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/46.10 MB Hdfs Read Thread Concurrency Bucket: 0:94.44% 1:5.556% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB - AverageHdfsReadThreadConcurrency: 0.06 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.74 MB (13355250) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.74 MB (13355250) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.74 MB (13355250) - DecompressionTime: 6.193ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780176) - PerReadThreadRawHdfsThroughput: 70.41 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2505000) - RowsReturned: 2.50M (2505000) - RowsReturnedRate: 5.36 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 170 (170) - ScannerThreadsTotalWallClockTime: 8s506ms - MaterializeTupleTime(*): 8s105ms - ScannerThreadsSysTime: 31.995ms - ScannerThreadsUserTime: 377.942ms - ScannerThreadsVoluntaryContextSwitches: 2.40K (2403) - TotalRawHdfsReadTime(*): 180.893ms - TotalReadThroughput: 1.42 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb499a (host=c2108.hal.cloudera.com:22000):(Total: 8s877ms, non-child: 8.906ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 7:1/46.01 MB MemoryUsage(500.0ms): 199.97 KB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 11.83 MB, 11.89 MB, 11.89 MB, 3.37 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.94 - PeakMemoryUsage: 19.89 MB (20853864) - PerHostPeakMemUsage: 2.47 GB (2656554664) - PrepareTime: 31.36ms - RowsProduced: 2.50M (2500000) - TotalCpuTime: 9s340ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7s740ms - TotalStorageWaitTime: 178.9ms DataStreamSender (dst_id=22):(Total: 8s620ms, non-child: 8s620ms, % non-child: 100.00%) - BytesSent: 306.39 MB (321275940) - NetworkThroughput(*): 7.98 MB/sec - OverallThroughput: 35.54 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 743.250ms - ThriftTransmitTime(*): 38s390ms - UncompressedRowBatchSize: 524.84 MB (550335540) HDFS_SCAN_NODE (id=11):(Total: 247.551ms, non-child: 247.551ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/46.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.71 MB (13328949) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.71 MB (13328949) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.71 MB (13328949) - DecompressionTime: 6.379ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780168) - PerReadThreadRawHdfsThroughput: 992.18 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2500000) - RowsReturned: 2.50M (2500000) - RowsReturnedRate: 10.10 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 140 (140) - ScannerThreadsTotalWallClockTime: 8s352ms - MaterializeTupleTime(*): 8s160ms - ScannerThreadsSysTime: 27.995ms - ScannerThreadsUserTime: 390.940ms - ScannerThreadsVoluntaryContextSwitches: 2.38K (2377) - TotalRawHdfsReadTime(*): 12.811ms - TotalReadThroughput: 1.41 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb499c (host=c2114.hal.cloudera.com:22000):(Total: 8s768ms, non-child: 9.233ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 2:1/46.01 MB MemoryUsage(500.0ms): 199.97 KB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.72 MB, 19.81 MB, 19.72 MB, 19.75 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.75 MB, 11.89 MB, 11.89 MB, 11.88 MB, 2.24 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.94 - PeakMemoryUsage: 19.89 MB (20853864) - PerHostPeakMemUsage: 2.46 GB (2641805216) - PrepareTime: 29.863ms - RowsProduced: 2.50M (2500000) - TotalCpuTime: 9s215ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7s644ms - TotalStorageWaitTime: 177.397ms DataStreamSender (dst_id=22):(Total: 8s515ms, non-child: 8s515ms, % non-child: 100.00%) - BytesSent: 305.35 MB (320185788) - NetworkThroughput(*): 8.04 MB/sec - OverallThroughput: 35.86 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 735.969ms - ThriftTransmitTime(*): 37s959ms - UncompressedRowBatchSize: 524.81 MB (550305342) HDFS_SCAN_NODE (id=11):(Total: 244.11ms, non-child: 244.11ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/46.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.71 MB (13328959) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.71 MB (13328959) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.71 MB (13328959) - DecompressionTime: 5.894ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780168) - PerReadThreadRawHdfsThroughput: 936.18 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2500000) - RowsReturned: 2.50M (2500000) - RowsReturnedRate: 10.25 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 166 (166) - ScannerThreadsTotalWallClockTime: 8s239ms - MaterializeTupleTime(*): 8s047ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 405.938ms - ScannerThreadsVoluntaryContextSwitches: 2.38K (2379) - TotalRawHdfsReadTime(*): 13.578ms - TotalReadThroughput: 1.41 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb499e (host=c2110.hal.cloudera.com:22000):(Total: 8s675ms, non-child: 8.726ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 8:1/46.01 MB MemoryUsage(500.0ms): 199.97 KB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.75 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.75 MB, 11.89 MB, 11.89 MB, 11.89 MB, 5.52 MB, 601.35 KB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1 - AverageThreadTokens: 1.89 - PeakMemoryUsage: 19.89 MB (20853872) - PerHostPeakMemUsage: 2.31 GB (2475014776) - PrepareTime: 25.6ms - RowsProduced: 2.50M (2500000) - TotalCpuTime: 9s111ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7s554ms - TotalStorageWaitTime: 179.701ms DataStreamSender (dst_id=22):(Total: 8s421ms, non-child: 8s421ms, % non-child: 100.00%) - BytesSent: 303.94 MB (318702810) - NetworkThroughput(*): 8.02 MB/sec - OverallThroughput: 36.09 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 734.589ms - ThriftTransmitTime(*): 37s909ms - UncompressedRowBatchSize: 524.79 MB (550277010) HDFS_SCAN_NODE (id=11):(Total: 244.966ms, non-child: 244.966ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/46.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.89 - BytesRead: 12.71 MB (13329040) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.71 MB (13329040) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.71 MB (13329040) - DecompressionTime: 6.340ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780176) - PerReadThreadRawHdfsThroughput: 764.03 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2500000) - RowsReturned: 2.50M (2500000) - RowsReturnedRate: 10.21 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 151 (151) - ScannerThreadsTotalWallClockTime: 8s144ms - MaterializeTupleTime(*): 7s950ms - ScannerThreadsSysTime: 30.995ms - ScannerThreadsUserTime: 389.940ms - ScannerThreadsVoluntaryContextSwitches: 2.40K (2395) - TotalRawHdfsReadTime(*): 16.637ms - TotalReadThroughput: 1.41 MB/sec Fragment F06: Instance 24449bb4dc430956:ca0f6ca2e0cb49a0 (host=c2106.hal.cloudera.com:22000):(Total: 18s155ms, non-child: 29.154ms, % non-child: 0.16%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 9:1/2.67 MB MemoryUsage(500.0ms): 400.00 KB, 66.15 MB, 65.88 MB, 66.13 MB, 66.06 MB, 66.06 MB, 66.13 MB, 66.06 MB, 66.00 MB, 66.13 MB, 66.00 MB, 65.88 MB, 65.94 MB, 65.95 MB, 65.94 MB, 65.88 MB, 50.16 MB, 50.16 MB, 50.28 MB, 50.16 MB, 50.22 MB, 50.28 MB, 50.22 MB, 50.22 MB, 50.28 MB, 50.10 MB, 50.22 MB, 50.28 MB, 50.22 MB, 50.16 MB, 50.28 MB, 50.16 MB, 34.28 MB, 34.22 MB, 34.22 MB, 34.22 MB, 6.59 MB ThreadUsage(500.0ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 66.54 MB (69770512) - PerHostPeakMemUsage: 3.92 GB (4212525088) - PrepareTime: 96.680us - RowsProduced: 5.00M (5000131) - TotalCpuTime: 20s957ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 15s027ms - TotalStorageWaitTime: 243.82ms DataStreamSender (dst_id=21):(Total: 17s973ms, non-child: 17s973ms, % non-child: 100.00%) - BytesSent: 1.06 GB (1134122796) - NetworkThroughput(*): 13.20 MB/sec - OverallThroughput: 60.18 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s748ms - ThriftTransmitTime(*): 1m21s - UncompressedRowBatchSize: 1.78 GB (1906588986) HDFS_SCAN_NODE (id=10):(Total: 153.466ms, non-child: 153.466ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/253.42 MB 9:1/2.67 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 ExecOption: Codegen enabled: 0 out of 2 BytesRead(500.0ms): 0, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 54.30 MB (56940682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.30 MB (56940682) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.30 MB (56940682) - DecompressionTime: 23.428ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 66.45 MB (69680400) - PerReadThreadRawHdfsThroughput: 851.34 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.00M (5000131) - RowsReturned: 5.00M (5000131) - RowsReturnedRate: 32.58 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 732 (732) - ScannerThreadsTotalWallClockTime: 18s038ms - MaterializeTupleTime(*): 17s757ms - ScannerThreadsSysTime: 48.992ms - ScannerThreadsUserTime: 1s564ms - ScannerThreadsVoluntaryContextSwitches: 4.77K (4774) - TotalRawHdfsReadTime(*): 63.784ms - TotalReadThroughput: 2.94 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a1 (host=c2108.hal.cloudera.com:22000):(Total: 17s823ms, non-child: 14.304ms, % non-child: 0.08%) Hdfs split stats (:<# splits>/): 4:1/2.66 MB 3:1/253.42 MB MemoryUsage(500.0ms): 65.97 MB, 66.13 MB, 66.06 MB, 66.07 MB, 66.13 MB, 66.00 MB, 66.00 MB, 66.06 MB, 66.13 MB, 66.13 MB, 66.06 MB, 66.00 MB, 66.06 MB, 66.13 MB, 66.13 MB, 50.22 MB, 50.03 MB, 50.28 MB, 50.03 MB, 50.22 MB, 50.28 MB, 50.16 MB, 50.10 MB, 50.28 MB, 50.22 MB, 50.22 MB, 50.28 MB, 50.22 MB, 50.16 MB, 50.22 MB, 34.28 MB, 34.28 MB, 34.28 MB, 34.22 MB, 34.22 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 66.54 MB (69768968) - PerHostPeakMemUsage: 3.76 GB (4033429560) - PrepareTime: 86.114us - RowsProduced: 5.00M (4999869) - TotalCpuTime: 20s601ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 14s717ms - TotalStorageWaitTime: 200.856ms DataStreamSender (dst_id=21):(Total: 17s666ms, non-child: 17s666ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1126136286) - NetworkThroughput(*): 14.62 MB/sec - OverallThroughput: 60.79 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s754ms - ThriftTransmitTime(*): 1m13s - UncompressedRowBatchSize: 1.78 GB (1906558038) HDFS_SCAN_NODE (id=10):(Total: 142.589ms, non-child: 142.589ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/2.66 MB 3:1/253.42 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 ExecOption: Codegen enabled: 0 out of 2 BytesRead(500.0ms): 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB, 54.30 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 54.30 MB (56937715) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.30 MB (56937715) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.30 MB (56937715) - DecompressionTime: 24.217ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 66.45 MB (69678856) - PerReadThreadRawHdfsThroughput: 942.54 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.00M (4999869) - RowsReturned: 5.00M (4999869) - RowsReturnedRate: 35.06 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 753 (753) - ScannerThreadsTotalWallClockTime: 17s663ms - MaterializeTupleTime(*): 17s422ms - ScannerThreadsSysTime: 66.989ms - ScannerThreadsUserTime: 1s547ms - ScannerThreadsVoluntaryContextSwitches: 4.79K (4794) - TotalRawHdfsReadTime(*): 57.610ms - TotalReadThroughput: 3.10 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a4 (host=c2110.hal.cloudera.com:22000):(Total: 16s866ms, non-child: 15.321ms, % non-child: 0.09%) Hdfs split stats (:<# splits>/): 0:1/253.43 MB MemoryUsage(500.0ms): 216.00 KB, 66.06 MB, 65.94 MB, 66.01 MB, 66.06 MB, 65.88 MB, 66.13 MB, 66.13 MB, 66.06 MB, 66.00 MB, 66.06 MB, 66.13 MB, 66.00 MB, 66.06 MB, 66.00 MB, 66.13 MB, 50.28 MB, 50.22 MB, 50.28 MB, 50.28 MB, 50.28 MB, 50.17 MB, 50.16 MB, 50.16 MB, 50.28 MB, 50.28 MB, 50.16 MB, 50.22 MB, 50.28 MB, 34.28 MB, 34.22 MB, 34.10 MB, 34.28 MB, 8.04 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - PeakMemoryUsage: 66.22 MB (69437280) - PerHostPeakMemUsage: 3.37 GB (3616261648) - PrepareTime: 83.301us - RowsProduced: 4.96M (4958374) - TotalCpuTime: 19s650ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 13s631ms - TotalStorageWaitTime: 106.253ms DataStreamSender (dst_id=21):(Total: 16s691ms, non-child: 16s691ms, % non-child: 100.00%) - BytesSent: 1.05 GB (1131781116) - NetworkThroughput(*): 15.43 MB/sec - OverallThroughput: 64.66 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s865ms - ThriftTransmitTime(*): 1m9s - UncompressedRowBatchSize: 1.76 GB (1890678174) HDFS_SCAN_NODE (id=10):(Total: 159.690ms, non-child: 159.690ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/253.43 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB, 53.56 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 53.56 MB (56158401) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.56 MB (56158401) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.56 MB (56158401) - DecompressionTime: 24.385ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 66.09 MB (69305344) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.96M (4958374) - RowsReturned: 4.96M (4958374) - RowsReturnedRate: 31.05 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 859 (859) - ScannerThreadsTotalWallClockTime: 16s484ms - MaterializeTupleTime(*): 16s340ms - ScannerThreadsSysTime: 61.990ms - ScannerThreadsUserTime: 1s600ms - ScannerThreadsVoluntaryContextSwitches: 4.73K (4728) - TotalRawHdfsReadTime(*): 48.580ms - TotalReadThroughput: 3.15 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a2 (host=c2112.hal.cloudera.com:22000):(Total: 16s808ms, non-child: 30.438ms, % non-child: 0.18%) Hdfs split stats (:<# splits>/): 10:1/253.44 MB MemoryUsage(500.0ms): 32.86 MB, 66.06 MB, 66.13 MB, 65.88 MB, 66.13 MB, 66.13 MB, 66.00 MB, 66.06 MB, 66.13 MB, 66.06 MB, 66.00 MB, 66.13 MB, 66.13 MB, 66.06 MB, 66.06 MB, 50.28 MB, 50.22 MB, 50.16 MB, 50.28 MB, 50.28 MB, 50.16 MB, 50.28 MB, 50.28 MB, 50.16 MB, 50.22 MB, 50.16 MB, 50.22 MB, 50.16 MB, 34.10 MB, 34.10 MB, 34.28 MB, 34.28 MB, 34.16 MB, 3.58 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - PeakMemoryUsage: 66.22 MB (69437280) - PerHostPeakMemUsage: 3.46 GB (3710148296) - PrepareTime: 69.291us - RowsProduced: 4.96M (4957891) - TotalCpuTime: 19s619ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 13s460ms - TotalStorageWaitTime: 187.731ms DataStreamSender (dst_id=21):(Total: 16s515ms, non-child: 16s515ms, % non-child: 100.00%) - BytesSent: 1.07 GB (1146390744) - NetworkThroughput(*): 15.28 MB/sec - OverallThroughput: 66.20 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s856ms - ThriftTransmitTime(*): 1m11s - UncompressedRowBatchSize: 1.76 GB (1890535740) HDFS_SCAN_NODE (id=10):(Total: 261.777ms, non-child: 261.777ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/253.44 MB Hdfs Read Thread Concurrency Bucket: 0:97.06% 1:2.941% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 23.82 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB, 53.55 MB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 53.55 MB (56153121) - BytesReadDataNodeCache: 0 - BytesReadLocal: 53.55 MB (56153121) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 53.55 MB (56153121) - DecompressionTime: 25.183ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 66.09 MB (69304944) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.96M (4957891) - RowsReturned: 4.96M (4957891) - RowsReturnedRate: 18.94 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 986 (986) - ScannerThreadsTotalWallClockTime: 16s412ms - MaterializeTupleTime(*): 16s185ms - ScannerThreadsSysTime: 74.988ms - ScannerThreadsUserTime: 1s468ms - ScannerThreadsVoluntaryContextSwitches: 4.81K (4808) - TotalRawHdfsReadTime(*): 51.431ms - TotalReadThroughput: 3.15 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb499f (host=c2114.hal.cloudera.com:22000):(Total: 16s230ms, non-child: 14.245ms, % non-child: 0.09%) Hdfs split stats (:<# splits>/): 1:1/2.69 MB 10:1/253.43 MB MemoryUsage(500.0ms): 400.00 KB, 66.03 MB, 66.06 MB, 66.13 MB, 66.13 MB, 66.00 MB, 66.06 MB, 66.13 MB, 66.13 MB, 66.00 MB, 66.06 MB, 66.13 MB, 66.13 MB, 66.00 MB, 66.06 MB, 66.13 MB, 50.28 MB, 50.16 MB, 50.28 MB, 50.28 MB, 50.16 MB, 50.28 MB, 50.28 MB, 50.22 MB, 50.22 MB, 50.16 MB, 50.16 MB, 50.28 MB, 34.28 MB, 34.22 MB, 34.22 MB, 34.28 MB, 6.64 MB ThreadUsage(500.0ms): 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 66.54 MB (69776128) - PerHostPeakMemUsage: 3.43 GB (3685291400) - PrepareTime: 84.801us - RowsProduced: 5.00M (5000918) - TotalCpuTime: 18s931ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 13s106ms - TotalStorageWaitTime: 202.917ms DataStreamSender (dst_id=21):(Total: 16s077ms, non-child: 16s077ms, % non-child: 100.00%) - BytesSent: 1.04 GB (1119048510) - NetworkThroughput(*): 15.33 MB/sec - OverallThroughput: 66.38 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s767ms - ThriftTransmitTime(*): 1m9s - UncompressedRowBatchSize: 1.78 GB (1906942602) HDFS_SCAN_NODE (id=10):(Total: 138.483ms, non-child: 138.483ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/2.69 MB 10:1/253.43 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:8 ExecOption: Codegen enabled: 0 out of 2 BytesRead(500.0ms): 0, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB, 54.31 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 54.31 MB (56950340) - BytesReadDataNodeCache: 0 - BytesReadLocal: 54.31 MB (56950340) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 54.31 MB (56950340) - DecompressionTime: 26.294ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 66.46 MB (69686016) - PerReadThreadRawHdfsThroughput: 944.91 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.00M (5000918) - RowsReturned: 5.00M (5000918) - RowsReturnedRate: 36.11 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 758 (758) - ScannerThreadsTotalWallClockTime: 15s973ms - MaterializeTupleTime(*): 15s726ms - ScannerThreadsSysTime: 55.990ms - ScannerThreadsUserTime: 1s581ms - ScannerThreadsVoluntaryContextSwitches: 4.77K (4771) - TotalRawHdfsReadTime(*): 57.478ms - TotalReadThroughput: 3.29 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a3 (host=c2104.hal.cloudera.com:22000):(Total: 14s532ms, non-child: 14.103ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/2.03 MB 0:1/2.64 MB 10:1/3.12 MB MemoryUsage(500.0ms): 66.84 MB, 65.97 MB, 65.94 MB, 65.88 MB, 66.00 MB, 65.94 MB, 66.13 MB, 66.13 MB, 66.13 MB, 66.06 MB, 66.06 MB, 66.06 MB, 66.13 MB, 50.28 MB, 50.28 MB, 50.22 MB, 50.16 MB, 50.22 MB, 50.28 MB, 50.28 MB, 50.16 MB, 50.28 MB, 50.28 MB, 50.28 MB, 34.28 MB, 34.16 MB, 34.22 MB, 34.10 MB, 6.85 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.97 - PeakMemoryUsage: 67.59 MB (70876576) - PerHostPeakMemUsage: 3.49 GB (3742760824) - PrepareTime: 31.356ms - RowsProduced: 5.08M (5082817) - TotalCpuTime: 17s299ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 11s276ms - TotalStorageWaitTime: 762.303ms DataStreamSender (dst_id=21):(Total: 14s254ms, non-child: 14s254ms, % non-child: 100.00%) - BytesSent: 1.08 GB (1157908164) - NetworkThroughput(*): 17.47 MB/sec - OverallThroughput: 77.47 MB/sec - PeakMemoryUsage: 24.00 KB (24576) - SerializeBatchTime: 2s796ms - ThriftTransmitTime(*): 1m3s - UncompressedRowBatchSize: 1.81 GB (1938163230) HDFS_SCAN_NODE (id=10):(Total: 264.72ms, non-child: 264.72ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/253.41 MB 9:1/2.03 MB 0:1/2.64 MB 10:1/3.12 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 ExecOption: Codegen enabled: 0 out of 4 BytesRead(500.0ms): 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB, 55.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.97 - BytesRead: 55.75 MB (58455825) - BytesReadDataNodeCache: 0 - BytesReadLocal: 55.75 MB (58455825) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 55.75 MB (58455825) - DecompressionTime: 24.222ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumScannerThreadsStarted: 4 (4) - PeakMemoryUsage: 67.51 MB (70786464) - PerReadThreadRawHdfsThroughput: 777.61 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.08M (5082817) - RowsReturned: 5.08M (5082817) - RowsReturnedRate: 19.25 M/sec - ScanRangesComplete: 4 (4) - ScannerThreadsInvoluntaryContextSwitches: 907 (907) - ScannerThreadsTotalWallClockTime: 14s773ms - MaterializeTupleTime(*): 13s955ms - ScannerThreadsSysTime: 68.988ms - ScannerThreadsUserTime: 1s519ms - ScannerThreadsVoluntaryContextSwitches: 4.99K (4985) - TotalRawHdfsReadTime(*): 71.690ms - TotalReadThroughput: 3.84 MB/sec Fragment F00: Instance 24449bb4dc430956:ca0f6ca2e0cb49a5 (host=c2112.hal.cloudera.com:22000):(Total: 36s729ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:2/266.31 MB 2:6/925.04 MB 4:7/1.29 GB 9:11/1.87 GB 7:8/1.25 GB 1:11/1.72 GB 5:6/770.64 MB 0:8/1.36 GB 10:13/1.69 GB 3:7/1.17 GB 8:10/1.32 GB MemoryUsage(1s000ms): 5.18 MB, 315.87 MB, 664.27 MB, 664.30 MB, 792.30 MB, 792.28 MB, 792.27 MB, 920.27 MB, 920.30 MB, 920.27 MB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.04 GB, 1.18 GB, 1.34 GB, 1.46 GB, 1.34 GB, 1.33 GB, 1.31 GB, 1.40 GB, 1.31 GB, 1.32 GB, 1.27 GB, 1.31 GB, 1.28 GB, 1.57 GB, 1.56 GB, 1.58 GB, 1.54 GB, 1.55 GB, 1.57 GB, 1.42 GB ThreadUsage(1s000ms): 1, 5, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 4 - AverageThreadTokens: 8.97 - PeakMemoryUsage: 1.62 GB (1742804880) - PerHostPeakMemUsage: 5.81 GB (6236361296) - PrepareTime: 464.322ms - RowsProduced: 282.05K (282054) - TotalCpuTime: 5m6s - TotalNetworkReceiveTime: 13s606ms - TotalNetworkSendTime: 15.485ms - TotalStorageWaitTime: 18s988ms CodeGen:(Total: 1s110ms, non-child: 1s110ms, % non-child: 100.00%) - CodegenTime: 8.324ms - CompileTime: 197.242ms - LoadTime: 110.719us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 485.991ms - PrepareTime: 425.331ms DataStreamSender (dst_id=19):(Total: 188.744ms, non-child: 188.744ms, % non-child: 100.00%) - BytesSent: 11.28 MB (11824610) - NetworkThroughput(*): 16.89 MB/sec - OverallThroughput: 59.75 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 91.474ms - ThriftTransmitTime(*): 667.589ms - UncompressedRowBatchSize: 16.33 MB (17120477) AGGREGATION_NODE (id=9):(Total: 36s511ms, non-child: 1s097ms, % non-child: 3.00%) ExecOption: Codegen Enabled, Spilled - BuildTime: 600.855ms - GetNewBlockTime: 21.750ms - GetResultsTime: 15.838ms - HTResizeTime: 17.696ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 284.79 MB (298627320) - PinTime: 7.64ms - RowsRepartitioned: 89.20K (89203) - RowsReturned: 282.05K (282054) - RowsReturnedRate: 7.72 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 9.921us HASH_JOIN_NODE (id=8):(Total: 35s414ms, non-child: 25s799ms, % non-child: 72.85%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s291ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s515ms - GetNewBlockTime: 1.405ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 3.02M (3017461) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 308.755ms - RowsReturned: 3.00M (2998837) - RowsReturnedRate: 84.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.109us EXCHANGE_NODE (id=18):(Total: 14s095ms, non-child: 654.194ms, % non-child: 4.64%) BytesReceived(1s000ms): 6.88 MB, 32.20 MB, 62.03 MB, 91.77 MB, 121.65 MB, 151.47 MB, 181.19 MB, 210.78 MB, 241.08 MB, 264.23 MB, 270.39 MB, 276.51 MB, 282.49 MB, 288.52 MB, 294.40 MB, 300.26 MB, 306.49 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 446.470ms - DeserializeRowBatchTimer: 1s251ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 309.648ms - SendersBlockedTotalTimer(*): 1s251ms HASH_JOIN_NODE (id=7):(Total: 15s334ms, non-child: 249.631ms, % non-child: 1.63%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 25.30us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 193.139us - GetNewBlockTime: 73.217us - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 8.65 MB (9066128) - PinTime: 0ns - ProbeRows: 3.02M (3017461) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 224.484ms - RowsReturned: 3.02M (3017461) - RowsReturnedRate: 196.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.305us EXCHANGE_NODE (id=17):(Total: 18.657us, non-child: 18.657us, % non-child: 100.00%) BytesReceived(1s000ms): 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 10.494us - DeserializeRowBatchTimer: 11.741us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 16.83 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 15s085ms, non-child: 428.337ms, % non-child: 2.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 139.499us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 234.516us - GetNewBlockTime: 100.915us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.52 MB (6837672) - PinTime: 0ns - ProbeRows: 6.41M (6408269) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 377.149ms - RowsReturned: 3.02M (3017461) - RowsReturnedRate: 200.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.439us EXCHANGE_NODE (id=16):(Total: 62.444us, non-child: 62.444us, % non-child: 100.00%) BytesReceived(1s000ms): 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 51.67us - DeserializeRowBatchTimer: 59.709us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 28.83 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 14s658ms, non-child: 729.734ms, % non-child: 4.98%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 12.219us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 28.382us - GetNewBlockTime: 62.396us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.21 MB (5464488) - PinTime: 0ns - ProbeRows: 13.11M (13105876) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 668.218ms - RowsReturned: 6.41M (6408269) - RowsReturnedRate: 437.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.323us EXCHANGE_NODE (id=15):(Total: 10.258us, non-child: 10.258us, % non-child: 100.00%) BytesReceived(1s000ms): 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 3.70us - DeserializeRowBatchTimer: 11.971us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 7.41 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 13s929ms, non-child: 13s929ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:2/266.31 MB 2:6/925.04 MB 4:7/1.29 GB 9:11/1.87 GB 7:8/1.25 GB 1:11/1.72 GB 5:6/770.64 MB 0:8/1.36 GB 10:13/1.69 GB 3:7/1.17 GB 8:10/1.32 GB Hdfs Read Thread Concurrency Bucket: 0:60.56% 1:21.13% 2:15.49% 3:2.817% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:623 ExecOption: Codegen enabled: 0 out of 89 BytesRead(1s000ms): 0, 230.96 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 263.61 MB, 330.75 MB, 473.92 MB, 701.64 MB, 856.65 MB, 987.11 MB, 1.10 GB, 1.26 GB, 1.40 GB, 1.56 GB, 1.68 GB, 1.84 GB, 1.98 GB, 2.12 GB, 2.30 GB, 2.43 GB - AverageHdfsReadThreadConcurrency: 0.61 - AverageScannerThreadConcurrency: 7.87 - BytesRead: 2.45 GB (2626934364) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 GB (2626934364) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 GB (2626934364) - DecompressionTime: 10s658ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 391.03 MB (410023864) - PerReadThreadRawHdfsThroughput: 123.16 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 241.20M (241201840) - RowsReturned: 13.11M (13105876) - RowsReturnedRate: 940.88 K/sec - ScanRangesComplete: 89 (89) - ScannerThreadsInvoluntaryContextSwitches: 13.88K (13882) - ScannerThreadsTotalWallClockTime: 4m42s - MaterializeTupleTime(*): 4m11s - ScannerThreadsSysTime: 352.942ms - ScannerThreadsUserTime: 1m44s - ScannerThreadsVoluntaryContextSwitches: 1.51K (1506) - TotalRawHdfsReadTime(*): 20s340ms - TotalReadThroughput: 68.64 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a8 (host=c2110.hal.cloudera.com:22000):(Total: 35s927ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:5/958.29 MB 4:10/1.27 GB 10:7/1.00 GB 8:4/909.27 MB 3:10/2.07 GB 7:12/1.48 GB 0:4/746.26 MB 5:4/745.94 MB 9:8/1.46 GB 1:10/1.14 GB 6:10/1.78 GB MemoryUsage(1s000ms): 1.68 MB, 288.77 MB, 574.72 MB, 574.71 MB, 702.70 MB, 702.72 MB, 702.72 MB, 830.73 MB, 830.72 MB, 830.72 MB, 958.70 MB, 958.70 MB, 958.70 MB, 958.70 MB, 958.70 MB, 958.70 MB, 958.70 MB, 958.71 MB, 1.06 GB, 1.23 GB, 1.32 GB, 1.23 GB, 1.24 GB, 1.28 GB, 1.30 GB, 1.24 GB, 1.29 GB, 1.27 GB, 1.24 GB, 1.41 GB, 1.54 GB, 1.50 GB, 1.49 GB, 1.48 GB, 1.47 GB, 1.48 GB, 751.44 MB ThreadUsage(1s000ms): 1, 4, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 7, 6, 1 - AverageThreadTokens: 7.09 - PeakMemoryUsage: 1.56 GB (1677255592) - PerHostPeakMemUsage: 5.72 GB (6143469040) - PrepareTime: 332.855ms - RowsProduced: 280.40K (280404) - TotalCpuTime: 4m - TotalNetworkReceiveTime: 13s528ms - TotalNetworkSendTime: 14.529ms - TotalStorageWaitTime: 9s836ms CodeGen:(Total: 1s086ms, non-child: 1s086ms, % non-child: 100.00%) - CodegenTime: 6.879ms - CompileTime: 226.310ms - LoadTime: 106.166us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 556.142ms - PrepareTime: 302.501ms DataStreamSender (dst_id=19):(Total: 207.0ms, non-child: 207.0ms, % non-child: 100.00%) - BytesSent: 11.21 MB (11752576) - NetworkThroughput(*): 16.20 MB/sec - OverallThroughput: 54.15 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 99.666ms - ThriftTransmitTime(*): 691.670ms - UncompressedRowBatchSize: 16.23 MB (17017666) AGGREGATION_NODE (id=9):(Total: 35s717ms, non-child: 991.523ms, % non-child: 2.78%) ExecOption: Codegen Enabled, Spilled - BuildTime: 606.686ms - GetNewBlockTime: 28.163ms - GetResultsTime: 17.802ms - HTResizeTime: 20.202ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 284.56 MB (298379848) - PinTime: 9.277ms - RowsRepartitioned: 87.76K (87764) - RowsReturned: 280.40K (280404) - RowsReturnedRate: 7.85 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 12.837us HASH_JOIN_NODE (id=8):(Total: 34s726ms, non-child: 24s940ms, % non-child: 71.82%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s407ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s065ms - GetNewBlockTime: 2.827ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 3.00M (3000653) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 308.631ms - RowsReturned: 2.98M (2982188) - RowsReturnedRate: 85.88 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.419us EXCHANGE_NODE (id=18):(Total: 14s039ms, non-child: 704.364ms, % non-child: 5.02%) BytesReceived(1s000ms): 5.05 MB, 27.86 MB, 57.84 MB, 87.56 MB, 117.35 MB, 147.15 MB, 176.99 MB, 206.46 MB, 236.29 MB, 262.65 MB, 269.48 MB, 275.65 MB, 281.64 MB, 287.61 MB, 293.53 MB, 299.39 MB, 305.48 MB, 311.41 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 466.312ms - DeserializeRowBatchTimer: 1s423ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.07 M/sec - SendersBlockedTimer: 246.346ms - SendersBlockedTotalTimer(*): 1s225ms HASH_JOIN_NODE (id=7):(Total: 15s107ms, non-child: 256.766ms, % non-child: 1.70%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 27.889us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 108.214us - GetNewBlockTime: 207.774us - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.65 MB (10120616) - PinTime: 0ns - ProbeRows: 3.00M (3000653) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 235.308ms - RowsReturned: 3.00M (3000653) - RowsReturnedRate: 198.62 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.378us EXCHANGE_NODE (id=17):(Total: 17.376us, non-child: 17.376us, % non-child: 100.00%) BytesReceived(1s000ms): 1.64 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 7.458us - DeserializeRowBatchTimer: 18.399us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 18.07 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s852ms, non-child: 424.936ms, % non-child: 2.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 142.793us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 274.77us - GetNewBlockTime: 313.568us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.40 MB (6709592) - PinTime: 0ns - ProbeRows: 6.34M (6342182) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 388.785ms - RowsReturned: 3.00M (3000653) - RowsReturnedRate: 202.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.723us EXCHANGE_NODE (id=16):(Total: 62.312us, non-child: 62.312us, % non-child: 100.00%) BytesReceived(1s000ms): 8.21 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 47.712us - DeserializeRowBatchTimer: 43.613us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 28.89 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 14s428ms, non-child: 731.344ms, % non-child: 5.07%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.74us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 34.685us - GetNewBlockTime: 513.140us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.13 MB (5374832) - PinTime: 0ns - ProbeRows: 12.98M (12982844) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 671.112ms - RowsReturned: 6.34M (6342182) - RowsReturnedRate: 439.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.107us EXCHANGE_NODE (id=15):(Total: 14.554us, non-child: 14.554us, % non-child: 100.00%) BytesReceived(1s000ms): 926.00 B, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 3.730us - DeserializeRowBatchTimer: 8.139us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 5.22 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 13s698ms, non-child: 13s698ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:5/958.29 MB 4:10/1.27 GB 10:7/1.00 GB 8:4/909.27 MB 3:10/2.07 GB 7:12/1.48 GB 0:4/746.26 MB 5:4/745.94 MB 9:8/1.46 GB 1:10/1.14 GB 6:10/1.78 GB Hdfs Read Thread Concurrency Bucket: 0:78.57% 1:14.29% 2:7.143% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:588 ExecOption: Codegen enabled: 0 out of 84 BytesRead(1s000ms): 0, 178.54 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 191.29 MB, 197.29 MB, 331.83 MB, 522.79 MB, 706.19 MB, 874.59 MB, 1.00 GB, 1.20 GB, 1.30 GB, 1.51 GB, 1.64 GB, 1.74 GB, 1.90 GB, 2.02 GB, 2.17 GB, 2.36 GB, 2.43 GB - AverageHdfsReadThreadConcurrency: 0.29 - AverageScannerThreadConcurrency: 5.90 - BytesRead: 2.43 GB (2605126642) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.43 GB (2605126642) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.43 GB (2605126642) - DecompressionTime: 8s755ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 6 (6) - PeakMemoryUsage: 299.07 MB (313593936) - PerReadThreadRawHdfsThroughput: 229.56 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 239.34M (239341693) - RowsReturned: 12.98M (12982844) - RowsReturnedRate: 947.74 K/sec - ScanRangesComplete: 84 (84) - ScannerThreadsInvoluntaryContextSwitches: 9.57K (9571) - ScannerThreadsTotalWallClockTime: 3m28s - MaterializeTupleTime(*): 3m8s - ScannerThreadsSysTime: 223.963ms - ScannerThreadsUserTime: 1m24s - ScannerThreadsVoluntaryContextSwitches: 1.32K (1325) - TotalRawHdfsReadTime(*): 10s822ms - TotalReadThroughput: 69.01 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a6 (host=c2108.hal.cloudera.com:22000):(Total: 33s813ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:4/848.02 MB 6:10/1.75 GB 2:4/703.92 MB 8:8/1.05 GB 7:9/1.76 GB 5:7/1.20 GB 0:12/1.46 GB 10:8/1.44 GB 3:8/1.22 GB 9:9/1.35 GB 1:6/729.68 MB MemoryUsage(1s000ms): 12.72 MB, 638.44 MB, 653.42 MB, 697.50 MB, 781.42 MB, 781.40 MB, 845.42 MB, 909.42 MB, 909.40 MB, 973.40 MB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.01 GB, 1.04 GB, 1.22 GB, 1.40 GB, 1.41 GB, 1.33 GB, 1.31 GB, 1.32 GB, 1.33 GB, 1.33 GB, 1.31 GB, 1.32 GB, 1.54 GB, 1.59 GB, 1.53 GB, 1.58 GB, 1.41 GB, 1.35 GB ThreadUsage(1s000ms): 1, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5, 2 - AverageThreadTokens: 8.91 - PeakMemoryUsage: 1.63 GB (1751388560) - PerHostPeakMemUsage: 5.57 GB (5978501520) - PrepareTime: 332.399ms - RowsProduced: 278.75K (278749) - TotalCpuTime: 4m41s - TotalNetworkReceiveTime: 13s667ms - TotalNetworkSendTime: 21.542ms - TotalStorageWaitTime: 13s562ms CodeGen:(Total: 987.683ms, non-child: 987.683ms, % non-child: 100.00%) - CodegenTime: 6.817ms - CompileTime: 210.624ms - LoadTime: 39.529us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 473.643ms - PrepareTime: 301.16ms DataStreamSender (dst_id=19):(Total: 200.518ms, non-child: 200.518ms, % non-child: 100.00%) - BytesSent: 11.14 MB (11685643) - NetworkThroughput(*): 16.02 MB/sec - OverallThroughput: 55.58 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 96.305ms - ThriftTransmitTime(*): 695.473ms - UncompressedRowBatchSize: 16.13 MB (16918496) AGGREGATION_NODE (id=9):(Total: 33s609ms, non-child: 1s077ms, % non-child: 3.20%) ExecOption: Codegen Enabled, Spilled - BuildTime: 698.565ms - GetNewBlockTime: 28.356ms - GetResultsTime: 16.607ms - HTResizeTime: 22.621ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 284.69 MB (298521112) - PinTime: 6.661ms - RowsRepartitioned: 85.84K (85842) - RowsReturned: 278.75K (278749) - RowsReturnedRate: 8.29 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 13.244us HASH_JOIN_NODE (id=8):(Total: 32s532ms, non-child: 24s950ms, % non-child: 76.69%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s364ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s031ms - GetNewBlockTime: 5.422ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 2.98M (2982111) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 345.358ms - RowsReturned: 2.96M (2963920) - RowsReturnedRate: 91.11 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.657us EXCHANGE_NODE (id=18):(Total: 14s182ms, non-child: 695.801ms, % non-child: 4.91%) BytesReceived(1s000ms): 5.05 MB, 25.59 MB, 55.63 MB, 85.29 MB, 115.09 MB, 144.82 MB, 174.66 MB, 204.16 MB, 234.29 MB, 261.24 MB, 268.99 MB, 275.18 MB, 281.15 MB, 287.14 MB, 293.06 MB, 298.93 MB, 304.94 MB, 311.09 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 469.545ms - DeserializeRowBatchTimer: 1s345ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 150.619ms - SendersBlockedTotalTimer(*): 742.721ms HASH_JOIN_NODE (id=7):(Total: 12s824ms, non-child: 291.698ms, % non-child: 2.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 29.782us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 74.503us - GetNewBlockTime: 95.234us - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 8.52 MB (8937520) - PinTime: 0ns - ProbeRows: 2.98M (2982111) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 268.712ms - RowsReturned: 2.98M (2982111) - RowsReturnedRate: 232.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.307us EXCHANGE_NODE (id=17):(Total: 18.272us, non-child: 18.272us, % non-child: 100.00%) BytesReceived(1s000ms): 1.64 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 8.695us - DeserializeRowBatchTimer: 15.418us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 17.18 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s533ms, non-child: 475.610ms, % non-child: 3.79%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 146.893us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 295.519us - GetNewBlockTime: 576.987us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 6.40 MB (6708952) - PinTime: 0ns - ProbeRows: 6.33M (6326095) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 436.138ms - RowsReturned: 2.98M (2982111) - RowsReturnedRate: 237.93 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.83us EXCHANGE_NODE (id=16):(Total: 75.840us, non-child: 75.840us, % non-child: 100.00%) BytesReceived(1s000ms): 8.21 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 54.36us - DeserializeRowBatchTimer: 60.504us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 23.73 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s059ms, non-child: 827.467ms, % non-child: 6.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.657us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 92.471us - GetNewBlockTime: 443.769us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.11 MB (5362264) - PinTime: 0ns - ProbeRows: 12.95M (12948526) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 766.90ms - RowsReturned: 6.33M (6326095) - RowsReturnedRate: 524.57 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.696us EXCHANGE_NODE (id=15):(Total: 13.595us, non-child: 13.595us, % non-child: 100.00%) BytesReceived(1s000ms): 926.00 B, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 3.343us - DeserializeRowBatchTimer: 13.652us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 5.59 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 11s233ms, non-child: 11s233ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:4/848.02 MB 6:10/1.75 GB 2:4/703.92 MB 8:8/1.05 GB 7:9/1.76 GB 5:7/1.20 GB 0:12/1.46 GB 10:8/1.44 GB 3:8/1.22 GB 9:9/1.35 GB 1:6/729.68 MB Hdfs Read Thread Concurrency Bucket: 0:71.21% 1:18.18% 2:4.545% 3:6.061% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:595 ExecOption: Codegen enabled: 0 out of 85 BytesRead(1s000ms): 0, 228.28 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 250.13 MB, 397.32 MB, 585.14 MB, 809.61 MB, 1005.96 MB, 1.16 GB, 1.30 GB, 1.50 GB, 1.67 GB, 1.89 GB, 2.04 GB, 2.26 GB, 2.39 GB, 2.42 GB - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 7.68 - BytesRead: 2.42 GB (2601083414) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.42 GB (2601083414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.42 GB (2601083414) - DecompressionTime: 9s195ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 377.08 MB (395395216) - PerReadThreadRawHdfsThroughput: 167.07 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 238.89M (238887109) - RowsReturned: 12.95M (12948526) - RowsReturnedRate: 1.15 M/sec - ScanRangesComplete: 85 (85) - ScannerThreadsInvoluntaryContextSwitches: 11.11K (11113) - ScannerThreadsTotalWallClockTime: 4m15s - MaterializeTupleTime(*): 3m51s - ScannerThreadsSysTime: 191.966ms - ScannerThreadsUserTime: 1m28s - ScannerThreadsVoluntaryContextSwitches: 1.44K (1435) - TotalRawHdfsReadTime(*): 14s847ms - TotalReadThroughput: 72.96 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49aa (host=c2114.hal.cloudera.com:22000):(Total: 33s679ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:5/820.60 MB 8:8/1.34 GB 4:4/684.33 MB 6:6/1.02 GB 3:12/1.75 GB 0:10/1.56 GB 5:6/1.15 GB 7:11/1.68 GB 2:3/279.36 MB 1:10/1.55 GB 9:9/1.66 GB MemoryUsage(1s000ms): 12.72 MB, 640.55 MB, 640.59 MB, 704.59 MB, 768.57 MB, 768.59 MB, 832.55 MB, 896.57 MB, 896.55 MB, 960.57 MB, 1.00 GB, 1.00 GB, 1.00 GB, 1.00 GB, 1.00 GB, 1.00 GB, 1.00 GB, 1.03 GB, 1.19 GB, 1.36 GB, 1.42 GB, 1.30 GB, 1.37 GB, 1.34 GB, 1.32 GB, 1.32 GB, 1.30 GB, 1.51 GB, 1.56 GB, 1.58 GB, 1.58 GB, 1.53 GB, 1.49 GB, 1.35 GB ThreadUsage(1s000ms): 1, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 7, 2 - AverageThreadTokens: 9.09 - PeakMemoryUsage: 1.61 GB (1733747968) - PerHostPeakMemUsage: 5.56 GB (5966618400) - PrepareTime: 326.792ms - RowsProduced: 278.98K (278979) - TotalCpuTime: 4m45s - TotalNetworkReceiveTime: 13s677ms - TotalNetworkSendTime: 19.387ms - TotalStorageWaitTime: 11s997ms CodeGen:(Total: 1s014ms, non-child: 1s014ms, % non-child: 100.00%) - CodegenTime: 6.940ms - CompileTime: 206.677ms - LoadTime: 33.970us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 509.251ms - PrepareTime: 296.152ms DataStreamSender (dst_id=19):(Total: 205.666ms, non-child: 205.666ms, % non-child: 100.00%) - BytesSent: 11.15 MB (11696129) - NetworkThroughput(*): 16.38 MB/sec - OverallThroughput: 54.23 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 99.394ms - ThriftTransmitTime(*): 680.864ms - UncompressedRowBatchSize: 16.15 MB (16932362) AGGREGATION_NODE (id=9):(Total: 33s470ms, non-child: 1s068ms, % non-child: 3.19%) ExecOption: Codegen Enabled, Spilled - BuildTime: 689.525ms - GetNewBlockTime: 32.57ms - GetResultsTime: 17.665ms - HTResizeTime: 21.78ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 286.11 MB (300007704) - PinTime: 7.527ms - RowsRepartitioned: 88.25K (88255) - RowsReturned: 278.98K (278979) - RowsReturnedRate: 8.34 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 14.65us HASH_JOIN_NODE (id=8):(Total: 32s401ms, non-child: 25s445ms, % non-child: 78.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s337ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s285ms - GetNewBlockTime: 9.668ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 2.98M (2984736) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 336.319ms - RowsReturned: 2.97M (2966737) - RowsReturnedRate: 91.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.797us EXCHANGE_NODE (id=18):(Total: 14s186ms, non-child: 697.952ms, % non-child: 4.92%) BytesReceived(1s000ms): 5.03 MB, 25.90 MB, 55.95 MB, 85.59 MB, 115.38 MB, 145.17 MB, 174.97 MB, 204.47 MB, 234.46 MB, 261.44 MB, 269.04 MB, 275.24 MB, 281.22 MB, 287.21 MB, 293.12 MB, 298.98 MB, 305.00 MB, 311.14 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 464.771ms - DeserializeRowBatchTimer: 1s378ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 172.573ms - SendersBlockedTotalTimer(*): 516.477ms HASH_JOIN_NODE (id=7):(Total: 12s443ms, non-child: 281.710ms, % non-child: 2.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 25.972us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 82.620us - GetNewBlockTime: 1.140ms - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.59 MB (10059864) - PinTime: 0ns - ProbeRows: 2.98M (2984736) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 258.622ms - RowsReturned: 2.98M (2984736) - RowsReturnedRate: 239.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.859us EXCHANGE_NODE (id=17):(Total: 18.24us, non-child: 18.24us, % non-child: 100.00%) BytesReceived(1s000ms): 1.64 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 8.639us - DeserializeRowBatchTimer: 18.145us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 17.42 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s163ms, non-child: 470.38ms, % non-child: 3.86%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 230.788us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 357.736us - GetNewBlockTime: 586.585us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 8.47 MB (8883728) - PinTime: 0ns - ProbeRows: 6.34M (6336187) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 431.13ms - RowsReturned: 2.98M (2984736) - RowsReturnedRate: 245.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.801us EXCHANGE_NODE (id=16):(Total: 78.781us, non-child: 78.781us, % non-child: 100.00%) BytesReceived(1s000ms): 8.21 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 58.446us - DeserializeRowBatchTimer: 76.38us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 22.85 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s695ms, non-child: 795.735ms, % non-child: 6.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 23.845us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 82.633us - GetNewBlockTime: 426.844us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.12 MB (5368928) - PinTime: 0ns - ProbeRows: 12.96M (12960417) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 734.129ms - RowsReturned: 6.34M (6336187) - RowsReturnedRate: 541.77 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 12.32us EXCHANGE_NODE (id=15):(Total: 14.837us, non-child: 14.837us, % non-child: 100.00%) BytesReceived(1s000ms): 926.00 B, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 4.495us - DeserializeRowBatchTimer: 16.904us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 5.12 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s900ms, non-child: 10s900ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:5/820.60 MB 8:8/1.34 GB 4:4/684.33 MB 6:6/1.02 GB 3:12/1.75 GB 0:10/1.56 GB 5:6/1.15 GB 7:11/1.68 GB 2:3/279.36 MB 1:10/1.55 GB 9:9/1.66 GB Hdfs Read Thread Concurrency Bucket: 0:77.27% 1:13.64% 2:4.545% 3:3.03% 4:1.515% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:588 ExecOption: Codegen enabled: 0 out of 84 BytesRead(1s000ms): 0, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 262.19 MB, 275.82 MB, 335.69 MB, 612.05 MB, 761.93 MB, 965.43 MB, 1.15 GB, 1.31 GB, 1.55 GB, 1.64 GB, 1.86 GB, 2.06 GB, 2.21 GB, 2.39 GB, 2.42 GB - AverageHdfsReadThreadConcurrency: 0.38 - AverageScannerThreadConcurrency: 7.74 - BytesRead: 2.42 GB (2602919711) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.42 GB (2602919711) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.42 GB (2602919711) - DecompressionTime: 9s174ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 379.89 MB (398347056) - PerReadThreadRawHdfsThroughput: 185.85 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 239.11M (239105568) - RowsReturned: 12.96M (12960417) - RowsReturnedRate: 1.19 M/sec - ScanRangesComplete: 84 (84) - ScannerThreadsInvoluntaryContextSwitches: 11.23K (11229) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 3m35s - ScannerThreadsSysTime: 245.959ms - ScannerThreadsUserTime: 1m29s - ScannerThreadsVoluntaryContextSwitches: 1.52K (1521) - TotalRawHdfsReadTime(*): 13s356ms - TotalReadThroughput: 73.01 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a9 (host=c2106.hal.cloudera.com:22000):(Total: 32s737ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:9/1.86 GB 1:6/971.41 MB 10:9/1.54 GB 9:7/1.27 GB 3:4/540.44 MB 5:9/1.37 GB 0:7/1.63 GB 6:3/518.93 MB 8:11/1.20 GB 7:5/656.89 MB 2:10/1.91 GB MemoryUsage(1s000ms): 12.74 MB, 634.83 MB, 665.46 MB, 729.44 MB, 793.48 MB, 793.46 MB, 857.46 MB, 921.44 MB, 921.46 MB, 985.46 MB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.02 GB, 1.07 GB, 1.23 GB, 1.42 GB, 1.42 GB, 1.27 GB, 1.33 GB, 1.33 GB, 1.33 GB, 1.36 GB, 1.35 GB, 1.43 GB, 1.61 GB, 1.58 GB, 1.52 GB, 1.59 GB, 1.44 GB ThreadUsage(1s000ms): 1, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 10, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 5 - AverageThreadTokens: 9.10 - PeakMemoryUsage: 1.65 GB (1767465496) - PerHostPeakMemUsage: 5.58 GB (5994578456) - PrepareTime: 325.310ms - RowsProduced: 278.47K (278473) - TotalCpuTime: 4m39s - TotalNetworkReceiveTime: 13s522ms - TotalNetworkSendTime: 23.106ms - TotalStorageWaitTime: 12s569ms CodeGen:(Total: 1s082ms, non-child: 1s082ms, % non-child: 100.00%) - CodegenTime: 7.113ms - CompileTime: 224.841ms - LoadTime: 94.131us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 560.98ms - PrepareTime: 294.974ms DataStreamSender (dst_id=19):(Total: 203.813ms, non-child: 203.813ms, % non-child: 100.00%) - BytesSent: 11.13 MB (11672208) - NetworkThroughput(*): 16.90 MB/sec - OverallThroughput: 54.62 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 95.817ms - ThriftTransmitTime(*): 658.778ms - UncompressedRowBatchSize: 16.12 MB (16902628) AGGREGATION_NODE (id=9):(Total: 32s530ms, non-child: 1s078ms, % non-child: 3.31%) ExecOption: Codegen Enabled, Spilled - BuildTime: 703.586ms - GetNewBlockTime: 24.229ms - GetResultsTime: 16.702ms - HTResizeTime: 21.260ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 284.71 MB (298539264) - PinTime: 6.793ms - RowsRepartitioned: 84.32K (84318) - RowsReturned: 278.47K (278473) - RowsReturnedRate: 8.56 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 13.256us HASH_JOIN_NODE (id=8):(Total: 31s452ms, non-child: 24s992ms, % non-child: 79.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s413ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s055ms - GetNewBlockTime: 6.523ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 2.98M (2976530) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 344.75ms - RowsReturned: 2.96M (2958459) - RowsReturnedRate: 94.06 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.6us EXCHANGE_NODE (id=18):(Total: 14s040ms, non-child: 702.688ms, % non-child: 5.00%) BytesReceived(1s000ms): 5.05 MB, 26.60 MB, 56.62 MB, 86.27 MB, 116.11 MB, 145.90 MB, 175.69 MB, 205.19 MB, 235.00 MB, 261.93 MB, 269.22 MB, 275.40 MB, 281.38 MB, 287.37 MB, 293.28 MB, 299.15 MB, 305.16 MB, 311.24 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 472.32ms - DeserializeRowBatchTimer: 1s371ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.07 M/sec - SendersBlockedTimer: 241.451ms - SendersBlockedTotalTimer(*): 959.580ms HASH_JOIN_NODE (id=7):(Total: 11s797ms, non-child: 302.140ms, % non-child: 2.56%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 41.899us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 74.536us - GetNewBlockTime: 1.27ms - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 9.17 MB (9610960) - PinTime: 0ns - ProbeRows: 2.98M (2976530) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 279.125ms - RowsReturned: 2.98M (2976530) - RowsReturnedRate: 252.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.967us EXCHANGE_NODE (id=17):(Total: 21.797us, non-child: 21.797us, % non-child: 100.00%) BytesReceived(1s000ms): 1.64 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 9.705us - DeserializeRowBatchTimer: 12.554us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 14.41 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 11s496ms, non-child: 490.507ms, % non-child: 4.27%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 195.574us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 443.25us - GetNewBlockTime: 631.854us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 8.04 MB (8427568) - PinTime: 0ns - ProbeRows: 6.32M (6321462) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 450.414ms - RowsReturned: 2.98M (2976530) - RowsReturnedRate: 258.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.425us EXCHANGE_NODE (id=16):(Total: 83.113us, non-child: 83.113us, % non-child: 100.00%) BytesReceived(1s000ms): 8.21 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 67.491us - DeserializeRowBatchTimer: 43.199us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 21.66 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s007ms, non-child: 826.750ms, % non-child: 7.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 11.364us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 51.503us - GetNewBlockTime: 128.161us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.14 MB (5388168) - PinTime: 0ns - ProbeRows: 12.93M (12929369) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 763.700ms - RowsReturned: 6.32M (6321462) - RowsReturnedRate: 574.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.102us EXCHANGE_NODE (id=15):(Total: 11.977us, non-child: 11.977us, % non-child: 100.00%) BytesReceived(1s000ms): 926.00 B, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 3.246us - DeserializeRowBatchTimer: 13.397us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 6.35 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s181ms, non-child: 10s181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:9/1.86 GB 1:6/971.41 MB 10:9/1.54 GB 9:7/1.27 GB 3:4/540.44 MB 5:9/1.37 GB 0:7/1.63 GB 6:3/518.93 MB 8:11/1.20 GB 7:5/656.89 MB 2:10/1.91 GB Hdfs Read Thread Concurrency Bucket: 0:76.56% 1:6.25% 2:12.5% 3:4.688% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:560 ExecOption: Codegen enabled: 0 out of 80 BytesRead(1s000ms): 0, 229.03 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 261.06 MB, 368.43 MB, 622.21 MB, 865.99 MB, 1.03 GB, 1.21 GB, 1.36 GB, 1.52 GB, 1.78 GB, 1.95 GB, 2.11 GB, 2.34 GB, 2.41 GB - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 7.88 - BytesRead: 2.41 GB (2591052105) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.41 GB (2591052105) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.41 GB (2591052105) - DecompressionTime: 9s049ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 389.24 MB (408151160) - PerReadThreadRawHdfsThroughput: 182.89 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 238.20M (238201816) - RowsReturned: 12.93M (12929369) - RowsReturnedRate: 1.27 M/sec - ScanRangesComplete: 80 (80) - ScannerThreadsInvoluntaryContextSwitches: 10.55K (10554) - ScannerThreadsTotalWallClockTime: 4m12s - MaterializeTupleTime(*): 3m50s - ScannerThreadsSysTime: 231.961ms - ScannerThreadsUserTime: 1m27s - ScannerThreadsVoluntaryContextSwitches: 1.43K (1434) - TotalRawHdfsReadTime(*): 13s511ms - TotalReadThroughput: 74.88 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49a7 (host=c2104.hal.cloudera.com:22000):(Total: 31s368ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:5/1.03 GB 4:8/1.68 GB 8:4/430.25 MB 10:10/2.04 GB 9:9/1.37 GB 7:3/493.36 MB 6:6/1.19 GB 3:5/673.51 MB 5:11/1.73 GB 0:10/1.65 GB 1:9/1.25 GB MemoryUsage(1s000ms): 8.06 MB, 588.38 MB, 849.96 MB, 850.91 MB, 978.91 MB, 978.91 MB, 978.91 MB, 1.08 GB, 1.08 GB, 1.08 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.21 GB, 1.22 GB, 1.38 GB, 1.55 GB, 1.61 GB, 1.54 GB, 1.57 GB, 1.61 GB, 1.56 GB, 1.53 GB, 1.80 GB, 1.78 GB, 1.85 GB, 1.83 GB, 1.55 GB, 1.36 GB ThreadUsage(1s000ms): 1, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 15, 15, 15, 15, 15, 15, 15, 15, 15, 13, 7, 3 - AverageThreadTokens: 14.52 - PeakMemoryUsage: 1.90 GB (2044103080) - PerHostPeakMemUsage: 5.97 GB (6405433768) - PrepareTime: 324.951ms - RowsProduced: 280.91K (280912) - TotalCpuTime: 7m13s - TotalNetworkReceiveTime: 13s620ms - TotalNetworkSendTime: 6.270ms - TotalStorageWaitTime: 15s691ms CodeGen:(Total: 1s121ms, non-child: 1s121ms, % non-child: 100.00%) - CodegenTime: 6.864ms - CompileTime: 239.47ms - LoadTime: 72.850us - ModuleFileSize: 2.56 MB (2683096) - OptimizationTime: 584.564ms - PrepareTime: 296.156ms DataStreamSender (dst_id=19):(Total: 182.533ms, non-child: 182.533ms, % non-child: 100.00%) - BytesSent: 11.23 MB (11778086) - NetworkThroughput(*): 19.44 MB/sec - OverallThroughput: 61.54 MB/sec - PeakMemoryUsage: 168.00 KB (172032) - SerializeBatchTime: 91.491ms - ThriftTransmitTime(*): 577.889ms - UncompressedRowBatchSize: 16.26 MB (17050891) AGGREGATION_NODE (id=9):(Total: 31s183ms, non-child: 1s092ms, % non-child: 3.50%) ExecOption: Codegen Enabled, Spilled - BuildTime: 724.248ms - GetNewBlockTime: 496.657us - GetResultsTime: 16.713ms - HTResizeTime: 23.461ms - HashBuckets: 557.06K (557056) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 1 (1) - NumRepartitions: 1 (1) - PartitionsCreated: 32 (32) - PeakMemoryUsage: 287.22 MB (301167144) - PinTime: 6.32us - RowsRepartitioned: 88.01K (88009) - RowsReturned: 280.91K (280912) - RowsReturnedRate: 9.01 K/sec - SpilledPartitions: 1 (1) - UnpinTime: 13.735us HASH_JOIN_NODE (id=8):(Total: 30s090ms, non-child: 25s154ms, % non-child: 83.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 2s299ms - BuildRows: 15.00M (15000000) - BuildRowsPartitioned: 15.00M (15000000) - BuildTime: 2s179ms - GetNewBlockTime: 1.325ms - HashBuckets: 33.55M (33554432) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.14 GB (1219543040) - PinTime: 0ns - ProbeRows: 3.00M (3004089) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 393.15ms - RowsReturned: 2.99M (2985930) - RowsReturnedRate: 99.23 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.27us EXCHANGE_NODE (id=18):(Total: 14s111ms, non-child: 660.717ms, % non-child: 4.68%) BytesReceived(500.0ms): 6.67 MB, 12.70 MB, 27.91 MB, 42.82 MB, 57.76 MB, 72.47 MB, 87.39 MB, 102.24 MB, 117.18 MB, 132.05 MB, 146.98 MB, 161.89 MB, 176.72 MB, 191.59 MB, 206.36 MB, 221.11 MB, 236.52 MB, 252.32 MB, 263.40 MB, 266.37 MB, 269.41 MB, 272.58 MB, 275.63 MB, 278.63 MB, 281.62 MB, 284.59 MB, 287.63 MB, 290.56 MB, 293.54 MB, 296.45 MB, 299.37 MB, 302.38 MB, 305.38 MB, 309.04 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB, 311.70 MB - BytesReceived: 311.70 MB (326843395) - ConvertRowBatchTime: 446.30ms - DeserializeRowBatchTimer: 1s393ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 15.00M (15000000) - RowsReturnedRate: 1.06 M/sec - SendersBlockedTimer: 283.660ms - SendersBlockedTotalTimer(*): 1s408ms HASH_JOIN_NODE (id=7):(Total: 10s278ms, non-child: 317.558ms, % non-child: 3.09%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 26.232us - BuildRows: 314 (314) - BuildRowsPartitioned: 314 (314) - BuildTime: 85.392us - GetNewBlockTime: 405.785us - HashBuckets: 672 (672) - LargestPartitionPercent: 8 (8) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.43 MB (10931616) - PinTime: 0ns - ProbeRows: 3.00M (3004089) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 294.154ms - RowsReturned: 3.00M (3004089) - RowsReturnedRate: 292.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.781us EXCHANGE_NODE (id=17):(Total: 19.736us, non-child: 19.736us, % non-child: 100.00%) BytesReceived(500.0ms): 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB, 3.28 KB - BytesReceived: 3.28 KB (3355) - ConvertRowBatchTime: 8.947us - DeserializeRowBatchTimer: 15.404us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 314 (314) - RowsReturnedRate: 15.91 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 9s962ms, non-child: 528.619ms, % non-child: 5.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 251.371us - BuildRows: 1.80K (1800) - BuildRowsPartitioned: 1.80K (1800) - BuildTime: 348.555us - GetNewBlockTime: 432.81us - HashBuckets: 4.10K (4096) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 8.28 MB (8683296) - PinTime: 0ns - ProbeRows: 6.35M (6351006) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 486.163ms - RowsReturned: 3.00M (3004089) - RowsReturnedRate: 301.53 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.82us EXCHANGE_NODE (id=16):(Total: 95.537us, non-child: 95.537us, % non-child: 100.00%) BytesReceived(500.0ms): 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB, 16.42 KB - BytesReceived: 16.42 KB (16812) - ConvertRowBatchTime: 78.888us - DeserializeRowBatchTimer: 64.233us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.80K (1800) - RowsReturnedRate: 18.84 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 9s436ms, non-child: 866.103ms, % non-child: 9.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 16.149us - BuildRows: 76 (76) - BuildRowsPartitioned: 76 (76) - BuildTime: 42.655us - GetNewBlockTime: 459.252us - HashBuckets: 156 (156) - LargestPartitionPercent: 11 (11) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 5.14 MB (5390632) - PinTime: 0ns - ProbeRows: 13.00M (12998513) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 803.524ms - RowsReturned: 6.35M (6351006) - RowsReturnedRate: 673.05 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.505us EXCHANGE_NODE (id=15):(Total: 20.705us, non-child: 20.705us, % non-child: 100.00%) BytesReceived(500.0ms): 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB, 1.81 KB - BytesReceived: 1.81 KB (1853) - ConvertRowBatchTime: 2.396us - DeserializeRowBatchTimer: 16.892us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 76 (76) - RowsReturnedRate: 3.67 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 8s571ms, non-child: 8s571ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:5/1.03 GB 4:8/1.68 GB 8:4/430.25 MB 10:10/2.04 GB 9:9/1.37 GB 7:3/493.36 MB 6:6/1.19 GB 3:5/673.51 MB 5:11/1.73 GB 0:10/1.65 GB 1:9/1.25 GB Hdfs Read Thread Concurrency Bucket: 0:69.35% 1:20.97% 2:3.226% 3:4.839% 4:0% 5:0% 6:0% 7:1.613% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:560 ExecOption: Codegen enabled: 0 out of 80 BytesRead(500.0ms): 0, 80.25 MB, 303.81 MB, 399.31 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.79 MB, 408.89 MB, 639.26 MB, 709.72 MB, 918.48 MB, 1021.14 MB, 1.11 GB, 1.23 GB, 1.29 GB, 1.42 GB, 1.55 GB, 1.67 GB, 1.79 GB, 1.88 GB, 2.03 GB, 2.18 GB, 2.26 GB, 2.43 GB, 2.43 GB, 2.43 GB, 2.43 GB, 2.43 GB, 2.43 GB - AverageHdfsReadThreadConcurrency: 0.53 - AverageScannerThreadConcurrency: 13.32 - BytesRead: 2.43 GB (2608178793) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.43 GB (2608178793) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.43 GB (2608178793) - DecompressionTime: 11s372ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 11 (11) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 625.07 MB (655436976) - PerReadThreadRawHdfsThroughput: 151.57 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 239.79M (239792962) - RowsReturned: 13.00M (12998513) - RowsReturnedRate: 1.52 M/sec - ScanRangesComplete: 80 (80) - ScannerThreadsInvoluntaryContextSwitches: 18.84K (18839) - ScannerThreadsTotalWallClockTime: 6m50s - MaterializeTupleTime(*): 6m22s - ScannerThreadsSysTime: 280.952ms - ScannerThreadsUserTime: 2m6s - ScannerThreadsVoluntaryContextSwitches: 1.46K (1459) - TotalRawHdfsReadTime(*): 16s410ms - TotalReadThroughput: 78.96 MB/sec Fragment F04: Instance 24449bb4dc430956:ca0f6ca2e0cb49ac (host=c2106.hal.cloudera.com:22000):(Total: 17s040ms, non-child: 16.756ms, % non-child: 0.10%) Hdfs split stats (:<# splits>/): 10:1/45.93 MB 0:1/46.00 MB MemoryUsage(500.0ms): 34.49 MB, 34.49 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.36 MB, 34.49 MB, 34.36 MB, 34.36 MB, 34.49 MB, 34.36 MB, 34.42 MB, 34.49 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.36 MB, 34.49 MB, 34.36 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.42 MB, 34.36 MB, 34.49 MB, 34.36 MB, 34.49 MB, 26.44 MB, 18.58 MB, 18.58 MB, 18.52 MB, 18.64 MB, 18.52 MB, 2.80 MB ThreadUsage(500.0ms): 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.94 - PeakMemoryUsage: 34.49 MB (36160888) - PerHostPeakMemUsage: 3.74 GB (4013197472) - PrepareTime: 114.784us - RowsProduced: 5.00M (4995000) - TotalCpuTime: 35s135ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 15s316ms - TotalStorageWaitTime: 33.420ms DataStreamSender (dst_id=18):(Total: 16s945ms, non-child: 16s945ms, % non-child: 100.00%) - BytesSent: 597.45 MB (626467002) - NetworkThroughput(*): 8.00 MB/sec - OverallThroughput: 35.26 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 1s431ms - ThriftTransmitTime(*): 1m14s - UncompressedRowBatchSize: 1.02 GB (1099548138) HDFS_SCAN_NODE (id=4):(Total: 78.980ms, non-child: 78.980ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/45.93 MB 0:1/46.00 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 2 BytesRead(500.0ms): 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB, 25.40 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.94 - BytesRead: 25.40 MB (26631659) - BytesReadDataNodeCache: 0 - BytesReadLocal: 25.40 MB (26631659) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 25.40 MB (26631659) - DecompressionTime: 11.451ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 34.45 MB (36119912) - PerReadThreadRawHdfsThroughput: 707.53 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 5.00M (4995000) - RowsReturned: 5.00M (4995000) - RowsReturnedRate: 63.24 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 355 (355) - ScannerThreadsTotalWallClockTime: 33s407ms - MaterializeTupleTime(*): 33s347ms - ScannerThreadsSysTime: 37.994ms - ScannerThreadsUserTime: 844.871ms - ScannerThreadsVoluntaryContextSwitches: 4.85K (4846) - TotalRawHdfsReadTime(*): 35.896ms - TotalReadThroughput: 1.49 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49ab (host=c2108.hal.cloudera.com:22000):(Total: 9s141ms, non-child: 9.894ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 7:1/46.01 MB MemoryUsage(500.0ms): 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 11.89 MB, 11.89 MB, 11.89 MB, 3.34 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.94 - PeakMemoryUsage: 19.89 MB (20853864) - PerHostPeakMemUsage: 2.60 GB (2788585216) - PrepareTime: 121.657us - RowsProduced: 2.50M (2500000) - TotalCpuTime: 9s707ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 8s155ms - TotalStorageWaitTime: 14.566ms DataStreamSender (dst_id=18):(Total: 9s083ms, non-child: 9s083ms, % non-child: 100.00%) - BytesSent: 327.08 MB (342968142) - NetworkThroughput(*): 8.14 MB/sec - OverallThroughput: 36.01 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 801.956ms - ThriftTransmitTime(*): 40s188ms - UncompressedRowBatchSize: 524.84 MB (550335540) HDFS_SCAN_NODE (id=4):(Total: 47.957ms, non-child: 47.957ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/46.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.71 MB (13328949) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.71 MB (13328949) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.71 MB (13328949) - DecompressionTime: 5.976ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780168) - PerReadThreadRawHdfsThroughput: 829.55 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2500000) - RowsReturned: 2.50M (2500000) - RowsReturnedRate: 52.13 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 173 (173) - ScannerThreadsTotalWallClockTime: 8s709ms - MaterializeTupleTime(*): 8s682ms - ScannerThreadsSysTime: 29.995ms - ScannerThreadsUserTime: 391.940ms - ScannerThreadsVoluntaryContextSwitches: 2.36K (2358) - TotalRawHdfsReadTime(*): 15.323ms - TotalReadThroughput: 1.41 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49ad (host=c2114.hal.cloudera.com:22000):(Total: 9s035ms, non-child: 10.48ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 2:1/46.01 MB MemoryUsage(500.0ms): 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.75 MB, 19.81 MB, 11.83 MB, 11.83 MB, 11.89 MB, 1.99 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.94 - PeakMemoryUsage: 19.89 MB (20853864) - PerHostPeakMemUsage: 2.58 GB (2774989976) - PrepareTime: 129.264us - RowsProduced: 2.50M (2500000) - TotalCpuTime: 9s623ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 8s040ms - TotalStorageWaitTime: 12.537ms DataStreamSender (dst_id=18):(Total: 8s973ms, non-child: 8s973ms, % non-child: 100.00%) - BytesSent: 327.17 MB (343058160) - NetworkThroughput(*): 8.24 MB/sec - OverallThroughput: 36.46 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 808.688ms - ThriftTransmitTime(*): 39s700ms - UncompressedRowBatchSize: 524.81 MB (550305342) HDFS_SCAN_NODE (id=4):(Total: 51.534ms, non-child: 51.534ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/46.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.71 MB (13328959) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.71 MB (13328959) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.71 MB (13328959) - DecompressionTime: 5.607ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780168) - PerReadThreadRawHdfsThroughput: 839.85 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2500000) - RowsReturned: 2.50M (2500000) - RowsReturnedRate: 48.51 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 171 (171) - ScannerThreadsTotalWallClockTime: 8s616ms - MaterializeTupleTime(*): 8s593ms - ScannerThreadsSysTime: 27.995ms - ScannerThreadsUserTime: 392.940ms - ScannerThreadsVoluntaryContextSwitches: 2.40K (2397) - TotalRawHdfsReadTime(*): 15.135ms - TotalReadThroughput: 1.41 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49af (host=c2110.hal.cloudera.com:22000):(Total: 8s977ms, non-child: 10.155ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 8:1/46.01 MB MemoryUsage(500.0ms): 199.97 KB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 11.89 MB, 11.89 MB, 11.88 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 19.89 MB (20853872) - PerHostPeakMemUsage: 2.52 GB (2708934280) - PrepareTime: 89.888us - RowsProduced: 2.50M (2500000) - TotalCpuTime: 9s570ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7s995ms - TotalStorageWaitTime: 14.662ms DataStreamSender (dst_id=18):(Total: 8s912ms, non-child: 8s912ms, % non-child: 100.00%) - BytesSent: 319.19 MB (334699458) - NetworkThroughput(*): 8.10 MB/sec - OverallThroughput: 35.81 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 797.589ms - ThriftTransmitTime(*): 39s417ms - UncompressedRowBatchSize: 524.79 MB (550277010) HDFS_SCAN_NODE (id=4):(Total: 54.56ms, non-child: 54.56ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/46.01 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB, 12.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 12.71 MB (13329040) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.71 MB (13329040) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.71 MB (13329040) - DecompressionTime: 8.515ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780176) - PerReadThreadRawHdfsThroughput: 771.64 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2500000) - RowsReturned: 2.50M (2500000) - RowsReturnedRate: 46.25 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 168 (168) - ScannerThreadsTotalWallClockTime: 8s576ms - MaterializeTupleTime(*): 8s546ms - ScannerThreadsSysTime: 26.995ms - ScannerThreadsUserTime: 404.938ms - ScannerThreadsVoluntaryContextSwitches: 2.39K (2391) - TotalRawHdfsReadTime(*): 16.473ms - TotalReadThroughput: 1.41 MB/sec Instance 24449bb4dc430956:ca0f6ca2e0cb49ae (host=c2112.hal.cloudera.com:22000):(Total: 8s954ms, non-child: 9.934ms, % non-child: 0.11%) Hdfs split stats (:<# splits>/): 6:1/46.10 MB MemoryUsage(500.0ms): 19.76 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.81 MB, 19.81 MB, 19.81 MB, 19.75 MB, 19.75 MB, 19.81 MB, 11.89 MB, 11.83 MB, 11.89 MB, 4.58 MB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 1.94 - PeakMemoryUsage: 19.89 MB (20853872) - PerHostPeakMemUsage: 2.61 GB (2799863736) - PrepareTime: 142.216us - RowsProduced: 2.50M (2505000) - TotalCpuTime: 9s458ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 8s057ms - TotalStorageWaitTime: 16.603ms DataStreamSender (dst_id=18):(Total: 8s876ms, non-child: 8s876ms, % non-child: 100.00%) - BytesSent: 299.33 MB (313867608) - NetworkThroughput(*): 7.68 MB/sec - OverallThroughput: 33.72 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 691.97ms - ThriftTransmitTime(*): 38s953ms - UncompressedRowBatchSize: 525.86 MB (551408364) HDFS_SCAN_NODE (id=4):(Total: 67.696ms, non-child: 67.696ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/46.10 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB, 12.74 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.94 - BytesRead: 12.74 MB (13355250) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.74 MB (13355250) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 12.74 MB (13355250) - DecompressionTime: 5.980ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 19.82 MB (20780176) - PerReadThreadRawHdfsThroughput: 705.58 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 2.50M (2505000) - RowsReturned: 2.50M (2505000) - RowsReturnedRate: 37.00 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 171 (171) - ScannerThreadsTotalWallClockTime: 8s551ms - MaterializeTupleTime(*): 8s522ms - ScannerThreadsSysTime: 26.995ms - ScannerThreadsUserTime: 391.940ms - ScannerThreadsVoluntaryContextSwitches: 2.48K (2484) - TotalRawHdfsReadTime(*): 18.51ms - TotalReadThroughput: 1.42 MB/sec Fragment F03: Instance 24449bb4dc430956:ca0f6ca2e0cb49b0 (host=c2110.hal.cloudera.com:22000):(Total: 46.908ms, non-child: 3.903ms, % non-child: 8.32%) Hdfs split stats (:<# splits>/): 9:1/2.17 MB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 1.28 MB (1341336) - PerHostPeakMemUsage: 648.41 MB (679905352) - PrepareTime: 404.844us - RowsProduced: 314 (314) - TotalCpuTime: 93.759ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.14ms - TotalStorageWaitTime: 9.561ms DataStreamSender (dst_id=17):(Total: 132.377us, non-child: 132.377us, % non-child: 100.00%) - BytesSent: 19.66 KB (20130) - NetworkThroughput(*): 1.11 MB/sec - OverallThroughput: 145.02 MB/sec - PeakMemoryUsage: 48.00 KB (49152) - SerializeBatchTime: 66.360us - ThriftTransmitTime(*): 17.269ms - UncompressedRowBatchSize: 36.82 KB (37704) HDFS_SCAN_NODE (id=3):(Total: 42.873ms, non-child: 42.873ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/2.17 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 466.62 KB (477816) - BytesReadDataNodeCache: 0 - BytesReadLocal: 466.62 KB (477816) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 466.62 KB (477816) - DecompressionTime: 425.906us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.22 MB (1283992) - PerReadThreadRawHdfsThroughput: 145.79 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 314 (314) - RowsReturnedRate: 7.32 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 42.150ms - MaterializeTupleTime(*): 30.672ms - ScannerThreadsSysTime: 1.999ms - ScannerThreadsUserTime: 28.995ms - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 3.125ms - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 24449bb4dc430956:ca0f6ca2e0cb49b1 (host=c2108.hal.cloudera.com:22000):(Total: 18.382ms, non-child: 3.883ms, % non-child: 21.13%) Hdfs split stats (:<# splits>/): 0:1/41.08 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 273.83 KB (280400) - PerHostPeakMemUsage: 647.96 MB (679439464) - PrepareTime: 139.683us - RowsProduced: 1.80K (1800) - TotalCpuTime: 30.237ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 7.636ms - TotalStorageWaitTime: 6.383ms DataStreamSender (dst_id=16):(Total: 5.648ms, non-child: 5.648ms, % non-child: 100.00%) - BytesSent: 98.51 KB (100872) - NetworkThroughput(*): 4.06 MB/sec - OverallThroughput: 17.03 MB/sec - PeakMemoryUsage: 48.00 KB (49152) - SerializeBatchTime: 305.103us - ThriftTransmitTime(*): 23.712ms - UncompressedRowBatchSize: 210.98 KB (216048) HDFS_SCAN_NODE (id=2):(Total: 8.849ms, non-child: 8.849ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/41.08 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:3 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 80.91 KB (82848) - BytesReadDataNodeCache: 0 - BytesReadLocal: 80.91 KB (82848) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 80.91 KB (82848) - DecompressionTime: 9.209us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 217.83 KB (223056) - PerReadThreadRawHdfsThroughput: 73.14 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 7.20K (7200) - RowsReturned: 1.80K (1800) - RowsReturnedRate: 203.40 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 8.668ms - MaterializeTupleTime(*): 1.816ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 999.0us - ScannerThreadsVoluntaryContextSwitches: 11 (11) - TotalRawHdfsReadTime(*): 1.80ms - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 24449bb4dc430956:ca0f6ca2e0cb49b2 (host=c2114.hal.cloudera.com:22000):(Total: 13.358ms, non-child: 3.382ms, % non-child: 25.32%) Hdfs split stats (:<# splits>/): 7:1/117.39 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 235.79 KB (241448) - PerHostPeakMemUsage: 649.61 MB (681169352) - PrepareTime: 209.564us - RowsProduced: 76 (76) - TotalCpuTime: 32.365ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 3.67ms - TotalStorageWaitTime: 7.467ms DataStreamSender (dst_id=15):(Total: 707.805us, non-child: 707.805us, % non-child: 100.00%) - BytesSent: 10.86 KB (11118) - NetworkThroughput(*): 770.02 KB/sec - OverallThroughput: 14.98 MB/sec - PeakMemoryUsage: 31.97 KB (32736) - SerializeBatchTime: 55.382us - ThriftTransmitTime(*): 14.100ms - UncompressedRowBatchSize: 16.32 KB (16716) HDFS_SCAN_NODE (id=1):(Total: 9.268ms, non-child: 9.268ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/117.39 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 109.21 KB (111826) - BytesReadDataNodeCache: 0 - BytesReadLocal: 109.21 KB (111826) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 109.21 KB (111826) - DecompressionTime: 3.510us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 195.82 KB (200520) - PerReadThreadRawHdfsThroughput: 149.93 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.35K (1350) - RowsReturned: 76 (76) - RowsReturnedRate: 8.20 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 8.392ms - MaterializeTupleTime(*): 431.16us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 711.295us - TotalReadThroughput: 0.00 /sec