impalad /backends /catalog /hadoop-varz /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query b45ac2a82caefd3:f987ea31ef3ee99f Plan Query Text plan Summary Profile Memory Download Thrift Profile Query (id=b45ac2a82caefd3:f987ea31ef3ee99f): Summary: Session ID: 6e448215e0946479:2781209211110395 Session Type: BEESWAX Start Time: 2016-09-01 16:18:46.655479000 End Time: 2016-09-01 16:18:52.913652000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.7.0-cdh5-INTERNAL RELEASE (build 7f66659b75a1ad6525d2c630d53b972b81d24ece) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.234.19:53618 Default Db: tpcds_1000_parquet Sql Statement: with results as (select i_item_id, s_state, 0 as g_state, ss_quantity agg1, ss_list_price agg2, ss_coupon_amt agg3, ss_sales_price agg4 from store_sales, customer_demographics, date_dim, store, item where ss_sold_date_sk = d_date_sk and ss_item_sk = i_item_sk and ss_store_sk = s_store_sk and ss_cdemo_sk = cd_demo_sk and cd_gender = 'F' and cd_marital_status = 'W' and cd_education_status = 'Secondary' and d_year = 2002 and s_state in ('OK','MI', 'SC', 'OH', 'TN', 'NC') ) select i_item_id, s_state, g_state, agg1, agg2, agg3, agg4 from ( select i_item_id, s_state, 0 as g_state, avg(agg1) agg1, avg(agg2) agg2, avg(agg3) agg3, avg(agg4) agg4 from results group by i_item_id, s_state union all select i_item_id, NULL AS s_state, 1 AS g_state, avg(agg1) agg1, avg(agg2) agg2, avg(agg3) agg3, avg(agg4) agg4 from results group by i_item_id union all select NULL AS i_item_id, NULL as s_state, 1 as g_state, avg(agg1) agg1, avg(agg2) agg2, avg(agg3) agg3, avg(agg4) agg4 from results ) foo order by i_item_id, s_state limit 100 Coordinator: vd1309.halxg.cloudera.com:22000 Query Options (non default): DISABLE_CODEGEN=1,NUM_SCANNER_THREADS=40 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.06GB VCores=5 51:MERGING-EXCHANGE [UNPARTITIONED] | order by: i_item_id ASC, s_state ASC | limit: 100 | hosts=7 per-host-mem=unavailable | tuple-ids=26 row-size=71B cardinality=100 | 31:TOP-N [LIMIT=100] | order by: i_item_id ASC, s_state ASC | hosts=7 per-host-mem=6.93KB | tuple-ids=26 row-size=71B cardinality=100 | 00:UNION | hosts=7 per-host-mem=0B | tuple-ids=24 row-size=71B cardinality=3569762 | |--50:EXCHANGE [RANDOM] | | hosts=7 per-host-mem=0B | | tuple-ids=23 row-size=20B cardinality=1 | | | 49:AGGREGATE [FINALIZE] | | output: avg:merge(agg1), avg:merge(agg2), avg:merge(agg3), avg:merge(agg4) | | hosts=7 per-host-mem=unavailable | | tuple-ids=23 row-size=20B cardinality=1 | | | 48:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=22 row-size=20B cardinality=1 | | | 30:AGGREGATE | | output: avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=22 row-size=20B cardinality=1 | | | 29:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_item_sk = i_item_sk | | hosts=7 per-host-mem=2.52MB | | tuple-ids=16,17,18,19,20 row-size=138B cardinality=15480000 | | | |--47:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=20 row-size=8B cardinality=300000 | | | | | 25:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | | partitions=1/1 files=1 size=27.40MB | | table stats: 300000 rows total | | column stats: all | | hosts=1 per-host-mem=80.00MB | | tuple-ids=20 row-size=8B cardinality=300000 | | | 28:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_store_sk = s_store_sk | | runtime filters: RF009 <- s_store_sk | | hosts=7 per-host-mem=6.45KB | | tuple-ids=16,17,18,19 row-size=130B cardinality=15696668 | | | |--46:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=19 row-size=22B cardinality=273 | | | | | 24:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | | partitions=1/1 files=1 size=87.37KB | | predicates: s_state IN ('OK', 'MI', 'SC', 'OH', 'TN', 'NC') | | table stats: 1002 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=19 row-size=22B cardinality=273 | | | 27:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_sold_date_sk = d_date_sk | | runtime filters: RF010 <- d_date_sk | | hosts=7 per-host-mem=3.21KB | | tuple-ids=16,17,18 row-size=108B cardinality=29498278 | | | |--45:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=18 row-size=8B cardinality=373 | | | | | 23:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d_year = 2002 | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=18 row-size=8B cardinality=373 | | | 26:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_cdemo_sk = cd_demo_sk | | runtime filters: RF011 <- cd_demo_sk | | hosts=7 per-host-mem=6.50MB | | tuple-ids=16,17 row-size=100B cardinality=144248951 | | | |--44:EXCHANGE [BROADCAST] | | | hosts=7 per-host-mem=0B | | | tuple-ids=17 row-size=64B cardinality=97399 | | | | | 22:SCAN HDFS [tpcds_1000_parquet.customer_demographics, RANDOM] | | partitions=1/1 files=7 size=8.00MB | | predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'Secondary' | | table stats: 1920800 rows total | | column stats: all | | hosts=7 per-host-mem=64.00MB | | tuple-ids=17 row-size=64B cardinality=97399 | | | 21:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] | partitions=1824/1824 files=1842 size=125.21GB | runtime filters: RF011 -> ss_cdemo_sk, RF010 -> ss_sold_date_sk, RF009 -> ss_store_sk | table stats: 2879987999 rows total | column stats: all | hosts=7 per-host-mem=560.00MB | tuple-ids=16 row-size=36B cardinality=2879987999 | |--43:AGGREGATE [FINALIZE] | | output: avg:merge(agg1), avg:merge(agg2), avg:merge(agg3), avg:merge(agg4) | | group by: i_item_id | | hosts=7 per-host-mem=10.00MB | | tuple-ids=15 row-size=52B cardinality=155207 | | | 42:EXCHANGE [HASH(i_item_id)] | | hosts=7 per-host-mem=0B | | tuple-ids=14 row-size=52B cardinality=155207 | | | 20:AGGREGATE [STREAMING] | | output: avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price) | | group by: i_item_id | | hosts=7 per-host-mem=10.00MB | | tuple-ids=14 row-size=52B cardinality=155207 | | | 19:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_item_sk = i_item_sk | | hosts=7 per-host-mem=12.59MB | | tuple-ids=8,9,10,11,12 row-size=170B cardinality=15480000 | | | |--41:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=12 row-size=40B cardinality=300000 | | | | | 15:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | | partitions=1/1 files=1 size=27.40MB | | table stats: 300000 rows total | | column stats: all | | hosts=1 per-host-mem=80.00MB | | tuple-ids=12 row-size=40B cardinality=300000 | | | 18:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_store_sk = s_store_sk | | runtime filters: RF005 <- s_store_sk | | hosts=7 per-host-mem=6.45KB | | tuple-ids=8,9,10,11 row-size=130B cardinality=15696668 | | | |--40:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=11 row-size=22B cardinality=273 | | | | | 14:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | | partitions=1/1 files=1 size=87.37KB | | predicates: s_state IN ('OK', 'MI', 'SC', 'OH', 'TN', 'NC') | | table stats: 1002 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=11 row-size=22B cardinality=273 | | | 17:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_sold_date_sk = d_date_sk | | runtime filters: RF006 <- d_date_sk | | hosts=7 per-host-mem=3.21KB | | tuple-ids=8,9,10 row-size=108B cardinality=29498278 | | | |--39:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=10 row-size=8B cardinality=373 | | | | | 13:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d_year = 2002 | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=10 row-size=8B cardinality=373 | | | 16:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_cdemo_sk = cd_demo_sk | | runtime filters: RF007 <- cd_demo_sk | | hosts=7 per-host-mem=6.50MB | | tuple-ids=8,9 row-size=100B cardinality=144248951 | | | |--38:EXCHANGE [BROADCAST] | | | hosts=7 per-host-mem=0B | | | tuple-ids=9 row-size=64B cardinality=97399 | | | | | 12:SCAN HDFS [tpcds_1000_parquet.customer_demographics, RANDOM] | | partitions=1/1 files=7 size=8.00MB | | predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'Secondary' | | table stats: 1920800 rows total | | column stats: all | | hosts=7 per-host-mem=64.00MB | | tuple-ids=9 row-size=64B cardinality=97399 | | | 11:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] | partitions=1824/1824 files=1842 size=125.21GB | runtime filters: RF007 -> ss_cdemo_sk, RF006 -> ss_sold_date_sk, RF005 -> ss_store_sk | table stats: 2879987999 rows total | column stats: all | hosts=7 per-host-mem=560.00MB | tuple-ids=8 row-size=36B cardinality=2879987999 | 37:AGGREGATE [FINALIZE] | output: avg:merge(agg1), avg:merge(agg2), avg:merge(agg3), avg:merge(agg4) | group by: i_item_id, s_state | hosts=7 per-host-mem=250.70MB | tuple-ids=7 row-size=70B cardinality=3414554 | 36:EXCHANGE [HASH(i_item_id,s_state)] | hosts=7 per-host-mem=0B | tuple-ids=6 row-size=70B cardinality=3414554 | 10:AGGREGATE [STREAMING] | output: avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price) | group by: i_item_id, s_state | hosts=7 per-host-mem=250.70MB | tuple-ids=6 row-size=70B cardinality=3414554 | 09:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_item_sk = i_item_sk | runtime filters: RF000 <- i_item_sk | hosts=7 per-host-mem=12.59MB | tuple-ids=0,1,2,3,4 row-size=170B cardinality=15480000 | |--35:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=4 row-size=40B cardinality=300000 | | | 05:SCAN HDFS [tpcds_1000_parquet.item, RANDOM] | partitions=1/1 files=1 size=27.40MB | table stats: 300000 rows total | column stats: all | hosts=1 per-host-mem=80.00MB | tuple-ids=4 row-size=40B cardinality=300000 | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF001 <- s_store_sk | hosts=7 per-host-mem=6.45KB | tuple-ids=0,1,2,3 row-size=130B cardinality=15696668 | |--34:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=3 row-size=22B cardinality=273 | | | 04:SCAN HDFS [tpcds_1000_parquet.store, RANDOM] | partitions=1/1 files=1 size=87.37KB | predicates: s_state IN ('OK', 'MI', 'SC', 'OH', 'TN', 'NC') | table stats: 1002 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=3 row-size=22B cardinality=273 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF002 <- d_date_sk | hosts=7 per-host-mem=3.21KB | tuple-ids=0,1,2 row-size=108B cardinality=29498278 | |--33:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=2 row-size=8B cardinality=373 | | | 03:SCAN HDFS [tpcds_1000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.15MB | predicates: d_year = 2002 | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=2 row-size=8B cardinality=373 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_cdemo_sk = cd_demo_sk | runtime filters: RF003 <- cd_demo_sk | hosts=7 per-host-mem=6.50MB | tuple-ids=0,1 row-size=100B cardinality=144248951 | |--32:EXCHANGE [BROADCAST] | | hosts=7 per-host-mem=0B | | tuple-ids=1 row-size=64B cardinality=97399 | | | 02:SCAN HDFS [tpcds_1000_parquet.customer_demographics, RANDOM] | partitions=1/1 files=7 size=8.00MB | predicates: cd_marital_status = 'W', cd_gender = 'F', cd_education_status = 'Secondary' | table stats: 1920800 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=1 row-size=64B cardinality=97399 | 01:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM] partitions=1824/1824 files=1842 size=125.21GB runtime filters: RF003 -> ss_cdemo_sk, RF002 -> ss_sold_date_sk, RF001 -> ss_store_sk, RF000 -> ss_item_sk table stats: 2879987999 rows total column stats: all hosts=7 per-host-mem=560.00MB tuple-ids=0 row-size=36B cardinality=2879987999 ---------------- Estimated Per-Host Mem: 1132989661 Estimated Per-Host VCores: 5 Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 51:MERGING-EXCHANGE 1 651.815us 651.815us 700 100 0 -1.00 B UNPARTITIONED 31:TOP-N 7 37.076ms 166.894ms 700 100 204.00 KB 6.93 KB 00:UNION 7 15.873ms 23.233ms 787.97K 3.57M 68.00 KB 0 |--43:AGGREGATE 7 108.108ms 381.294ms 150.00K 155.21K 27.26 MB 10.00 MB FINALIZE | 42:EXCHANGE 7 5.940ms 18.466ms 857.85K 155.21K 0 0 HASH(i_item_id) | 20:AGGREGATE 7 2s803ms 4s861ms 857.85K 155.21K 189.27 MB 10.00 MB STREAMING | 19:HASH JOIN 7 163.579ms 197.946ms 1.79M 15.48M 161.33 MB 12.59 MB INNER JOIN, BROADCAST | |--41:EXCHANGE 7 11.740ms 13.279ms 300.00K 300.00K 0 0 BROADCAST | | 15:SCAN HDFS 1 20.460ms 20.460ms 300.00K 300.00K 15.84 MB 80.00 MB tpcds_1000_parquet.item | 18:HASH JOIN 7 56.761ms 81.614ms 1.79M 15.70M 17.32 MB 6.45 KB INNER JOIN, BROADCAST | |--40:EXCHANGE 7 17.754us 22.433us 258 273 0 0 BROADCAST | | 14:SCAN HDFS 1 3.531ms 3.531ms 258 273 152.00 KB 32.00 MB tpcds_1000_parquet.store | 17:HASH JOIN 7 54.458ms 80.073ms 1.79M 29.50M 17.32 MB 3.21 KB INNER JOIN, BROADCAST | |--39:EXCHANGE 7 22.394us 33.487us 365 373 0 0 BROADCAST | | 13:SCAN HDFS 1 14.353ms 14.353ms 365 373 2.07 MB 32.00 MB tpcds_1000_parquet.date_dim | 16:HASH JOIN 7 98.737ms 106.639ms 1.79M 144.25M 18.25 MB 6.50 MB INNER JOIN, BROADCAST | |--38:EXCHANGE 7 1.991ms 2.904ms 27.44K 97.40K 0 0 BROADCAST | | 12:SCAN HDFS 6 36.761ms 51.395ms 27.44K 97.40K 27.59 MB 64.00 MB tpcds_1000_parquet.customer... | 11:SCAN HDFS 7 200.297ms 404.143ms 1.79M 2.88B 2.02 GB 560.00 MB tpcds_1000_parquet.store_sales |--50:EXCHANGE 7 2.772us 6.053us 1 1 0 0 RANDOM | 49:AGGREGATE 1 1.193ms 1.193ms 1 1 44.00 KB -1.00 B FINALIZE | 48:EXCHANGE 1 107.551us 107.551us 7 1 0 -1.00 B UNPARTITIONED | 30:AGGREGATE 7 2s417ms 4s962ms 7 1 16.41 MB 10.00 MB | 29:HASH JOIN 7 146.316ms 167.077ms 1.79M 15.48M 33.41 MB 2.52 MB INNER JOIN, BROADCAST | |--47:EXCHANGE 7 10.762ms 11.505ms 300.00K 300.00K 0 0 BROADCAST | | 25:SCAN HDFS 1 14.445ms 14.445ms 300.00K 300.00K 7.60 MB 80.00 MB tpcds_1000_parquet.item | 28:HASH JOIN 7 55.273ms 64.411ms 1.79M 15.70M 17.41 MB 6.45 KB INNER JOIN, BROADCAST | |--46:EXCHANGE 7 17.164us 22.252us 258 273 0 0 BROADCAST | | 24:SCAN HDFS 1 8.109ms 8.109ms 258 273 136.00 KB 32.00 MB tpcds_1000_parquet.store | 27:HASH JOIN 7 54.718ms 67.009ms 1.79M 29.50M 17.41 MB 3.21 KB INNER JOIN, BROADCAST | |--45:EXCHANGE 7 17.980us 22.595us 365 373 0 0 BROADCAST | | 23:SCAN HDFS 1 20.469ms 20.469ms 365 373 2.07 MB 32.00 MB tpcds_1000_parquet.date_dim | 26:HASH JOIN 7 90.999ms 100.095ms 1.79M 144.25M 18.25 MB 6.50 MB INNER JOIN, BROADCAST | |--44:EXCHANGE 7 1.394ms 2.098ms 27.44K 97.40K 0 0 BROADCAST | | 22:SCAN HDFS 6 36.312ms 45.940ms 27.44K 97.40K 24.23 MB 64.00 MB tpcds_1000_parquet.customer... | 21:SCAN HDFS 7 145.391ms 425.626ms 1.79M 2.88B 2.12 GB 560.00 MB tpcds_1000_parquet.store_sales 37:AGGREGATE 7 401.678ms 771.298ms 637.97K 3.41M 182.40 MB 250.70 MB FINALIZE 36:EXCHANGE 7 45.177ms 137.433ms 1.46M 3.41M 0 0 HASH(i_item_id,s_state) 10:AGGREGATE 7 2s307ms 2s438ms 1.46M 3.41M 223.17 MB 250.70 MB STREAMING 09:HASH JOIN 7 103.636ms 127.174ms 1.79M 15.48M 161.16 MB 12.59 MB INNER JOIN, BROADCAST |--35:EXCHANGE 7 12.902ms 14.128ms 300.00K 300.00K 0 0 BROADCAST | 05:SCAN HDFS 1 20.138ms 20.138ms 300.00K 300.00K 15.77 MB 80.00 MB tpcds_1000_parquet.item 08:HASH JOIN 7 54.768ms 69.265ms 1.79M 15.70M 17.15 MB 6.45 KB INNER JOIN, BROADCAST |--34:EXCHANGE 7 21.553us 24.096us 258 273 0 0 BROADCAST | 04:SCAN HDFS 1 2.968ms 2.968ms 258 273 136.00 KB 32.00 MB tpcds_1000_parquet.store 07:HASH JOIN 7 48.483ms 60.880ms 1.79M 29.50M 17.15 MB 3.21 KB INNER JOIN, BROADCAST |--33:EXCHANGE 7 24.346us 33.858us 365 373 0 0 BROADCAST | 03:SCAN HDFS 1 13.858ms 13.858ms 365 373 2.07 MB 32.00 MB tpcds_1000_parquet.date_dim 06:HASH JOIN 7 103.535ms 114.700ms 1.79M 144.25M 18.25 MB 6.50 MB INNER JOIN, BROADCAST |--32:EXCHANGE 7 1.886ms 4.303ms 27.44K 97.40K 0 0 BROADCAST | 02:SCAN HDFS 6 34.780ms 41.215ms 27.44K 97.40K 27.94 MB 64.00 MB tpcds_1000_parquet.customer... 01:SCAN HDFS 7 480.066ms 1s201ms 1.79M 2.88B 1.95 GB 560.00 MB tpcds_1000_parquet.store_sales Planner Timeline: 138.405ms - Analysis finished: 33.831ms (33.831ms) - Equivalence classes computed: 35.204ms (1.372ms) - Single node plan created: 106.026ms (70.822ms) - Runtime filters computed: 107.104ms (1.078ms) - Distributed plan created: 128.642ms (21.537ms) - Lineage info computed: 130.114ms (1.471ms) - Planning finished: 138.405ms (8.291ms) Query Timeline: 6s280ms - Start execution: 56.734us (56.734us) - Planning finished: 167.133ms (167.076ms) - Submit for admission: 180.086ms (12.953ms) - Completed admission: 180.665ms (578.498us) - Ready to start 56 remote fragments: 186.310ms (5.645ms) - All 56 remote fragments started: 300.701ms (114.391ms) - Rows available: 6s197ms (5s896ms) - First row fetched: 6s218ms (21.706ms) - Unregister query: 6s258ms (39.404ms) - ComputeScanRangeAssignmentTimer: 6.379ms ImpalaServer: - ClientFetchWaitTimer: 47.790ms - RowMaterializationTimer: 595.554us Execution Profile b45ac2a82caefd3:f987ea31ef3ee99f:(Total: 6s014ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 10 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- 3 6 1 7 LOCAL false 0 (7) N/A N/A 2 7 1 7 LOCAL true 0 (7) N/A N/A 1 8 1 7 LOCAL false 0 (7) N/A N/A 0 9 1 7 LOCAL false 0 (7) N/A N/A 7 16 11 7 LOCAL false 0 (7) N/A N/A 6 17 11 7 LOCAL true 0 (7) N/A N/A 5 18 11 7 LOCAL false 0 (7) N/A N/A 11 26 21 7 LOCAL false 0 (7) N/A N/A 10 27 21 7 LOCAL true 0 (7) N/A N/A 9 28 21 7 LOCAL false 0 (7) N/A N/A Fragment start latencies: Count: 56, 25th %-ile: 2ms, 50th %-ile: 3ms, 75th %-ile: 24ms, 90th %-ile: 29ms, 95th %-ile: 32ms, 99.9th %-ile: 36ms Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- 3 6 1 7 LOCAL false 0 (7) N/A N/A 2 7 1 7 LOCAL true 0 (7) N/A N/A 1 8 1 7 LOCAL false 0 (7) N/A N/A 0 9 1 7 LOCAL false 0 (7) N/A N/A 7 16 11 7 LOCAL false 0 (7) N/A N/A 6 17 11 7 LOCAL true 0 (7) N/A N/A 5 18 11 7 LOCAL false 0 (7) N/A N/A 11 26 21 7 LOCAL false 0 (7) N/A N/A 10 27 21 7 LOCAL true 0 (7) N/A N/A 9 28 21 7 LOCAL false 0 (7) N/A N/A Per Node Peak Memory Usage: vd1310.halxg.cloudera.com:22000(6.34 GB) vd1316.halxg.cloudera.com:22000(5.19 GB) vd1314.halxg.cloudera.com:22000(5.61 GB) vd1311.halxg.cloudera.com:22000(6.04 GB) vd1312.halxg.cloudera.com:22000(6.03 GB) vd1313.halxg.cloudera.com:22000(6.06 GB) vd1309.halxg.cloudera.com:22000(5.41 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F19:(Total: 5s886ms, non-child: 1.725ms, % non-child: 0.03%) MemoryUsage(500.000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 63.82 KB (65352) - PerHostPeakMemUsage: 0 - PrepareTime: 110.180us - RowsProduced: 0 (0) - TotalCpuTime: 6s034ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 482 (482) - BlocksRecycled: 240 (240) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 563.57 MB (590945536) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns EXCHANGE_NODE (id=51):(Total: 5s884ms, non-child: 651.815us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 27.58 KB (28237) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 289.233us - FirstBatchArrivalWaitTime: 5s884ms - MergeGetNext: 571.840us - MergeGetNextBatch: 12.491us - PeakMemoryUsage: 0 - RowsReturned: 700 (700) - RowsReturnedRate: 118.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F18:(Total: 6s000ms, non-child: 2.761ms, % non-child: 0.05%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s995ms max:6s008ms mean: 6s003ms stddev:3.869ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 7 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 218.97 MB (229610916) - PerHostPeakMemUsage: 5.81 GB (6239595580) - PrepareTime: 2.199ms - RowsProduced: 100 (100) - TotalCpuTime: 578.249ms - TotalNetworkReceiveTime: 5s423ms - TotalNetworkSendTime: 332.832us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 489 (489) - BlocksRecycled: 232 (232) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 586.33 MB (614807509) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 118.676us, non-child: 118.676us, % non-child: 100.00%) - BytesSent: 3.94 KB (4033) - NetworkThroughput(*): 85.32 MB/sec - OverallThroughput: 32.93 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 47.389us - TransmitDataRPCTime: 47.870us - UncompressedRowBatchSize: 7.58 KB (7766) SORT_NODE (id=31):(Total: 5s997ms, non-child: 37.076ms, % non-child: 0.62%) - InsertBatchTime: 16.476ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s960ms, non-child: 15.873ms, % non-child: 0.27%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 112.57K (112566) - RowsReturnedRate: 18.89 K/sec AGGREGATION_NODE (id=43):(Total: 1s381ms, non-child: 108.108ms, % non-child: 7.83%) - BuildTime: 86.456ms - GetNewBlockTime: 3.153ms - GetResultsTime: 17.594ms - HTResizeTime: 4.216ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28575254) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.43K (21428) - RowsReturnedRate: 15.64 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.174us EXCHANGE_NODE (id=42):(Total: 1s273ms, non-child: 1s273ms, % non-child: 100.00%) - BytesReceived: 8.93 MB (9364672) - ConvertRowBatchTime: 2.326ms - DeserializeRowBatchTimer: 165.209ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 122.55K (122550) - RowsReturnedRate: 101.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 2.772us, non-child: 2.772us, % non-child: 100.00%) - BytesReceived: 4.00 B (4) - ConvertRowBatchTime: 370.000ns - DeserializeRowBatchTimer: 3.447us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 23.60 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s563ms, non-child: 401.678ms, % non-child: 8.80%) - BuildTime: 303.399ms - GetNewBlockTime: 10.740ms - GetResultsTime: 81.742ms - HTResizeTime: 36.119ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.39 MB (191246557) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 91.14K (91138) - RowsReturnedRate: 19.97 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.601us EXCHANGE_NODE (id=36):(Total: 4s161ms, non-child: 4s161ms, % non-child: 100.00%) - BytesReceived: 17.03 MB (17853182) - ConvertRowBatchTime: 6.467ms - DeserializeRowBatchTimer: 201.833ms - FirstBatchArrivalWaitTime: 2s487ms - PeakMemoryUsage: 0 - RowsReturned: 209.16K (209163) - RowsReturnedRate: 50.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F17:(Total: 5s871ms, non-child: 8.476ms, % non-child: 0.14%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:5s876ms max:5s876ms mean: 5s876ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 89.31 KB (91456) - PerHostPeakMemUsage: 5.41 GB (5806841432) - PrepareTime: 275.745us - RowsProduced: 1 (1) - TotalCpuTime: 13.041ms - TotalNetworkReceiveTime: 5s862ms - TotalNetworkSendTime: 304.441us - TotalStorageWaitTime: 0.000ns DataStreamSender (dst_id=50):(Total: 141.172us, non-child: 141.172us, % non-child: 100.00%) - BytesSent: 32.00 B (32) - NetworkThroughput(*): 1.23 MB/sec - OverallThroughput: 221.36 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 23.167us - TransmitDataRPCTime: 24.884us - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=49):(Total: 5s863ms, non-child: 1.193ms, % non-child: 0.02%) - BuildTime: 19.171us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 44.00 KB (45056) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=48):(Total: 5s862ms, non-child: 5s862ms, % non-child: 100.00%) - BytesReceived: 754.00 B (754) - ConvertRowBatchTime: 11.992us - DeserializeRowBatchTimer: 161.907us - FirstBatchArrivalWaitTime: 1s490ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 1.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F12:(Total: 2s953ms, non-child: 8.090ms, % non-child: 0.27%) split sizes: min: 17.75 GB, max: 17.98 GB, avg: 17.89 GB, stddev: 65.96 MB completion times: min:1s454ms max:5s835ms mean: 2s966ms stddev:1s474ms execution rates: min:3.07 GB/sec max:12.30 GB/sec mean:7.49 GB/sec stddev:3.14 GB/sec num instances: 7 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 1.86 GB (1995768950) - PerHostPeakMemUsage: 5.81 GB (6239595580) - PrepareTime: 2.176ms - RowsProduced: 1 (1) - TotalCpuTime: 1m50s - TotalNetworkReceiveTime: 111.109ms - TotalNetworkSendTime: 248.605us - TotalStorageWaitTime: 2s933ms DataStreamSender (dst_id=48):(Total: 59.761us, non-child: 59.761us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - NetworkThroughput(*): 4.77 MB/sec - OverallThroughput: 1.98 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 16.712us - TransmitDataRPCTime: 30.839us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 2s945ms, non-child: 2s417ms, % non-child: 82.08%) - BuildTime: 2s410ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 15.57 MB (16329332) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 527.725ms, non-child: 146.316ms, % non-child: 27.73%) - BuildPartitionTime: 39.485ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 18.748ms - GetNewBlockTime: 650.987us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 32.58 MB (34160372) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 90.126ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 507.67 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 3.568us EXCHANGE_NODE (id=47):(Total: 102.243ms, non-child: 102.243ms, % non-child: 100.00%) - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 8.441ms - DeserializeRowBatchTimer: 11.406ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.97 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 356.767ms, non-child: 55.273ms, % non-child: 15.49%) - BuildPartitionTime: 93.560us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 28.081us - GetNewBlockTime: 431.433us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.57 MB (17378804) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.812ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 774.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.450us EXCHANGE_NODE (id=46):(Total: 3.931ms, non-child: 3.931ms, % non-child: 100.00%) - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.423us - DeserializeRowBatchTimer: 34.882us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 11.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 301.497ms, non-child: 54.718ms, % non-child: 18.15%) - BuildPartitionTime: 112.436us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 32.823us - GetNewBlockTime: 637.368us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.57 MB (17379060) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.776ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 937.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.442us EXCHANGE_NODE (id=45):(Total: 4.173ms, non-child: 4.173ms, % non-child: 100.00%) - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.906us - DeserializeRowBatchTimer: 28.565us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 12.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 246.781ms, non-child: 90.999ms, % non-child: 36.87%) - BuildPartitionTime: 10.292ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.787ms - GetNewBlockTime: 1.008ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19129913) - PinTime: 0.000ns - ProbeRows: 256.00K (255996) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 64.829ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 1.18 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.514us EXCHANGE_NODE (id=44):(Total: 10.431ms, non-child: 10.431ms, % non-child: 100.00%) - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 654.171us - DeserializeRowBatchTimer: 6.009ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 10.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 145.391ms, non-child: 145.391ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.39 - AverageScannerThreadConcurrency: 38.93 - BytesRead: 894.13 MB (937567382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 894.13 MB (937567382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 894.13 MB (937567382) - DecompressionTime: 7s699ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.82 GB (1953546331) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 78.59M (78585725) - RowsReturned: 256.00K (255996) - RowsReturnedRate: 2.33 M/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 7.81K (7809) - ScannerThreadsTotalWallClockTime: 1m49s - MaterializeTupleTime(*): 29s864ms - ScannerThreadsSysTime: 34s235ms - ScannerThreadsUserTime: 23s012ms - ScannerThreadsVoluntaryContextSwitches: 367.01K (367015) - TotalRawHdfsReadTime(*): 707.515ms - TotalReadThroughput: 384.58 MB/sec Filter 11 (1.00 MB): - Rows processed: 78.59M (78585725) - Rows rejected: 77.49M (77487998) - Rows total: 78.59M (78585725) Filter 10 (1.00 MB): - Files processed: 263 (263) - Files rejected: 211 (211) - Files total: 263 (263) - RowGroups processed: 590 (590) - RowGroups rejected: 0 (0) - RowGroups total: 590 (590) - Rows processed: 725.47K (725470) - Rows rejected: 0 (0) - Rows total: 725.49K (725492) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 9 (1.00 MB): - Rows processed: 1.10M (1097727) - Rows rejected: 841.73K (841730) - Rows total: 1.10M (1097727) Averaged Fragment F16:(Total: 203.081ms, non-child: 117.147ms, % non-child: 57.68%) split sizes: min: 27.40 MB, max: 27.40 MB, avg: 27.40 MB, stddev: 0 completion times: min:208.468ms max:208.468ms mean: 208.468ms stddev:0.000ns execution rates: min:131.46 MB/sec max:131.46 MB/sec mean:131.46 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.70 MB (8072024) - PerHostPeakMemUsage: 1020.84 MB (1070425056) - PrepareTime: 259.765us - RowsProduced: 300.00K (300000) - TotalCpuTime: 211.127ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 136.253ms - TotalStorageWaitTime: 6.884ms DataStreamSender (dst_id=47):(Total: 71.488ms, non-child: 71.488ms, % non-child: 100.00%) - BytesSent: 16.11 MB (16893863) - NetworkThroughput(*): 381.48 MB/sec - OverallThroughput: 225.37 MB/sec - RowsReturned: 300.00K (300000) - SerializeBatchTime: 29.053ms - TransmitDataRPCTime: 42.232ms - UncompressedRowBatchSize: 40.06 MB (42008204) HDFS_SCAN_NODE (id=25):(Total: 14.445ms, non-child: 14.445ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.32 MB (1384495) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.32 MB (1384495) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.32 MB (1384495) - DecompressionTime: 7.677ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.60 MB (7967352) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 300.00K (300000) - RowsReturnedRate: 20.77 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 146.622ms - MaterializeTupleTime(*): 10.918ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 236 (236) - TotalRawHdfsReadTime(*): 1.024ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F15:(Total: 69.387ms, non-child: 60.940ms, % non-child: 87.83%) split sizes: min: 87.37 KB, max: 87.37 KB, avg: 87.37 KB, stddev: 0 completion times: min:110.265ms max:110.265ms mean: 110.265ms stddev:0.000ns execution rates: min:792.36 KB/sec max:792.36 KB/sec mean:792.36 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 189.30 KB (193840) - PerHostPeakMemUsage: 46.33 MB (48582632) - PrepareTime: 203.328us - RowsProduced: 258 (258) - TotalCpuTime: 19.072ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 55.112ms - TotalStorageWaitTime: 4.688ms DataStreamSender (dst_id=46):(Total: 338.013us, non-child: 338.013us, % non-child: 100.00%) - BytesSent: 39.29 KB (40236) - NetworkThroughput(*): 192.47 MB/sec - OverallThroughput: 113.52 MB/sec - RowsReturned: 258 (258) - SerializeBatchTime: 89.181us - TransmitDataRPCTime: 199.363us - UncompressedRowBatchSize: 52.94 KB (54208) HDFS_SCAN_NODE (id=24):(Total: 8.109ms, non-child: 8.109ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 93.34 KB (95579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.34 KB (95579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.34 KB (95579) - DecompressionTime: 4.858us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 136.00 KB (139264) - PerReadThreadRawHdfsThroughput: 1.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 258 (258) - RowsReturnedRate: 31.81 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 5.688ms - MaterializeTupleTime(*): 99.401us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 52.097us - TotalReadThroughput: 0.00 /sec Averaged Fragment F14:(Total: 69.376ms, non-child: 48.625ms, % non-child: 70.09%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:118.036ms max:118.036ms mean: 118.036ms stddev:0.000ns execution rates: min:18.21 MB/sec max:18.21 MB/sec mean:18.21 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.15 MB (2252432) - PerHostPeakMemUsage: 47.37 MB (49668248) - PrepareTime: 144.660us - RowsProduced: 365 (365) - TotalCpuTime: 46.606ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39.242ms - TotalStorageWaitTime: 7.484ms DataStreamSender (dst_id=45):(Total: 282.382us, non-child: 282.382us, % non-child: 100.00%) - BytesSent: 20.10 KB (20587) - NetworkThroughput(*): 136.23 MB/sec - OverallThroughput: 69.53 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 96.846us - TransmitDataRPCTime: 144.118us - UncompressedRowBatchSize: 39.95 KB (40908) HDFS_SCAN_NODE (id=23):(Total: 20.469ms, non-child: 20.469ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 170.858us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.07 MB (2167800) - PerReadThreadRawHdfsThroughput: 596.94 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 17.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 20.065ms - MaterializeTupleTime(*): 8.318ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 761.084us - TotalReadThroughput: 0.00 /sec Averaged Fragment F13:(Total: 77.533ms, non-child: 37.833ms, % non-child: 48.80%) split sizes: min: 1.14 MB, max: 2.28 MB, avg: 1.33 MB, stddev: 433.63 KB completion times: min:111.804ms max:129.866ms mean: 118.601ms stddev:6.297ms execution rates: min:8.78 MB/sec max:18.44 MB/sec mean:11.20 MB/sec stddev:3.27 MB/sec num instances: 6 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 16.58 MB (17383220) - PerHostPeakMemUsage: 58.02 MB (60841920) - PrepareTime: 332.644us - RowsProduced: 4.57K (4573) - TotalCpuTime: 113.669ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28.798ms - TotalStorageWaitTime: 10.339ms DataStreamSender (dst_id=44):(Total: 3.388ms, non-child: 3.388ms, % non-child: 100.00%) - BytesSent: 847.66 KB (868000) - NetworkThroughput(*): 785.86 MB/sec - OverallThroughput: 248.49 MB/sec - RowsReturned: 4.57K (4573) - SerializeBatchTime: 2.234ms - TransmitDataRPCTime: 1.114ms - UncompressedRowBatchSize: 2.17 MB (2273077) HDFS_SCAN_NODE (id=22):(Total: 36.312ms, non-child: 36.312ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.44 MB (1509041) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 MB (1509041) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 MB (1509041) - DecompressionTime: 1.153ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 12.42 MB (13028106) - PerReadThreadRawHdfsThroughput: 1.94 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 320.13K (320133) - RowsReturned: 4.57K (4573) - RowsReturnedRate: 127.48 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 23 (23) - ScannerThreadsTotalWallClockTime: 72.982ms - MaterializeTupleTime(*): 59.192ms - ScannerThreadsSysTime: 11.497ms - ScannerThreadsUserTime: 48.825ms - ScannerThreadsVoluntaryContextSwitches: 52 (52) - TotalRawHdfsReadTime(*): 745.645us - TotalReadThroughput: 0.00 /sec Averaged Fragment F06:(Total: 3s590ms, non-child: 82.194ms, % non-child: 2.29%) split sizes: min: 17.75 GB, max: 17.98 GB, avg: 17.89 GB, stddev: 65.96 MB completion times: min:2s557ms max:5s932ms mean: 3s602ms stddev:1s102ms execution rates: min:3.02 GB/sec max:7.00 GB/sec mean:5.35 GB/sec stddev:1.28 GB/sec num instances: 7 - AverageThreadTokens: 34.24 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.16 GB (2313933982) - PerHostPeakMemUsage: 5.81 GB (6239595580) - PrepareTime: 4.285ms - RowsProduced: 122.55K (122550) - TotalCpuTime: 1m57s - TotalNetworkReceiveTime: 193.183ms - TotalNetworkSendTime: 48.815ms - TotalStorageWaitTime: 3s765ms DataStreamSender (dst_id=42):(Total: 80.577ms, non-child: 80.577ms, % non-child: 100.00%) - BytesSent: 8.93 MB (9364672) - NetworkThroughput(*): 524.51 MB/sec - OverallThroughput: 112.58 MB/sec - RowsReturned: 122.55K (122550) - SerializeBatchTime: 63.196ms - TransmitDataRPCTime: 17.256ms - UncompressedRowBatchSize: 31.32 MB (32846050) AGGREGATION_NODE (id=20):(Total: 3s427ms, non-child: 2s803ms, % non-child: 81.80%) - GetNewBlockTime: 9.236ms - GetResultsTime: 72.082ms - HTResizeTime: 36.362ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 188.20 MB (197341027) - PinTime: 0.000ns - ReductionFactorEstimate: 60.87 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 122.55K (122550) - RowsReturnedRate: 38.80 K/sec - StreamingTime: 2s707ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 623.702ms, non-child: 163.579ms, % non-child: 26.23%) - BuildPartitionTime: 65.193ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 20.653ms - GetNewBlockTime: 3.444ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.84 MB (168657602) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 95.182ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 423.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.778us EXCHANGE_NODE (id=41):(Total: 143.420ms, non-child: 143.420ms, % non-child: 100.00%) - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 7.896ms - DeserializeRowBatchTimer: 26.738ms - FirstBatchArrivalWaitTime: 2.044ms - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.16 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 442.630ms, non-child: 56.761ms, % non-child: 12.82%) - BuildPartitionTime: 104.621us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 39.999us - GetNewBlockTime: 338.309us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.84 MB (17658306) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.745ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 605.86 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.353us EXCHANGE_NODE (id=40):(Total: 14.750ms, non-child: 14.750ms, % non-child: 100.00%) - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.982us - DeserializeRowBatchTimer: 27.153us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 9.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 385.872ms, non-child: 54.458ms, % non-child: 14.11%) - BuildPartitionTime: 133.027us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 47.863us - GetNewBlockTime: 823.710us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.84 MB (17658562) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.789ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 697.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.803us EXCHANGE_NODE (id=39):(Total: 11.755ms, non-child: 11.755ms, % non-child: 100.00%) - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 12.711us - DeserializeRowBatchTimer: 21.666us - FirstBatchArrivalWaitTime: 830.604us - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 331.418ms, non-child: 98.737ms, % non-child: 29.79%) - BuildPartitionTime: 12.164ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.525ms - GetNewBlockTime: 1.632ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19129913) - PinTime: 0.000ns - ProbeRows: 256.00K (255996) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 64.418ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 816.20 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.608us EXCHANGE_NODE (id=38):(Total: 32.414ms, non-child: 32.414ms, % non-child: 100.00%) - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 696.887us - DeserializeRowBatchTimer: 6.094ms - FirstBatchArrivalWaitTime: 1.086ms - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 5.29 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 200.297ms, non-child: 200.297ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 35.78 - BytesRead: 894.13 MB (937567382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 894.13 MB (937567382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 894.13 MB (937567382) - DecompressionTime: 7s090ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.94 GB (2087993365) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 78.59M (78585725) - RowsReturned: 256.00K (255996) - RowsReturnedRate: 1.42 M/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 7.49K (7486) - ScannerThreadsTotalWallClockTime: 1m57s - MaterializeTupleTime(*): 28s370ms - ScannerThreadsSysTime: 33s874ms - ScannerThreadsUserTime: 22s831ms - ScannerThreadsVoluntaryContextSwitches: 420.08K (420079) - TotalRawHdfsReadTime(*): 767.763ms - TotalReadThroughput: 287.15 MB/sec Filter 7 (1.00 MB): - Rows processed: 78.59M (78585725) - Rows rejected: 77.49M (77487998) - Rows total: 78.59M (78585725) Filter 6 (1.00 MB): - Files processed: 263 (263) - Files rejected: 211 (211) - Files total: 263 (263) - RowGroups processed: 590 (590) - RowGroups rejected: 0 (0) - RowGroups total: 590 (590) - Rows processed: 725.47K (725470) - Rows rejected: 0 (0) - Rows total: 725.49K (725492) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 5 (1.00 MB): - Rows processed: 1.10M (1097727) - Rows rejected: 841.73K (841730) - Rows total: 1.10M (1097727) Averaged Fragment F10:(Total: 240.154ms, non-child: 110.943ms, % non-child: 46.20%) split sizes: min: 27.40 MB, max: 27.40 MB, avg: 27.40 MB, stddev: 0 completion times: min:246.330ms max:246.330ms mean: 246.330ms stddev:0.000ns execution rates: min:111.25 MB/sec max:111.25 MB/sec mean:111.25 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 15.87 MB (16643160) - PerHostPeakMemUsage: 1.92 GB (2058399872) - PrepareTime: 108.789us - RowsProduced: 300.00K (300000) - TotalCpuTime: 273.649ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 116.207ms - TotalStorageWaitTime: 3.975ms DataStreamSender (dst_id=41):(Total: 108.750ms, non-child: 108.750ms, % non-child: 100.00%) - BytesSent: 31.46 MB (32993177) - NetworkThroughput(*): 732.69 MB/sec - OverallThroughput: 289.33 MB/sec - RowsReturned: 300.00K (300000) - SerializeBatchTime: 65.697ms - TransmitDataRPCTime: 42.943ms - UncompressedRowBatchSize: 104.15 MB (109208204) HDFS_SCAN_NODE (id=15):(Total: 20.460ms, non-child: 20.460ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.30 MB (2408738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.30 MB (2408738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.30 MB (2408738) - DecompressionTime: 21.715ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.84 MB (16606296) - PerReadThreadRawHdfsThroughput: 1018.92 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 300.00K (300000) - RowsReturnedRate: 14.66 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 26 (26) - ScannerThreadsTotalWallClockTime: 150.700ms - MaterializeTupleTime(*): 24.839ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 370 (370) - TotalRawHdfsReadTime(*): 2.254ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F09:(Total: 63.954ms, non-child: 60.117ms, % non-child: 94.00%) split sizes: min: 87.37 KB, max: 87.37 KB, avg: 87.37 KB, stddev: 0 completion times: min:103.988ms max:103.988ms mean: 103.988ms stddev:0.000ns execution rates: min:840.19 KB/sec max:840.19 KB/sec mean:840.19 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 197.30 KB (202032) - PerHostPeakMemUsage: 209.23 MB (219392528) - PrepareTime: 243.915us - RowsProduced: 258 (258) - TotalCpuTime: 10.798ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.259ms - TotalStorageWaitTime: 1.985ms DataStreamSender (dst_id=40):(Total: 305.529us, non-child: 305.529us, % non-child: 100.00%) - BytesSent: 39.29 KB (40236) - NetworkThroughput(*): 220.06 MB/sec - OverallThroughput: 125.59 MB/sec - RowsReturned: 258 (258) - SerializeBatchTime: 86.619us - TransmitDataRPCTime: 174.370us - UncompressedRowBatchSize: 52.94 KB (54208) HDFS_SCAN_NODE (id=14):(Total: 3.531ms, non-child: 3.531ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 93.34 KB (95579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.34 KB (95579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.34 KB (95579) - DecompressionTime: 4.561us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 152.00 KB (155648) - PerReadThreadRawHdfsThroughput: 1.62 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 258 (258) - RowsReturnedRate: 73.05 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.997ms - MaterializeTupleTime(*): 87.985us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 54.998us - TotalReadThroughput: 0.00 /sec Averaged Fragment F08:(Total: 64.555ms, non-child: 49.960ms, % non-child: 77.39%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:86.363ms max:86.363ms mean: 86.363ms stddev:0.000ns execution rates: min:24.89 MB/sec max:24.89 MB/sec mean:24.89 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.15 MB (2252432) - PerHostPeakMemUsage: 216.83 MB (227360168) - PrepareTime: 119.792us - RowsProduced: 365 (365) - TotalCpuTime: 32.860ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45.994ms - TotalStorageWaitTime: 3.306ms DataStreamSender (dst_id=39):(Total: 240.557us, non-child: 240.557us, % non-child: 100.00%) - BytesSent: 20.10 KB (20587) - NetworkThroughput(*): 203.30 MB/sec - OverallThroughput: 81.62 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 60.045us - TransmitDataRPCTime: 96.572us - UncompressedRowBatchSize: 39.95 KB (40908) HDFS_SCAN_NODE (id=13):(Total: 14.353ms, non-child: 14.353ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 179.484us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.07 MB (2167800) - PerReadThreadRawHdfsThroughput: 852.33 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 25.43 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 14.123ms - MaterializeTupleTime(*): 8.921ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 533.029us - TotalReadThroughput: 0.00 /sec Averaged Fragment F07:(Total: 71.730ms, non-child: 31.791ms, % non-child: 44.32%) split sizes: min: 1.14 MB, max: 2.28 MB, avg: 1.33 MB, stddev: 433.63 KB completion times: min:83.274ms max:103.026ms mean: 93.306ms stddev:6.844ms execution rates: min:11.07 MB/sec max:26.22 MB/sec mean:14.51 MB/sec stddev:5.30 MB/sec num instances: 6 - AverageThreadTokens: 0.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 16.16 MB (16948246) - PerHostPeakMemUsage: 305.34 MB (320168653) - PrepareTime: 259.398us - RowsProduced: 4.57K (4573) - TotalCpuTime: 116.150ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22.364ms - TotalStorageWaitTime: 5.872ms DataStreamSender (dst_id=38):(Total: 3.177ms, non-child: 3.177ms, % non-child: 100.00%) - BytesSent: 849.28 KB (869666) - NetworkThroughput(*): 902.97 MB/sec - OverallThroughput: 264.77 MB/sec - RowsReturned: 4.57K (4573) - SerializeBatchTime: 2.185ms - TransmitDataRPCTime: 923.823us - UncompressedRowBatchSize: 2.17 MB (2273077) HDFS_SCAN_NODE (id=12):(Total: 36.761ms, non-child: 36.761ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.44 MB (1509041) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 MB (1509041) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 MB (1509041) - DecompressionTime: 1.356ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 12.04 MB (12623170) - PerReadThreadRawHdfsThroughput: 2.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 320.13K (320133) - RowsReturned: 4.57K (4573) - RowsReturnedRate: 136.39 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 22 (22) - ScannerThreadsTotalWallClockTime: 69.293ms - MaterializeTupleTime(*): 59.173ms - ScannerThreadsSysTime: 10.831ms - ScannerThreadsUserTime: 49.158ms - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalRawHdfsReadTime(*): 698.089us - TotalReadThroughput: 420.14 KB/sec Averaged Fragment F00:(Total: 3s439ms, non-child: 168.741ms, % non-child: 4.91%) split sizes: min: 17.75 GB, max: 17.98 GB, avg: 17.89 GB, stddev: 65.96 MB completion times: min:2s799ms max:4s388ms mean: 3s455ms stddev:441.790ms execution rates: min:4.08 GB/sec max:6.39 GB/sec mean:5.26 GB/sec stddev:648.24 MB/sec num instances: 7 - AverageThreadTokens: 28.89 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.14 GB (2298206460) - PerHostPeakMemUsage: 5.81 GB (6239595580) - PrepareTime: 3.699ms - RowsProduced: 209.16K (209163) - TotalCpuTime: 1m39s - TotalNetworkReceiveTime: 79.422ms - TotalNetworkSendTime: 92.074ms - TotalStorageWaitTime: 5s164ms DataStreamSender (dst_id=36):(Total: 164.009ms, non-child: 164.009ms, % non-child: 100.00%) - BytesSent: 17.03 MB (17853182) - NetworkThroughput(*): 545.23 MB/sec - OverallThroughput: 105.06 MB/sec - RowsReturned: 209.16K (209163) - SerializeBatchTime: 131.846ms - TransmitDataRPCTime: 31.923ms - UncompressedRowBatchSize: 57.05 MB (59826001) AGGREGATION_NODE (id=10):(Total: 3s107ms, non-child: 2s307ms, % non-child: 74.27%) - GetNewBlockTime: 5.154ms - GetResultsTime: 162.645ms - HTResizeTime: 45.506ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 212.41 MB (222724810) - PinTime: 0.000ns - ReductionFactorEstimate: 14.50 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 209.16K (209163) - RowsReturnedRate: 68.28 K/sec - StreamingTime: 2s102ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 799.427ms, non-child: 103.636ms, % non-child: 12.96%) - BuildPartitionTime: 107.759ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 24.240ms - GetNewBlockTime: 2.082ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.80 MB (168608363) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.331ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 351.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.877us EXCHANGE_NODE (id=35):(Total: 71.914ms, non-child: 71.914ms, % non-child: 100.00%) - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 8.361ms - DeserializeRowBatchTimer: 25.742ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 4.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 696.119ms, non-child: 54.768ms, % non-child: 7.87%) - BuildPartitionTime: 119.488us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 47.020us - GetNewBlockTime: 1.355ms - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.79 MB (17609067) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.314ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 411.76 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.933us EXCHANGE_NODE (id=34):(Total: 2.651ms, non-child: 2.651ms, % non-child: 100.00%) - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 10.544us - DeserializeRowBatchTimer: 27.123us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 8.75 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 641.355ms, non-child: 48.483ms, % non-child: 7.56%) - BuildPartitionTime: 122.383us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 43.731us - GetNewBlockTime: 1.059ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.73 MB (17541780) - PinTime: 0.000ns - ProbeRows: 255.89K (255889) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.827ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 452.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.943us EXCHANGE_NODE (id=33):(Total: 5.330ms, non-child: 5.330ms, % non-child: 100.00%) - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 12.986us - DeserializeRowBatchTimer: 22.009us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 7.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 592.875ms, non-child: 103.535ms, % non-child: 17.46%) - BuildPartitionTime: 14.467ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.381ms - GetNewBlockTime: 1.248ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19129913) - PinTime: 0.000ns - ProbeRows: 256.00K (255996) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 65.302ms - RowsReturned: 255.89K (255889) - RowsReturnedRate: 495.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.698us EXCHANGE_NODE (id=32):(Total: 9.354ms, non-child: 9.354ms, % non-child: 100.00%) - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 876.479us - DeserializeRowBatchTimer: 6.218ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 11.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 480.066ms, non-child: 480.066ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 33.22 - BytesRead: 894.13 MB (937567382) - BytesReadDataNodeCache: 0 - BytesReadLocal: 894.13 MB (937567382) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 894.13 MB (937567382) - DecompressionTime: 5s199ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.87 GB (2011848768) - PerReadThreadRawHdfsThroughput: 917.38 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 78.59M (78585725) - RowsReturned: 256.00K (255996) - RowsReturnedRate: 643.27 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 6.94K (6939) - ScannerThreadsTotalWallClockTime: 1m38s - MaterializeTupleTime(*): 23s914ms - ScannerThreadsSysTime: 33s853ms - ScannerThreadsUserTime: 21s333ms - ScannerThreadsVoluntaryContextSwitches: 344.39K (344389) - TotalRawHdfsReadTime(*): 985.066ms - TotalReadThroughput: 307.86 MB/sec Filter 3 (1.00 MB): - Rows processed: 78.59M (78585725) - Rows rejected: 77.49M (77487998) - Rows total: 78.59M (78585725) Filter 2 (1.00 MB): - Files processed: 263 (263) - Files rejected: 211 (211) - Files total: 263 (263) - RowGroups processed: 590 (590) - RowGroups rejected: 0 (0) - RowGroups total: 590 (590) - Rows processed: 725.47K (725470) - Rows rejected: 0 (0) - Rows total: 725.49K (725492) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 1 (1.00 MB): - Rows processed: 1.10M (1097727) - Rows rejected: 841.73K (841730) - Rows total: 1.10M (1097727) Filter 0 (1.00 MB): - Rows processed: 256.00K (255996) - Rows rejected: 0 (0) - Rows total: 256.00K (255996) Averaged Fragment F04:(Total: 234.263ms, non-child: 107.370ms, % non-child: 45.83%) split sizes: min: 27.40 MB, max: 27.40 MB, avg: 27.40 MB, stddev: 0 completion times: min:246.732ms max:246.732ms mean: 246.732ms stddev:0.000ns execution rates: min:111.07 MB/sec max:111.07 MB/sec mean:111.07 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 15.87 MB (16643160) - PerHostPeakMemUsage: 1.94 GB (2084602912) - PrepareTime: 60.184us - RowsProduced: 300.00K (300000) - TotalCpuTime: 283.649ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 105.711ms - TotalStorageWaitTime: 3.643ms DataStreamSender (dst_id=35):(Total: 106.754ms, non-child: 106.754ms, % non-child: 100.00%) - BytesSent: 31.46 MB (32992393) - NetworkThroughput(*): 720.95 MB/sec - OverallThroughput: 294.73 MB/sec - RowsReturned: 300.00K (300000) - SerializeBatchTime: 62.997ms - TransmitDataRPCTime: 43.642ms - UncompressedRowBatchSize: 104.15 MB (109208204) HDFS_SCAN_NODE (id=5):(Total: 20.138ms, non-child: 20.138ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.30 MB (2408738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.30 MB (2408738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.30 MB (2408738) - DecompressionTime: 20.026ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.77 MB (16540760) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 300.00K (300000) - RowsReturnedRate: 14.90 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 26 (26) - ScannerThreadsTotalWallClockTime: 148.952ms - MaterializeTupleTime(*): 25.804ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 345 (345) - TotalRawHdfsReadTime(*): 2.076ms - TotalReadThroughput: 0.00 /sec Averaged Fragment F03:(Total: 64.936ms, non-child: 60.600ms, % non-child: 93.32%) split sizes: min: 87.37 KB, max: 87.37 KB, avg: 87.37 KB, stddev: 0 completion times: min:78.502ms max:78.502ms mean: 78.502ms stddev:0.000ns execution rates: min:1.09 MB/sec max:1.09 MB/sec mean:1.09 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 189.30 KB (193840) - PerHostPeakMemUsage: 345.11 MB (361875968) - PrepareTime: 190.682us - RowsProduced: 258 (258) - TotalCpuTime: 12.875ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.652ms - TotalStorageWaitTime: 1.754ms DataStreamSender (dst_id=34):(Total: 1.368ms, non-child: 1.368ms, % non-child: 100.00%) - BytesSent: 36.83 KB (37709) - NetworkThroughput(*): 184.84 MB/sec - OverallThroughput: 26.29 MB/sec - RowsReturned: 258 (258) - SerializeBatchTime: 1.110ms - TransmitDataRPCTime: 194.555us - UncompressedRowBatchSize: 52.94 KB (54208) HDFS_SCAN_NODE (id=4):(Total: 2.968ms, non-child: 2.968ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 93.34 KB (95579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.34 KB (95579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.34 KB (95579) - DecompressionTime: 1.519us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 136.00 KB (139264) - PerReadThreadRawHdfsThroughput: 2.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 258 (258) - RowsReturnedRate: 86.92 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3.472ms - MaterializeTupleTime(*): 58.982us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 38.325us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 62.020ms, non-child: 47.852ms, % non-child: 77.16%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:77.306ms max:77.306ms mean: 77.306ms stddev:0.000ns execution rates: min:27.81 MB/sec max:27.81 MB/sec mean:27.81 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.15 MB (2252432) - PerHostPeakMemUsage: 358.38 MB (375785512) - PrepareTime: 147.891us - RowsProduced: 365 (365) - TotalCpuTime: 35.463ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.307ms - TotalStorageWaitTime: 1.891ms DataStreamSender (dst_id=33):(Total: 308.754us, non-child: 308.754us, % non-child: 100.00%) - BytesSent: 27.56 KB (28217) - NetworkThroughput(*): 207.84 MB/sec - OverallThroughput: 87.16 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 92.830us - TransmitDataRPCTime: 129.475us - UncompressedRowBatchSize: 39.95 KB (40908) HDFS_SCAN_NODE (id=3):(Total: 13.858ms, non-child: 13.858ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 217.617us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.07 MB (2167800) - PerReadThreadRawHdfsThroughput: 800.88 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 26.34 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 13.597ms - MaterializeTupleTime(*): 9.041ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 16 (16) - TotalRawHdfsReadTime(*): 567.277us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 71.472ms, non-child: 33.527ms, % non-child: 46.91%) split sizes: min: 1.14 MB, max: 2.28 MB, avg: 1.33 MB, stddev: 433.63 KB completion times: min:81.016ms max:89.379ms mean: 84.106ms stddev:3.078ms execution rates: min:13.09 MB/sec max:25.51 MB/sec mean:15.74 MB/sec stddev:4.38 MB/sec num instances: 6 - AverageThreadTokens: 0.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 16.96 MB (17781268) - PerHostPeakMemUsage: 432.65 MB (453666452) - PrepareTime: 199.952us - RowsProduced: 4.57K (4573) - TotalCpuTime: 112.925ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 21.556ms - TotalStorageWaitTime: 5.990ms DataStreamSender (dst_id=32):(Total: 3.164ms, non-child: 3.164ms, % non-child: 100.00%) - BytesSent: 848.51 KB (868872) - NetworkThroughput(*): 844.01 MB/sec - OverallThroughput: 260.16 MB/sec - RowsReturned: 4.57K (4573) - SerializeBatchTime: 2.091ms - TransmitDataRPCTime: 968.479us - UncompressedRowBatchSize: 2.17 MB (2273077) HDFS_SCAN_NODE (id=2):(Total: 34.780ms, non-child: 34.780ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.17 - BytesRead: 1.44 MB (1509041) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.44 MB (1509041) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.44 MB (1509041) - DecompressionTime: 1.799ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 12.80 MB (13416597) - PerReadThreadRawHdfsThroughput: 1.98 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 320.13K (320133) - RowsReturned: 4.57K (4573) - RowsReturnedRate: 137.74 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 66.582ms - MaterializeTupleTime(*): 55.849ms - ScannerThreadsSysTime: 11.164ms - ScannerThreadsUserTime: 46.658ms - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalRawHdfsReadTime(*): 751.593us - TotalReadThroughput: 420.14 KB/sec Fragment F18: Instance b45ac2a82caefd3:f987ea31ef3ee9a7 (host=vd1310.halxg.cloudera.com:22000):(Total: 6s006ms, non-child: 2.927ms, % non-child: 0.05%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 30.44 MB, 68.99 MB, 214.62 MB, 214.83 MB, 175.91 MB, 43.80 MB, 27.23 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 218.91 MB (229539680) - PerHostPeakMemUsage: 6.34 GB (6806403240) - PrepareTime: 2.199ms - RowsProduced: 100 (100) - TotalCpuTime: 1s359ms - TotalNetworkReceiveTime: 4s647ms - TotalNetworkSendTime: 269.289us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 514 (514) - BlocksRecycled: 208 (208) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 699.44 MB (733420800) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 99.233us, non-child: 99.233us, % non-child: 100.00%) - BytesSent: 3.90 KB (3994) - NetworkThroughput(*): 108.78 MB/sec - OverallThroughput: 38.38 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 40.483us - TransmitDataRPCTime: 35.017us - UncompressedRowBatchSize: 7.59 KB (7774) SORT_NODE (id=31):(Total: 6s003ms, non-child: 166.894ms, % non-child: 2.78%) ExecOption: Codegen Disabled - InsertBatchTime: 27.978ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s836ms, non-child: 23.233ms, % non-child: 0.40%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 112.43K (112429) - RowsReturnedRate: 19.26 K/sec AGGREGATION_NODE (id=43):(Total: 1s096ms, non-child: 381.294ms, % non-child: 34.79%) ExecOption: Codegen Disabled - BuildTime: 355.492ms - GetNewBlockTime: 19.751ms - GetResultsTime: 21.052ms - HTResizeTime: 24.832ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28570464) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.17K (21166) - RowsReturnedRate: 19.31 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.594us EXCHANGE_NODE (id=42):(Total: 714.804ms, non-child: 18.466ms, % non-child: 2.58%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.21 MB, 4.70 MB, 6.29 MB, 6.29 MB, 7.55 MB, 7.55 MB, 7.55 MB - BytesReceived: 8.82 MB (9244626) - ConvertRowBatchTime: 4.886ms - DeserializeRowBatchTimer: 395.051ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 120.94K (120937) - RowsReturnedRate: 169.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 1.991us, non-child: 1.991us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 221.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s716ms, non-child: 771.298ms, % non-child: 16.35%) ExecOption: Codegen Disabled - BuildTime: 524.392ms - GetNewBlockTime: 38.664ms - GetResultsTime: 180.792ms - HTResizeTime: 80.726ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.40 MB (191263560) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 91.26K (91263) - RowsReturnedRate: 19.35 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.310us EXCHANGE_NODE (id=36):(Total: 3s945ms, non-child: 137.433ms, % non-child: 3.48%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 732.41 KB, 4.92 MB, 14.52 MB, 15.97 MB - BytesReceived: 17.01 MB (17839849) - ConvertRowBatchTime: 5.439ms - DeserializeRowBatchTimer: 437.336ms - FirstBatchArrivalWaitTime: 2s487ms - PeakMemoryUsage: 0 - RowsReturned: 209.04K (209037) - RowsReturnedRate: 52.98 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b45ac2a82caefd3:f987ea31ef3ee9a2 (host=vd1313.halxg.cloudera.com:22000):(Total: 6s004ms, non-child: 2.276ms, % non-child: 0.04%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 41.11 MB, 123.82 MB, 214.96 MB, 215.17 MB, 27.23 MB, 27.23 MB, 27.38 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 218.74 MB (229362720) - PerHostPeakMemUsage: 6.06 GB (6510672952) - PrepareTime: 1.949ms - RowsProduced: 100 (100) - TotalCpuTime: 471.177ms - TotalNetworkReceiveTime: 5s534ms - TotalNetworkSendTime: 384.596us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 482 (482) - BlocksRecycled: 240 (240) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 563.57 MB (590945536) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 102.983us, non-child: 102.983us, % non-child: 100.00%) - BytesSent: 3.98 KB (4075) - NetworkThroughput(*): 96.64 MB/sec - OverallThroughput: 37.74 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 40.926us - TransmitDataRPCTime: 40.212us - UncompressedRowBatchSize: 7.58 KB (7764) SORT_NODE (id=31):(Total: 6s002ms, non-child: 15.511ms, % non-child: 0.26%) ExecOption: Codegen Disabled - InsertBatchTime: 14.967ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s986ms, non-child: 16.525ms, % non-child: 0.28%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 111.93K (111933) - RowsReturnedRate: 18.70 K/sec AGGREGATION_NODE (id=43):(Total: 1s432ms, non-child: 65.233ms, % non-child: 4.55%) ExecOption: Codegen Disabled - BuildTime: 40.185ms - GetNewBlockTime: 305.945us - GetResultsTime: 20.711ms - HTResizeTime: 838.940us - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.26 MB (28583136) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.35K (21348) - RowsReturnedRate: 14.90 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.768us EXCHANGE_NODE (id=42):(Total: 1s367ms, non-child: 3.492ms, % non-child: 0.26%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.93 MB, 6.27 MB, 6.35 MB, 6.35 MB, 7.62 MB, 7.62 MB, 7.66 MB - BytesReceived: 8.89 MB (9324855) - ConvertRowBatchTime: 1.744ms - DeserializeRowBatchTimer: 139.343ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 122.03K (122035) - RowsReturnedRate: 89.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 1.897us, non-child: 1.897us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 297.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s537ms, non-child: 360.139ms, % non-child: 7.94%) ExecOption: Codegen Disabled - BuildTime: 286.027ms - GetNewBlockTime: 13.161ms - GetResultsTime: 65.311ms - HTResizeTime: 29.397ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.35 MB (191206872) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 90.58K (90585) - RowsReturnedRate: 19.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.136us EXCHANGE_NODE (id=36):(Total: 4s177ms, non-child: 28.856ms, % non-child: 0.69%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.83 MB, 8.58 MB, 14.52 MB, 16.50 MB - BytesReceived: 16.91 MB (17729933) - ConvertRowBatchTime: 6.339ms - DeserializeRowBatchTimer: 171.146ms - FirstBatchArrivalWaitTime: 2s489ms - PeakMemoryUsage: 0 - RowsReturned: 207.74K (207737) - RowsReturnedRate: 49.72 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b45ac2a82caefd3:f987ea31ef3ee9a6 (host=vd1316.halxg.cloudera.com:22000):(Total: 6s002ms, non-child: 2.112ms, % non-child: 0.04%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 47.01 MB, 152.36 MB, 215.61 MB, 216.75 MB, 27.21 MB, 27.21 MB, 27.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 219.28 MB (229930352) - PerHostPeakMemUsage: 5.19 GB (5575694536) - PrepareTime: 1.944ms - RowsProduced: 100 (100) - TotalCpuTime: 398.727ms - TotalNetworkReceiveTime: 5s604ms - TotalNetworkSendTime: 346.550us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 472 (472) - BlocksRecycled: 250 (250) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 554.55 MB (581484032) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 137.127us, non-child: 137.127us, % non-child: 100.00%) - BytesSent: 3.86 KB (3952) - NetworkThroughput(*): 49.33 MB/sec - OverallThroughput: 27.48 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 40.819us - TransmitDataRPCTime: 76.407us - UncompressedRowBatchSize: 7.58 KB (7762) SORT_NODE (id=31):(Total: 6s000ms, non-child: 13.575ms, % non-child: 0.23%) ExecOption: Codegen Disabled - InsertBatchTime: 13.128ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s986ms, non-child: 13.892ms, % non-child: 0.23%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 113.27K (113267) - RowsReturnedRate: 18.92 K/sec AGGREGATION_NODE (id=43):(Total: 1s440ms, non-child: 63.344ms, % non-child: 4.40%) ExecOption: Codegen Disabled - BuildTime: 41.897ms - GetNewBlockTime: 240.111us - GetResultsTime: 17.352ms - HTResizeTime: 825.804us - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28574560) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.75K (21753) - RowsReturnedRate: 15.10 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.498us EXCHANGE_NODE (id=42):(Total: 1s377ms, non-child: 3.920ms, % non-child: 0.28%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 2.63 MB, 6.48 MB, 6.48 MB, 6.85 MB, 7.77 MB, 7.77 MB, 8.23 MB - BytesReceived: 9.07 MB (9508090) - ConvertRowBatchTime: 1.985ms - DeserializeRowBatchTimer: 79.305ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 124.37K (124374) - RowsReturnedRate: 90.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 2.003us, non-child: 2.003us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 220.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s532ms, non-child: 291.804ms, % non-child: 6.44%) ExecOption: Codegen Disabled - BuildTime: 226.942ms - GetNewBlockTime: 436.425us - GetResultsTime: 57.008ms - HTResizeTime: 12.600ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.40 MB (191263560) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 91.51K (91514) - RowsReturnedRate: 20.19 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.210us EXCHANGE_NODE (id=36):(Total: 4s240ms, non-child: 25.170ms, % non-child: 0.59%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 2.49 MB, 10.38 MB, 15.08 MB, 16.86 MB - BytesReceived: 17.12 MB (17950928) - ConvertRowBatchTime: 7.911ms - DeserializeRowBatchTimer: 138.912ms - FirstBatchArrivalWaitTime: 2s489ms - PeakMemoryUsage: 0 - RowsReturned: 210.32K (210320) - RowsReturnedRate: 49.59 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b45ac2a82caefd3:f987ea31ef3ee9a5 (host=vd1314.halxg.cloudera.com:22000):(Total: 6s000ms, non-child: 2.451ms, % non-child: 0.04%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 32.54 MB, 81.68 MB, 214.98 MB, 215.05 MB, 27.26 MB, 27.26 MB, 27.26 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 218.88 MB (229516424) - PerHostPeakMemUsage: 5.61 GB (6020138352) - PrepareTime: 1.769ms - RowsProduced: 100 (100) - TotalCpuTime: 443.302ms - TotalNetworkReceiveTime: 5s558ms - TotalNetworkSendTime: 271.617us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 482 (482) - BlocksRecycled: 240 (240) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 563.69 MB (591076608) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 115.476us, non-child: 115.476us, % non-child: 100.00%) - BytesSent: 3.94 KB (4032) - NetworkThroughput(*): 93.73 MB/sec - OverallThroughput: 33.30 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 39.901us - TransmitDataRPCTime: 41.024us - UncompressedRowBatchSize: 7.59 KB (7768) SORT_NODE (id=31):(Total: 5s997ms, non-child: 15.619ms, % non-child: 0.26%) ExecOption: Codegen Disabled - InsertBatchTime: 14.166ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s982ms, non-child: 14.199ms, % non-child: 0.24%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 112.26K (112264) - RowsReturnedRate: 18.77 K/sec AGGREGATION_NODE (id=43):(Total: 1s431ms, non-child: 62.705ms, % non-child: 4.38%) ExecOption: Codegen Disabled - BuildTime: 42.275ms - GetNewBlockTime: 238.778us - GetResultsTime: 16.716ms - HTResizeTime: 822.029us - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28576800) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.35K (21352) - RowsReturnedRate: 14.91 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 598.000ns EXCHANGE_NODE (id=42):(Total: 1s369ms, non-child: 4.084ms, % non-child: 0.30%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.23 MB, 5.28 MB, 6.36 MB, 6.36 MB, 7.63 MB, 7.63 MB, 7.63 MB - BytesReceived: 8.90 MB (9330159) - ConvertRowBatchTime: 2.007ms - DeserializeRowBatchTimer: 163.746ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 122.14K (122137) - RowsReturnedRate: 89.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 2.455us, non-child: 2.455us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 339.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s536ms, non-child: 334.527ms, % non-child: 7.37%) ExecOption: Codegen Disabled - BuildTime: 264.421ms - GetNewBlockTime: 4.123ms - GetResultsTime: 61.847ms - HTResizeTime: 26.105ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.40 MB (191263560) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 90.91K (90912) - RowsReturnedRate: 20.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.531us EXCHANGE_NODE (id=36):(Total: 4s201ms, non-child: 40.347ms, % non-child: 0.96%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.01 MB, 6.00 MB, 14.60 MB, 16.12 MB - BytesReceived: 17.01 MB (17839718) - ConvertRowBatchTime: 7.294ms - DeserializeRowBatchTimer: 200.929ms - FirstBatchArrivalWaitTime: 2s487ms - PeakMemoryUsage: 0 - RowsReturned: 208.99K (208990) - RowsReturnedRate: 49.74 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b45ac2a82caefd3:f987ea31ef3ee9a3 (host=vd1312.halxg.cloudera.com:22000):(Total: 5s998ms, non-child: 2.118ms, % non-child: 0.04%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 37.96 MB, 112.40 MB, 215.13 MB, 215.10 MB, 27.32 MB, 27.32 MB, 27.32 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 218.99 MB (229623456) - PerHostPeakMemUsage: 6.03 GB (6472625824) - PrepareTime: 1.436ms - RowsProduced: 100 (100) - TotalCpuTime: 491.075ms - TotalNetworkReceiveTime: 5s508ms - TotalNetworkSendTime: 374.446us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 498 (498) - BlocksRecycled: 224 (224) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 568.54 MB (596155648) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 141.348us, non-child: 141.348us, % non-child: 100.00%) - BytesSent: 3.98 KB (4079) - NetworkThroughput(*): 88.12 MB/sec - OverallThroughput: 27.52 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 85.835us - TransmitDataRPCTime: 44.144us - UncompressedRowBatchSize: 7.59 KB (7776) SORT_NODE (id=31):(Total: 5s996ms, non-child: 17.476ms, % non-child: 0.29%) ExecOption: Codegen Disabled - InsertBatchTime: 16.765ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s979ms, non-child: 15.228ms, % non-child: 0.25%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 112.44K (112439) - RowsReturnedRate: 18.80 K/sec AGGREGATION_NODE (id=43):(Total: 1s413ms, non-child: 61.462ms, % non-child: 4.35%) ExecOption: Codegen Disabled - BuildTime: 42.102ms - GetNewBlockTime: 201.396us - GetResultsTime: 16.150ms - HTResizeTime: 703.270us - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28570464) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.43K (21432) - RowsReturnedRate: 15.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 542.000ns EXCHANGE_NODE (id=42):(Total: 1s351ms, non-child: 3.772ms, % non-child: 0.28%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.59 MB, 6.04 MB, 6.38 MB, 6.38 MB, 7.65 MB, 7.65 MB, 7.65 MB - BytesReceived: 8.93 MB (9359822) - ConvertRowBatchTime: 1.826ms - DeserializeRowBatchTimer: 141.998ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 122.50K (122501) - RowsReturnedRate: 90.63 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 2.120us, non-child: 2.120us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 196.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s550ms, non-child: 385.425ms, % non-child: 8.47%) ExecOption: Codegen Disabled - BuildTime: 301.609ms - GetNewBlockTime: 4.568ms - GetResultsTime: 76.188ms - HTResizeTime: 64.694ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.39 MB (191245512) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 91.01K (91007) - RowsReturnedRate: 20.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 947.000ns EXCHANGE_NODE (id=36):(Total: 4s165ms, non-child: 32.913ms, % non-child: 0.79%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.54 MB, 7.69 MB, 14.58 MB, 16.46 MB - BytesReceived: 17.02 MB (17843764) - ConvertRowBatchTime: 4.749ms - DeserializeRowBatchTimer: 173.660ms - FirstBatchArrivalWaitTime: 2s489ms - PeakMemoryUsage: 0 - RowsReturned: 209.06K (209057) - RowsReturnedRate: 50.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b45ac2a82caefd3:f987ea31ef3ee9a4 (host=vd1311.halxg.cloudera.com:22000):(Total: 5s998ms, non-child: 2.092ms, % non-child: 0.03%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 38.53 MB, 113.64 MB, 215.21 MB, 215.30 MB, 27.47 MB, 27.47 MB, 27.47 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 219.10 MB (229741776) - PerHostPeakMemUsage: 6.04 GB (6484792728) - PrepareTime: 1.306ms - RowsProduced: 100 (100) - TotalCpuTime: 455.301ms - TotalNetworkReceiveTime: 5s544ms - TotalNetworkSendTime: 389.456us - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 491 (491) - BlocksRecycled: 231 (231) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 568.16 MB (595762432) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=51):(Total: 111.535us, non-child: 111.535us, % non-child: 100.00%) - BytesSent: 4.00 KB (4095) - NetworkThroughput(*): 69.10 MB/sec - OverallThroughput: 35.01 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 44.252us - TransmitDataRPCTime: 56.513us - UncompressedRowBatchSize: 7.57 KB (7756) SORT_NODE (id=31):(Total: 5s996ms, non-child: 15.048ms, % non-child: 0.25%) ExecOption: Codegen Disabled - InsertBatchTime: 14.274ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s981ms, non-child: 14.009ms, % non-child: 0.23%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 112.85K (112854) - RowsReturnedRate: 18.87 K/sec AGGREGATION_NODE (id=43):(Total: 1s429ms, non-child: 61.870ms, % non-child: 4.33%) ExecOption: Codegen Disabled - BuildTime: 42.375ms - GetNewBlockTime: 182.766us - GetResultsTime: 16.108ms - HTResizeTime: 706.428us - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28576800) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.51K (21512) - RowsReturnedRate: 15.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 558.000ns EXCHANGE_NODE (id=42):(Total: 1s368ms, non-child: 4.161ms, % non-child: 0.30%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.69 MB, 6.12 MB, 6.41 MB, 6.41 MB, 7.68 MB, 7.68 MB, 7.68 MB - BytesReceived: 8.97 MB (9403549) - ConvertRowBatchTime: 2.017ms - DeserializeRowBatchTimer: 123.869ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 123.09K (123093) - RowsReturnedRate: 89.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 6.053us, non-child: 6.053us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 32.00 B (32) - ConvertRowBatchTime: 803.000ns - DeserializeRowBatchTimer: 24.133us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 165.21 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s537ms, non-child: 349.482ms, % non-child: 7.70%) ExecOption: Codegen Disabled - BuildTime: 279.619ms - GetNewBlockTime: 10.164ms - GetResultsTime: 61.974ms - HTResizeTime: 23.248ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.40 MB (191263560) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 91.34K (91341) - RowsReturnedRate: 20.13 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 928.000ns EXCHANGE_NODE (id=36):(Total: 4s187ms, non-child: 29.642ms, % non-child: 0.71%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 1.65 MB, 7.97 MB, 14.62 MB, 16.56 MB - BytesReceived: 17.06 MB (17892321) - ConvertRowBatchTime: 6.840ms - DeserializeRowBatchTimer: 149.506ms - FirstBatchArrivalWaitTime: 2s490ms - PeakMemoryUsage: 0 - RowsReturned: 209.57K (209574) - RowsReturnedRate: 50.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance b45ac2a82caefd3:f987ea31ef3ee9a1 (host=vd1309.halxg.cloudera.com:22000):(Total: 5s992ms, non-child: 5.348ms, % non-child: 0.09%) MemoryUsage(500.000ms): 20.58 MB, 20.58 MB, 20.58 MB, 20.58 MB, 21.26 MB, 50.32 MB, 170.57 MB, 215.18 MB, 217.54 MB, 27.40 MB, 27.40 MB, 27.28 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 218.93 MB (229562008) - PerHostPeakMemUsage: 5.41 GB (5806841432) - PrepareTime: 4.788ms - RowsProduced: 100 (100) - TotalCpuTime: 428.503ms - TotalNetworkReceiveTime: 5s566ms - TotalNetworkSendTime: 293.871us - TotalStorageWaitTime: 0.000ns DataStreamSender (dst_id=51):(Total: 123.034us, non-child: 123.034us, % non-child: 100.00%) - BytesSent: 3.92 KB (4010) - NetworkThroughput(*): 91.54 MB/sec - OverallThroughput: 31.08 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 39.508us - TransmitDataRPCTime: 41.776us - UncompressedRowBatchSize: 7.58 KB (7766) SORT_NODE (id=31):(Total: 5s986ms, non-child: 15.408ms, % non-child: 0.26%) ExecOption: Codegen Disabled - InsertBatchTime: 14.053ms - PeakMemoryUsage: 204.00 KB (208896) - RowsReturned: 100 (100) - RowsReturnedRate: 16.00 /sec UNION_NODE (id=0):(Total: 5s971ms, non-child: 14.023ms, % non-child: 0.23%) - PeakMemoryUsage: 68.00 KB (69632) - RowsReturned: 112.78K (112782) - RowsReturnedRate: 18.89 K/sec AGGREGATION_NODE (id=43):(Total: 1s425ms, non-child: 60.850ms, % non-child: 4.27%) ExecOption: Codegen Disabled - BuildTime: 40.869ms - GetNewBlockTime: 1.153ms - GetResultsTime: 15.071ms - HTResizeTime: 787.856us - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 1 (1) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 27.25 MB (28574560) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 21.43K (21435) - RowsReturnedRate: 15.04 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.663us EXCHANGE_NODE (id=42):(Total: 1s364ms, non-child: 3.684ms, % non-child: 0.27%) BytesReceived(500.000ms): 0, 0, 0, 0, 193.97 KB, 2.97 MB, 6.39 MB, 6.39 MB, 7.04 MB, 7.67 MB, 7.67 MB, 8.46 MB - BytesReceived: 8.95 MB (9381603) - ConvertRowBatchTime: 1.813ms - DeserializeRowBatchTimer: 113.148ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 122.77K (122773) - RowsReturnedRate: 89.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=50):(Total: 2.889us, non-child: 2.889us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 520.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=37):(Total: 4s531ms, non-child: 319.070ms, % non-child: 7.04%) ExecOption: Codegen Disabled - BuildTime: 240.779ms - GetNewBlockTime: 4.061ms - GetResultsTime: 69.071ms - HTResizeTime: 16.063ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 182.36 MB (191219280) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 91.35K (91347) - RowsReturnedRate: 20.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.150us EXCHANGE_NODE (id=36):(Total: 4s212ms, non-child: 21.881ms, % non-child: 0.52%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 2.89 MB, 11.54 MB, 15.21 MB, 16.90 MB - BytesReceived: 17.05 MB (17875767) - ConvertRowBatchTime: 6.698ms - DeserializeRowBatchTimer: 141.344ms - FirstBatchArrivalWaitTime: 2s478ms - PeakMemoryUsage: 0 - RowsReturned: 209.43K (209427) - RowsReturnedRate: 49.71 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F17: Instance b45ac2a82caefd3:f987ea31ef3ee9a8 (host=vd1309.halxg.cloudera.com:22000):(Total: 5s871ms, non-child: 8.476ms, % non-child: 0.14%) MemoryUsage(500.000ms): 53.30 KB, 53.30 KB, 53.30 KB, 69.30 KB, 77.30 KB, 77.30 KB, 77.30 KB, 81.30 KB, 85.30 KB, 85.30 KB, 85.30 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 89.31 KB (91456) - PerHostPeakMemUsage: 5.41 GB (5806841432) - PrepareTime: 275.745us - RowsProduced: 1 (1) - TotalCpuTime: 13.041ms - TotalNetworkReceiveTime: 5s862ms - TotalNetworkSendTime: 304.441us - TotalStorageWaitTime: 0.000ns DataStreamSender (dst_id=50):(Total: 141.172us, non-child: 141.172us, % non-child: 100.00%) - BytesSent: 32.00 B (32) - NetworkThroughput(*): 1.23 MB/sec - OverallThroughput: 221.36 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 23.167us - TransmitDataRPCTime: 24.884us - UncompressedRowBatchSize: 32.00 B (32) AGGREGATION_NODE (id=49):(Total: 5s863ms, non-child: 1.193ms, % non-child: 0.02%) ExecOption: Codegen Disabled - BuildTime: 19.171us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 44.00 KB (45056) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=48):(Total: 5s862ms, non-child: 107.551us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 214.00 B, 428.00 B, 428.00 B, 428.00 B, 536.00 B, 643.00 B, 643.00 B, 643.00 B - BytesReceived: 754.00 B (754) - ConvertRowBatchTime: 11.992us - DeserializeRowBatchTimer: 161.907us - FirstBatchArrivalWaitTime: 1s490ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 1.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F12: Instance b45ac2a82caefd3:f987ea31ef3ee9a9 (host=vd1310.halxg.cloudera.com:22000):(Total: 5s823ms, non-child: 7.187ms, % non-child: 0.12%) Hdfs split stats (:<# splits>/): 2:26/1.74 GB 3:28/2.20 GB 1:36/2.51 GB 4:33/2.24 GB 7:34/2.20 GB 6:37/2.57 GB 0:37/2.58 GB 5:28/1.87 GB Filter 10 arrival: 13ms Filter 9 arrival: 19ms Filter 11 arrival: 37ms MemoryUsage(500.000ms): 65.32 MB, 1.94 GB, 2.07 GB, 1.81 GB, 1.68 GB, 1.59 GB, 1.71 GB, 1.73 GB, 1.34 GB, 951.27 MB, 661.35 MB, 125.14 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.09 GB (2242547912) - PerHostPeakMemUsage: 6.34 GB (6806403240) - PrepareTime: 2.309ms - RowsProduced: 1 (1) - TotalCpuTime: 3m47s - TotalNetworkReceiveTime: 138.229ms - TotalNetworkSendTime: 271.425us - TotalStorageWaitTime: 2s974ms DataStreamSender (dst_id=48):(Total: 33.871us, non-child: 33.871us, % non-child: 100.00%) - BytesSent: 111.00 B (111) - NetworkThroughput(*): 7.37 MB/sec - OverallThroughput: 3.13 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.164us - TransmitDataRPCTime: 14.358us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 5s816ms, non-child: 4s962ms, % non-child: 85.33%) ExecOption: Codegen Disabled - BuildTime: 4s960ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.23 MB (17022112) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 853.365ms, non-child: 160.990ms, % non-child: 18.87%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 40.191ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 16.326ms - GetNewBlockTime: 593.147us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 33.24 MB (34853152) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 98.543ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 299.44 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.852us EXCHANGE_NODE (id=47):(Total: 108.692ms, non-child: 10.526ms, % non-child: 9.68%) BytesReceived(500.000ms): 546.62 KB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 8.601ms - DeserializeRowBatchTimer: 8.950ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 666.228ms, non-child: 56.516ms, % non-child: 8.48%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 113.568us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 36.677us - GetNewBlockTime: 242.826us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.23 MB (18071584) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 47.341ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 383.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.512us EXCHANGE_NODE (id=46):(Total: 14.092ms, non-child: 21.475us, % non-child: 0.15%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 8.102us - DeserializeRowBatchTimer: 34.968us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 18.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 609.714ms, non-child: 67.009ms, % non-child: 10.99%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 98.915us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 16.062us - GetNewBlockTime: 297.014us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.23 MB (18071840) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.136ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 419.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 677.000ns EXCHANGE_NODE (id=45):(Total: 6.705ms, non-child: 11.488us, % non-child: 0.17%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 4.828us - DeserializeRowBatchTimer: 30.500us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 54.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 542.707ms, non-child: 98.442ms, % non-child: 18.14%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 10.511ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.315ms - GetNewBlockTime: 715.511us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139208) - PinTime: 0.000ns - ProbeRows: 255.72K (255716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 63.567ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 470.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.734us EXCHANGE_NODE (id=44):(Total: 18.644ms, non-child: 1.509ms, % non-child: 8.10%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 768.425us - DeserializeRowBatchTimer: 5.323ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 1.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 425.626ms, non-child: 425.626ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 54 Hdfs split stats (:<# splits>/): 2:26/1.74 GB 3:28/2.20 GB 1:36/2.51 GB 4:33/2.24 GB 7:34/2.20 GB 6:37/2.57 GB 0:37/2.58 GB 5:28/1.87 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:91.67% 1:0% 2:0% 3:0% 4:8.333% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:205 PARQUET/SNAPPY:378 BytesRead(500.000ms): 14.44 MB, 670.59 MB, 670.59 MB, 670.59 MB, 746.81 MB, 839.81 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 38.92 - BytesRead: 906.08 MB (950095129) - BytesReadDataNodeCache: 0 - BytesReadLocal: 906.08 MB (950095129) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 906.08 MB (950095129) - DecompressionTime: 16s196ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 54 (54) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 2.05 GB (2200422768) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 79.60M (79595827) - RowsReturned: 255.72K (255716) - RowsReturnedRate: 600.80 K/sec - ScanRangesComplete: 259 (259) - ScannerThreadsInvoluntaryContextSwitches: 12.96K (12965) - ScannerThreadsTotalWallClockTime: 3m44s - MaterializeTupleTime(*): 50s472ms - ScannerThreadsSysTime: 1m1s - ScannerThreadsUserTime: 28s349ms - ScannerThreadsVoluntaryContextSwitches: 705.64K (705638) - TotalRawHdfsReadTime(*): 674.083ms - TotalReadThroughput: 151.01 MB/sec Filter 11 (1.00 MB): - Rows processed: 79.60M (79595827) - Rows rejected: 78.49M (78485147) - Rows total: 79.60M (79595827) Filter 10 (1.00 MB): - Files processed: 259 (259) - Files rejected: 205 (205) - Files total: 259 (259) - RowGroups processed: 600 (600) - RowGroups rejected: 0 (0) - RowGroups total: 600 (600) - Rows processed: 750.70K (750700) - Rows rejected: 0 (0) - Rows total: 750.72K (750722) - Splits processed: 54 (54) - Splits rejected: 0 (0) - Splits total: 54 (54) Filter 9 (1.00 MB): - Rows processed: 1.11M (1110680) - Rows rejected: 854.96K (854964) - Rows total: 1.11M (1110680) Instance b45ac2a82caefd3:f987ea31ef3ee9ad (host=vd1312.halxg.cloudera.com:22000):(Total: 4s060ms, non-child: 6.169ms, % non-child: 0.15%) Hdfs split stats (:<# splits>/): 4:35/2.82 GB 3:32/1.94 GB 2:26/2.01 GB 7:25/1.39 GB 0:34/2.13 GB 5:33/2.25 GB 6:35/2.20 GB 1:43/3.02 GB Filter 9 arrival: 8ms Filter 10 arrival: 14ms Filter 11 arrival: 32ms MemoryUsage(500.000ms): 1.06 GB, 1.96 GB, 1.56 GB, 1.50 GB, 1.81 GB, 1.45 GB, 1.02 GB, 486.60 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 1.98 GB (2122958328) - PerHostPeakMemUsage: 6.03 GB (6472625824) - PrepareTime: 1.663ms - RowsProduced: 1 (1) - TotalCpuTime: 2m32s - TotalNetworkReceiveTime: 125.062ms - TotalNetworkSendTime: 340.034us - TotalStorageWaitTime: 2s956ms DataStreamSender (dst_id=48):(Total: 62.188us, non-child: 62.188us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - NetworkThroughput(*): 3.08 MB/sec - OverallThroughput: 1.64 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 20.137us - TransmitDataRPCTime: 33.163us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 4s054ms, non-child: 3s552ms, % non-child: 87.63%) ExecOption: Codegen Disabled - BuildTime: 3s547ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.04 MB (16822768) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 501.604ms, non-child: 145.048ms, % non-child: 28.92%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 39.856ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 20.357ms - GetNewBlockTime: 365.888us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 33.05 MB (34653808) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.689ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 506.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.853us EXCHANGE_NODE (id=47):(Total: 104.936ms, non-child: 10.513ms, % non-child: 10.02%) BytesReceived(500.000ms): 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 7.876ms - DeserializeRowBatchTimer: 11.489ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 325.810ms, non-child: 56.222ms, % non-child: 17.26%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 84.474us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 31.337us - GetNewBlockTime: 288.295us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17872240) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.198ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 780.17 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.499us EXCHANGE_NODE (id=46):(Total: 3.868ms, non-child: 22.252us, % non-child: 0.58%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 8.093us - DeserializeRowBatchTimer: 33.217us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 66.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 269.591ms, non-child: 57.002ms, % non-child: 21.14%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 68.227us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 40.806us - GetNewBlockTime: 239.030us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17872496) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.357ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 942.87 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.562us EXCHANGE_NODE (id=45):(Total: 8.572ms, non-child: 21.256us, % non-child: 0.25%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 10.097us - DeserializeRowBatchTimer: 34.376us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 42.58 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 212.592ms, non-child: 86.502ms, % non-child: 40.69%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 8.726ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 986.467us - GetNewBlockTime: 361.005us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19123592) - PinTime: 0.000ns - ProbeRows: 254.30K (254296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 65.275ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 1.20 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.204us EXCHANGE_NODE (id=44):(Total: 16.662ms, non-child: 1.662ms, % non-child: 9.98%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 513.294us - DeserializeRowBatchTimer: 5.806ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 1.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 109.434ms, non-child: 109.434ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 55 Hdfs split stats (:<# splits>/): 4:35/2.82 GB 3:32/1.94 GB 2:26/2.01 GB 7:25/1.39 GB 0:34/2.13 GB 5:33/2.25 GB 6:35/2.20 GB 1:43/3.02 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:0% 2:12.5% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:208 PARQUET/SNAPPY:385 BytesRead(500.000ms): 545.29 MB, 598.50 MB, 607.99 MB, 880.02 MB, 880.02 MB, 880.02 MB, 880.02 MB, 880.02 MB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 880.02 MB (922767484) - BytesReadDataNodeCache: 0 - BytesReadLocal: 880.02 MB (922767484) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 880.02 MB (922767484) - DecompressionTime: 9s559ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.94 GB (2080770920) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.22M (77222588) - RowsReturned: 254.30K (254296) - RowsReturnedRate: 2.32 M/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 8.89K (8893) - ScannerThreadsTotalWallClockTime: 2m31s - MaterializeTupleTime(*): 29s797ms - ScannerThreadsSysTime: 45s220ms - ScannerThreadsUserTime: 24s158ms - ScannerThreadsVoluntaryContextSwitches: 585.90K (585898) - TotalRawHdfsReadTime(*): 674.324ms - TotalReadThroughput: 220.00 MB/sec Filter 11 (1.00 MB): - Rows processed: 77.22M (77222588) - Rows rejected: 76.14M (76142102) - Rows total: 77.22M (77222588) Filter 10 (1.00 MB): - Files processed: 263 (263) - Files rejected: 208 (208) - Files total: 263 (263) - RowGroups processed: 582 (582) - RowGroups rejected: 0 (0) - RowGroups total: 582 (582) - Rows processed: 756.34K (756338) - Rows rejected: 0 (0) - Rows total: 756.36K (756358) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Filter 9 (1.00 MB): - Rows processed: 1.08M (1080486) - Rows rejected: 826.19K (826190) - Rows total: 1.08M (1080486) Instance b45ac2a82caefd3:f987ea31ef3ee9ac (host=vd1311.halxg.cloudera.com:22000):(Total: 3s535ms, non-child: 6.975ms, % non-child: 0.20%) Hdfs split stats (:<# splits>/): 1:37/2.55 GB 4:34/2.10 GB 3:31/2.30 GB 7:29/1.91 GB 2:36/2.58 GB 5:36/2.31 GB 6:36/2.37 GB 0:25/1.81 GB Filter 9 arrival: 14ms Filter 10 arrival: 20ms Filter 11 arrival: 38ms MemoryUsage(500.000ms): 1.10 GB, 2.08 GB, 1.66 GB, 1.84 GB, 1.82 GB, 1.41 GB, 817.91 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.09 GB (2245572776) - PerHostPeakMemUsage: 6.04 GB (6484792728) - PrepareTime: 1.980ms - RowsProduced: 1 (1) - TotalCpuTime: 2m15s - TotalNetworkReceiveTime: 143.788ms - TotalNetworkSendTime: 290.376us - TotalStorageWaitTime: 2s907ms DataStreamSender (dst_id=48):(Total: 30.150us, non-child: 30.150us, % non-child: 100.00%) - BytesSent: 108.00 B (108) - NetworkThroughput(*): 12.52 MB/sec - OverallThroughput: 3.42 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.509us - TransmitDataRPCTime: 8.225us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 3s528ms, non-child: 3s008ms, % non-child: 85.25%) ExecOption: Codegen Disabled - BuildTime: 3s005ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.41 MB (17203512) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 520.564ms, non-child: 167.077ms, % non-child: 32.10%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 39.748ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 25.289ms - GetNewBlockTime: 339.598us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 33.41 MB (35034552) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.442ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 499.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 14.465us EXCHANGE_NODE (id=47):(Total: 111.356ms, non-child: 11.505ms, % non-child: 10.33%) BytesReceived(500.000ms): 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 9.421ms - DeserializeRowBatchTimer: 10.759ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.69 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 323.803ms, non-child: 64.411ms, % non-child: 19.89%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 118.191us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 14.828us - GetNewBlockTime: 509.726us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.41 MB (18252984) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.303ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 803.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.591us EXCHANGE_NODE (id=46):(Total: 9.502ms, non-child: 21.252us, % non-child: 0.22%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.911us - DeserializeRowBatchTimer: 29.485us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 27.15 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 259.396ms, non-child: 48.566ms, % non-child: 18.72%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 220.394us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 35.597us - GetNewBlockTime: 386.451us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.41 MB (18253240) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.835ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 1.00 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.396us EXCHANGE_NODE (id=45):(Total: 13.866ms, non-child: 22.595us, % non-child: 0.16%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 9.983us - DeserializeRowBatchTimer: 19.592us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 26.32 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 210.833ms, non-child: 86.992ms, % non-child: 41.26%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 10.559ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.142ms - GetNewBlockTime: 390.194us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19121912) - PinTime: 0.000ns - ProbeRows: 260.22K (260216) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 62.436ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 1.23 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.358us EXCHANGE_NODE (id=44):(Total: 19.797ms, non-child: 1.587ms, % non-child: 8.02%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 686.347us - DeserializeRowBatchTimer: 5.265ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 1.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 104.046ms, non-child: 104.046ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 52 Hdfs split stats (:<# splits>/): 1:37/2.55 GB 4:34/2.10 GB 3:31/2.30 GB 7:29/1.91 GB 2:36/2.58 GB 5:36/2.31 GB 6:36/2.37 GB 0:25/1.81 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:71.43% 1:14.29% 2:14.29% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:212 PARQUET/SNAPPY:364 BytesRead(500.000ms): 597.28 MB, 682.23 MB, 769.63 MB, 910.21 MB, 910.21 MB, 910.21 MB, 910.21 MB - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 38.86 - BytesRead: 910.21 MB (954422640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 910.21 MB (954422640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 910.21 MB (954422640) - DecompressionTime: 6s425ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 2.05 GB (2203328304) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 80.04M (80041225) - RowsReturned: 260.22K (260216) - RowsReturnedRate: 2.50 M/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 8.04K (8040) - ScannerThreadsTotalWallClockTime: 2m14s - MaterializeTupleTime(*): 26s959ms - ScannerThreadsSysTime: 32s027ms - ScannerThreadsUserTime: 23s576ms - ScannerThreadsVoluntaryContextSwitches: 467.81K (467813) - TotalRawHdfsReadTime(*): 694.117ms - TotalReadThroughput: 260.06 MB/sec Filter 11 (1.00 MB): - Rows processed: 80.04M (80041225) - Rows rejected: 78.92M (78922489) - Rows total: 80.04M (80041225) Filter 10 (1.00 MB): - Files processed: 264 (264) - Files rejected: 212 (212) - Files total: 264 (264) - RowGroups processed: 604 (604) - RowGroups rejected: 0 (0) - RowGroups total: 604 (604) - Rows processed: 731.28K (731278) - Rows rejected: 0 (0) - Rows total: 731.30K (731301) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 9 (1.00 MB): - Rows processed: 1.12M (1118736) - Rows rejected: 858.52K (858520) - Rows total: 1.12M (1118736) Instance b45ac2a82caefd3:f987ea31ef3ee9ab (host=vd1314.halxg.cloudera.com:22000):(Total: 2s068ms, non-child: 8.123ms, % non-child: 0.39%) Hdfs split stats (:<# splits>/): 0:39/3.10 GB 3:32/1.94 GB 7:31/2.26 GB 2:30/1.90 GB 5:23/1.63 GB 1:33/2.21 GB 4:38/2.80 GB 6:36/2.14 GB Filter 9 arrival: 6ms Filter 10 arrival: 10ms Filter 11 arrival: 26ms MemoryUsage(500.000ms): 515.14 MB, 1.61 GB, 1.46 GB, 564.20 MB ThreadUsage(500.000ms): 40, 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 1.80 GB (1927497640) - PerHostPeakMemUsage: 5.61 GB (6020138352) - PrepareTime: 2.333ms - RowsProduced: 1 (1) - TotalCpuTime: 1m16s - TotalNetworkReceiveTime: 94.215ms - TotalNetworkSendTime: 210.795us - TotalStorageWaitTime: 2s402ms DataStreamSender (dst_id=48):(Total: 72.745us, non-child: 72.745us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - NetworkThroughput(*): 2.85 MB/sec - OverallThroughput: 1.40 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 27.744us - TransmitDataRPCTime: 35.809us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 2s060ms, non-child: 1s579ms, % non-child: 76.68%) ExecOption: Codegen Disabled - BuildTime: 1s574ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.91 MB (15632528) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 480.462ms, non-child: 145.181ms, % non-child: 30.22%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 37.487ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 19.110ms - GetNewBlockTime: 416.300us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 31.91 MB (33463568) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 92.856ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 536.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.250us EXCHANGE_NODE (id=47):(Total: 101.231ms, non-child: 9.710ms, % non-child: 9.59%) BytesReceived(500.000ms): 1.36 MB, 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 7.894ms - DeserializeRowBatchTimer: 10.483ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 310.947ms, non-child: 61.949ms, % non-child: 19.92%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 115.539us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 33.962us - GetNewBlockTime: 660.153us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.91 MB (16682000) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.204ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 828.59 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.785us EXCHANGE_NODE (id=46):(Total: 16.725us, non-child: 16.725us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.985us - DeserializeRowBatchTimer: 31.002us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 15.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 249.001ms, non-child: 54.940ms, % non-child: 22.06%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 77.009us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 38.654us - GetNewBlockTime: 370.587us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.91 MB (16682256) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 46.990ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 1.03 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.838us EXCHANGE_NODE (id=45):(Total: 13.929us, non-child: 13.929us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 5.985us - DeserializeRowBatchTimer: 24.570us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 26.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 194.064ms, non-child: 100.095ms, % non-child: 51.58%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 11.817ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.181ms - GetNewBlockTime: 1.739ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139544) - PinTime: 0.000ns - ProbeRows: 257.70K (257701) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 65.925ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 1.33 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.294us EXCHANGE_NODE (id=44):(Total: 2.025ms, non-child: 1.395ms, % non-child: 68.91%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 673.053us - DeserializeRowBatchTimer: 5.986ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 13.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 92.196ms, non-child: 92.196ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 53 Hdfs split stats (:<# splits>/): 0:39/3.10 GB 3:32/1.94 GB 7:31/2.26 GB 2:30/1.90 GB 5:23/1.63 GB 1:33/2.21 GB 4:38/2.80 GB 6:36/2.14 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:0% 3:25% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:209 PARQUET/SNAPPY:371 BytesRead(500.000ms): 316.73 MB, 811.56 MB, 904.97 MB, 904.97 MB - AverageHdfsReadThreadConcurrency: 1.00 - AverageScannerThreadConcurrency: 38.75 - BytesRead: 904.97 MB (948928325) - BytesReadDataNodeCache: 0 - BytesReadLocal: 904.97 MB (948928325) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 904.97 MB (948928325) - DecompressionTime: 5s618ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.76 GB (1885260808) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 79.52M (79522774) - RowsReturned: 257.70K (257701) - RowsReturnedRate: 2.80 M/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 6.99K (6993) - ScannerThreadsTotalWallClockTime: 1m16s - MaterializeTupleTime(*): 25s680ms - ScannerThreadsSysTime: 34s065ms - ScannerThreadsUserTime: 21s712ms - ScannerThreadsVoluntaryContextSwitches: 256.26K (256258) - TotalRawHdfsReadTime(*): 727.379ms - TotalReadThroughput: 452.48 MB/sec Filter 11 (1.00 MB): - Rows processed: 79.52M (79522774) - Rows rejected: 78.42M (78415074) - Rows total: 79.52M (79522774) Filter 10 (1.00 MB): - Files processed: 262 (262) - Files rejected: 209 (209) - Files total: 262 (262) - RowGroups processed: 592 (592) - RowGroups rejected: 0 (0) - RowGroups total: 592 (592) - Rows processed: 729.91K (729907) - Rows rejected: 0 (0) - Rows total: 729.93K (729928) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Filter 9 (1.00 MB): - Rows processed: 1.11M (1107700) - Rows rejected: 850.00K (849999) - Rows total: 1.11M (1107700) Instance b45ac2a82caefd3:f987ea31ef3ee9ae (host=vd1313.halxg.cloudera.com:22000):(Total: 2s004ms, non-child: 8.396ms, % non-child: 0.42%) Hdfs split stats (:<# splits>/): 1:32/2.22 GB 6:32/2.17 GB 3:36/2.46 GB 5:44/3.22 GB 4:34/2.05 GB 0:34/2.20 GB 2:33/1.98 GB 7:23/1.59 GB Filter 9 arrival: 5ms Filter 10 arrival: 6ms Filter 11 arrival: 31ms MemoryUsage(500.000ms): 1.24 GB, 1.77 GB, 1.67 GB, 508.94 MB ThreadUsage(500.000ms): 40, 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.16 GB (2321370280) - PerHostPeakMemUsage: 6.06 GB (6510672952) - PrepareTime: 1.906ms - RowsProduced: 1 (1) - TotalCpuTime: 1m8s - TotalNetworkReceiveTime: 112.528ms - TotalNetworkSendTime: 213.095us - TotalStorageWaitTime: 3s339ms DataStreamSender (dst_id=48):(Total: 64.254us, non-child: 64.254us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - NetworkThroughput(*): 2.77 MB/sec - OverallThroughput: 1.59 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.873us - TransmitDataRPCTime: 36.790us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 1s995ms, non-child: 1s511ms, % non-child: 75.73%) ExecOption: Codegen Disabled - BuildTime: 1s494ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 15.99 MB (16771504) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 484.361ms, non-child: 145.278ms, % non-child: 29.99%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 34.291ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 18.375ms - GetNewBlockTime: 447.680us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 33.00 MB (34602544) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 92.652ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 582.22 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.745us EXCHANGE_NODE (id=47):(Total: 110.153ms, non-child: 11.321ms, % non-child: 10.28%) BytesReceived(500.000ms): 2.30 MB, 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 8.481ms - DeserializeRowBatchTimer: 11.008ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 308.401ms, non-child: 54.809ms, % non-child: 17.77%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 83.192us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 33.257us - GetNewBlockTime: 265.827us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.00 MB (17820976) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.832ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 914.40 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.434us EXCHANGE_NODE (id=46):(Total: 13.864us, non-child: 13.864us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.775us - DeserializeRowBatchTimer: 39.130us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 18.61 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 253.594ms, non-child: 60.463ms, % non-child: 23.84%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 125.486us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 36.915us - GetNewBlockTime: 323.075us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.00 MB (17821232) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.983ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 1.11 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.594us EXCHANGE_NODE (id=45):(Total: 19.181us, non-child: 19.181us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 10.454us - DeserializeRowBatchTimer: 20.300us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 19.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 193.134ms, non-child: 97.167ms, % non-child: 50.31%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 12.546ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.256ms - GetNewBlockTime: 312.270us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19138856) - PinTime: 0.000ns - ProbeRows: 282.13K (282130) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 72.099ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 1.46 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.567us EXCHANGE_NODE (id=44):(Total: 12.246ms, non-child: 2.098ms, % non-child: 17.14%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 805.085us - DeserializeRowBatchTimer: 5.318ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 2.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 83.725ms, non-child: 83.725ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 53 Hdfs split stats (:<# splits>/): 1:32/2.22 GB 6:32/2.17 GB 3:36/2.46 GB 5:44/3.22 GB 4:34/2.05 GB 0:34/2.20 GB 2:33/1.98 GB 7:23/1.59 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:50% 1:25% 2:25% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:215 PARQUET/SNAPPY:371 BytesRead(500.000ms): 712.22 MB, 926.62 MB, 979.44 MB, 979.44 MB - AverageHdfsReadThreadConcurrency: 0.75 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 979.44 MB (1027020737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 979.44 MB (1027020737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 979.44 MB (1027020737) - DecompressionTime: 6s697ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 2.12 GB (2279166208) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 86.20M (86202147) - RowsReturned: 282.13K (282130) - RowsReturnedRate: 3.37 M/sec - ScanRangesComplete: 268 (268) - ScannerThreadsInvoluntaryContextSwitches: 5.68K (5682) - ScannerThreadsTotalWallClockTime: 1m8s - MaterializeTupleTime(*): 30s396ms - ScannerThreadsSysTime: 19s341ms - ScannerThreadsUserTime: 24s020ms - ScannerThreadsVoluntaryContextSwitches: 210.36K (210360) - TotalRawHdfsReadTime(*): 826.718ms - TotalReadThroughput: 489.72 MB/sec Filter 11 (1.00 MB): - Rows processed: 86.20M (86202147) - Rows rejected: 85.00M (84995305) - Rows total: 86.20M (86202147) Filter 10 (1.00 MB): - Files processed: 268 (268) - Files rejected: 215 (215) - Files total: 268 (268) - RowGroups processed: 644 (644) - RowGroups rejected: 0 (0) - RowGroups total: 644 (644) - Rows processed: 751.37K (751374) - Rows rejected: 0 (0) - Rows total: 751.40K (751399) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Filter 9 (1.00 MB): - Rows processed: 1.21M (1206842) - Rows rejected: 924.71K (924712) - Rows total: 1.21M (1206842) Instance b45ac2a82caefd3:f987ea31ef3ee9af (host=vd1309.halxg.cloudera.com:22000):(Total: 1s739ms, non-child: 12.828ms, % non-child: 0.74%) Hdfs split stats (:<# splits>/): 6:29/1.84 GB 4:29/1.92 GB 7:29/2.11 GB 2:34/2.06 GB 1:33/2.30 GB 0:37/2.13 GB 5:38/3.00 GB 3:41/2.53 GB Filter 9 arrival: 12ms Filter 10 arrival: 13ms Filter 11 arrival: 23ms MemoryUsage(500.000ms): 1.12 GB, 1.46 GB, 695.62 MB ThreadUsage(500.000ms): 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 1.49 GB (1595255328) - PerHostPeakMemUsage: 5.41 GB (5806841432) - PrepareTime: 3.260ms - RowsProduced: 1 (1) - TotalCpuTime: 58s907ms - TotalNetworkReceiveTime: 71.012ms - TotalNetworkSendTime: 183.409us - TotalStorageWaitTime: 2s479ms DataStreamSender (dst_id=48):(Total: 85.038us, non-child: 85.038us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - NetworkThroughput(*): 2.01 MB/sec - OverallThroughput: 1.20 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.450us - TransmitDataRPCTime: 50.808us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 1s726ms, non-child: 1s281ms, % non-child: 74.21%) ExecOption: Codegen Disabled - BuildTime: 1s274ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.65 MB (15363728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 445.233ms, non-child: 144.968ms, % non-child: 32.56%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 46.216ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 20.837ms - GetNewBlockTime: 1.653ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 31.66 MB (33194768) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 85.329ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 555.72 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.251us EXCHANGE_NODE (id=47):(Total: 80.112ms, non-child: 11.389ms, % non-child: 14.22%) BytesReceived(500.000ms): 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 8.687ms - DeserializeRowBatchTimer: 14.518ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 3.74 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 286.790ms, non-child: 50.161ms, % non-child: 17.49%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 82.049us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 33.676us - GetNewBlockTime: 451.539us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.65 MB (16413200) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.754ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 862.74 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.760us EXCHANGE_NODE (id=46):(Total: 15.418us, non-child: 15.418us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 6.996us - DeserializeRowBatchTimer: 22.126us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 16.73 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 236.632ms, non-child: 49.052ms, % non-child: 20.73%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 103.491us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 40.733us - GetNewBlockTime: 634.538us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.65 MB (16413456) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 44.077ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 1.05 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.063us EXCHANGE_NODE (id=45):(Total: 19.666us, non-child: 19.666us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 11.360us - DeserializeRowBatchTimer: 17.397us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 18.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 187.582ms, non-child: 84.940ms, % non-child: 45.28%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 8.601ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.778ms - GetNewBlockTime: 193.453us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19125880) - PinTime: 0.000ns - ProbeRows: 247.52K (247523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 64.456ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 1.32 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 817.000ns EXCHANGE_NODE (id=44):(Total: 669.616us, non-child: 669.616us, % non-child: 100.00%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 521.625us - DeserializeRowBatchTimer: 7.832ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 40.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 101.976ms, non-child: 101.976ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 52 Hdfs split stats (:<# splits>/): 6:29/1.84 GB 4:29/1.92 GB 7:29/2.11 GB 2:34/2.06 GB 1:33/2.30 GB 0:37/2.13 GB 5:38/3.00 GB 3:41/2.53 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:218 PARQUET/SNAPPY:364 BytesRead(500.000ms): 604.20 MB, 863.10 MB, 863.10 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 863.10 MB (905023870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 863.10 MB (905023870) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 863.10 MB (905023870) - DecompressionTime: 5s082ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.45 GB (1552896664) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.79M (75793861) - RowsReturned: 247.52K (247523) - RowsReturnedRate: 2.43 M/sec - ScanRangesComplete: 270 (270) - ScannerThreadsInvoluntaryContextSwitches: 6.92K (6917) - ScannerThreadsTotalWallClockTime: 58s719ms - MaterializeTupleTime(*): 24s824ms - ScannerThreadsSysTime: 25s465ms - ScannerThreadsUserTime: 21s029ms - ScannerThreadsVoluntaryContextSwitches: 186.44K (186438) - TotalRawHdfsReadTime(*): 741.029ms - TotalReadThroughput: 575.40 MB/sec Filter 11 (1.00 MB): - Rows processed: 75.79M (75793861) - Rows rejected: 74.74M (74736321) - Rows total: 75.79M (75793861) Filter 10 (1.00 MB): - Files processed: 270 (270) - Files rejected: 218 (218) - Files total: 270 (270) - RowGroups processed: 569 (569) - RowGroups rejected: 0 (0) - RowGroups total: 569 (569) - Rows processed: 723.45K (723449) - Rows rejected: 0 (0) - Rows total: 723.47K (723470) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 9 (1.00 MB): - Rows processed: 1.06M (1057540) - Rows rejected: 810.02K (810017) - Rows total: 1.06M (1057540) Instance b45ac2a82caefd3:f987ea31ef3ee9aa (host=vd1316.halxg.cloudera.com:22000):(Total: 1s441ms, non-child: 6.953ms, % non-child: 0.48%) Hdfs split stats (:<# splits>/): 4:32/2.01 GB 7:34/2.53 GB 2:35/2.87 GB 0:30/1.93 GB 6:27/1.56 GB 1:35/2.61 GB 3:30/1.86 GB 5:33/2.53 GB Filter 9 arrival: 7ms Filter 10 arrival: 10ms Filter 11 arrival: 26ms MemoryUsage(500.000ms): 1.27 GB, 1.22 GB, 290.28 MB ThreadUsage(500.000ms): 40, 40, 40 - AverageThreadTokens: 40.00 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 1.41 GB (1515180392) - PerHostPeakMemUsage: 5.19 GB (5575694536) - PrepareTime: 1.779ms - RowsProduced: 1 (1) - TotalCpuTime: 50s625ms - TotalNetworkReceiveTime: 92.931ms - TotalNetworkSendTime: 231.102us - TotalStorageWaitTime: 3s471ms DataStreamSender (dst_id=48):(Total: 70.085us, non-child: 70.085us, % non-child: 100.00%) - BytesSent: 107.00 B (107) - NetworkThroughput(*): 2.78 MB/sec - OverallThroughput: 1.46 MB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.107us - TransmitDataRPCTime: 36.724us - UncompressedRowBatchSize: 240.00 B (240) AGGREGATION_NODE (id=30):(Total: 1s434ms, non-child: 1s025ms, % non-child: 71.52%) ExecOption: Codegen Disabled - BuildTime: 1s017ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 14.77 MB (15489176) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HASH_JOIN_NODE (id=29):(Total: 408.485ms, non-child: 115.674ms, % non-child: 28.32%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 38.604ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 10.944ms - GetNewBlockTime: 741.241us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 31.78 MB (33320216) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 78.369ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 573.55 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.560us EXCHANGE_NODE (id=47):(Total: 99.223ms, non-child: 10.371ms, % non-child: 10.45%) BytesReceived(500.000ms): 2.30 MB, 2.30 MB, 2.30 MB - BytesReceived: 2.30 MB (2413409) - ConvertRowBatchTime: 8.127ms - DeserializeRowBatchTimer: 12.633ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 3.02 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=28):(Total: 275.389ms, non-child: 42.842ms, % non-child: 15.56%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 57.910us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 12.831us - GetNewBlockTime: 601.667us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.77 MB (16538648) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 38.052ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 850.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 574.000ns EXCHANGE_NODE (id=46):(Total: 9.164us, non-child: 9.164us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 5.104us - DeserializeRowBatchTimer: 54.249us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 28.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=27):(Total: 232.548ms, non-child: 45.996ms, % non-child: 19.78%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 93.533us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 20.994us - GetNewBlockTime: 2.210ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.77 MB (16538904) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 36.052ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 1.01 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 966.000ns EXCHANGE_NODE (id=45):(Total: 17.750us, non-child: 17.750us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 9.640us - DeserializeRowBatchTimer: 53.221us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 20.56 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=26):(Total: 186.554ms, non-child: 82.856ms, % non-child: 44.41%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 9.283ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 854.203us - GetNewBlockTime: 3.348ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.23 MB (19120400) - PinTime: 0.000ns - ProbeRows: 234.39K (234393) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 60.047ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 1.26 M/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.629us EXCHANGE_NODE (id=44):(Total: 2.971ms, non-child: 839.564us, % non-child: 28.25%) BytesReceived(500.000ms): 726.56 KB, 726.56 KB, 726.56 KB - BytesReceived: 726.56 KB (744000) - ConvertRowBatchTime: 611.369us - DeserializeRowBatchTimer: 6.531ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 9.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=21):(Total: 100.731ms, non-child: 100.731ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 4:32/2.01 GB 7:34/2.53 GB 2:35/2.87 GB 0:30/1.93 GB 6:27/1.56 GB 1:35/2.61 GB 3:30/1.86 GB 5:33/2.53 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:211 PARQUET/SNAPPY:315 BytesRead(500.000ms): 696.33 MB, 815.12 MB, 815.12 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 815.12 MB (854713494) - BytesReadDataNodeCache: 0 - BytesReadLocal: 815.12 MB (854713494) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 815.12 MB (854713494) - DecompressionTime: 4s314ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.37 GB (1472978648) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 71.72M (71721657) - RowsReturned: 234.39K (234393) - RowsReturnedRate: 2.33 M/sec - ScanRangesComplete: 256 (256) - ScannerThreadsInvoluntaryContextSwitches: 5.18K (5176) - ScannerThreadsTotalWallClockTime: 50s439ms - MaterializeTupleTime(*): 20s918ms - ScannerThreadsSysTime: 22s253ms - ScannerThreadsUserTime: 18s237ms - ScannerThreadsVoluntaryContextSwitches: 156.70K (156700) - TotalRawHdfsReadTime(*): 614.957ms - TotalReadThroughput: 543.41 MB/sec Filter 11 (1.00 MB): - Rows processed: 71.72M (71721657) - Rows rejected: 70.72M (70719551) - Rows total: 71.72M (71721657) Filter 10 (1.00 MB): - Files processed: 256 (256) - Files rejected: 211 (211) - Files total: 256 (256) - RowGroups processed: 539 (539) - RowGroups rejected: 0 (0) - RowGroups total: 539 (539) - Rows processed: 635.25K (635247) - Rows rejected: 0 (0) - Rows total: 635.27K (635268) - Splits processed: 45 (45) - Splits rejected: 0 (0) - Splits total: 45 (45) Filter 9 (1.00 MB): - Rows processed: 1.00M (1002106) - Rows rejected: 767.71K (767713) - Rows total: 1.00M (1002106) Fragment F16: Instance b45ac2a82caefd3:f987ea31ef3ee9b0 (host=vd1309.halxg.cloudera.com:22000):(Total: 203.081ms, non-child: 117.147ms, % non-child: 57.68%) Hdfs split stats (:<# splits>/): 7:1/27.40 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.70 MB (8072024) - PerHostPeakMemUsage: 1020.84 MB (1070425056) - PrepareTime: 259.765us - RowsProduced: 300.00K (300000) - TotalCpuTime: 211.127ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 136.253ms - TotalStorageWaitTime: 6.884ms DataStreamSender (dst_id=47):(Total: 71.488ms, non-child: 71.488ms, % non-child: 100.00%) - BytesSent: 16.11 MB (16893863) - NetworkThroughput(*): 381.48 MB/sec - OverallThroughput: 225.37 MB/sec - RowsReturned: 300.00K (300000) - SerializeBatchTime: 29.053ms - TransmitDataRPCTime: 42.232ms - UncompressedRowBatchSize: 40.06 MB (42008204) HDFS_SCAN_NODE (id=25):(Total: 14.445ms, non-child: 14.445ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/27.40 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.32 MB (1384495) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.32 MB (1384495) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.32 MB (1384495) - DecompressionTime: 7.677ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.60 MB (7967352) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 300.00K (300000) - RowsReturnedRate: 20.77 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 15 (15) - ScannerThreadsTotalWallClockTime: 146.622ms - MaterializeTupleTime(*): 10.918ms - ScannerThreadsSysTime: 4.999ms - ScannerThreadsUserTime: 18.997ms - ScannerThreadsVoluntaryContextSwitches: 236 (236) - TotalRawHdfsReadTime(*): 1.024ms - TotalReadThroughput: 0.00 /sec Fragment F15: Instance b45ac2a82caefd3:f987ea31ef3ee9b1 (host=vd1314.halxg.cloudera.com:22000):(Total: 69.387ms, non-child: 60.940ms, % non-child: 87.83%) Hdfs split stats (:<# splits>/): 1:1/87.37 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 189.30 KB (193840) - PerHostPeakMemUsage: 46.33 MB (48582632) - PrepareTime: 203.328us - RowsProduced: 258 (258) - TotalCpuTime: 19.072ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 55.112ms - TotalStorageWaitTime: 4.688ms DataStreamSender (dst_id=46):(Total: 338.013us, non-child: 338.013us, % non-child: 100.00%) - BytesSent: 39.29 KB (40236) - NetworkThroughput(*): 192.47 MB/sec - OverallThroughput: 113.52 MB/sec - RowsReturned: 258 (258) - SerializeBatchTime: 89.181us - TransmitDataRPCTime: 199.363us - UncompressedRowBatchSize: 52.94 KB (54208) HDFS_SCAN_NODE (id=24):(Total: 8.109ms, non-child: 8.109ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/87.37 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 93.34 KB (95579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.34 KB (95579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.34 KB (95579) - DecompressionTime: 4.858us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 136.00 KB (139264) - PerReadThreadRawHdfsThroughput: 1.71 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 258 (258) - RowsReturnedRate: 31.81 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 5.688ms - MaterializeTupleTime(*): 99.401us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 8 (8) - TotalRawHdfsReadTime(*): 52.097us - TotalReadThroughput: 0.00 /sec Fragment F14: Instance b45ac2a82caefd3:f987ea31ef3ee9b2 (host=vd1314.halxg.cloudera.com:22000):(Total: 69.376ms, non-child: 48.625ms, % non-child: 70.09%) Hdfs split stats (:<# splits>/): 6:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.15 MB (2252432) - PerHostPeakMemUsage: 47.37 MB (49668248) - PrepareTime: 144.660us - RowsProduced: 365 (365) - TotalCpuTime: 46.606ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 39.242ms - TotalStorageWaitTime: 7.484ms DataStreamSender (dst_id=45):(Total: 282.382us, non-child: 282.382us, % non-child: 100.00%) - BytesSent: 20.10 KB (20587) - NetworkThroughput(*): 136.23 MB/sec - OverallThroughput: 69.53 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 96.846us - TransmitDataRPCTime: 144.118us - UncompressedRowBatchSize: 39.95 KB (40908) HDFS_SCAN_NODE (id=23):(Total: 20.469ms, non-child: 20.469ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/2.15 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 170.858us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.07 MB (2167800) - PerReadThreadRawHdfsThroughput: 596.94 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 17.83 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 20.065ms - MaterializeTupleTime(*): 8.318ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 761.084us - TotalReadThroughput: 0.00 /sec Fragment F13: Instance b45ac2a82caefd3:f987ea31ef3ee9b7 (host=vd1316.halxg.cloudera.com:22000):(Total: 85.494ms, non-child: 43.477ms, % non-child: 50.85%) Hdfs split stats (:<# splits>/): 7:1/1.14 MB 6:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 28.16 MB (29529976) - PerHostPeakMemUsage: 79.40 MB (83253408) - PrepareTime: 140.976us - RowsProduced: 7.83K (7829) - TotalCpuTime: 188.145ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 32.791ms - TotalStorageWaitTime: 18.161ms DataStreamSender (dst_id=44):(Total: 5.794ms, non-child: 5.794ms, % non-child: 100.00%) - BytesSent: 1.41 MB (1480857) - NetworkThroughput(*): 795.63 MB/sec - OverallThroughput: 243.74 MB/sec - RowsReturned: 7.83K (7829) - SerializeBatchTime: 3.979ms - TransmitDataRPCTime: 1.775ms - UncompressedRowBatchSize: 3.71 MB (3891237) HDFS_SCAN_NODE (id=22):(Total: 36.223ms, non-child: 36.223ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 7:1/1.14 MB 6:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.46 MB (2581384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.46 MB (2581384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.46 MB (2581384) - DecompressionTime: 2.699ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 24.23 MB (25403048) - PerReadThreadRawHdfsThroughput: 1.69 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 547.43K (547428) - RowsReturned: 7.83K (7829) - RowsReturnedRate: 216.13 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 48 (48) - ScannerThreadsTotalWallClockTime: 152.109ms - MaterializeTupleTime(*): 126.545ms - ScannerThreadsSysTime: 28.995ms - ScannerThreadsUserTime: 98.984ms - ScannerThreadsVoluntaryContextSwitches: 97 (97) - TotalRawHdfsReadTime(*): 1.420ms - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9b6 (host=vd1314.halxg.cloudera.com:22000):(Total: 77.758ms, non-child: 28.662ms, % non-child: 36.86%) Hdfs split stats (:<# splits>/): 6:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.60 MB (13213552) - PerHostPeakMemUsage: 51.47 MB (53968848) - PrepareTime: 1.022ms - RowsProduced: 3.91K (3907) - TotalCpuTime: 118.454ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 18.777ms - TotalStorageWaitTime: 11.936ms DataStreamSender (dst_id=44):(Total: 3.155ms, non-child: 3.155ms, % non-child: 100.00%) - BytesSent: 731.53 KB (749091) - NetworkThroughput(*): 685.46 MB/sec - OverallThroughput: 226.41 MB/sec - RowsReturned: 3.91K (3907) - SerializeBatchTime: 2.086ms - TransmitDataRPCTime: 1.042ms - UncompressedRowBatchSize: 1.85 MB (1941891) HDFS_SCAN_NODE (id=22):(Total: 45.940ms, non-child: 45.940ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290406) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290406) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290406) - DecompressionTime: 713.456us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.44 MB (8847208) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3907) - RowsReturnedRate: 85.04 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 36 (36) - ScannerThreadsTotalWallClockTime: 68.580ms - MaterializeTupleTime(*): 54.209ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 43.993ms - ScannerThreadsVoluntaryContextSwitches: 72 (72) - TotalRawHdfsReadTime(*): 639.978us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9b3 (host=vd1310.halxg.cloudera.com:22000):(Total: 77.319ms, non-child: 43.064ms, % non-child: 55.70%) Hdfs split stats (:<# splits>/): 0:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311608) - PerHostPeakMemUsage: 63.36 MB (66438696) - PrepareTime: 92.327us - RowsProduced: 3.91K (3911) - TotalCpuTime: 87.632ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 34.814ms - TotalStorageWaitTime: 7.693ms DataStreamSender (dst_id=44):(Total: 2.611ms, non-child: 2.611ms, % non-child: 100.00%) - BytesSent: 720.50 KB (737793) - NetworkThroughput(*): 772.79 MB/sec - OverallThroughput: 269.42 MB/sec - RowsReturned: 3.91K (3911) - SerializeBatchTime: 1.674ms - TransmitDataRPCTime: 910.490us - UncompressedRowBatchSize: 1.85 MB (1943879) HDFS_SCAN_NODE (id=22):(Total: 31.643ms, non-child: 31.643ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290670) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290670) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290670) - DecompressionTime: 743.215us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.44 MB (10945264) - PerReadThreadRawHdfsThroughput: 2.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3911) - RowsReturnedRate: 123.60 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 51.090ms - MaterializeTupleTime(*): 41.088ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 23 (23) - TotalRawHdfsReadTime(*): 518.793us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9b5 (host=vd1313.halxg.cloudera.com:22000):(Total: 76.660ms, non-child: 37.532ms, % non-child: 48.96%) Hdfs split stats (:<# splits>/): 4:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311640) - PerHostPeakMemUsage: 52.35 MB (54895584) - PrepareTime: 168.067us - RowsProduced: 3.90K (3905) - TotalCpuTime: 96.832ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30.044ms - TotalStorageWaitTime: 8.893ms DataStreamSender (dst_id=44):(Total: 3.634ms, non-child: 3.634ms, % non-child: 100.00%) - BytesSent: 730.17 KB (747691) - NetworkThroughput(*): 560.64 MB/sec - OverallThroughput: 196.17 MB/sec - RowsReturned: 3.90K (3905) - SerializeBatchTime: 2.326ms - TransmitDataRPCTime: 1.271ms - UncompressedRowBatchSize: 1.85 MB (1940897) HDFS_SCAN_NODE (id=22):(Total: 35.492ms, non-child: 35.492ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290957) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290957) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290957) - DecompressionTime: 796.330us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.38 MB (10887952) - PerReadThreadRawHdfsThroughput: 1.84 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.90K (3905) - RowsReturnedRate: 110.02 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 57.187ms - MaterializeTupleTime(*): 45.846ms - ScannerThreadsSysTime: 5.999ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 654.831us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9b8 (host=vd1311.halxg.cloudera.com:22000):(Total: 74.156ms, non-child: 36.999ms, % non-child: 49.89%) Hdfs split stats (:<# splits>/): 1:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311584) - PerHostPeakMemUsage: 47.49 MB (49796472) - PrepareTime: 86.192us - RowsProduced: 3.91K (3908) - TotalCpuTime: 89.654ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 30.437ms - TotalStorageWaitTime: 8.860ms DataStreamSender (dst_id=44):(Total: 2.636ms, non-child: 2.636ms, % non-child: 100.00%) - BytesSent: 722.35 KB (739683) - NetworkThroughput(*): 628.73 MB/sec - OverallThroughput: 267.54 MB/sec - RowsReturned: 3.91K (3908) - SerializeBatchTime: 1.478ms - TransmitDataRPCTime: 1.121ms - UncompressedRowBatchSize: 1.85 MB (1942388) HDFS_SCAN_NODE (id=22):(Total: 34.520ms, non-child: 34.520ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290724) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290724) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290724) - DecompressionTime: 763.062us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.38 MB (10887896) - PerReadThreadRawHdfsThroughput: 1.86 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3908) - RowsReturnedRate: 113.21 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 53.335ms - MaterializeTupleTime(*): 42.144ms - ScannerThreadsSysTime: 8.998ms - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 29 (29) - TotalRawHdfsReadTime(*): 645.426us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9b4 (host=vd1309.halxg.cloudera.com:22000):(Total: 73.810ms, non-child: 37.262ms, % non-child: 50.48%) Hdfs split stats (:<# splits>/): 2:1/1.16 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.90 MB (15620960) - PerHostPeakMemUsage: 54.07 MB (56698512) - PrepareTime: 485.632us - RowsProduced: 3.98K (3980) - TotalCpuTime: 101.295ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.924ms - TotalStorageWaitTime: 6.490ms DataStreamSender (dst_id=44):(Total: 2.495ms, non-child: 2.495ms, % non-child: 100.00%) - BytesSent: 735.24 KB (752885) - NetworkThroughput(*): 1.24 GB/sec - OverallThroughput: 287.68 MB/sec - RowsReturned: 3.98K (3980) - SerializeBatchTime: 1.862ms - TransmitDataRPCTime: 564.509us - UncompressedRowBatchSize: 1.89 MB (1978172) HDFS_SCAN_NODE (id=22):(Total: 34.051ms, non-child: 34.051ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/1.16 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.25 MB (1310109) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.25 MB (1310109) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.25 MB (1310109) - DecompressionTime: 1.205ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.68 MB (11197272) - PerReadThreadRawHdfsThroughput: 2.05 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 278.52K (278516) - RowsReturned: 3.98K (3980) - RowsReturnedRate: 116.88 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 17 (17) - ScannerThreadsTotalWallClockTime: 55.592ms - MaterializeTupleTime(*): 45.324ms - ScannerThreadsSysTime: 2.999ms - ScannerThreadsUserTime: 42.993ms - ScannerThreadsVoluntaryContextSwitches: 66 (66) - TotalRawHdfsReadTime(*): 594.644us - TotalReadThroughput: 0.00 /sec Fragment F06: Instance b45ac2a82caefd3:f987ea31ef3ee9b9 (host=vd1310.halxg.cloudera.com:22000):(Total: 5s924ms, non-child: 51.081ms, % non-child: 0.86%) Hdfs split stats (:<# splits>/): 2:26/1.74 GB 3:28/2.20 GB 1:36/2.51 GB 4:33/2.24 GB 7:34/2.20 GB 6:37/2.57 GB 0:37/2.58 GB 5:28/1.87 GB Filter 6 arrival: 20ms Filter 5 arrival: 54ms Filter 7 arrival: 79ms MemoryUsage(500.000ms): 10.60 MB, 1.67 GB, 2.16 GB, 1.76 GB, 1.82 GB, 2.05 GB, 2.14 GB, 1.75 GB, 1.30 GB, 1.08 GB, 742.81 MB, 463.68 MB ThreadUsage(500.000ms): 3, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40, 40 - AverageThreadTokens: 36.92 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.20 GB (2364803488) - PerHostPeakMemUsage: 6.34 GB (6806403240) - PrepareTime: 3.371ms - RowsProduced: 122.63K (122627) - TotalCpuTime: 3m41s - TotalNetworkReceiveTime: 267.125ms - TotalNetworkSendTime: 2.464ms - TotalStorageWaitTime: 3s948ms DataStreamSender (dst_id=42):(Total: 70.779ms, non-child: 70.779ms, % non-child: 100.00%) - BytesSent: 8.94 MB (9370292) - NetworkThroughput(*): 640.18 MB/sec - OverallThroughput: 126.25 MB/sec - RowsReturned: 122.63K (122627) - SerializeBatchTime: 56.708ms - TransmitDataRPCTime: 13.958ms - UncompressedRowBatchSize: 31.34 MB (32866688) AGGREGATION_NODE (id=20):(Total: 5s802ms, non-child: 4s861ms, % non-child: 83.77%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 15.346ms - GetResultsTime: 66.578ms - HTResizeTime: 51.024ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 188.54 MB (197696888) - PinTime: 0.000ns - ReductionFactorEstimate: 60.42 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 122.63K (122627) - RowsReturnedRate: 21.13 K/sec - StreamingTime: 4s776ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 941.564ms, non-child: 197.946ms, % non-child: 21.02%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 64.669ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 28.324ms - GetNewBlockTime: 4.579ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.59 MB (168394104) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 102.934ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 271.39 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.074us EXCHANGE_NODE (id=41):(Total: 167.169ms, non-child: 11.324ms, % non-child: 6.77%) BytesReceived(500.000ms): 31.84 KB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 8.273ms - DeserializeRowBatchTimer: 24.061ms - FirstBatchArrivalWaitTime: 11.300ms - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 1.79 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 726.029ms, non-child: 81.614ms, % non-child: 11.24%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 165.107us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 52.067us - GetNewBlockTime: 149.909us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.59 MB (17394808) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 54.508ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 351.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 535.000ns EXCHANGE_NODE (id=40):(Total: 45.533ms, non-child: 17.868us, % non-child: 0.04%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 4.049us - DeserializeRowBatchTimer: 10.312us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 5.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 644.418ms, non-child: 80.073ms, % non-child: 12.43%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 163.450us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 68.526us - GetNewBlockTime: 154.138us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.59 MB (17395064) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.523ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 396.52 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.508us EXCHANGE_NODE (id=39):(Total: 10.233ms, non-child: 22.933us, % non-child: 0.22%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 11.370us - DeserializeRowBatchTimer: 21.092us - FirstBatchArrivalWaitTime: 5.814ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 35.67 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 564.348ms, non-child: 106.639ms, % non-child: 18.90%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 12.827ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.506ms - GetNewBlockTime: 3.384ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139208) - PinTime: 0.000ns - ProbeRows: 255.72K (255716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 71.263ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 452.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.704us EXCHANGE_NODE (id=38):(Total: 53.754ms, non-child: 1.662ms, % non-child: 3.09%) BytesReceived(500.000ms): 243.73 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 700.739us - DeserializeRowBatchTimer: 5.096ms - FirstBatchArrivalWaitTime: 7.607ms - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 510.47 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 404.143ms, non-child: 404.143ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 54 Hdfs split stats (:<# splits>/): 2:26/1.74 GB 3:28/2.20 GB 1:36/2.51 GB 4:33/2.24 GB 7:34/2.20 GB 6:37/2.57 GB 0:37/2.58 GB 5:28/1.87 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:205 PARQUET/SNAPPY:378 BytesRead(500.000ms): 0, 659.15 MB, 659.15 MB, 681.56 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 35.75 - BytesRead: 906.08 MB (950095129) - BytesReadDataNodeCache: 0 - BytesReadLocal: 906.08 MB (950095129) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 906.08 MB (950095129) - DecompressionTime: 12s863ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 54 (54) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 2.02 GB (2172256832) - PerReadThreadRawHdfsThroughput: 1.07 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 79.60M (79595827) - RowsReturned: 255.72K (255716) - RowsReturnedRate: 632.74 K/sec - ScanRangesComplete: 259 (259) - ScannerThreadsInvoluntaryContextSwitches: 12.69K (12692) - ScannerThreadsTotalWallClockTime: 3m39s - MaterializeTupleTime(*): 43s607ms - ScannerThreadsSysTime: 1m7s - ScannerThreadsUserTime: 28s505ms - ScannerThreadsVoluntaryContextSwitches: 777.50K (777495) - TotalRawHdfsReadTime(*): 827.840ms - TotalReadThroughput: 151.01 MB/sec Filter 7 (1.00 MB): - Rows processed: 79.60M (79595827) - Rows rejected: 78.49M (78485147) - Rows total: 79.60M (79595827) Filter 6 (1.00 MB): - Files processed: 259 (259) - Files rejected: 205 (205) - Files total: 259 (259) - RowGroups processed: 600 (600) - RowGroups rejected: 0 (0) - RowGroups total: 600 (600) - Rows processed: 750.70K (750700) - Rows rejected: 0 (0) - Rows total: 750.72K (750722) - Splits processed: 54 (54) - Splits rejected: 0 (0) - Splits total: 54 (54) Filter 5 (1.00 MB): - Rows processed: 1.11M (1110680) - Rows rejected: 854.96K (854964) - Rows total: 1.11M (1110680) Instance b45ac2a82caefd3:f987ea31ef3ee9bd (host=vd1312.halxg.cloudera.com:22000):(Total: 4s452ms, non-child: 84.184ms, % non-child: 1.89%) Hdfs split stats (:<# splits>/): 4:35/2.82 GB 3:32/1.94 GB 2:26/2.01 GB 7:25/1.39 GB 0:34/2.13 GB 5:33/2.25 GB 6:35/2.20 GB 1:43/3.02 GB Filter 5 arrival: 40ms Filter 6 arrival: 48ms Filter 7 arrival: 67ms MemoryUsage(500.000ms): 583.97 MB, 2.10 GB, 1.76 GB, 1.69 GB, 1.93 GB, 2.00 GB, 1.44 GB, 1.23 GB, 518.38 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 35.67 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.13 GB (2290694728) - PerHostPeakMemUsage: 6.03 GB (6472625824) - PrepareTime: 2.437ms - RowsProduced: 122.59K (122587) - TotalCpuTime: 2m38s - TotalNetworkReceiveTime: 266.621ms - TotalNetworkSendTime: 57.395ms - TotalStorageWaitTime: 3s651ms DataStreamSender (dst_id=42):(Total: 72.621ms, non-child: 72.621ms, % non-child: 100.00%) - BytesSent: 8.93 MB (9367225) - NetworkThroughput(*): 560.71 MB/sec - OverallThroughput: 123.01 MB/sec - RowsReturned: 122.59K (122587) - SerializeBatchTime: 56.575ms - TransmitDataRPCTime: 15.932ms - UncompressedRowBatchSize: 31.33 MB (32855968) AGGREGATION_NODE (id=20):(Total: 4s295ms, non-child: 3s700ms, % non-child: 86.15%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 11.793ms - GetResultsTime: 62.528ms - HTResizeTime: 30.030ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 187.38 MB (196482752) - PinTime: 0.000ns - ReductionFactorEstimate: 60.60 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 122.59K (122587) - RowsReturnedRate: 28.54 K/sec - StreamingTime: 3s622ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 594.936ms, non-child: 163.697ms, % non-child: 27.52%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 60.113ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 21.659ms - GetNewBlockTime: 1.041ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.05 MB (168870944) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 90.775ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 427.25 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.013us EXCHANGE_NODE (id=41):(Total: 161.148ms, non-child: 12.446ms, % non-child: 7.72%) BytesReceived(500.000ms): 3.61 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 8.124ms - DeserializeRowBatchTimer: 28.667ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 1.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 412.584ms, non-child: 54.191ms, % non-child: 13.13%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 99.723us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 32.773us - GetNewBlockTime: 289.798us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17871648) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.575ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 616.09 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.521us EXCHANGE_NODE (id=40):(Total: 31.916ms, non-child: 22.433us, % non-child: 0.07%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 8.223us - DeserializeRowBatchTimer: 30.295us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 8.08 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 358.396ms, non-child: 50.134ms, % non-child: 13.99%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 131.008us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 33.278us - GetNewBlockTime: 265.543us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17871904) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.654ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 709.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.806us EXCHANGE_NODE (id=39):(Total: 38.659ms, non-child: 23.060us, % non-child: 0.06%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 10.340us - DeserializeRowBatchTimer: 17.320us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 9.44 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 308.273ms, non-child: 94.345ms, % non-child: 30.60%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 12.094ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.423ms - GetNewBlockTime: 254.027us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19123592) - PinTime: 0.000ns - ProbeRows: 254.30K (254296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 63.533ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 824.56 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.531us EXCHANGE_NODE (id=38):(Total: 44.363ms, non-child: 1.720ms, % non-child: 3.88%) BytesReceived(500.000ms): 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 777.342us - DeserializeRowBatchTimer: 5.291ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 618.52 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 169.570ms, non-child: 169.570ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 55 Hdfs split stats (:<# splits>/): 4:35/2.82 GB 3:32/1.94 GB 2:26/2.01 GB 7:25/1.39 GB 0:34/2.13 GB 5:33/2.25 GB 6:35/2.20 GB 1:43/3.02 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:88.89% 1:0% 2:0% 3:0% 4:11.11% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:208 PARQUET/SNAPPY:385 BytesRead(500.000ms): 263.82 MB, 622.03 MB, 622.03 MB, 843.04 MB, 880.02 MB, 880.02 MB, 880.02 MB, 880.02 MB, 880.02 MB - AverageHdfsReadThreadConcurrency: 0.44 - AverageScannerThreadConcurrency: 34.56 - BytesRead: 880.02 MB (922767484) - BytesReadDataNodeCache: 0 - BytesReadLocal: 880.02 MB (922767484) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 880.02 MB (922767484) - DecompressionTime: 10s545ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.95 GB (2095965648) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.22M (77222588) - RowsReturned: 254.30K (254296) - RowsReturnedRate: 1.50 M/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 8.87K (8869) - ScannerThreadsTotalWallClockTime: 2m38s - MaterializeTupleTime(*): 30s603ms - ScannerThreadsSysTime: 41s510ms - ScannerThreadsUserTime: 24s109ms - ScannerThreadsVoluntaryContextSwitches: 624.27K (624275) - TotalRawHdfsReadTime(*): 766.067ms - TotalReadThroughput: 195.56 MB/sec Filter 7 (1.00 MB): - Rows processed: 77.22M (77222588) - Rows rejected: 76.14M (76142102) - Rows total: 77.22M (77222588) Filter 6 (1.00 MB): - Files processed: 263 (263) - Files rejected: 208 (208) - Files total: 263 (263) - RowGroups processed: 582 (582) - RowGroups rejected: 0 (0) - RowGroups total: 582 (582) - Rows processed: 756.34K (756338) - Rows rejected: 0 (0) - Rows total: 756.36K (756358) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Filter 5 (1.00 MB): - Rows processed: 1.08M (1080486) - Rows rejected: 826.19K (826190) - Rows total: 1.08M (1080486) Instance b45ac2a82caefd3:f987ea31ef3ee9bb (host=vd1314.halxg.cloudera.com:22000):(Total: 3s241ms, non-child: 87.226ms, % non-child: 2.69%) Hdfs split stats (:<# splits>/): 0:39/3.10 GB 3:32/1.94 GB 7:31/2.26 GB 2:30/1.90 GB 5:23/1.63 GB 1:33/2.21 GB 4:38/2.80 GB 6:36/2.14 GB Filter 5 arrival: 14ms Filter 6 arrival: 15ms Filter 7 arrival: 65ms MemoryUsage(500.000ms): 26.63 MB, 1.96 GB, 1.79 GB, 1.95 GB, 1.73 GB, 1.12 GB, 111.42 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 34.43 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.06 GB (2216779096) - PerHostPeakMemUsage: 5.61 GB (6020138352) - PrepareTime: 7.220ms - RowsProduced: 122.60K (122597) - TotalCpuTime: 1m42s - TotalNetworkReceiveTime: 182.552ms - TotalNetworkSendTime: 65.132ms - TotalStorageWaitTime: 3s657ms DataStreamSender (dst_id=42):(Total: 84.961ms, non-child: 84.961ms, % non-child: 100.00%) - BytesSent: 8.94 MB (9372035) - NetworkThroughput(*): 458.13 MB/sec - OverallThroughput: 105.20 MB/sec - RowsReturned: 122.60K (122597) - SerializeBatchTime: 65.337ms - TransmitDataRPCTime: 19.509ms - UncompressedRowBatchSize: 31.34 MB (32858640) AGGREGATION_NODE (id=20):(Total: 3s069ms, non-child: 2s469ms, % non-child: 80.46%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 9.217ms - GetResultsTime: 76.151ms - HTResizeTime: 45.477ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 188.36 MB (197511784) - PinTime: 0.000ns - ReductionFactorEstimate: 61.52 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 122.60K (122597) - RowsReturnedRate: 39.95 K/sec - StreamingTime: 2s376ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 599.666ms, non-child: 157.213ms, % non-child: 26.22%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 57.056ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 19.465ms - GetNewBlockTime: 2.565ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.12 MB (168943832) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 92.930ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 429.65 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.702us EXCHANGE_NODE (id=41):(Total: 155.646ms, non-child: 9.273ms, % non-child: 5.96%) BytesReceived(500.000ms): 1.19 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 7.032ms - DeserializeRowBatchTimer: 23.070ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 1.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 411.988ms, non-child: 51.626ms, % non-child: 12.53%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 95.246us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 32.353us - GetNewBlockTime: 230.380us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.11 MB (17944536) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 41.890ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 625.37 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.524us EXCHANGE_NODE (id=40):(Total: 14.076us, non-child: 14.076us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.244us - DeserializeRowBatchTimer: 12.467us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 18.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 360.365ms, non-child: 49.059ms, % non-child: 13.61%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 130.731us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 34.426us - GetNewBlockTime: 275.451us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.11 MB (17944792) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 37.983ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 714.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.491us EXCHANGE_NODE (id=39):(Total: 33.487us, non-child: 33.487us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 24.773us - DeserializeRowBatchTimer: 16.732us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.90 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 311.307ms, non-child: 102.263ms, % non-child: 32.85%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 13.938ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.575ms - GetNewBlockTime: 369.576us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139544) - PinTime: 0.000ns - ProbeRows: 257.70K (257701) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 64.849ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 827.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.433us EXCHANGE_NODE (id=38):(Total: 35.322ms, non-child: 2.379ms, % non-child: 6.74%) BytesReceived(500.000ms): 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 881.118us - DeserializeRowBatchTimer: 5.976ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 776.83 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 173.725ms, non-child: 173.725ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 53 Hdfs split stats (:<# splits>/): 0:39/3.10 GB 3:32/1.94 GB 7:31/2.26 GB 2:30/1.90 GB 5:23/1.63 GB 1:33/2.21 GB 4:38/2.80 GB 6:36/2.14 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:209 PARQUET/SNAPPY:371 BytesRead(500.000ms): 0, 612.42 MB, 904.97 MB, 904.97 MB, 904.97 MB, 904.97 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 38.83 - BytesRead: 904.97 MB (948928325) - BytesReadDataNodeCache: 0 - BytesReadLocal: 904.97 MB (948928325) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 904.97 MB (948928325) - DecompressionTime: 5s131ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.87 GB (2013199048) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 79.52M (79522774) - RowsReturned: 257.70K (257701) - RowsReturnedRate: 1.48 M/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 6.66K (6664) - ScannerThreadsTotalWallClockTime: 1m41s - MaterializeTupleTime(*): 24s844ms - ScannerThreadsSysTime: 28s787ms - ScannerThreadsUserTime: 21s594ms - ScannerThreadsVoluntaryContextSwitches: 378.25K (378252) - TotalRawHdfsReadTime(*): 712.471ms - TotalReadThroughput: 301.66 MB/sec Filter 7 (1.00 MB): - Rows processed: 79.52M (79522774) - Rows rejected: 78.42M (78415074) - Rows total: 79.52M (79522774) Filter 6 (1.00 MB): - Files processed: 262 (262) - Files rejected: 209 (209) - Files total: 262 (262) - RowGroups processed: 592 (592) - RowGroups rejected: 0 (0) - RowGroups total: 592 (592) - Rows processed: 729.91K (729907) - Rows rejected: 0 (0) - Rows total: 729.93K (729928) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Filter 5 (1.00 MB): - Rows processed: 1.11M (1107700) - Rows rejected: 850.00K (849999) - Rows total: 1.11M (1107700) Instance b45ac2a82caefd3:f987ea31ef3ee9be (host=vd1313.halxg.cloudera.com:22000):(Total: 3s140ms, non-child: 81.510ms, % non-child: 2.60%) Hdfs split stats (:<# splits>/): 1:32/2.22 GB 6:32/2.17 GB 3:36/2.46 GB 5:44/3.22 GB 4:34/2.05 GB 0:34/2.20 GB 2:33/1.98 GB 7:23/1.59 GB Filter 5 arrival: 8ms Filter 6 arrival: 9ms Filter 7 arrival: 31ms MemoryUsage(500.000ms): 763.29 MB, 2.15 GB, 1.97 GB, 2.02 GB, 1.60 GB, 740.63 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 33.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.31 GB (2481476232) - PerHostPeakMemUsage: 6.06 GB (6510672952) - PrepareTime: 3.422ms - RowsProduced: 126.83K (126827) - TotalCpuTime: 1m40s - TotalNetworkReceiveTime: 111.759ms - TotalNetworkSendTime: 58.213ms - TotalStorageWaitTime: 4s479ms DataStreamSender (dst_id=42):(Total: 74.505ms, non-child: 74.505ms, % non-child: 100.00%) - BytesSent: 9.28 MB (9734793) - NetworkThroughput(*): 488.67 MB/sec - OverallThroughput: 124.61 MB/sec - RowsReturned: 126.83K (126827) - SerializeBatchTime: 55.371ms - TransmitDataRPCTime: 18.998ms - UncompressedRowBatchSize: 32.42 MB (33992380) AGGREGATION_NODE (id=20):(Total: 2s984ms, non-child: 2s421ms, % non-child: 81.12%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 7.831ms - GetResultsTime: 70.728ms - HTResizeTime: 52.766ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 188.98 MB (198161704) - PinTime: 0.000ns - ReductionFactorEstimate: 60.79 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 126.83K (126827) - RowsReturnedRate: 42.49 K/sec - StreamingTime: 2s330ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 563.629ms, non-child: 151.963ms, % non-child: 26.96%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 76.481ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 13.395ms - GetNewBlockTime: 2.710ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.04 MB (168858920) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 96.625ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 500.34 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.552us EXCHANGE_NODE (id=41):(Total: 108.530ms, non-child: 12.975ms, % non-child: 11.96%) BytesReceived(500.000ms): 4.42 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 8.122ms - DeserializeRowBatchTimer: 32.400ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 408.686ms, non-child: 54.623ms, % non-child: 13.37%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 69.951us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 21.006us - GetNewBlockTime: 229.406us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.03 MB (17859624) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 43.964ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 690.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 755.000ns EXCHANGE_NODE (id=40):(Total: 13.222us, non-child: 13.222us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.902us - DeserializeRowBatchTimer: 24.877us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 19.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 354.065ms, non-child: 59.723ms, % non-child: 16.87%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 117.417us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 46.366us - GetNewBlockTime: 240.143us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.03 MB (17859880) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.688ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 796.47 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.394us EXCHANGE_NODE (id=39):(Total: 16.101us, non-child: 16.101us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 10.495us - DeserializeRowBatchTimer: 13.595us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 22.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 294.345ms, non-child: 102.409ms, % non-child: 34.79%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 8.412ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.771ms - GetNewBlockTime: 512.861us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19138856) - PinTime: 0.000ns - ProbeRows: 282.13K (282130) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 66.930ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 958.07 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 731.000ns EXCHANGE_NODE (id=38):(Total: 12.205ms, non-child: 2.904ms, % non-child: 23.79%) BytesReceived(500.000ms): 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 390.374us - DeserializeRowBatchTimer: 5.997ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 2.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 179.734ms, non-child: 179.734ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 53 Hdfs split stats (:<# splits>/): 1:32/2.22 GB 6:32/2.17 GB 3:36/2.46 GB 5:44/3.22 GB 4:34/2.05 GB 0:34/2.20 GB 2:33/1.98 GB 7:23/1.59 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:0% 2:0% 3:0% 4:0% 5:16.67% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:215 PARQUET/SNAPPY:371 BytesRead(500.000ms): 375.33 MB, 693.97 MB, 979.44 MB, 979.44 MB, 979.44 MB, 979.44 MB - AverageHdfsReadThreadConcurrency: 0.83 - AverageScannerThreadConcurrency: 32.33 - BytesRead: 979.44 MB (1027020737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 979.44 MB (1027020737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 979.44 MB (1027020737) - DecompressionTime: 5s960ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 2.01 GB (2161494536) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 86.20M (86202147) - RowsReturned: 282.13K (282130) - RowsReturnedRate: 1.57 M/sec - ScanRangesComplete: 268 (268) - ScannerThreadsInvoluntaryContextSwitches: 6.36K (6355) - ScannerThreadsTotalWallClockTime: 1m40s - MaterializeTupleTime(*): 28s467ms - ScannerThreadsSysTime: 26s269ms - ScannerThreadsUserTime: 23s837ms - ScannerThreadsVoluntaryContextSwitches: 322.56K (322565) - TotalRawHdfsReadTime(*): 924.225ms - TotalReadThroughput: 326.48 MB/sec Filter 7 (1.00 MB): - Rows processed: 86.20M (86202147) - Rows rejected: 85.00M (84995305) - Rows total: 86.20M (86202147) Filter 6 (1.00 MB): - Files processed: 268 (268) - Files rejected: 215 (215) - Files total: 268 (268) - RowGroups processed: 644 (644) - RowGroups rejected: 0 (0) - RowGroups total: 644 (644) - Rows processed: 751.37K (751374) - Rows rejected: 0 (0) - Rows total: 751.40K (751399) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Filter 5 (1.00 MB): - Rows processed: 1.21M (1206842) - Rows rejected: 924.71K (924712) - Rows total: 1.21M (1206842) Instance b45ac2a82caefd3:f987ea31ef3ee9bc (host=vd1311.halxg.cloudera.com:22000):(Total: 2s984ms, non-child: 89.870ms, % non-child: 3.01%) Hdfs split stats (:<# splits>/): 1:37/2.55 GB 4:34/2.10 GB 3:31/2.30 GB 7:29/1.91 GB 2:36/2.58 GB 5:36/2.31 GB 6:36/2.37 GB 0:25/1.81 GB Filter 5 arrival: 34ms Filter 6 arrival: 43ms Filter 7 arrival: 60ms MemoryUsage(500.000ms): 686.89 MB, 1.87 GB, 1.98 GB, 1.44 GB, 829.13 MB, 165.45 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 33.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.13 GB (2283269160) - PerHostPeakMemUsage: 6.04 GB (6484792728) - PrepareTime: 5.202ms - RowsProduced: 123.47K (123467) - TotalCpuTime: 1m22s - TotalNetworkReceiveTime: 240.643ms - TotalNetworkSendTime: 34.868ms - TotalStorageWaitTime: 3s762ms DataStreamSender (dst_id=42):(Total: 103.257ms, non-child: 103.257ms, % non-child: 100.00%) - BytesSent: 9.00 MB (9436000) - NetworkThroughput(*): 574.34 MB/sec - OverallThroughput: 87.15 MB/sec - RowsReturned: 123.47K (123467) - SerializeBatchTime: 87.420ms - TransmitDataRPCTime: 15.668ms - UncompressedRowBatchSize: 31.56 MB (33091832) AGGREGATION_NODE (id=20):(Total: 2s791ms, non-child: 2s205ms, % non-child: 78.99%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 9.385ms - GetResultsTime: 94.856ms - HTResizeTime: 29.440ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 2 (2) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 189.27 MB (198468344) - PinTime: 0.000ns - ReductionFactorEstimate: 61.16 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 123.47K (123467) - RowsReturnedRate: 44.22 K/sec - StreamingTime: 2s053ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 586.466ms, non-child: 170.525ms, % non-child: 29.08%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 64.598ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 27.015ms - GetNewBlockTime: 3.970ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.33 MB (169165560) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 99.139ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 443.58 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.715us EXCHANGE_NODE (id=41):(Total: 150.673ms, non-child: 10.984ms, % non-child: 7.29%) BytesReceived(500.000ms): 3.85 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 7.766ms - DeserializeRowBatchTimer: 27.177ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 1.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 416.336ms, non-child: 55.344ms, % non-child: 13.29%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 78.491us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 30.791us - GetNewBlockTime: 252.250us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.32 MB (18166264) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.979ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 624.84 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.506us EXCHANGE_NODE (id=40):(Total: 25.740ms, non-child: 17.842us, % non-child: 0.07%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 7.567us - DeserializeRowBatchTimer: 24.784us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 10.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 360.994ms, non-child: 51.917ms, % non-child: 14.38%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 162.168us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 61.485us - GetNewBlockTime: 244.625us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.32 MB (18166520) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.961ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 720.63 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.067us EXCHANGE_NODE (id=39):(Total: 33.304ms, non-child: 19.740us, % non-child: 0.06%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 10.243us - DeserializeRowBatchTimer: 28.262us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 10.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 309.079ms, non-child: 92.628ms, % non-child: 29.97%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 10.250ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.706ms - GetNewBlockTime: 472.353us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19121912) - PinTime: 0.000ns - ProbeRows: 260.22K (260216) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 67.793ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 841.68 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.138us EXCHANGE_NODE (id=38):(Total: 39.920ms, non-child: 1.724ms, % non-child: 4.32%) BytesReceived(500.000ms): 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 669.266us - DeserializeRowBatchTimer: 5.811ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 687.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 176.534ms, non-child: 176.534ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 52 Hdfs split stats (:<# splits>/): 1:37/2.55 GB 4:34/2.10 GB 3:31/2.30 GB 7:29/1.91 GB 2:36/2.58 GB 5:36/2.31 GB 6:36/2.37 GB 0:25/1.81 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:0% 3:0% 4:20% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:212 PARQUET/SNAPPY:364 BytesRead(500.000ms): 350.48 MB, 682.26 MB, 910.21 MB, 910.21 MB, 910.21 MB - AverageHdfsReadThreadConcurrency: 0.80 - AverageScannerThreadConcurrency: 38.80 - BytesRead: 910.21 MB (954422640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 910.21 MB (954422640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 910.21 MB (954422640) - DecompressionTime: 6s855ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.87 GB (2011382360) - PerReadThreadRawHdfsThroughput: 1.16 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 80.04M (80041225) - RowsReturned: 260.22K (260216) - RowsReturnedRate: 1.47 M/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 6.33K (6327) - ScannerThreadsTotalWallClockTime: 1m22s - MaterializeTupleTime(*): 28s347ms - ScannerThreadsSysTime: 25s694ms - ScannerThreadsUserTime: 22s495ms - ScannerThreadsVoluntaryContextSwitches: 301.16K (301157) - TotalRawHdfsReadTime(*): 766.572ms - TotalReadThroughput: 364.08 MB/sec Filter 7 (1.00 MB): - Rows processed: 80.04M (80041225) - Rows rejected: 78.92M (78922489) - Rows total: 80.04M (80041225) Filter 6 (1.00 MB): - Files processed: 264 (264) - Files rejected: 212 (212) - Files total: 264 (264) - RowGroups processed: 604 (604) - RowGroups rejected: 0 (0) - RowGroups total: 604 (604) - Rows processed: 731.28K (731278) - Rows rejected: 0 (0) - Rows total: 731.30K (731301) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 5 (1.00 MB): - Rows processed: 1.12M (1118736) - Rows rejected: 858.52K (858520) - Rows total: 1.12M (1118736) Instance b45ac2a82caefd3:f987ea31ef3ee9bf (host=vd1309.halxg.cloudera.com:22000):(Total: 2s844ms, non-child: 89.735ms, % non-child: 3.15%) Hdfs split stats (:<# splits>/): 6:29/1.84 GB 4:29/1.92 GB 7:29/2.11 GB 2:34/2.06 GB 1:33/2.30 GB 0:37/2.13 GB 5:38/3.00 GB 3:41/2.53 GB Filter 5 arrival: 12ms Filter 6 arrival: 15ms Filter 7 arrival: 29ms MemoryUsage(500.000ms): 1.32 GB, 1.82 GB, 1.93 GB, 1.52 GB, 887.83 MB, 35.78 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 33.50 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.13 GB (2290258696) - PerHostPeakMemUsage: 5.41 GB (5806841432) - PrepareTime: 5.914ms - RowsProduced: 121.00K (121003) - TotalCpuTime: 1m27s - TotalNetworkReceiveTime: 96.674ms - TotalNetworkSendTime: 55.588ms - TotalStorageWaitTime: 2s703ms DataStreamSender (dst_id=42):(Total: 84.985ms, non-child: 84.985ms, % non-child: 100.00%) - BytesSent: 8.81 MB (9233790) - NetworkThroughput(*): 465.02 MB/sec - OverallThroughput: 103.62 MB/sec - RowsReturned: 121.00K (121003) - SerializeBatchTime: 65.922ms - TransmitDataRPCTime: 18.936ms - UncompressedRowBatchSize: 30.93 MB (32431424) AGGREGATION_NODE (id=20):(Total: 2s670ms, non-child: 2s127ms, % non-child: 79.69%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 6.918ms - GetResultsTime: 74.470ms - HTResizeTime: 20.287ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 187.16 MB (196255632) - PinTime: 0.000ns - ReductionFactorEstimate: 60.38 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 121.00K (121003) - RowsReturnedRate: 45.31 K/sec - StreamingTime: 2s031ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 542.266ms, non-child: 162.045ms, % non-child: 29.88%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 67.529ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 18.123ms - GetNewBlockTime: 1.488ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.04 MB (168862552) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 100.637ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 456.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.849us EXCHANGE_NODE (id=41):(Total: 105.308ms, non-child: 13.279ms, % non-child: 12.61%) BytesReceived(500.000ms): 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 8.221ms - DeserializeRowBatchTimer: 27.797ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 2.85 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 363.596ms, non-child: 52.689ms, % non-child: 14.49%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 71.117us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 51.251us - GetNewBlockTime: 935.459us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17863256) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.878ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 680.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.041us EXCHANGE_NODE (id=40):(Total: 21.065us, non-child: 21.065us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 12.098us - DeserializeRowBatchTimer: 63.695us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 12.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 310.911ms, non-child: 42.487ms, % non-child: 13.67%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 95.651us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 48.826us - GetNewBlockTime: 1.500ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17863512) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 36.591ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 795.80 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.659us EXCHANGE_NODE (id=39):(Total: 19.585us, non-child: 19.585us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 10.461us - DeserializeRowBatchTimer: 40.687us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 18.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 268.427ms, non-child: 97.985ms, % non-child: 36.50%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 12.096ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.066ms - GetNewBlockTime: 1.445ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19125880) - PinTime: 0.000ns - ProbeRows: 247.52K (247523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 61.003ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 921.75 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.924us EXCHANGE_NODE (id=38):(Total: 871.112us, non-child: 871.112us, % non-child: 100.00%) BytesReceived(500.000ms): 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 703.614us - DeserializeRowBatchTimer: 7.233ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 31.50 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 169.575ms, non-child: 169.575ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 52 Hdfs split stats (:<# splits>/): 6:29/1.84 GB 4:29/1.92 GB 7:29/2.11 GB 2:34/2.06 GB 1:33/2.30 GB 0:37/2.13 GB 5:38/3.00 GB 3:41/2.53 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:20% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:218 PARQUET/SNAPPY:364 BytesRead(500.000ms): 583.42 MB, 747.68 MB, 863.10 MB, 863.10 MB, 863.10 MB - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 863.10 MB (905023870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 863.10 MB (905023870) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 863.10 MB (905023870) - DecompressionTime: 4s541ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.94 GB (2086637744) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.79M (75793861) - RowsReturned: 247.52K (247523) - RowsReturnedRate: 1.46 M/sec - ScanRangesComplete: 270 (270) - ScannerThreadsInvoluntaryContextSwitches: 6.42K (6425) - ScannerThreadsTotalWallClockTime: 1m27s - MaterializeTupleTime(*): 22s942ms - ScannerThreadsSysTime: 25s458ms - ScannerThreadsUserTime: 20s897ms - ScannerThreadsVoluntaryContextSwitches: 295.88K (295882) - TotalRawHdfsReadTime(*): 717.739ms - TotalReadThroughput: 345.24 MB/sec Filter 7 (1.00 MB): - Rows processed: 75.79M (75793861) - Rows rejected: 74.74M (74736321) - Rows total: 75.79M (75793861) Filter 6 (1.00 MB): - Files processed: 270 (270) - Files rejected: 218 (218) - Files total: 270 (270) - RowGroups processed: 569 (569) - RowGroups rejected: 0 (0) - RowGroups total: 569 (569) - Rows processed: 723.45K (723449) - Rows rejected: 0 (0) - Rows total: 723.47K (723470) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 5 (1.00 MB): - Rows processed: 1.06M (1057540) - Rows rejected: 810.02K (810017) - Rows total: 1.06M (1057540) Instance b45ac2a82caefd3:f987ea31ef3ee9ba (host=vd1316.halxg.cloudera.com:22000):(Total: 2s542ms, non-child: 91.751ms, % non-child: 3.61%) Hdfs split stats (:<# splits>/): 4:32/2.01 GB 7:34/2.53 GB 2:35/2.87 GB 0:30/1.93 GB 6:27/1.56 GB 1:35/2.61 GB 3:30/1.86 GB 5:33/2.53 GB Filter 5 arrival: 8ms Filter 6 arrival: 12ms Filter 7 arrival: 70ms MemoryUsage(500.000ms): 1.43 GB, 1.84 GB, 1.79 GB, 1.22 GB, 344.03 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 1 - AverageThreadTokens: 32.20 - BloomFilterBytes: 3.00 MB (3145728) - PeakMemoryUsage: 2.11 GB (2270256480) - PerHostPeakMemUsage: 5.19 GB (5575694536) - PrepareTime: 2.432ms - RowsProduced: 118.74K (118742) - TotalCpuTime: 1m11s - TotalNetworkReceiveTime: 186.910ms - TotalNetworkSendTime: 68.043ms - TotalStorageWaitTime: 4s154ms DataStreamSender (dst_id=42):(Total: 72.931ms, non-child: 72.931ms, % non-child: 100.00%) - BytesSent: 8.62 MB (9038569) - NetworkThroughput(*): 484.56 MB/sec - OverallThroughput: 118.19 MB/sec - RowsReturned: 118.74K (118742) - SerializeBatchTime: 55.040ms - TransmitDataRPCTime: 17.789ms - UncompressedRowBatchSize: 30.35 MB (31825420) AGGREGATION_NODE (id=20):(Total: 2s377ms, non-child: 1s840ms, % non-child: 77.40%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 4.165ms - GetResultsTime: 59.260ms - HTResizeTime: 25.506ms - HashBuckets: 262.14K (262144) - LargestPartitionPercent: 3 (3) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 187.69 MB (196810088) - PinTime: 0.000ns - ReductionFactorEstimate: 61.20 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 118.74K (118742) - RowsReturnedRate: 49.94 K/sec - StreamingTime: 1s762ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=19):(Total: 537.386ms, non-child: 141.666ms, % non-child: 26.36%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously - BuildPartitionTime: 65.906ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 16.588ms - GetNewBlockTime: 7.753ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.75 MB (167507304) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 83.236ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 435.98 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.543us EXCHANGE_NODE (id=41):(Total: 155.465ms, non-child: 11.898ms, % non-child: 7.65%) BytesReceived(500.000ms): 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713311) - ConvertRowBatchTime: 7.736ms - DeserializeRowBatchTimer: 23.996ms - FirstBatchArrivalWaitTime: 3.008ms - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 1.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=18):(Total: 359.193ms, non-child: 47.238ms, % non-child: 13.15%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 152.713us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 59.754us - GetNewBlockTime: 280.966us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.74 MB (16508008) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 36.423ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 652.26 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.592us EXCHANGE_NODE (id=40):(Total: 17.775us, non-child: 17.775us, % non-child: 100.00%) BytesReceived(500.000ms): 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB, 5.61 KB - BytesReceived: 5.61 KB (5748) - ConvertRowBatchTime: 8.797us - DeserializeRowBatchTimer: 23.644us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 14.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=17):(Total: 311.957ms, non-child: 47.812ms, % non-child: 15.33%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 130.768us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 42.138us - GetNewBlockTime: 3.085ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.74 MB (16508264) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 33.124ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 751.03 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.696us EXCHANGE_NODE (id=39):(Total: 21.854us, non-child: 21.854us, % non-child: 100.00%) BytesReceived(500.000ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 11.296us - DeserializeRowBatchTimer: 13.978us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 16.70 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=16):(Total: 264.150ms, non-child: 94.889ms, % non-child: 35.92%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 15.534ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 3.626ms - GetNewBlockTime: 4.988ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.23 MB (19120400) - PinTime: 0.000ns - ProbeRows: 234.39K (234393) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 55.557ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 886.95 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.796us EXCHANGE_NODE (id=38):(Total: 40.465ms, non-child: 2.679ms, % non-child: 6.62%) BytesReceived(500.000ms): 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB, 727.96 KB - BytesReceived: 727.96 KB (745428) - ConvertRowBatchTime: 755.760us - DeserializeRowBatchTimer: 7.251ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 678.11 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=11):(Total: 128.798ms, non-child: 128.798ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 4:32/2.01 GB 7:34/2.53 GB 2:35/2.87 GB 0:30/1.93 GB 6:27/1.56 GB 1:35/2.61 GB 3:30/1.86 GB 5:33/2.53 GB Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:20% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:211 PARQUET/SNAPPY:315 BytesRead(500.000ms): 613.13 MB, 815.12 MB, 815.12 MB, 815.12 MB, 815.12 MB - AverageHdfsReadThreadConcurrency: 0.40 - AverageScannerThreadConcurrency: 31.20 - BytesRead: 815.12 MB (854713494) - BytesReadDataNodeCache: 0 - BytesReadLocal: 815.12 MB (854713494) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 815.12 MB (854713494) - DecompressionTime: 3s737ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.93 GB (2075017392) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 71.72M (71721657) - RowsReturned: 234.39K (234393) - RowsReturnedRate: 1.82 M/sec - ScanRangesComplete: 256 (256) - ScannerThreadsInvoluntaryContextSwitches: 5.08K (5075) - ScannerThreadsTotalWallClockTime: 1m10s - MaterializeTupleTime(*): 19s777ms - ScannerThreadsSysTime: 21s664ms - ScannerThreadsUserTime: 18s378ms - ScannerThreadsVoluntaryContextSwitches: 240.93K (240931) - TotalRawHdfsReadTime(*): 659.425ms - TotalReadThroughput: 326.05 MB/sec Filter 7 (1.00 MB): - Rows processed: 71.72M (71721657) - Rows rejected: 70.72M (70719551) - Rows total: 71.72M (71721657) Filter 6 (1.00 MB): - Files processed: 256 (256) - Files rejected: 211 (211) - Files total: 256 (256) - RowGroups processed: 539 (539) - RowGroups rejected: 0 (0) - RowGroups total: 539 (539) - Rows processed: 635.25K (635247) - Rows rejected: 0 (0) - Rows total: 635.27K (635268) - Splits processed: 45 (45) - Splits rejected: 0 (0) - Splits total: 45 (45) Filter 5 (1.00 MB): - Rows processed: 1.00M (1002106) - Rows rejected: 767.71K (767713) - Rows total: 1.00M (1002106) Fragment F10: Instance b45ac2a82caefd3:f987ea31ef3ee9c0 (host=vd1309.halxg.cloudera.com:22000):(Total: 240.154ms, non-child: 110.943ms, % non-child: 46.20%) Hdfs split stats (:<# splits>/): 7:1/27.40 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 15.87 MB (16643160) - PerHostPeakMemUsage: 1.92 GB (2058399872) - PrepareTime: 108.789us - RowsProduced: 300.00K (300000) - TotalCpuTime: 273.649ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 116.207ms - TotalStorageWaitTime: 3.975ms DataStreamSender (dst_id=41):(Total: 108.750ms, non-child: 108.750ms, % non-child: 100.00%) - BytesSent: 31.46 MB (32993177) - NetworkThroughput(*): 732.69 MB/sec - OverallThroughput: 289.33 MB/sec - RowsReturned: 300.00K (300000) - SerializeBatchTime: 65.697ms - TransmitDataRPCTime: 42.943ms - UncompressedRowBatchSize: 104.15 MB (109208204) HDFS_SCAN_NODE (id=15):(Total: 20.460ms, non-child: 20.460ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/27.40 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.30 MB (2408738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.30 MB (2408738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.30 MB (2408738) - DecompressionTime: 21.715ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.84 MB (16606296) - PerReadThreadRawHdfsThroughput: 1018.92 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 300.00K (300000) - RowsReturnedRate: 14.66 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 26 (26) - ScannerThreadsTotalWallClockTime: 150.700ms - MaterializeTupleTime(*): 24.839ms - ScannerThreadsSysTime: 14.997ms - ScannerThreadsUserTime: 35.994ms - ScannerThreadsVoluntaryContextSwitches: 370 (370) - TotalRawHdfsReadTime(*): 2.254ms - TotalReadThroughput: 0.00 /sec Fragment F09: Instance b45ac2a82caefd3:f987ea31ef3ee9c1 (host=vd1314.halxg.cloudera.com:22000):(Total: 63.954ms, non-child: 60.117ms, % non-child: 94.00%) Hdfs split stats (:<# splits>/): 1:1/87.37 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 197.30 KB (202032) - PerHostPeakMemUsage: 209.23 MB (219392528) - PrepareTime: 243.915us - RowsProduced: 258 (258) - TotalCpuTime: 10.798ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.259ms - TotalStorageWaitTime: 1.985ms DataStreamSender (dst_id=40):(Total: 305.529us, non-child: 305.529us, % non-child: 100.00%) - BytesSent: 39.29 KB (40236) - NetworkThroughput(*): 220.06 MB/sec - OverallThroughput: 125.59 MB/sec - RowsReturned: 258 (258) - SerializeBatchTime: 86.619us - TransmitDataRPCTime: 174.370us - UncompressedRowBatchSize: 52.94 KB (54208) HDFS_SCAN_NODE (id=14):(Total: 3.531ms, non-child: 3.531ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/87.37 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 93.34 KB (95579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.34 KB (95579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.34 KB (95579) - DecompressionTime: 4.561us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 152.00 KB (155648) - PerReadThreadRawHdfsThroughput: 1.62 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 258 (258) - RowsReturnedRate: 73.05 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2.997ms - MaterializeTupleTime(*): 87.985us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 4 (4) - TotalRawHdfsReadTime(*): 54.998us - TotalReadThroughput: 0.00 /sec Fragment F08: Instance b45ac2a82caefd3:f987ea31ef3ee9c2 (host=vd1314.halxg.cloudera.com:22000):(Total: 64.555ms, non-child: 49.960ms, % non-child: 77.39%) Hdfs split stats (:<# splits>/): 6:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.15 MB (2252432) - PerHostPeakMemUsage: 216.83 MB (227360168) - PrepareTime: 119.792us - RowsProduced: 365 (365) - TotalCpuTime: 32.860ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 45.994ms - TotalStorageWaitTime: 3.306ms DataStreamSender (dst_id=39):(Total: 240.557us, non-child: 240.557us, % non-child: 100.00%) - BytesSent: 20.10 KB (20587) - NetworkThroughput(*): 203.30 MB/sec - OverallThroughput: 81.62 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 60.045us - TransmitDataRPCTime: 96.572us - UncompressedRowBatchSize: 39.95 KB (40908) HDFS_SCAN_NODE (id=13):(Total: 14.353ms, non-child: 14.353ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/2.15 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 179.484us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.07 MB (2167800) - PerReadThreadRawHdfsThroughput: 852.33 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 25.43 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 14 (14) - ScannerThreadsTotalWallClockTime: 14.123ms - MaterializeTupleTime(*): 8.921ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 9.998ms - ScannerThreadsVoluntaryContextSwitches: 10 (10) - TotalRawHdfsReadTime(*): 533.029us - TotalReadThroughput: 0.00 /sec Fragment F07: Instance b45ac2a82caefd3:f987ea31ef3ee9c7 (host=vd1316.halxg.cloudera.com:22000):(Total: 75.682ms, non-child: 39.147ms, % non-child: 51.73%) Hdfs split stats (:<# splits>/): 7:1/1.14 MB 6:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.53 MB (33060760) - PerHostPeakMemUsage: 320.74 MB (336323624) - PrepareTime: 169.378us - RowsProduced: 7.83K (7829) - TotalCpuTime: 164.295ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 27.481ms - TotalStorageWaitTime: 10.853ms DataStreamSender (dst_id=38):(Total: 5.717ms, non-child: 5.717ms, % non-child: 100.00%) - BytesSent: 1.41 MB (1480857) - NetworkThroughput(*): 904.70 MB/sec - OverallThroughput: 247.01 MB/sec - RowsReturned: 7.83K (7829) - SerializeBatchTime: 4.082ms - TransmitDataRPCTime: 1.561ms - UncompressedRowBatchSize: 3.71 MB (3891237) HDFS_SCAN_NODE (id=12):(Total: 30.817ms, non-child: 30.817ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 7:1/1.14 MB 6:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.46 MB (2581384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.46 MB (2581384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.46 MB (2581384) - DecompressionTime: 2.583ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 27.59 MB (28933832) - PerReadThreadRawHdfsThroughput: 1.85 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 547.43K (547428) - RowsReturned: 7.83K (7829) - RowsReturnedRate: 254.04 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 31 (31) - ScannerThreadsTotalWallClockTime: 125.165ms - MaterializeTupleTime(*): 106.889ms - ScannerThreadsSysTime: 16.996ms - ScannerThreadsUserTime: 90.986ms - ScannerThreadsVoluntaryContextSwitches: 141 (141) - TotalRawHdfsReadTime(*): 1.302ms - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9c6 (host=vd1314.halxg.cloudera.com:22000):(Total: 75.187ms, non-child: 21.252ms, % non-child: 28.27%) Hdfs split stats (:<# splits>/): 6:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 11.05 MB (11583328) - PerHostPeakMemUsage: 344.94 MB (361699344) - PrepareTime: 150.226us - RowsProduced: 3.91K (3907) - TotalCpuTime: 129.505ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 13.928ms - TotalStorageWaitTime: 4.057ms DataStreamSender (dst_id=38):(Total: 2.538ms, non-child: 2.538ms, % non-child: 100.00%) - BytesSent: 731.04 KB (748580) - NetworkThroughput(*): 886.20 MB/sec - OverallThroughput: 281.18 MB/sec - RowsReturned: 3.91K (3907) - SerializeBatchTime: 1.671ms - TransmitDataRPCTime: 805.573us - UncompressedRowBatchSize: 1.85 MB (1941891) HDFS_SCAN_NODE (id=12):(Total: 51.395ms, non-child: 51.395ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290406) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290406) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290406) - DecompressionTime: 1.147ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 7.05 MB (7397208) - PerReadThreadRawHdfsThroughput: 2.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3907) - RowsReturnedRate: 76.02 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 25 (25) - ScannerThreadsTotalWallClockTime: 70.090ms - MaterializeTupleTime(*): 60.615ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 48.992ms - ScannerThreadsVoluntaryContextSwitches: 59 (59) - TotalRawHdfsReadTime(*): 524.552us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9c4 (host=vd1309.halxg.cloudera.com:22000):(Total: 73.783ms, non-child: 23.833ms, % non-child: 32.30%) Hdfs split stats (:<# splits>/): 2:1/1.16 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.27 MB (12864632) - PerHostPeakMemUsage: 411.51 MB (431501008) - PrepareTime: 619.556us - RowsProduced: 3.98K (3980) - TotalCpuTime: 128.013ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 12.453ms - TotalStorageWaitTime: 4.380ms DataStreamSender (dst_id=38):(Total: 2.518ms, non-child: 2.518ms, % non-child: 100.00%) - BytesSent: 737.99 KB (755706) - NetworkThroughput(*): 1.04 GB/sec - OverallThroughput: 286.19 MB/sec - RowsReturned: 3.98K (3980) - SerializeBatchTime: 1.746ms - TransmitDataRPCTime: 678.007us - UncompressedRowBatchSize: 1.89 MB (1978172) HDFS_SCAN_NODE (id=12):(Total: 47.431ms, non-child: 47.431ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/1.16 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.25 MB (1310109) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.25 MB (1310109) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.25 MB (1310109) - DecompressionTime: 1.278ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.05 MB (8440944) - PerReadThreadRawHdfsThroughput: 2.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 278.52K (278516) - RowsReturned: 3.98K (3980) - RowsReturnedRate: 83.91 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 38 (38) - ScannerThreadsTotalWallClockTime: 64.076ms - MaterializeTupleTime(*): 55.896ms - ScannerThreadsSysTime: 6.998ms - ScannerThreadsUserTime: 48.992ms - ScannerThreadsVoluntaryContextSwitches: 71 (71) - TotalRawHdfsReadTime(*): 577.878us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9c8 (host=vd1311.halxg.cloudera.com:22000):(Total: 70.863ms, non-child: 28.178ms, % non-child: 39.76%) Hdfs split stats (:<# splits>/): 1:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.93 MB (13557512) - PerHostPeakMemUsage: 273.24 MB (286513976) - PrepareTime: 278.995us - RowsProduced: 3.91K (3908) - TotalCpuTime: 112.766ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 19.703ms - TotalStorageWaitTime: 5.606ms DataStreamSender (dst_id=38):(Total: 2.794ms, non-child: 2.794ms, % non-child: 100.00%) - BytesSent: 729.09 KB (746585) - NetworkThroughput(*): 824.91 MB/sec - OverallThroughput: 254.76 MB/sec - RowsReturned: 3.91K (3908) - SerializeBatchTime: 1.859ms - TransmitDataRPCTime: 863.121us - UncompressedRowBatchSize: 1.85 MB (1942388) HDFS_SCAN_NODE (id=12):(Total: 39.890ms, non-child: 39.890ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290724) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290724) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290724) - DecompressionTime: 1.220ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.71 MB (9133824) - PerReadThreadRawHdfsThroughput: 1.80 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3908) - RowsReturnedRate: 97.97 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 18 (18) - ScannerThreadsTotalWallClockTime: 65.109ms - MaterializeTupleTime(*): 56.451ms - ScannerThreadsSysTime: 9.998ms - ScannerThreadsUserTime: 47.992ms - ScannerThreadsVoluntaryContextSwitches: 57 (57) - TotalRawHdfsReadTime(*): 666.154us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9c3 (host=vd1310.halxg.cloudera.com:22000):(Total: 69.595ms, non-child: 42.024ms, % non-child: 60.38%) Hdfs split stats (:<# splits>/): 0:1/1.14 MB MemoryUsage(500.000ms): 12.63 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311608) - PerHostPeakMemUsage: 226.02 MB (237001600) - PrepareTime: 163.456us - RowsProduced: 3.91K (3911) - TotalCpuTime: 78.667ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33.975ms - TotalStorageWaitTime: 3.799ms DataStreamSender (dst_id=38):(Total: 2.516ms, non-child: 2.516ms, % non-child: 100.00%) - BytesSent: 723.21 KB (740565) - NetworkThroughput(*): 819.34 MB/sec - OverallThroughput: 280.66 MB/sec - RowsReturned: 3.91K (3911) - SerializeBatchTime: 1.608ms - TransmitDataRPCTime: 861.981us - UncompressedRowBatchSize: 1.85 MB (1943879) HDFS_SCAN_NODE (id=12):(Total: 25.053ms, non-child: 25.053ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 1.23 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290670) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290670) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290670) - DecompressionTime: 919.406us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.44 MB (10945264) - PerReadThreadRawHdfsThroughput: 2.82 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3911) - RowsReturnedRate: 156.10 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 13 (13) - ScannerThreadsTotalWallClockTime: 44.807ms - MaterializeTupleTime(*): 37.616ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 30.995ms - ScannerThreadsVoluntaryContextSwitches: 58 (58) - TotalRawHdfsReadTime(*): 425.724us - TotalReadThroughput: 2.46 MB/sec Instance b45ac2a82caefd3:f987ea31ef3ee9c5 (host=vd1313.halxg.cloudera.com:22000):(Total: 65.272ms, non-child: 36.313ms, % non-child: 55.63%) Hdfs split stats (:<# splits>/): 4:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311640) - PerHostPeakMemUsage: 255.56 MB (267972368) - PrepareTime: 174.782us - RowsProduced: 3.90K (3905) - TotalCpuTime: 83.654ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 26.640ms - TotalStorageWaitTime: 6.540ms DataStreamSender (dst_id=38):(Total: 2.978ms, non-child: 2.978ms, % non-child: 100.00%) - BytesSent: 728.23 KB (745703) - NetworkThroughput(*): 919.72 MB/sec - OverallThroughput: 238.79 MB/sec - RowsReturned: 3.90K (3905) - SerializeBatchTime: 2.146ms - TransmitDataRPCTime: 773.234us - UncompressedRowBatchSize: 1.85 MB (1940897) HDFS_SCAN_NODE (id=12):(Total: 25.981ms, non-child: 25.981ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290957) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290957) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290957) - DecompressionTime: 988.860us - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.38 MB (10887952) - PerReadThreadRawHdfsThroughput: 1.74 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.90K (3905) - RowsReturnedRate: 150.30 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 46.513ms - MaterializeTupleTime(*): 37.570ms - ScannerThreadsSysTime: 11.998ms - ScannerThreadsUserTime: 26.995ms - ScannerThreadsVoluntaryContextSwitches: 49 (49) - TotalRawHdfsReadTime(*): 691.475us - TotalReadThroughput: 0.00 /sec Fragment F00: Instance b45ac2a82caefd3:f987ea31ef3ee9c9 (host=vd1310.halxg.cloudera.com:22000):(Total: 4s366ms, non-child: 179.393ms, % non-child: 4.11%) Hdfs split stats (:<# splits>/): 2:26/1.74 GB 3:28/2.20 GB 1:36/2.51 GB 4:33/2.24 GB 7:34/2.20 GB 6:37/2.57 GB 0:37/2.58 GB 5:28/1.87 GB Filter 1 arrival: 13ms Filter 2 arrival: 18ms Filter 3 arrival: 39ms Filter 0 arrival: 192ms MemoryUsage(500.000ms): 0, 1.22 GB, 1.91 GB, 2.20 GB, 1.40 GB, 910.20 MB, 439.97 MB, 408.97 MB, 91.65 MB ThreadUsage(500.000ms): 1, 40, 40, 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 31.33 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.24 GB (2401227408) - PerHostPeakMemUsage: 6.34 GB (6806403240) - PrepareTime: 3.104ms - RowsProduced: 208.85K (208848) - TotalCpuTime: 2m13s - TotalNetworkReceiveTime: 66.058ms - TotalNetworkSendTime: 18.966ms - TotalStorageWaitTime: 4s835ms DataStreamSender (dst_id=36):(Total: 198.223ms, non-child: 198.223ms, % non-child: 100.00%) - BytesSent: 17.00 MB (17823674) - NetworkThroughput(*): 566.44 MB/sec - OverallThroughput: 85.75 MB/sec - RowsReturned: 208.85K (208848) - SerializeBatchTime: 167.905ms - TransmitDataRPCTime: 30.008ms - UncompressedRowBatchSize: 56.97 MB (59735864) AGGREGATION_NODE (id=10):(Total: 3s988ms, non-child: 2s417ms, % non-child: 60.62%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 1.447ms - GetResultsTime: 256.690ms - HTResizeTime: 66.071ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 210.31 MB (220530392) - PinTime: 0.000ns - ReductionFactorEstimate: 14.48 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 208.85K (208848) - RowsReturnedRate: 52.36 K/sec - StreamingTime: 2s072ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 1s570ms, non-child: 115.093ms, % non-child: 7.33%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 117.582ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 25.004ms - GetNewBlockTime: 1.905ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.13 MB (168956624) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 104.232ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 162.66 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.193us EXCHANGE_NODE (id=35):(Total: 62.717ms, non-child: 14.128ms, % non-child: 22.53%) BytesReceived(500.000ms): 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 9.391ms - DeserializeRowBatchTimer: 24.509ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 4.78 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 1s456ms, non-child: 69.265ms, % non-child: 4.76%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 115.783us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 51.938us - GetNewBlockTime: 305.450us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.13 MB (17957328) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 52.053ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 175.48 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.792us EXCHANGE_NODE (id=34):(Total: 22.782us, non-child: 22.782us, % non-child: 100.00%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 12.622us - DeserializeRowBatchTimer: 27.413us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 11.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 1s386ms, non-child: 60.880ms, % non-child: 4.39%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 128.657us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 41.047us - GetNewBlockTime: 395.622us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.13 MB (17957584) - PinTime: 0.000ns - ProbeRows: 255.53K (255528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 48.522ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 184.24 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.621us EXCHANGE_NODE (id=33):(Total: 4.017ms, non-child: 24.743us, % non-child: 0.62%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 10.661us - DeserializeRowBatchTimer: 37.764us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 90.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 1s326ms, non-child: 114.700ms, % non-child: 8.65%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 13.394ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 3.140ms - GetNewBlockTime: 498.029us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139208) - PinTime: 0.000ns - ProbeRows: 255.72K (255716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 72.036ms - RowsReturned: 255.53K (255528) - RowsReturnedRate: 192.70 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.607us EXCHANGE_NODE (id=32):(Total: 10.133ms, non-child: 1.340ms, % non-child: 13.22%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 794.198us - DeserializeRowBatchTimer: 5.264ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 2.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 1s201ms, non-child: 1s201ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 54 Hdfs split stats (:<# splits>/): 2:26/1.74 GB 3:28/2.20 GB 1:36/2.51 GB 4:33/2.24 GB 7:34/2.20 GB 6:37/2.57 GB 0:37/2.58 GB 5:28/1.87 GB Runtime filters: All filters arrived. Waited 161ms Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:205 PARQUET/SNAPPY:378 BytesRead(500.000ms): 660.81 MB, 833.27 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB, 906.08 MB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 906.08 MB (950095129) - BytesReadDataNodeCache: 0 - BytesReadLocal: 906.08 MB (950095129) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 906.08 MB (950095129) - DecompressionTime: 7s345ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 54 (54) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.90 GB (2042355888) - PerReadThreadRawHdfsThroughput: 833.65 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 79.60M (79595827) - RowsReturned: 255.72K (255716) - RowsReturnedRate: 212.88 K/sec - ScanRangesComplete: 259 (259) - ScannerThreadsInvoluntaryContextSwitches: 10.71K (10706) - ScannerThreadsTotalWallClockTime: 2m12s - MaterializeTupleTime(*): 30s215ms - ScannerThreadsSysTime: 1m2s - ScannerThreadsUserTime: 24s625ms - ScannerThreadsVoluntaryContextSwitches: 487.91K (487908) - TotalRawHdfsReadTime(*): 1s086ms - TotalReadThroughput: 258.88 MB/sec Filter 3 (1.00 MB): - Rows processed: 79.60M (79595827) - Rows rejected: 78.49M (78485147) - Rows total: 79.60M (79595827) Filter 2 (1.00 MB): - Files processed: 259 (259) - Files rejected: 205 (205) - Files total: 259 (259) - RowGroups processed: 600 (600) - RowGroups rejected: 0 (0) - RowGroups total: 600 (600) - Rows processed: 750.70K (750700) - Rows rejected: 0 (0) - Rows total: 750.72K (750722) - Splits processed: 54 (54) - Splits rejected: 0 (0) - Splits total: 54 (54) Filter 1 (1.00 MB): - Rows processed: 1.11M (1110680) - Rows rejected: 854.96K (854964) - Rows total: 1.11M (1110680) Filter 0 (1.00 MB): - Rows processed: 255.72K (255716) - Rows rejected: 0 (0) - Rows total: 255.72K (255716) Instance b45ac2a82caefd3:f987ea31ef3ee9cc (host=vd1311.halxg.cloudera.com:22000):(Total: 3s515ms, non-child: 155.223ms, % non-child: 4.42%) Hdfs split stats (:<# splits>/): 1:37/2.55 GB 4:34/2.10 GB 3:31/2.30 GB 7:29/1.91 GB 2:36/2.58 GB 5:36/2.31 GB 6:36/2.37 GB 0:25/1.81 GB Filter 2 arrival: 17ms Filter 1 arrival: 17ms Filter 3 arrival: 37ms Filter 0 arrival: 192ms MemoryUsage(500.000ms): 155.59 MB, 1.59 GB, 2.07 GB, 1.89 GB, 1.30 GB, 803.94 MB, 174.03 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 1, 1 - AverageThreadTokens: 28.86 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.19 GB (2353827672) - PerHostPeakMemUsage: 6.04 GB (6484792728) - PrepareTime: 2.174ms - RowsProduced: 212.03K (212030) - TotalCpuTime: 1m38s - TotalNetworkReceiveTime: 108.006ms - TotalNetworkSendTime: 68.572ms - TotalStorageWaitTime: 5s180ms DataStreamSender (dst_id=36):(Total: 176.687ms, non-child: 176.687ms, % non-child: 100.00%) - BytesSent: 17.27 MB (18103780) - NetworkThroughput(*): 607.71 MB/sec - OverallThroughput: 97.72 MB/sec - RowsReturned: 212.03K (212030) - SerializeBatchTime: 148.029ms - TransmitDataRPCTime: 28.410ms - UncompressedRowBatchSize: 57.84 MB (60645992) AGGREGATION_NODE (id=10):(Total: 3s183ms, non-child: 2s423ms, % non-child: 76.13%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 2.085ms - GetResultsTime: 165.223ms - HTResizeTime: 50.396ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 217.25 MB (227800216) - PinTime: 0.000ns - ReductionFactorEstimate: 14.41 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 212.03K (212030) - RowsReturnedRate: 66.61 K/sec - StreamingTime: 2s206ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 759.807ms, non-child: 127.174ms, % non-child: 16.74%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 98.791ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 27.788ms - GetNewBlockTime: 1.565ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 159.25 MB (166990248) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 100.714ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 342.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.201us EXCHANGE_NODE (id=35):(Total: 85.344ms, non-child: 12.646ms, % non-child: 14.82%) BytesReceived(500.000ms): 3.56 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 8.490ms - DeserializeRowBatchTimer: 27.153ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 3.52 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 632.949ms, non-child: 53.276ms, % non-child: 8.42%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 123.033us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 51.360us - GetNewBlockTime: 267.709us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.25 MB (15990952) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.339ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 411.00 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.525us EXCHANGE_NODE (id=34):(Total: 9.269ms, non-child: 19.341us, % non-child: 0.21%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 7.537us - DeserializeRowBatchTimer: 25.682us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 27.83 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 579.676ms, non-child: 51.843ms, % non-child: 8.94%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 96.876us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 33.065us - GetNewBlockTime: 298.773us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 15.25 MB (15991208) - PinTime: 0.000ns - ProbeRows: 260.14K (260145) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 40.381ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 448.78 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.876us EXCHANGE_NODE (id=33):(Total: 8.029ms, non-child: 22.725us, % non-child: 0.28%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 9.866us - DeserializeRowBatchTimer: 19.458us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 45.45 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 527.835ms, non-child: 96.572ms, % non-child: 18.30%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 12.144ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 973.101us - GetNewBlockTime: 894.044us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19121912) - PinTime: 0.000ns - ProbeRows: 260.22K (260216) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 66.807ms - RowsReturned: 260.14K (260145) - RowsReturnedRate: 492.85 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.586us EXCHANGE_NODE (id=32):(Total: 15.279ms, non-child: 1.101ms, % non-child: 7.21%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 815.837us - DeserializeRowBatchTimer: 5.600ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 1.80 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 415.987ms, non-child: 415.987ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 52 Hdfs split stats (:<# splits>/): 1:37/2.55 GB 4:34/2.10 GB 3:31/2.30 GB 7:29/1.91 GB 2:36/2.58 GB 5:36/2.31 GB 6:36/2.37 GB 0:25/1.81 GB Runtime filters: All filters arrived. Waited 161ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:212 PARQUET/SNAPPY:364 BytesRead(500.000ms): 0, 695.89 MB, 910.21 MB, 910.21 MB, 910.21 MB, 910.21 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.33 - BytesRead: 910.21 MB (954422640) - BytesReadDataNodeCache: 0 - BytesReadLocal: 910.21 MB (954422640) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 910.21 MB (954422640) - DecompressionTime: 5s469ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.95 GB (2094653272) - PerReadThreadRawHdfsThroughput: 828.22 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 80.04M (80041225) - RowsReturned: 260.22K (260216) - RowsReturnedRate: 625.54 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 6.10K (6098) - ScannerThreadsTotalWallClockTime: 1m37s - MaterializeTupleTime(*): 23s851ms - ScannerThreadsSysTime: 29s775ms - ScannerThreadsUserTime: 21s346ms - ScannerThreadsVoluntaryContextSwitches: 293.02K (293019) - TotalRawHdfsReadTime(*): 1s098ms - TotalReadThroughput: 303.40 MB/sec Filter 3 (1.00 MB): - Rows processed: 80.04M (80041225) - Rows rejected: 78.92M (78922489) - Rows total: 80.04M (80041225) Filter 2 (1.00 MB): - Files processed: 264 (264) - Files rejected: 212 (212) - Files total: 264 (264) - RowGroups processed: 604 (604) - RowGroups rejected: 0 (0) - RowGroups total: 604 (604) - Rows processed: 731.28K (731278) - Rows rejected: 0 (0) - Rows total: 731.30K (731301) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 1 (1.00 MB): - Rows processed: 1.12M (1118736) - Rows rejected: 858.52K (858520) - Rows total: 1.12M (1118736) Filter 0 (1.00 MB): - Rows processed: 260.22K (260216) - Rows rejected: 0 (0) - Rows total: 260.22K (260216) Instance b45ac2a82caefd3:f987ea31ef3ee9cd (host=vd1312.halxg.cloudera.com:22000):(Total: 3s448ms, non-child: 209.978ms, % non-child: 6.09%) Hdfs split stats (:<# splits>/): 4:35/2.82 GB 3:32/1.94 GB 2:26/2.01 GB 7:25/1.39 GB 0:34/2.13 GB 5:33/2.25 GB 6:35/2.20 GB 1:43/3.02 GB Filter 1 arrival: 16ms Filter 2 arrival: 28ms Filter 3 arrival: 48ms Filter 0 arrival: 202ms MemoryUsage(500.000ms): 155.55 MB, 1.45 GB, 1.90 GB, 1.86 GB, 1.22 GB, 520.85 MB, 101.82 MB ThreadUsage(500.000ms): 2, 40, 40, 40, 40, 1, 1 - AverageThreadTokens: 23.43 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.10 GB (2255632824) - PerHostPeakMemUsage: 6.03 GB (6472625824) - PrepareTime: 1.983ms - RowsProduced: 208.13K (208130) - TotalCpuTime: 1m32s - TotalNetworkReceiveTime: 136.586ms - TotalNetworkSendTime: 84.466ms - TotalStorageWaitTime: 4s738ms DataStreamSender (dst_id=36):(Total: 159.139ms, non-child: 159.139ms, % non-child: 100.00%) - BytesSent: 16.94 MB (17761986) - NetworkThroughput(*): 685.37 MB/sec - OverallThroughput: 106.44 MB/sec - RowsReturned: 208.13K (208130) - SerializeBatchTime: 134.164ms - TransmitDataRPCTime: 24.715ms - UncompressedRowBatchSize: 56.77 MB (59530500) AGGREGATION_NODE (id=10):(Total: 3s079ms, non-child: 2s358ms, % non-child: 76.59%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 1.670ms - GetResultsTime: 221.439ms - HTResizeTime: 50.017ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 208.54 MB (218674152) - PinTime: 0.000ns - ReductionFactorEstimate: 14.64 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 208.13K (208130) - RowsReturnedRate: 67.58 K/sec - StreamingTime: 2s067ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 721.020ms, non-child: 103.046ms, % non-child: 14.29%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 107.756ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 24.754ms - GetNewBlockTime: 635.516us - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.03 MB (168855240) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 91.335ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 352.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.663us EXCHANGE_NODE (id=35):(Total: 88.386ms, non-child: 13.615ms, % non-child: 15.40%) BytesReceived(500.000ms): 3.30 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 8.087ms - DeserializeRowBatchTimer: 27.003ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 3.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 618.319ms, non-child: 63.714ms, % non-child: 10.30%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 127.784us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 48.970us - GetNewBlockTime: 299.553us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.03 MB (17855944) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 49.898ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 411.10 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.502us EXCHANGE_NODE (id=34):(Total: 9.182ms, non-child: 23.516us, % non-child: 0.26%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 8.138us - DeserializeRowBatchTimer: 24.563us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 28.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 554.609ms, non-child: 53.410ms, % non-child: 9.63%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 122.429us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 35.247us - GetNewBlockTime: 175.875us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.58 MB (17383400) - PinTime: 0.000ns - ProbeRows: 254.19K (254189) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 45.246ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 458.32 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.918us EXCHANGE_NODE (id=33):(Total: 20.991ms, non-child: 33.858us, % non-child: 0.16%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 20.006us - DeserializeRowBatchTimer: 9.673us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 17.39 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 501.203ms, non-child: 102.134ms, % non-child: 20.38%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 12.612ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.177ms - GetNewBlockTime: 303.022us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19123592) - PinTime: 0.000ns - ProbeRows: 254.30K (254296) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 69.726ms - RowsReturned: 254.19K (254189) - RowsReturnedRate: 507.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.680us EXCHANGE_NODE (id=32):(Total: 27.499ms, non-child: 2.102ms, % non-child: 7.65%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 791.521us - DeserializeRowBatchTimer: 5.738ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 997.82 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 371.573ms, non-child: 371.573ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 55 Hdfs split stats (:<# splits>/): 4:35/2.82 GB 3:32/1.94 GB 2:26/2.01 GB 7:25/1.39 GB 0:34/2.13 GB 5:33/2.25 GB 6:35/2.20 GB 1:43/3.02 GB Runtime filters: All filters arrived. Waited 160ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:208 PARQUET/SNAPPY:385 BytesRead(500.000ms): 0, 645.86 MB, 840.08 MB, 880.02 MB, 880.02 MB, 880.02 MB - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 26.00 - BytesRead: 880.02 MB (922767484) - BytesReadDataNodeCache: 0 - BytesReadLocal: 880.02 MB (922767484) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 880.02 MB (922767484) - DecompressionTime: 7s455ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 55 (55) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.80 GB (1932468232) - PerReadThreadRawHdfsThroughput: 853.75 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 77.22M (77222588) - RowsReturned: 254.30K (254296) - RowsReturnedRate: 684.38 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 6.55K (6548) - ScannerThreadsTotalWallClockTime: 1m31s - MaterializeTupleTime(*): 26s551ms - ScannerThreadsSysTime: 29s473ms - ScannerThreadsUserTime: 22s266ms - ScannerThreadsVoluntaryContextSwitches: 338.41K (338412) - TotalRawHdfsReadTime(*): 1s030ms - TotalReadThroughput: 293.34 MB/sec Filter 3 (1.00 MB): - Rows processed: 77.22M (77222588) - Rows rejected: 76.14M (76142102) - Rows total: 77.22M (77222588) Filter 2 (1.00 MB): - Files processed: 263 (263) - Files rejected: 208 (208) - Files total: 263 (263) - RowGroups processed: 582 (582) - RowGroups rejected: 0 (0) - RowGroups total: 582 (582) - Rows processed: 756.34K (756338) - Rows rejected: 0 (0) - Rows total: 756.36K (756358) - Splits processed: 55 (55) - Splits rejected: 0 (0) - Splits total: 55 (55) Filter 1 (1.00 MB): - Rows processed: 1.08M (1080486) - Rows rejected: 826.19K (826190) - Rows total: 1.08M (1080486) Filter 0 (1.00 MB): - Rows processed: 254.30K (254296) - Rows rejected: 0 (0) - Rows total: 254.30K (254296) Instance b45ac2a82caefd3:f987ea31ef3ee9ce (host=vd1313.halxg.cloudera.com:22000):(Total: 3s372ms, non-child: 145.335ms, % non-child: 4.31%) Hdfs split stats (:<# splits>/): 1:32/2.22 GB 6:32/2.17 GB 3:36/2.46 GB 5:44/3.22 GB 4:34/2.05 GB 0:34/2.20 GB 2:33/1.98 GB 7:23/1.59 GB Filter 1 arrival: 15ms Filter 2 arrival: 15ms Filter 3 arrival: 26ms Filter 0 arrival: 178ms MemoryUsage(500.000ms): 155.59 MB, 1.70 GB, 2.12 GB, 2.15 GB, 1.74 GB, 1.06 GB, 134.87 MB ThreadUsage(500.000ms): 2, 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 29.00 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.27 GB (2433571464) - PerHostPeakMemUsage: 6.06 GB (6510672952) - PrepareTime: 5.122ms - RowsProduced: 227.06K (227058) - TotalCpuTime: 1m40s - TotalNetworkReceiveTime: 44.307ms - TotalNetworkSendTime: 110.267ms - TotalStorageWaitTime: 4s939ms DataStreamSender (dst_id=36):(Total: 146.478ms, non-child: 146.478ms, % non-child: 100.00%) - BytesSent: 18.51 MB (19410329) - NetworkThroughput(*): 532.75 MB/sec - OverallThroughput: 126.37 MB/sec - RowsReturned: 227.06K (227058) - SerializeBatchTime: 111.543ms - TransmitDataRPCTime: 34.746ms - UncompressedRowBatchSize: 61.94 MB (64944384) AGGREGATION_NODE (id=10):(Total: 3s080ms, non-child: 2s417ms, % non-child: 78.47%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 3.042ms - GetResultsTime: 107.412ms - HTResizeTime: 44.316ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 223.17 MB (234007016) - PinTime: 0.000ns - ReductionFactorEstimate: 14.06 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 227.06K (227058) - RowsReturnedRate: 73.71 K/sec - StreamingTime: 2s288ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 663.097ms, non-child: 95.422ms, % non-child: 14.39%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 112.374ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 28.681ms - GetNewBlockTime: 2.765ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.98 MB (168802800) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 88.201ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 425.28 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.583us EXCHANGE_NODE (id=35):(Total: 52.891ms, non-child: 14.096ms, % non-child: 26.65%) BytesReceived(500.000ms): 4.23 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 8.274ms - DeserializeRowBatchTimer: 32.335ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 5.67 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 567.971ms, non-child: 52.890ms, % non-child: 9.31%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 87.157us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 51.808us - GetNewBlockTime: 349.265us - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.98 MB (17803504) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 42.527ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 496.51 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.978us EXCHANGE_NODE (id=34):(Total: 15.700us, non-child: 15.700us, % non-child: 100.00%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 8.753us - DeserializeRowBatchTimer: 34.576us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 16.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 515.084ms, non-child: 47.836ms, % non-child: 9.29%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 119.800us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 56.310us - GetNewBlockTime: 458.115us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.98 MB (17803760) - PinTime: 0.000ns - ProbeRows: 282.00K (282004) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 39.504ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 547.49 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.132us EXCHANGE_NODE (id=33):(Total: 26.768us, non-child: 26.768us, % non-child: 100.00%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 16.902us - DeserializeRowBatchTimer: 15.532us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 13.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 467.252ms, non-child: 93.608ms, % non-child: 20.03%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 9.757ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 964.802us - GetNewBlockTime: 446.359us - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19138856) - PinTime: 0.000ns - ProbeRows: 282.13K (282130) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 68.860ms - RowsReturned: 282.00K (282004) - RowsReturnedRate: 603.54 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.094us EXCHANGE_NODE (id=32):(Total: 607.083us, non-child: 607.083us, % non-child: 100.00%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 380.877us - DeserializeRowBatchTimer: 7.046ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 45.20 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 373.041ms, non-child: 373.041ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 53 Hdfs split stats (:<# splits>/): 1:32/2.22 GB 6:32/2.17 GB 3:36/2.46 GB 5:44/3.22 GB 4:34/2.05 GB 0:34/2.20 GB 2:33/1.98 GB 7:23/1.59 GB Runtime filters: All filters arrived. Waited 161ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:215 PARQUET/SNAPPY:371 BytesRead(500.000ms): 0, 692.96 MB, 979.44 MB, 979.44 MB, 979.44 MB, 979.44 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 32.50 - BytesRead: 979.44 MB (1027020737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 979.44 MB (1027020737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 979.44 MB (1027020737) - DecompressionTime: 4s896ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.94 GB (2079297800) - PerReadThreadRawHdfsThroughput: 889.62 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 86.20M (86202147) - RowsReturned: 282.13K (282130) - RowsReturnedRate: 756.30 K/sec - ScanRangesComplete: 268 (268) - ScannerThreadsInvoluntaryContextSwitches: 6.32K (6322) - ScannerThreadsTotalWallClockTime: 1m40s - MaterializeTupleTime(*): 25s071ms - ScannerThreadsSysTime: 29s242ms - ScannerThreadsUserTime: 22s399ms - ScannerThreadsVoluntaryContextSwitches: 317.62K (317625) - TotalRawHdfsReadTime(*): 1s100ms - TotalReadThroughput: 326.48 MB/sec Filter 3 (1.00 MB): - Rows processed: 86.20M (86202147) - Rows rejected: 85.00M (84995305) - Rows total: 86.20M (86202147) Filter 2 (1.00 MB): - Files processed: 268 (268) - Files rejected: 215 (215) - Files total: 268 (268) - RowGroups processed: 644 (644) - RowGroups rejected: 0 (0) - RowGroups total: 644 (644) - Rows processed: 751.37K (751374) - Rows rejected: 0 (0) - Rows total: 751.40K (751399) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Filter 1 (1.00 MB): - Rows processed: 1.21M (1206842) - Rows rejected: 924.71K (924712) - Rows total: 1.21M (1206842) Filter 0 (1.00 MB): - Rows processed: 282.13K (282130) - Rows rejected: 0 (0) - Rows total: 282.13K (282130) Instance b45ac2a82caefd3:f987ea31ef3ee9cb (host=vd1314.halxg.cloudera.com:22000):(Total: 3s371ms, non-child: 152.967ms, % non-child: 4.54%) Hdfs split stats (:<# splits>/): 0:39/3.10 GB 3:32/1.94 GB 7:31/2.26 GB 2:30/1.90 GB 5:23/1.63 GB 1:33/2.21 GB 4:38/2.80 GB 6:36/2.14 GB Filter 2 arrival: 16ms Filter 1 arrival: 16ms Filter 3 arrival: 39ms Filter 0 arrival: 182ms MemoryUsage(500.000ms): 28.43 MB, 1.35 GB, 1.79 GB, 1.95 GB, 1.71 GB, 973.29 MB, 169.16 MB ThreadUsage(500.000ms): 3, 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 29.14 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.01 GB (2161264656) - PerHostPeakMemUsage: 5.61 GB (6020138352) - PrepareTime: 3.375ms - RowsProduced: 209.95K (209947) - TotalCpuTime: 1m39s - TotalNetworkReceiveTime: 51.659ms - TotalNetworkSendTime: 120.923ms - TotalStorageWaitTime: 4s575ms DataStreamSender (dst_id=36):(Total: 147.020ms, non-child: 147.020ms, % non-child: 100.00%) - BytesSent: 17.09 MB (17923004) - NetworkThroughput(*): 434.59 MB/sec - OverallThroughput: 116.26 MB/sec - RowsReturned: 209.95K (209947) - SerializeBatchTime: 107.505ms - TransmitDataRPCTime: 39.330ms - UncompressedRowBatchSize: 57.27 MB (60050206) AGGREGATION_NODE (id=10):(Total: 3s071ms, non-child: 2s438ms, % non-child: 79.40%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 8.210ms - GetResultsTime: 126.292ms - HTResizeTime: 46.816ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 211.46 MB (221734416) - PinTime: 0.000ns - ReductionFactorEstimate: 14.71 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 209.95K (209947) - RowsReturnedRate: 68.35 K/sec - StreamingTime: 2s290ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 632.790ms, non-child: 97.899ms, % non-child: 15.47%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 111.078ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 21.886ms - GetNewBlockTime: 2.087ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.04 MB (168864736) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 87.877ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 407.16 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.912us EXCHANGE_NODE (id=35):(Total: 59.647ms, non-child: 11.321ms, % non-child: 18.98%) BytesReceived(500.000ms): 727.54 KB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 7.916ms - DeserializeRowBatchTimer: 22.218ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 5.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 535.219ms, non-child: 54.389ms, % non-child: 10.16%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 144.790us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 43.609us - GetNewBlockTime: 4.294ms - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17865440) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 37.972ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 481.38 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.643us EXCHANGE_NODE (id=34):(Total: 24.096us, non-child: 24.096us, % non-child: 100.00%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 12.712us - DeserializeRowBatchTimer: 33.848us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 10.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 480.835ms, non-child: 44.904ms, % non-child: 9.34%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 95.862us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 36.718us - GetNewBlockTime: 2.711ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.04 MB (17865696) - PinTime: 0.000ns - ProbeRows: 257.65K (257647) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.730ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 535.83 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.588us EXCHANGE_NODE (id=33):(Total: 14.580us, non-child: 14.580us, % non-child: 100.00%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 7.412us - DeserializeRowBatchTimer: 27.617us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 25.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 435.935ms, non-child: 103.876ms, % non-child: 23.83%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 19.776ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.056ms - GetNewBlockTime: 1.352ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.25 MB (19139544) - PinTime: 0.000ns - ProbeRows: 257.70K (257701) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59.825ms - RowsReturned: 257.65K (257647) - RowsReturnedRate: 591.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.249us EXCHANGE_NODE (id=32):(Total: 1.600ms, non-child: 1.600ms, % non-child: 100.00%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 1.178ms - DeserializeRowBatchTimer: 7.074ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 17.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 330.628ms, non-child: 330.628ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 53 Hdfs split stats (:<# splits>/): 0:39/3.10 GB 3:32/1.94 GB 7:31/2.26 GB 2:30/1.90 GB 5:23/1.63 GB 1:33/2.21 GB 4:38/2.80 GB 6:36/2.14 GB Runtime filters: All filters arrived. Waited 140ms Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:16.67% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:209 PARQUET/SNAPPY:371 BytesRead(500.000ms): 0, 573.65 MB, 782.39 MB, 904.97 MB, 904.97 MB, 904.97 MB - AverageHdfsReadThreadConcurrency: 0.17 - AverageScannerThreadConcurrency: 32.50 - BytesRead: 904.97 MB (948928325) - BytesReadDataNodeCache: 0 - BytesReadLocal: 904.97 MB (948928325) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 904.97 MB (948928325) - DecompressionTime: 4s363ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 53 (53) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.82 GB (1956783848) - PerReadThreadRawHdfsThroughput: 950.61 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 79.52M (79522774) - RowsReturned: 257.70K (257701) - RowsReturnedRate: 779.43 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 7.60K (7600) - ScannerThreadsTotalWallClockTime: 1m39s - MaterializeTupleTime(*): 22s868ms - ScannerThreadsSysTime: 34s418ms - ScannerThreadsUserTime: 20s819ms - ScannerThreadsVoluntaryContextSwitches: 418.17K (418166) - TotalRawHdfsReadTime(*): 951.987ms - TotalReadThroughput: 301.66 MB/sec Filter 3 (1.00 MB): - Rows processed: 79.52M (79522774) - Rows rejected: 78.42M (78415074) - Rows total: 79.52M (79522774) Filter 2 (1.00 MB): - Files processed: 262 (262) - Files rejected: 209 (209) - Files total: 262 (262) - RowGroups processed: 592 (592) - RowGroups rejected: 0 (0) - RowGroups total: 592 (592) - Rows processed: 729.91K (729907) - Rows rejected: 0 (0) - Rows total: 729.93K (729928) - Splits processed: 53 (53) - Splits rejected: 0 (0) - Splits total: 53 (53) Filter 1 (1.00 MB): - Rows processed: 1.11M (1107700) - Rows rejected: 850.00K (849999) - Rows total: 1.11M (1107700) Filter 0 (1.00 MB): - Rows processed: 257.70K (257701) - Rows rejected: 0 (0) - Rows total: 257.70K (257701) Instance b45ac2a82caefd3:f987ea31ef3ee9cf (host=vd1309.halxg.cloudera.com:22000):(Total: 3s219ms, non-child: 204.336ms, % non-child: 6.35%) Hdfs split stats (:<# splits>/): 6:29/1.84 GB 4:29/1.92 GB 7:29/2.11 GB 2:34/2.06 GB 1:33/2.30 GB 0:37/2.13 GB 5:38/3.00 GB 3:41/2.53 GB Filter 1 arrival: 14ms Filter 2 arrival: 20ms Filter 3 arrival: 40ms Filter 0 arrival: 195ms MemoryUsage(500.000ms): 397.94 MB, 2.06 GB, 1.90 GB, 1.69 GB, 1.08 GB, 149.06 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 40, 1 - AverageThreadTokens: 33.50 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.08 GB (2232184464) - PerHostPeakMemUsage: 5.41 GB (5806841432) - PrepareTime: 5.010ms - RowsProduced: 203.18K (203176) - TotalCpuTime: 1m32s - TotalNetworkReceiveTime: 76.249ms - TotalNetworkSendTime: 153.475ms - TotalStorageWaitTime: 6s177ms DataStreamSender (dst_id=36):(Total: 172.627ms, non-child: 172.627ms, % non-child: 100.00%) - BytesSent: 16.53 MB (17333856) - NetworkThroughput(*): 444.47 MB/sec - OverallThroughput: 95.76 MB/sec - RowsReturned: 203.18K (203176) - SerializeBatchTime: 135.216ms - TransmitDataRPCTime: 37.192ms - UncompressedRowBatchSize: 55.42 MB (58113528) AGGREGATION_NODE (id=10):(Total: 2s842ms, non-child: 2s210ms, % non-child: 77.78%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 5.349ms - GetResultsTime: 144.598ms - HTResizeTime: 33.497ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 209.04 MB (219195920) - PinTime: 0.000ns - ReductionFactorEstimate: 14.66 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 203.18K (203176) - RowsReturnedRate: 71.48 K/sec - StreamingTime: 2s042ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 631.526ms, non-child: 89.825ms, % non-child: 14.22%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 105.612ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 24.014ms - GetNewBlockTime: 2.557ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 161.16 MB (168985528) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 81.764ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 391.79 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.714us EXCHANGE_NODE (id=35):(Total: 75.992ms, non-child: 13.229ms, % non-child: 17.41%) BytesReceived(500.000ms): 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 8.322ms - DeserializeRowBatchTimer: 24.098ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 3.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 542.060ms, non-child: 47.239ms, % non-child: 8.71%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 113.335us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 56.164us - GetNewBlockTime: 1.016ms - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.15 MB (17986232) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 37.680ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 456.45 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.281us EXCHANGE_NODE (id=34):(Total: 23.102us, non-child: 23.102us, % non-child: 100.00%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 12.290us - DeserializeRowBatchTimer: 21.680us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 11.17 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 494.826ms, non-child: 38.294ms, % non-child: 7.74%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 137.059us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 39.115us - GetNewBlockTime: 1.375ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 17.15 MB (17986488) - PinTime: 0.000ns - ProbeRows: 247.43K (247425) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 34.089ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 500.02 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.239us EXCHANGE_NODE (id=33):(Total: 4.210ms, non-child: 23.354us, % non-child: 0.55%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 9.860us - DeserializeRowBatchTimer: 19.258us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 86.69 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 456.536ms, non-child: 100.116ms, % non-child: 21.93%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 16.498ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 3.670ms - GetNewBlockTime: 2.250ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.24 MB (19125880) - PinTime: 0.000ns - ProbeRows: 247.52K (247523) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 59.565ms - RowsReturned: 247.43K (247425) - RowsReturnedRate: 541.96 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.933us EXCHANGE_NODE (id=32):(Total: 6.057ms, non-child: 2.152ms, % non-child: 35.53%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 1.104ms - DeserializeRowBatchTimer: 6.084ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 4.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 350.417ms, non-child: 350.417ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 52 Hdfs split stats (:<# splits>/): 6:29/1.84 GB 4:29/1.92 GB 7:29/2.11 GB 2:34/2.06 GB 1:33/2.30 GB 0:37/2.13 GB 5:38/3.00 GB 3:41/2.53 GB Runtime filters: All filters arrived. Waited 160ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:0% 3:0% 4:20% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:218 PARQUET/SNAPPY:364 BytesRead(500.000ms): 167.27 MB, 710.23 MB, 863.10 MB, 863.10 MB, 863.10 MB - AverageHdfsReadThreadConcurrency: 0.80 - AverageScannerThreadConcurrency: 39.00 - BytesRead: 863.10 MB (905023870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 863.10 MB (905023870) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 863.10 MB (905023870) - DecompressionTime: 3s790ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 52 (52) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.89 GB (2026357016) - PerReadThreadRawHdfsThroughput: 1016.72 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 75.79M (75793861) - RowsReturned: 247.52K (247523) - RowsReturnedRate: 706.37 K/sec - ScanRangesComplete: 270 (270) - ScannerThreadsInvoluntaryContextSwitches: 6.08K (6081) - ScannerThreadsTotalWallClockTime: 1m31s - MaterializeTupleTime(*): 21s074ms - ScannerThreadsSysTime: 26s274ms - ScannerThreadsUserTime: 19s571ms - ScannerThreadsVoluntaryContextSwitches: 259.40K (259400) - TotalRawHdfsReadTime(*): 848.907ms - TotalReadThroughput: 345.24 MB/sec Filter 3 (1.00 MB): - Rows processed: 75.79M (75793861) - Rows rejected: 74.74M (74736321) - Rows total: 75.79M (75793861) Filter 2 (1.00 MB): - Files processed: 270 (270) - Files rejected: 218 (218) - Files total: 270 (270) - RowGroups processed: 569 (569) - RowGroups rejected: 0 (0) - RowGroups total: 569 (569) - Rows processed: 723.45K (723449) - Rows rejected: 0 (0) - Rows total: 723.47K (723470) - Splits processed: 52 (52) - Splits rejected: 0 (0) - Splits total: 52 (52) Filter 1 (1.00 MB): - Rows processed: 1.06M (1057540) - Rows rejected: 810.02K (810017) - Rows total: 1.06M (1057540) Filter 0 (1.00 MB): - Rows processed: 247.52K (247523) - Rows rejected: 0 (0) - Rows total: 247.52K (247523) Instance b45ac2a82caefd3:f987ea31ef3ee9ca (host=vd1316.halxg.cloudera.com:22000):(Total: 2s786ms, non-child: 133.955ms, % non-child: 4.81%) Hdfs split stats (:<# splits>/): 4:32/2.01 GB 7:34/2.53 GB 2:35/2.87 GB 0:30/1.93 GB 6:27/1.56 GB 1:35/2.61 GB 3:30/1.86 GB 5:33/2.53 GB Filter 1 arrival: 16ms Filter 2 arrival: 17ms Filter 3 arrival: 40ms Filter 0 arrival: 191ms MemoryUsage(500.000ms): 210.62 MB, 2.00 GB, 2.02 GB, 1.58 GB, 740.37 MB, 16.41 MB ThreadUsage(500.000ms): 40, 40, 40, 40, 1, 1 - AverageThreadTokens: 27.00 - BloomFilterBytes: 4.00 MB (4194304) - PeakMemoryUsage: 2.10 GB (2249736736) - PerHostPeakMemUsage: 5.19 GB (5575694536) - PrepareTime: 5.125ms - RowsProduced: 194.95K (194953) - TotalCpuTime: 1m17s - TotalNetworkReceiveTime: 73.086ms - TotalNetworkSendTime: 87.853ms - TotalStorageWaitTime: 5s707ms DataStreamSender (dst_id=36):(Total: 147.888ms, non-child: 147.888ms, % non-child: 100.00%) - BytesSent: 15.85 MB (16615651) - NetworkThroughput(*): 545.25 MB/sec - OverallThroughput: 107.15 MB/sec - RowsReturned: 194.95K (194953) - SerializeBatchTime: 118.562ms - TransmitDataRPCTime: 29.061ms - UncompressedRowBatchSize: 53.18 MB (55761534) AGGREGATION_NODE (id=10):(Total: 2s504ms, non-child: 1s888ms, % non-child: 75.37%) ExecOption: Streaming Preaggregation, Codegen Disabled - GetNewBlockTime: 14.277ms - GetResultsTime: 116.862ms - HTResizeTime: 27.428ms - HashBuckets: 524.29K (524288) - LargestPartitionPercent: 5 (5) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 207.07 MB (217131560) - PinTime: 0.000ns - ReductionFactorEstimate: 14.55 - ReductionFactorThresholdToExpand: 2.00 - RowsPassedThrough: 0 (0) - RowsReturned: 194.95K (194953) - RowsReturnedRate: 77.83 K/sec - StreamingTime: 1s751ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=9):(Total: 616.855ms, non-child: 96.995ms, % non-child: 15.72%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 101.118ms - BuildRows: 300.00K (300000) - BuildRowsPartitioned: 300.00K (300000) - BuildTime: 17.549ms - GetNewBlockTime: 3.059ms - HashBuckets: 524.29K (524288) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 160.98 MB (168803368) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 85.192ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 379.81 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.878us EXCHANGE_NODE (id=35):(Total: 78.425ms, non-child: 11.281ms, % non-child: 14.39%) BytesReceived(500.000ms): 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB, 4.49 MB - BytesReceived: 4.49 MB (4713199) - ConvertRowBatchTime: 8.047ms - DeserializeRowBatchTimer: 22.877ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 300.00K (300000) - RowsReturnedRate: 3.83 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=8):(Total: 520.145ms, non-child: 42.602ms, % non-child: 8.19%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 124.539us - BuildRows: 258 (258) - BuildRowsPartitioned: 258 (258) - BuildTime: 25.296us - GetNewBlockTime: 2.955ms - HashBuckets: 496 (496) - HashCollisions: 0 (0) - LargestPartitionPercent: 9 (9) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.98 MB (17804072) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 33.733ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 450.43 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.810us EXCHANGE_NODE (id=34):(Total: 22.335us, non-child: 22.335us, % non-child: 100.00%) BytesReceived(500.000ms): 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB, 5.26 KB - BytesReceived: 5.26 KB (5387) - ConvertRowBatchTime: 11.759us - DeserializeRowBatchTimer: 22.101us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 258 (258) - RowsReturnedRate: 11.55 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=7):(Total: 477.548ms, non-child: 42.217ms, % non-child: 8.84%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 156.000us - BuildRows: 365 (365) - BuildRowsPartitioned: 365 (365) - BuildTime: 64.620us - GetNewBlockTime: 2.001ms - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 16.98 MB (17804328) - PinTime: 0.000ns - ProbeRows: 234.29K (234289) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 35.320ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 490.61 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 2.232us EXCHANGE_NODE (id=33):(Total: 24.399us, non-child: 24.399us, % non-child: 100.00%) BytesReceived(500.000ms): 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB, 3.94 KB - BytesReceived: 3.94 KB (4031) - ConvertRowBatchTime: 16.197us - DeserializeRowBatchTimer: 24.761us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 14.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 435.334ms, non-child: 113.739ms, % non-child: 26.13%) ExecOption: Build Side Codegen Disabled, Probe Side Codegen Disabled, Hash Table Construction Codegen Disabled, Join Build-Side Prepared Asynchronously, 1 of 1 Runtime Filter Published - BuildPartitionTime: 17.086ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 3.687ms - GetNewBlockTime: 2.995ms - HashBuckets: 65.54K (65536) - HashCollisions: 0 (0) - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 18.23 MB (19120400) - PinTime: 0.000ns - ProbeRows: 234.39K (234393) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 60.293ms - RowsReturned: 234.29K (234289) - RowsReturnedRate: 538.18 K/sec - SpilledPartitions: 0 (0) - UnpinTime: 1.742us EXCHANGE_NODE (id=32):(Total: 4.303ms, non-child: 4.303ms, % non-child: 100.00%) BytesReceived(500.000ms): 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB, 727.29 KB - BytesReceived: 727.29 KB (744748) - ConvertRowBatchTime: 1.070ms - DeserializeRowBatchTimer: 6.718ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 6.38 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 317.613ms, non-child: 317.613ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 45 Hdfs split stats (:<# splits>/): 4:32/2.01 GB 7:34/2.53 GB 2:35/2.87 GB 0:30/1.93 GB 6:27/1.56 GB 1:35/2.61 GB 3:30/1.86 GB 5:33/2.53 GB Runtime filters: All filters arrived. Waited 160ms Hdfs Read Thread Concurrency Bucket: 0:80% 1:0% 2:0% 3:20% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/NONE:211 PARQUET/SNAPPY:315 BytesRead(500.000ms): 25.83 MB, 815.12 MB, 815.12 MB, 815.12 MB, 815.12 MB - AverageHdfsReadThreadConcurrency: 0.60 - AverageScannerThreadConcurrency: 31.20 - BytesRead: 815.12 MB (854713494) - BytesReadDataNodeCache: 0 - BytesReadLocal: 815.12 MB (854713494) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 815.12 MB (854713494) - DecompressionTime: 3s078ms - MaxCompressedTextFileLength: 0 - NumColumns: 7 (7) - NumDisksAccessed: 8 (8) - NumRowGroups: 45 (45) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 1.82 GB (1951025320) - PerReadThreadRawHdfsThroughput: 1.02 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 71.72M (71721657) - RowsReturned: 234.39K (234393) - RowsReturnedRate: 737.98 K/sec - ScanRangesComplete: 256 (256) - ScannerThreadsInvoluntaryContextSwitches: 5.22K (5224) - ScannerThreadsTotalWallClockTime: 1m17s - MaterializeTupleTime(*): 17s764ms - ScannerThreadsSysTime: 25s072ms - ScannerThreadsUserTime: 18s302ms - ScannerThreadsVoluntaryContextSwitches: 296.19K (296194) - TotalRawHdfsReadTime(*): 776.963ms - TotalReadThroughput: 326.05 MB/sec Filter 3 (1.00 MB): - Rows processed: 71.72M (71721657) - Rows rejected: 70.72M (70719551) - Rows total: 71.72M (71721657) Filter 2 (1.00 MB): - Files processed: 256 (256) - Files rejected: 211 (211) - Files total: 256 (256) - RowGroups processed: 539 (539) - RowGroups rejected: 0 (0) - RowGroups total: 539 (539) - Rows processed: 635.25K (635247) - Rows rejected: 0 (0) - Rows total: 635.27K (635268) - Splits processed: 45 (45) - Splits rejected: 0 (0) - Splits total: 45 (45) Filter 1 (1.00 MB): - Rows processed: 1.00M (1002106) - Rows rejected: 767.71K (767713) - Rows total: 1.00M (1002106) Filter 0 (1.00 MB): - Rows processed: 234.39K (234393) - Rows rejected: 0 (0) - Rows total: 234.39K (234393) Fragment F04: Instance b45ac2a82caefd3:f987ea31ef3ee9d0 (host=vd1309.halxg.cloudera.com:22000):(Total: 234.263ms, non-child: 107.370ms, % non-child: 45.83%) Hdfs split stats (:<# splits>/): 7:1/27.40 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 15.87 MB (16643160) - PerHostPeakMemUsage: 1.94 GB (2084602912) - PrepareTime: 60.184us - RowsProduced: 300.00K (300000) - TotalCpuTime: 283.649ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 105.711ms - TotalStorageWaitTime: 3.643ms DataStreamSender (dst_id=35):(Total: 106.754ms, non-child: 106.754ms, % non-child: 100.00%) - BytesSent: 31.46 MB (32992393) - NetworkThroughput(*): 720.95 MB/sec - OverallThroughput: 294.73 MB/sec - RowsReturned: 300.00K (300000) - SerializeBatchTime: 62.997ms - TransmitDataRPCTime: 43.642ms - UncompressedRowBatchSize: 104.15 MB (109208204) HDFS_SCAN_NODE (id=5):(Total: 20.138ms, non-child: 20.138ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 7:1/27.40 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.30 MB (2408738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.30 MB (2408738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.30 MB (2408738) - DecompressionTime: 20.026ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 15.77 MB (16540760) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 300.00K (300000) - RowsReturned: 300.00K (300000) - RowsReturnedRate: 14.90 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 26 (26) - ScannerThreadsTotalWallClockTime: 148.952ms - MaterializeTupleTime(*): 25.804ms - ScannerThreadsSysTime: 20.996ms - ScannerThreadsUserTime: 29.995ms - ScannerThreadsVoluntaryContextSwitches: 345 (345) - TotalRawHdfsReadTime(*): 2.076ms - TotalReadThroughput: 0.00 /sec Fragment F03: Instance b45ac2a82caefd3:f987ea31ef3ee9d1 (host=vd1314.halxg.cloudera.com:22000):(Total: 64.936ms, non-child: 60.600ms, % non-child: 93.32%) Hdfs split stats (:<# splits>/): 1:1/87.37 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 189.30 KB (193840) - PerHostPeakMemUsage: 345.11 MB (361875968) - PrepareTime: 190.682us - RowsProduced: 258 (258) - TotalCpuTime: 12.875ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 56.652ms - TotalStorageWaitTime: 1.754ms DataStreamSender (dst_id=34):(Total: 1.368ms, non-child: 1.368ms, % non-child: 100.00%) - BytesSent: 36.83 KB (37709) - NetworkThroughput(*): 184.84 MB/sec - OverallThroughput: 26.29 MB/sec - RowsReturned: 258 (258) - SerializeBatchTime: 1.110ms - TransmitDataRPCTime: 194.555us - UncompressedRowBatchSize: 52.94 KB (54208) HDFS_SCAN_NODE (id=4):(Total: 2.968ms, non-child: 2.968ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/87.37 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 93.34 KB (95579) - BytesReadDataNodeCache: 0 - BytesReadLocal: 93.34 KB (95579) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 93.34 KB (95579) - DecompressionTime: 1.519us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 136.00 KB (139264) - PerReadThreadRawHdfsThroughput: 2.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 1.00K (1002) - RowsReturned: 258 (258) - RowsReturnedRate: 86.92 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 3.472ms - MaterializeTupleTime(*): 58.982us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 12 (12) - TotalRawHdfsReadTime(*): 38.325us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance b45ac2a82caefd3:f987ea31ef3ee9d2 (host=vd1314.halxg.cloudera.com:22000):(Total: 62.020ms, non-child: 47.852ms, % non-child: 77.16%) Hdfs split stats (:<# splits>/): 6:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.15 MB (2252432) - PerHostPeakMemUsage: 358.38 MB (375785512) - PrepareTime: 147.891us - RowsProduced: 365 (365) - TotalCpuTime: 35.463ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 43.307ms - TotalStorageWaitTime: 1.891ms DataStreamSender (dst_id=33):(Total: 308.754us, non-child: 308.754us, % non-child: 100.00%) - BytesSent: 27.56 KB (28217) - NetworkThroughput(*): 207.84 MB/sec - OverallThroughput: 87.16 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 92.830us - TransmitDataRPCTime: 129.475us - UncompressedRowBatchSize: 39.95 KB (40908) HDFS_SCAN_NODE (id=3):(Total: 13.858ms, non-child: 13.858ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/2.15 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.22 KB (476387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.22 KB (476387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.22 KB (476387) - DecompressionTime: 217.617us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 2.07 MB (2167800) - PerReadThreadRawHdfsThroughput: 800.88 MB/sec - RemoteScanRanges: 0 (0) - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 26.34 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 13.597ms - MaterializeTupleTime(*): 9.041ms - ScannerThreadsSysTime: 999.000us - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 16 (16) - TotalRawHdfsReadTime(*): 567.277us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance b45ac2a82caefd3:f987ea31ef3ee9d7 (host=vd1316.halxg.cloudera.com:22000):(Total: 80.483ms, non-child: 47.392ms, % non-child: 58.88%) Hdfs split stats (:<# splits>/): 7:1/1.14 MB 6:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 31.93 MB (33479520) - PerHostPeakMemUsage: 506.94 MB (531560328) - PrepareTime: 86.475us - RowsProduced: 7.83K (7829) - TotalCpuTime: 155.912ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28.771ms - TotalStorageWaitTime: 10.997ms DataStreamSender (dst_id=32):(Total: 5.020ms, non-child: 5.020ms, % non-child: 100.00%) - BytesSent: 1.42 MB (1487605) - NetworkThroughput(*): 1.08 GB/sec - OverallThroughput: 282.57 MB/sec - RowsReturned: 7.83K (7829) - SerializeBatchTime: 3.682ms - TransmitDataRPCTime: 1.285ms - UncompressedRowBatchSize: 3.71 MB (3891237) HDFS_SCAN_NODE (id=2):(Total: 28.070ms, non-child: 28.070ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 2 Hdfs split stats (:<# splits>/): 7:1/1.14 MB 6:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:8 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.46 MB (2581384) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.46 MB (2581384) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.46 MB (2581384) - DecompressionTime: 2.239ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 27.94 MB (29295248) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 547.43K (547428) - RowsReturned: 7.83K (7829) - RowsReturnedRate: 278.90 K/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 21 (21) - ScannerThreadsTotalWallClockTime: 112.932ms - MaterializeTupleTime(*): 95.151ms - ScannerThreadsSysTime: 21.996ms - ScannerThreadsUserTime: 76.987ms - ScannerThreadsVoluntaryContextSwitches: 88 (88) - TotalRawHdfsReadTime(*): 1.536ms - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9d5 (host=vd1313.halxg.cloudera.com:22000):(Total: 71.626ms, non-child: 34.768ms, % non-child: 48.54%) Hdfs split stats (:<# splits>/): 4:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311640) - PerHostPeakMemUsage: 388.59 MB (407468696) - PrepareTime: 93.198us - RowsProduced: 3.90K (3905) - TotalCpuTime: 95.481ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.268ms - TotalStorageWaitTime: 5.292ms DataStreamSender (dst_id=32):(Total: 2.582ms, non-child: 2.582ms, % non-child: 100.00%) - BytesSent: 723.05 KB (740404) - NetworkThroughput(*): 708.23 MB/sec - OverallThroughput: 273.44 MB/sec - RowsReturned: 3.90K (3905) - SerializeBatchTime: 1.542ms - TransmitDataRPCTime: 997.001us - UncompressedRowBatchSize: 1.85 MB (1940897) HDFS_SCAN_NODE (id=2):(Total: 34.275ms, non-child: 34.275ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 4:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290957) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290957) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290957) - DecompressionTime: 1.332ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.38 MB (10887952) - PerReadThreadRawHdfsThroughput: 1.81 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.90K (3905) - RowsReturnedRate: 113.93 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 12 (12) - ScannerThreadsTotalWallClockTime: 52.681ms - MaterializeTupleTime(*): 43.554ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 34.994ms - ScannerThreadsVoluntaryContextSwitches: 66 (66) - TotalRawHdfsReadTime(*): 665.622us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9d3 (host=vd1310.halxg.cloudera.com:22000):(Total: 71.591ms, non-child: 36.837ms, % non-child: 51.45%) Hdfs split stats (:<# splits>/): 0:1/1.14 MB MemoryUsage(500.000ms): 10.88 MB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 14.60 MB (15311608) - PerHostPeakMemUsage: 382.56 MB (401144896) - PrepareTime: 64.775us - RowsProduced: 3.91K (3911) - TotalCpuTime: 95.311ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 28.741ms - TotalStorageWaitTime: 5.213ms DataStreamSender (dst_id=32):(Total: 2.908ms, non-child: 2.908ms, % non-child: 100.00%) - BytesSent: 722.85 KB (740201) - NetworkThroughput(*): 865.85 MB/sec - OverallThroughput: 242.68 MB/sec - RowsReturned: 3.91K (3911) - SerializeBatchTime: 2.063ms - TransmitDataRPCTime: 815.277us - UncompressedRowBatchSize: 1.85 MB (1943879) HDFS_SCAN_NODE (id=2):(Total: 31.845ms, non-child: 31.845ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 0:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 BytesRead(500.000ms): 1.23 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 1.23 MB (1290670) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290670) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290670) - DecompressionTime: 2.657ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 10.44 MB (10945264) - PerReadThreadRawHdfsThroughput: 2.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3911) - RowsReturnedRate: 122.81 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 9 (9) - ScannerThreadsTotalWallClockTime: 56.168ms - MaterializeTupleTime(*): 46.611ms - ScannerThreadsSysTime: 7.998ms - ScannerThreadsUserTime: 40.993ms - ScannerThreadsVoluntaryContextSwitches: 97 (97) - TotalRawHdfsReadTime(*): 515.999us - TotalReadThroughput: 2.46 MB/sec Instance b45ac2a82caefd3:f987ea31ef3ee9d6 (host=vd1314.halxg.cloudera.com:22000):(Total: 68.983ms, non-child: 27.909ms, % non-child: 40.46%) Hdfs split stats (:<# splits>/): 6:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.98 MB (14655352) - PerHostPeakMemUsage: 426.81 MB (447541752) - PrepareTime: 186.389us - RowsProduced: 3.91K (3907) - TotalCpuTime: 112.430ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 16.753ms - TotalStorageWaitTime: 3.367ms DataStreamSender (dst_id=32):(Total: 2.533ms, non-child: 2.533ms, % non-child: 100.00%) - BytesSent: 726.54 KB (743974) - NetworkThroughput(*): 873.99 MB/sec - OverallThroughput: 280.04 MB/sec - RowsReturned: 3.91K (3907) - SerializeBatchTime: 1.569ms - TransmitDataRPCTime: 811.808us - UncompressedRowBatchSize: 1.85 MB (1941891) HDFS_SCAN_NODE (id=2):(Total: 38.540ms, non-child: 38.540ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290406) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290406) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290406) - DecompressionTime: 1.132ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 9.81 MB (10289008) - PerReadThreadRawHdfsThroughput: 2.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3907) - RowsReturnedRate: 101.37 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 11 (11) - ScannerThreadsTotalWallClockTime: 60.555ms - MaterializeTupleTime(*): 50.555ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 37 (37) - TotalRawHdfsReadTime(*): 517.832us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9d8 (host=vd1311.halxg.cloudera.com:22000):(Total: 68.852ms, non-child: 24.618ms, % non-child: 35.75%) Hdfs split stats (:<# splits>/): 1:1/1.14 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 12.77 MB (13385480) - PerHostPeakMemUsage: 431.21 MB (452152416) - PrepareTime: 139.465us - RowsProduced: 3.91K (3908) - TotalCpuTime: 111.786ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.819ms - TotalStorageWaitTime: 5.494ms DataStreamSender (dst_id=32):(Total: 3.018ms, non-child: 3.018ms, % non-child: 100.00%) - BytesSent: 729.61 KB (747117) - NetworkThroughput(*): 704.56 MB/sec - OverallThroughput: 236.01 MB/sec - RowsReturned: 3.91K (3908) - SerializeBatchTime: 1.961ms - TransmitDataRPCTime: 1.011ms - UncompressedRowBatchSize: 1.85 MB (1942388) HDFS_SCAN_NODE (id=2):(Total: 41.215ms, non-child: 41.215ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 1:1/1.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1290724) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1290724) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.23 MB (1290724) - DecompressionTime: 1.124ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 8.55 MB (8961792) - PerReadThreadRawHdfsThroughput: 2.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 273.71K (273714) - RowsReturned: 3.91K (3908) - RowsReturnedRate: 94.82 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 16 (16) - ScannerThreadsTotalWallClockTime: 61.492ms - MaterializeTupleTime(*): 53.039ms - ScannerThreadsSysTime: 10.998ms - ScannerThreadsUserTime: 42.993ms - ScannerThreadsVoluntaryContextSwitches: 38 (38) - TotalRawHdfsReadTime(*): 574.269us - TotalReadThroughput: 0.00 /sec Instance b45ac2a82caefd3:f987ea31ef3ee9d4 (host=vd1309.halxg.cloudera.com:22000):(Total: 67.295ms, non-child: 29.640ms, % non-child: 44.05%) Hdfs split stats (:<# splits>/): 2:1/1.16 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 13.87 MB (14544008) - PerHostPeakMemUsage: 459.80 MB (482130624) - PrepareTime: 629.410us - RowsProduced: 3.98K (3980) - TotalCpuTime: 106.632ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 14.982ms - TotalStorageWaitTime: 5.576ms DataStreamSender (dst_id=32):(Total: 2.920ms, non-child: 2.920ms, % non-child: 100.00%) - BytesSent: 736.26 KB (753935) - NetworkThroughput(*): 807.65 MB/sec - OverallThroughput: 246.19 MB/sec - RowsReturned: 3.98K (3980) - SerializeBatchTime: 1.730ms - TransmitDataRPCTime: 890.246us - UncompressedRowBatchSize: 1.89 MB (1978172) HDFS_SCAN_NODE (id=2):(Total: 34.734ms, non-child: 34.734ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Disabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 2:1/1.16 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.25 MB (1310109) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.25 MB (1310109) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.25 MB (1310109) - DecompressionTime: 2.310ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 9.65 MB (10120320) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 278.52K (278516) - RowsReturned: 3.98K (3980) - RowsReturnedRate: 114.58 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 33 (33) - ScannerThreadsTotalWallClockTime: 55.665ms - MaterializeTupleTime(*): 46.183ms - ScannerThreadsSysTime: 3.999ms - ScannerThreadsUserTime: 41.993ms - ScannerThreadsVoluntaryContextSwitches: 101 (101) - TotalRawHdfsReadTime(*): 698.887us - TotalReadThroughput: 0.00 /sec