impalad /backends /catalog /hadoop-varz /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query da46dbd7c4e8e43b:bc4eab3900000000 Plan Query Text plan Summary Profile Memory Download Thrift Profile Query (id=da46dbd7c4e8e43b:bc4eab3900000000): Summary: Session ID: 7140c210bdce9da0:84679a7213c8fb98 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2016-09-14 00:39:51.396416000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.8.0-cdh5-INTERNAL RELEASE (build 1a83f8bbe871df0527923e6f131a295270e54d33) User: Connected User: Delegated User: Network Address: 172.18.13.195:63028 Default Db: tpcds_10_parquet Sql Statement: select * from (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a1, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a2, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a3, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a4, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a5, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a6, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a7, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a8, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a9, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a10, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a11, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a12, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a13, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a14, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a15, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a16, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a17, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a18, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a19, (select count(*) from store_sales a where ss_item_sk > 10 and ss_customer_sk > 10 and ss_ticket_number > 0 and ss_coupon_amt > 0 ) a20 Coordinator: vd1309.halxg.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=74.00MB VCores=1 58:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40,43,46,49,52,55,58 row-size=160B cardinality=1 | |--117:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=58 row-size=8B cardinality=1 | | | 116:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=58 row-size=8B cardinality=1 | | | 115:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=58 row-size=8B cardinality=1 | | | 39:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=58 row-size=8B cardinality=1 | | | 38:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=57 row-size=24B cardinality=2880099 | 57:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40,43,46,49,52,55 row-size=152B cardinality=1 | |--114:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=55 row-size=8B cardinality=1 | | | 113:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=55 row-size=8B cardinality=1 | | | 112:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=55 row-size=8B cardinality=1 | | | 37:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=55 row-size=8B cardinality=1 | | | 36:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=54 row-size=24B cardinality=2880099 | 56:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40,43,46,49,52 row-size=144B cardinality=1 | |--111:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=52 row-size=8B cardinality=1 | | | 110:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=52 row-size=8B cardinality=1 | | | 109:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=52 row-size=8B cardinality=1 | | | 35:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=52 row-size=8B cardinality=1 | | | 34:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=51 row-size=24B cardinality=2880099 | 55:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40,43,46,49 row-size=136B cardinality=1 | |--108:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=49 row-size=8B cardinality=1 | | | 107:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=49 row-size=8B cardinality=1 | | | 106:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=49 row-size=8B cardinality=1 | | | 33:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=49 row-size=8B cardinality=1 | | | 32:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=48 row-size=24B cardinality=2880099 | 54:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40,43,46 row-size=128B cardinality=1 | |--105:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=46 row-size=8B cardinality=1 | | | 104:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=46 row-size=8B cardinality=1 | | | 103:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=46 row-size=8B cardinality=1 | | | 31:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=46 row-size=8B cardinality=1 | | | 30:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=45 row-size=24B cardinality=2880099 | 53:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40,43 row-size=120B cardinality=1 | |--102:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=43 row-size=8B cardinality=1 | | | 101:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=43 row-size=8B cardinality=1 | | | 100:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=43 row-size=8B cardinality=1 | | | 29:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=43 row-size=8B cardinality=1 | | | 28:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=42 row-size=24B cardinality=2880099 | 52:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37,40 row-size=112B cardinality=1 | |--99:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=40 row-size=8B cardinality=1 | | | 98:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=40 row-size=8B cardinality=1 | | | 97:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=40 row-size=8B cardinality=1 | | | 27:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=40 row-size=8B cardinality=1 | | | 26:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=39 row-size=24B cardinality=2880099 | 51:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34,37 row-size=104B cardinality=1 | |--96:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=37 row-size=8B cardinality=1 | | | 95:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=37 row-size=8B cardinality=1 | | | 94:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=37 row-size=8B cardinality=1 | | | 25:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=37 row-size=8B cardinality=1 | | | 24:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=36 row-size=24B cardinality=2880099 | 50:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31,34 row-size=96B cardinality=1 | |--93:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=34 row-size=8B cardinality=1 | | | 92:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=34 row-size=8B cardinality=1 | | | 91:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=34 row-size=8B cardinality=1 | | | 23:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=34 row-size=8B cardinality=1 | | | 22:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=33 row-size=24B cardinality=2880099 | 49:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28,31 row-size=88B cardinality=1 | |--90:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=31 row-size=8B cardinality=1 | | | 89:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=31 row-size=8B cardinality=1 | | | 88:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=31 row-size=8B cardinality=1 | | | 21:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=31 row-size=8B cardinality=1 | | | 20:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=30 row-size=24B cardinality=2880099 | 48:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25,28 row-size=80B cardinality=1 | |--87:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=28 row-size=8B cardinality=1 | | | 86:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=28 row-size=8B cardinality=1 | | | 85:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=28 row-size=8B cardinality=1 | | | 19:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=28 row-size=8B cardinality=1 | | | 18:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=27 row-size=24B cardinality=2880099 | 47:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22,25 row-size=72B cardinality=1 | |--84:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=25 row-size=8B cardinality=1 | | | 83:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=25 row-size=8B cardinality=1 | | | 82:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=25 row-size=8B cardinality=1 | | | 17:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=25 row-size=8B cardinality=1 | | | 16:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=24 row-size=24B cardinality=2880099 | 46:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19,22 row-size=64B cardinality=1 | |--81:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=22 row-size=8B cardinality=1 | | | 80:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=22 row-size=8B cardinality=1 | | | 79:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=22 row-size=8B cardinality=1 | | | 15:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=22 row-size=8B cardinality=1 | | | 14:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=21 row-size=24B cardinality=2880099 | 45:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16,19 row-size=56B cardinality=1 | |--78:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=19 row-size=8B cardinality=1 | | | 77:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=19 row-size=8B cardinality=1 | | | 76:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=19 row-size=8B cardinality=1 | | | 13:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=19 row-size=8B cardinality=1 | | | 12:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=18 row-size=24B cardinality=2880099 | 44:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13,16 row-size=48B cardinality=1 | |--75:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=16 row-size=8B cardinality=1 | | | 74:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=16 row-size=8B cardinality=1 | | | 73:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=16 row-size=8B cardinality=1 | | | 11:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=16 row-size=8B cardinality=1 | | | 10:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=15 row-size=24B cardinality=2880099 | 43:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10,13 row-size=40B cardinality=1 | |--72:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=13 row-size=8B cardinality=1 | | | 71:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=13 row-size=8B cardinality=1 | | | 70:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=13 row-size=8B cardinality=1 | | | 09:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=13 row-size=8B cardinality=1 | | | 08:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=12 row-size=24B cardinality=2880099 | 42:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7,10 row-size=32B cardinality=1 | |--69:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=10 row-size=8B cardinality=1 | | | 68:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=10 row-size=8B cardinality=1 | | | 67:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=10 row-size=8B cardinality=1 | | | 07:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=10 row-size=8B cardinality=1 | | | 06:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=9 row-size=24B cardinality=2880099 | 41:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4,7 row-size=24B cardinality=1 | |--66:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=7 row-size=8B cardinality=1 | | | 65:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=7 row-size=8B cardinality=1 | | | 64:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=7 row-size=8B cardinality=1 | | | 05:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=7 row-size=8B cardinality=1 | | | 04:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=6 row-size=24B cardinality=2880099 | 40:NESTED LOOP JOIN [CROSS JOIN, BROADCAST] | hosts=7 per-host-mem=unavailable | tuple-ids=1,4 row-size=16B cardinality=1 | |--63:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=4 row-size=8B cardinality=1 | | | 62:AGGREGATE [FINALIZE] | | output: count:merge(*) | | hosts=7 per-host-mem=unavailable | | tuple-ids=4 row-size=8B cardinality=1 | | | 61:EXCHANGE [UNPARTITIONED] | | hosts=7 per-host-mem=unavailable | | tuple-ids=4 row-size=8B cardinality=1 | | | 03:AGGREGATE | | output: count(*) | | hosts=7 per-host-mem=10.00MB | | tuple-ids=4 row-size=8B cardinality=1 | | | 02:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] | partitions=1824/1824 files=1824 size=1.70GB | predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 | table stats: 28800991 rows total | column stats: all | hosts=7 per-host-mem=64.00MB | tuple-ids=3 row-size=24B cardinality=2880099 | 60:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=7 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 59:EXCHANGE [UNPARTITIONED] | hosts=7 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 01:AGGREGATE | output: count(*) | hosts=7 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=1 | 00:SCAN HDFS [tpcds_10_parquet.store_sales a, RANDOM] partitions=1824/1824 files=1824 size=1.70GB predicates: ss_item_sk > 10, ss_customer_sk > 10, ss_ticket_number > 0, ss_coupon_amt > 0 table stats: 28800991 rows total column stats: all hosts=7 per-host-mem=64.00MB tuple-ids=0 row-size=24B cardinality=2880099 ---------------- Estimated Per-Host Mem: 77594624 Estimated Per-Host VCores: 1 Request Pool: root.default Admission result: Admitted immediately Planner Timeline: 89.347ms - Analysis finished: 19.530ms (19.530ms) - Equivalence classes computed: 20.157ms (626.739us) - Single node plan created: 74.178ms (54.020ms) - Runtime filters computed: 74.279ms (101.103us) - Distributed plan created: 77.333ms (3.053ms) - Lineage info computed: 78.809ms (1.476ms) - Planning finished: 89.347ms (10.537ms) Query Timeline: 38s543ms - Start execution: 367.285us (367.285us) - Planning finished: 174.939ms (174.571ms) - Submit for admission: 251.899ms (76.960ms) - Completed admission: 251.948ms (48.521us) - Ready to start 159 remote fragments: 324.214ms (72.265ms) - All 159 remote fragments started: 1s084ms (760.671ms) - ComputeScanRangeAssignmentTimer: 60.795ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile da46dbd7c4e8e43b:bc4eab3900000000:(Total: 830.199ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 159, 25th %-ile: 24ms, 50th %-ile: 27ms, 75th %-ile: 32ms, 90th %-ile: 36ms, 95th %-ile: 39ms, 99.9th %-ile: 49ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 65.635ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1s000ms): 1.79 MB, 1.79 MB, 1.79 MB, 1.79 MB, 1.79 MB, 1.79 MB, 1.79 MB, 1.79 MB, 1.79 MB, 1.80 MB, 1.82 MB, 1.82 MB, 1.82 MB, 1.83 MB, 1.83 MB, 1.84 MB, 1.85 MB, 1.85 MB, 1.85 MB, 1.86 MB, 1.88 MB, 1.88 MB, 1.89 MB, 1.89 MB, 1.90 MB, 1.90 MB, 1.91 MB, 1.92 MB, 1.92 MB, 1.92 MB, 1.93 MB, 1.93 MB, 1.95 MB, 1.96 MB, 1.97 MB, 1.98 MB, 1.98 MB, 1.99 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 MB (2084904) - PerHostPeakMemUsage: 0 - PrepareTime: 64.004ms - RowsProduced: 0 (0) - TotalCpuTime: 1m7s - TotalNetworkReceiveTime: 1m39s - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 77.034ms, non-child: 0.000ns, % non-child: 0.00%) - CodegenTime: 1.852ms - CompileTime: 4.022ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 11.556ms - PrepareTime: 60.312ms NESTED_LOOP_JOIN_NODE (id=58):(Total: 127.971ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 13.170us - PeakMemoryUsage: 172.00 KB (176128) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=117):(Total: 9s434ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.290us - DeserializeRowBatchTimer: 5.839us - FirstBatchArrivalWaitTime: 9s434ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=57):(Total: 127.550ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 6.536us - PeakMemoryUsage: 164.00 KB (167936) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=114):(Total: 8s799ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.101us - DeserializeRowBatchTimer: 6.851us - FirstBatchArrivalWaitTime: 8s799ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=56):(Total: 127.184ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 14.677us - PeakMemoryUsage: 156.00 KB (159744) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=111):(Total: 12s235ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.156us - DeserializeRowBatchTimer: 6.656us - FirstBatchArrivalWaitTime: 12s235ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=55):(Total: 126.816ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 14.687us - PeakMemoryUsage: 148.00 KB (151552) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=108):(Total: 14s499ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.066us - DeserializeRowBatchTimer: 7.618us - FirstBatchArrivalWaitTime: 14s499ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=54):(Total: 126.446ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 17.349us - PeakMemoryUsage: 140.00 KB (143360) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=105):(Total: 15s731ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.941us - DeserializeRowBatchTimer: 12.559us - FirstBatchArrivalWaitTime: 15s731ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=53):(Total: 126.079ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 1 (1) - BuildTime: 13.989us - PeakMemoryUsage: 132.00 KB (135168) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=102):(Total: 18s125ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.199us - DeserializeRowBatchTimer: 7.904us - FirstBatchArrivalWaitTime: 18s125ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=52):(Total: 125.733ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 7.633us - PeakMemoryUsage: 124.00 KB (126976) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=99):(Total: 931.823ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.517us - DeserializeRowBatchTimer: 37.088us - FirstBatchArrivalWaitTime: 931.688ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=51):(Total: 125.360ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 1 (1) - BuildTime: 6.124us - PeakMemoryUsage: 116.00 KB (118784) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=96):(Total: 3s343ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 3.057us - DeserializeRowBatchTimer: 6.722us - FirstBatchArrivalWaitTime: 3s343ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=50):(Total: 124.919ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 7.648us - PeakMemoryUsage: 108.00 KB (110592) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=93):(Total: 1s111ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 640.000ns - DeserializeRowBatchTimer: 4.303us - FirstBatchArrivalWaitTime: 1s111ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=49):(Total: 124.356ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 1 (1) - BuildTime: 4.998us - PeakMemoryUsage: 100.00 KB (102400) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=90):(Total: 4s059ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 3.260us - DeserializeRowBatchTimer: 8.851us - FirstBatchArrivalWaitTime: 4s059ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=48):(Total: 123.579ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 7.728us - PeakMemoryUsage: 92.00 KB (94208) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=87):(Total: 1s482ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.224us - DeserializeRowBatchTimer: 12.753us - FirstBatchArrivalWaitTime: 1s482ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=47):(Total: 122.992ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 1 (1) - BuildTime: 5.831us - PeakMemoryUsage: 84.00 KB (86016) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=84):(Total: 3s768ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 769.000ns - DeserializeRowBatchTimer: 12.051us - FirstBatchArrivalWaitTime: 3s768ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=46):(Total: 122.668ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 8.610us - PeakMemoryUsage: 76.00 KB (77824) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=81):(Total: 2s000ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.537us - DeserializeRowBatchTimer: 8.125us - FirstBatchArrivalWaitTime: 2s000ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=45):(Total: 122.349ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 1 (1) - BuildTime: 4.778us - PeakMemoryUsage: 68.00 KB (69632) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=78):(Total: 2s391ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.016us - DeserializeRowBatchTimer: 6.933us - FirstBatchArrivalWaitTime: 2s391ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=44):(Total: 122.011ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Join Build-Side Prepared Asynchronously - BuildRows: 1 (1) - BuildTime: 19.659us - PeakMemoryUsage: 60.00 KB (61440) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=75):(Total: 1s717ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 1.718us - DeserializeRowBatchTimer: 8.035us - FirstBatchArrivalWaitTime: 1s717ms - PeakMemoryUsage: 0 - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=43):(Total: 121.633ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 40.00 KB (40960) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=72): BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=42):(Total: 121.277ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 32.00 KB (32768) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=69): BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B - BytesReceived: 16.00 B (16) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 5.095us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=41):(Total: 120.976ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 24.00 KB (24576) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=66): BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns NESTED_LOOP_JOIN_NODE (id=40):(Total: 120.663ms, non-child: 0.000ns, % non-child: 0.00%) - BuildRows: 0 (0) - BuildTime: 0.000ns - PeakMemoryUsage: 16.00 KB (16384) - ProbeRows: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 EXCHANGE_NODE (id=63): BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=60):(Total: 60.209ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.00 KB (4096) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=59): BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8.00 B, 16.00 B, 16.00 B, 32.00 B, 56.00 B, 64.00 B - BytesReceived: 64.00 B (64) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 1.080ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F39:(Total: 10s249ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 56.573ms - RowsProduced: 1 (1) - TotalCpuTime: 69.712ms - TotalNetworkReceiveTime: 10s190ms - TotalNetworkSendTime: 151.919us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 65.739ms, non-child: 65.739ms, % non-child: 100.00%) - CodegenTime: 383.648us - CompileTime: 2.429ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 6.709ms - PrepareTime: 56.027ms DataStreamSender (dst_id=117):(Total: 58.084us, non-child: 58.084us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 636.27 KB/sec - OverallThroughput: 269.01 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 21.019us - TransmitDataRPCTime: 24.557us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=116):(Total: 10s247ms, non-child: 56.635ms, % non-child: 0.55%) - BuildTime: 11.747us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=115):(Total: 10s190ms, non-child: 10s190ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 17.166us - DeserializeRowBatchTimer: 3.741ms - FirstBatchArrivalWaitTime: 3s858ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F38:(Total: 6s646ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 5.37 - BloomFilterBytes: 0 - PeakMemoryUsage: 10.31 MB (10806384) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 37.556ms - RowsProduced: 1 (1) - TotalCpuTime: 27s042ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 766.458us - TotalStorageWaitTime: 25s389ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 74.782ms, non-child: 74.782ms, % non-child: 100.00%) - CodegenTime: 570.639us - CompileTime: 10.440ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 27.974ms - PrepareTime: 35.892ms DataStreamSender (dst_id=115):(Total: 52.752us, non-child: 52.752us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 547.41 KB/sec - OverallThroughput: 309.49 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.528us - TransmitDataRPCTime: 31.217us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 6s639ms, non-child: 148.257ms, % non-child: 2.23%) - BuildTime: 77.441ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 6s490ms, non-child: 6s490ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.45 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 66.570ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 40 (40) - PeakMemoryUsage: 10.15 MB (10646270) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 129.44 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 110 (110) - ScannerThreadsTotalWallClockTime: 27s042ms - MaterializeTupleTime(*): 611.383ms - ScannerThreadsSysTime: 98.256ms - ScannerThreadsUserTime: 901.127ms - ScannerThreadsVoluntaryContextSwitches: 3.61K (3612) - TotalRawHdfsReadTime(*): 44.883ms - TotalReadThroughput: 9.83 MB/sec Averaged Fragment F37:(Total: 9s613ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 53.301ms - RowsProduced: 1 (1) - TotalCpuTime: 69.869ms - TotalNetworkReceiveTime: 9s556ms - TotalNetworkSendTime: 202.369us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 63.140ms, non-child: 63.140ms, % non-child: 100.00%) - CodegenTime: 382.439us - CompileTime: 2.461ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 6.614ms - PrepareTime: 53.496ms DataStreamSender (dst_id=114):(Total: 64.480us, non-child: 64.480us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 433.96 KB/sec - OverallThroughput: 242.32 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 18.663us - TransmitDataRPCTime: 36.006us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=113):(Total: 9s610ms, non-child: 53.993ms, % non-child: 0.56%) - BuildTime: 259.789us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=112):(Total: 9s556ms, non-child: 9s556ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 15.747us - DeserializeRowBatchTimer: 771.908us - FirstBatchArrivalWaitTime: 4s084ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F36:(Total: 7s603ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 4.83 - BloomFilterBytes: 0 - PeakMemoryUsage: 9.17 MB (9610421) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 34.906ms - RowsProduced: 1 (1) - TotalCpuTime: 28s049ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 316.758us - TotalStorageWaitTime: 26s390ms CodeGen:(Total: 71.111ms, non-child: 71.111ms, % non-child: 100.00%) - CodegenTime: 591.615us - CompileTime: 10.415ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 27.319ms - PrepareTime: 32.904ms DataStreamSender (dst_id=112):(Total: 55.540us, non-child: 55.540us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 543.96 KB/sec - OverallThroughput: 292.06 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.133us - TransmitDataRPCTime: 30.400us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 7s597ms, non-child: 133.157ms, % non-child: 1.75%) - BuildTime: 67.610ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 7s463ms, non-child: 7s463ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.85 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 67.727ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 37 (37) - PeakMemoryUsage: 9.04 MB (9478582) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 107.75 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 129 (129) - ScannerThreadsTotalWallClockTime: 28s049ms - MaterializeTupleTime(*): 605.891ms - ScannerThreadsSysTime: 100.543ms - ScannerThreadsUserTime: 896.558ms - ScannerThreadsVoluntaryContextSwitches: 3.58K (3580) - TotalRawHdfsReadTime(*): 41.512ms - TotalReadThroughput: 8.52 MB/sec Averaged Fragment F35:(Total: 12s989ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 39.494ms - RowsProduced: 1 (1) - TotalCpuTime: 55.200ms - TotalNetworkReceiveTime: 12s948ms - TotalNetworkSendTime: 203.198us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 52.022ms, non-child: 52.022ms, % non-child: 100.00%) - CodegenTime: 262.329us - CompileTime: 2.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 7.955ms - PrepareTime: 40.538ms DataStreamSender (dst_id=111):(Total: 59.242us, non-child: 59.242us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 436.21 KB/sec - OverallThroughput: 263.75 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.871us - TransmitDataRPCTime: 35.820us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=110):(Total: 12s987ms, non-child: 39.568ms, % non-child: 0.30%) - BuildTime: 10.093us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=109):(Total: 12s948ms, non-child: 12s948ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 15.263us - DeserializeRowBatchTimer: 122.566us - FirstBatchArrivalWaitTime: 8s391ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F34:(Total: 10s558ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 3.78 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.19 MB (8592979) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 38.128ms - RowsProduced: 1 (1) - TotalCpuTime: 29s558ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 271.274us - TotalStorageWaitTime: 27s983ms CodeGen:(Total: 80.363ms, non-child: 80.363ms, % non-child: 100.00%) - CodegenTime: 599.222us - CompileTime: 12.123ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.556ms - PrepareTime: 36.170ms DataStreamSender (dst_id=109):(Total: 57.596us, non-child: 57.596us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 499.67 KB/sec - OverallThroughput: 278.63 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.832us - TransmitDataRPCTime: 33.354us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 10s552ms, non-child: 150.770ms, % non-child: 1.43%) - BuildTime: 74.186ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 10s401ms, non-child: 10s401ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 2.83 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 67.090ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 30 (30) - PeakMemoryUsage: 8.03 MB (8422426) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 74.26 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 98 (98) - ScannerThreadsTotalWallClockTime: 29s558ms - MaterializeTupleTime(*): 604.925ms - ScannerThreadsSysTime: 98.688ms - ScannerThreadsUserTime: 900.560ms - ScannerThreadsVoluntaryContextSwitches: 3.45K (3452) - TotalRawHdfsReadTime(*): 43.265ms - TotalReadThroughput: 5.86 MB/sec Averaged Fragment F33:(Total: 15s249ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 51.868ms - RowsProduced: 1 (1) - TotalCpuTime: 65.561ms - TotalNetworkReceiveTime: 15s194ms - TotalNetworkSendTime: 229.975us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 60.647ms, non-child: 60.647ms, % non-child: 100.00%) - CodegenTime: 428.402us - CompileTime: 1.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 6.744ms - PrepareTime: 50.858ms DataStreamSender (dst_id=108):(Total: 52.505us, non-child: 52.505us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 640.71 KB/sec - OverallThroughput: 297.59 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.547us - TransmitDataRPCTime: 24.387us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=107):(Total: 15s246ms, non-child: 51.923ms, % non-child: 0.34%) - BuildTime: 7.225us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=106):(Total: 15s194ms, non-child: 15s194ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 14.672us - DeserializeRowBatchTimer: 68.657us - FirstBatchArrivalWaitTime: 9s883ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F32:(Total: 12s479ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 3.31 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.49 MB (8901013) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 46.180ms - RowsProduced: 1 (1) - TotalCpuTime: 30s346ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 245.356us - TotalStorageWaitTime: 28s820ms CodeGen:(Total: 91.748ms, non-child: 91.748ms, % non-child: 100.00%) - CodegenTime: 671.603us - CompileTime: 12.777ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.568ms - PrepareTime: 43.804ms DataStreamSender (dst_id=106):(Total: 57.319us, non-child: 57.319us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 472.07 KB/sec - OverallThroughput: 283.83 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.821us - TransmitDataRPCTime: 34.959us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 12s472ms, non-child: 174.699ms, % non-child: 1.40%) - BuildTime: 80.911ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 12s298ms, non-child: 12s298ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.34 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 66.244ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 27 (27) - PeakMemoryUsage: 8.33 MB (8737883) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 62.04 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 89 (89) - ScannerThreadsTotalWallClockTime: 30s346ms - MaterializeTupleTime(*): 604.224ms - ScannerThreadsSysTime: 96.547ms - ScannerThreadsUserTime: 903.561ms - ScannerThreadsVoluntaryContextSwitches: 3.48K (3476) - TotalRawHdfsReadTime(*): 41.338ms - TotalReadThroughput: 4.92 MB/sec Averaged Fragment F31:(Total: 16s417ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 42.515ms - RowsProduced: 1 (1) - TotalCpuTime: 66.596ms - TotalNetworkReceiveTime: 16s371ms - TotalNetworkSendTime: 730.022us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 62.846ms, non-child: 62.846ms, % non-child: 100.00%) - CodegenTime: 343.277us - CompileTime: 4.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 10.548ms - PrepareTime: 46.528ms DataStreamSender (dst_id=105):(Total: 54.459us, non-child: 54.459us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 712.04 KB/sec - OverallThroughput: 286.91 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.974us - TransmitDataRPCTime: 21.944us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=104):(Total: 16s414ms, non-child: 42.648ms, % non-child: 0.26%) - BuildTime: 10.985us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=103):(Total: 16s372ms, non-child: 16s372ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 13.576us - DeserializeRowBatchTimer: 60.193us - FirstBatchArrivalWaitTime: 11s624ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F30:(Total: 14s162ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 3.10 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.38 MB (8787364) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 50.380ms - RowsProduced: 1 (1) - TotalCpuTime: 31s304ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 262.666us - TotalStorageWaitTime: 29s832ms CodeGen:(Total: 94.786ms, non-child: 94.786ms, % non-child: 100.00%) - CodegenTime: 605.662us - CompileTime: 11.896ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.331ms - PrepareTime: 47.329ms DataStreamSender (dst_id=103):(Total: 47.069us, non-child: 47.069us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 636.65 KB/sec - OverallThroughput: 343.78 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.996us - TransmitDataRPCTime: 26.974us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 14s156ms, non-child: 169.772ms, % non-child: 1.20%) - BuildTime: 74.677ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 13s986ms, non-child: 13s986ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.13 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 70.113ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 24 (24) - PeakMemoryUsage: 8.31 MB (8708468) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 54.37 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 104 (104) - ScannerThreadsTotalWallClockTime: 31s304ms - MaterializeTupleTime(*): 602.721ms - ScannerThreadsSysTime: 99.691ms - ScannerThreadsUserTime: 909.135ms - ScannerThreadsVoluntaryContextSwitches: 3.40K (3404) - TotalRawHdfsReadTime(*): 42.224ms - TotalReadThroughput: 4.30 MB/sec Averaged Fragment F29:(Total: 18s809ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 67.061ms - RowsProduced: 1 (1) - TotalCpuTime: 84.150ms - TotalNetworkReceiveTime: 18s741ms - TotalNetworkSendTime: 213.315us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 80.442ms, non-child: 80.442ms, % non-child: 100.00%) - CodegenTime: 351.345us - CompileTime: 3.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 8.950ms - PrepareTime: 62.326ms DataStreamSender (dst_id=102):(Total: 68.292us, non-child: 68.292us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 462.22 KB/sec - OverallThroughput: 228.80 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.960us - TransmitDataRPCTime: 33.804us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=101):(Total: 18s808ms, non-child: 67.127ms, % non-child: 0.36%) - BuildTime: 12.723us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=100):(Total: 18s741ms, non-child: 18s741ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 13.227us - DeserializeRowBatchTimer: 236.029us - FirstBatchArrivalWaitTime: 14s011ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F28:(Total: 15s677ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.68 MB (9099154) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 44.225ms - RowsProduced: 1 (1) - TotalCpuTime: 32s000ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 238.657us - TotalStorageWaitTime: 30s644ms CodeGen:(Total: 89.044ms, non-child: 89.044ms, % non-child: 100.00%) - CodegenTime: 558.895us - CompileTime: 14.121ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.045ms - PrepareTime: 41.828ms DataStreamSender (dst_id=100):(Total: 48.788us, non-child: 48.788us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 587.45 KB/sec - OverallThroughput: 334.79 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.337us - TransmitDataRPCTime: 28.612us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 15s670ms, non-child: 165.136ms, % non-child: 1.05%) - BuildTime: 71.466ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 15s505ms, non-child: 15s505ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.01 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 61.659ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 20 (20) - PeakMemoryUsage: 8.64 MB (9061700) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 48.83 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 113 (113) - ScannerThreadsTotalWallClockTime: 32s000ms - MaterializeTupleTime(*): 589.872ms - ScannerThreadsSysTime: 96.691ms - ScannerThreadsUserTime: 902.709ms - ScannerThreadsVoluntaryContextSwitches: 3.26K (3259) - TotalRawHdfsReadTime(*): 44.612ms - TotalReadThroughput: 3.88 MB/sec Averaged Fragment F27:(Total: 19s707ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 64.832ms - RowsProduced: 1 (1) - TotalCpuTime: 85.463ms - TotalNetworkReceiveTime: 19s640ms - TotalNetworkSendTime: 209.333us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 81.462ms, non-child: 81.462ms, % non-child: 100.00%) - CodegenTime: 449.810us - CompileTime: 4.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 9.690ms - PrepareTime: 66.051ms DataStreamSender (dst_id=99):(Total: 60.674us, non-child: 60.674us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 507.63 KB/sec - OverallThroughput: 257.52 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.589us - TransmitDataRPCTime: 30.780us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=98):(Total: 19s705ms, non-child: 64.894ms, % non-child: 0.33%) - BuildTime: 9.809us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=97):(Total: 19s640ms, non-child: 19s640ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 11.662us - DeserializeRowBatchTimer: 465.230us - FirstBatchArrivalWaitTime: 14s417ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F26:(Total: 16s880ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.47 MB (8882581) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 48.802ms - RowsProduced: 1 (1) - TotalCpuTime: 32s759ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 289.997us - TotalStorageWaitTime: 31s339ms CodeGen:(Total: 90.864ms, non-child: 90.864ms, % non-child: 100.00%) - CodegenTime: 590.632us - CompileTime: 11.378ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.008ms - PrepareTime: 46.699ms DataStreamSender (dst_id=97):(Total: 50.044us, non-child: 50.044us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 560.65 KB/sec - OverallThroughput: 316.16 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.352us - TransmitDataRPCTime: 28.570us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 16s873ms, non-child: 184.661ms, % non-child: 1.09%) - BuildTime: 81.021ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 16s688ms, non-child: 16s688ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.95 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 62.229ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 20 (20) - PeakMemoryUsage: 8.38 MB (8784865) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 45.55 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 136 (136) - ScannerThreadsTotalWallClockTime: 32s759ms - MaterializeTupleTime(*): 598.661ms - ScannerThreadsSysTime: 97.833ms - ScannerThreadsUserTime: 902.852ms - ScannerThreadsVoluntaryContextSwitches: 3.28K (3276) - TotalRawHdfsReadTime(*): 41.562ms - TotalReadThroughput: 3.64 MB/sec Averaged Fragment F25:(Total: 22s074ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 73.912ms - RowsProduced: 1 (1) - TotalCpuTime: 97.133ms - TotalNetworkReceiveTime: 21s999ms - TotalNetworkSendTime: 187.856us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 92.530ms, non-child: 92.530ms, % non-child: 100.00%) - CodegenTime: 417.301us - CompileTime: 3.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 13.423ms - PrepareTime: 72.116ms DataStreamSender (dst_id=96):(Total: 73.806us, non-child: 73.806us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 393.43 KB/sec - OverallThroughput: 211.70 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 21.680us - TransmitDataRPCTime: 39.715us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=95):(Total: 22s073ms, non-child: 74.203ms, % non-child: 0.34%) - BuildTime: 220.300us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=94):(Total: 21s999ms, non-child: 21s999ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 13.431us - DeserializeRowBatchTimer: 49.043us - FirstBatchArrivalWaitTime: 15s675ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F24:(Total: 19s088ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.77 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.59 MB (9004336) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 51.424ms - RowsProduced: 1 (1) - TotalCpuTime: 33s972ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 229.630us - TotalStorageWaitTime: 32s545ms CodeGen:(Total: 93.684ms, non-child: 93.684ms, % non-child: 100.00%) - CodegenTime: 628.728us - CompileTime: 11.803ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.060ms - PrepareTime: 48.595ms DataStreamSender (dst_id=94):(Total: 52.091us, non-child: 52.091us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 529.04 KB/sec - OverallThroughput: 304.19 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.090us - TransmitDataRPCTime: 30.075us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 19s082ms, non-child: 191.244ms, % non-child: 1.00%) - BuildTime: 74.399ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 18s891ms, non-child: 18s891ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.78 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 70.063ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 8.52 MB (8930006) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 40.19 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 124 (124) - ScannerThreadsTotalWallClockTime: 33s972ms - MaterializeTupleTime(*): 593.724ms - ScannerThreadsSysTime: 104.834ms - ScannerThreadsUserTime: 902.996ms - ScannerThreadsVoluntaryContextSwitches: 3.25K (3246) - TotalRawHdfsReadTime(*): 42.553ms - TotalReadThroughput: 3.20 MB/sec Averaged Fragment F23:(Total: 23s150ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 72.817ms - RowsProduced: 1 (1) - TotalCpuTime: 102.185ms - TotalNetworkReceiveTime: 23s075ms - TotalNetworkSendTime: 177.625us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 95.695ms, non-child: 95.695ms, % non-child: 100.00%) - CodegenTime: 365.517us - CompileTime: 2.534ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 13.010ms - PrepareTime: 78.538ms DataStreamSender (dst_id=93):(Total: 62.636us, non-child: 62.636us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 408.23 KB/sec - OverallThroughput: 249.46 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.457us - TransmitDataRPCTime: 38.275us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=92):(Total: 23s148ms, non-child: 73.008ms, % non-child: 0.32%) - BuildTime: 145.699us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=91):(Total: 23s075ms, non-child: 23s075ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 16.140us - DeserializeRowBatchTimer: 48.441us - FirstBatchArrivalWaitTime: 17s845ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F22:(Total: 20s718ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.71 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.09 MB (8481501) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 46.580ms - RowsProduced: 1 (1) - TotalCpuTime: 35s192ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 234.852us - TotalStorageWaitTime: 33s788ms CodeGen:(Total: 87.902ms, non-child: 87.902ms, % non-child: 100.00%) - CodegenTime: 587.639us - CompileTime: 11.367ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.507ms - PrepareTime: 44.303ms DataStreamSender (dst_id=91):(Total: 51.424us, non-child: 51.424us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 574.97 KB/sec - OverallThroughput: 308.12 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 12.852us - TransmitDataRPCTime: 28.535us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 20s712ms, non-child: 217.132ms, % non-child: 1.05%) - BuildTime: 78.283ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 20s495ms, non-child: 20s495ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.72 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 63.033ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 7.92 MB (8301230) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 36.95 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 102 (102) - ScannerThreadsTotalWallClockTime: 35s192ms - MaterializeTupleTime(*): 583.884ms - ScannerThreadsSysTime: 102.835ms - ScannerThreadsUserTime: 894.997ms - ScannerThreadsVoluntaryContextSwitches: 3.23K (3229) - TotalRawHdfsReadTime(*): 41.331ms - TotalReadThroughput: 2.97 MB/sec Averaged Fragment F21:(Total: 26s074ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 65.765ms - RowsProduced: 1 (1) - TotalCpuTime: 85.572ms - TotalNetworkReceiveTime: 26s006ms - TotalNetworkSendTime: 209.381us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 78.749ms, non-child: 78.749ms, % non-child: 100.00%) - CodegenTime: 468.430us - CompileTime: 2.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 8.846ms - PrepareTime: 61.204ms DataStreamSender (dst_id=90):(Total: 71.558us, non-child: 71.558us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 404.25 KB/sec - OverallThroughput: 218.35 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 20.874us - TransmitDataRPCTime: 38.652us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=89):(Total: 26s073ms, non-child: 66.257ms, % non-child: 0.25%) - BuildTime: 442.453us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=88):(Total: 26s006ms, non-child: 26s006ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 25.000us - DeserializeRowBatchTimer: 175.662us - FirstBatchArrivalWaitTime: 18s537ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F20:(Total: 22s621ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.65 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.07 MB (8462293) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 49.911ms - RowsProduced: 1 (1) - TotalCpuTime: 36s306ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 246.429us - TotalStorageWaitTime: 34s881ms CodeGen:(Total: 92.713ms, non-child: 92.713ms, % non-child: 100.00%) - CodegenTime: 622.436us - CompileTime: 11.919ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.188ms - PrepareTime: 47.681ms DataStreamSender (dst_id=88):(Total: 48.514us, non-child: 48.514us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 626.20 KB/sec - OverallThroughput: 326.58 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.366us - TransmitDataRPCTime: 27.708us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 22s615ms, non-child: 246.485ms, % non-child: 1.09%) - BuildTime: 85.416ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 22s369ms, non-child: 22s369ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.66 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 68.303ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 7.90 MB (8280244) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 33.93 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 107 (107) - ScannerThreadsTotalWallClockTime: 36s306ms - MaterializeTupleTime(*): 602.221ms - ScannerThreadsSysTime: 100.835ms - ScannerThreadsUserTime: 912.852ms - ScannerThreadsVoluntaryContextSwitches: 3.28K (3276) - TotalRawHdfsReadTime(*): 44.380ms - TotalReadThroughput: 2.71 MB/sec Averaged Fragment F19:(Total: 27s515ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 64.617ms - RowsProduced: 1 (1) - TotalCpuTime: 77.567ms - TotalNetworkReceiveTime: 27s449ms - TotalNetworkSendTime: 229.817us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 75.267ms, non-child: 75.267ms, % non-child: 100.00%) - CodegenTime: 342.040us - CompileTime: 2.584ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 7.217ms - PrepareTime: 63.667ms DataStreamSender (dst_id=87):(Total: 62.767us, non-child: 62.767us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 477.41 KB/sec - OverallThroughput: 248.94 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 18.139us - TransmitDataRPCTime: 32.729us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=86):(Total: 27s514ms, non-child: 64.724ms, % non-child: 0.24%) - BuildTime: 20.140us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=85):(Total: 27s449ms, non-child: 27s449ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 21.070us - DeserializeRowBatchTimer: 54.988us - FirstBatchArrivalWaitTime: 20s613ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F18:(Total: 23s561ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.62 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.10 MB (8498204) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 46.203ms - RowsProduced: 1 (1) - TotalCpuTime: 36s912ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 239.830us - TotalStorageWaitTime: 35s475ms CodeGen:(Total: 86.227ms, non-child: 86.227ms, % non-child: 100.00%) - CodegenTime: 633.239us - CompileTime: 11.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.376ms - PrepareTime: 43.948ms DataStreamSender (dst_id=85):(Total: 53.559us, non-child: 53.559us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 480.34 KB/sec - OverallThroughput: 294.70 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.550us - TransmitDataRPCTime: 33.480us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=19):(Total: 23s555ms, non-child: 208.061ms, % non-child: 0.88%) - BuildTime: 74.095ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=18):(Total: 23s347ms, non-child: 23s347ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.63 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 61.756ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 7.93 MB (8315250) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 32.50 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 122 (122) - ScannerThreadsTotalWallClockTime: 36s912ms - MaterializeTupleTime(*): 593.343ms - ScannerThreadsSysTime: 108.120ms - ScannerThreadsUserTime: 895.427ms - ScannerThreadsVoluntaryContextSwitches: 3.21K (3211) - TotalRawHdfsReadTime(*): 42.001ms - TotalReadThroughput: 2.60 MB/sec Averaged Fragment F17:(Total: 29s763ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 67.599ms - RowsProduced: 1 (1) - TotalCpuTime: 84.727ms - TotalNetworkReceiveTime: 29s694ms - TotalNetworkSendTime: 323.558us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 80.992ms, non-child: 80.992ms, % non-child: 100.00%) - CodegenTime: 446.587us - CompileTime: 2.960ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 9.597ms - PrepareTime: 66.433ms DataStreamSender (dst_id=84):(Total: 58.569us, non-child: 58.569us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 477.07 KB/sec - OverallThroughput: 266.78 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.654us - TransmitDataRPCTime: 32.752us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=83):(Total: 29s762ms, non-child: 67.655ms, % non-child: 0.23%) - BuildTime: 9.185us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=82):(Total: 29s694ms, non-child: 29s694ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 15.440us - DeserializeRowBatchTimer: 750.888us - FirstBatchArrivalWaitTime: 22s136ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F16:(Total: 26s066ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.51 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.28 MB (8677281) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 51.190ms - RowsProduced: 1 (1) - TotalCpuTime: 38s715ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 306.388us - TotalStorageWaitTime: 37s320ms CodeGen:(Total: 93.773ms, non-child: 93.773ms, % non-child: 100.00%) - CodegenTime: 553.622us - CompileTime: 11.867ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.224ms - PrepareTime: 48.609ms DataStreamSender (dst_id=82):(Total: 50.228us, non-child: 50.228us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 554.76 KB/sec - OverallThroughput: 317.88 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.735us - TransmitDataRPCTime: 28.981us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=17):(Total: 26s059ms, non-child: 263.175ms, % non-child: 1.01%) - BuildTime: 80.033ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=16):(Total: 25s796ms, non-child: 25s796ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.53 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 63.178ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 8.15 MB (8549762) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 29.36 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 125 (125) - ScannerThreadsTotalWallClockTime: 38s715ms - MaterializeTupleTime(*): 598.736ms - ScannerThreadsSysTime: 101.408ms - ScannerThreadsUserTime: 909.568ms - ScannerThreadsVoluntaryContextSwitches: 3.21K (3211) - TotalRawHdfsReadTime(*): 41.461ms - TotalReadThroughput: 2.34 MB/sec Averaged Fragment F15:(Total: 31s731ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 56.739ms - RowsProduced: 1 (1) - TotalCpuTime: 75.920ms - TotalNetworkReceiveTime: 31s674ms - TotalNetworkSendTime: 177.355us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 74.168ms, non-child: 74.168ms, % non-child: 100.00%) - CodegenTime: 338.946us - CompileTime: 5.852ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 10.629ms - PrepareTime: 56.330ms DataStreamSender (dst_id=81):(Total: 68.580us, non-child: 68.580us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 405.30 KB/sec - OverallThroughput: 227.84 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 18.799us - TransmitDataRPCTime: 38.552us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=80):(Total: 31s730ms, non-child: 56.833ms, % non-child: 0.18%) - BuildTime: 12.425us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=79):(Total: 31s674ms, non-child: 31s674ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 17.137us - DeserializeRowBatchTimer: 69.331us - FirstBatchArrivalWaitTime: 22s984ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F14:(Total: 26s415ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.48 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.20 MB (8602672) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 47.647ms - RowsProduced: 1 (1) - TotalCpuTime: 38s692ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 294.611us - TotalStorageWaitTime: 37s267ms CodeGen:(Total: 92.137ms, non-child: 92.137ms, % non-child: 100.00%) - CodegenTime: 637.416us - CompileTime: 11.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.555ms - PrepareTime: 45.218ms DataStreamSender (dst_id=79):(Total: 53.759us, non-child: 53.759us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 572.77 KB/sec - OverallThroughput: 307.28 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 12.149us - TransmitDataRPCTime: 30.058us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=15):(Total: 26s408ms, non-child: 232.845ms, % non-child: 0.88%) - BuildTime: 77.186ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=14):(Total: 26s175ms, non-child: 26s175ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.49 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 62.276ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 8.08 MB (8468660) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 28.98 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 114 (114) - ScannerThreadsTotalWallClockTime: 38s692ms - MaterializeTupleTime(*): 593.977ms - ScannerThreadsSysTime: 102.693ms - ScannerThreadsUserTime: 905.856ms - ScannerThreadsVoluntaryContextSwitches: 3.25K (3251) - TotalRawHdfsReadTime(*): 41.274ms - TotalReadThroughput: 2.31 MB/sec Averaged Fragment F13:(Total: 32s080ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 59.303ms - RowsProduced: 1 (1) - TotalCpuTime: 87.138ms - TotalNetworkReceiveTime: 32s020ms - TotalNetworkSendTime: 180.867us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 80.897ms, non-child: 80.897ms, % non-child: 100.00%) - CodegenTime: 460.865us - CompileTime: 6.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 13.560ms - PrepareTime: 57.294ms DataStreamSender (dst_id=78):(Total: 80.278us, non-child: 80.278us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 513.81 KB/sec - OverallThroughput: 194.64 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 36.340us - TransmitDataRPCTime: 30.410us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=77):(Total: 32s079ms, non-child: 59.392ms, % non-child: 0.19%) - BuildTime: 24.523us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=76):(Total: 32s020ms, non-child: 32s020ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 14.009us - DeserializeRowBatchTimer: 57.834us - FirstBatchArrivalWaitTime: 22s807ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F12:(Total: 27s669ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.45 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.06 MB (8451651) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 47.053ms - RowsProduced: 1 (1) - TotalCpuTime: 39s517ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 228.178us - TotalStorageWaitTime: 38s103ms CodeGen:(Total: 88.254ms, non-child: 88.254ms, % non-child: 100.00%) - CodegenTime: 648.530us - CompileTime: 11.601ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.174ms - PrepareTime: 44.773ms DataStreamSender (dst_id=76):(Total: 48.864us, non-child: 48.864us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 568.43 KB/sec - OverallThroughput: 326.32 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.414us - TransmitDataRPCTime: 28.579us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=13):(Total: 27s662ms, non-child: 274.481ms, % non-child: 0.99%) - BuildTime: 73.917ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=12):(Total: 27s388ms, non-child: 27s388ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.46 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 61.508ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 7.96 MB (8350428) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 27.74 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 103 (103) - ScannerThreadsTotalWallClockTime: 39s517ms - MaterializeTupleTime(*): 602.614ms - ScannerThreadsSysTime: 98.979ms - ScannerThreadsUserTime: 915.997ms - ScannerThreadsVoluntaryContextSwitches: 3.25K (3246) - TotalRawHdfsReadTime(*): 41.228ms - TotalReadThroughput: 2.21 MB/sec Averaged Fragment F11:(Total: 33s776ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 63.602ms - RowsProduced: 1 (1) - TotalCpuTime: 83.209ms - TotalNetworkReceiveTime: 33s710ms - TotalNetworkSendTime: 303.492us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 80.421ms, non-child: 80.421ms, % non-child: 100.00%) - CodegenTime: 469.867us - CompileTime: 2.467ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 12.495ms - PrepareTime: 64.509ms DataStreamSender (dst_id=75):(Total: 52.380us, non-child: 52.380us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 694.35 KB/sec - OverallThroughput: 298.30 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.009us - TransmitDataRPCTime: 22.503us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=74):(Total: 33s774ms, non-child: 63.677ms, % non-child: 0.19%) - BuildTime: 9.790us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=73):(Total: 33s710ms, non-child: 33s710ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 12.703us - DeserializeRowBatchTimer: 73.985us - FirstBatchArrivalWaitTime: 25s733ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F10:(Total: 29s752ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.84 MB (8220321) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 49.462ms - RowsProduced: 1 (1) - TotalCpuTime: 41s276ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 827.329us - TotalStorageWaitTime: 39s875ms CodeGen:(Total: 90.916ms, non-child: 90.916ms, % non-child: 100.00%) - CodegenTime: 650.647us - CompileTime: 11.769ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.018ms - PrepareTime: 47.528ms DataStreamSender (dst_id=73):(Total: 47.257us, non-child: 47.257us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 624.17 KB/sec - OverallThroughput: 334.58 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.306us - TransmitDataRPCTime: 25.922us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=11):(Total: 29s744ms, non-child: 289.036ms, % non-child: 0.97%) - BuildTime: 73.857ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=10):(Total: 29s455ms, non-child: 29s455ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.41 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 70.064ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 7.75 MB (8128485) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 25.80 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 96 (96) - ScannerThreadsTotalWallClockTime: 41s276ms - MaterializeTupleTime(*): 594.914ms - ScannerThreadsSysTime: 101.551ms - ScannerThreadsUserTime: 907.855ms - ScannerThreadsVoluntaryContextSwitches: 3.29K (3292) - TotalRawHdfsReadTime(*): 42.719ms - TotalReadThroughput: 2.06 MB/sec Averaged Fragment F09:(Total: 72.064ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 56.02 KB (57360) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 67.262ms - RowsProduced: 0 (0) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 34s059ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 86.277ms, non-child: 86.277ms, % non-child: 100.00%) - CodegenTime: 413.051us - CompileTime: 2.941ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 13.366ms - PrepareTime: 68.939ms DataStreamSender (dst_id=72):(Total: 13.575us, non-child: 13.575us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=71):(Total: 67.261ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 32.00 KB (32768) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=70):(Total: 26s192ms, non-child: 26s192ms, % non-child: 100.00%) - BytesReceived: 80.00 B (80) - ConvertRowBatchTime: 9.607us - DeserializeRowBatchTimer: 33.093us - FirstBatchArrivalWaitTime: 26s192ms - PeakMemoryUsage: 0 - RowsReturned: 5 (5) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F08:(Total: 26s072ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.43 MB (8841397) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 49.312ms - RowsProduced: 0 (0) - TotalCpuTime: 37s101ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 192.856us - TotalStorageWaitTime: 40s420ms CodeGen:(Total: 91.300ms, non-child: 91.300ms, % non-child: 100.00%) - CodegenTime: 559.251us - CompileTime: 13.250ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.454ms - PrepareTime: 46.963ms DataStreamSender (dst_id=70):(Total: 50.057us, non-child: 50.057us, % non-child: 100.00%) - BytesSent: 13.00 B (13) - NetworkThroughput(*): 422.38 KB/sec - OverallThroughput: 245.00 KB/sec - RowsReturned: 0 (0) - SerializeBatchTime: 9.761us - TransmitDataRPCTime: 29.200us - UncompressedRowBatchSize: 13.00 B (13) AGGREGATION_NODE (id=9):(Total: 26s066ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 75.853ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=8):(Total: 30s524ms, non-child: 30s524ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.36 - BytesRead: 60.01 MB (62921417) - BytesReadDataNodeCache: 0 - BytesReadLocal: 51.48 MB (53982247) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 51.48 MB (53982247) - DecompressionTime: 70.231ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 6 (6) - NumRowGroups: 259 (259) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 8.33 MB (8737816) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.10M (4102277) - RowsReturned: 749.27K (749274) - RowsReturnedRate: 24.81 K/sec - ScanRangesComplete: 259 (259) - ScannerThreadsInvoluntaryContextSwitches: 105 (105) - ScannerThreadsTotalWallClockTime: 37s101ms - MaterializeTupleTime(*): 591.819ms - ScannerThreadsSysTime: 92.552ms - ScannerThreadsUserTime: 825.868ms - ScannerThreadsVoluntaryContextSwitches: 2.97K (2970) - TotalRawHdfsReadTime(*): 42.400ms - TotalReadThroughput: 1.98 MB/sec Averaged Fragment F07:(Total: 36s414ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 82.528ms - RowsProduced: 1 (1) - TotalCpuTime: 111.965ms - TotalNetworkReceiveTime: 36s329ms - TotalNetworkSendTime: 265.074us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 106.150ms, non-child: 106.150ms, % non-child: 100.00%) - CodegenTime: 409.774us - CompileTime: 3.304ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 9.576ms - PrepareTime: 92.397ms DataStreamSender (dst_id=69):(Total: 86.340us, non-child: 86.340us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 265.27 KB/sec - OverallThroughput: 180.97 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.816us - TransmitDataRPCTime: 58.903us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=68):(Total: 36s412ms, non-child: 83.047ms, % non-child: 0.23%) - BuildTime: 450.732us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=67):(Total: 36s329ms, non-child: 36s329ms, % non-child: 100.00%) - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 12.524us - DeserializeRowBatchTimer: 99.635us - FirstBatchArrivalWaitTime: 28s780ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F06:(Total: 32s360ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.82 MB (8201450) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 51.722ms - RowsProduced: 1 (1) - TotalCpuTime: 43s060ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 216.055us - TotalStorageWaitTime: 41s672ms CodeGen:(Total: 94.958ms, non-child: 94.958ms, % non-child: 100.00%) - CodegenTime: 693.323us - CompileTime: 11.227ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 33.557ms - PrepareTime: 49.578ms DataStreamSender (dst_id=67):(Total: 50.477us, non-child: 50.477us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 584.08 KB/sec - OverallThroughput: 314.67 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.146us - TransmitDataRPCTime: 27.116us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=7):(Total: 32s353ms, non-child: 241.154ms, % non-child: 0.75%) - BuildTime: 73.793ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=6):(Total: 32s112ms, non-child: 32s112ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.34 - BytesRead: 60.18 MB (63100616) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.18 MB (63100616) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.18 MB (63100616) - DecompressionTime: 62.512ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 260 (260) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 7.72 MB (8096082) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.11M (4114427) - RowsReturned: 751.58K (751578) - RowsReturnedRate: 23.53 K/sec - ScanRangesComplete: 260 (260) - ScannerThreadsInvoluntaryContextSwitches: 97 (97) - ScannerThreadsTotalWallClockTime: 43s060ms - MaterializeTupleTime(*): 590.134ms - ScannerThreadsSysTime: 103.980ms - ScannerThreadsUserTime: 897.572ms - ScannerThreadsVoluntaryContextSwitches: 3.25K (3254) - TotalRawHdfsReadTime(*): 41.508ms - TotalReadThroughput: 1.88 MB/sec Averaged Fragment F05:(Total: 67.521ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 48.02 KB (49168) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 65.422ms - RowsProduced: 0 (0) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 32s086ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 77.693ms, non-child: 77.693ms, % non-child: 100.00%) - CodegenTime: 406.974us - CompileTime: 2.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 8.051ms - PrepareTime: 63.983ms DataStreamSender (dst_id=66):(Total: 14.695us, non-child: 14.695us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=65):(Total: 65.421ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 24.00 KB (24576) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=64):(Total: 29s560ms, non-child: 29s560ms, % non-child: 100.00%) - BytesReceived: 48.00 B (48) - ConvertRowBatchTime: 6.428us - DeserializeRowBatchTimer: 2.902ms - FirstBatchArrivalWaitTime: 29s560ms - PeakMemoryUsage: 0 - RowsReturned: 3 (3) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F04:(Total: 23s644ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.71 MB (8079844) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 50.448ms - RowsProduced: 0 (0) - TotalCpuTime: 34s010ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 606.731us - TotalStorageWaitTime: 42s210ms CodeGen:(Total: 95.598ms, non-child: 95.598ms, % non-child: 100.00%) - CodegenTime: 580.040us - CompileTime: 11.413ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.997ms - PrepareTime: 48.407ms DataStreamSender (dst_id=64):(Total: 41.036us, non-child: 41.036us, % non-child: 100.00%) - BytesSent: 11.00 B (11) - NetworkThroughput(*): 384.76 KB/sec - OverallThroughput: 218.24 KB/sec - RowsReturned: 0 (0) - SerializeBatchTime: 7.346us - TransmitDataRPCTime: 23.047us - UncompressedRowBatchSize: 11.00 B (11) AGGREGATION_NODE (id=5):(Total: 23s637ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 87.322ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=4):(Total: 32s803ms, non-child: 32s803ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.30 - BytesRead: 59.86 MB (62766717) - BytesReadDataNodeCache: 0 - BytesReadLocal: 42.55 MB (44615935) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 42.55 MB (44615935) - DecompressionTime: 69.568ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 5 (5) - NumRowGroups: 259 (259) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 7.53 MB (7890558) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.09M (4093857) - RowsReturned: 747.72K (747723) - RowsReturnedRate: 22.92 K/sec - ScanRangesComplete: 258 (258) - ScannerThreadsInvoluntaryContextSwitches: 97 (97) - ScannerThreadsTotalWallClockTime: 34s011ms - MaterializeTupleTime(*): 599.790ms - ScannerThreadsSysTime: 77.127ms - ScannerThreadsUserTime: 706.316ms - ScannerThreadsVoluntaryContextSwitches: 2.43K (2426) - TotalRawHdfsReadTime(*): 41.443ms - TotalReadThroughput: 1.82 MB/sec Averaged Fragment F03:(Total: 66.361ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 52.02 KB (53264) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 65.482ms - RowsProduced: 0 (0) - TotalCpuTime: 0.000ns - TotalNetworkReceiveTime: 35s189ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 90.582ms, non-child: 90.582ms, % non-child: 100.00%) - CodegenTime: 480.762us - CompileTime: 6.032ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 16.898ms - PrepareTime: 66.431ms DataStreamSender (dst_id=63):(Total: 12.529us, non-child: 12.529us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=62):(Total: 65.481ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 28.00 KB (28672) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=61):(Total: 29s205ms, non-child: 29s205ms, % non-child: 100.00%) - BytesReceived: 64.00 B (64) - ConvertRowBatchTime: 7.935us - DeserializeRowBatchTimer: 45.902us - FirstBatchArrivalWaitTime: 29s205ms - PeakMemoryUsage: 0 - RowsReturned: 4 (4) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 18s532ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.29 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.90 MB (8285109) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 53.633ms - RowsProduced: 0 (0) - TotalCpuTime: 28s627ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 556.838us - TotalStorageWaitTime: 42s060ms CodeGen:(Total: 97.164ms, non-child: 97.164ms, % non-child: 100.00%) - CodegenTime: 678.872us - CompileTime: 11.520ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 33.805ms - PrepareTime: 50.774ms DataStreamSender (dst_id=61):(Total: 37.046us, non-child: 37.046us, % non-child: 100.00%) - BytesSent: 9.00 B (9) - NetworkThroughput(*): 302.11 KB/sec - OverallThroughput: 163.53 KB/sec - RowsReturned: 0 (0) - SerializeBatchTime: 6.576us - TransmitDataRPCTime: 19.250us - UncompressedRowBatchSize: 9.00 B (9) AGGREGATION_NODE (id=3):(Total: 18s524ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 78.347ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 695.30 KB (711987) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=2):(Total: 33s144ms, non-child: 33s144ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.29 - BytesRead: 59.59 MB (62480746) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.47 MB (36140089) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.47 MB (36140089) - DecompressionTime: 67.365ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 257 (257) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 7.80 MB (8176632) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.07M (4074762) - RowsReturned: 744.07K (744069) - RowsReturnedRate: 22.55 K/sec - ScanRangesComplete: 257 (257) - ScannerThreadsInvoluntaryContextSwitches: 53 (53) - ScannerThreadsTotalWallClockTime: 28s569ms - MaterializeTupleTime(*): 605.882ms - ScannerThreadsSysTime: 72.128ms - ScannerThreadsUserTime: 660.466ms - ScannerThreadsVoluntaryContextSwitches: 2.38K (2381) - TotalRawHdfsReadTime(*): 40.948ms - TotalReadThroughput: 1.80 MB/sec Averaged Fragment F00:(Total: 19s776ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 247.57 MB, max: 248.26 MB, avg: 248.01 MB, stddev: 242.62 KB - AverageThreadTokens: 2.26 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.50 MB (7866917) - PerHostPeakMemUsage: 59.53 MB (62421278) - PrepareTime: 52.436ms - RowsProduced: 0 (0) - TotalCpuTime: 29s588ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 392.453us - TotalStorageWaitTime: 42s946ms CodeGen:(Total: 98.077ms, non-child: 98.077ms, % non-child: 100.00%) - CodegenTime: 618.783us - CompileTime: 14.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.781ms - PrepareTime: 50.230ms DataStreamSender (dst_id=59):(Total: 31.822us, non-child: 31.822us, % non-child: 100.00%) - BytesSent: 9.00 B (9) - NetworkThroughput(*): 343.09 KB/sec - OverallThroughput: 185.89 KB/sec - RowsReturned: 0 (0) - SerializeBatchTime: 5.750us - TransmitDataRPCTime: 15.509us - UncompressedRowBatchSize: 9.00 B (9) AGGREGATION_NODE (id=1):(Total: 19s769ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 71.280ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 694.60 KB (711274) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 34s275ms, non-child: 34s275ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.27 - BytesRead: 59.26 MB (62142917) - BytesReadDataNodeCache: 0 - BytesReadLocal: 34.47 MB (36140089) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 34.47 MB (36140089) - DecompressionTime: 69.447ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 4 (4) - NumRowGroups: 256 (256) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 7.40 MB (7761222) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4052103) - RowsReturned: 739.84K (739840) - RowsReturnedRate: 21.63 K/sec - ScanRangesComplete: 256 (256) - ScannerThreadsInvoluntaryContextSwitches: 83 (83) - ScannerThreadsTotalWallClockTime: 29s507ms - MaterializeTupleTime(*): 601.673ms - ScannerThreadsSysTime: 72.842ms - ScannerThreadsUserTime: 655.753ms - ScannerThreadsVoluntaryContextSwitches: 2.32K (2321) - TotalRawHdfsReadTime(*): 41.795ms - TotalReadThroughput: 1.72 MB/sec Fragment F39: Instance da46dbd7c4e8e43b:bc4eab3900000001 (host=vd1309.halxg.cloudera.com:22000):(Total: 10s249ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 44.01 KB, 44.01 KB, 44.01 KB, 48.01 KB, 52.01 KB, 52.01 KB, 52.01 KB, 56.01 KB, 60.01 KB, 60.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 56.573ms - RowsProduced: 1 (1) - TotalCpuTime: 69.712ms - TotalNetworkReceiveTime: 10s190ms - TotalNetworkSendTime: 151.919us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 65.739ms, non-child: 65.739ms, % non-child: 100.00%) - CodegenTime: 383.648us - CompileTime: 2.429ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 6.709ms - PrepareTime: 56.027ms DataStreamSender (dst_id=117):(Total: 58.084us, non-child: 58.084us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 636.27 KB/sec - OverallThroughput: 269.01 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 21.019us - TransmitDataRPCTime: 24.557us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=116):(Total: 10s247ms, non-child: 56.635ms, % non-child: 0.55%) ExecOption: Codegen Enabled - BuildTime: 11.747us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=115):(Total: 10s190ms, non-child: 121.292us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 32.00 B, 32.00 B, 32.00 B, 48.00 B, 64.00 B, 64.00 B, 64.00 B, 80.00 B, 96.00 B, 96.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 17.166us - DeserializeRowBatchTimer: 3.741ms - FirstBatchArrivalWaitTime: 3s858ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F38: Instance da46dbd7c4e8e43b:bc4eab3900000008 (host=vd1314.halxg.cloudera.com:22000):(Total: 3s830ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 28.00 KB, 2.14 MB, 1.49 MB, 1.38 MB, 855.51 KB, 924.30 KB, 281.24 KB, 389.95 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3 - AverageThreadTokens: 5.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.35 MB (7706912) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 34.562ms - RowsProduced: 1 (1) - TotalCpuTime: 23s079ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 310.882us - TotalStorageWaitTime: 21s903ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 67.462ms, non-child: 67.462ms, % non-child: 100.00%) - CodegenTime: 606.492us - CompileTime: 9.885ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 24.651ms - PrepareTime: 32.450ms DataStreamSender (dst_id=115):(Total: 70.541us, non-child: 70.541us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 323.53 KB/sec - OverallThroughput: 221.50 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.725us - TransmitDataRPCTime: 48.295us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 3s820ms, non-child: 89.769ms, % non-child: 2.35%) ExecOption: Codegen Enabled - BuildTime: 37.505ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 3s731ms, non-child: 3s731ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 0, 34.06 MB, 42.81 MB, 48.22 MB, 52.32 MB, 55.44 MB, 57.62 MB, 59.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 5.00 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 44.069ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 34 (34) - PeakMemoryUsage: 7.31 MB (7670048) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 204.58 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 125 (125) - ScannerThreadsTotalWallClockTime: 23s079ms - MaterializeTupleTime(*): 561.623ms - ScannerThreadsSysTime: 97.974ms - ScannerThreadsUserTime: 888.847ms - ScannerThreadsVoluntaryContextSwitches: 3.34K (3343) - TotalRawHdfsReadTime(*): 41.373ms - TotalReadThroughput: 14.89 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000007 (host=vd1316.halxg.cloudera.com:22000):(Total: 4s219ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 2.78 MB, 2.79 MB, 3.55 MB, 1.78 MB, 1.39 MB, 427.38 KB, 779.94 KB, 92.00 KB, 351.28 KB ThreadUsage(500.000ms): 29, 12, 8, 6, 5, 4, 4, 3, 2 - AverageThreadTokens: 8.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.60 MB (9015400) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 34.783ms - RowsProduced: 1 (1) - TotalCpuTime: 26s638ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 215.519us - TotalStorageWaitTime: 25s328ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 68.388ms, non-child: 68.388ms, % non-child: 100.00%) - CodegenTime: 616.267us - CompileTime: 9.571ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 25.612ms - PrepareTime: 32.756ms DataStreamSender (dst_id=115):(Total: 52.021us, non-child: 52.021us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 471.01 KB/sec - OverallThroughput: 300.36 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.718us - TransmitDataRPCTime: 33.173us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 4s213ms, non-child: 114.662ms, % non-child: 2.72%) ExecOption: Codegen Enabled - BuildTime: 56.713ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 4s099ms, non-child: 4s099ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 15.12 MB, 34.13 MB, 41.53 MB, 46.39 MB, 50.61 MB, 53.26 MB, 55.48 MB, 57.35 MB, 59.29 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 7.11 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 45.334ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 8.51 MB (8921192) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 186.46 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 92 (92) - ScannerThreadsTotalWallClockTime: 26s638ms - MaterializeTupleTime(*): 558.232ms - ScannerThreadsSysTime: 121.960ms - ScannerThreadsUserTime: 853.845ms - ScannerThreadsVoluntaryContextSwitches: 3.59K (3586) - TotalRawHdfsReadTime(*): 41.133ms - TotalReadThroughput: 13.18 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000002 (host=vd1309.halxg.cloudera.com:22000):(Total: 5s822ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 27.10 MB, 2.22 MB, 1.02 MB, 691.54 KB, 44.00 KB, 44.00 KB, 84.00 KB, 232.17 KB, 44.00 KB, 690.40 KB, 172.00 KB, 356.19 KB ThreadUsage(500.000ms): 14, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.58 - BloomFilterBytes: 0 - PeakMemoryUsage: 30.26 MB (31732616) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 53.454ms - RowsProduced: 1 (1) - TotalCpuTime: 12s349ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 219.244us - TotalStorageWaitTime: 10s287ms CodeGen:(Total: 112.920ms, non-child: 112.920ms, % non-child: 100.00%) - CodegenTime: 552.467us - CompileTime: 14.295ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 44.135ms - PrepareTime: 53.945ms DataStreamSender (dst_id=115):(Total: 41.671us, non-child: 41.671us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 651.91 KB/sec - OverallThroughput: 374.96 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.512us - TransmitDataRPCTime: 23.968us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 5s814ms, non-child: 330.247ms, % non-child: 5.68%) ExecOption: Codegen Enabled - BuildTime: 237.440ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 5s484ms, non-child: 5s484ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 22.75 MB, 37.68 MB, 44.01 MB, 48.30 MB, 51.27 MB, 53.88 MB, 55.62 MB, 57.16 MB, 58.39 MB, 59.56 MB, 60.55 MB, 62.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.58 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 180.072ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 29.89 MB (31336776) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 123.53 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 127 (127) - ScannerThreadsTotalWallClockTime: 12s349ms - MaterializeTupleTime(*): 838.600ms - ScannerThreadsSysTime: 101.976ms - ScannerThreadsUserTime: 986.841ms - ScannerThreadsVoluntaryContextSwitches: 4.23K (4229) - TotalRawHdfsReadTime(*): 43.615ms - TotalReadThroughput: 10.37 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000003 (host=vd1310.halxg.cloudera.com:22000):(Total: 10s155ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 3.15 MB, 2.20 MB, 1.80 MB, 600.77 KB, 729.91 KB, 1.66 MB, 1.02 MB, 713.20 KB, 621.22 KB, 92.00 KB, 84.00 KB, 588.46 KB, 44.00 KB, 385.56 KB, 683.78 KB, 384.66 KB, 1.01 MB, 383.34 KB, 382.52 KB, 694.30 KB ThreadUsage(500.000ms): 16, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.85 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.24 MB (5497000) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 34.572ms - RowsProduced: 1 (1) - TotalCpuTime: 27s801ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 213.299us - TotalStorageWaitTime: 26s668ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 67.116ms, non-child: 67.116ms, % non-child: 100.00%) - CodegenTime: 631.960us - CompileTime: 9.239ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 24.710ms - PrepareTime: 32.716ms DataStreamSender (dst_id=115):(Total: 36.767us, non-child: 36.767us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 821.81 KB/sec - OverallThroughput: 424.97 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.074us - TransmitDataRPCTime: 19.013us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 10s149ms, non-child: 129.201ms, % non-child: 1.27%) ExecOption: Codegen Enabled - BuildTime: 42.062ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 10s020ms, non-child: 10s020ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 11.59 MB, 24.26 MB, 30.36 MB, 35.91 MB, 39.67 MB, 42.25 MB, 44.50 MB, 47.24 MB, 49.27 MB, 50.73 MB, 51.94 MB, 53.39 MB, 54.60 MB, 55.20 MB, 56.21 MB, 57.08 MB, 57.61 MB, 58.37 MB, 58.84 MB, 59.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.85 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 44.231ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 5.18 MB (5435560) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 76.47 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 156 (156) - ScannerThreadsTotalWallClockTime: 27s801ms - MaterializeTupleTime(*): 556.890ms - ScannerThreadsSysTime: 103.974ms - ScannerThreadsUserTime: 867.856ms - ScannerThreadsVoluntaryContextSwitches: 2.97K (2968) - TotalRawHdfsReadTime(*): 53.697ms - TotalReadThroughput: 5.93 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000004 (host=vd1313.halxg.cloudera.com:22000):(Total: 8s339ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 1.85 MB, 1.16 MB, 2.30 MB, 775.88 KB, 926.80 KB, 1.66 MB, 672.77 KB, 412.10 KB, 417.86 KB, 1005.88 KB, 84.00 KB, 84.00 KB, 377.93 KB, 227.73 KB, 228.12 KB, 386.30 KB ThreadUsage(500.000ms): 17, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 4.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.99 MB (8382600) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 35.311ms - RowsProduced: 1 (1) - TotalCpuTime: 34s673ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.322ms - TotalStorageWaitTime: 32s197ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 68.907ms, non-child: 68.907ms, % non-child: 100.00%) - CodegenTime: 534.684us - CompileTime: 9.827ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 25.224ms - PrepareTime: 33.394ms DataStreamSender (dst_id=115):(Total: 49.727us, non-child: 49.727us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 685.73 KB/sec - OverallThroughput: 314.21 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.225us - TransmitDataRPCTime: 22.786us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 8s332ms, non-child: 126.947ms, % non-child: 1.52%) ExecOption: Codegen Enabled - BuildTime: 70.757ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 8s205ms, non-child: 8s205ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 20.51 MB, 28.97 MB, 35.40 MB, 39.85 MB, 43.31 MB, 45.70 MB, 47.82 MB, 50.29 MB, 52.03 MB, 53.36 MB, 54.81 MB, 56.02 MB, 57.14 MB, 57.99 MB, 58.33 MB, 58.69 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.38 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 56.816ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 59 (59) - PeakMemoryUsage: 7.57 MB (7940272) - PerReadThreadRawHdfsThroughput: 1.14 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 93.18 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 105 (105) - ScannerThreadsTotalWallClockTime: 34s673ms - MaterializeTupleTime(*): 626.192ms - ScannerThreadsSysTime: 79.972ms - ScannerThreadsUserTime: 912.828ms - ScannerThreadsVoluntaryContextSwitches: 3.86K (3856) - TotalRawHdfsReadTime(*): 50.922ms - TotalReadThroughput: 7.34 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000006 (host=vd1311.halxg.cloudera.com:22000):(Total: 6s350ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 1.44 MB, 3.66 MB, 2.29 MB, 788.62 KB, 2.13 MB, 140.00 KB, 1.46 MB, 1.29 MB, 234.12 KB, 92.00 KB, 282.26 KB, 44.00 KB, 225.96 KB ThreadUsage(500.000ms): 40, 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2 - AverageThreadTokens: 7.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.60 MB (5870248) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 36.698ms - RowsProduced: 1 (1) - TotalCpuTime: 30s318ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 2.835ms - TotalStorageWaitTime: 28s933ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.258ms, non-child: 71.258ms, % non-child: 100.00%) - CodegenTime: 525.194us - CompileTime: 10.573ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 25.772ms - PrepareTime: 34.415ms DataStreamSender (dst_id=115):(Total: 63.860us, non-child: 63.860us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 422.97 KB/sec - OverallThroughput: 244.68 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.664us - TransmitDataRPCTime: 36.941us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 6s341ms, non-child: 101.437ms, % non-child: 1.60%) ExecOption: Codegen Enabled - BuildTime: 46.652ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 6s239ms, non-child: 6s239ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 2.39 MB, 25.47 MB, 33.12 MB, 38.71 MB, 43.66 MB, 46.32 MB, 48.85 MB, 51.31 MB, 53.45 MB, 55.64 MB, 56.91 MB, 58.06 MB, 58.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.46 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 48.622ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 41 (41) - PeakMemoryUsage: 5.55 MB (5817000) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 122.38 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 57 (57) - ScannerThreadsTotalWallClockTime: 30s318ms - MaterializeTupleTime(*): 576.247ms - ScannerThreadsSysTime: 95.972ms - ScannerThreadsUserTime: 896.845ms - ScannerThreadsVoluntaryContextSwitches: 3.67K (3672) - TotalRawHdfsReadTime(*): 41.625ms - TotalReadThroughput: 9.06 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000005 (host=vd1312.halxg.cloudera.com:22000):(Total: 7s808ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 3.34 MB, 2.72 MB, 2.22 MB, 2.20 MB, 1.58 MB, 783.41 KB, 1.01 MB, 661.39 KB, 235.14 KB, 522.70 KB, 44.00 KB, 393.73 KB, 375.73 KB, 44.00 KB, 380.66 KB ThreadUsage(500.000ms): 18, 10, 7, 6, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 4.80 - BloomFilterBytes: 0 - PeakMemoryUsage: 7.10 MB (7439912) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 33.514ms - RowsProduced: 1 (1) - TotalCpuTime: 34s434ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 248.818us - TotalStorageWaitTime: 32s405ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 160.00 GB (171798691840) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 67.424ms, non-child: 67.424ms, % non-child: 100.00%) - CodegenTime: 527.410us - CompileTime: 9.688ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 25.716ms - PrepareTime: 31.567ms DataStreamSender (dst_id=115):(Total: 54.683us, non-child: 54.683us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 454.93 KB/sec - OverallThroughput: 285.74 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.781us - TransmitDataRPCTime: 34.346us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=39):(Total: 7s801ms, non-child: 145.537ms, % non-child: 1.87%) ExecOption: Codegen Enabled - BuildTime: 50.954ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=38):(Total: 7s655ms, non-child: 7s655ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:6.667% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 22.03 MB, 30.89 MB, 37.12 MB, 41.98 MB, 45.59 MB, 47.58 MB, 50.22 MB, 52.32 MB, 54.24 MB, 55.55 MB, 56.66 MB, 57.67 MB, 59.13 MB, 60.00 MB, 60.55 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.80 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 46.843ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 59 (59) - PeakMemoryUsage: 7.06 MB (7403048) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 99.47 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 108 (108) - ScannerThreadsTotalWallClockTime: 34s434ms - MaterializeTupleTime(*): 561.897ms - ScannerThreadsSysTime: 85.969ms - ScannerThreadsUserTime: 900.828ms - ScannerThreadsVoluntaryContextSwitches: 3.64K (3636) - TotalRawHdfsReadTime(*): 41.819ms - TotalReadThroughput: 8.07 MB/sec Fragment F37: Instance da46dbd7c4e8e43b:bc4eab3900000009 (host=vd1309.halxg.cloudera.com:22000):(Total: 9s613ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 40.01 KB, 40.01 KB, 40.01 KB, 44.01 KB, 44.01 KB, 44.01 KB, 52.01 KB, 56.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 53.301ms - RowsProduced: 1 (1) - TotalCpuTime: 69.869ms - TotalNetworkReceiveTime: 9s556ms - TotalNetworkSendTime: 202.369us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 63.140ms, non-child: 63.140ms, % non-child: 100.00%) - CodegenTime: 382.439us - CompileTime: 2.461ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 6.614ms - PrepareTime: 53.496ms DataStreamSender (dst_id=114):(Total: 64.480us, non-child: 64.480us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 433.96 KB/sec - OverallThroughput: 242.32 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 18.663us - TransmitDataRPCTime: 36.006us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=113):(Total: 9s610ms, non-child: 53.993ms, % non-child: 0.56%) ExecOption: Codegen Enabled - BuildTime: 259.789us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=112):(Total: 9s556ms, non-child: 139.890us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 32.00 B, 32.00 B, 32.00 B, 64.00 B, 80.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 15.747us - DeserializeRowBatchTimer: 771.908us - FirstBatchArrivalWaitTime: 4s084ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F36: Instance da46dbd7c4e8e43b:bc4eab390000000a (host=vd1309.halxg.cloudera.com:22000):(Total: 4s056ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 2.85 MB, 1.66 MB, 60.00 KB, 239.16 KB, 23.14 MB, 84.00 KB, 224.88 KB, 368.38 KB ThreadUsage(500.000ms): 14, 6, 4, 3, 2, 2, 2, 2 - AverageThreadTokens: 4.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.36 MB (25542984) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 37.233ms - RowsProduced: 1 (1) - TotalCpuTime: 11s313ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 874.342us - TotalStorageWaitTime: 9s310ms CodeGen:(Total: 75.150ms, non-child: 75.150ms, % non-child: 100.00%) - CodegenTime: 490.389us - CompileTime: 9.790ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.349ms - PrepareTime: 35.340ms DataStreamSender (dst_id=112):(Total: 54.024us, non-child: 54.024us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 409.42 KB/sec - OverallThroughput: 289.22 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.240us - TransmitDataRPCTime: 38.164us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 4s049ms, non-child: 244.209ms, % non-child: 6.03%) ExecOption: Codegen Enabled - BuildTime: 173.883ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 3s804ms, non-child: 3s804ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 14.56 MB, 29.82 MB, 36.96 MB, 41.60 MB, 57.60 MB, 59.25 MB, 60.68 MB, 61.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.38 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 185.323ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 19 (19) - PeakMemoryUsage: 24.17 MB (25346096) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 178.06 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 161 (161) - ScannerThreadsTotalWallClockTime: 11s313ms - MaterializeTupleTime(*): 786.004ms - ScannerThreadsSysTime: 111.976ms - ScannerThreadsUserTime: 924.849ms - ScannerThreadsVoluntaryContextSwitches: 4.18K (4183) - TotalRawHdfsReadTime(*): 43.063ms - TotalReadThroughput: 15.48 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000000d (host=vd1312.halxg.cloudera.com:22000):(Total: 8s529ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 2.17 MB, 1.15 MB, 2.19 MB, 432.16 KB, 1.32 MB, 140.00 KB, 1.28 MB, 441.60 KB, 749.84 KB, 659.51 KB, 881.37 KB, 224.57 KB, 383.67 KB, 225.15 KB, 84.00 KB, 44.00 KB, 384.76 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 4.41 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.61 MB (6933152) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 33.469ms - RowsProduced: 1 (1) - TotalCpuTime: 35s152ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.597us - TotalStorageWaitTime: 32s937ms CodeGen:(Total: 66.303ms, non-child: 66.303ms, % non-child: 100.00%) - CodegenTime: 576.317us - CompileTime: 9.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 24.846ms - PrepareTime: 31.657ms DataStreamSender (dst_id=112):(Total: 48.209us, non-child: 48.209us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 560.20 KB/sec - OverallThroughput: 324.11 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.658us - TransmitDataRPCTime: 27.892us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 8s522ms, non-child: 136.905ms, % non-child: 1.61%) ExecOption: Codegen Enabled - BuildTime: 48.154ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 8s385ms, non-child: 8s385ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 21.01 MB, 29.81 MB, 36.76 MB, 41.27 MB, 44.76 MB, 47.02 MB, 49.45 MB, 51.26 MB, 53.23 MB, 54.77 MB, 56.03 MB, 56.95 MB, 58.04 MB, 59.11 MB, 59.75 MB, 60.00 MB, 60.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.41 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 47.373ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 59 (59) - PeakMemoryUsage: 6.57 MB (6888096) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 90.81 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 126 (126) - ScannerThreadsTotalWallClockTime: 35s152ms - MaterializeTupleTime(*): 589.722ms - ScannerThreadsSysTime: 112.967ms - ScannerThreadsUserTime: 898.832ms - ScannerThreadsVoluntaryContextSwitches: 3.55K (3548) - TotalRawHdfsReadTime(*): 41.169ms - TotalReadThroughput: 7.13 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000010 (host=vd1314.halxg.cloudera.com:22000):(Total: 8s769ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 0, 1.71 MB, 736.87 KB, 156.00 KB, 1.17 MB, 1.50 MB, 1.16 MB, 1.15 MB, 132.00 KB, 930.99 KB, 882.91 KB, 382.88 KB, 84.00 KB, 84.00 KB, 172.00 KB, 737.46 KB, 380.00 KB, 689.28 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.14 MB (6433136) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 33.807ms - RowsProduced: 1 (1) - TotalCpuTime: 27s968ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 194.418us - TotalStorageWaitTime: 26s771ms CodeGen:(Total: 76.966ms, non-child: 76.966ms, % non-child: 100.00%) - CodegenTime: 733.707us - CompileTime: 11.547ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 33.357ms - PrepareTime: 31.674ms DataStreamSender (dst_id=112):(Total: 75.226us, non-child: 75.226us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 364.12 KB/sec - OverallThroughput: 207.71 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.028us - TransmitDataRPCTime: 42.912us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 8s763ms, non-child: 97.526ms, % non-child: 1.11%) ExecOption: Codegen Enabled - BuildTime: 41.747ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 8s665ms, non-child: 8s665ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 19.58 MB, 26.83 MB, 32.95 MB, 37.74 MB, 41.08 MB, 43.41 MB, 45.66 MB, 47.84 MB, 49.60 MB, 50.93 MB, 52.43 MB, 53.63 MB, 54.86 MB, 56.38 MB, 57.57 MB, 58.63 MB, 59.60 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.82 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 44.343ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 6.10 MB (6396272) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 88.08 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 85 (85) - ScannerThreadsTotalWallClockTime: 27s968ms - MaterializeTupleTime(*): 571.173ms - ScannerThreadsSysTime: 95.976ms - ScannerThreadsUserTime: 904.848ms - ScannerThreadsVoluntaryContextSwitches: 3.29K (3295) - TotalRawHdfsReadTime(*): 40.661ms - TotalReadThroughput: 7.01 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000000e (host=vd1311.halxg.cloudera.com:22000):(Total: 6s474ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 1.45 MB, 3.43 MB, 1.20 MB, 1.14 MB, 1.70 MB, 1.02 MB, 715.16 KB, 396.38 KB, 680.45 KB, 411.59 KB, 584.59 KB, 84.00 KB, 393.70 KB ThreadUsage(500.000ms): 40, 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2 - AverageThreadTokens: 7.46 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.26 MB (6564568) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 35.402ms - RowsProduced: 1 (1) - TotalCpuTime: 30s565ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 236.147us - TotalStorageWaitTime: 29s051ms CodeGen:(Total: 69.769ms, non-child: 69.769ms, % non-child: 100.00%) - CodegenTime: 594.172us - CompileTime: 10.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 25.313ms - PrepareTime: 33.401ms DataStreamSender (dst_id=112):(Total: 71.201us, non-child: 71.201us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 557.36 KB/sec - OverallThroughput: 219.45 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 23.832us - TransmitDataRPCTime: 28.034us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 6s467ms, non-child: 101.325ms, % non-child: 1.57%) ExecOption: Codegen Enabled - BuildTime: 47.645ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 6s366ms, non-child: 6s366ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 900.00 KB, 25.69 MB, 33.29 MB, 38.48 MB, 43.04 MB, 46.24 MB, 48.45 MB, 51.03 MB, 53.35 MB, 55.46 MB, 56.91 MB, 57.90 MB, 58.65 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.46 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 45.212ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 6.23 MB (6527704) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 119.94 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 88 (88) - ScannerThreadsTotalWallClockTime: 30s565ms - MaterializeTupleTime(*): 575.088ms - ScannerThreadsSysTime: 89.971ms - ScannerThreadsUserTime: 896.843ms - ScannerThreadsVoluntaryContextSwitches: 3.39K (3390) - TotalRawHdfsReadTime(*): 41.695ms - TotalReadThroughput: 9.02 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000000c (host=vd1313.halxg.cloudera.com:22000):(Total: 8s184ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 3.59 MB, 3.00 MB, 1.61 MB, 1.82 MB, 1.06 MB, 100.00 KB, 52.00 KB, 429.54 KB, 1023.17 KB, 677.41 KB, 44.00 KB, 373.95 KB, 1.00 MB, 44.00 KB, 374.63 KB, 84.00 KB ThreadUsage(500.000ms): 17, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 4.38 - BloomFilterBytes: 0 - PeakMemoryUsage: 8.04 MB (8428912) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 35.364ms - RowsProduced: 1 (1) - TotalCpuTime: 34s856ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 221.631us - TotalStorageWaitTime: 32s578ms CodeGen:(Total: 68.711ms, non-child: 68.711ms, % non-child: 100.00%) - CodegenTime: 539.650us - CompileTime: 9.908ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 24.832ms - PrepareTime: 33.507ms DataStreamSender (dst_id=112):(Total: 45.446us, non-child: 45.446us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 809.38 KB/sec - OverallThroughput: 343.81 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.001us - TransmitDataRPCTime: 19.305us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 8s177ms, non-child: 125.704ms, % non-child: 1.54%) ExecOption: Codegen Enabled - BuildTime: 74.350ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 8s051ms, non-child: 8s051ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 22.06 MB, 30.20 MB, 36.53 MB, 40.92 MB, 43.94 MB, 45.92 MB, 48.73 MB, 50.65 MB, 52.46 MB, 54.03 MB, 55.17 MB, 56.44 MB, 57.71 MB, 58.10 MB, 58.52 MB, 59.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 3.38 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 59.909ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 59 (59) - PeakMemoryUsage: 7.53 MB (7895440) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 94.96 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 105 (105) - ScannerThreadsTotalWallClockTime: 34s856ms - MaterializeTupleTime(*): 592.250ms - ScannerThreadsSysTime: 91.968ms - ScannerThreadsUserTime: 883.833ms - ScannerThreadsVoluntaryContextSwitches: 4.02K (4023) - TotalRawHdfsReadTime(*): 43.051ms - TotalReadThroughput: 7.40 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000000f (host=vd1316.halxg.cloudera.com:22000):(Total: 7s691ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 4.23 MB, 2.80 MB, 2.50 MB, 1.05 MB, 647.11 KB, 1.50 MB, 442.38 KB, 1.06 MB, 664.15 KB, 92.00 KB, 52.00 KB, 172.00 KB, 231.21 KB, 229.21 KB, 227.45 KB, 44.00 KB ThreadUsage(500.000ms): 28, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2 - AverageThreadTokens: 5.56 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.13 MB (6428920) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 35.017ms - RowsProduced: 1 (1) - TotalCpuTime: 29s133ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 232.306us - TotalStorageWaitTime: 27s830ms CodeGen:(Total: 76.259ms, non-child: 76.259ms, % non-child: 100.00%) - CodegenTime: 676.816us - CompileTime: 13.382ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.872ms - PrepareTime: 32.606ms DataStreamSender (dst_id=112):(Total: 47.471us, non-child: 47.471us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 570.88 KB/sec - OverallThroughput: 329.15 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.696us - TransmitDataRPCTime: 27.370us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 7s685ms, non-child: 109.276ms, % non-child: 1.42%) ExecOption: Codegen Enabled - BuildTime: 44.973ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 7s576ms, non-child: 7s576ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 4.75 MB, 23.15 MB, 30.45 MB, 35.97 MB, 40.33 MB, 43.35 MB, 45.61 MB, 47.84 MB, 49.67 MB, 51.26 MB, 52.55 MB, 54.26 MB, 55.55 MB, 56.77 MB, 57.89 MB, 59.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.56 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 46.101ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 34 (34) - PeakMemoryUsage: 6.10 MB (6392056) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 100.89 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 105 (105) - ScannerThreadsTotalWallClockTime: 29s133ms - MaterializeTupleTime(*): 566.241ms - ScannerThreadsSysTime: 92.975ms - ScannerThreadsUserTime: 887.848ms - ScannerThreadsVoluntaryContextSwitches: 3.64K (3639) - TotalRawHdfsReadTime(*): 40.449ms - TotalReadThroughput: 7.39 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000000b (host=vd1310.halxg.cloudera.com:22000):(Total: 9s520ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 2.00 MB, 4.22 MB, 1.41 MB, 2.28 MB, 180.00 KB, 281.70 KB, 414.23 KB, 410.52 KB, 397.10 KB, 692.77 KB, 384.43 KB, 278.55 KB, 84.00 KB, 44.00 KB, 44.00 KB, 226.34 KB, 84.00 KB, 381.48 KB, 683.30 KB ThreadUsage(500.000ms): 16, 10, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.62 MB (6941280) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 34.052ms - RowsProduced: 1 (1) - TotalCpuTime: 27s359ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 207.867us - TotalStorageWaitTime: 26s254ms CodeGen:(Total: 64.619ms, non-child: 64.619ms, % non-child: 100.00%) - CodegenTime: 530.254us - CompileTime: 8.392ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 23.668ms - PrepareTime: 32.143ms DataStreamSender (dst_id=112):(Total: 47.208us, non-child: 47.208us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 536.41 KB/sec - OverallThroughput: 330.98 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.482us - TransmitDataRPCTime: 29.129us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=37):(Total: 9s514ms, non-child: 117.155ms, % non-child: 1.23%) ExecOption: Codegen Enabled - BuildTime: 42.520ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=36):(Total: 9s397ms, non-child: 9s397ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 12.54 MB, 25.31 MB, 32.77 MB, 37.71 MB, 41.83 MB, 44.40 MB, 46.66 MB, 48.73 MB, 50.68 MB, 52.70 MB, 53.63 MB, 54.77 MB, 55.56 MB, 55.99 MB, 56.77 MB, 57.60 MB, 58.15 MB, 58.69 MB, 59.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.95 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 45.827ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 6.58 MB (6904416) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 81.54 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 238 (238) - ScannerThreadsTotalWallClockTime: 27s359ms - MaterializeTupleTime(*): 560.755ms - ScannerThreadsSysTime: 107.973ms - ScannerThreadsUserTime: 878.854ms - ScannerThreadsVoluntaryContextSwitches: 2.99K (2986) - TotalRawHdfsReadTime(*): 40.498ms - TotalReadThroughput: 6.24 MB/sec Fragment F35: Instance da46dbd7c4e8e43b:bc4eab3900000011 (host=vd1309.halxg.cloudera.com:22000):(Total: 12s989ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 48.01 KB, 48.01 KB, 48.01 KB, 48.01 KB, 56.01 KB, 56.01 KB, 56.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 39.494ms - RowsProduced: 1 (1) - TotalCpuTime: 55.200ms - TotalNetworkReceiveTime: 12s948ms - TotalNetworkSendTime: 203.198us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 52.022ms, non-child: 52.022ms, % non-child: 100.00%) - CodegenTime: 262.329us - CompileTime: 2.988ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 7.955ms - PrepareTime: 40.538ms DataStreamSender (dst_id=111):(Total: 59.242us, non-child: 59.242us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 436.21 KB/sec - OverallThroughput: 263.75 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.871us - TransmitDataRPCTime: 35.820us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=110):(Total: 12s987ms, non-child: 39.568ms, % non-child: 0.30%) ExecOption: Codegen Enabled - BuildTime: 10.093us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=109):(Total: 12s948ms, non-child: 119.350us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 48.00 B, 48.00 B, 48.00 B, 48.00 B, 80.00 B, 80.00 B, 80.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 15.263us - DeserializeRowBatchTimer: 122.566us - FirstBatchArrivalWaitTime: 8s391ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F34: Instance da46dbd7c4e8e43b:bc4eab3900000015 (host=vd1312.halxg.cloudera.com:22000):(Total: 11s070ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 4.29 MB, 983.60 KB, 642.64 KB, 953.39 KB, 1.52 MB, 455.31 KB, 553.52 KB, 92.00 KB, 92.00 KB, 1.02 MB, 44.00 KB, 84.00 KB, 382.41 KB, 84.00 KB, 228.02 KB, 380.55 KB, 231.54 KB, 372.74 KB, 1.01 MB, 361.24 KB, 84.00 KB, 529.77 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.57 MB (5836112) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 36.271ms - RowsProduced: 1 (1) - TotalCpuTime: 34s623ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 258.596us - TotalStorageWaitTime: 33s098ms CodeGen:(Total: 75.106ms, non-child: 75.106ms, % non-child: 100.00%) - CodegenTime: 643.927us - CompileTime: 10.903ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.044ms - PrepareTime: 33.719ms DataStreamSender (dst_id=109):(Total: 47.763us, non-child: 47.763us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 593.47 KB/sec - OverallThroughput: 327.14 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.150us - TransmitDataRPCTime: 26.328us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 11s064ms, non-child: 113.795ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 52.255ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 10s950ms, non-child: 10s950ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 16.13 MB, 25.20 MB, 32.09 MB, 36.21 MB, 39.49 MB, 42.06 MB, 44.15 MB, 46.10 MB, 47.73 MB, 49.20 MB, 50.48 MB, 51.77 MB, 53.16 MB, 54.02 MB, 55.11 MB, 55.94 MB, 56.84 MB, 57.62 MB, 58.28 MB, 59.29 MB, 59.93 MB, 60.53 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.86 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 48.157ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 5.51 MB (5774672) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 69.54 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 74 (74) - ScannerThreadsTotalWallClockTime: 34s623ms - MaterializeTupleTime(*): 583.943ms - ScannerThreadsSysTime: 90.973ms - ScannerThreadsUserTime: 917.839ms - ScannerThreadsVoluntaryContextSwitches: 3.67K (3670) - TotalRawHdfsReadTime(*): 40.605ms - TotalReadThroughput: 5.50 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000016 (host=vd1311.halxg.cloudera.com:22000):(Total: 9s003ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 28.00 KB, 3.17 MB, 1.27 MB, 1.72 MB, 1.07 MB, 691.61 KB, 2.24 MB, 876.20 KB, 388.56 KB, 425.48 KB, 916.55 KB, 44.00 KB, 44.00 KB, 746.23 KB, 392.09 KB, 369.04 KB, 225.52 KB, 44.00 KB ThreadUsage(500.000ms): 1, 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.78 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.78 MB (6063400) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 35.627ms - RowsProduced: 1 (1) - TotalCpuTime: 31s226ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 258.803us - TotalStorageWaitTime: 29s684ms CodeGen:(Total: 75.145ms, non-child: 75.145ms, % non-child: 100.00%) - CodegenTime: 611.954us - CompileTime: 11.277ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.873ms - PrepareTime: 33.431ms DataStreamSender (dst_id=109):(Total: 76.831us, non-child: 76.831us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 325.61 KB/sec - OverallThroughput: 203.37 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.203us - TransmitDataRPCTime: 47.987us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 8s996ms, non-child: 117.678ms, % non-child: 1.31%) ExecOption: Codegen Enabled - BuildTime: 40.810ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 8s879ms, non-child: 8s879ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 0, 20.27 MB, 28.18 MB, 34.00 MB, 38.16 MB, 41.45 MB, 43.94 MB, 46.25 MB, 48.26 MB, 50.48 MB, 51.90 MB, 52.93 MB, 54.54 MB, 55.99 MB, 56.96 MB, 57.47 MB, 58.32 MB, 59.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.94 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 44.807ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 39 (39) - PeakMemoryUsage: 5.73 MB (6005952) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 86.00 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 92 (92) - ScannerThreadsTotalWallClockTime: 31s226ms - MaterializeTupleTime(*): 551.687ms - ScannerThreadsSysTime: 104.971ms - ScannerThreadsUserTime: 855.847ms - ScannerThreadsVoluntaryContextSwitches: 3.48K (3476) - TotalRawHdfsReadTime(*): 41.328ms - TotalReadThroughput: 6.56 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000014 (host=vd1313.halxg.cloudera.com:22000):(Total: 12s607ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 3.49 MB, 2.73 MB, 2.35 MB, 2.06 MB, 1.21 MB, 668.48 KB, 52.00 KB, 92.00 KB, 235.55 KB, 984.09 KB, 84.00 KB, 377.52 KB, 571.23 KB, 366.38 KB, 44.00 KB, 573.20 KB, 959.27 KB, 44.00 KB, 44.00 KB, 570.41 KB, 44.00 KB, 84.00 KB, 686.55 KB, 44.00 KB, 574.52 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.60 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.37 MB (5631992) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 34.772ms - RowsProduced: 1 (1) - TotalCpuTime: 36s687ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 230.097us - TotalStorageWaitTime: 34s446ms CodeGen:(Total: 76.404ms, non-child: 76.404ms, % non-child: 100.00%) - CodegenTime: 469.908us - CompileTime: 11.340ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.628ms - PrepareTime: 32.985ms DataStreamSender (dst_id=109):(Total: 62.231us, non-child: 62.231us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 402.47 KB/sec - OverallThroughput: 251.08 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.306us - TransmitDataRPCTime: 38.823us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 12s601ms, non-child: 122.424ms, % non-child: 0.97%) ExecOption: Codegen Enabled - BuildTime: 48.960ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 12s478ms, non-child: 12s478ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 14.35 MB, 22.95 MB, 27.99 MB, 33.00 MB, 36.66 MB, 38.91 MB, 41.19 MB, 43.22 MB, 45.23 MB, 46.49 MB, 47.68 MB, 48.68 MB, 50.16 MB, 51.17 MB, 51.97 MB, 53.17 MB, 54.40 MB, 55.27 MB, 55.88 MB, 57.16 MB, 57.94 MB, 58.38 MB, 58.78 MB, 58.98 MB, 59.56 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.60 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 46.982ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 5.34 MB (5595128) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 61.27 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 103 (103) - ScannerThreadsTotalWallClockTime: 36s687ms - MaterializeTupleTime(*): 578.269ms - ScannerThreadsSysTime: 88.974ms - ScannerThreadsUserTime: 906.835ms - ScannerThreadsVoluntaryContextSwitches: 3.38K (3384) - TotalRawHdfsReadTime(*): 41.468ms - TotalReadThroughput: 4.77 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000018 (host=vd1314.halxg.cloudera.com:22000):(Total: 8s349ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 0, 2.49 MB, 3.01 MB, 640.00 KB, 937.05 KB, 773.57 KB, 478.47 KB, 1005.67 KB, 409.20 KB, 371.33 KB, 92.00 KB, 376.15 KB, 365.12 KB, 44.00 KB, 1.01 MB, 44.00 KB, 574.27 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.76 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.65 MB (5920272) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 35.676ms - RowsProduced: 1 (1) - TotalCpuTime: 27s348ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 201.222us - TotalStorageWaitTime: 26s140ms CodeGen:(Total: 77.282ms, non-child: 77.282ms, % non-child: 100.00%) - CodegenTime: 674.851us - CompileTime: 11.673ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.752ms - PrepareTime: 33.423ms DataStreamSender (dst_id=109):(Total: 50.314us, non-child: 50.314us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 571.80 KB/sec - OverallThroughput: 310.55 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.140us - TransmitDataRPCTime: 27.326us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 8s342ms, non-child: 112.504ms, % non-child: 1.35%) ExecOption: Codegen Enabled - BuildTime: 42.638ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 8s230ms, non-child: 8s230ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 19.44 MB, 28.56 MB, 34.43 MB, 39.13 MB, 42.09 MB, 44.53 MB, 46.80 MB, 48.82 MB, 50.52 MB, 52.02 MB, 53.85 MB, 55.01 MB, 56.08 MB, 57.16 MB, 58.68 MB, 59.71 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.94 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 44.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 5.56 MB (5826064) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 92.74 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 104 (104) - ScannerThreadsTotalWallClockTime: 27s348ms - MaterializeTupleTime(*): 577.952ms - ScannerThreadsSysTime: 98.974ms - ScannerThreadsUserTime: 905.849ms - ScannerThreadsVoluntaryContextSwitches: 3.20K (3199) - TotalRawHdfsReadTime(*): 40.178ms - TotalReadThroughput: 7.46 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000012 (host=vd1309.halxg.cloudera.com:22000):(Total: 11s055ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 3.02 MB, 1.99 MB, 286.87 KB, 627.15 KB, 581.49 KB, 44.00 KB, 357.09 KB, 356.68 KB, 22.67 MB, 84.00 KB, 84.00 KB, 229.13 KB, 84.00 KB, 391.82 KB, 393.45 KB, 1.00 MB, 375.91 KB, 84.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 84.00 KB ThreadUsage(500.000ms): 14, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.86 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.23 MB (25411376) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 52.340ms - RowsProduced: 1 (1) - TotalCpuTime: 16s989ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 242.289us - TotalStorageWaitTime: 14s875ms CodeGen:(Total: 104.172ms, non-child: 104.172ms, % non-child: 100.00%) - CodegenTime: 659.101us - CompileTime: 15.223ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 36.223ms - PrepareTime: 51.978ms DataStreamSender (dst_id=109):(Total: 64.452us, non-child: 64.452us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 368.07 KB/sec - OverallThroughput: 242.43 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.711us - TransmitDataRPCTime: 42.451us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 11s047ms, non-child: 320.866ms, % non-child: 2.90%) ExecOption: Codegen Enabled - BuildTime: 243.060ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 10s726ms, non-child: 10s726ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 3.76 MB, 17.89 MB, 24.02 MB, 28.42 MB, 31.90 MB, 34.50 MB, 36.28 MB, 37.74 MB, 52.28 MB, 53.39 MB, 54.43 MB, 55.51 MB, 56.50 MB, 57.25 MB, 58.28 MB, 59.19 MB, 60.29 MB, 60.62 MB, 61.06 MB, 61.40 MB, 61.75 MB, 62.19 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.86 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 196.767ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 23.44 MB (24573960) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 63.16 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 124 (124) - ScannerThreadsTotalWallClockTime: 16s989ms - MaterializeTupleTime(*): 804.848ms - ScannerThreadsSysTime: 106.977ms - ScannerThreadsUserTime: 930.852ms - ScannerThreadsVoluntaryContextSwitches: 4.06K (4063) - TotalRawHdfsReadTime(*): 58.799ms - TotalReadThroughput: 5.65 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000017 (host=vd1316.halxg.cloudera.com:22000):(Total: 8s897ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 4.37 MB, 2.13 MB, 1.24 MB, 1.53 MB, 1.80 MB, 895.88 KB, 548.02 KB, 1.33 MB, 771.84 KB, 388.75 KB, 855.43 KB, 84.00 KB, 392.89 KB, 84.00 KB, 678.20 KB, 229.94 KB, 688.77 KB, 386.97 KB ThreadUsage(500.000ms): 27, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 5.11 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.72 MB (5998176) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 39.526ms - RowsProduced: 1 (1) - TotalCpuTime: 29s813ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 231.477us - TotalStorageWaitTime: 28s575ms CodeGen:(Total: 86.517ms, non-child: 86.517ms, % non-child: 100.00%) - CodegenTime: 669.293us - CompileTime: 13.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 35.570ms - PrepareTime: 36.826ms DataStreamSender (dst_id=109):(Total: 49.194us, non-child: 49.194us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 609.90 KB/sec - OverallThroughput: 317.62 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.729us - TransmitDataRPCTime: 25.619us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 8s891ms, non-child: 115.627ms, % non-child: 1.30%) ExecOption: Codegen Enabled - BuildTime: 45.983ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 8s775ms, non-child: 8s775ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 2.77 MB, 20.97 MB, 28.49 MB, 33.98 MB, 38.28 MB, 40.99 MB, 43.33 MB, 45.68 MB, 47.70 MB, 49.33 MB, 50.93 MB, 52.58 MB, 53.69 MB, 55.25 MB, 55.90 MB, 56.76 MB, 57.63 MB, 58.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 4.11 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 44.735ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 29 (29) - PeakMemoryUsage: 5.65 MB (5928544) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 87.10 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 93 (93) - ScannerThreadsTotalWallClockTime: 29s813ms - MaterializeTupleTime(*): 563.783ms - ScannerThreadsSysTime: 103.972ms - ScannerThreadsUserTime: 883.852ms - ScannerThreadsVoluntaryContextSwitches: 3.35K (3354) - TotalRawHdfsReadTime(*): 40.087ms - TotalReadThroughput: 6.51 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000013 (host=vd1310.halxg.cloudera.com:22000):(Total: 12s926ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 4.85 MB, 3.23 MB, 616.75 KB, 1.47 MB, 1.57 MB, 977.46 KB, 555.11 KB, 1018.08 KB, 379.79 KB, 750.31 KB, 229.00 KB, 172.00 KB, 44.00 KB, 209.23 KB, 84.00 KB, 44.00 KB, 576.14 KB, 229.34 KB, 84.00 KB, 44.00 KB, 688.01 KB, 979.97 KB, 231.64 KB, 353.16 KB, 375.29 KB, 229.27 KB ThreadUsage(500.000ms): 18, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.04 MB (5289528) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 32.685ms - RowsProduced: 1 (1) - TotalCpuTime: 30s217ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 476.435us - TotalStorageWaitTime: 29s064ms CodeGen:(Total: 67.918ms, non-child: 67.918ms, % non-child: 100.00%) - CodegenTime: 465.521us - CompileTime: 10.851ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 25.801ms - PrepareTime: 30.831ms DataStreamSender (dst_id=109):(Total: 52.388us, non-child: 52.388us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 626.40 KB/sec - OverallThroughput: 298.25 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 19.585us - TransmitDataRPCTime: 24.944us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=35):(Total: 12s921ms, non-child: 152.494ms, % non-child: 1.18%) ExecOption: Codegen Enabled - BuildTime: 45.599ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=34):(Total: 12s768ms, non-child: 12s768ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 8.47 MB, 21.06 MB, 27.59 MB, 32.33 MB, 36.11 MB, 39.01 MB, 41.13 MB, 43.36 MB, 45.21 MB, 47.08 MB, 48.39 MB, 49.66 MB, 50.77 MB, 51.78 MB, 52.87 MB, 53.99 MB, 55.03 MB, 55.71 MB, 56.45 MB, 56.86 MB, 57.35 MB, 57.91 MB, 58.30 MB, 58.75 MB, 59.09 MB, 59.43 MB - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 2.50 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 43.620ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 5.01 MB (5252664) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 60.01 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 100 (100) - ScannerThreadsTotalWallClockTime: 30s217ms - MaterializeTupleTime(*): 573.991ms - ScannerThreadsSysTime: 95.977ms - ScannerThreadsUserTime: 902.852ms - ScannerThreadsVoluntaryContextSwitches: 3.02K (3022) - TotalRawHdfsReadTime(*): 40.390ms - TotalReadThroughput: 4.57 MB/sec Fragment F33: Instance da46dbd7c4e8e43b:bc4eab3900000019 (host=vd1309.halxg.cloudera.com:22000):(Total: 15s249ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 44.01 KB, 44.01 KB, 48.01 KB, 48.01 KB, 56.01 KB, 56.01 KB, 60.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 51.868ms - RowsProduced: 1 (1) - TotalCpuTime: 65.561ms - TotalNetworkReceiveTime: 15s194ms - TotalNetworkSendTime: 229.975us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 60.647ms, non-child: 60.647ms, % non-child: 100.00%) - CodegenTime: 428.402us - CompileTime: 1.837ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 6.744ms - PrepareTime: 50.858ms DataStreamSender (dst_id=108):(Total: 52.505us, non-child: 52.505us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 640.71 KB/sec - OverallThroughput: 297.59 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.547us - TransmitDataRPCTime: 24.387us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=107):(Total: 15s246ms, non-child: 51.923ms, % non-child: 0.34%) ExecOption: Codegen Enabled - BuildTime: 7.225us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=106):(Total: 15s194ms, non-child: 117.705us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 32.00 B, 32.00 B, 48.00 B, 48.00 B, 80.00 B, 80.00 B, 96.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 14.672us - DeserializeRowBatchTimer: 68.657us - FirstBatchArrivalWaitTime: 9s883ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F32: Instance da46dbd7c4e8e43b:bc4eab390000001c (host=vd1313.halxg.cloudera.com:22000):(Total: 11s142ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 1.61 MB, 2.27 MB, 1.68 MB, 590.12 KB, 1.38 MB, 762.64 KB, 622.89 KB, 92.00 KB, 1.29 MB, 92.00 KB, 84.00 KB, 356.29 KB, 371.77 KB, 44.00 KB, 223.52 KB, 44.00 KB, 44.00 KB, 719.30 KB, 570.41 KB, 366.01 KB, 84.00 KB, 84.00 KB ThreadUsage(500.000ms): 17, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.73 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.49 MB (5757400) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 33.734ms - RowsProduced: 1 (1) - TotalCpuTime: 35s007ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 255.279us - TotalStorageWaitTime: 32s977ms CodeGen:(Total: 73.772ms, non-child: 73.772ms, % non-child: 100.00%) - CodegenTime: 492.749us - CompileTime: 11.419ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.646ms - PrepareTime: 32.336ms DataStreamSender (dst_id=106):(Total: 74.826us, non-child: 74.826us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 455.95 KB/sec - OverallThroughput: 208.82 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 23.130us - TransmitDataRPCTime: 34.269us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 11s136ms, non-child: 129.070ms, % non-child: 1.16%) ExecOption: Codegen Enabled - BuildTime: 46.431ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 11s007ms, non-child: 11s007ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:95.45% 1:4.545% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 15.52 MB, 24.04 MB, 30.20 MB, 34.12 MB, 37.34 MB, 40.00 MB, 42.24 MB, 44.25 MB, 46.24 MB, 47.80 MB, 49.11 MB, 50.29 MB, 51.68 MB, 52.82 MB, 53.57 MB, 54.54 MB, 55.58 MB, 56.42 MB, 57.40 MB, 58.16 MB, 59.15 MB, 59.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.73 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 47.915ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 47 (47) - PeakMemoryUsage: 5.46 MB (5720536) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 69.46 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 84 (84) - ScannerThreadsTotalWallClockTime: 35s007ms - MaterializeTupleTime(*): 605.067ms - ScannerThreadsSysTime: 87.974ms - ScannerThreadsUserTime: 935.832ms - ScannerThreadsVoluntaryContextSwitches: 3.60K (3596) - TotalRawHdfsReadTime(*): 41.593ms - TotalReadThroughput: 5.42 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000001e (host=vd1311.halxg.cloudera.com:22000):(Total: 12s701ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 0, 3.61 MB, 1.54 MB, 1.40 MB, 1.81 MB, 1.24 MB, 799.68 KB, 763.27 KB, 713.38 KB, 52.00 KB, 567.54 KB, 384.04 KB, 396.17 KB, 374.71 KB, 84.00 KB, 361.18 KB, 367.38 KB, 44.00 KB, 234.63 KB, 697.68 KB, 386.30 KB, 388.59 KB, 644.72 KB, 84.00 KB, 84.00 KB, 662.27 KB ThreadUsage(500.000ms): 1, 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.23 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.51 MB (5777952) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 51.221ms - RowsProduced: 1 (1) - TotalCpuTime: 32s796ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 179.363us - TotalStorageWaitTime: 31s432ms CodeGen:(Total: 102.114ms, non-child: 102.114ms, % non-child: 100.00%) - CodegenTime: 819.805us - CompileTime: 15.018ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 38.375ms - PrepareTime: 48.191ms DataStreamSender (dst_id=106):(Total: 51.138us, non-child: 51.138us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 509.84 KB/sec - OverallThroughput: 305.54 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.038us - TransmitDataRPCTime: 30.647us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 12s695ms, non-child: 154.132ms, % non-child: 1.21%) ExecOption: Codegen Enabled - BuildTime: 44.037ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 12s541ms, non-child: 12s541ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 14.91 MB, 22.64 MB, 28.09 MB, 32.45 MB, 35.47 MB, 37.65 MB, 40.27 MB, 42.49 MB, 44.51 MB, 46.14 MB, 47.52 MB, 48.38 MB, 50.09 MB, 51.07 MB, 51.64 MB, 52.85 MB, 54.09 MB, 54.93 MB, 55.54 MB, 56.34 MB, 57.02 MB, 57.77 MB, 58.42 MB, 58.95 MB, 59.41 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.32 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 46.636ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 29 (29) - PeakMemoryUsage: 5.45 MB (5716512) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 60.89 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 94 (94) - ScannerThreadsTotalWallClockTime: 32s796ms - MaterializeTupleTime(*): 576.529ms - ScannerThreadsSysTime: 95.972ms - ScannerThreadsUserTime: 897.848ms - ScannerThreadsVoluntaryContextSwitches: 3.30K (3304) - TotalRawHdfsReadTime(*): 41.038ms - TotalReadThroughput: 4.75 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000001b (host=vd1310.halxg.cloudera.com:22000):(Total: 12s792ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 2.70 MB, 2.44 MB, 2.27 MB, 2.51 MB, 379.75 KB, 396.52 KB, 554.80 KB, 237.23 KB, 1.35 MB, 1.05 MB, 233.37 KB, 84.00 KB, 561.84 KB, 231.73 KB, 651.91 KB, 742.81 KB, 44.00 KB, 227.55 KB, 387.79 KB, 44.00 KB, 365.56 KB, 84.00 KB, 84.00 KB, 377.80 KB, 373.40 KB, 696.68 KB ThreadUsage(500.000ms): 16, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.42 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.94 MB (6223912) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 34.939ms - RowsProduced: 1 (1) - TotalCpuTime: 29s361ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 266.213us - TotalStorageWaitTime: 28s241ms CodeGen:(Total: 78.811ms, non-child: 78.811ms, % non-child: 100.00%) - CodegenTime: 870.292us - CompileTime: 12.537ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 33.438ms - PrepareTime: 32.466ms DataStreamSender (dst_id=106):(Total: 44.937us, non-child: 44.937us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 621.49 KB/sec - OverallThroughput: 347.71 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.320us - TransmitDataRPCTime: 25.141us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 12s786ms, non-child: 118.551ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 40.293ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 12s668ms, non-child: 12s668ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 7.26 MB, 20.18 MB, 27.02 MB, 31.97 MB, 35.32 MB, 38.14 MB, 40.81 MB, 43.17 MB, 45.19 MB, 47.10 MB, 48.42 MB, 49.77 MB, 51.14 MB, 52.24 MB, 53.00 MB, 53.97 MB, 54.70 MB, 55.62 MB, 55.98 MB, 56.51 MB, 56.93 MB, 57.31 MB, 57.83 MB, 58.44 MB, 58.92 MB, 59.43 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.42 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 43.727ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 19 (19) - PeakMemoryUsage: 5.89 MB (6178856) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 60.48 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 64 (64) - ScannerThreadsTotalWallClockTime: 29s361ms - MaterializeTupleTime(*): 546.520ms - ScannerThreadsSysTime: 78.982ms - ScannerThreadsUserTime: 877.855ms - ScannerThreadsVoluntaryContextSwitches: 3.23K (3226) - TotalRawHdfsReadTime(*): 40.649ms - TotalReadThroughput: 4.57 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000001d (host=vd1312.halxg.cloudera.com:22000):(Total: 15s134ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 3.71 MB, 1.27 MB, 1.31 MB, 2.28 MB, 1.49 MB, 630.55 KB, 1.43 MB, 132.00 KB, 92.00 KB, 731.95 KB, 615.88 KB, 231.35 KB, 394.71 KB, 44.00 KB, 1022.41 KB, 374.48 KB, 44.00 KB, 44.00 KB, 84.00 KB, 84.00 KB, 692.72 KB, 84.00 KB, 580.03 KB, 84.00 KB, 962.95 KB, 370.91 KB, 84.00 KB, 371.77 KB, 362.76 KB, 44.00 KB ThreadUsage(500.000ms): 19, 10, 7, 6, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.43 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.77 MB (7097888) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 53.752ms - RowsProduced: 1 (1) - TotalCpuTime: 36s918ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 327.522us - TotalStorageWaitTime: 35s354ms CodeGen:(Total: 101.906ms, non-child: 101.906ms, % non-child: 100.00%) - CodegenTime: 611.374us - CompileTime: 11.116ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 38.696ms - PrepareTime: 51.544ms DataStreamSender (dst_id=106):(Total: 63.046us, non-child: 63.046us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 352.00 KB/sec - OverallThroughput: 247.83 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.498us - TransmitDataRPCTime: 44.389us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 15s127ms, non-child: 155.191ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 46.895ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 14s972ms, non-child: 14s972ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 10.97 MB, 19.80 MB, 25.69 MB, 29.43 MB, 32.63 MB, 35.00 MB, 37.39 MB, 39.48 MB, 41.54 MB, 42.96 MB, 44.43 MB, 45.90 MB, 46.95 MB, 48.52 MB, 49.68 MB, 50.83 MB, 52.31 MB, 52.67 MB, 53.95 MB, 54.82 MB, 55.64 MB, 56.39 MB, 57.25 MB, 57.78 MB, 58.30 MB, 59.00 MB, 59.58 MB, 59.98 MB, 60.41 MB, 60.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.43 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 47.949ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 34 (34) - PeakMemoryUsage: 6.73 MB (7061024) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 50.86 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 82 (82) - ScannerThreadsTotalWallClockTime: 36s919ms - MaterializeTupleTime(*): 576.052ms - ScannerThreadsSysTime: 95.975ms - ScannerThreadsUserTime: 896.842ms - ScannerThreadsVoluntaryContextSwitches: 3.53K (3531) - TotalRawHdfsReadTime(*): 40.470ms - TotalReadThroughput: 4.05 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000020 (host=vd1314.halxg.cloudera.com:22000):(Total: 11s829ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 2.86 MB, 1.66 MB, 1.35 MB, 333.80 KB, 778.26 KB, 854.70 KB, 395.09 KB, 381.24 KB, 360.30 KB, 716.91 KB, 44.00 KB, 385.23 KB, 44.00 KB, 703.34 KB, 84.00 KB, 84.00 KB, 386.95 KB, 372.43 KB, 688.57 KB, 229.23 KB, 656.47 KB, 84.00 KB, 359.66 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.35 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.39 MB (6700728) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 47.496ms - RowsProduced: 1 (1) - TotalCpuTime: 29s488ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 254.545us - TotalStorageWaitTime: 28s274ms CodeGen:(Total: 88.962ms, non-child: 88.962ms, % non-child: 100.00%) - CodegenTime: 654.902us - CompileTime: 11.260ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.879ms - PrepareTime: 44.296ms DataStreamSender (dst_id=106):(Total: 41.801us, non-child: 41.801us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 620.04 KB/sec - OverallThroughput: 373.79 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.531us - TransmitDataRPCTime: 25.200us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 11s822ms, non-child: 122.111ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 47.160ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 11s700ms, non-child: 11s700ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 14.81 MB, 23.01 MB, 29.17 MB, 33.73 MB, 36.68 MB, 39.40 MB, 41.69 MB, 43.69 MB, 46.00 MB, 47.46 MB, 48.79 MB, 49.80 MB, 50.85 MB, 52.20 MB, 53.88 MB, 54.75 MB, 55.77 MB, 56.75 MB, 57.43 MB, 58.55 MB, 59.16 MB, 59.47 MB, 59.78 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.35 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 44.711ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 6.36 MB (6663864) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 65.24 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 101 (101) - ScannerThreadsTotalWallClockTime: 29s488ms - MaterializeTupleTime(*): 586.854ms - ScannerThreadsSysTime: 112.975ms - ScannerThreadsUserTime: 904.852ms - ScannerThreadsVoluntaryContextSwitches: 3.31K (3309) - TotalRawHdfsReadTime(*): 40.808ms - TotalReadThroughput: 5.20 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000001f (host=vd1316.halxg.cloudera.com:22000):(Total: 13s916ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 28.00 KB, 1.90 MB, 2.06 MB, 2.99 MB, 1.65 MB, 140.00 KB, 776.48 KB, 663.34 KB, 1.19 MB, 92.00 KB, 723.37 KB, 378.76 KB, 570.88 KB, 802.11 KB, 382.59 KB, 669.04 KB, 399.37 KB, 44.00 KB, 84.00 KB, 225.55 KB, 697.93 KB, 44.00 KB, 387.56 KB, 44.00 KB, 84.00 KB, 575.12 KB, 44.00 KB, 377.19 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.02 MB (5267080) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 46.756ms - RowsProduced: 1 (1) - TotalCpuTime: 33s352ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 248.803us - TotalStorageWaitTime: 31s965ms CodeGen:(Total: 97.511ms, non-child: 97.511ms, % non-child: 100.00%) - CodegenTime: 674.515us - CompileTime: 14.831ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 37.453ms - PrepareTime: 44.478ms DataStreamSender (dst_id=106):(Total: 69.014us, non-child: 69.014us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 328.39 KB/sec - OverallThroughput: 226.40 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.338us - TransmitDataRPCTime: 47.580us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 13s910ms, non-child: 137.754ms, % non-child: 0.99%) ExecOption: Codegen Enabled - BuildTime: 49.985ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 13s772ms, non-child: 13s772ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 0, 15.46 MB, 22.09 MB, 28.17 MB, 33.23 MB, 36.04 MB, 38.43 MB, 40.65 MB, 42.51 MB, 44.27 MB, 45.79 MB, 46.94 MB, 48.41 MB, 49.64 MB, 50.54 MB, 51.94 MB, 52.49 MB, 53.19 MB, 53.89 MB, 54.62 MB, 55.32 MB, 55.69 MB, 56.19 MB, 56.81 MB, 57.25 MB, 58.02 MB, 58.45 MB, 58.99 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.15 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 43.850ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 4.99 MB (5230216) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 55.50 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 75 (75) - ScannerThreadsTotalWallClockTime: 33s352ms - MaterializeTupleTime(*): 575.767ms - ScannerThreadsSysTime: 90.976ms - ScannerThreadsUserTime: 908.847ms - ScannerThreadsVoluntaryContextSwitches: 3.30K (3300) - TotalRawHdfsReadTime(*): 40.532ms - TotalReadThroughput: 4.21 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000001a (host=vd1309.halxg.cloudera.com:22000):(Total: 9s838ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 4.08 MB, 2.25 MB, 968.05 KB, 729.79 KB, 371.82 KB, 668.02 KB, 44.00 KB, 22.77 MB, 44.00 KB, 209.38 KB, 84.00 KB, 226.35 KB, 365.90 KB, 651.41 KB, 981.77 KB, 84.00 KB, 391.78 KB, 384.43 KB, 654.84 KB, 377.09 KB ThreadUsage(500.000ms): 14, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.30 MB (25482136) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 55.364ms - RowsProduced: 1 (1) - TotalCpuTime: 15s502ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 185.769us - TotalStorageWaitTime: 13s495ms CodeGen:(Total: 99.161ms, non-child: 99.161ms, % non-child: 100.00%) - CodegenTime: 577.590us - CompileTime: 13.257ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.490ms - PrepareTime: 53.315ms DataStreamSender (dst_id=106):(Total: 56.474us, non-child: 56.474us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 416.74 KB/sec - OverallThroughput: 276.68 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.893us - TransmitDataRPCTime: 37.493us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=33):(Total: 9s830ms, non-child: 406.082ms, % non-child: 4.13%) ExecOption: Codegen Enabled - BuildTime: 291.577ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=32):(Total: 9s424ms, non-child: 9s424ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 1.99 MB, 17.50 MB, 23.97 MB, 28.71 MB, 32.03 MB, 34.93 MB, 36.71 MB, 51.15 MB, 52.62 MB, 54.21 MB, 55.55 MB, 56.72 MB, 57.58 MB, 58.60 MB, 60.05 MB, 60.90 MB, 61.13 MB, 61.48 MB, 61.88 MB, 62.25 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.95 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 188.921ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 23.45 MB (24594176) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 71.88 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 127 (127) - ScannerThreadsTotalWallClockTime: 15s502ms - MaterializeTupleTime(*): 762.779ms - ScannerThreadsSysTime: 112.978ms - ScannerThreadsUserTime: 902.857ms - ScannerThreadsVoluntaryContextSwitches: 4.07K (4068) - TotalRawHdfsReadTime(*): 44.273ms - TotalReadThroughput: 6.23 MB/sec Fragment F31: Instance da46dbd7c4e8e43b:bc4eab3900000021 (host=vd1309.halxg.cloudera.com:22000):(Total: 16s417ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 40.01 KB, 44.01 KB, 44.01 KB, 52.01 KB, 56.01 KB, 56.01 KB, 56.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 42.515ms - RowsProduced: 1 (1) - TotalCpuTime: 66.596ms - TotalNetworkReceiveTime: 16s371ms - TotalNetworkSendTime: 730.022us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 62.846ms, non-child: 62.846ms, % non-child: 100.00%) - CodegenTime: 343.277us - CompileTime: 4.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 10.548ms - PrepareTime: 46.528ms DataStreamSender (dst_id=105):(Total: 54.459us, non-child: 54.459us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 712.04 KB/sec - OverallThroughput: 286.91 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 17.974us - TransmitDataRPCTime: 21.944us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=104):(Total: 16s414ms, non-child: 42.648ms, % non-child: 0.26%) ExecOption: Codegen Enabled - BuildTime: 10.985us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=103):(Total: 16s372ms, non-child: 136.193us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 32.00 B, 32.00 B, 64.00 B, 80.00 B, 80.00 B, 80.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 13.576us - DeserializeRowBatchTimer: 60.193us - FirstBatchArrivalWaitTime: 11s624ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F30: Instance da46dbd7c4e8e43b:bc4eab3900000026 (host=vd1311.halxg.cloudera.com:22000):(Total: 11s604ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 0, 3.53 MB, 2.45 MB, 2.05 MB, 459.16 KB, 723.13 KB, 796.38 KB, 275.09 KB, 236.71 KB, 414.30 KB, 1.01 MB, 84.00 KB, 381.60 KB, 44.00 KB, 44.00 KB, 44.00 KB, 381.79 KB, 993.09 KB, 44.00 KB, 84.00 KB, 44.00 KB, 1.05 MB, 84.00 KB, 664.86 KB ThreadUsage(500.000ms): 1, 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.97 MB (6263072) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 45.539ms - RowsProduced: 1 (1) - TotalCpuTime: 31s879ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 202.877us - TotalStorageWaitTime: 30s434ms CodeGen:(Total: 87.447ms, non-child: 87.447ms, % non-child: 100.00%) - CodegenTime: 568.421us - CompileTime: 11.105ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.641ms - PrepareTime: 43.000ms DataStreamSender (dst_id=103):(Total: 44.599us, non-child: 44.599us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 588.42 KB/sec - OverallThroughput: 350.34 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.348us - TransmitDataRPCTime: 26.554us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 11s596ms, non-child: 124.354ms, % non-child: 1.07%) ExecOption: Codegen Enabled - BuildTime: 44.306ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 11s471ms, non-child: 11s471ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 14.72 MB, 22.08 MB, 27.87 MB, 32.64 MB, 36.14 MB, 38.17 MB, 40.51 MB, 42.40 MB, 44.33 MB, 45.57 MB, 47.19 MB, 48.27 MB, 50.00 MB, 51.20 MB, 52.16 MB, 53.59 MB, 54.80 MB, 55.92 MB, 56.53 MB, 57.30 MB, 58.19 MB, 58.78 MB, 59.41 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.43 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 46.414ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 29 (29) - PeakMemoryUsage: 5.94 MB (6226208) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 66.56 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 117 (117) - ScannerThreadsTotalWallClockTime: 31s879ms - MaterializeTupleTime(*): 591.972ms - ScannerThreadsSysTime: 116.974ms - ScannerThreadsUserTime: 901.848ms - ScannerThreadsVoluntaryContextSwitches: 3.23K (3234) - TotalRawHdfsReadTime(*): 41.620ms - TotalReadThroughput: 5.17 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000024 (host=vd1313.halxg.cloudera.com:22000):(Total: 16s341ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 2.09 MB, 1.44 MB, 1.24 MB, 1.53 MB, 575.38 KB, 1.77 MB, 695.65 KB, 1.28 MB, 400.64 KB, 600.48 KB, 236.44 KB, 977.28 KB, 84.00 KB, 687.89 KB, 84.00 KB, 44.00 KB, 227.08 KB, 225.58 KB, 44.00 KB, 44.00 KB, 663.42 KB, 748.64 KB, 389.66 KB, 226.27 KB, 1.02 MB, 84.00 KB, 351.11 KB, 44.00 KB, 44.00 KB, 975.47 KB, 44.00 KB, 578.92 KB ThreadUsage(500.000ms): 16, 10, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.17 MB (5424112) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 54.142ms - RowsProduced: 1 (1) - TotalCpuTime: 37s163ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 236.348us - TotalStorageWaitTime: 35s752ms CodeGen:(Total: 95.063ms, non-child: 95.063ms, % non-child: 100.00%) - CodegenTime: 590.452us - CompileTime: 10.996ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.963ms - PrepareTime: 48.353ms DataStreamSender (dst_id=103):(Total: 43.714us, non-child: 43.714us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 849.79 KB/sec - OverallThroughput: 357.44 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.686us - TransmitDataRPCTime: 18.387us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 16s334ms, non-child: 152.910ms, % non-child: 0.94%) ExecOption: Codegen Enabled - BuildTime: 47.218ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 16s181ms, non-child: 16s181ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 9.84 MB, 17.83 MB, 23.30 MB, 27.42 MB, 30.38 MB, 33.31 MB, 35.43 MB, 37.87 MB, 40.01 MB, 41.61 MB, 43.11 MB, 44.36 MB, 45.56 MB, 46.89 MB, 47.79 MB, 49.00 MB, 49.93 MB, 50.98 MB, 51.44 MB, 51.95 MB, 53.03 MB, 53.75 MB, 54.29 MB, 55.04 MB, 55.90 MB, 56.55 MB, 57.03 MB, 57.66 MB, 58.19 MB, 58.73 MB, 58.97 MB, 59.39 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.19 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 47.560ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 29 (29) - PeakMemoryUsage: 5.14 MB (5387248) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 47.25 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 114 (114) - ScannerThreadsTotalWallClockTime: 37s163ms - MaterializeTupleTime(*): 588.375ms - ScannerThreadsSysTime: 110.972ms - ScannerThreadsUserTime: 911.847ms - ScannerThreadsVoluntaryContextSwitches: 3.24K (3237) - TotalRawHdfsReadTime(*): 41.817ms - TotalReadThroughput: 3.71 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000022 (host=vd1309.halxg.cloudera.com:22000):(Total: 14s536ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 28.00 KB, 2.18 MB, 23.66 MB, 52.00 KB, 391.20 KB, 212.00 KB, 384.88 KB, 84.00 KB, 172.00 KB, 360.26 KB, 84.00 KB, 384.35 KB, 84.00 KB, 84.00 KB, 207.57 KB, 84.00 KB, 377.10 KB, 385.91 KB, 685.89 KB, 84.00 KB, 44.00 KB, 392.88 KB, 228.17 KB, 44.00 KB, 44.00 KB, 84.00 KB, 44.00 KB, 376.68 KB, 229.29 KB ThreadUsage(500.000ms): 1, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.21 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.48 MB (25672440) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 58.081ms - RowsProduced: 1 (1) - TotalCpuTime: 19s445ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 411.368us - TotalStorageWaitTime: 17s210ms CodeGen:(Total: 121.625ms, non-child: 121.625ms, % non-child: 100.00%) - CodegenTime: 658.105us - CompileTime: 16.027ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 49.232ms - PrepareTime: 55.855ms DataStreamSender (dst_id=103):(Total: 39.426us, non-child: 39.426us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 788.94 KB/sec - OverallThroughput: 396.31 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.169us - TransmitDataRPCTime: 19.805us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 14s529ms, non-child: 347.482ms, % non-child: 2.39%) ExecOption: Codegen Enabled - BuildTime: 240.516ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 14s182ms, non-child: 14s182ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 0, 12.82 MB, 31.72 MB, 36.20 MB, 39.80 MB, 42.15 MB, 43.67 MB, 45.90 MB, 47.61 MB, 49.49 MB, 50.30 MB, 51.62 MB, 52.74 MB, 53.92 MB, 55.08 MB, 55.72 MB, 56.74 MB, 57.09 MB, 58.03 MB, 58.32 MB, 59.25 MB, 59.58 MB, 60.17 MB, 60.54 MB, 61.06 MB, 61.59 MB, 61.84 MB, 62.00 MB, 62.33 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.25 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 219.523ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 24.39 MB (25570032) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 47.77 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 138 (138) - ScannerThreadsTotalWallClockTime: 19s445ms - MaterializeTupleTime(*): 770.270ms - ScannerThreadsSysTime: 117.977ms - ScannerThreadsUserTime: 945.851ms - ScannerThreadsVoluntaryContextSwitches: 4.11K (4111) - TotalRawHdfsReadTime(*): 43.558ms - TotalReadThroughput: 4.30 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000025 (host=vd1312.halxg.cloudera.com:22000):(Total: 13s965ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 3.60 MB, 1.77 MB, 2.14 MB, 1.71 MB, 1.08 MB, 678.37 KB, 235.14 KB, 439.62 KB, 587.42 KB, 397.98 KB, 84.00 KB, 84.00 KB, 1021.45 KB, 362.22 KB, 44.00 KB, 376.98 KB, 664.33 KB, 396.42 KB, 388.11 KB, 666.38 KB, 1.26 MB, 368.86 KB, 374.27 KB, 389.64 KB, 394.48 KB, 740.92 KB, 44.00 KB, 392.16 KB ThreadUsage(500.000ms): 19, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.76 MB (6037320) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 46.298ms - RowsProduced: 1 (1) - TotalCpuTime: 35s576ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 283.008us - TotalStorageWaitTime: 34s067ms CodeGen:(Total: 85.019ms, non-child: 85.019ms, % non-child: 100.00%) - CodegenTime: 579.068us - CompileTime: 11.037ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.480ms - PrepareTime: 43.974ms DataStreamSender (dst_id=103):(Total: 50.715us, non-child: 50.715us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 493.17 KB/sec - OverallThroughput: 308.09 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.512us - TransmitDataRPCTime: 31.683us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 13s958ms, non-child: 147.740ms, % non-child: 1.06%) ExecOption: Codegen Enabled - BuildTime: 62.029ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 13s810ms, non-child: 13s810ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 11.14 MB, 19.58 MB, 26.17 MB, 30.48 MB, 33.80 MB, 36.20 MB, 38.81 MB, 40.82 MB, 42.76 MB, 44.27 MB, 45.67 MB, 46.99 MB, 48.50 MB, 49.64 MB, 51.13 MB, 52.26 MB, 53.05 MB, 54.03 MB, 54.98 MB, 55.56 MB, 56.28 MB, 57.03 MB, 57.81 MB, 58.33 MB, 58.85 MB, 59.61 MB, 60.15 MB, 60.81 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.50 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 44.164ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 34 (34) - PeakMemoryUsage: 5.72 MB (6000456) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 55.14 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 50 (50) - ScannerThreadsTotalWallClockTime: 35s576ms - MaterializeTupleTime(*): 582.008ms - ScannerThreadsSysTime: 67.982ms - ScannerThreadsUserTime: 936.839ms - ScannerThreadsVoluntaryContextSwitches: 3.51K (3508) - TotalRawHdfsReadTime(*): 41.246ms - TotalReadThroughput: 4.34 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000027 (host=vd1316.halxg.cloudera.com:22000):(Total: 13s862ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 28.00 KB, 2.06 MB, 2.70 MB, 852.55 KB, 586.35 KB, 439.19 KB, 728.38 KB, 1.33 MB, 379.23 KB, 936.96 KB, 713.79 KB, 84.00 KB, 44.00 KB, 44.00 KB, 374.78 KB, 228.98 KB, 656.68 KB, 84.00 KB, 226.61 KB, 84.00 KB, 225.48 KB, 44.00 KB, 373.55 KB, 375.39 KB, 1.02 MB, 44.00 KB, 229.02 KB, 384.80 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.18 MB (6484232) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 48.192ms - RowsProduced: 1 (1) - TotalCpuTime: 33s314ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 276.645us - TotalStorageWaitTime: 31s917ms CodeGen:(Total: 92.568ms, non-child: 92.568ms, % non-child: 100.00%) - CodegenTime: 737.688us - CompileTime: 11.038ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 35.440ms - PrepareTime: 45.481ms DataStreamSender (dst_id=103):(Total: 69.935us, non-child: 69.935us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 325.97 KB/sec - OverallThroughput: 223.42 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.804us - TransmitDataRPCTime: 47.934us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 13s857ms, non-child: 125.125ms, % non-child: 0.90%) ExecOption: Codegen Enabled - BuildTime: 48.460ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 13s732ms, non-child: 13s732ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 0, 16.25 MB, 22.98 MB, 28.48 MB, 33.06 MB, 35.70 MB, 37.95 MB, 40.45 MB, 42.24 MB, 43.97 MB, 45.07 MB, 46.74 MB, 47.83 MB, 49.05 MB, 50.29 MB, 51.27 MB, 52.19 MB, 53.10 MB, 54.02 MB, 54.66 MB, 55.31 MB, 55.68 MB, 56.18 MB, 56.82 MB, 57.35 MB, 58.21 MB, 58.77 MB, 59.12 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.15 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 46.756ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 6.13 MB (6425192) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 55.66 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 90 (90) - ScannerThreadsTotalWallClockTime: 33s314ms - MaterializeTupleTime(*): 568.050ms - ScannerThreadsSysTime: 93.975ms - ScannerThreadsUserTime: 902.848ms - ScannerThreadsVoluntaryContextSwitches: 3.37K (3371) - TotalRawHdfsReadTime(*): 40.408ms - TotalReadThroughput: 4.22 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000028 (host=vd1314.halxg.cloudera.com:22000):(Total: 13s035ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 2.24 MB, 2.56 MB, 1.68 MB, 961.68 KB, 1.15 MB, 733.57 KB, 698.30 KB, 439.88 KB, 52.00 KB, 92.00 KB, 355.33 KB, 970.79 KB, 1.01 MB, 571.10 KB, 84.00 KB, 231.89 KB, 687.16 KB, 84.00 KB, 225.42 KB, 364.43 KB, 380.80 KB, 227.96 KB, 364.83 KB, 84.00 KB, 44.00 KB, 681.05 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.19 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.23 MB (5480032) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 55.275ms - RowsProduced: 1 (1) - TotalCpuTime: 30s311ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 194.566us - TotalStorageWaitTime: 29s147ms CodeGen:(Total: 95.020ms, non-child: 95.020ms, % non-child: 100.00%) - CodegenTime: 619.410us - CompileTime: 10.828ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.466ms - PrepareTime: 51.819ms DataStreamSender (dst_id=103):(Total: 39.968us, non-child: 39.968us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 744.93 KB/sec - OverallThroughput: 390.94 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.420us - TransmitDataRPCTime: 20.975us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 13s027ms, non-child: 129.448ms, % non-child: 0.99%) ExecOption: Codegen Enabled - BuildTime: 39.299ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 12s898ms, non-child: 12s898ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 12.86 MB, 20.96 MB, 26.87 MB, 30.80 MB, 34.01 MB, 36.12 MB, 38.40 MB, 40.52 MB, 42.45 MB, 44.17 MB, 45.28 MB, 47.05 MB, 48.61 MB, 50.38 MB, 51.26 MB, 52.45 MB, 53.39 MB, 54.30 MB, 55.13 MB, 55.65 MB, 55.99 MB, 56.93 MB, 57.27 MB, 58.09 MB, 59.09 MB, 59.92 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.19 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 43.611ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 5.03 MB (5269432) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 59.18 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 112 (112) - ScannerThreadsTotalWallClockTime: 30s311ms - MaterializeTupleTime(*): 573.014ms - ScannerThreadsSysTime: 101.976ms - ScannerThreadsUserTime: 898.853ms - ScannerThreadsVoluntaryContextSwitches: 3.15K (3152) - TotalRawHdfsReadTime(*): 46.214ms - TotalReadThroughput: 4.61 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000023 (host=vd1310.halxg.cloudera.com:22000):(Total: 15s794ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 5.58 MB, 1.97 MB, 2.43 MB, 1.50 MB, 464.12 KB, 767.16 KB, 565.44 KB, 241.55 KB, 728.26 KB, 1.27 MB, 363.01 KB, 979.62 KB, 371.79 KB, 228.39 KB, 392.30 KB, 84.00 KB, 226.55 KB, 364.34 KB, 172.00 KB, 84.00 KB, 44.00 KB, 44.00 KB, 659.35 KB, 1.02 MB, 1.00 MB, 982.48 KB, 369.10 KB, 84.00 KB, 84.00 KB, 84.00 KB, 817.43 KB, 381.44 KB ThreadUsage(500.000ms): 18, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.87 MB (6150344) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 45.135ms - RowsProduced: 1 (1) - TotalCpuTime: 31s440ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 233.852us - TotalStorageWaitTime: 30s295ms CodeGen:(Total: 86.759ms, non-child: 86.759ms, % non-child: 100.00%) - CodegenTime: 486.491us - CompileTime: 12.240ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.098ms - PrepareTime: 42.824ms DataStreamSender (dst_id=103):(Total: 41.127us, non-child: 41.127us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 665.35 KB/sec - OverallThroughput: 379.92 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.039us - TransmitDataRPCTime: 23.484us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=31):(Total: 15s788ms, non-child: 161.344ms, % non-child: 1.02%) ExecOption: Codegen Enabled - BuildTime: 40.913ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=30):(Total: 15s627ms, non-child: 15s627ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 3.74 MB, 16.67 MB, 24.02 MB, 28.83 MB, 32.60 MB, 35.28 MB, 36.94 MB, 38.96 MB, 40.86 MB, 42.87 MB, 43.97 MB, 45.57 MB, 46.72 MB, 47.92 MB, 49.15 MB, 50.32 MB, 50.88 MB, 51.91 MB, 52.88 MB, 53.50 MB, 53.73 MB, 54.17 MB, 54.91 MB, 55.51 MB, 56.03 MB, 56.61 MB, 57.10 MB, 57.48 MB, 58.07 MB, 58.51 MB, 59.02 MB, 59.44 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.22 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 42.760ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 18 (18) - PeakMemoryUsage: 5.80 MB (6080712) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 49.03 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 110 (110) - ScannerThreadsTotalWallClockTime: 31s440ms - MaterializeTupleTime(*): 545.360ms - ScannerThreadsSysTime: 87.981ms - ScannerThreadsUserTime: 865.860ms - ScannerThreadsVoluntaryContextSwitches: 3.22K (3216) - TotalRawHdfsReadTime(*): 40.704ms - TotalReadThroughput: 3.72 MB/sec Fragment F29: Instance da46dbd7c4e8e43b:bc4eab3900000029 (host=vd1309.halxg.cloudera.com:22000):(Total: 18s809ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 52.01 KB, 52.01 KB, 56.01 KB, 56.01 KB, 60.01 KB, 60.01 KB, 60.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 67.061ms - RowsProduced: 1 (1) - TotalCpuTime: 84.150ms - TotalNetworkReceiveTime: 18s741ms - TotalNetworkSendTime: 213.315us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 80.442ms, non-child: 80.442ms, % non-child: 100.00%) - CodegenTime: 351.345us - CompileTime: 3.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 8.950ms - PrepareTime: 62.326ms DataStreamSender (dst_id=102):(Total: 68.292us, non-child: 68.292us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 462.22 KB/sec - OverallThroughput: 228.80 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.960us - TransmitDataRPCTime: 33.804us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=101):(Total: 18s808ms, non-child: 67.127ms, % non-child: 0.36%) ExecOption: Codegen Enabled - BuildTime: 12.723us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=100):(Total: 18s741ms, non-child: 107.685us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 64.00 B, 64.00 B, 80.00 B, 80.00 B, 96.00 B, 96.00 B, 96.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 13.227us - DeserializeRowBatchTimer: 236.029us - FirstBatchArrivalWaitTime: 14s011ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F28: Instance da46dbd7c4e8e43b:bc4eab390000002a (host=vd1309.halxg.cloudera.com:22000):(Total: 14s681ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 28.00 KB, 1.20 MB, 789.16 KB, 572.34 KB, 718.69 KB, 349.93 KB, 549.96 KB, 84.00 KB, 44.00 KB, 1.08 MB, 571.23 KB, 44.00 KB, 84.00 KB, 84.00 KB, 224.14 KB, 234.27 KB, 652.41 KB, 686.80 KB, 342.98 KB, 578.06 KB, 365.91 KB, 44.00 KB, 673.09 KB, 227.93 KB, 84.00 KB, 229.90 KB, 84.00 KB, 985.07 KB, 84.00 KB, 84.00 KB ThreadUsage(500.000ms): 1, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.20 - BloomFilterBytes: 0 - PeakMemoryUsage: 26.24 MB (27514072) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 54.799ms - RowsProduced: 1 (1) - TotalCpuTime: 19s426ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 324.550us - TotalStorageWaitTime: 17s488ms CodeGen:(Total: 134.878ms, non-child: 134.878ms, % non-child: 100.00%) - CodegenTime: 570.637us - CompileTime: 34.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 45.153ms - PrepareTime: 51.511ms DataStreamSender (dst_id=100):(Total: 37.803us, non-child: 37.803us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 728.03 KB/sec - OverallThroughput: 413.33 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.815us - TransmitDataRPCTime: 21.462us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 14s674ms, non-child: 303.797ms, % non-child: 2.07%) ExecOption: Codegen Enabled - BuildTime: 231.311ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 14s370ms, non-child: 14s370ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 0, 24.43 MB, 31.40 MB, 35.88 MB, 39.84 MB, 42.34 MB, 44.54 MB, 46.52 MB, 48.18 MB, 49.43 MB, 50.42 MB, 51.63 MB, 52.69 MB, 53.64 MB, 54.38 MB, 55.24 MB, 56.18 MB, 56.45 MB, 57.37 MB, 57.86 MB, 58.45 MB, 58.98 MB, 59.55 MB, 60.34 MB, 60.73 MB, 61.13 MB, 61.42 MB, 61.86 MB, 62.28 MB, 62.45 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.24 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 163.219ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 26.20 MB (27477208) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 47.14 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 93 (93) - ScannerThreadsTotalWallClockTime: 19s426ms - MaterializeTupleTime(*): 710.436ms - ScannerThreadsSysTime: 111.978ms - ScannerThreadsUserTime: 899.859ms - ScannerThreadsVoluntaryContextSwitches: 4.03K (4027) - TotalRawHdfsReadTime(*): 58.803ms - TotalReadThroughput: 4.16 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000002c (host=vd1313.halxg.cloudera.com:22000):(Total: 18s677ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 4.49 MB, 3.31 MB, 1.05 MB, 961.93 KB, 1.82 MB, 705.94 KB, 132.00 KB, 626.92 KB, 681.23 KB, 742.96 KB, 84.00 KB, 739.73 KB, 365.12 KB, 44.00 KB, 44.00 KB, 375.70 KB, 700.91 KB, 44.00 KB, 84.00 KB, 84.00 KB, 44.00 KB, 368.74 KB, 583.05 KB, 363.09 KB, 228.81 KB, 381.65 KB, 84.00 KB, 360.31 KB, 676.74 KB, 554.70 KB, 44.00 KB, 148.00 KB, 84.00 KB, 84.00 KB, 371.80 KB, 1.01 MB, 84.00 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.90 MB (6189720) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 45.818ms - RowsProduced: 1 (1) - TotalCpuTime: 38s134ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 258.069us - TotalStorageWaitTime: 36s771ms CodeGen:(Total: 83.272ms, non-child: 83.272ms, % non-child: 100.00%) - CodegenTime: 539.425us - CompileTime: 10.762ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 28.356ms - PrepareTime: 43.524ms DataStreamSender (dst_id=100):(Total: 64.840us, non-child: 64.840us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 462.67 KB/sec - OverallThroughput: 240.98 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.886us - TransmitDataRPCTime: 33.771us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 18s670ms, non-child: 179.672ms, % non-child: 0.96%) ExecOption: Codegen Enabled - BuildTime: 47.915ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 18s490ms, non-child: 18s490ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 7.29 MB, 16.32 MB, 21.99 MB, 26.26 MB, 29.33 MB, 31.70 MB, 34.00 MB, 36.58 MB, 38.43 MB, 39.57 MB, 41.06 MB, 42.49 MB, 43.46 MB, 44.60 MB, 45.99 MB, 46.66 MB, 47.60 MB, 48.67 MB, 49.45 MB, 50.14 MB, 51.08 MB, 51.67 MB, 52.54 MB, 53.22 MB, 53.72 MB, 54.13 MB, 54.79 MB, 55.19 MB, 55.71 MB, 56.27 MB, 56.80 MB, 57.42 MB, 57.93 MB, 58.28 MB, 58.68 MB, 59.26 MB, 59.58 MB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.08 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 44.130ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 5.87 MB (6152856) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 41.35 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 90 (90) - ScannerThreadsTotalWallClockTime: 38s135ms - MaterializeTupleTime(*): 578.364ms - ScannerThreadsSysTime: 100.977ms - ScannerThreadsUserTime: 907.849ms - ScannerThreadsVoluntaryContextSwitches: 3.16K (3161) - TotalRawHdfsReadTime(*): 41.846ms - TotalReadThroughput: 3.22 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000002b (host=vd1310.halxg.cloudera.com:22000):(Total: 15s933ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 4.13 MB, 2.03 MB, 1.36 MB, 632.28 KB, 930.72 KB, 1.02 MB, 1.27 MB, 918.72 KB, 399.82 KB, 1.28 MB, 212.00 KB, 44.00 KB, 84.00 KB, 44.00 KB, 369.10 KB, 351.79 KB, 664.77 KB, 370.52 KB, 44.00 KB, 84.00 KB, 388.75 KB, 673.34 KB, 673.95 KB, 44.00 KB, 84.00 KB, 44.00 KB, 364.02 KB, 381.01 KB, 367.74 KB, 687.27 KB, 227.12 KB, 84.00 KB ThreadUsage(500.000ms): 16, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.16 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.77 MB (6052144) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 42.451ms - RowsProduced: 1 (1) - TotalCpuTime: 31s158ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 217.251us - TotalStorageWaitTime: 30s040ms CodeGen:(Total: 80.485ms, non-child: 80.485ms, % non-child: 100.00%) - CodegenTime: 556.624us - CompileTime: 10.626ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.355ms - PrepareTime: 39.828ms DataStreamSender (dst_id=100):(Total: 59.018us, non-child: 59.018us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 379.91 KB/sec - OverallThroughput: 264.75 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.284us - TransmitDataRPCTime: 41.128us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 15s926ms, non-child: 157.641ms, % non-child: 0.99%) ExecOption: Codegen Enabled - BuildTime: 43.529ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 15s769ms, non-child: 15s769ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 2.60 MB, 16.31 MB, 22.53 MB, 27.40 MB, 31.31 MB, 34.05 MB, 36.25 MB, 38.72 MB, 40.51 MB, 42.35 MB, 43.39 MB, 45.04 MB, 46.24 MB, 47.79 MB, 49.16 MB, 50.29 MB, 51.54 MB, 52.25 MB, 53.05 MB, 53.84 MB, 54.07 MB, 54.81 MB, 55.25 MB, 55.82 MB, 56.27 MB, 56.69 MB, 57.18 MB, 57.62 MB, 58.13 MB, 58.64 MB, 58.99 MB, 59.38 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.16 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 41.915ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 5.73 MB (6011152) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 48.59 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 79 (79) - ScannerThreadsTotalWallClockTime: 31s158ms - MaterializeTupleTime(*): 561.050ms - ScannerThreadsSysTime: 100.977ms - ScannerThreadsUserTime: 870.859ms - ScannerThreadsVoluntaryContextSwitches: 3.10K (3103) - TotalRawHdfsReadTime(*): 40.220ms - TotalReadThroughput: 3.71 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000002f (host=vd1316.halxg.cloudera.com:22000):(Total: 14s687ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 0, 4.90 MB, 1.02 MB, 1.57 MB, 1.34 MB, 597.94 KB, 1.28 MB, 92.00 KB, 339.89 KB, 414.81 KB, 589.34 KB, 680.70 KB, 44.00 KB, 362.06 KB, 84.00 KB, 229.52 KB, 84.00 KB, 226.55 KB, 44.00 KB, 44.00 KB, 84.00 KB, 389.79 KB, 690.28 KB, 382.59 KB, 84.00 KB, 84.00 KB, 44.00 KB, 229.02 KB, 84.00 KB, 44.00 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.17 MB (6466328) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 41.303ms - RowsProduced: 1 (1) - TotalCpuTime: 33s516ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 203.002us - TotalStorageWaitTime: 32s272ms CodeGen:(Total: 78.465ms, non-child: 78.465ms, % non-child: 100.00%) - CodegenTime: 577.864us - CompileTime: 10.125ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 28.726ms - PrepareTime: 39.145ms DataStreamSender (dst_id=100):(Total: 36.826us, non-child: 36.826us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 859.93 KB/sec - OverallThroughput: 424.29 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.066us - TransmitDataRPCTime: 18.170us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 14s681ms, non-child: 122.614ms, % non-child: 0.84%) ExecOption: Codegen Enabled - BuildTime: 41.711ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 14s559ms, non-child: 14s559ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 14.92 MB, 21.49 MB, 27.28 MB, 31.80 MB, 34.91 MB, 37.03 MB, 39.31 MB, 41.03 MB, 42.66 MB, 43.84 MB, 45.05 MB, 46.40 MB, 47.84 MB, 49.24 MB, 50.30 MB, 51.03 MB, 51.77 MB, 52.65 MB, 53.50 MB, 54.21 MB, 54.71 MB, 55.39 MB, 56.05 MB, 56.65 MB, 57.16 MB, 57.77 MB, 58.26 MB, 58.72 MB, 59.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.07 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 43.947ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 6.13 MB (6429464) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 52.50 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 141 (141) - ScannerThreadsTotalWallClockTime: 33s516ms - MaterializeTupleTime(*): 555.556ms - ScannerThreadsSysTime: 86.975ms - ScannerThreadsUserTime: 891.854ms - ScannerThreadsVoluntaryContextSwitches: 3.17K (3166) - TotalRawHdfsReadTime(*): 40.702ms - TotalReadThroughput: 4.08 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000030 (host=vd1314.halxg.cloudera.com:22000):(Total: 15s032ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 2.89 MB, 4.14 MB, 2.88 MB, 471.80 KB, 745.92 KB, 902.45 KB, 180.00 KB, 1.42 MB, 709.60 KB, 1.02 MB, 44.00 KB, 381.73 KB, 84.00 KB, 380.34 KB, 368.66 KB, 687.09 KB, 838.00 KB, 579.34 KB, 231.49 KB, 355.33 KB, 84.00 KB, 84.00 KB, 84.00 KB, 84.00 KB, 44.00 KB, 385.63 KB, 84.00 KB, 401.80 KB, 659.12 KB, 985.79 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.03 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.64 MB (5918808) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 42.457ms - RowsProduced: 1 (1) - TotalCpuTime: 31s748ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 229.201us - TotalStorageWaitTime: 30s564ms CodeGen:(Total: 84.587ms, non-child: 84.587ms, % non-child: 100.00%) - CodegenTime: 617.005us - CompileTime: 11.761ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 32.002ms - PrepareTime: 40.151ms DataStreamSender (dst_id=100):(Total: 49.993us, non-child: 49.993us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 482.03 KB/sec - OverallThroughput: 312.54 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.906us - TransmitDataRPCTime: 32.415us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 15s025ms, non-child: 125.760ms, % non-child: 0.84%) ExecOption: Codegen Enabled - BuildTime: 42.398ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 14s899ms, non-child: 14s899ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 9.94 MB, 18.59 MB, 25.30 MB, 29.34 MB, 32.42 MB, 34.35 MB, 36.60 MB, 39.02 MB, 41.01 MB, 42.64 MB, 44.40 MB, 45.69 MB, 46.86 MB, 48.22 MB, 49.07 MB, 49.84 MB, 51.10 MB, 52.03 MB, 52.95 MB, 53.57 MB, 54.03 MB, 54.65 MB, 55.26 MB, 55.77 MB, 56.54 MB, 57.22 MB, 57.67 MB, 58.24 MB, 59.15 MB, 59.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.03 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 45.638ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 19 (19) - PeakMemoryUsage: 5.61 MB (5881944) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 51.23 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 169 (169) - ScannerThreadsTotalWallClockTime: 31s748ms - MaterializeTupleTime(*): 569.047ms - ScannerThreadsSysTime: 105.977ms - ScannerThreadsUserTime: 899.853ms - ScannerThreadsVoluntaryContextSwitches: 2.92K (2922) - TotalRawHdfsReadTime(*): 40.796ms - TotalReadThroughput: 3.99 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000002d (host=vd1312.halxg.cloudera.com:22000):(Total: 16s761ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 2.84 MB, 3.04 MB, 2.94 MB, 731.41 KB, 991.59 KB, 693.84 KB, 279.82 KB, 1.40 MB, 196.00 KB, 588.75 KB, 44.00 KB, 44.00 KB, 84.00 KB, 393.73 KB, 84.00 KB, 570.55 KB, 84.00 KB, 693.57 KB, 375.24 KB, 384.90 KB, 701.84 KB, 383.18 KB, 695.73 KB, 378.67 KB, 360.08 KB, 44.00 KB, 44.00 KB, 84.00 KB, 378.25 KB, 84.00 KB, 84.00 KB, 84.00 KB, 409.73 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.24 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.90 MB (5132856) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 42.798ms - RowsProduced: 1 (1) - TotalCpuTime: 36s793ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 229.599us - TotalStorageWaitTime: 35s434ms CodeGen:(Total: 83.400ms, non-child: 83.400ms, % non-child: 100.00%) - CodegenTime: 543.789us - CompileTime: 10.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.150ms - PrepareTime: 40.715ms DataStreamSender (dst_id=100):(Total: 53.594us, non-child: 53.594us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 508.44 KB/sec - OverallThroughput: 291.54 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.868us - TransmitDataRPCTime: 30.731us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 16s755ms, non-child: 138.950ms, % non-child: 0.83%) ExecOption: Codegen Enabled - BuildTime: 46.603ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 16s616ms, non-child: 16s616ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 7.37 MB, 16.88 MB, 23.07 MB, 27.37 MB, 30.49 MB, 32.95 MB, 35.33 MB, 37.39 MB, 39.25 MB, 41.09 MB, 42.22 MB, 43.87 MB, 45.35 MB, 46.53 MB, 47.42 MB, 49.20 MB, 50.08 MB, 50.99 MB, 52.12 MB, 53.14 MB, 54.01 MB, 54.54 MB, 55.39 MB, 56.08 MB, 56.69 MB, 57.23 MB, 57.75 MB, 58.28 MB, 58.68 MB, 59.14 MB, 59.48 MB, 60.00 MB, 60.53 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.24 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 43.485ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 4.86 MB (5095992) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 45.83 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 91 (91) - ScannerThreadsTotalWallClockTime: 36s793ms - MaterializeTupleTime(*): 588.452ms - ScannerThreadsSysTime: 83.978ms - ScannerThreadsUserTime: 943.842ms - ScannerThreadsVoluntaryContextSwitches: 3.44K (3444) - TotalRawHdfsReadTime(*): 48.957ms - TotalReadThroughput: 3.67 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000002e (host=vd1311.halxg.cloudera.com:22000):(Total: 13s967ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 1.06 MB, 975.71 KB, 864.52 KB, 2.47 MB, 1.21 MB, 1.32 MB, 132.00 KB, 858.11 KB, 1011.80 KB, 52.00 KB, 383.65 KB, 402.63 KB, 683.96 KB, 84.00 KB, 84.00 KB, 44.00 KB, 365.35 KB, 84.00 KB, 44.00 KB, 224.59 KB, 376.02 KB, 84.00 KB, 44.00 KB, 394.49 KB, 683.84 KB, 665.76 KB, 370.02 KB, 36.00 KB ThreadUsage(500.000ms): 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 3.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.12 MB (6420152) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 39.950ms - RowsProduced: 1 (1) - TotalCpuTime: 33s221ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 208.933us - TotalStorageWaitTime: 31s941ms CodeGen:(Total: 78.222ms, non-child: 78.222ms, % non-child: 100.00%) - CodegenTime: 506.922us - CompileTime: 10.211ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.575ms - PrepareTime: 37.925ms DataStreamSender (dst_id=100):(Total: 39.445us, non-child: 39.445us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 691.10 KB/sec - OverallThroughput: 396.12 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.537us - TransmitDataRPCTime: 22.609us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=29):(Total: 13s959ms, non-child: 127.515ms, % non-child: 0.91%) ExecOption: Codegen Enabled - BuildTime: 46.799ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=28):(Total: 13s831ms, non-child: 13s831ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 12.23 MB, 20.36 MB, 26.15 MB, 30.42 MB, 33.13 MB, 35.16 MB, 37.67 MB, 39.75 MB, 41.58 MB, 43.11 MB, 44.69 MB, 45.69 MB, 47.13 MB, 47.95 MB, 49.51 MB, 50.71 MB, 52.09 MB, 52.55 MB, 53.77 MB, 54.43 MB, 55.05 MB, 55.51 MB, 56.60 MB, 57.19 MB, 57.61 MB, 58.20 MB, 58.57 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.22 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 49.277ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 6.09 MB (6383288) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 55.21 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 132 (132) - ScannerThreadsTotalWallClockTime: 33s221ms - MaterializeTupleTime(*): 566.197ms - ScannerThreadsSysTime: 85.977ms - ScannerThreadsUserTime: 904.853ms - ScannerThreadsVoluntaryContextSwitches: 2.99K (2992) - TotalRawHdfsReadTime(*): 40.959ms - TotalReadThroughput: 4.34 MB/sec Fragment F27: Instance da46dbd7c4e8e43b:bc4eab3900000031 (host=vd1309.halxg.cloudera.com:22000):(Total: 19s707ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 44.01 KB, 44.01 KB, 44.01 KB, 44.01 KB, 52.01 KB, 56.01 KB, 56.01 KB, 60.01 KB, 60.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 64.832ms - RowsProduced: 1 (1) - TotalCpuTime: 85.463ms - TotalNetworkReceiveTime: 19s640ms - TotalNetworkSendTime: 209.333us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 81.462ms, non-child: 81.462ms, % non-child: 100.00%) - CodegenTime: 449.810us - CompileTime: 4.384ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 9.690ms - PrepareTime: 66.051ms DataStreamSender (dst_id=99):(Total: 60.674us, non-child: 60.674us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 507.63 KB/sec - OverallThroughput: 257.52 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.589us - TransmitDataRPCTime: 30.780us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=98):(Total: 19s705ms, non-child: 64.894ms, % non-child: 0.33%) ExecOption: Codegen Enabled - BuildTime: 9.809us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=97):(Total: 19s640ms, non-child: 112.088us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 64.00 B, 80.00 B, 80.00 B, 96.00 B, 96.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 11.662us - DeserializeRowBatchTimer: 465.230us - FirstBatchArrivalWaitTime: 14s417ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F26: Instance da46dbd7c4e8e43b:bc4eab3900000036 (host=vd1311.halxg.cloudera.com:22000):(Total: 14s388ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 3.73 MB, 2.61 MB, 1.29 MB, 660.70 KB, 400.52 KB, 285.95 KB, 1001.09 KB, 448.52 KB, 382.96 KB, 1.17 MB, 84.00 KB, 374.49 KB, 388.62 KB, 148.00 KB, 44.00 KB, 237.52 KB, 667.38 KB, 357.48 KB, 84.00 KB, 84.00 KB, 388.98 KB, 1.01 MB, 383.65 KB, 376.91 KB, 380.68 KB, 380.06 KB, 359.46 KB, 44.00 KB ThreadUsage(500.000ms): 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.18 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.72 MB (5993208) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 44.966ms - RowsProduced: 1 (1) - TotalCpuTime: 33s034ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 240.345us - TotalStorageWaitTime: 31s692ms CodeGen:(Total: 85.595ms, non-child: 85.595ms, % non-child: 100.00%) - CodegenTime: 672.828us - CompileTime: 10.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.863ms - PrepareTime: 42.362ms DataStreamSender (dst_id=97):(Total: 56.883us, non-child: 56.883us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 600.89 KB/sec - OverallThroughput: 274.69 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.557us - TransmitDataRPCTime: 26.003us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 14s381ms, non-child: 122.369ms, % non-child: 0.85%) ExecOption: Codegen Enabled - BuildTime: 45.787ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 14s259ms, non-child: 14s259ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 10.73 MB, 19.07 MB, 25.38 MB, 29.76 MB, 32.62 MB, 34.88 MB, 37.22 MB, 39.37 MB, 40.93 MB, 42.64 MB, 43.85 MB, 45.46 MB, 46.60 MB, 48.08 MB, 49.20 MB, 50.23 MB, 51.17 MB, 52.15 MB, 52.78 MB, 53.83 MB, 54.64 MB, 55.43 MB, 56.36 MB, 57.14 MB, 57.61 MB, 58.01 MB, 58.38 MB, 59.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.18 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 45.947ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 5.65 MB (5923576) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 53.55 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 141 (141) - ScannerThreadsTotalWallClockTime: 33s034ms - MaterializeTupleTime(*): 570.339ms - ScannerThreadsSysTime: 103.975ms - ScannerThreadsUserTime: 883.852ms - ScannerThreadsVoluntaryContextSwitches: 3.07K (3067) - TotalRawHdfsReadTime(*): 41.576ms - TotalReadThroughput: 4.22 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000038 (host=vd1314.halxg.cloudera.com:22000):(Total: 14s650ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 1.29 MB, 2.36 MB, 1.54 MB, 377.24 KB, 590.00 KB, 423.51 KB, 730.79 KB, 241.62 KB, 1.55 MB, 403.33 KB, 227.97 KB, 689.67 KB, 385.73 KB, 44.00 KB, 381.87 KB, 44.00 KB, 700.69 KB, 1.00 MB, 574.58 KB, 84.00 KB, 44.00 KB, 393.05 KB, 228.68 KB, 227.98 KB, 84.00 KB, 687.09 KB, 378.66 KB, 44.00 KB, 148.00 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.07 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.27 MB (5524960) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 40.863ms - RowsProduced: 1 (1) - TotalCpuTime: 31s101ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 261.923us - TotalStorageWaitTime: 29s908ms CodeGen:(Total: 80.295ms, non-child: 80.295ms, % non-child: 100.00%) - CodegenTime: 507.468us - CompileTime: 11.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.889ms - PrepareTime: 38.558ms DataStreamSender (dst_id=97):(Total: 43.869us, non-child: 43.869us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 646.06 KB/sec - OverallThroughput: 356.17 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.160us - TransmitDataRPCTime: 24.185us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 14s643ms, non-child: 130.449ms, % non-child: 0.89%) ExecOption: Codegen Enabled - BuildTime: 48.818ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 14s512ms, non-child: 14s512ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 10.01 MB, 17.49 MB, 23.73 MB, 27.95 MB, 31.29 MB, 33.52 MB, 36.08 MB, 38.54 MB, 40.94 MB, 42.41 MB, 43.69 MB, 45.08 MB, 46.34 MB, 47.22 MB, 48.66 MB, 49.68 MB, 51.13 MB, 52.39 MB, 53.31 MB, 54.19 MB, 54.62 MB, 55.21 MB, 56.15 MB, 56.76 MB, 57.66 MB, 58.14 MB, 58.67 MB, 59.03 MB, 59.73 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.07 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 45.652ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 19 (19) - PeakMemoryUsage: 5.23 MB (5488096) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 52.59 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 131 (131) - ScannerThreadsTotalWallClockTime: 31s101ms - MaterializeTupleTime(*): 575.415ms - ScannerThreadsSysTime: 95.978ms - ScannerThreadsUserTime: 910.853ms - ScannerThreadsVoluntaryContextSwitches: 3.19K (3188) - TotalRawHdfsReadTime(*): 40.716ms - TotalReadThroughput: 4.12 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000032 (host=vd1309.halxg.cloudera.com:22000):(Total: 17s477ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 0, 2.58 MB, 417.28 KB, 1.01 MB, 44.00 KB, 44.00 KB, 949.76 KB, 44.00 KB, 227.96 KB, 392.19 KB, 835.34 KB, 383.66 KB, 44.00 KB, 889.05 KB, 651.62 KB, 515.91 KB, 972.66 KB, 84.00 KB, 44.00 KB, 44.00 KB, 228.83 KB, 380.81 KB, 338.57 KB, 1017.20 KB, 44.00 KB, 381.65 KB, 375.27 KB, 229.46 KB, 44.00 KB, 376.23 KB, 576.27 KB, 359.35 KB, 376.26 KB, 44.00 KB, 371.32 KB ThreadUsage(500.000ms): 1, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 23.90 MB (25061384) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 71.718ms - RowsProduced: 1 (1) - TotalCpuTime: 21s828ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 158.759us - TotalStorageWaitTime: 19s690ms CodeGen:(Total: 131.810ms, non-child: 131.810ms, % non-child: 100.00%) - CodegenTime: 612.316us - CompileTime: 15.225ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 43.225ms - PrepareTime: 72.882ms DataStreamSender (dst_id=97):(Total: 54.102us, non-child: 54.102us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 449.81 KB/sec - OverallThroughput: 288.81 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.376us - TransmitDataRPCTime: 34.737us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 17s464ms, non-child: 400.875ms, % non-child: 2.30%) ExecOption: Codegen Enabled - BuildTime: 279.699ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 17s063ms, non-child: 17s063ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 9.87 MB, 15.99 MB, 20.67 MB, 24.52 MB, 26.25 MB, 28.06 MB, 29.86 MB, 31.88 MB, 33.37 MB, 34.95 MB, 36.11 MB, 36.94 MB, 37.90 MB, 39.05 MB, 40.49 MB, 40.85 MB, 42.21 MB, 42.29 MB, 43.16 MB, 43.74 MB, 44.10 MB, 57.97 MB, 58.66 MB, 59.05 MB, 59.65 MB, 60.13 MB, 60.51 MB, 60.71 MB, 60.86 MB, 61.39 MB, 61.63 MB, 61.85 MB, 62.18 MB, 62.33 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.21 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 161.825ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 23.56 MB (24705048) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 39.70 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 101 (101) - ScannerThreadsTotalWallClockTime: 21s828ms - MaterializeTupleTime(*): 787.391ms - ScannerThreadsSysTime: 105.980ms - ScannerThreadsUserTime: 935.854ms - ScannerThreadsVoluntaryContextSwitches: 4.13K (4128) - TotalRawHdfsReadTime(*): 44.786ms - TotalReadThroughput: 3.67 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000033 (host=vd1310.halxg.cloudera.com:22000):(Total: 17s008ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 1.06 MB, 2.48 MB, 3.13 MB, 692.95 KB, 328.60 KB, 618.89 KB, 196.00 KB, 372.85 KB, 993.74 KB, 424.62 KB, 360.17 KB, 84.00 KB, 84.00 KB, 1.24 MB, 44.00 KB, 387.96 KB, 379.16 KB, 44.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 574.85 KB, 84.00 KB, 229.27 KB, 44.00 KB, 44.00 KB, 691.35 KB, 383.74 KB, 579.91 KB, 44.00 KB, 380.70 KB, 84.00 KB, 1.02 MB ThreadUsage(500.000ms): 18, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.20 MB (5450424) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 45.000ms - RowsProduced: 1 (1) - TotalCpuTime: 32s010ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 296.243us - TotalStorageWaitTime: 30s838ms CodeGen:(Total: 79.515ms, non-child: 79.515ms, % non-child: 100.00%) - CodegenTime: 477.176us - CompileTime: 9.784ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 26.390ms - PrepareTime: 42.850ms DataStreamSender (dst_id=97):(Total: 45.223us, non-child: 45.223us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 594.83 KB/sec - OverallThroughput: 345.51 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.843us - TransmitDataRPCTime: 26.268us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 17s002ms, non-child: 148.922ms, % non-child: 0.88%) ExecOption: Codegen Enabled - BuildTime: 43.377ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 16s853ms, non-child: 16s853ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:97.06% 1:2.941% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 1.07 MB, 14.23 MB, 21.44 MB, 26.23 MB, 30.32 MB, 33.14 MB, 35.35 MB, 37.38 MB, 39.63 MB, 41.41 MB, 42.47 MB, 43.79 MB, 45.54 MB, 46.38 MB, 47.61 MB, 49.40 MB, 49.92 MB, 50.89 MB, 52.18 MB, 52.53 MB, 53.13 MB, 53.56 MB, 54.25 MB, 54.96 MB, 55.52 MB, 55.89 MB, 56.41 MB, 56.81 MB, 57.17 MB, 57.71 MB, 58.06 MB, 58.52 MB, 58.85 MB, 59.23 MB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.15 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 44.295ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 5.16 MB (5413560) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 45.46 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 240 (240) - ScannerThreadsTotalWallClockTime: 32s010ms - MaterializeTupleTime(*): 552.853ms - ScannerThreadsSysTime: 107.975ms - ScannerThreadsUserTime: 873.857ms - ScannerThreadsVoluntaryContextSwitches: 2.87K (2866) - TotalRawHdfsReadTime(*): 40.502ms - TotalReadThroughput: 3.48 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000035 (host=vd1312.halxg.cloudera.com:22000):(Total: 19s614ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 1.82 MB, 2.70 MB, 1.07 MB, 1.06 MB, 1.39 MB, 785.96 KB, 1.29 MB, 52.00 KB, 387.46 KB, 1.19 MB, 44.00 KB, 1.00 MB, 364.90 KB, 228.02 KB, 362.19 KB, 406.20 KB, 84.00 KB, 378.55 KB, 84.00 KB, 44.00 KB, 229.85 KB, 578.39 KB, 44.00 KB, 387.64 KB, 379.74 KB, 228.13 KB, 351.95 KB, 232.28 KB, 368.11 KB, 376.73 KB, 84.00 KB, 84.00 KB, 379.06 KB, 378.67 KB, 1.00 MB, 385.66 KB, 44.00 KB, 373.85 KB, 44.00 KB ThreadUsage(500.000ms): 19, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.17 MB (6465824) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 48.527ms - RowsProduced: 1 (1) - TotalCpuTime: 39s200ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 629.215us - TotalStorageWaitTime: 37s807ms CodeGen:(Total: 85.843ms, non-child: 85.843ms, % non-child: 100.00%) - CodegenTime: 543.530us - CompileTime: 10.057ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.436ms - PrepareTime: 44.104ms DataStreamSender (dst_id=97):(Total: 52.924us, non-child: 52.924us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 455.61 KB/sec - OverallThroughput: 295.23 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.939us - TransmitDataRPCTime: 34.295us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 19s609ms, non-child: 160.665ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 47.034ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 19s448ms, non-child: 19s448ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 7.11 MB, 15.37 MB, 21.95 MB, 26.06 MB, 29.31 MB, 31.42 MB, 33.59 MB, 35.75 MB, 37.29 MB, 39.20 MB, 40.34 MB, 41.75 MB, 42.72 MB, 44.08 MB, 45.19 MB, 45.72 MB, 47.38 MB, 47.96 MB, 49.13 MB, 50.34 MB, 50.83 MB, 51.55 MB, 52.33 MB, 52.89 MB, 53.62 MB, 54.46 MB, 54.81 MB, 55.42 MB, 55.94 MB, 56.72 MB, 57.17 MB, 57.60 MB, 58.10 MB, 58.61 MB, 59.18 MB, 59.61 MB, 60.00 MB, 60.47 MB, 60.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.08 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 44.706ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 6.11 MB (6404384) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 39.15 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 133 (133) - ScannerThreadsTotalWallClockTime: 39s200ms - MaterializeTupleTime(*): 571.936ms - ScannerThreadsSysTime: 80.976ms - ScannerThreadsUserTime: 921.848ms - ScannerThreadsVoluntaryContextSwitches: 3.29K (3289) - TotalRawHdfsReadTime(*): 41.205ms - TotalReadThroughput: 3.11 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000034 (host=vd1313.halxg.cloudera.com:22000):(Total: 18s332ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 1.21 MB, 908.67 KB, 1.32 MB, 1.02 MB, 752.48 KB, 1.46 MB, 230.65 KB, 571.91 KB, 1.03 MB, 237.57 KB, 606.52 KB, 226.38 KB, 44.00 KB, 225.70 KB, 44.00 KB, 44.00 KB, 44.00 KB, 372.15 KB, 384.76 KB, 648.70 KB, 882.11 KB, 229.16 KB, 968.34 KB, 231.89 KB, 695.05 KB, 44.00 KB, 44.00 KB, 359.72 KB, 363.65 KB, 84.00 KB, 44.00 KB, 84.00 KB, 84.00 KB, 44.00 KB, 84.00 KB, 228.63 KB, 36.00 KB ThreadUsage(500.000ms): 17, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 3.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.28 MB (6583304) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 43.675ms - RowsProduced: 1 (1) - TotalCpuTime: 37s594ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 214.675us - TotalStorageWaitTime: 36s154ms CodeGen:(Total: 82.232ms, non-child: 82.232ms, % non-child: 100.00%) - CodegenTime: 582.647us - CompileTime: 11.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 28.942ms - PrepareTime: 41.548ms DataStreamSender (dst_id=97):(Total: 42.516us, non-child: 42.516us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 683.63 KB/sec - OverallThroughput: 367.51 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.986us - TransmitDataRPCTime: 22.856us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 18s327ms, non-child: 174.896ms, % non-child: 0.95%) ExecOption: Codegen Enabled - BuildTime: 50.361ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 18s152ms, non-child: 18s152ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 7.36 MB, 16.01 MB, 22.07 MB, 26.22 MB, 29.36 MB, 31.93 MB, 34.01 MB, 36.12 MB, 37.91 MB, 39.57 MB, 40.88 MB, 42.17 MB, 43.91 MB, 44.74 MB, 46.40 MB, 47.17 MB, 48.32 MB, 49.44 MB, 50.13 MB, 51.04 MB, 51.62 MB, 52.29 MB, 53.03 MB, 53.75 MB, 54.19 MB, 54.83 MB, 55.18 MB, 55.67 MB, 56.11 MB, 56.66 MB, 57.42 MB, 57.94 MB, 58.29 MB, 58.54 MB, 59.07 MB, 59.46 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.06 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 47.647ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 26 (26) - PeakMemoryUsage: 6.22 MB (6521864) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 42.12 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 124 (124) - ScannerThreadsTotalWallClockTime: 37s595ms - MaterializeTupleTime(*): 573.268ms - ScannerThreadsSysTime: 89.976ms - ScannerThreadsUserTime: 905.851ms - ScannerThreadsVoluntaryContextSwitches: 3.28K (3279) - TotalRawHdfsReadTime(*): 41.710ms - TotalReadThroughput: 3.30 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000037 (host=vd1316.halxg.cloudera.com:22000):(Total: 16s689ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 0, 964.07 KB, 2.51 MB, 2.78 MB, 1.69 MB, 931.28 KB, 769.36 KB, 1.17 MB, 52.00 KB, 92.00 KB, 708.60 KB, 229.48 KB, 44.00 KB, 375.18 KB, 84.00 KB, 84.00 KB, 44.00 KB, 359.08 KB, 232.12 KB, 387.36 KB, 84.00 KB, 380.54 KB, 368.98 KB, 226.32 KB, 84.00 KB, 667.46 KB, 384.45 KB, 576.87 KB, 44.00 KB, 360.62 KB, 44.00 KB, 44.00 KB, 212.00 KB, 229.48 KB ThreadUsage(500.000ms): 1, 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 6.77 MB (7098968) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 46.868ms - RowsProduced: 1 (1) - TotalCpuTime: 34s548ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 228.820us - TotalStorageWaitTime: 33s284ms CodeGen:(Total: 90.756ms, non-child: 90.756ms, % non-child: 100.00%) - CodegenTime: 738.463us - CompileTime: 11.191ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.311ms - PrepareTime: 44.591ms DataStreamSender (dst_id=97):(Total: 54.791us, non-child: 54.791us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 493.74 KB/sec - OverallThroughput: 285.17 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.605us - TransmitDataRPCTime: 31.646us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=27):(Total: 16s682ms, non-child: 154.448ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 52.070ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=26):(Total: 16s528ms, non-child: 16s528ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 12.53 MB, 19.39 MB, 25.22 MB, 29.16 MB, 32.36 MB, 34.34 MB, 36.74 MB, 38.69 MB, 40.35 MB, 41.71 MB, 43.44 MB, 44.61 MB, 45.89 MB, 47.48 MB, 48.36 MB, 49.23 MB, 50.13 MB, 50.89 MB, 51.42 MB, 52.39 MB, 52.80 MB, 53.41 MB, 53.92 MB, 54.55 MB, 55.02 MB, 55.66 MB, 56.44 MB, 56.88 MB, 57.38 MB, 57.83 MB, 58.26 MB, 58.80 MB, 59.28 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.94 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 45.531ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 6.71 MB (7037528) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 46.24 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 82 (82) - ScannerThreadsTotalWallClockTime: 34s548ms - MaterializeTupleTime(*): 559.428ms - ScannerThreadsSysTime: 99.974ms - ScannerThreadsUserTime: 887.853ms - ScannerThreadsVoluntaryContextSwitches: 3.12K (3120) - TotalRawHdfsReadTime(*): 40.435ms - TotalReadThroughput: 3.59 MB/sec Fragment F25: Instance da46dbd7c4e8e43b:bc4eab3900000039 (host=vd1309.halxg.cloudera.com:22000):(Total: 22s074ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 40.01 KB, 40.01 KB, 44.01 KB, 48.01 KB, 52.01 KB, 52.01 KB, 56.01 KB, 56.01 KB, 56.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 73.912ms - RowsProduced: 1 (1) - TotalCpuTime: 97.133ms - TotalNetworkReceiveTime: 21s999ms - TotalNetworkSendTime: 187.856us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 92.530ms, non-child: 92.530ms, % non-child: 100.00%) - CodegenTime: 417.301us - CompileTime: 3.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 13.423ms - PrepareTime: 72.116ms DataStreamSender (dst_id=96):(Total: 73.806us, non-child: 73.806us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 393.43 KB/sec - OverallThroughput: 211.70 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 21.680us - TransmitDataRPCTime: 39.715us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=95):(Total: 22s073ms, non-child: 74.203ms, % non-child: 0.34%) ExecOption: Codegen Enabled - BuildTime: 220.300us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=94):(Total: 21s999ms, non-child: 111.046us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 32.00 B, 48.00 B, 64.00 B, 64.00 B, 80.00 B, 80.00 B, 80.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 13.431us - DeserializeRowBatchTimer: 49.043us - FirstBatchArrivalWaitTime: 15s675ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F24: Instance da46dbd7c4e8e43b:bc4eab390000003b (host=vd1310.halxg.cloudera.com:22000):(Total: 19s922ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 28.00 KB, 1.50 MB, 1.56 MB, 2.29 MB, 515.79 KB, 453.47 KB, 752.18 KB, 281.39 KB, 406.45 KB, 52.00 KB, 44.00 KB, 44.00 KB, 84.00 KB, 225.37 KB, 367.96 KB, 375.02 KB, 517.72 KB, 1.00 MB, 44.00 KB, 984.56 KB, 44.00 KB, 368.12 KB, 684.00 KB, 233.43 KB, 849.07 KB, 84.00 KB, 354.36 KB, 84.00 KB, 382.64 KB, 1.00 MB, 387.74 KB, 44.00 KB, 656.94 KB, 44.00 KB, 375.29 KB, 656.36 KB, 44.00 KB, 227.19 KB, 979.97 KB, 362.62 KB ThreadUsage(500.000ms): 1, 9, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.52 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.99 MB (5230864) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 48.727ms - RowsProduced: 1 (1) - TotalCpuTime: 33s836ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 239.758us - TotalStorageWaitTime: 32s698ms CodeGen:(Total: 90.239ms, non-child: 90.239ms, % non-child: 100.00%) - CodegenTime: 520.528us - CompileTime: 11.501ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.671ms - PrepareTime: 46.535ms DataStreamSender (dst_id=94):(Total: 42.413us, non-child: 42.413us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 599.81 KB/sec - OverallThroughput: 368.40 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.461us - TransmitDataRPCTime: 26.050us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 19s915ms, non-child: 140.786ms, % non-child: 0.71%) ExecOption: Codegen Enabled - BuildTime: 37.543ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 19s774ms, non-child: 19s774ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 0, 10.90 MB, 18.40 MB, 23.49 MB, 26.97 MB, 29.79 MB, 32.01 MB, 34.51 MB, 36.51 MB, 37.80 MB, 39.12 MB, 40.58 MB, 42.14 MB, 43.05 MB, 44.10 MB, 45.78 MB, 46.60 MB, 47.93 MB, 49.11 MB, 49.73 MB, 50.25 MB, 50.92 MB, 51.59 MB, 52.38 MB, 52.94 MB, 53.56 MB, 54.05 MB, 54.35 MB, 54.95 MB, 55.43 MB, 55.97 MB, 56.16 MB, 56.54 MB, 56.86 MB, 57.27 MB, 57.69 MB, 57.99 MB, 58.40 MB, 58.69 MB, 59.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.56 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 44.228ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 4.95 MB (5194000) - PerReadThreadRawHdfsThroughput: 1.47 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 38.75 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 103 (103) - ScannerThreadsTotalWallClockTime: 33s836ms - MaterializeTupleTime(*): 558.594ms - ScannerThreadsSysTime: 100.978ms - ScannerThreadsUserTime: 875.860ms - ScannerThreadsVoluntaryContextSwitches: 2.99K (2990) - TotalRawHdfsReadTime(*): 39.551ms - TotalReadThroughput: 2.96 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000003d (host=vd1312.halxg.cloudera.com:22000):(Total: 21s968ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 5.30 MB, 1.81 MB, 1.94 MB, 1.21 MB, 2.15 MB, 1.18 MB, 1019.59 KB, 1.34 MB, 1003.58 KB, 400.26 KB, 84.00 KB, 356.59 KB, 394.01 KB, 380.66 KB, 231.41 KB, 980.53 KB, 44.00 KB, 44.00 KB, 84.00 KB, 84.00 KB, 44.00 KB, 363.21 KB, 398.84 KB, 229.13 KB, 361.09 KB, 44.00 KB, 580.03 KB, 1.23 MB, 362.39 KB, 228.46 KB, 84.00 KB, 352.72 KB, 373.88 KB, 227.90 KB, 84.00 KB, 84.00 KB, 571.90 KB, 394.48 KB, 84.00 KB, 386.20 KB, 44.00 KB, 656.67 KB, 44.00 KB, 367.68 KB ThreadUsage(500.000ms): 19, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.66 MB (5930752) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 45.539ms - RowsProduced: 1 (1) - TotalCpuTime: 40s260ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 247.801us - TotalStorageWaitTime: 38s894ms CodeGen:(Total: 93.700ms, non-child: 93.700ms, % non-child: 100.00%) - CodegenTime: 565.359us - CompileTime: 11.340ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 37.176ms - PrepareTime: 44.516ms DataStreamSender (dst_id=94):(Total: 59.291us, non-child: 59.291us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 643.45 KB/sec - OverallThroughput: 263.53 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.935us - TransmitDataRPCTime: 24.283us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 21s960ms, non-child: 168.717ms, % non-child: 0.77%) ExecOption: Codegen Enabled - BuildTime: 45.755ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 21s791ms, non-child: 21s791ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 4.27 MB, 13.84 MB, 20.68 MB, 24.42 MB, 27.72 MB, 30.17 MB, 32.45 MB, 34.25 MB, 35.97 MB, 37.65 MB, 38.99 MB, 40.53 MB, 41.66 MB, 43.51 MB, 44.67 MB, 45.48 MB, 47.02 MB, 47.79 MB, 49.11 MB, 49.90 MB, 50.32 MB, 50.82 MB, 51.35 MB, 51.85 MB, 52.47 MB, 53.09 MB, 53.70 MB, 54.39 MB, 54.89 MB, 55.50 MB, 55.80 MB, 56.45 MB, 56.88 MB, 57.66 MB, 57.95 MB, 58.39 MB, 58.71 MB, 58.96 MB, 59.24 MB, 59.47 MB, 59.76 MB, 60.31 MB, 60.53 MB, 60.85 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.95 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 47.253ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 5.59 MB (5861120) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 34.94 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 151 (151) - ScannerThreadsTotalWallClockTime: 40s260ms - MaterializeTupleTime(*): 590.635ms - ScannerThreadsSysTime: 106.977ms - ScannerThreadsUserTime: 933.847ms - ScannerThreadsVoluntaryContextSwitches: 3.19K (3185) - TotalRawHdfsReadTime(*): 40.985ms - TotalReadThroughput: 2.77 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000003e (host=vd1311.halxg.cloudera.com:22000):(Total: 15s646ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 714.33 KB, 1.25 MB, 1.48 MB, 1.57 MB, 708.53 KB, 412.77 KB, 712.30 KB, 866.39 KB, 1.01 MB, 92.00 KB, 357.09 KB, 84.00 KB, 479.18 KB, 226.85 KB, 228.38 KB, 1.03 MB, 44.00 KB, 693.19 KB, 84.00 KB, 234.09 KB, 981.99 KB, 44.00 KB, 44.00 KB, 381.48 KB, 233.15 KB, 44.00 KB, 44.00 KB, 376.74 KB, 44.00 KB, 44.00 KB, 221.57 KB ThreadUsage(500.000ms): 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 3.06 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.81 MB (6093736) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 45.937ms - RowsProduced: 1 (1) - TotalCpuTime: 33s279ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 234.092us - TotalStorageWaitTime: 31s956ms CodeGen:(Total: 85.909ms, non-child: 85.909ms, % non-child: 100.00%) - CodegenTime: 617.572us - CompileTime: 10.686ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.252ms - PrepareTime: 43.463ms DataStreamSender (dst_id=94):(Total: 46.210us, non-child: 46.210us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 550.58 KB/sec - OverallThroughput: 338.13 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.692us - TransmitDataRPCTime: 28.379us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 15s640ms, non-child: 146.652ms, % non-child: 0.94%) ExecOption: Codegen Enabled - BuildTime: 46.193ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 15s494ms, non-child: 15s494ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 7.77 MB, 16.28 MB, 22.10 MB, 26.41 MB, 29.66 MB, 31.93 MB, 34.58 MB, 36.64 MB, 38.30 MB, 39.77 MB, 41.09 MB, 42.77 MB, 44.12 MB, 45.22 MB, 46.27 MB, 47.54 MB, 49.05 MB, 49.90 MB, 51.06 MB, 51.82 MB, 52.63 MB, 53.14 MB, 54.10 MB, 54.83 MB, 55.55 MB, 56.02 MB, 56.70 MB, 57.29 MB, 57.75 MB, 58.26 MB, 59.09 MB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 2.06 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 46.754ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 5.75 MB (6032296) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 49.28 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 90 (90) - ScannerThreadsTotalWallClockTime: 33s279ms - MaterializeTupleTime(*): 577.755ms - ScannerThreadsSysTime: 95.978ms - ScannerThreadsUserTime: 906.852ms - ScannerThreadsVoluntaryContextSwitches: 3.18K (3178) - TotalRawHdfsReadTime(*): 40.941ms - TotalReadThroughput: 3.81 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000003c (host=vd1313.halxg.cloudera.com:22000):(Total: 21s098ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 4.11 MB, 3.24 MB, 1.16 MB, 1.26 MB, 1.36 MB, 744.80 KB, 1.35 MB, 1.58 MB, 52.00 KB, 237.70 KB, 376.15 KB, 652.48 KB, 1.00 MB, 361.78 KB, 231.89 KB, 84.00 KB, 44.00 KB, 391.94 KB, 358.35 KB, 739.55 KB, 653.92 KB, 236.44 KB, 697.89 KB, 44.00 KB, 687.89 KB, 84.00 KB, 44.00 KB, 44.00 KB, 392.64 KB, 84.00 KB, 234.15 KB, 44.00 KB, 432.30 KB, 44.00 KB, 383.65 KB, 44.00 KB, 227.64 KB, 229.59 KB, 229.16 KB, 227.20 KB, 382.98 KB, 381.67 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.98 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.91 MB (6195808) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 48.434ms - RowsProduced: 1 (1) - TotalCpuTime: 39s665ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 231.608us - TotalStorageWaitTime: 38s158ms CodeGen:(Total: 87.580ms, non-child: 87.580ms, % non-child: 100.00%) - CodegenTime: 623.899us - CompileTime: 10.489ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.020ms - PrepareTime: 46.399ms DataStreamSender (dst_id=94):(Total: 57.310us, non-child: 57.310us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 526.29 KB/sec - OverallThroughput: 272.64 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.814us - TransmitDataRPCTime: 29.689us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 21s093ms, non-child: 188.313ms, % non-child: 0.89%) ExecOption: Codegen Enabled - BuildTime: 50.219ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 20s905ms, non-child: 20s905ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:97.62% 1:2.381% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 5.48 MB, 14.62 MB, 20.24 MB, 24.23 MB, 27.58 MB, 29.58 MB, 32.30 MB, 34.58 MB, 36.67 MB, 37.92 MB, 38.96 MB, 40.42 MB, 41.95 MB, 42.93 MB, 44.39 MB, 45.47 MB, 46.83 MB, 47.50 MB, 48.28 MB, 49.07 MB, 49.79 MB, 50.60 MB, 51.12 MB, 51.94 MB, 52.34 MB, 53.16 MB, 53.93 MB, 54.28 MB, 54.96 MB, 55.59 MB, 55.99 MB, 56.53 MB, 56.97 MB, 57.31 MB, 57.81 MB, 58.26 MB, 58.58 MB, 58.75 MB, 58.92 MB, 59.09 MB, 59.32 MB, 59.59 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.98 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 46.945ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 5.87 MB (6158944) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 36.57 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 125 (125) - ScannerThreadsTotalWallClockTime: 39s665ms - MaterializeTupleTime(*): 563.182ms - ScannerThreadsSysTime: 111.974ms - ScannerThreadsUserTime: 885.852ms - ScannerThreadsVoluntaryContextSwitches: 3.21K (3207) - TotalRawHdfsReadTime(*): 41.421ms - TotalReadThroughput: 2.84 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000003a (host=vd1309.halxg.cloudera.com:22000):(Total: 17s656ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 0, 1.70 MB, 1.08 MB, 92.00 KB, 365.03 KB, 682.56 KB, 84.00 KB, 148.00 KB, 381.77 KB, 84.00 KB, 1.11 MB, 574.50 KB, 358.57 KB, 230.23 KB, 359.76 KB, 84.00 KB, 673.09 KB, 44.00 KB, 44.00 KB, 393.45 KB, 668.02 KB, 381.65 KB, 84.00 KB, 52.00 KB, 358.19 KB, 573.31 KB, 700.47 KB, 44.00 KB, 397.59 KB, 84.00 KB, 84.00 KB, 368.20 KB, 84.00 KB, 719.93 KB, 232.06 KB, 225.37 KB ThreadUsage(500.000ms): 1, 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.17 - BloomFilterBytes: 0 - PeakMemoryUsage: 26.76 MB (28061648) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 71.336ms - RowsProduced: 1 (1) - TotalCpuTime: 21s805ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 166.490us - TotalStorageWaitTime: 19s590ms CodeGen:(Total: 118.529ms, non-child: 118.529ms, % non-child: 100.00%) - CodegenTime: 779.324us - CompileTime: 14.809ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.440ms - PrepareTime: 64.276ms DataStreamSender (dst_id=94):(Total: 55.126us, non-child: 55.126us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 481.29 KB/sec - OverallThroughput: 283.44 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.545us - TransmitDataRPCTime: 32.465us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 17s649ms, non-child: 361.880ms, % non-child: 2.05%) ExecOption: Codegen Enabled - BuildTime: 252.527ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 17s287ms, non-child: 17s287ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 20.95 MB, 28.06 MB, 33.14 MB, 36.76 MB, 38.97 MB, 40.98 MB, 42.80 MB, 44.65 MB, 46.44 MB, 47.64 MB, 49.17 MB, 49.94 MB, 50.96 MB, 52.08 MB, 53.32 MB, 53.72 MB, 54.81 MB, 54.98 MB, 55.93 MB, 56.42 MB, 56.97 MB, 57.76 MB, 58.28 MB, 58.60 MB, 59.22 MB, 59.54 MB, 60.09 MB, 60.26 MB, 60.97 MB, 61.24 MB, 61.46 MB, 61.75 MB, 61.89 MB, 62.33 MB, 62.50 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.20 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 215.506ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 9 (9) - PeakMemoryUsage: 26.53 MB (27819872) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 39.19 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 139 (139) - ScannerThreadsTotalWallClockTime: 21s805ms - MaterializeTupleTime(*): 736.924ms - ScannerThreadsSysTime: 114.978ms - ScannerThreadsUserTime: 924.854ms - ScannerThreadsVoluntaryContextSwitches: 4.02K (4020) - TotalRawHdfsReadTime(*): 54.559ms - TotalReadThroughput: 3.57 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000003f (host=vd1316.halxg.cloudera.com:22000):(Total: 18s836ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 3.95 MB, 1.92 MB, 2.48 MB, 1.85 MB, 1.18 MB, 703.48 KB, 384.27 KB, 1.18 MB, 1.35 MB, 991.39 KB, 1023.32 KB, 368.75 KB, 84.00 KB, 44.00 KB, 664.64 KB, 224.30 KB, 44.00 KB, 233.66 KB, 84.00 KB, 232.12 KB, 84.00 KB, 379.37 KB, 44.00 KB, 357.42 KB, 362.28 KB, 1.00 MB, 225.41 KB, 351.16 KB, 84.00 KB, 231.20 KB, 364.98 KB, 383.12 KB, 977.43 KB, 44.00 KB, 388.31 KB, 669.57 KB, 378.48 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.84 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.48 MB (5745280) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 52.257ms - RowsProduced: 1 (1) - TotalCpuTime: 35s354ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.285us - TotalStorageWaitTime: 34s114ms CodeGen:(Total: 93.462ms, non-child: 93.462ms, % non-child: 100.00%) - CodegenTime: 691.356us - CompileTime: 12.433ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.663ms - PrepareTime: 49.700ms DataStreamSender (dst_id=94):(Total: 47.931us, non-child: 47.931us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 483.37 KB/sec - OverallThroughput: 325.99 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.211us - TransmitDataRPCTime: 32.325us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 18s829ms, non-child: 160.741ms, % non-child: 0.85%) ExecOption: Codegen Enabled - BuildTime: 45.245ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 18s668ms, non-child: 18s668ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 9.24 MB, 16.89 MB, 21.98 MB, 26.53 MB, 29.93 MB, 32.20 MB, 34.72 MB, 37.17 MB, 38.76 MB, 39.92 MB, 41.33 MB, 42.55 MB, 43.77 MB, 44.71 MB, 45.79 MB, 46.92 MB, 48.06 MB, 48.90 MB, 49.54 MB, 50.18 MB, 50.91 MB, 51.50 MB, 52.13 MB, 52.62 MB, 53.14 MB, 53.62 MB, 54.16 MB, 54.60 MB, 55.06 MB, 55.46 MB, 55.81 MB, 56.21 MB, 56.80 MB, 57.22 MB, 57.89 MB, 58.56 MB, 59.02 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.84 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 45.859ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 18 (18) - PeakMemoryUsage: 5.44 MB (5708416) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 40.94 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 134 (134) - ScannerThreadsTotalWallClockTime: 35s354ms - MaterializeTupleTime(*): 553.073ms - ScannerThreadsSysTime: 88.981ms - ScannerThreadsUserTime: 894.856ms - ScannerThreadsVoluntaryContextSwitches: 3.09K (3088) - TotalRawHdfsReadTime(*): 40.251ms - TotalReadThroughput: 3.19 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000040 (host=vd1314.halxg.cloudera.com:22000):(Total: 18s493ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 1.60 MB, 1.03 MB, 1.30 MB, 810.52 KB, 1.02 MB, 1.37 MB, 92.00 KB, 751.86 KB, 996.36 KB, 737.71 KB, 377.47 KB, 84.00 KB, 970.79 KB, 84.00 KB, 353.38 KB, 375.80 KB, 693.02 KB, 84.00 KB, 1.24 MB, 44.00 KB, 84.00 KB, 84.00 KB, 385.88 KB, 84.00 KB, 383.11 KB, 84.00 KB, 376.63 KB, 385.73 KB, 84.00 KB, 361.00 KB, 238.70 KB, 363.84 KB, 229.58 KB, 735.34 KB, 84.00 KB, 84.00 KB, 985.79 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.84 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.50 MB (5772264) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 47.735ms - RowsProduced: 1 (1) - TotalCpuTime: 33s609ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 201.380us - TotalStorageWaitTime: 32s409ms CodeGen:(Total: 86.366ms, non-child: 86.366ms, % non-child: 100.00%) - CodegenTime: 603.058us - CompileTime: 11.360ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.198ms - PrepareTime: 45.274ms DataStreamSender (dst_id=94):(Total: 56.361us, non-child: 56.361us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 418.46 KB/sec - OverallThroughput: 277.23 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.976us - TransmitDataRPCTime: 37.339us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=25):(Total: 18s487ms, non-child: 171.619ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 43.313ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=24):(Total: 18s315ms, non-child: 18s315ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 6.95 MB, 15.29 MB, 20.50 MB, 25.07 MB, 27.84 MB, 30.19 MB, 32.49 MB, 35.17 MB, 37.18 MB, 38.64 MB, 40.23 MB, 41.68 MB, 42.89 MB, 43.92 MB, 45.01 MB, 46.03 MB, 47.05 MB, 48.07 MB, 48.92 MB, 49.97 MB, 50.75 MB, 51.46 MB, 51.87 MB, 52.67 MB, 53.56 MB, 54.06 MB, 54.59 MB, 54.98 MB, 55.70 MB, 56.47 MB, 57.08 MB, 57.44 MB, 57.87 MB, 58.30 MB, 58.94 MB, 59.46 MB, 59.90 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.84 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 43.894ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 5.47 MB (5735400) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 41.67 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 132 (132) - ScannerThreadsTotalWallClockTime: 33s609ms - MaterializeTupleTime(*): 575.902ms - ScannerThreadsSysTime: 113.976ms - ScannerThreadsUserTime: 898.855ms - ScannerThreadsVoluntaryContextSwitches: 3.06K (3057) - TotalRawHdfsReadTime(*): 40.161ms - TotalReadThroughput: 3.24 MB/sec Fragment F23: Instance da46dbd7c4e8e43b:bc4eab3900000041 (host=vd1309.halxg.cloudera.com:22000):(Total: 23s150ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 40.01 KB, 44.01 KB, 48.01 KB, 52.01 KB, 52.01 KB, 52.01 KB, 56.01 KB, 56.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 72.817ms - RowsProduced: 1 (1) - TotalCpuTime: 102.185ms - TotalNetworkReceiveTime: 23s075ms - TotalNetworkSendTime: 177.625us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 95.695ms, non-child: 95.695ms, % non-child: 100.00%) - CodegenTime: 365.517us - CompileTime: 2.534ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 13.010ms - PrepareTime: 78.538ms DataStreamSender (dst_id=93):(Total: 62.636us, non-child: 62.636us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 408.23 KB/sec - OverallThroughput: 249.46 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.457us - TransmitDataRPCTime: 38.275us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=92):(Total: 23s148ms, non-child: 73.008ms, % non-child: 0.32%) ExecOption: Codegen Enabled - BuildTime: 145.699us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=91):(Total: 23s075ms, non-child: 116.482us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 32.00 B, 48.00 B, 64.00 B, 64.00 B, 64.00 B, 80.00 B, 80.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 16.140us - DeserializeRowBatchTimer: 48.441us - FirstBatchArrivalWaitTime: 17s845ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F22: Instance da46dbd7c4e8e43b:bc4eab3900000045 (host=vd1312.halxg.cloudera.com:22000):(Total: 23s057ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 4.50 MB, 1.41 MB, 863.40 KB, 1.78 MB, 1.27 MB, 1.64 MB, 381.88 KB, 410.39 KB, 1.39 MB, 220.00 KB, 44.00 KB, 84.00 KB, 971.59 KB, 226.47 KB, 84.00 KB, 84.00 KB, 681.60 KB, 376.73 KB, 391.51 KB, 396.42 KB, 683.57 KB, 741.73 KB, 385.18 KB, 652.09 KB, 227.49 KB, 653.39 KB, 84.00 KB, 1.13 MB, 227.30 KB, 84.00 KB, 232.70 KB, 379.74 KB, 44.00 KB, 362.22 KB, 84.00 KB, 1021.34 KB, 385.65 KB, 392.74 KB, 376.98 KB, 44.00 KB, 388.80 KB, 224.99 KB, 44.00 KB, 360.63 KB, 381.09 KB, 84.00 KB ThreadUsage(500.000ms): 19, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.28 MB (5532384) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 39.873ms - RowsProduced: 1 (1) - TotalCpuTime: 41s304ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 210.297us - TotalStorageWaitTime: 39s876ms CodeGen:(Total: 76.612ms, non-child: 76.612ms, % non-child: 100.00%) - CodegenTime: 544.289us - CompileTime: 10.976ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 27.419ms - PrepareTime: 37.637ms DataStreamSender (dst_id=91):(Total: 41.667us, non-child: 41.667us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 697.39 KB/sec - OverallThroughput: 375.00 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.705us - TransmitDataRPCTime: 22.405us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 23s050ms, non-child: 181.044ms, % non-child: 0.79%) ExecOption: Codegen Enabled - BuildTime: 54.063ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 22s869ms, non-child: 22s869ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 3.94 MB, 12.95 MB, 18.88 MB, 23.36 MB, 26.74 MB, 28.91 MB, 31.30 MB, 33.64 MB, 35.57 MB, 36.87 MB, 38.33 MB, 40.06 MB, 41.11 MB, 42.45 MB, 43.43 MB, 44.72 MB, 45.54 MB, 46.24 MB, 46.85 MB, 47.54 MB, 48.47 MB, 49.34 MB, 50.15 MB, 51.14 MB, 51.83 MB, 52.24 MB, 52.74 MB, 53.48 MB, 54.39 MB, 54.86 MB, 55.34 MB, 55.71 MB, 56.23 MB, 56.64 MB, 57.27 MB, 57.80 MB, 58.18 MB, 58.35 MB, 58.75 MB, 58.97 MB, 59.30 MB, 59.72 MB, 59.92 MB, 60.24 MB, 60.42 MB, 60.80 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.91 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 45.357ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 23 (23) - PeakMemoryUsage: 5.22 MB (5470944) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 33.30 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 58 (58) - ScannerThreadsTotalWallClockTime: 41s304ms - MaterializeTupleTime(*): 591.092ms - ScannerThreadsSysTime: 112.977ms - ScannerThreadsUserTime: 923.846ms - ScannerThreadsVoluntaryContextSwitches: 3.41K (3411) - TotalRawHdfsReadTime(*): 40.821ms - TotalReadThroughput: 2.64 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000042 (host=vd1309.halxg.cloudera.com:22000):(Total: 20s041ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 457.09 KB, 758.26 KB, 564.16 KB, 382.30 KB, 44.00 KB, 686.80 KB, 385.91 KB, 972.66 KB, 44.00 KB, 226.98 KB, 225.59 KB, 651.41 KB, 44.00 KB, 84.00 KB, 385.47 KB, 44.00 KB, 385.90 KB, 84.00 KB, 84.00 KB, 84.00 KB, 44.00 KB, 369.53 KB, 84.00 KB, 84.00 KB, 229.75 KB, 44.00 KB, 720.91 KB, 44.00 KB, 372.98 KB, 227.68 KB, 227.09 KB, 393.06 KB, 371.78 KB, 84.00 KB, 376.19 KB, 8.45 MB, 22.80 MB, 44.00 KB, 367.47 KB, 36.00 KB ThreadUsage(500.000ms): 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.15 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.34 MB (25520200) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 57.956ms - RowsProduced: 1 (1) - TotalCpuTime: 23s845ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 177.074us - TotalStorageWaitTime: 21s879ms CodeGen:(Total: 104.835ms, non-child: 104.835ms, % non-child: 100.00%) - CodegenTime: 641.933us - CompileTime: 12.397ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 36.160ms - PrepareTime: 55.409ms DataStreamSender (dst_id=91):(Total: 53.534us, non-child: 53.534us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 456.10 KB/sec - OverallThroughput: 291.87 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.900us - TransmitDataRPCTime: 34.258us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 20s035ms, non-child: 499.709ms, % non-child: 2.49%) ExecOption: Codegen Enabled - BuildTime: 259.010ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 19s535ms, non-child: 19s535ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 7.19 MB, 13.92 MB, 18.32 MB, 21.71 MB, 24.93 MB, 26.72 MB, 28.47 MB, 30.22 MB, 31.85 MB, 33.21 MB, 34.83 MB, 36.02 MB, 37.36 MB, 38.07 MB, 38.74 MB, 39.88 MB, 40.03 MB, 41.34 MB, 42.20 MB, 42.72 MB, 43.16 MB, 43.65 MB, 44.22 MB, 44.90 MB, 45.29 MB, 45.92 MB, 46.15 MB, 46.70 MB, 47.03 MB, 47.37 MB, 47.54 MB, 47.73 MB, 47.89 MB, 48.18 MB, 48.24 MB, 54.12 MB, 62.08 MB, 62.35 MB, 62.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.18 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 171.442ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 8 (8) - PeakMemoryUsage: 23.45 MB (24594176) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479) - RowsReturnedRate: 34.68 K/sec - ScanRangesComplete: 223 (223) - ScannerThreadsInvoluntaryContextSwitches: 101 (101) - ScannerThreadsTotalWallClockTime: 23s845ms - MaterializeTupleTime(*): 677.274ms - ScannerThreadsSysTime: 122.977ms - ScannerThreadsUserTime: 874.863ms - ScannerThreadsVoluntaryContextSwitches: 3.89K (3888) - TotalRawHdfsReadTime(*): 43.807ms - TotalReadThroughput: 3.21 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000048 (host=vd1314.halxg.cloudera.com:22000):(Total: 19s798ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 3.11 MB, 1.80 MB, 832.89 KB, 732.09 KB, 997.35 KB, 758.64 KB, 403.80 KB, 1.15 MB, 687.91 KB, 1.60 MB, 360.41 KB, 574.58 KB, 701.05 KB, 578.73 KB, 377.11 KB, 44.00 KB, 44.00 KB, 354.84 KB, 84.00 KB, 1.00 MB, 44.00 KB, 704.27 KB, 672.36 KB, 380.66 KB, 44.00 KB, 84.00 KB, 84.00 KB, 84.00 KB, 357.53 KB, 374.58 KB, 44.00 KB, 231.55 KB, 84.00 KB, 358.87 KB, 44.00 KB, 84.00 KB, 84.00 KB, 44.00 KB, 372.78 KB, 36.00 KB ThreadUsage(500.000ms): 13, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.77 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.90 MB (6186592) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 46.041ms - RowsProduced: 1 (1) - TotalCpuTime: 34s489ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 220.150us - TotalStorageWaitTime: 33s233ms CodeGen:(Total: 86.934ms, non-child: 86.934ms, % non-child: 100.00%) - CodegenTime: 526.554us - CompileTime: 10.476ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 31.881ms - PrepareTime: 43.897ms DataStreamSender (dst_id=91):(Total: 48.522us, non-child: 48.522us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 741.05 KB/sec - OverallThroughput: 322.02 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 18.623us - TransmitDataRPCTime: 21.085us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 19s793ms, non-child: 165.401ms, % non-child: 0.84%) ExecOption: Codegen Enabled - BuildTime: 48.875ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 19s628ms, non-child: 19s628ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 5.53 MB, 13.35 MB, 19.29 MB, 23.19 MB, 26.69 MB, 29.63 MB, 32.24 MB, 34.07 MB, 36.04 MB, 37.62 MB, 38.98 MB, 40.21 MB, 41.40 MB, 42.56 MB, 43.90 MB, 44.90 MB, 45.77 MB, 46.52 MB, 47.34 MB, 48.15 MB, 49.15 MB, 49.72 MB, 50.93 MB, 51.65 MB, 52.18 MB, 52.80 MB, 53.14 MB, 53.65 MB, 54.31 MB, 55.00 MB, 55.61 MB, 56.29 MB, 56.93 MB, 57.42 MB, 57.88 MB, 58.50 MB, 58.94 MB, 59.28 MB, 59.61 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 43.468ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 5.86 MB (6149728) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 38.89 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 67 (67) - ScannerThreadsTotalWallClockTime: 34s489ms - MaterializeTupleTime(*): 575.706ms - ScannerThreadsSysTime: 102.979ms - ScannerThreadsUserTime: 901.855ms - ScannerThreadsVoluntaryContextSwitches: 3.12K (3121) - TotalRawHdfsReadTime(*): 40.932ms - TotalReadThroughput: 3.06 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000043 (host=vd1310.halxg.cloudera.com:22000):(Total: 21s883ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB MemoryUsage(500.000ms): 0, 2.05 MB, 2.07 MB, 1.20 MB, 1.03 MB, 1.61 MB, 376.72 KB, 431.39 KB, 132.00 KB, 393.25 KB, 84.00 KB, 1.25 MB, 229.71 KB, 367.96 KB, 84.00 KB, 362.23 KB, 44.00 KB, 375.18 KB, 369.10 KB, 373.26 KB, 359.10 KB, 44.00 KB, 371.98 KB, 84.00 KB, 1.04 MB, 372.30 KB, 386.23 KB, 84.00 KB, 1.01 MB, 44.00 KB, 84.00 KB, 385.76 KB, 44.00 KB, 227.36 KB, 579.02 KB, 84.00 KB, 1.02 MB, 44.00 KB, 84.00 KB, 44.00 KB, 397.40 KB, 226.94 KB, 655.67 KB, 227.12 KB ThreadUsage(500.000ms): 1, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.98 MB (5218152) - PerHostPeakMemUsage: 50.54 MB (52996928) - PrepareTime: 42.395ms - RowsProduced: 1 (1) - TotalCpuTime: 35s425ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 190.358us - TotalStorageWaitTime: 34s230ms CodeGen:(Total: 83.534ms, non-child: 83.534ms, % non-child: 100.00%) - CodegenTime: 573.715us - CompileTime: 12.100ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.625ms - PrepareTime: 40.167ms DataStreamSender (dst_id=91):(Total: 55.481us, non-child: 55.481us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 447.36 KB/sec - OverallThroughput: 281.63 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.374us - TransmitDataRPCTime: 34.927us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 21s875ms, non-child: 184.941ms, % non-child: 0.85%) ExecOption: Codegen Enabled - BuildTime: 41.413ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.00 KB (663552) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 21s690ms, non-child: 21s690ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 263 out of 263 Hdfs split stats (:<# splits>/): 2:28/28.87 MB 7:31/24.99 MB 0:29/23.88 MB 4:39/39.01 MB 6:32/33.38 MB 3:28/25.64 MB 1:33/32.61 MB 5:43/39.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1052 BytesRead(500.000ms): 9.27 MB, 16.77 MB, 21.34 MB, 25.26 MB, 28.21 MB, 30.54 MB, 33.10 MB, 35.43 MB, 37.17 MB, 38.29 MB, 39.94 MB, 40.94 MB, 42.31 MB, 43.39 MB, 44.22 MB, 45.27 MB, 46.48 MB, 47.36 MB, 47.71 MB, 48.83 MB, 49.19 MB, 50.12 MB, 50.58 MB, 51.39 MB, 51.86 MB, 52.21 MB, 52.75 MB, 53.13 MB, 53.69 MB, 54.22 MB, 54.62 MB, 55.30 MB, 55.72 MB, 56.17 MB, 56.70 MB, 57.24 MB, 57.47 MB, 57.74 MB, 58.07 MB, 58.57 MB, 59.00 MB, 59.24 MB, 59.43 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.53 - BytesRead: 59.46 MB (62344471) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.46 MB (62344471) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.46 MB (62344471) - DecompressionTime: 44.155ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 263 (263) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 4.94 MB (5181288) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4051651) - RowsReturned: 766.23K (766231) - RowsReturnedRate: 35.33 K/sec - ScanRangesComplete: 263 (263) - ScannerThreadsInvoluntaryContextSwitches: 160 (160) - ScannerThreadsTotalWallClockTime: 35s425ms - MaterializeTupleTime(*): 562.139ms - ScannerThreadsSysTime: 98.980ms - ScannerThreadsUserTime: 894.858ms - ScannerThreadsVoluntaryContextSwitches: 2.93K (2929) - TotalRawHdfsReadTime(*): 40.827ms - TotalReadThroughput: 2.76 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000046 (host=vd1311.halxg.cloudera.com:22000):(Total: 17s840ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 2.60 MB, 2.57 MB, 1.07 MB, 1.11 MB, 407.50 KB, 140.00 KB, 1.01 MB, 235.09 KB, 92.00 KB, 384.17 KB, 221.57 KB, 44.00 KB, 369.04 KB, 84.00 KB, 573.20 KB, 686.45 KB, 364.45 KB, 84.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 84.00 KB, 656.54 KB, 1023.69 KB, 84.00 KB, 382.43 KB, 230.08 KB, 380.56 KB, 84.00 KB, 662.17 KB, 84.00 KB, 1013.69 KB, 44.00 KB, 84.00 KB, 369.21 KB ThreadUsage(500.000ms): 13, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.91 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.94 MB (6225912) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 41.688ms - RowsProduced: 1 (1) - TotalCpuTime: 35s275ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 325.974us - TotalStorageWaitTime: 33s938ms CodeGen:(Total: 80.467ms, non-child: 80.467ms, % non-child: 100.00%) - CodegenTime: 598.975us - CompileTime: 11.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 28.869ms - PrepareTime: 39.717ms DataStreamSender (dst_id=91):(Total: 56.988us, non-child: 56.988us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 566.04 KB/sec - OverallThroughput: 274.18 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 20.243us - TransmitDataRPCTime: 27.604us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 17s834ms, non-child: 131.019ms, % non-child: 0.73%) ExecOption: Codegen Enabled - BuildTime: 44.483ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 17s703ms, non-child: 17s703ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 7.44 MB, 14.89 MB, 20.60 MB, 24.89 MB, 28.00 MB, 30.10 MB, 32.87 MB, 35.06 MB, 36.93 MB, 38.38 MB, 39.40 MB, 40.89 MB, 41.98 MB, 43.50 MB, 44.76 MB, 46.20 MB, 47.42 MB, 48.66 MB, 49.51 MB, 50.12 MB, 51.07 MB, 51.86 MB, 52.66 MB, 53.35 MB, 54.18 MB, 54.97 MB, 55.35 MB, 55.80 MB, 56.44 MB, 57.00 MB, 57.58 MB, 58.21 MB, 58.76 MB, 59.03 MB, 59.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.91 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 42.077ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 5.84 MB (6123512) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 43.13 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 62 (62) - ScannerThreadsTotalWallClockTime: 35s276ms - MaterializeTupleTime(*): 552.746ms - ScannerThreadsSysTime: 84.978ms - ScannerThreadsUserTime: 888.852ms - ScannerThreadsVoluntaryContextSwitches: 3.07K (3069) - TotalRawHdfsReadTime(*): 41.407ms - TotalReadThroughput: 3.39 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000044 (host=vd1313.halxg.cloudera.com:22000):(Total: 23s049ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 2.95 MB, 3.15 MB, 1.55 MB, 1.05 MB, 773.31 KB, 403.24 KB, 392.02 KB, 664.71 KB, 927.38 KB, 52.00 KB, 44.00 KB, 84.00 KB, 388.51 KB, 84.00 KB, 716.17 KB, 1.01 MB, 44.00 KB, 84.00 KB, 575.05 KB, 84.00 KB, 717.97 KB, 84.00 KB, 658.80 KB, 1.02 MB, 1.02 MB, 84.00 KB, 84.00 KB, 44.00 KB, 665.63 KB, 44.00 KB, 44.00 KB, 44.00 KB, 372.83 KB, 687.79 KB, 44.00 KB, 44.00 KB, 395.85 KB, 368.77 KB, 44.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 84.00 KB, 578.42 KB, 228.85 KB ThreadUsage(500.000ms): 18, 10, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.84 MB (5073368) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 52.758ms - RowsProduced: 1 (1) - TotalCpuTime: 40s557ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 262.712us - TotalStorageWaitTime: 39s164ms CodeGen:(Total: 96.760ms, non-child: 96.760ms, % non-child: 100.00%) - CodegenTime: 656.597us - CompileTime: 11.153ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 34.859ms - PrepareTime: 49.565ms DataStreamSender (dst_id=91):(Total: 45.282us, non-child: 45.282us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 694.07 KB/sec - OverallThroughput: 345.06 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.186us - TransmitDataRPCTime: 22.512us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 23s043ms, non-child: 188.682ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 51.700ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 22s854ms, non-child: 22s854ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 3.47 MB, 11.16 MB, 16.52 MB, 21.02 MB, 24.26 MB, 26.48 MB, 28.73 MB, 31.14 MB, 33.21 MB, 34.54 MB, 36.10 MB, 37.65 MB, 39.00 MB, 40.41 MB, 41.32 MB, 43.03 MB, 44.11 MB, 45.06 MB, 46.16 MB, 46.95 MB, 47.43 MB, 48.33 MB, 48.96 MB, 50.15 MB, 50.76 MB, 51.42 MB, 51.94 MB, 52.36 MB, 53.02 MB, 53.51 MB, 54.39 MB, 54.73 MB, 55.23 MB, 55.65 MB, 56.11 MB, 56.79 MB, 57.13 MB, 57.64 MB, 57.84 MB, 58.01 MB, 58.18 MB, 58.52 MB, 58.69 MB, 59.06 MB, 59.39 MB, 59.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.87 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 47.847ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 21 (21) - PeakMemoryUsage: 4.80 MB (5036504) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 33.45 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 150 (150) - ScannerThreadsTotalWallClockTime: 40s557ms - MaterializeTupleTime(*): 580.133ms - ScannerThreadsSysTime: 94.979ms - ScannerThreadsUserTime: 917.850ms - ScannerThreadsVoluntaryContextSwitches: 3.04K (3039) - TotalRawHdfsReadTime(*): 41.033ms - TotalReadThroughput: 2.59 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000047 (host=vd1316.halxg.cloudera.com:22000):(Total: 19s358ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 627.16 KB, 3.42 MB, 985.58 KB, 425.02 KB, 1.79 MB, 586.30 KB, 92.00 KB, 132.00 KB, 728.18 KB, 92.00 KB, 1017.20 KB, 44.00 KB, 371.99 KB, 839.30 KB, 84.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 1.01 MB, 233.09 KB, 380.01 KB, 228.86 KB, 391.23 KB, 229.60 KB, 377.81 KB, 574.14 KB, 392.05 KB, 700.55 KB, 231.21 KB, 387.48 KB, 44.00 KB, 44.00 KB, 84.00 KB, 375.95 KB, 84.00 KB, 84.00 KB, 228.15 KB, 662.80 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.35 MB (5613904) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 45.349ms - RowsProduced: 1 (1) - TotalCpuTime: 35s447ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.399us - TotalStorageWaitTime: 34s198ms CodeGen:(Total: 86.170ms, non-child: 86.170ms, % non-child: 100.00%) - CodegenTime: 571.411us - CompileTime: 11.234ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.736ms - PrepareTime: 43.729ms DataStreamSender (dst_id=91):(Total: 58.497us, non-child: 58.497us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 422.81 KB/sec - OverallThroughput: 267.11 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.936us - TransmitDataRPCTime: 36.955us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=23):(Total: 19s352ms, non-child: 169.130ms, % non-child: 0.87%) ExecOption: Codegen Enabled - BuildTime: 48.434ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=22):(Total: 19s183ms, non-child: 19s183ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 7.80 MB, 16.07 MB, 21.30 MB, 25.56 MB, 28.81 MB, 31.16 MB, 33.83 MB, 35.58 MB, 37.25 MB, 38.61 MB, 39.76 MB, 41.53 MB, 42.56 MB, 43.72 MB, 44.93 MB, 45.69 MB, 46.64 MB, 47.67 MB, 48.54 MB, 49.42 MB, 49.94 MB, 50.45 MB, 51.16 MB, 51.83 MB, 52.45 MB, 53.24 MB, 53.67 MB, 54.09 MB, 54.70 MB, 55.06 MB, 55.60 MB, 55.94 MB, 56.38 MB, 57.04 MB, 57.50 MB, 58.27 MB, 58.67 MB, 59.09 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.82 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 46.886ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 18 (18) - PeakMemoryUsage: 5.30 MB (5552464) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 39.84 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 122 (122) - ScannerThreadsTotalWallClockTime: 35s447ms - MaterializeTupleTime(*): 548.097ms - ScannerThreadsSysTime: 101.978ms - ScannerThreadsUserTime: 862.859ms - ScannerThreadsVoluntaryContextSwitches: 3.15K (3147) - TotalRawHdfsReadTime(*): 40.492ms - TotalReadThroughput: 3.11 MB/sec Fragment F21: Instance da46dbd7c4e8e43b:bc4eab3900000049 (host=vd1309.halxg.cloudera.com:22000):(Total: 26s074ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 28.00 KB, 40.01 KB, 40.01 KB, 40.01 KB, 40.01 KB, 40.01 KB, 44.01 KB, 44.01 KB, 52.01 KB, 52.01 KB, 52.01 KB, 56.01 KB, 60.01 KB, 60.01 KB, 60.01 KB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 64.02 KB (65552) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 65.765ms - RowsProduced: 1 (1) - TotalCpuTime: 85.572ms - TotalNetworkReceiveTime: 26s006ms - TotalNetworkSendTime: 209.381us - TotalStorageWaitTime: 0.000ns CodeGen:(Total: 78.749ms, non-child: 78.749ms, % non-child: 100.00%) - CodegenTime: 468.430us - CompileTime: 2.669ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 8.846ms - PrepareTime: 61.204ms DataStreamSender (dst_id=90):(Total: 71.558us, non-child: 71.558us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 404.25 KB/sec - OverallThroughput: 218.35 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 20.874us - TransmitDataRPCTime: 38.652us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=89):(Total: 26s073ms, non-child: 66.257ms, % non-child: 0.25%) ExecOption: Codegen Enabled - BuildTime: 442.453us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 40.00 KB (40960) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=88):(Total: 26s006ms, non-child: 162.339us, % non-child: 0.00%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 16.00 B, 32.00 B, 32.00 B, 64.00 B, 64.00 B, 64.00 B, 80.00 B, 96.00 B, 96.00 B, 96.00 B - BytesReceived: 112.00 B (112) - ConvertRowBatchTime: 25.000us - DeserializeRowBatchTimer: 175.662us - FirstBatchArrivalWaitTime: 18s537ms - PeakMemoryUsage: 0 - RowsReturned: 7 (7) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F20: Instance da46dbd7c4e8e43b:bc4eab390000004c (host=vd1313.halxg.cloudera.com:22000):(Total: 24s281ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB MemoryUsage(500.000ms): 4.38 MB, 2.33 MB, 2.00 MB, 656.30 KB, 60.00 KB, 624.06 KB, 370.38 KB, 389.02 KB, 1.05 MB, 420.15 KB, 172.00 KB, 227.56 KB, 226.37 KB, 652.38 KB, 44.00 KB, 354.13 KB, 44.00 KB, 372.15 KB, 383.82 KB, 371.47 KB, 84.00 KB, 649.85 KB, 1.01 MB, 84.00 KB, 84.00 KB, 686.80 KB, 355.19 KB, 44.00 KB, 84.00 KB, 1015.45 KB, 44.00 KB, 399.98 KB, 44.00 KB, 387.88 KB, 224.79 KB, 44.00 KB, 387.45 KB, 383.49 KB, 359.66 KB, 361.78 KB, 367.50 KB, 84.00 KB, 583.05 KB, 228.12 KB, 354.63 KB, 975.47 KB, 386.51 KB, 384.34 KB, 36.00 KB ThreadUsage(500.000ms): 20, 9, 7, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.82 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.10 MB (5348336) - PerHostPeakMemUsage: 56.14 MB (58864040) - PrepareTime: 42.727ms - RowsProduced: 1 (1) - TotalCpuTime: 41s064ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 190.104us - TotalStorageWaitTime: 39s705ms CodeGen:(Total: 81.124ms, non-child: 81.124ms, % non-child: 100.00%) - CodegenTime: 579.198us - CompileTime: 11.349ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 28.494ms - PrepareTime: 40.761ms DataStreamSender (dst_id=88):(Total: 44.061us, non-child: 44.061us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 1.07 MB/sec - OverallThroughput: 354.62 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.900us - TransmitDataRPCTime: 14.321us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 24s275ms, non-child: 172.373ms, % non-child: 0.71%) ExecOption: Codegen Enabled - BuildTime: 46.786ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 564.05 KB (577584) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 24s103ms, non-child: 24s103ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 265 out of 265 Hdfs split stats (:<# splits>/): 2:26/26.74 MB 0:35/31.43 MB 4:33/31.86 MB 1:34/29.77 MB 6:36/30.50 MB 3:27/26.62 MB 7:31/29.77 MB 5:43/41.54 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1060 BytesRead(500.000ms): 2.33 MB, 10.00 MB, 16.95 MB, 21.68 MB, 24.91 MB, 27.39 MB, 29.82 MB, 32.05 MB, 34.20 MB, 35.57 MB, 37.21 MB, 38.49 MB, 39.95 MB, 40.89 MB, 41.98 MB, 43.14 MB, 44.12 MB, 45.13 MB, 45.82 MB, 46.60 MB, 47.50 MB, 48.15 MB, 48.66 MB, 49.50 MB, 49.93 MB, 50.57 MB, 51.26 MB, 51.63 MB, 52.24 MB, 52.87 MB, 53.69 MB, 54.02 MB, 54.56 MB, 55.05 MB, 55.65 MB, 55.85 MB, 56.32 MB, 56.93 MB, 57.15 MB, 57.49 MB, 57.66 MB, 58.04 MB, 58.36 MB, 58.61 MB, 58.78 MB, 59.07 MB, 59.30 MB, 59.47 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.85 - BytesRead: 59.65 MB (62550630) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.65 MB (62550630) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.65 MB (62550630) - DecompressionTime: 45.312ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 265 (265) - NumScannerThreadsStarted: 19 (19) - PeakMemoryUsage: 5.06 MB (5303280) - PerReadThreadRawHdfsThroughput: 1.40 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.05M (4045218) - RowsReturned: 764.57K (764569) - RowsReturnedRate: 31.72 K/sec - ScanRangesComplete: 265 (265) - ScannerThreadsInvoluntaryContextSwitches: 163 (163) - ScannerThreadsTotalWallClockTime: 41s064ms - MaterializeTupleTime(*): 562.510ms - ScannerThreadsSysTime: 107.976ms - ScannerThreadsUserTime: 887.855ms - ScannerThreadsVoluntaryContextSwitches: 3.09K (3091) - TotalRawHdfsReadTime(*): 41.543ms - TotalReadThroughput: 2.48 MB/sec Instance da46dbd7c4e8e43b:bc4eab3900000050 (host=vd1314.halxg.cloudera.com:22000):(Total: 21s195ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB MemoryUsage(500.000ms): 931.45 KB, 1.49 MB, 849.13 KB, 1.70 MB, 564.47 KB, 1.65 MB, 279.61 KB, 434.20 KB, 581.84 KB, 1.27 MB, 228.54 KB, 395.19 KB, 376.25 KB, 391.73 KB, 578.53 KB, 84.00 KB, 172.00 KB, 362.12 KB, 689.10 KB, 84.00 KB, 381.20 KB, 84.00 KB, 339.70 KB, 84.00 KB, 44.00 KB, 44.00 KB, 228.21 KB, 357.53 KB, 44.00 KB, 44.00 KB, 574.05 KB, 655.41 KB, 84.00 KB, 44.00 KB, 722.56 KB, 84.00 KB, 700.69 KB, 84.00 KB, 383.98 KB, 212.00 KB, 44.00 KB, 84.00 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.74 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.70 MB (5974448) - PerHostPeakMemUsage: 57.05 MB (59823688) - PrepareTime: 41.854ms - RowsProduced: 1 (1) - TotalCpuTime: 35s501ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 262.478us - TotalStorageWaitTime: 34s274ms CodeGen:(Total: 80.534ms, non-child: 80.534ms, % non-child: 100.00%) - CodegenTime: 618.324us - CompileTime: 10.876ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.250ms - PrepareTime: 39.718ms DataStreamSender (dst_id=88):(Total: 48.507us, non-child: 48.507us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 529.09 KB/sec - OverallThroughput: 322.12 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.769us - TransmitDataRPCTime: 29.532us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 21s189ms, non-child: 155.733ms, % non-child: 0.73%) ExecOption: Codegen Enabled - BuildTime: 48.604ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 649.36 KB (664944) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 21s034ms, non-child: 21s034ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 269 out of 269 Hdfs split stats (:<# splits>/): 7:30/26.84 MB 5:40/34.30 MB 2:37/31.67 MB 0:32/32.41 MB 4:35/31.19 MB 6:29/28.14 MB 3:34/31.80 MB 1:32/31.66 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1076 BytesRead(500.000ms): 4.46 MB, 12.20 MB, 18.27 MB, 22.76 MB, 26.15 MB, 28.17 MB, 30.83 MB, 32.68 MB, 34.85 MB, 36.23 MB, 37.69 MB, 38.74 MB, 40.22 MB, 41.12 MB, 42.60 MB, 43.57 MB, 44.70 MB, 45.55 MB, 46.15 MB, 46.89 MB, 47.63 MB, 48.68 MB, 49.40 MB, 50.26 MB, 50.85 MB, 51.55 MB, 52.39 MB, 52.74 MB, 53.12 MB, 53.47 MB, 54.58 MB, 55.23 MB, 55.54 MB, 55.80 MB, 56.47 MB, 57.21 MB, 57.61 MB, 58.34 MB, 58.75 MB, 59.20 MB, 59.62 MB, 59.89 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.74 - BytesRead: 59.97 MB (62883953) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.97 MB (62883953) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.97 MB (62883953) - DecompressionTime: 45.622ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 269 (269) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 5.63 MB (5904816) - PerReadThreadRawHdfsThroughput: 1.46 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038377) - RowsReturned: 763.31K (763309) - RowsReturnedRate: 36.29 K/sec - ScanRangesComplete: 269 (269) - ScannerThreadsInvoluntaryContextSwitches: 58 (58) - ScannerThreadsTotalWallClockTime: 35s501ms - MaterializeTupleTime(*): 585.668ms - ScannerThreadsSysTime: 101.978ms - ScannerThreadsUserTime: 923.850ms - ScannerThreadsVoluntaryContextSwitches: 3.25K (3246) - TotalRawHdfsReadTime(*): 40.128ms - TotalReadThroughput: 2.85 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000004d (host=vd1312.halxg.cloudera.com:22000):(Total: 25s949ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB MemoryUsage(500.000ms): 1.15 MB, 4.44 MB, 731.32 KB, 1.66 MB, 1.84 MB, 1.03 MB, 379.25 KB, 241.06 KB, 1.37 MB, 234.38 KB, 388.11 KB, 44.00 KB, 226.25 KB, 44.00 KB, 355.16 KB, 84.00 KB, 84.00 KB, 225.88 KB, 381.96 KB, 703.82 KB, 44.00 KB, 84.00 KB, 389.81 KB, 377.56 KB, 363.37 KB, 232.12 KB, 384.76 KB, 44.00 KB, 997.61 KB, 373.85 KB, 84.00 KB, 231.71 KB, 657.59 KB, 684.84 KB, 375.24 KB, 229.98 KB, 44.00 KB, 44.00 KB, 681.12 KB, 224.87 KB, 226.06 KB, 388.80 KB, 44.00 KB, 369.30 KB, 84.00 KB, 376.67 KB, 371.62 KB, 44.00 KB, 84.00 KB, 362.76 KB, 44.00 KB, 356.90 KB ThreadUsage(500.000ms): 19, 10, 7, 5, 5, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.81 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.02 MB (5268656) - PerHostPeakMemUsage: 58.56 MB (61405424) - PrepareTime: 44.567ms - RowsProduced: 1 (1) - TotalCpuTime: 42s551ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 208.240us - TotalStorageWaitTime: 41s048ms CodeGen:(Total: 85.751ms, non-child: 85.751ms, % non-child: 100.00%) - CodegenTime: 571.649us - CompileTime: 12.682ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 30.107ms - PrepareTime: 42.301ms DataStreamSender (dst_id=88):(Total: 45.735us, non-child: 45.735us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 582.44 KB/sec - OverallThroughput: 341.64 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.565us - TransmitDataRPCTime: 26.827us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 25s944ms, non-child: 202.859ms, % non-child: 0.78%) ExecOption: Codegen Enabled - BuildTime: 51.531ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 562.59 KB (576096) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 25s741ms, non-child: 25s741ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 278 out of 278 Hdfs split stats (:<# splits>/): 3:34/33.25 MB 4:39/36.20 MB 7:30/27.27 MB 0:34/28.15 MB 1:36/32.46 MB 6:40/37.70 MB 5:29/21.43 MB 2:36/31.79 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1112 BytesRead(500.000ms): 900.00 KB, 9.71 MB, 16.58 MB, 20.85 MB, 24.63 MB, 26.83 MB, 29.26 MB, 31.15 MB, 32.84 MB, 34.10 MB, 35.51 MB, 37.04 MB, 37.97 MB, 39.18 MB, 40.02 MB, 41.59 MB, 42.64 MB, 43.64 MB, 44.26 MB, 44.93 MB, 45.92 MB, 46.80 MB, 47.55 MB, 48.64 MB, 49.19 MB, 49.79 MB, 50.15 MB, 50.84 MB, 51.79 MB, 52.23 MB, 52.56 MB, 53.12 MB, 53.53 MB, 54.49 MB, 54.85 MB, 55.34 MB, 55.54 MB, 55.71 MB, 56.28 MB, 56.72 MB, 57.07 MB, 57.25 MB, 57.69 MB, 58.18 MB, 58.47 MB, 58.83 MB, 59.05 MB, 59.41 MB, 59.68 MB, 60.07 MB, 60.43 MB, 60.85 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.81 - BytesRead: 60.87 MB (63828583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 60.87 MB (63828583) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 60.87 MB (63828583) - DecompressionTime: 45.199ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 278 (278) - NumScannerThreadsStarted: 18 (18) - PeakMemoryUsage: 4.97 MB (5207216) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4036770) - RowsReturned: 761.51K (761511) - RowsReturnedRate: 29.58 K/sec - ScanRangesComplete: 278 (278) - ScannerThreadsInvoluntaryContextSwitches: 83 (83) - ScannerThreadsTotalWallClockTime: 42s551ms - MaterializeTupleTime(*): 580.124ms - ScannerThreadsSysTime: 103.977ms - ScannerThreadsUserTime: 912.852ms - ScannerThreadsVoluntaryContextSwitches: 3.30K (3297) - TotalRawHdfsReadTime(*): 42.121ms - TotalReadThroughput: 2.34 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000004e (host=vd1311.halxg.cloudera.com:22000):(Total: 18s494ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB MemoryUsage(500.000ms): 3.17 MB, 3.28 MB, 1.47 MB, 762.88 KB, 749.46 KB, 469.37 KB, 582.77 KB, 534.23 KB, 378.16 KB, 92.00 KB, 148.00 KB, 381.36 KB, 44.00 KB, 84.00 KB, 44.00 KB, 44.00 KB, 44.00 KB, 376.77 KB, 84.00 KB, 232.65 KB, 228.98 KB, 44.00 KB, 359.89 KB, 372.87 KB, 695.76 KB, 570.55 KB, 1.02 MB, 233.10 KB, 228.03 KB, 84.00 KB, 44.00 KB, 376.91 KB, 44.00 KB, 693.55 KB, 84.00 KB, 394.49 KB, 84.00 KB ThreadUsage(500.000ms): 14, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.89 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.25 MB (5502384) - PerHostPeakMemUsage: 54.94 MB (57608336) - PrepareTime: 43.275ms - RowsProduced: 1 (1) - TotalCpuTime: 34s679ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 221.161us - TotalStorageWaitTime: 33s336ms CodeGen:(Total: 79.174ms, non-child: 79.174ms, % non-child: 100.00%) - CodegenTime: 532.732us - CompileTime: 10.565ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 26.921ms - PrepareTime: 40.685ms DataStreamSender (dst_id=88):(Total: 42.187us, non-child: 42.187us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 655.63 KB/sec - OverallThroughput: 370.37 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.679us - TransmitDataRPCTime: 23.832us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 18s489ms, non-child: 151.097ms, % non-child: 0.82%) ExecOption: Codegen Enabled - BuildTime: 46.482ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 563.88 KB (577416) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 18s337ms, non-child: 18s337ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 264 out of 264 Hdfs split stats (:<# splits>/): 4:31/32.69 MB 6:30/29.18 MB 3:31/26.27 MB 0:41/37.32 MB 1:31/29.29 MB 7:36/34.85 MB 5:31/30.22 MB 2:33/27.77 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1056 BytesRead(500.000ms): 5.22 MB, 13.59 MB, 19.61 MB, 24.06 MB, 26.98 MB, 29.44 MB, 31.68 MB, 34.09 MB, 35.65 MB, 37.16 MB, 38.45 MB, 40.07 MB, 41.44 MB, 42.73 MB, 44.21 MB, 45.08 MB, 46.40 MB, 47.42 MB, 48.14 MB, 48.89 MB, 49.59 MB, 50.14 MB, 51.24 MB, 52.10 MB, 52.87 MB, 53.57 MB, 54.31 MB, 54.84 MB, 55.45 MB, 56.18 MB, 56.77 MB, 57.50 MB, 57.90 MB, 58.31 MB, 58.60 MB, 58.84 MB, 59.38 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.89 - BytesRead: 59.45 MB (62342275) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.45 MB (62342275) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.45 MB (62342275) - DecompressionTime: 44.075ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 264 (264) - NumScannerThreadsStarted: 18 (18) - PeakMemoryUsage: 5.19 MB (5440944) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4038354) - RowsReturned: 763.61K (763610) - RowsReturnedRate: 41.64 K/sec - ScanRangesComplete: 264 (264) - ScannerThreadsInvoluntaryContextSwitches: 130 (130) - ScannerThreadsTotalWallClockTime: 34s679ms - MaterializeTupleTime(*): 564.664ms - ScannerThreadsSysTime: 84.982ms - ScannerThreadsUserTime: 919.852ms - ScannerThreadsVoluntaryContextSwitches: 3.08K (3082) - TotalRawHdfsReadTime(*): 54.983ms - TotalReadThroughput: 3.21 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000004f (host=vd1316.halxg.cloudera.com:22000):(Total: 22s461ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB MemoryUsage(500.000ms): 1.38 MB, 1.96 MB, 1.41 MB, 188.00 KB, 2.10 MB, 268.00 KB, 632.16 KB, 1.36 MB, 826.28 KB, 852.57 KB, 384.45 KB, 231.90 KB, 368.75 KB, 84.00 KB, 84.00 KB, 172.00 KB, 389.12 KB, 44.00 KB, 84.00 KB, 84.00 KB, 84.00 KB, 84.00 KB, 583.11 KB, 654.67 KB, 381.43 KB, 387.32 KB, 377.89 KB, 571.75 KB, 1.01 MB, 84.00 KB, 357.43 KB, 226.43 KB, 577.77 KB, 688.07 KB, 231.71 KB, 44.00 KB, 384.98 KB, 380.85 KB, 388.63 KB, 382.34 KB, 664.64 KB, 383.19 KB, 666.48 KB, 84.00 KB, 36.00 KB ThreadUsage(500.000ms): 12, 8, 6, 5, 4, 4, 3, 3, 3, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 5.32 MB (5580752) - PerHostPeakMemUsage: 54.75 MB (57412952) - PrepareTime: 44.692ms - RowsProduced: 1 (1) - TotalCpuTime: 38s103ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 327.245us - TotalStorageWaitTime: 36s814ms CodeGen:(Total: 83.161ms, non-child: 83.161ms, % non-child: 100.00%) - CodegenTime: 511.867us - CompileTime: 10.344ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 29.670ms - PrepareTime: 42.313ms DataStreamSender (dst_id=88):(Total: 55.675us, non-child: 55.675us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 400.88 KB/sec - OverallThroughput: 280.65 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.415us - TransmitDataRPCTime: 38.977us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 22s454ms, non-child: 208.076ms, % non-child: 0.93%) ExecOption: Codegen Enabled - BuildTime: 55.632ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 648.68 KB (664248) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 22s246ms, non-child: 22s246ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 262 out of 262 Hdfs split stats (:<# splits>/): 2:28/31.79 MB 7:41/34.90 MB 5:27/24.70 MB 0:31/33.16 MB 4:43/34.34 MB 1:20/19.09 MB 3:34/34.04 MB 6:38/35.87 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:1048 BytesRead(500.000ms): 6.79 MB, 14.60 MB, 19.66 MB, 23.88 MB, 26.88 MB, 29.19 MB, 31.79 MB, 33.95 MB, 35.54 MB, 36.81 MB, 38.24 MB, 39.43 MB, 40.38 MB, 41.70 MB, 42.39 MB, 43.43 MB, 44.37 MB, 45.26 MB, 46.37 MB, 47.16 MB, 47.78 MB, 48.38 MB, 49.24 MB, 49.72 MB, 50.36 MB, 51.03 MB, 51.38 MB, 51.98 MB, 52.53 MB, 53.02 MB, 53.75 MB, 54.18 MB, 54.79 MB, 55.29 MB, 55.64 MB, 56.01 MB, 56.34 MB, 56.82 MB, 57.04 MB, 57.43 MB, 57.71 MB, 58.09 MB, 58.66 MB, 59.06 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.70 - BytesRead: 59.31 MB (62190221) - BytesReadDataNodeCache: 0 - BytesReadLocal: 59.31 MB (62190221) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 59.31 MB (62190221) - DecompressionTime: 44.573ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 262 (262) - NumScannerThreadsStarted: 17 (17) - PeakMemoryUsage: 5.26 MB (5511120) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.04M (4044679) - RowsReturned: 764.34K (764342) - RowsReturnedRate: 34.36 K/sec - ScanRangesComplete: 262 (262) - ScannerThreadsInvoluntaryContextSwitches: 118 (118) - ScannerThreadsTotalWallClockTime: 38s103ms - MaterializeTupleTime(*): 567.090ms - ScannerThreadsSysTime: 93.978ms - ScannerThreadsUserTime: 897.853ms - ScannerThreadsVoluntaryContextSwitches: 3.07K (3074) - TotalRawHdfsReadTime(*): 47.705ms - TotalReadThroughput: 2.68 MB/sec Instance da46dbd7c4e8e43b:bc4eab390000004a (host=vd1309.halxg.cloudera.com:22000):(Total: 22s135ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB MemoryUsage(500.000ms): 1.39 MB, 414.14 KB, 397.45 KB, 44.00 KB, 84.00 KB, 376.68 KB, 690.40 KB, 719.93 KB, 226.39 KB, 1.01 MB, 84.00 KB, 84.00 KB, 44.00 KB, 838.66 KB, 970.84 KB, 13.14 MB, 376.29 KB, 231.99 KB, 84.00 KB, 231.58 KB, 1017.20 KB, 656.28 KB, 646.41 KB, 84.00 KB, 226.02 KB, 84.00 KB, 44.00 KB, 44.00 KB, 356.23 KB, 372.27 KB, 376.06 KB, 368.41 KB, 44.00 KB, 651.41 KB, 84.00 KB, 392.98 KB, 44.00 KB, 671.87 KB, 383.02 KB, 224.88 KB, 84.00 KB, 234.27 KB, 399.15 KB, 36.00 KB ThreadUsage(500.000ms): 6, 4, 3, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1 - AverageThreadTokens: 2.14 - BloomFilterBytes: 0 - PeakMemoryUsage: 24.34 MB (25524456) - PerHostPeakMemUsage: 84.72 MB (88837584) - PrepareTime: 80.346ms - RowsProduced: 1 (1) - TotalCpuTime: 25s432ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 245.114us - TotalStorageWaitTime: 23s365ms CodeGen:(Total: 138.564ms, non-child: 138.564ms, % non-child: 100.00%) - CodegenTime: 775.061us - CompileTime: 13.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1949344) - NumFunctions: 80 (80) - NumInstructions: 2.73K (2725) - OptimizationTime: 44.930ms - PrepareTime: 78.320ms DataStreamSender (dst_id=88):(Total: 59.056us, non-child: 59.056us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 402.41 KB/sec - OverallThroughput: 264.58 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.610us - TransmitDataRPCTime: 38.829us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=21):(Total: 22s126ms, non-child: 611.387ms, % non-child: 2.76%) ExecOption: Codegen Enabled - BuildTime: 307.166ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 1.20 MB (1260072) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=20):(Total: 21s515ms, non-child: 21s515ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 223 out of 223 Hdfs split stats (:<# splits>/): 7:29/25.59 MB 0:25/24.49 MB 4:30/26.52 MB 3:29/29.82 MB 1:21/19.87 MB 6:34/77.17 MB 5:20/18.66 MB 2:35/25.76 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% File Formats: PARQUET/SNAPPY:892 BytesRead(500.000ms): 5.68 MB, 12.79 MB, 16.66 MB, 20.29 MB, 22.81 MB, 24.77 MB, 26.42 MB, 27.90 MB, 29.90 MB, 30.74 MB, 31.91 MB, 33.37 MB, 34.68 MB, 35.80 MB, 36.93 MB, 45.97 MB, 51.41 MB, 52.44 MB, 52.99 MB, 53.74 MB, 54.23 MB, 54.84 MB, 55.62 MB, 56.45 MB, 57.02 MB, 57.67 MB, 58.02 MB, 58.62 MB, 58.77 MB, 59.46 MB, 59.85 MB, 60.07 MB, 60.53 MB, 60.75 MB, 61.06 MB, 61.12 MB, 61.31 MB, 61.53 MB, 61.73 MB, 61.89 MB, 62.01 MB, 62.32 MB, 62.34 MB - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 1.16 - BytesRead: 62.53 MB (65564180) - BytesReadDataNodeCache: 0 - BytesReadLocal: 62.53 MB (65564180) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 62.53 MB (65564180) - DecompressionTime: 209.158ms - MaxCompressedTextFileLength: 0 - NumColumns: 4 (4) - NumDisksAccessed: 8 (8) - NumRowGroups: 223 (223) - NumScannerThreadsStarted: 7 (7) - PeakMemoryUsage: 23.45 MB (24594176) - PerReadThreadRawHdfsThroughput: 1.42 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 4.55M (4545942) - RowsReturned: 677.48K (677479)