impalad /backends /catalog /hadoop-varz /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query 594518549f864a64:edcb0b4500000000 Plan Query Text plan Summary Profile Memory Download Thrift Profile Query (id=594518549f864a64:edcb0b4500000000): Summary: Session ID: 914924d1d85fb1b4:e910b8842d78bb2 Session Type: BEESWAX Start Time: 2016-11-16 11:18:45.369710000 End Time: 2016-11-16 11:19:44.368862000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build cd3a5f4de2ef55c0101db7ac173a9193ed307559) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.20.122.101:53473 Default Db: tpcds_3000_parquet Sql Statement: with wss as (select d_week_seq, ss_store_sk, sum(case when (d_day_name='Sunday') then ss_sales_price else null end) sun_sales, sum(case when (d_day_name='Monday') then ss_sales_price else null end) mon_sales, sum(case when (d_day_name='Tuesday') then ss_sales_price else null end) tue_sales, sum(case when (d_day_name='Wednesday') then ss_sales_price else null end) wed_sales, sum(case when (d_day_name='Thursday') then ss_sales_price else null end) thu_sales, sum(case when (d_day_name='Friday') then ss_sales_price else null end) fri_sales, sum(case when (d_day_name='Saturday') then ss_sales_price else null end) sat_sales from store_sales,date_dim where d_date_sk = ss_sold_date_sk group by d_week_seq,ss_store_sk ) select s_store_name1,s_store_id1,d_week_seq1 ,sun_sales1/sun_sales2,mon_sales1/mon_sales2 ,tue_sales1/tue_sales2,wed_sales1/wed_sales2,thu_sales1/thu_sales2 ,fri_sales1/fri_sales2,sat_sales1/sat_sales2 from (select s_store_name s_store_name1,wss.d_week_seq d_week_seq1 ,s_store_id s_store_id1,sun_sales sun_sales1 ,mon_sales mon_sales1,tue_sales tue_sales1 ,wed_sales wed_sales1,thu_sales thu_sales1 ,fri_sales fri_sales1,sat_sales sat_sales1 from wss,store,date_dim d where d.d_week_seq = wss.d_week_seq and ss_store_sk = s_store_sk and d_month_seq between 1185 and 1185 + 11) y, (select s_store_name s_store_name2,wss.d_week_seq d_week_seq2 ,s_store_id s_store_id2,sun_sales sun_sales2 ,mon_sales mon_sales2,tue_sales tue_sales2 ,wed_sales wed_sales2,thu_sales thu_sales2 ,fri_sales fri_sales2,sat_sales sat_sales2 from wss,store,date_dim d where d.d_week_seq = wss.d_week_seq and ss_store_sk = s_store_sk and d_month_seq between 1185+ 12 and 1185 + 23) x where s_store_id1=s_store_id2 and d_week_seq1=d_week_seq2-52 order by s_store_name1,s_store_id1,d_week_seq1 limit 100 Coordinator: d2401.halxg.cloudera.com:22000 Query Options (non default): RUNTIME_FILTER_WAIT_TIME_MS=2500 Plan: ---------------- Estimated Per-Host Requirements: Memory=1.04GB VCores=5 PLAN-ROOT SINK | 30:MERGING-EXCHANGE [UNPARTITIONED] | order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC | limit: 100 | hosts=19 per-host-mem=unavailable | tuple-ids=14 row-size=280B cardinality=100 | 17:TOP-N [LIMIT=100] | order by: s_store_name1 ASC, s_store_id1 ASC, d_week_seq1 ASC | hosts=19 per-host-mem=27.34KB | tuple-ids=14 row-size=280B cardinality=100 | 16:HASH JOIN [INNER JOIN, PARTITIONED] | hash predicates: d_week_seq = d_week_seq - 52, s_store_id = s_store_id | runtime filters: RF000 <- d_week_seq - 52, RF001 <- s_store_id | hosts=19 per-host-mem=6.29MB | tuple-ids=2,5,4,9,12,11 row-size=348B cardinality=694933 | |--29:EXCHANGE [HASH(d_week_seq - 52,s_store_id)] | | hosts=19 per-host-mem=0B | | tuple-ids=9,12,11 row-size=164B cardinality=694933 | | | 15:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_store_sk = s_store_sk | | runtime filters: RF005 <- s_store_sk | | hosts=19 per-host-mem=52.21KB | | tuple-ids=9,12,11 row-size=164B cardinality=694933 | | | |--27:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=11 row-size=36B cardinality=1350 | | | | | 12:SCAN HDFS [tpcds_3000_parquet.store, RANDOM] | | partitions=1/1 files=1 size=115.36KB | | table stats: 1350 rows total | | column stats: all | | hosts=1 per-host-mem=48.00MB | | tuple-ids=11 row-size=36B cardinality=1350 | | | 14:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: d_week_seq = d.d_week_seq | | runtime filters: RF006 <- d.d_week_seq | | hosts=19 per-host-mem=62.78KB | | tuple-ids=9,12 row-size=128B cardinality=694933 | | | |--26:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=12 row-size=8B cardinality=7305 | | | | | 13:SCAN HDFS [tpcds_3000_parquet.date_dim d, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | predicates: d_month_seq <= 1185 + 23, d_month_seq >= 1185 + 12 | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=32.00MB | | tuple-ids=12 row-size=8B cardinality=7305 | | | 25:AGGREGATE [FINALIZE] | | output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) | | group by: d_week_seq, ss_store_sk | | hosts=19 per-host-mem=10.00MB | | tuple-ids=9 row-size=120B cardinality=6949226 | | | 24:EXCHANGE [HASH(d_week_seq,ss_store_sk)] | | hosts=19 per-host-mem=0B | | tuple-ids=9 row-size=120B cardinality=6949226 | | | 11:AGGREGATE [STREAMING] | | output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) | | group by: d_week_seq, ss_store_sk | | hosts=19 per-host-mem=874.80MB | | tuple-ids=9 row-size=120B cardinality=6949226 | | | 10:HASH JOIN [INNER JOIN, BROADCAST] | | hash predicates: ss_sold_date_sk = d_date_sk | | runtime filters: RF007 <- d_date_sk | | hosts=19 per-host-mem=2.39MB | | tuple-ids=7,8 row-size=43B cardinality=8639936081 | | | |--23:EXCHANGE [BROADCAST] | | | hosts=1 per-host-mem=0B | | | tuple-ids=8 row-size=31B cardinality=73049 | | | | | 09:SCAN HDFS [tpcds_3000_parquet.date_dim, RANDOM] | | partitions=1/1 files=1 size=2.15MB | | runtime filters: RF006 -> tpcds_3000_parquet.date_dim.d_week_seq | | table stats: 73049 rows total | | column stats: all | | hosts=1 per-host-mem=48.00MB | | tuple-ids=8 row-size=31B cardinality=73049 | | | 08:SCAN HDFS [tpcds_3000_parquet.store_sales, RANDOM] | partitions=1824/1824 files=2649 size=376.48GB | runtime filters: RF005 -> tpcds_3000_parquet.store_sales.ss_store_sk, RF007 -> ss_sold_date_sk | table stats: 8639936081 rows total | column stats: all | hosts=19 per-host-mem=176.00MB | tuple-ids=7 row-size=12B cardinality=8639936081 | 28:EXCHANGE [HASH(d_week_seq,s_store_id)] | hosts=19 per-host-mem=0B | tuple-ids=2,5,4 row-size=184B cardinality=694933 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_store_sk = s_store_sk | runtime filters: RF002 <- s_store_sk | hosts=19 per-host-mem=81.09KB | tuple-ids=2,5,4 row-size=184B cardinality=694933 | |--22:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=4 row-size=56B cardinality=1350 | | | 04:SCAN HDFS [tpcds_3000_parquet.store, RANDOM] | partitions=1/1 files=1 size=115.36KB | runtime filters: RF001 -> s_store_id | table stats: 1350 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=4 row-size=56B cardinality=1350 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: d_week_seq = d.d_week_seq | runtime filters: RF003 <- d.d_week_seq | hosts=19 per-host-mem=62.78KB | tuple-ids=2,5 row-size=128B cardinality=694933 | |--21:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=5 row-size=8B cardinality=7305 | | | 05:SCAN HDFS [tpcds_3000_parquet.date_dim d, RANDOM] | partitions=1/1 files=1 size=2.15MB | predicates: d_month_seq >= 1185, d_month_seq <= 1185 + 11 | runtime filters: RF000 -> d.d_week_seq | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=32.00MB | tuple-ids=5 row-size=8B cardinality=7305 | 20:AGGREGATE [FINALIZE] | output: sum:merge(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum:merge(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) | group by: d_week_seq, ss_store_sk | hosts=19 per-host-mem=10.00MB | tuple-ids=2 row-size=120B cardinality=6949226 | 19:EXCHANGE [HASH(d_week_seq,ss_store_sk)] | hosts=19 per-host-mem=0B | tuple-ids=2 row-size=120B cardinality=6949226 | 03:AGGREGATE [STREAMING] | output: sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END), sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) | group by: d_week_seq, ss_store_sk | hosts=19 per-host-mem=874.80MB | tuple-ids=2 row-size=120B cardinality=6949226 | 02:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: ss_sold_date_sk = d_date_sk | runtime filters: RF004 <- d_date_sk | hosts=19 per-host-mem=2.39MB | tuple-ids=0,1 row-size=43B cardinality=8639936081 | |--18:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=1 row-size=31B cardinality=73049 | | | 01:SCAN HDFS [tpcds_3000_parquet.date_dim, RANDOM] | partitions=1/1 files=1 size=2.15MB | runtime filters: RF000 -> tpcds_3000_parquet.date_dim.d_week_seq, RF003 -> tpcds_3000_parquet.date_dim.d_week_seq | table stats: 73049 rows total | column stats: all | hosts=1 per-host-mem=48.00MB | tuple-ids=1 row-size=31B cardinality=73049 | 00:SCAN HDFS [tpcds_3000_parquet.store_sales, RANDOM] partitions=1824/1824 files=2649 size=376.48GB runtime filters: RF002 -> tpcds_3000_parquet.store_sales.ss_store_sk, RF004 -> ss_sold_date_sk table stats: 8639936081 rows total column stats: all hosts=19 per-host-mem=176.00MB tuple-ids=0 row-size=12B cardinality=8639936081 ---------------- Estimated Per-Host Mem: 1114835439 Estimated Per-Host VCores: 5 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------------------- 30:MERGING-EXCHANGE 1 258.459us 258.459us 100 100 0 -1.00 B UNPARTITIONED 17:TOP-N 19 6.050ms 11.963ms 1.90K 100 313.68 KB 27.34 KB 16:HASH JOIN 19 6.301ms 10.733ms 1.71M 694.93K 10.81 MB 6.29 MB INNER JOIN, PARTITIONED |--29:EXCHANGE 19 2.271ms 8.686ms 247.05K 694.93K 0 0 HASH(d_week_seq - 52,s_stor... | 15:HASH JOIN 19 1.196ms 1.574ms 247.05K 694.93K 1.09 MB 52.21 KB INNER JOIN, BROADCAST | |--27:EXCHANGE 19 39.266us 60.248us 1.35K 1.35K 0 0 BROADCAST | | 12:SCAN HDFS 1 15.294ms 15.294ms 1.35K 1.35K 136.00 KB 48.00 MB tpcds_3000_parquet.store | 14:HASH JOIN 19 1.781ms 3.270ms 247.42K 694.93K 2.05 MB 62.78 KB INNER JOIN, BROADCAST | |--26:EXCHANGE 19 16.657us 26.172us 366 7.30K 0 0 BROADCAST | | 13:SCAN HDFS 1 16.883ms 16.883ms 366 7.30K 1.07 MB 32.00 MB tpcds_3000_parquet.date_dim d | 25:AGGREGATE 19 6.215ms 9.576ms 35.83K 6.95M 2.66 MB 10.00 MB FINALIZE | 24:EXCHANGE 19 1.388ms 3.139ms 282.57K 6.95M 0 0 HASH(d_week_seq,ss_store_sk) | 11:AGGREGATE 19 6s928ms 9s910ms 282.57K 6.95M 10.33 MB 874.80 MB STREAMING | 10:HASH JOIN 19 3s082ms 4s365ms 1.69B 8.64B 1.22 MB 2.39 MB INNER JOIN, BROADCAST | |--23:EXCHANGE 19 16.229us 29.532us 371 73.05K 0 0 BROADCAST | | 09:SCAN HDFS 1 514.302ms 514.302ms 371 73.05K 3.05 MB 48.00 MB tpcds_3000_parquet.date_dim | 08:SCAN HDFS 19 391.558ms 658.455ms 1.69B 8.64B 215.62 MB 176.00 MB tpcds_3000_parquet.store_sales 28:EXCHANGE 19 1.930ms 5.479ms 246.38K 694.93K 0 0 HASH(d_week_seq,s_store_id) 07:HASH JOIN 19 1.362ms 2.020ms 246.38K 694.93K 1.11 MB 81.09 KB INNER JOIN, BROADCAST |--22:EXCHANGE 19 41.967us 64.116us 1.35K 1.35K 0 0 BROADCAST | 04:SCAN HDFS 1 2s470ms 2s470ms 1.35K 1.35K 182.55 KB 48.00 MB tpcds_3000_parquet.store 06:HASH JOIN 19 1.998ms 2.748ms 246.74K 694.93K 2.05 MB 62.78 KB INNER JOIN, BROADCAST |--21:EXCHANGE 19 16.828us 25.300us 365 7.30K 0 0 BROADCAST | 05:SCAN HDFS 1 2s462ms 2s462ms 365 7.30K 1.07 MB 32.00 MB tpcds_3000_parquet.date_dim d 20:AGGREGATE 19 15.010ms 21.651ms 177.11K 6.95M 11.16 MB 10.00 MB FINALIZE 19:EXCHANGE 19 6.568ms 11.383ms 1.37M 6.95M 0 0 HASH(d_week_seq,ss_store_sk) 03:AGGREGATE 19 32s643ms 38s128ms 1.37M 6.95M 139.22 MB 874.80 MB STREAMING 02:HASH JOIN 19 12s856ms 15s551ms 8.25B 8.64B 11.20 MB 2.39 MB INNER JOIN, BROADCAST |--18:EXCHANGE 19 1.850ms 4.123ms 73.05K 73.05K 0 0 BROADCAST | 01:SCAN HDFS 1 2s494ms 2s494ms 73.05K 73.05K 3.44 MB 48.00 MB tpcds_3000_parquet.date_dim 00:SCAN HDFS 19 1s520ms 2s097ms 8.25B 8.64B 221.53 MB 176.00 MB tpcds_3000_parquet.store_sales Planner Timeline: 75.168ms - Analysis finished: 25.846ms (25.846ms) - Equivalence classes computed: 27.150ms (1.304ms) - Single node plan created: 48.450ms (21.299ms) - Runtime filters computed: 49.725ms (1.275ms) - Distributed plan created: 59.169ms (9.443ms) - Lineage info computed: 61.897ms (2.728ms) - Planning finished: 75.168ms (13.270ms) Query Timeline: 59s073ms - Query submitted: 176.800us (176.800us) - Planning finished: 160.154ms (159.978ms) - Ready to start 102 fragment instances: 197.427ms (37.273ms) - All 102 fragment instances started: 437.951ms (240.523ms) - First dynamic filter received: 928.711ms (490.759ms) - Rows available: 58s703ms (57s774ms) - First row fetched: 58s929ms (226.599ms) - Unregister query: 58s999ms (69.380ms) - ComputeScanRangeAssignmentTimer: 11.363ms ImpalaServer: - ClientFetchWaitTimer: 282.219ms - RowMaterializationTimer: 13.745ms Execution Profile 594518549f864a64:edcb0b4500000000:(Total: 58s510ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 8 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------------------- 7 10 8 19 LOCAL true 0 (19) N/A N/A true 6 14 9 1 REMOTE false 1 (3) N/A N/A true 5 15 8 19 REMOTE false 1 (3) N/A N/A true 4 2 0 19 LOCAL true 0 (19) N/A N/A true 3 6 1 1 REMOTE false 1 (3) N/A N/A true 2 7 0 19 REMOTE false 1 (3) N/A N/A true 1 16 4 1 REMOTE false 19 (19) N/A N/A true 0 16 1, 5 1, 1 REMOTE, REMOTE false, false 19 (19) N/A N/A true Fragment instance start latencies: Count: 102, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 23ms, 90th %-ile: 26ms, 95th %-ile: 31ms, 99.9th %-ile: 40ms Per Node Peak Memory Usage: d2416.halxg.cloudera.com:22000(452.30 MB) d2407.halxg.cloudera.com:22000(427.93 MB) d2411.halxg.cloudera.com:22000(458.45 MB) d2404.halxg.cloudera.com:22000(446.16 MB) d2410.halxg.cloudera.com:22000(446.28 MB) d2420.halxg.cloudera.com:22000(452.62 MB) d2418.halxg.cloudera.com:22000(434.49 MB) d2417.halxg.cloudera.com:22000(422.28 MB) d2402.halxg.cloudera.com:22000(470.56 MB) d2414.halxg.cloudera.com:22000(452.28 MB) d2405.halxg.cloudera.com:22000(386.37 MB) d2413.halxg.cloudera.com:22000(434.44 MB) d2406.halxg.cloudera.com:22000(404.25 MB) d2415.halxg.cloudera.com:22000(428.23 MB) d2403.halxg.cloudera.com:22000(373.40 MB) d2421.halxg.cloudera.com:22000(376.57 MB) d2419.halxg.cloudera.com:22000(422.26 MB) d2409.halxg.cloudera.com:22000(416.66 MB) d2401.halxg.cloudera.com:22000(373.14 MB) Final filter table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------------------- 7 10 8 19 LOCAL true 0 (19) N/A N/A true 6 14 9 1 REMOTE false 0 (3) 928.714ms 928.716ms false 5 15 8 19 REMOTE false 0 (3) 928.949ms 928.950ms false 4 2 0 19 LOCAL true 0 (19) N/A N/A true 3 6 1 1 REMOTE false 0 (3) 2s818ms 2s818ms false 2 7 0 19 REMOTE false 0 (3) 2s804ms 2s804ms false 1 16 4 1 REMOTE false 0 (19) 16s021ms 16s049ms false 0 16 1, 5 1, 1 REMOTE, REMOTE false, false 0 (19) 16s020ms 16s226ms false - FiltersReceived: 42 (42) - FinalizationTimer: 0.000ns Coordinator Fragment F11: Instance 594518549f864a64:edcb0b4500000000 (host=d2401.halxg.cloudera.com:22000):(Total: 58s502ms, non-child: 5.040ms, % non-child: 0.01%) MemoryUsage(1s000ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 273.48 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 540.52 KB (553492) - PerHostPeakMemUsage: 373.14 MB (391262307) - RowsProduced: 100 (100) - TotalCpuTime: 58s730ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 227.194ms - ExecTreeExecTime: 136.354us - OpenTime: 58s456ms - ExecTreeOpenTime: 57s698ms - PrepareTime: 46.238ms - ExecTreePrepareTime: 35.047ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.54 MB (5811200) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 798.856ms, non-child: 798.856ms, % non-child: 100.00%) - CodegenTime: 978.589us - CompileTime: 220.904ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 169 (169) - NumInstructions: 6.44K (6443) - OptimizationTime: 534.686ms - PrepareTime: 42.453ms PLAN_ROOT_SINK: EXCHANGE_NODE (id=30):(Total: 57s698ms, non-child: 258.459us, % non-child: 0.00%) ExecOption: Codegen Enabled BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 20.70 KB - BytesReceived: 41.41 KB (42403) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 931.822us - FirstBatchArrivalWaitTime: 57s698ms - MergeGetNext: 123.087us - MergeGetNextBatch: 1.756us - PeakMemoryUsage: 0 - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F10:(Total: 58s497ms, non-child: 7.976ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:58s497ms max:58s499ms mean: 58s498ms stddev:810.220us execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 19 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.23 MB (13876225) - PerHostPeakMemUsage: 425.19 MB (445846248) - RowsProduced: 100 (100) - TotalCpuTime: 15s096ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 212.906us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 415.005us - ExecTreeExecTime: 14.650us - OpenTime: 58s462ms - ExecTreeOpenTime: 57s776ms - PrepareTime: 35.253ms - ExecTreePrepareTime: 24.099ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 65 (65) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 19.60 MB (20550428) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 710.962ms, non-child: 710.962ms, % non-child: 100.00%) - CodegenTime: 2.006ms - CompileTime: 202.523ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 481.588ms - PrepareTime: 26.206ms DataStreamSender (dst_id=30):(Total: 77.533us, non-child: 77.533us, % non-child: 100.00%) - BytesSent: 2.18 KB (2231) - NetworkThroughput(*): 88.49 MB/sec - OverallThroughput: 28.08 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 40.572us - TransmitDataRPCTime: 25.489us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s778ms, non-child: 6.050ms, % non-child: 0.01%) - InsertBatchTime: 5.094ms - PeakMemoryUsage: 305.37 KB (312698) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s772ms, non-child: 6.301ms, % non-child: 0.01%) - BuildRows: 13.00K (13002) - BuildTime: 10.075ms - PeakMemoryUsage: 10.80 MB (11326666) - ProbeRows: 12.97K (12967) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.405ms - RowsReturned: 90.02K (90023) - RowsReturnedRate: 1.56 K/sec Hash Join Builder (join_node_id=16): - BuildRowsPartitionTime: 4.414ms - BuildRowsPartitioned: 13.00K (13002) - GetNewBlockTime: 116.018us - HashBuckets: 32.23K (32229) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.882ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s086ms, non-child: 15s086ms, % non-child: 100.00%) - BytesReceived: 390.21 KB (399573) - ConvertRowBatchTime: 362.322us - DeserializeRowBatchTimer: 3.809ms - FirstBatchArrivalWaitTime: 15s071ms - PeakMemoryUsage: 0 - RowsReturned: 13.00K (13002) - RowsReturnedRate: 861.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s765ms, non-child: 57s765ms, % non-child: 100.00%) - BytesReceived: 500.61 KB (512620) - ConvertRowBatchTime: 412.819us - DeserializeRowBatchTimer: 4.303ms - FirstBatchArrivalWaitTime: 57s743ms - PeakMemoryUsage: 0 - RowsReturned: 12.97K (12967) - RowsReturnedRate: 223.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F10: Instance 594518549f864a64:5e (host=d2409.halxg.cloudera.com:22000):(Total: 58s498ms, non-child: 8.288ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.38 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.19 MB (13835004) - PerHostPeakMemUsage: 416.66 MB (436898048) - RowsProduced: 100 (100) - TotalCpuTime: 15s118ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 217.596us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 420.596us - ExecTreeExecTime: 26.280us - OpenTime: 58s464ms - ExecTreeOpenTime: 57s798ms - PrepareTime: 33.986ms - ExecTreePrepareTime: 22.515ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.06 MB (5303296) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 689.653ms, non-child: 689.653ms, % non-child: 100.00%) - CodegenTime: 2.085ms - CompileTime: 195.629ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 468.881ms - PrepareTime: 24.484ms DataStreamSender (dst_id=30):(Total: 72.056us, non-child: 72.056us, % non-child: 100.00%) - BytesSent: 2.19 KB (2242) - NetworkThroughput(*): 100.61 MB/sec - OverallThroughput: 29.67 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 40.328us - TransmitDataRPCTime: 21.252us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s800ms, non-child: 5.469ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.498ms - PeakMemoryUsage: 307.48 KB (314859) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s795ms, non-child: 5.865ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.89K (12894) - BuildTime: 9.096ms - PeakMemoryUsage: 10.81 MB (11337451) - ProbeRows: 12.86K (12862) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.007ms - RowsReturned: 89.33K (89326) - RowsReturnedRate: 1.54 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.042ms - BuildRowsPartitioned: 12.89K (12894) - GetNewBlockTime: 159.712us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.673ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s109ms, non-child: 2.022ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 193.13 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB, 386.26 KB - BytesReceived: 386.26 KB (395528) - ConvertRowBatchTime: 362.504us - DeserializeRowBatchTimer: 3.721ms - FirstBatchArrivalWaitTime: 15s093ms - PeakMemoryUsage: 0 - RowsReturned: 12.89K (12894) - RowsReturnedRate: 853.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s789ms, non-child: 1.871ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 496.05 KB (507954) - ConvertRowBatchTime: 496.264us - DeserializeRowBatchTimer: 3.822ms - FirstBatchArrivalWaitTime: 57s765ms - PeakMemoryUsage: 0 - RowsReturned: 12.86K (12862) - RowsReturnedRate: 222.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:63 (host=d2416.halxg.cloudera.com:22000):(Total: 58s498ms, non-child: 7.068ms, % non-child: 0.01%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.16 MB (13798205) - PerHostPeakMemUsage: 452.30 MB (474274611) - RowsProduced: 100 (100) - TotalCpuTime: 15s128ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 163.920us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 335.164us - ExecTreeExecTime: 24.108us - OpenTime: 58s466ms - ExecTreeOpenTime: 57s808ms - PrepareTime: 32.157ms - ExecTreePrepareTime: 22.088ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.56 MB (5827584) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 681.073ms, non-child: 681.073ms, % non-child: 100.00%) - CodegenTime: 1.856ms - CompileTime: 197.817ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 458.710ms - PrepareTime: 23.939ms DataStreamSender (dst_id=30):(Total: 71.504us, non-child: 71.504us, % non-child: 100.00%) - BytesSent: 2.21 KB (2258) - NetworkThroughput(*): 94.45 MB/sec - OverallThroughput: 30.12 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 36.956us - TransmitDataRPCTime: 22.800us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s809ms, non-child: 5.866ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.980ms - PeakMemoryUsage: 303.93 KB (311220) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s804ms, non-child: 5.846ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.22K (13222) - BuildTime: 9.897ms - PeakMemoryUsage: 10.79 MB (11317428) - ProbeRows: 13.21K (13207) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.208ms - RowsReturned: 91.52K (91522) - RowsReturnedRate: 1.58 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.599ms - BuildRowsPartitioned: 13.22K (13222) - GetNewBlockTime: 81.148us - HashBuckets: 31.74K (31744) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.851ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s118ms, non-child: 1.321ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB, 397.10 KB - BytesReceived: 397.10 KB (406631) - ConvertRowBatchTime: 354.312us - DeserializeRowBatchTimer: 3.366ms - FirstBatchArrivalWaitTime: 15s100ms - PeakMemoryUsage: 0 - RowsReturned: 13.22K (13222) - RowsReturnedRate: 874.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s798ms, non-child: 1.243ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 509.99 KB (522226) - ConvertRowBatchTime: 384.928us - DeserializeRowBatchTimer: 3.770ms - FirstBatchArrivalWaitTime: 57s774ms - PeakMemoryUsage: 0 - RowsReturned: 13.21K (13207) - RowsReturnedRate: 228.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:65 (host=d2419.halxg.cloudera.com:22000):(Total: 58s498ms, non-child: 7.255ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.38 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.17 MB (13814502) - PerHostPeakMemUsage: 422.26 MB (442774864) - RowsProduced: 100 (100) - TotalCpuTime: 15s117ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 135.658us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 320.104us - ExecTreeExecTime: 5.056us - OpenTime: 58s464ms - ExecTreeOpenTime: 57s796ms - PrepareTime: 33.274ms - ExecTreePrepareTime: 22.612ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 4.85 MB (5090304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 692.204ms, non-child: 692.204ms, % non-child: 100.00%) - CodegenTime: 2.384ms - CompileTime: 199.808ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 467.003ms - PrepareTime: 24.734ms DataStreamSender (dst_id=30):(Total: 107.814us, non-child: 107.814us, % non-child: 100.00%) - BytesSent: 2.20 KB (2256) - NetworkThroughput(*): 136.20 MB/sec - OverallThroughput: 19.96 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 80.416us - TransmitDataRPCTime: 15.796us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s798ms, non-child: 5.635ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.737ms - PeakMemoryUsage: 303.89 KB (311182) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s792ms, non-child: 5.685ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.16K (13156) - BuildTime: 9.791ms - PeakMemoryUsage: 10.81 MB (11333774) - ProbeRows: 13.12K (13117) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.198ms - RowsReturned: 91.07K (91072) - RowsReturnedRate: 1.57 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.544ms - BuildRowsPartitioned: 13.16K (13156) - GetNewBlockTime: 147.008us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.731ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s107ms, non-child: 1.782ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 197.37 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB, 394.74 KB - BytesReceived: 394.74 KB (404216) - ConvertRowBatchTime: 381.736us - DeserializeRowBatchTimer: 3.013ms - FirstBatchArrivalWaitTime: 15s090ms - PeakMemoryUsage: 0 - RowsReturned: 13.16K (13156) - RowsReturnedRate: 870.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s787ms, non-child: 1.693ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 505.91 KB (518056) - ConvertRowBatchTime: 462.808us - DeserializeRowBatchTimer: 3.465ms - FirstBatchArrivalWaitTime: 57s762ms - PeakMemoryUsage: 0 - RowsReturned: 13.12K (13117) - RowsReturnedRate: 226.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:62 (host=d2420.halxg.cloudera.com:22000):(Total: 58s498ms, non-child: 8.941ms, % non-child: 0.02%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 5.64 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 14.10 MB (14784462) - PerHostPeakMemUsage: 452.62 MB (474607649) - RowsProduced: 100 (100) - TotalCpuTime: 14s930ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 218.074us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 380.730us - ExecTreeExecTime: 8.100us - OpenTime: 58s457ms - ExecTreeOpenTime: 57s610ms - PrepareTime: 40.480ms - ExecTreePrepareTime: 28.268ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.57 MB (5843968) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 876.685ms, non-child: 876.685ms, % non-child: 100.00%) - CodegenTime: 2.081ms - CompileTime: 256.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 589.098ms - PrepareTime: 30.042ms DataStreamSender (dst_id=30):(Total: 113.878us, non-child: 113.878us, % non-child: 100.00%) - BytesSent: 2.14 KB (2196) - NetworkThroughput(*): 52.31 MB/sec - OverallThroughput: 18.39 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 60.280us - TransmitDataRPCTime: 40.036us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s612ms, non-child: 11.963ms, % non-child: 0.02%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 9.921ms - PeakMemoryUsage: 303.75 KB (311038) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s600ms, non-child: 10.733ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.49K (13489) - BuildTime: 14.577ms - PeakMemoryUsage: 10.81 MB (11333630) - ProbeRows: 13.46K (13462) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 6.804ms - RowsReturned: 93.49K (93487) - RowsReturnedRate: 1.62 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 7.224ms - BuildRowsPartitioned: 13.49K (13489) - GetNewBlockTime: 103.122us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.182ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 14s915ms, non-child: 8.686ms, % non-child: 0.06%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 202.27 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB, 404.53 KB - BytesReceived: 404.53 KB (414242) - ConvertRowBatchTime: 597.866us - DeserializeRowBatchTimer: 8.316ms - FirstBatchArrivalWaitTime: 14s902ms - PeakMemoryUsage: 0 - RowsReturned: 13.49K (13489) - RowsReturnedRate: 904.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s590ms, non-child: 5.479ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 519.38 KB (531843) - ConvertRowBatchTime: 576.112us - DeserializeRowBatchTimer: 10.370ms - FirstBatchArrivalWaitTime: 57s574ms - PeakMemoryUsage: 0 - RowsReturned: 13.46K (13462) - RowsReturnedRate: 233.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:5d (host=d2415.halxg.cloudera.com:22000):(Total: 58s498ms, non-child: 7.765ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.25 MB (13896761) - PerHostPeakMemUsage: 428.23 MB (449029818) - RowsProduced: 100 (100) - TotalCpuTime: 15s113ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 195.696us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 415.460us - ExecTreeExecTime: 27.704us - OpenTime: 58s465ms - ExecTreeOpenTime: 57s794ms - PrepareTime: 33.012ms - ExecTreePrepareTime: 22.465ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.57 MB (5843968) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 694.529ms, non-child: 694.529ms, % non-child: 100.00%) - CodegenTime: 1.845ms - CompileTime: 197.596ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 472.215ms - PrepareTime: 23.990ms DataStreamSender (dst_id=30):(Total: 79.164us, non-child: 79.164us, % non-child: 100.00%) - BytesSent: 2.20 KB (2253) - NetworkThroughput(*): 78.41 MB/sec - OverallThroughput: 27.14 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 41.120us - TransmitDataRPCTime: 27.404us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s795ms, non-child: 5.602ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.625ms - PeakMemoryUsage: 303.86 KB (311153) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s790ms, non-child: 6.216ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.18K (13177) - BuildTime: 9.595ms - PeakMemoryUsage: 10.81 MB (11333745) - ProbeRows: 13.14K (13136) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.471ms - RowsReturned: 91.27K (91271) - RowsReturnedRate: 1.58 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.435ms - BuildRowsPartitioned: 13.18K (13177) - GetNewBlockTime: 214.656us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.860ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s103ms, non-child: 2.304ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB, 395.84 KB - BytesReceived: 395.84 KB (405340) - ConvertRowBatchTime: 344.580us - DeserializeRowBatchTimer: 3.795ms - FirstBatchArrivalWaitTime: 15s089ms - PeakMemoryUsage: 0 - RowsReturned: 13.18K (13177) - RowsReturnedRate: 872.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s783ms, non-child: 2.441ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 506.74 KB (518901) - ConvertRowBatchTime: 508.444us - DeserializeRowBatchTimer: 4.207ms - FirstBatchArrivalWaitTime: 57s760ms - PeakMemoryUsage: 0 - RowsReturned: 13.14K (13136) - RowsReturnedRate: 227.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:5a (host=d2421.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 8.696ms, % non-child: 0.01%) MemoryUsage(1s000ms): 112.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.18 MB (13818709) - PerHostPeakMemUsage: 376.57 MB (394860975) - RowsProduced: 100 (100) - TotalCpuTime: 15s107ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 198.064us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 332.596us - ExecTreeExecTime: 4.880us - OpenTime: 58s463ms - ExecTreeOpenTime: 57s786ms - PrepareTime: 34.159ms - ExecTreePrepareTime: 22.269ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 62 (62) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.56 MB (5827584) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 700.602ms, non-child: 700.602ms, % non-child: 100.00%) - CodegenTime: 1.900ms - CompileTime: 196.989ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 478.628ms - PrepareTime: 24.368ms DataStreamSender (dst_id=30):(Total: 68.288us, non-child: 68.288us, % non-child: 100.00%) - BytesSent: 2.14 KB (2189) - NetworkThroughput(*): 87.16 MB/sec - OverallThroughput: 30.57 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 33.444us - TransmitDataRPCTime: 23.952us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s788ms, non-child: 5.430ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.412ms - PeakMemoryUsage: 304.81 KB (312124) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s783ms, non-child: 5.622ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.63K (12631) - BuildTime: 10.748ms - PeakMemoryUsage: 10.79 MB (11318332) - ProbeRows: 12.61K (12609) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.006ms - RowsReturned: 87.58K (87585) - RowsReturnedRate: 1.51 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.518ms - BuildRowsPartitioned: 12.63K (12631) - GetNewBlockTime: 149.272us - HashBuckets: 31.74K (31744) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.326ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s096ms, non-child: 1.845ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB, 378.70 KB - BytesReceived: 378.70 KB (387789) - ConvertRowBatchTime: 359.084us - DeserializeRowBatchTimer: 3.554ms - FirstBatchArrivalWaitTime: 15s082ms - PeakMemoryUsage: 0 - RowsReturned: 12.63K (12631) - RowsReturnedRate: 836.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s777ms, non-child: 1.633ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 486.93 KB (498613) - ConvertRowBatchTime: 389.436us - DeserializeRowBatchTimer: 3.874ms - FirstBatchArrivalWaitTime: 57s755ms - PeakMemoryUsage: 0 - RowsReturned: 12.61K (12609) - RowsReturnedRate: 218.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:59 (host=d2404.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 7.391ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.38 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.22 MB (13860682) - PerHostPeakMemUsage: 446.16 MB (467827573) - RowsProduced: 100 (100) - TotalCpuTime: 15s116ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 247.812us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 394.720us - ExecTreeExecTime: 4.788us - OpenTime: 58s464ms - ExecTreeOpenTime: 57s797ms - PrepareTime: 33.500ms - ExecTreePrepareTime: 22.543ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.57 MB (5843968) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 691.200ms, non-child: 691.200ms, % non-child: 100.00%) - CodegenTime: 1.870ms - CompileTime: 196.859ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 468.882ms - PrepareTime: 24.909ms DataStreamSender (dst_id=30):(Total: 76.352us, non-child: 76.352us, % non-child: 100.00%) - BytesSent: 2.18 KB (2236) - NetworkThroughput(*): 79.77 MB/sec - OverallThroughput: 27.93 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 39.224us - TransmitDataRPCTime: 26.732us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s799ms, non-child: 6.607ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 5.785ms - PeakMemoryUsage: 307.24 KB (314609) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s792ms, non-child: 6.515ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.13K (13133) - BuildTime: 10.489ms - PeakMemoryUsage: 10.81 MB (11337201) - ProbeRows: 13.08K (13079) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.835ms - RowsReturned: 90.85K (90851) - RowsReturnedRate: 1.57 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.538ms - BuildRowsPartitioned: 13.13K (13133) - GetNewBlockTime: 142.964us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.829ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s106ms, non-child: 1.903ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 196.83 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB, 393.67 KB - BytesReceived: 393.67 KB (403119) - ConvertRowBatchTime: 354.856us - DeserializeRowBatchTimer: 3.552ms - FirstBatchArrivalWaitTime: 15s093ms - PeakMemoryUsage: 0 - RowsReturned: 13.13K (13133) - RowsReturnedRate: 869.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s785ms, non-child: 2.029ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 505.37 KB (517495) - ConvertRowBatchTime: 354.816us - DeserializeRowBatchTimer: 4.939ms - FirstBatchArrivalWaitTime: 57s764ms - PeakMemoryUsage: 0 - RowsReturned: 13.08K (13079) - RowsReturnedRate: 226.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:64 (host=d2417.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 7.993ms, % non-child: 0.01%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.27 MB (13910842) - PerHostPeakMemUsage: 422.28 MB (442794776) - RowsProduced: 100 (100) - TotalCpuTime: 15s116ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 182.810us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 343.710us - ExecTreeExecTime: 5.090us - OpenTime: 58s463ms - ExecTreeOpenTime: 57s795ms - PrepareTime: 34.394ms - ExecTreePrepareTime: 22.986ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.17 MB (5417984) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 692.362ms, non-child: 692.362ms, % non-child: 100.00%) - CodegenTime: 1.855ms - CompileTime: 199.291ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 467.103ms - PrepareTime: 25.438ms DataStreamSender (dst_id=30):(Total: 75.070us, non-child: 75.070us, % non-child: 100.00%) - BytesSent: 2.19 KB (2238) - NetworkThroughput(*): 88.66 MB/sec - OverallThroughput: 28.43 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 40.062us - TransmitDataRPCTime: 24.072us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s797ms, non-child: 5.856ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.857ms - PeakMemoryUsage: 305.00 KB (312320) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s791ms, non-child: 5.728ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.89K (12888) - BuildTime: 10.177ms - PeakMemoryUsage: 10.81 MB (11334912) - ProbeRows: 12.86K (12859) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.991ms - RowsReturned: 89.37K (89368) - RowsReturnedRate: 1.55 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.492ms - BuildRowsPartitioned: 12.89K (12888) - GetNewBlockTime: 88.382us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.854ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s105ms, non-child: 1.870ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB, 387.12 KB - BytesReceived: 387.12 KB (396412) - ConvertRowBatchTime: 350.636us - DeserializeRowBatchTimer: 3.945ms - FirstBatchArrivalWaitTime: 15s088ms - PeakMemoryUsage: 0 - RowsReturned: 12.89K (12888) - RowsReturnedRate: 853.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s785ms, non-child: 2.716ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 496.59 KB (508507) - ConvertRowBatchTime: 483.894us - DeserializeRowBatchTimer: 3.516ms - FirstBatchArrivalWaitTime: 57s759ms - PeakMemoryUsage: 0 - RowsReturned: 12.86K (12859) - RowsReturnedRate: 222.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:58 (host=d2418.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 8.241ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.38 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.14 MB (13773550) - PerHostPeakMemUsage: 434.49 MB (455591858) - RowsProduced: 100 (100) - TotalCpuTime: 15s114ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 165.528us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 330.980us - ExecTreeExecTime: 21.912us - OpenTime: 58s462ms - ExecTreeOpenTime: 57s795ms - PrepareTime: 34.503ms - ExecTreePrepareTime: 22.787ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.57 MB (5843968) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 691.668ms, non-child: 691.668ms, % non-child: 100.00%) - CodegenTime: 1.838ms - CompileTime: 196.441ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 469.517ms - PrepareTime: 25.028ms DataStreamSender (dst_id=30):(Total: 74.060us, non-child: 74.060us, % non-child: 100.00%) - BytesSent: 2.20 KB (2253) - NetworkThroughput(*): 107.97 MB/sec - OverallThroughput: 29.01 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 43.408us - TransmitDataRPCTime: 19.900us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s797ms, non-child: 5.716ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.912ms - PeakMemoryUsage: 304.90 KB (312213) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s791ms, non-child: 5.637ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.04K (13041) - BuildTime: 9.374ms - PeakMemoryUsage: 10.81 MB (11334805) - ProbeRows: 12.99K (12988) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.009ms - RowsReturned: 90.27K (90271) - RowsReturnedRate: 1.56 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.109ms - BuildRowsPartitioned: 13.04K (13041) - GetNewBlockTime: 87.748us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.840ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s105ms, non-child: 1.802ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 195.74 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB, 391.47 KB - BytesReceived: 391.47 KB (400869) - ConvertRowBatchTime: 336.152us - DeserializeRowBatchTimer: 3.396ms - FirstBatchArrivalWaitTime: 15s092ms - PeakMemoryUsage: 0 - RowsReturned: 13.04K (13041) - RowsReturnedRate: 863.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s786ms, non-child: 1.188ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 501.04 KB (513063) - ConvertRowBatchTime: 355.568us - DeserializeRowBatchTimer: 3.568ms - FirstBatchArrivalWaitTime: 57s764ms - PeakMemoryUsage: 0 - RowsReturned: 12.99K (12988) - RowsReturnedRate: 224.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:5c (host=d2411.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 7.507ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.38 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.17 MB (13814564) - PerHostPeakMemUsage: 458.45 MB (480717922) - RowsProduced: 100 (100) - TotalCpuTime: 15s110ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 186.128us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 522.035us - ExecTreeExecTime: 5.340us - OpenTime: 58s464ms - ExecTreeOpenTime: 57s790ms - PrepareTime: 32.982ms - ExecTreePrepareTime: 22.450ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.06 MB (5303296) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 697.853ms, non-child: 697.853ms, % non-child: 100.00%) - CodegenTime: 1.873ms - CompileTime: 197.318ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 475.322ms - PrepareTime: 24.557ms DataStreamSender (dst_id=30):(Total: 77.728us, non-child: 77.728us, % non-child: 100.00%) - BytesSent: 2.20 KB (2253) - NetworkThroughput(*): 68.80 MB/sec - OverallThroughput: 27.64 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 35.756us - TransmitDataRPCTime: 31.232us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s792ms, non-child: 5.156ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.258ms - PeakMemoryUsage: 306.57 KB (313931) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s786ms, non-child: 5.539ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.48K (12480) - BuildTime: 8.614ms - PeakMemoryUsage: 10.81 MB (11336523) - ProbeRows: 12.46K (12460) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.071ms - RowsReturned: 86.58K (86584) - RowsReturnedRate: 1.50 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 3.653ms - BuildRowsPartitioned: 12.48K (12480) - GetNewBlockTime: 125.032us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.688ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s101ms, non-child: 1.838ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 187.26 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB, 374.51 KB - BytesReceived: 374.51 KB (383500) - ConvertRowBatchTime: 302.428us - DeserializeRowBatchTimer: 3.468ms - FirstBatchArrivalWaitTime: 15s085ms - PeakMemoryUsage: 0 - RowsReturned: 12.48K (12480) - RowsReturnedRate: 826.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s781ms, non-child: 1.307ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 480.27 KB (491796) - ConvertRowBatchTime: 368.160us - DeserializeRowBatchTimer: 3.518ms - FirstBatchArrivalWaitTime: 57s758ms - PeakMemoryUsage: 0 - RowsReturned: 12.46K (12460) - RowsReturnedRate: 215.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:57 (host=d2403.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 7.497ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.37 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.18 MB (13817540) - PerHostPeakMemUsage: 373.40 MB (391534926) - RowsProduced: 100 (100) - TotalCpuTime: 15s091ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 168.928us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 573.828us - ExecTreeExecTime: 26.044us - OpenTime: 58s464ms - ExecTreeOpenTime: 57s772ms - PrepareTime: 33.003ms - ExecTreePrepareTime: 22.497ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.21 MB (5467136) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 715.412ms, non-child: 715.412ms, % non-child: 100.00%) - CodegenTime: 1.858ms - CompileTime: 196.770ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 493.710ms - PrepareTime: 24.312ms DataStreamSender (dst_id=30):(Total: 63.988us, non-child: 63.988us, % non-child: 100.00%) - BytesSent: 2.21 KB (2258) - NetworkThroughput(*): 124.39 MB/sec - OverallThroughput: 33.65 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 36.020us - TransmitDataRPCTime: 17.312us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s774ms, non-child: 5.341ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.572ms - PeakMemoryUsage: 303.83 KB (311126) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s768ms, non-child: 5.743ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.32K (13316) - BuildTime: 8.917ms - PeakMemoryUsage: 10.79 MB (11317334) - ProbeRows: 13.28K (13279) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.086ms - RowsReturned: 92.10K (92104) - RowsReturnedRate: 1.59 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 3.915ms - BuildRowsPartitioned: 13.32K (13316) - GetNewBlockTime: 125.748us - HashBuckets: 31.74K (31744) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.472ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s082ms, non-child: 2.032ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 199.67 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB, 399.35 KB - BytesReceived: 399.35 KB (408931) - ConvertRowBatchTime: 334.448us - DeserializeRowBatchTimer: 3.153ms - FirstBatchArrivalWaitTime: 15s069ms - PeakMemoryUsage: 0 - RowsReturned: 13.32K (13316) - RowsReturnedRate: 882.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s763ms, non-child: 1.989ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 512.95 KB (525257) - ConvertRowBatchTime: 351.852us - DeserializeRowBatchTimer: 3.835ms - FirstBatchArrivalWaitTime: 57s741ms - PeakMemoryUsage: 0 - RowsReturned: 13.28K (13279) - RowsReturnedRate: 229.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:56 (host=d2402.halxg.cloudera.com:22000):(Total: 58s497ms, non-child: 7.254ms, % non-child: 0.01%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.14 MB (13781766) - PerHostPeakMemUsage: 470.56 MB (493413990) - RowsProduced: 100 (100) - TotalCpuTime: 15s107ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 184.592us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 362.696us - ExecTreeExecTime: 31.800us - OpenTime: 58s463ms - ExecTreeOpenTime: 57s789ms - PrepareTime: 33.269ms - ExecTreePrepareTime: 22.956ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.54 MB (5811200) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 697.919ms, non-child: 697.919ms, % non-child: 100.00%) - CodegenTime: 2.028ms - CompileTime: 199.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 473.347ms - PrepareTime: 24.883ms DataStreamSender (dst_id=30):(Total: 89.780us, non-child: 89.780us, % non-child: 100.00%) - BytesSent: 2.18 KB (2233) - NetworkThroughput(*): 61.24 MB/sec - OverallThroughput: 23.72 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 42.156us - TransmitDataRPCTime: 34.776us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s792ms, non-child: 5.605ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.617ms - PeakMemoryUsage: 313.68 KB (321212) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s786ms, non-child: 6.641ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.04K (13040) - BuildTime: 8.741ms - PeakMemoryUsage: 10.79 MB (11311036) - ProbeRows: 12.99K (12994) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.150ms - RowsReturned: 90.17K (90172) - RowsReturnedRate: 1.56 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 3.928ms - BuildRowsPartitioned: 13.04K (13040) - GetNewBlockTime: 80.840us - HashBuckets: 30.72K (30720) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.460ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s098ms, non-child: 2.586ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB, 391.82 KB - BytesReceived: 391.82 KB (401225) - ConvertRowBatchTime: 357.912us - DeserializeRowBatchTimer: 3.284ms - FirstBatchArrivalWaitTime: 15s085ms - PeakMemoryUsage: 0 - RowsReturned: 13.04K (13040) - RowsReturnedRate: 863.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s779ms, non-child: 2.103ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 502.29 KB (514346) - ConvertRowBatchTime: 406.844us - DeserializeRowBatchTimer: 4.262ms - FirstBatchArrivalWaitTime: 57s758ms - PeakMemoryUsage: 0 - RowsReturned: 12.99K (12994) - RowsReturnedRate: 224.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:60 (host=d2410.halxg.cloudera.com:22000):(Total: 58s496ms, non-child: 7.500ms, % non-child: 0.01%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.18 MB (13815042) - PerHostPeakMemUsage: 446.28 MB (467956828) - RowsProduced: 100 (100) - TotalCpuTime: 15s114ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 165.748us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 385.576us - ExecTreeExecTime: 5.436us - OpenTime: 58s464ms - ExecTreeOpenTime: 57s794ms - PrepareTime: 32.244ms - ExecTreePrepareTime: 22.245ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.17 MB (5417984) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 693.319ms, non-child: 693.319ms, % non-child: 100.00%) - CodegenTime: 1.806ms - CompileTime: 200.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 468.052ms - PrepareTime: 23.906ms DataStreamSender (dst_id=30):(Total: 70.240us, non-child: 70.240us, % non-child: 100.00%) - BytesSent: 2.19 KB (2238) - NetworkThroughput(*): 84.56 MB/sec - OverallThroughput: 30.39 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 34.092us - TransmitDataRPCTime: 25.240us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s796ms, non-child: 5.883ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 5.039ms - PeakMemoryUsage: 303.83 KB (311117) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s790ms, non-child: 5.983ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.86K (12860) - BuildTime: 10.468ms - PeakMemoryUsage: 10.81 MB (11333709) - ProbeRows: 12.83K (12828) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.060ms - RowsReturned: 88.87K (88872) - RowsReturnedRate: 1.54 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.805ms - BuildRowsPartitioned: 12.86K (12860) - GetNewBlockTime: 100.560us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.039ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s104ms, non-child: 1.581ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB, 385.80 KB - BytesReceived: 385.80 KB (395058) - ConvertRowBatchTime: 350.528us - DeserializeRowBatchTimer: 3.722ms - FirstBatchArrivalWaitTime: 15s088ms - PeakMemoryUsage: 0 - RowsReturned: 12.86K (12860) - RowsReturnedRate: 851.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s784ms, non-child: 1.557ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 495.57 KB (507459) - ConvertRowBatchTime: 410.596us - DeserializeRowBatchTimer: 4.026ms - FirstBatchArrivalWaitTime: 57s761ms - PeakMemoryUsage: 0 - RowsReturned: 12.83K (12828) - RowsReturnedRate: 221.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:5b (host=d2401.halxg.cloudera.com:22000):(Total: 58s496ms, non-child: 11.635ms, % non-child: 0.02%) MemoryUsage(1s000ms): 112.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB, 12.60 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.20 MB (13836723) - PerHostPeakMemUsage: 373.14 MB (391262307) - RowsProduced: 100 (100) - TotalCpuTime: 14s991ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 453.256us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 587.795us - ExecTreeExecTime: 5.053us - OpenTime: 58s438ms - ExecTreeOpenTime: 57s668ms - PrepareTime: 58.411ms - ExecTreePrepareTime: 42.230ms CodeGen:(Total: 814.140ms, non-child: 814.140ms, % non-child: 100.00%) - CodegenTime: 2.969ms - CompileTime: 219.128ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 546.448ms - PrepareTime: 47.758ms DataStreamSender (dst_id=30):(Total: 84.480us, non-child: 84.480us, % non-child: 100.00%) - BytesSent: 2.21 KB (2261) - NetworkThroughput(*): 56.14 MB/sec - OverallThroughput: 25.52 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 31.384us - TransmitDataRPCTime: 38.410us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s670ms, non-child: 5.649ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.877ms - PeakMemoryUsage: 303.92 KB (311214) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s665ms, non-child: 6.532ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.91K (12911) - BuildTime: 12.416ms - PeakMemoryUsage: 10.78 MB (11301038) - ProbeRows: 12.86K (12862) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.268ms - RowsReturned: 89.36K (89365) - RowsReturnedRate: 1.55 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.398ms - BuildRowsPartitioned: 12.91K (12911) - GetNewBlockTime: 162.989us - HashBuckets: 30.72K (30720) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.508ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 14s978ms, non-child: 2.117ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB, 387.33 KB - BytesReceived: 387.33 KB (396628) - ConvertRowBatchTime: 471.281us - DeserializeRowBatchTimer: 3.587ms - FirstBatchArrivalWaitTime: 14s964ms - PeakMemoryUsage: 0 - RowsReturned: 12.91K (12911) - RowsReturnedRate: 861.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s658ms, non-child: 1.688ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 496.18 KB (508093) - ConvertRowBatchTime: 336.449us - DeserializeRowBatchTimer: 3.651ms - FirstBatchArrivalWaitTime: 57s636ms - PeakMemoryUsage: 0 - RowsReturned: 12.86K (12862) - RowsReturnedRate: 223.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:61 (host=d2405.halxg.cloudera.com:22000):(Total: 58s496ms, non-child: 8.112ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.37 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.12 MB (13757089) - PerHostPeakMemUsage: 386.37 MB (405137773) - RowsProduced: 100 (100) - TotalCpuTime: 15s115ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 172.368us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 332.140us - ExecTreeExecTime: 24.716us - OpenTime: 58s462ms - ExecTreeOpenTime: 57s794ms - PrepareTime: 34.527ms - ExecTreePrepareTime: 23.236ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 133.56 MB (140045312) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 691.585ms, non-child: 691.585ms, % non-child: 100.00%) - CodegenTime: 2.066ms - CompileTime: 198.783ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 467.381ms - PrepareTime: 24.891ms DataStreamSender (dst_id=30):(Total: 67.976us, non-child: 67.976us, % non-child: 100.00%) - BytesSent: 2.18 KB (2236) - NetworkThroughput(*): 84.14 MB/sec - OverallThroughput: 31.37 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 31.668us - TransmitDataRPCTime: 25.344us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s796ms, non-child: 5.609ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.742ms - PeakMemoryUsage: 303.86 KB (311151) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s791ms, non-child: 6.640ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.98K (12982) - BuildTime: 10.979ms - PeakMemoryUsage: 10.79 MB (11317359) - ProbeRows: 12.95K (12954) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.364ms - RowsReturned: 89.98K (89982) - RowsReturnedRate: 1.56 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.925ms - BuildRowsPartitioned: 12.98K (12982) - GetNewBlockTime: 112.768us - HashBuckets: 31.74K (31744) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.263ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s104ms, non-child: 2.035ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 194.92 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB, 389.84 KB - BytesReceived: 389.84 KB (399199) - ConvertRowBatchTime: 323.452us - DeserializeRowBatchTimer: 3.677ms - FirstBatchArrivalWaitTime: 15s088ms - PeakMemoryUsage: 0 - RowsReturned: 12.98K (12982) - RowsReturnedRate: 859.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s784ms, non-child: 1.307ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 500.13 KB (512136) - ConvertRowBatchTime: 371.296us - DeserializeRowBatchTimer: 4.112ms - FirstBatchArrivalWaitTime: 57s760ms - PeakMemoryUsage: 0 - RowsReturned: 12.95K (12954) - RowsReturnedRate: 224.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:55 (host=d2414.halxg.cloudera.com:22000):(Total: 58s496ms, non-child: 7.364ms, % non-child: 0.01%) MemoryUsage(1s000ms): 120.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 6.37 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.20 MB (13839274) - PerHostPeakMemUsage: 452.28 MB (474247758) - RowsProduced: 100 (100) - TotalCpuTime: 15s108ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 194.556us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 353.978us - ExecTreeExecTime: 22.784us - OpenTime: 58s463ms - ExecTreeOpenTime: 57s789ms - PrepareTime: 32.731ms - ExecTreePrepareTime: 22.729ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 63 (63) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.56 MB (5827584) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 698.178ms, non-child: 698.178ms, % non-child: 100.00%) - CodegenTime: 1.842ms - CompileTime: 201.076ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 471.979ms - PrepareTime: 24.457ms DataStreamSender (dst_id=30):(Total: 73.576us, non-child: 73.576us, % non-child: 100.00%) - BytesSent: 2.17 KB (2218) - NetworkThroughput(*): 85.21 MB/sec - OverallThroughput: 28.75 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 37.314us - TransmitDataRPCTime: 24.824us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s791ms, non-child: 5.676ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.817ms - PeakMemoryUsage: 305.24 KB (312567) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s785ms, non-child: 5.506ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.00K (13001) - BuildTime: 9.895ms - PeakMemoryUsage: 10.79 MB (11318775) - ProbeRows: 12.96K (12959) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.137ms - RowsReturned: 89.90K (89903) - RowsReturnedRate: 1.55 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.027ms - BuildRowsPartitioned: 13.00K (13001) - GetNewBlockTime: 55.690us - HashBuckets: 31.74K (31744) - HashCollisions: 0 (0) - HashTablesBuildTime: 2.263ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s098ms, non-child: 2.304ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 195.28 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB, 390.56 KB - BytesReceived: 390.56 KB (399932) - ConvertRowBatchTime: 354.476us - DeserializeRowBatchTimer: 3.969ms - FirstBatchArrivalWaitTime: 15s086ms - PeakMemoryUsage: 0 - RowsReturned: 13.00K (13001) - RowsReturnedRate: 861.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s779ms, non-child: 1.689ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 500.91 KB (512927) - ConvertRowBatchTime: 344.698us - DeserializeRowBatchTimer: 3.954ms - FirstBatchArrivalWaitTime: 57s758ms - PeakMemoryUsage: 0 - RowsReturned: 12.96K (12959) - RowsReturnedRate: 224.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:5f (host=d2407.halxg.cloudera.com:22000):(Total: 58s496ms, non-child: 8.152ms, % non-child: 0.01%) MemoryUsage(1s000ms): 58.37 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB, 12.61 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.20 MB (13839297) - PerHostPeakMemUsage: 427.93 MB (448721364) - RowsProduced: 100 (100) - TotalCpuTime: 15s100ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 182.556us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 348.516us - ExecTreeExecTime: 19.644us - OpenTime: 58s460ms - ExecTreeOpenTime: 57s780ms - PrepareTime: 35.795ms - ExecTreePrepareTime: 24.889ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.04 MB (5286912) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 704.407ms, non-child: 704.407ms, % non-child: 100.00%) - CodegenTime: 1.809ms - CompileTime: 201.232ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 476.700ms - PrepareTime: 25.830ms DataStreamSender (dst_id=30):(Total: 72.908us, non-child: 72.908us, % non-child: 100.00%) - BytesSent: 2.17 KB (2227) - NetworkThroughput(*): 97.42 MB/sec - OverallThroughput: 29.13 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 39.532us - TransmitDataRPCTime: 21.800us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s783ms, non-child: 5.933ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.758ms - PeakMemoryUsage: 304.53 KB (311834) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s777ms, non-child: 7.258ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 13.15K (13151) - BuildTime: 9.678ms - PeakMemoryUsage: 10.79 MB (11318042) - ProbeRows: 13.12K (13122) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.178ms - RowsReturned: 91.10K (91101) - RowsReturnedRate: 1.58 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 4.596ms - BuildRowsPartitioned: 13.15K (13151) - GetNewBlockTime: 89.604us - HashBuckets: 31.74K (31744) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.691ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s090ms, non-child: 1.805ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 197.26 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB, 394.53 KB - BytesReceived: 394.53 KB (403999) - ConvertRowBatchTime: 357.100us - DeserializeRowBatchTimer: 3.544ms - FirstBatchArrivalWaitTime: 15s075ms - PeakMemoryUsage: 0 - RowsReturned: 13.15K (13151) - RowsReturnedRate: 871.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s770ms, non-child: 1.759ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 506.33 KB (518484) - ConvertRowBatchTime: 480.976us - DeserializeRowBatchTimer: 4.603ms - FirstBatchArrivalWaitTime: 57s746ms - PeakMemoryUsage: 0 - RowsReturned: 13.12K (13122) - RowsReturnedRate: 227.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:53 (host=d2406.halxg.cloudera.com:22000):(Total: 58s495ms, non-child: 7.677ms, % non-child: 0.01%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.19 MB (13830501) - PerHostPeakMemUsage: 404.25 MB (423884539) - RowsProduced: 100 (100) - TotalCpuTime: 15s109ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 200.680us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 565.046us - ExecTreeExecTime: 5.190us - OpenTime: 58s462ms - ExecTreeOpenTime: 57s790ms - PrepareTime: 33.570ms - ExecTreePrepareTime: 22.982ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 80 (80) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 133.57 MB (140061696) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 696.046ms, non-child: 696.046ms, % non-child: 100.00%) - CodegenTime: 1.876ms - CompileTime: 198.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 471.661ms - PrepareTime: 24.775ms DataStreamSender (dst_id=30):(Total: 70.054us, non-child: 70.054us, % non-child: 100.00%) - BytesSent: 2.07 KB (2123) - NetworkThroughput(*): 84.83 MB/sec - OverallThroughput: 28.90 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 34.352us - TransmitDataRPCTime: 23.866us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s792ms, non-child: 5.678ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 4.848ms - PeakMemoryUsage: 307.83 KB (315213) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s786ms, non-child: 5.563ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.93K (12933) - BuildTime: 9.063ms - PeakMemoryUsage: 10.81 MB (11337805) - ProbeRows: 12.91K (12906) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2.966ms - RowsReturned: 89.49K (89487) - RowsReturnedRate: 1.55 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 3.614ms - BuildRowsPartitioned: 12.93K (12933) - GetNewBlockTime: 50.042us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.652ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s100ms, non-child: 1.651ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB, 388.02 KB - BytesReceived: 388.02 KB (397328) - ConvertRowBatchTime: 296.648us - DeserializeRowBatchTimer: 3.277ms - FirstBatchArrivalWaitTime: 15s089ms - PeakMemoryUsage: 0 - RowsReturned: 12.93K (12933) - RowsReturnedRate: 856.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s780ms, non-child: 1.796ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 497.99 KB (509946) - ConvertRowBatchTime: 416.704us - DeserializeRowBatchTimer: 4.137ms - FirstBatchArrivalWaitTime: 57s760ms - PeakMemoryUsage: 0 - RowsReturned: 12.91K (12906) - RowsReturnedRate: 223.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:54 (host=d2413.halxg.cloudera.com:22000):(Total: 58s495ms, non-child: 7.203ms, % non-child: 0.01%) MemoryUsage(1s000ms): 116.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 124.73 KB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB, 12.63 MB ThreadUsage(1s000ms): 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 13.18 MB (13823763) - PerHostPeakMemUsage: 434.44 MB (455541136) - RowsProduced: 100 (100) - TotalCpuTime: 15s116ms - TotalNetworkReceiveTime: 1m12s - TotalNetworkSendTime: 411.248us - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 579.436us - ExecTreeExecTime: 4.428us - OpenTime: 58s461ms - ExecTreeOpenTime: 57s797ms - PrepareTime: 33.818ms - ExecTreePrepareTime: 23.137ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 272 (272) - BlocksRecycled: 64 (64) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 204.80 GB (219902328832) - PeakMemoryUsage: 5.57 MB (5843968) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 689.447ms, non-child: 689.447ms, % non-child: 100.00%) - CodegenTime: 2.268ms - CompileTime: 197.729ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 173 (173) - NumInstructions: 5.39K (5391) - OptimizationTime: 465.528ms - PrepareTime: 25.613ms DataStreamSender (dst_id=30):(Total: 64.227us, non-child: 64.227us, % non-child: 100.00%) - BytesSent: 2.18 KB (2235) - NetworkThroughput(*): 108.97 MB/sec - OverallThroughput: 33.19 MB/sec - RowsReturned: 100 (100) - SerializeBatchTime: 33.372us - TransmitDataRPCTime: 19.560us - UncompressedRowBatchSize: 27.64 KB (28304) SORT_NODE (id=17):(Total: 57s799ms, non-child: 6.276ms, % non-child: 0.01%) ExecOption: Codegen Disabled, Codegen Enabled - InsertBatchTime: 5.542ms - PeakMemoryUsage: 303.89 KB (311179) - RowsReturned: 100 (100) - RowsReturnedRate: 1.00 /sec HASH_JOIN_NODE (id=16):(Total: 57s792ms, non-child: 6.465ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 12.74K (12745) - BuildTime: 8.914ms - PeakMemoryUsage: 10.81 MB (11333771) - ProbeRows: 12.69K (12692) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3.879ms - RowsReturned: 88.13K (88127) - RowsReturnedRate: 1.52 K/sec Hash Join Builder (join_node_id=16): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 2 of 2 Runtime Filters Published - BuildRowsPartitionTime: 3.514ms - BuildRowsPartitioned: 12.74K (12745) - GetNewBlockTime: 127.068us - HashBuckets: 32.77K (32768) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.569ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=29):(Total: 15s107ms, non-child: 1.665ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB, 382.77 KB - BytesReceived: 382.77 KB (391953) - ConvertRowBatchTime: 294.136us - DeserializeRowBatchTimer: 4.021ms - FirstBatchArrivalWaitTime: 15s095ms - PeakMemoryUsage: 0 - RowsReturned: 12.74K (12745) - RowsReturnedRate: 843.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns EXCHANGE_NODE (id=28):(Total: 57s786ms, non-child: 1.187ms, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 490.90 KB (502679) - ConvertRowBatchTime: 343.724us - DeserializeRowBatchTimer: 4.130ms - FirstBatchArrivalWaitTime: 57s767ms - PeakMemoryUsage: 0 - RowsReturned: 12.69K (12692) - RowsReturnedRate: 219.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F02:(Total: 58s464ms, non-child: 5.990ms, % non-child: 0.01%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:58s480ms max:58s496ms mean: 58s484ms stddev:3.298ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 19 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.27 MB (17062835) - PerHostPeakMemUsage: 425.19 MB (445846248) - RowsProduced: 12.97K (12967) - TotalCpuTime: 3s872ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.230ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 19.101ms - ExecTreeExecTime: 3.548ms - OpenTime: 58s420ms - ExecTreeOpenTime: 57s803ms - PrepareTime: 43.473ms - ExecTreePrepareTime: 22.713ms CodeGen:(Total: 640.721ms, non-child: 640.721ms, % non-child: 100.00%) - CodegenTime: 3.670ms - CompileTime: 192.228ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 423.179ms - PrepareTime: 24.754ms DataStreamSender (dst_id=28):(Total: 8.627ms, non-child: 8.627ms, % non-child: 100.00%) - BytesSent: 500.61 KB (512620) - NetworkThroughput(*): 163.77 MB/sec - OverallThroughput: 57.56 MB/sec - RowsReturned: 12.97K (12967) - SerializeBatchTime: 5.097ms - TransmitDataRPCTime: 3.018ms - UncompressedRowBatchSize: 2.47 MB (2593731) HASH_JOIN_NODE (id=7):(Total: 57s808ms, non-child: 1.362ms, % non-child: 0.00%) - BuildRows: 1.35K (1350) - BuildTime: 2.355ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.99K (12986) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 475.748us - RowsReturned: 12.97K (12967) - RowsReturnedRate: 223.00 /sec Hash Join Builder (join_node_id=7): - BuildRowsPartitionTime: 223.335us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 87.933us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 131.654us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s932ms, non-child: 1s932ms, % non-child: 100.00%) - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 26.972us - DeserializeRowBatchTimer: 191.663us - FirstBatchArrivalWaitTime: 1s932ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 698.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s807ms, non-child: 1.998ms, % non-child: 0.00%) - BuildRows: 365 (365) - BuildTime: 2.131ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.32K (9321) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 647.497us - RowsReturned: 12.99K (12986) - RowsReturnedRate: 224.00 /sec Hash Join Builder (join_node_id=6): - BuildRowsPartitionTime: 32.130us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 105.972us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 210.790us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s934ms, non-child: 1s934ms, % non-child: 100.00%) - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 7.659us - DeserializeRowBatchTimer: 19.400us - FirstBatchArrivalWaitTime: 1s934ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s805ms, non-child: 15.010ms, % non-child: 0.03%) - BuildTime: 11.394ms - GetNewBlockTime: 190.933us - GetResultsTime: 954.412us - HTResizeTime: 1.615ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.97 MB (11506910) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.32K (9321) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.081us EXCHANGE_NODE (id=19):(Total: 57s790ms, non-child: 57s790ms, % non-child: 100.00%) - BytesReceived: 1.70 MB (1785230) - ConvertRowBatchTime: 2.497ms - DeserializeRowBatchTimer: 11.808ms - FirstBatchArrivalWaitTime: 45s585ms - PeakMemoryUsage: 0 - RowsReturned: 72.01K (72011) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F02: Instance 594518549f864a64:29 (host=d2419.halxg.cloudera.com:22000):(Total: 58s467ms, non-child: 4.183ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.76 MB, 7.78 MB, 10.98 MB, 16.26 MB, 16.22 MB, 16.22 MB, 16.27 MB, 16.32 MB, 16.32 MB, 16.32 MB, 16.32 MB, 16.32 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.41 MB (17212232) - PerHostPeakMemUsage: 422.26 MB (442774864) - RowsProduced: 12.52K (12522) - TotalCpuTime: 3s908ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.059ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.668ms - ExecTreeExecTime: 2.791ms - OpenTime: 58s429ms - ExecTreeOpenTime: 57s826ms - PrepareTime: 38.227ms - ExecTreePrepareTime: 21.293ms CodeGen:(Total: 624.960ms, non-child: 624.960ms, % non-child: 100.00%) - CodegenTime: 3.029ms - CompileTime: 191.938ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 409.664ms - PrepareTime: 22.849ms DataStreamSender (dst_id=28):(Total: 7.153ms, non-child: 7.153ms, % non-child: 100.00%) - BytesSent: 483.42 KB (495017) - NetworkThroughput(*): 183.64 MB/sec - OverallThroughput: 66.00 MB/sec - RowsReturned: 12.52K (12522) - SerializeBatchTime: 4.163ms - TransmitDataRPCTime: 2.570ms - UncompressedRowBatchSize: 2.39 MB (2505403) HASH_JOIN_NODE (id=7):(Total: 57s831ms, non-child: 1.283ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.471ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.53K (12529) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 416.332us - RowsReturned: 12.52K (12522) - RowsReturnedRate: 216.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 208.448us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 85.318us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 169.508us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s951ms, non-child: 45.172us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 34.016us - DeserializeRowBatchTimer: 172.510us - FirstBatchArrivalWaitTime: 1s950ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 691.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s829ms, non-child: 2.170ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.172ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.21K (9212) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 571.022us - RowsReturned: 12.53K (12529) - RowsReturnedRate: 216.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 24.792us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 120.674us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 125.116us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s952ms, non-child: 13.024us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.332us - DeserializeRowBatchTimer: 180.314us - FirstBatchArrivalWaitTime: 1s952ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s827ms, non-child: 14.842ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.591ms - GetNewBlockTime: 396.896us - GetResultsTime: 746.224us - HTResizeTime: 1.770ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11695968) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.21K (9212) - RowsReturnedRate: 159.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.020us EXCHANGE_NODE (id=19):(Total: 57s812ms, non-child: 11.383ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 84.22 KB, 87.44 KB, 433.24 KB, 1.18 MB, 1.46 MB, 1.50 MB, 1.55 MB, 1.59 MB, 1.59 MB, 1.59 MB, 1.59 MB, 1.59 MB - BytesReceived: 1.68 MB (1757238) - ConvertRowBatchTime: 4.761ms - DeserializeRowBatchTimer: 10.481ms - FirstBatchArrivalWaitTime: 45s604ms - PeakMemoryUsage: 0 - RowsReturned: 70.93K (70931) - RowsReturnedRate: 1.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:27 (host=d2416.halxg.cloudera.com:22000):(Total: 58s467ms, non-child: 3.702ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.61 MB, 7.77 MB, 7.79 MB, 16.28 MB, 16.28 MB, 16.32 MB, 16.32 MB, 16.32 MB, 16.32 MB, 16.32 MB, 16.32 MB, 16.32 MB ThreadUsage(1s000ms): 1, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.05 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.45 MB (17245000) - PerHostPeakMemUsage: 452.30 MB (474274611) - RowsProduced: 12.73K (12735) - TotalCpuTime: 3s917ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 2.799ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 18.252ms - ExecTreeExecTime: 3.542ms - OpenTime: 58s428ms - ExecTreeOpenTime: 57s830ms - PrepareTime: 38.709ms - ExecTreePrepareTime: 20.421ms CodeGen:(Total: 619.498ms, non-child: 619.498ms, % non-child: 100.00%) - CodegenTime: 3.084ms - CompileTime: 189.738ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 407.165ms - PrepareTime: 22.046ms DataStreamSender (dst_id=28):(Total: 8.465ms, non-child: 8.465ms, % non-child: 100.00%) - BytesSent: 491.93 KB (503737) - NetworkThroughput(*): 170.48 MB/sec - OverallThroughput: 56.75 MB/sec - RowsReturned: 12.73K (12735) - SerializeBatchTime: 5.138ms - TransmitDataRPCTime: 2.817ms - UncompressedRowBatchSize: 2.43 MB (2546799) HASH_JOIN_NODE (id=7):(Total: 57s835ms, non-child: 1.357ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.508ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.76K (12763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 445.244us - RowsReturned: 12.73K (12735) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 201.360us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 79.220us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.692us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s955ms, non-child: 37.784us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.496us - DeserializeRowBatchTimer: 169.592us - FirstBatchArrivalWaitTime: 1s955ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 690.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s834ms, non-child: 2.223ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.912ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.36K (9364) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 590.252us - RowsReturned: 12.76K (12763) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.384us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 79.044us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 169.104us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s957ms, non-child: 15.680us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 7.040us - DeserializeRowBatchTimer: 7.884us - FirstBatchArrivalWaitTime: 1s957ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s832ms, non-child: 15.534ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.775ms - GetNewBlockTime: 160.852us - GetResultsTime: 900.480us - HTResizeTime: 1.669ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.16 MB (11700778) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.36K (9364) - RowsReturnedRate: 161.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 932.000ns EXCHANGE_NODE (id=19):(Total: 57s816ms, non-child: 4.641ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42.34 KB, 84.69 KB, 213.79 KB, 1.06 MB, 1.48 MB, 1.52 MB, 1.57 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB - BytesReceived: 1.70 MB (1786344) - ConvertRowBatchTime: 1.852ms - DeserializeRowBatchTimer: 10.854ms - FirstBatchArrivalWaitTime: 45s607ms - PeakMemoryUsage: 0 - RowsReturned: 72.07K (72068) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:28 (host=d2417.halxg.cloudera.com:22000):(Total: 58s466ms, non-child: 5.735ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.61 MB, 7.76 MB, 7.79 MB, 15.74 MB, 15.77 MB, 15.77 MB, 15.76 MB, 15.75 MB, 15.75 MB, 15.75 MB, 15.75 MB, 15.75 MB ThreadUsage(1s000ms): 1, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.05 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 15.97 MB (16745288) - PerHostPeakMemUsage: 422.28 MB (442794776) - RowsProduced: 12.85K (12847) - TotalCpuTime: 3s894ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.208ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 19.105ms - ExecTreeExecTime: 3.339ms - OpenTime: 58s426ms - ExecTreeOpenTime: 57s818ms - PrepareTime: 40.803ms - ExecTreePrepareTime: 20.936ms CodeGen:(Total: 629.579ms, non-child: 629.579ms, % non-child: 100.00%) - CodegenTime: 3.344ms - CompileTime: 193.427ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 412.814ms - PrepareTime: 22.765ms DataStreamSender (dst_id=28):(Total: 8.231ms, non-child: 8.231ms, % non-child: 100.00%) - BytesSent: 496.32 KB (508235) - NetworkThroughput(*): 182.66 MB/sec - OverallThroughput: 58.88 MB/sec - RowsReturned: 12.85K (12847) - SerializeBatchTime: 5.100ms - TransmitDataRPCTime: 2.653ms - UncompressedRowBatchSize: 2.45 MB (2570167) HASH_JOIN_NODE (id=7):(Total: 57s823ms, non-child: 1.425ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.188ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.88K (12880) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 457.490us - RowsReturned: 12.85K (12847) - RowsReturnedRate: 222.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 218.550us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 82.522us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 109.934us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s944ms, non-child: 37.974us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.570us - DeserializeRowBatchTimer: 176.314us - FirstBatchArrivalWaitTime: 1s943ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 694.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s822ms, non-child: 1.910ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.980ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.26K (9256) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 654.414us - RowsReturned: 12.88K (12880) - RowsReturnedRate: 222.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.168us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 222.946us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 152.518us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s945ms, non-child: 16.792us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.736us - DeserializeRowBatchTimer: 7.000us - FirstBatchArrivalWaitTime: 1s945ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s820ms, non-child: 13.842ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.401ms - GetNewBlockTime: 223.228us - GetResultsTime: 937.322us - HTResizeTime: 1.266ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.68 MB (11198644) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.26K (9256) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.136us EXCHANGE_NODE (id=19):(Total: 57s806ms, non-child: 4.717ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 41.89 KB, 83.79 KB, 214.42 KB, 1.05 MB, 1.46 MB, 1.51 MB, 1.56 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB - BytesReceived: 1.69 MB (1771867) - ConvertRowBatchTime: 1.760ms - DeserializeRowBatchTimer: 10.996ms - FirstBatchArrivalWaitTime: 45s596ms - PeakMemoryUsage: 0 - RowsReturned: 71.53K (71534) - RowsReturnedRate: 1.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:26 (host=d2420.halxg.cloudera.com:22000):(Total: 58s466ms, non-child: 1.905ms, % non-child: 0.00%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.77 MB, 7.77 MB, 7.74 MB, 16.28 MB, 16.29 MB, 16.33 MB, 16.32 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.46 MB (17261384) - PerHostPeakMemUsage: 452.62 MB (474607649) - RowsProduced: 12.88K (12876) - TotalCpuTime: 3s655ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.222ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 27.890ms - ExecTreeExecTime: 5.767ms - OpenTime: 58s414ms - ExecTreeOpenTime: 57s698ms - PrepareTime: 52.109ms - ExecTreePrepareTime: 27.588ms CodeGen:(Total: 744.636ms, non-child: 744.636ms, % non-child: 100.00%) - CodegenTime: 4.713ms - CompileTime: 202.780ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 511.227ms - PrepareTime: 29.931ms DataStreamSender (dst_id=28):(Total: 13.613ms, non-child: 13.613ms, % non-child: 100.00%) - BytesSent: 497.54 KB (509486) - NetworkThroughput(*): 110.18 MB/sec - OverallThroughput: 35.69 MB/sec - RowsReturned: 12.88K (12876) - SerializeBatchTime: 8.529ms - TransmitDataRPCTime: 4.409ms - UncompressedRowBatchSize: 2.46 MB (2575765) HASH_JOIN_NODE (id=7):(Total: 57s706ms, non-child: 2.020ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.843ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.90K (12904) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 741.476us - RowsReturned: 12.88K (12876) - RowsReturnedRate: 223.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 398.668us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 139.900us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 263.480us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s823ms, non-child: 64.116us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 45.612us - DeserializeRowBatchTimer: 296.800us - FirstBatchArrivalWaitTime: 1s823ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 740.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s704ms, non-child: 2.748ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 3.256ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.34K (9344) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1.169ms - RowsReturned: 12.90K (12904) - RowsReturnedRate: 223.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 50.236us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 152.204us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 258.176us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s825ms, non-child: 25.300us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 13.230us - DeserializeRowBatchTimer: 15.496us - FirstBatchArrivalWaitTime: 1s825ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 199.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s701ms, non-child: 21.651ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 16.137ms - GetNewBlockTime: 212.192us - GetResultsTime: 1.876ms - HTResizeTime: 2.763ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.16 MB (11697728) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.34K (9344) - RowsReturnedRate: 161.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.238us EXCHANGE_NODE (id=19):(Total: 57s679ms, non-child: 7.409ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 85.18 KB, 85.18 KB, 287.78 KB, 1.14 MB, 1.48 MB, 1.52 MB, 1.57 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB - BytesReceived: 1.70 MB (1785938) - ConvertRowBatchTime: 2.605ms - DeserializeRowBatchTimer: 20.723ms - FirstBatchArrivalWaitTime: 45s477ms - PeakMemoryUsage: 0 - RowsReturned: 72.01K (72006) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:25 (host=d2405.halxg.cloudera.com:22000):(Total: 58s466ms, non-child: 5.536ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.78 MB, 7.78 MB, 8.11 MB, 16.04 MB, 16.28 MB, 16.26 MB, 16.26 MB, 16.26 MB, 16.26 MB, 16.26 MB, 16.26 MB, 16.26 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.50 MB (17302344) - PerHostPeakMemUsage: 386.37 MB (405137773) - RowsProduced: 13.33K (13329) - TotalCpuTime: 3s881ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 2.478ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 16.997ms - ExecTreeExecTime: 3.427ms - OpenTime: 58s426ms - ExecTreeOpenTime: 57s811ms - PrepareTime: 40.321ms - ExecTreePrepareTime: 20.795ms CodeGen:(Total: 636.224ms, non-child: 636.224ms, % non-child: 100.00%) - CodegenTime: 3.254ms - CompileTime: 192.376ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 420.162ms - PrepareTime: 23.108ms DataStreamSender (dst_id=28):(Total: 8.090ms, non-child: 8.090ms, % non-child: 100.00%) - BytesSent: 515.29 KB (527659) - NetworkThroughput(*): 161.40 MB/sec - OverallThroughput: 62.20 MB/sec - RowsReturned: 13.33K (13329) - SerializeBatchTime: 4.519ms - TransmitDataRPCTime: 3.117ms - UncompressedRowBatchSize: 2.54 MB (2665884) HASH_JOIN_NODE (id=7):(Total: 57s816ms, non-child: 1.376ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.153ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.35K (13346) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 413.624us - RowsReturned: 13.33K (13329) - RowsReturnedRate: 230.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 231.136us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 95.436us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 121.332us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s937ms, non-child: 35.344us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.052us - DeserializeRowBatchTimer: 218.584us - FirstBatchArrivalWaitTime: 1s937ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 696.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s815ms, non-child: 1.588ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.907ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.41K (9408) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 583.020us - RowsReturned: 13.35K (13346) - RowsReturnedRate: 230.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.540us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 90.224us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 165.180us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s939ms, non-child: 14.060us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 7.144us - DeserializeRowBatchTimer: 10.112us - FirstBatchArrivalWaitTime: 1s939ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s813ms, non-child: 16.125ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 12.590ms - GetNewBlockTime: 160.496us - GetResultsTime: 773.480us - HTResizeTime: 2.335ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11691872) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.41K (9408) - RowsReturnedRate: 162.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 836.000ns EXCHANGE_NODE (id=19):(Total: 57s797ms, non-child: 8.757ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 86.28 KB, 86.28 KB, 314.03 KB, 1.16 MB, 1.49 MB, 1.53 MB, 1.58 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB - BytesReceived: 1.72 MB (1802877) - ConvertRowBatchTime: 3.350ms - DeserializeRowBatchTimer: 11.949ms - FirstBatchArrivalWaitTime: 45s591ms - PeakMemoryUsage: 0 - RowsReturned: 72.70K (72699) - RowsReturnedRate: 1.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:24 (host=d2410.halxg.cloudera.com:22000):(Total: 58s465ms, non-child: 28.431ms, % non-child: 0.05%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 2.41 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.60 MB, 7.76 MB, 7.78 MB, 15.80 MB, 15.74 MB, 15.76 MB, 15.76 MB, 15.75 MB, 15.75 MB, 15.75 MB, 15.75 MB, 15.75 MB ThreadUsage(1s000ms): 1, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 15.93 MB (16704328) - PerHostPeakMemUsage: 446.28 MB (467956828) - RowsProduced: 12.66K (12660) - TotalCpuTime: 3s866ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.250ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 18.496ms - ExecTreeExecTime: 3.307ms - OpenTime: 58s403ms - ExecTreeOpenTime: 57s804ms - PrepareTime: 62.674ms - ExecTreePrepareTime: 20.457ms CodeGen:(Total: 620.587ms, non-child: 620.587ms, % non-child: 100.00%) - CodegenTime: 3.049ms - CompileTime: 186.531ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 411.342ms - PrepareTime: 22.131ms DataStreamSender (dst_id=28):(Total: 8.243ms, non-child: 8.243ms, % non-child: 100.00%) - BytesSent: 488.41 KB (500135) - NetworkThroughput(*): 169.45 MB/sec - OverallThroughput: 57.86 MB/sec - RowsReturned: 12.66K (12660) - SerializeBatchTime: 4.894ms - TransmitDataRPCTime: 2.814ms - UncompressedRowBatchSize: 2.42 MB (2532314) HASH_JOIN_NODE (id=7):(Total: 57s808ms, non-child: 1.327ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 1.971ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.68K (12681) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 450.772us - RowsReturned: 12.66K (12660) - RowsReturnedRate: 218.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 190.328us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 90.020us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 105.912us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s930ms, non-child: 36.760us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.288us - DeserializeRowBatchTimer: 158.068us - FirstBatchArrivalWaitTime: 1s930ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 699.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s807ms, non-child: 2.123ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.701ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.22K (9223) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 615.204us - RowsReturned: 12.68K (12681) - RowsReturnedRate: 219.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.936us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 63.124us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 130.836us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s932ms, non-child: 14.980us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.612us - DeserializeRowBatchTimer: 19.328us - FirstBatchArrivalWaitTime: 1s932ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s805ms, non-child: 13.646ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.326ms - GetNewBlockTime: 186.240us - GetResultsTime: 923.796us - HTResizeTime: 1.074ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.66 MB (11174050) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.22K (9223) - RowsReturnedRate: 159.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 972.000ns EXCHANGE_NODE (id=19):(Total: 57s791ms, non-child: 4.518ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 41.60 KB, 83.21 KB, 213.85 KB, 1.01 MB, 1.42 MB, 1.51 MB, 1.56 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB - BytesReceived: 1.69 MB (1769076) - ConvertRowBatchTime: 1.823ms - DeserializeRowBatchTimer: 10.761ms - FirstBatchArrivalWaitTime: 45s584ms - PeakMemoryUsage: 0 - RowsReturned: 71.35K (71349) - RowsReturnedRate: 1.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:23 (host=d2407.halxg.cloudera.com:22000):(Total: 58s465ms, non-child: 5.540ms, % non-child: 0.01%) MemoryUsage(1s000ms): 1.20 MB, 2.41 MB, 2.41 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.61 MB, 7.77 MB, 7.79 MB, 16.04 MB, 16.24 MB, 16.26 MB, 16.28 MB, 16.25 MB, 16.25 MB, 16.25 MB, 16.25 MB, 16.25 MB ThreadUsage(1s000ms): 1, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.45 MB (17253192) - PerHostPeakMemUsage: 427.93 MB (448721364) - RowsProduced: 12.71K (12711) - TotalCpuTime: 3s905ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 2.811ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 19.310ms - ExecTreeExecTime: 3.481ms - OpenTime: 58s424ms - ExecTreeOpenTime: 57s822ms - PrepareTime: 41.063ms - ExecTreePrepareTime: 20.680ms CodeGen:(Total: 624.055ms, non-child: 624.055ms, % non-child: 100.00%) - CodegenTime: 4.047ms - CompileTime: 186.639ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 414.176ms - PrepareTime: 22.711ms DataStreamSender (dst_id=28):(Total: 8.456ms, non-child: 8.456ms, % non-child: 100.00%) - BytesSent: 489.36 KB (501103) - NetworkThroughput(*): 167.28 MB/sec - OverallThroughput: 56.51 MB/sec - RowsReturned: 12.71K (12711) - SerializeBatchTime: 5.123ms - TransmitDataRPCTime: 2.856ms - UncompressedRowBatchSize: 2.42 MB (2542146) HASH_JOIN_NODE (id=7):(Total: 57s827ms, non-child: 1.467ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 1.951ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.75K (12746) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 595.720us - RowsReturned: 12.71K (12711) - RowsReturnedRate: 219.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 199.484us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 84.984us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 87.276us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s949ms, non-child: 38.116us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 24.036us - DeserializeRowBatchTimer: 356.084us - FirstBatchArrivalWaitTime: 1s948ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 692.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s825ms, non-child: 1.899ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.635ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.26K (9263) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 697.700us - RowsReturned: 12.75K (12746) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.768us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 61.656us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 114.696us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s952ms, non-child: 15.292us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.848us - DeserializeRowBatchTimer: 11.004us - FirstBatchArrivalWaitTime: 1s951ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s823ms, non-child: 13.488ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.262ms - GetNewBlockTime: 131.896us - GetResultsTime: 905.720us - HTResizeTime: 1.059ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.16 MB (11700656) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.26K (9263) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.472us EXCHANGE_NODE (id=19):(Total: 57s810ms, non-child: 5.207ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 85.04 KB, 128.29 KB, 496.06 KB, 1.24 MB, 1.51 MB, 1.51 MB, 1.58 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB, 1.60 MB - BytesReceived: 1.69 MB (1771547) - ConvertRowBatchTime: 1.843ms - DeserializeRowBatchTimer: 10.483ms - FirstBatchArrivalWaitTime: 45s603ms - PeakMemoryUsage: 0 - RowsReturned: 71.51K (71513) - RowsReturnedRate: 1.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:22 (host=d2409.halxg.cloudera.com:22000):(Total: 58s464ms, non-child: 4.560ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.78 MB, 7.78 MB, 10.76 MB, 16.27 MB, 16.32 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.45 MB (17245000) - PerHostPeakMemUsage: 416.66 MB (436898048) - RowsProduced: 13.24K (13237) - TotalCpuTime: 3s919ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 2.868ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 20.043ms - ExecTreeExecTime: 3.634ms - OpenTime: 58s424ms - ExecTreeOpenTime: 57s827ms - PrepareTime: 40.576ms - ExecTreePrepareTime: 20.263ms CodeGen:(Total: 618.180ms, non-child: 618.180ms, % non-child: 100.00%) - CodegenTime: 5.264ms - CompileTime: 185.055ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 410.265ms - PrepareTime: 22.316ms DataStreamSender (dst_id=28):(Total: 9.765ms, non-child: 9.765ms, % non-child: 100.00%) - BytesSent: 510.14 KB (522387) - NetworkThroughput(*): 160.88 MB/sec - OverallThroughput: 51.01 MB/sec - RowsReturned: 13.24K (13237) - SerializeBatchTime: 6.182ms - TransmitDataRPCTime: 3.096ms - UncompressedRowBatchSize: 2.52 MB (2647487) HASH_JOIN_NODE (id=7):(Total: 57s832ms, non-child: 1.455ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.738ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.27K (13265) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 464.128us - RowsReturned: 13.24K (13237) - RowsReturnedRate: 228.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 285.320us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 103.800us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 113.044us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s956ms, non-child: 36.728us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.152us - DeserializeRowBatchTimer: 189.916us - FirstBatchArrivalWaitTime: 1s955ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 690.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s830ms, non-child: 1.800ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.936ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.53K (9526) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 676.576us - RowsReturned: 13.27K (13265) - RowsReturnedRate: 229.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.016us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 71.000us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 173.240us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s958ms, non-child: 15.888us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.748us - DeserializeRowBatchTimer: 8.055us - FirstBatchArrivalWaitTime: 1s957ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s829ms, non-child: 14.647ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.123ms - GetNewBlockTime: 148.780us - GetResultsTime: 962.624us - HTResizeTime: 1.642ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11691872) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.53K (9526) - RowsReturnedRate: 164.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 960.000ns EXCHANGE_NODE (id=19):(Total: 57s814ms, non-child: 4.716ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 87.41 KB, 87.41 KB, 393.10 KB, 1.18 MB, 1.50 MB, 1.54 MB, 1.59 MB, 1.64 MB, 1.64 MB, 1.64 MB, 1.64 MB, 1.64 MB - BytesReceived: 1.73 MB (1811955) - ConvertRowBatchTime: 1.880ms - DeserializeRowBatchTimer: 11.029ms - FirstBatchArrivalWaitTime: 45s608ms - PeakMemoryUsage: 0 - RowsReturned: 73.11K (73108) - RowsReturnedRate: 1.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:21 (host=d2415.halxg.cloudera.com:22000):(Total: 58s464ms, non-child: 4.881ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.77 MB, 7.78 MB, 8.28 MB, 16.28 MB, 16.28 MB, 16.32 MB, 16.32 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.45 MB (17253192) - PerHostPeakMemUsage: 428.23 MB (449029818) - RowsProduced: 12.97K (12969) - TotalCpuTime: 3s902ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.297ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 20.676ms - ExecTreeExecTime: 3.748ms - OpenTime: 58s424ms - ExecTreeOpenTime: 57s819ms - PrepareTime: 39.724ms - ExecTreePrepareTime: 20.287ms CodeGen:(Total: 625.575ms, non-child: 625.575ms, % non-child: 100.00%) - CodegenTime: 3.619ms - CompileTime: 189.647ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 413.069ms - PrepareTime: 22.322ms DataStreamSender (dst_id=28):(Total: 8.721ms, non-child: 8.721ms, % non-child: 100.00%) - BytesSent: 499.57 KB (511561) - NetworkThroughput(*): 156.28 MB/sec - OverallThroughput: 55.94 MB/sec - RowsReturned: 12.97K (12969) - SerializeBatchTime: 5.107ms - TransmitDataRPCTime: 3.121ms - UncompressedRowBatchSize: 2.47 MB (2593853) HASH_JOIN_NODE (id=7):(Total: 57s824ms, non-child: 1.386ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.005ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.98K (12983) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 513.464us - RowsReturned: 12.97K (12969) - RowsReturnedRate: 224.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 221.412us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 72.044us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 99.328us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s947ms, non-child: 32.695us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 24.000us - DeserializeRowBatchTimer: 165.084us - FirstBatchArrivalWaitTime: 1s947ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 693.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s823ms, non-child: 1.765ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.702ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.40K (9397) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 670.220us - RowsReturned: 12.98K (12983) - RowsReturnedRate: 224.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.256us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 57.124us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 108.392us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s950ms, non-child: 13.908us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.752us - DeserializeRowBatchTimer: 8.020us - FirstBatchArrivalWaitTime: 1s950ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s821ms, non-child: 14.863ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.311ms - GetNewBlockTime: 140.332us - GetResultsTime: 993.264us - HTResizeTime: 1.489ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.16 MB (11697972) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.40K (9397) - RowsReturnedRate: 162.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 844.000ns EXCHANGE_NODE (id=19):(Total: 57s806ms, non-child: 4.376ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 60.23 KB, 87.66 KB, 266.93 KB, 1.13 MB, 1.50 MB, 1.54 MB, 1.59 MB, 1.64 MB, 1.64 MB, 1.64 MB, 1.64 MB, 1.64 MB - BytesReceived: 1.73 MB (1812301) - ConvertRowBatchTime: 1.724ms - DeserializeRowBatchTimer: 11.927ms - FirstBatchArrivalWaitTime: 45s601ms - PeakMemoryUsage: 0 - RowsReturned: 73.12K (73121) - RowsReturnedRate: 1.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:1e (host=d2421.halxg.cloudera.com:22000):(Total: 58s463ms, non-child: 5.849ms, % non-child: 0.01%) MemoryUsage(1s000ms): 1.24 MB, 2.41 MB, 2.41 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.61 MB, 7.77 MB, 7.75 MB, 15.25 MB, 15.28 MB, 15.25 MB, 15.29 MB, 15.25 MB, 15.25 MB, 15.25 MB, 15.25 MB, 15.25 MB ThreadUsage(1s000ms): 1, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 15.45 MB (16204616) - PerHostPeakMemUsage: 376.57 MB (394860975) - RowsProduced: 13.70K (13699) - TotalCpuTime: 3s886ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 4.483ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 19.426ms - ExecTreeExecTime: 3.453ms - OpenTime: 58s422ms - ExecTreeOpenTime: 57s809ms - PrepareTime: 41.581ms - ExecTreePrepareTime: 20.909ms CodeGen:(Total: 634.805ms, non-child: 634.805ms, % non-child: 100.00%) - CodegenTime: 3.382ms - CompileTime: 187.566ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 423.732ms - PrepareTime: 22.956ms DataStreamSender (dst_id=28):(Total: 8.478ms, non-child: 8.478ms, % non-child: 100.00%) - BytesSent: 528.40 KB (541079) - NetworkThroughput(*): 173.09 MB/sec - OverallThroughput: 60.86 MB/sec - RowsReturned: 13.70K (13699) - SerializeBatchTime: 4.944ms - TransmitDataRPCTime: 2.981ms - UncompressedRowBatchSize: 2.61 MB (2739951) HASH_JOIN_NODE (id=7):(Total: 57s814ms, non-child: 949.204us, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.244ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.71K (13713) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 491.984us - RowsReturned: 13.70K (13699) - RowsReturnedRate: 236.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 210.192us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 93.480us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 182.872us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s939ms, non-child: 47.152us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 31.220us - DeserializeRowBatchTimer: 221.856us - FirstBatchArrivalWaitTime: 1s938ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 696.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s813ms, non-child: 1.910ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.251ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.37K (9368) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 642.204us - RowsReturned: 13.71K (13713) - RowsReturnedRate: 237.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 32.624us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 114.064us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 193.352us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s942ms, non-child: 16.172us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.856us - DeserializeRowBatchTimer: 8.748us - FirstBatchArrivalWaitTime: 1s941ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s811ms, non-child: 14.628ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 10.948ms - GetNewBlockTime: 157.440us - GetResultsTime: 968.012us - HTResizeTime: 1.602ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.16 MB (10651488) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.37K (9368) - RowsReturnedRate: 162.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.300us EXCHANGE_NODE (id=19):(Total: 57s797ms, non-child: 5.084ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42.36 KB, 84.72 KB, 217.12 KB, 987.52 KB, 1.44 MB, 1.53 MB, 1.58 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB - BytesReceived: 1.72 MB (1800969) - ConvertRowBatchTime: 1.813ms - DeserializeRowBatchTimer: 10.705ms - FirstBatchArrivalWaitTime: 45s592ms - PeakMemoryUsage: 0 - RowsReturned: 72.64K (72645) - RowsReturnedRate: 1.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:20 (host=d2411.halxg.cloudera.com:22000):(Total: 58s463ms, non-child: 3.772ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.76 MB, 7.76 MB, 11.23 MB, 15.79 MB, 15.81 MB, 15.78 MB, 15.78 MB, 15.77 MB, 15.77 MB, 15.77 MB, 15.77 MB, 15.77 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 15.94 MB (16712520) - PerHostPeakMemUsage: 458.45 MB (480717922) - RowsProduced: 12.73K (12729) - TotalCpuTime: 3s880ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 2.840ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 18.364ms - ExecTreeExecTime: 3.378ms - OpenTime: 58s422ms - ExecTreeOpenTime: 57s807ms - PrepareTime: 41.178ms - ExecTreePrepareTime: 22.465ms CodeGen:(Total: 638.346ms, non-child: 638.346ms, % non-child: 100.00%) - CodegenTime: 3.090ms - CompileTime: 195.026ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 417.725ms - PrepareTime: 25.082ms DataStreamSender (dst_id=28):(Total: 8.853ms, non-child: 8.853ms, % non-child: 100.00%) - BytesSent: 492.57 KB (504391) - NetworkThroughput(*): 152.96 MB/sec - OverallThroughput: 54.33 MB/sec - RowsReturned: 12.73K (12729) - SerializeBatchTime: 5.228ms - TransmitDataRPCTime: 3.144ms - UncompressedRowBatchSize: 2.43 MB (2546190) HASH_JOIN_NODE (id=7):(Total: 57s812ms, non-child: 1.348ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.310ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.75K (12750) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 482.156us - RowsReturned: 12.73K (12729) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 230.896us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 77.344us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 146.784us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s937ms, non-child: 35.896us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.956us - DeserializeRowBatchTimer: 215.240us - FirstBatchArrivalWaitTime: 1s936ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 696.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s811ms, non-child: 1.910ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.980ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.15K (9155) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 648.752us - RowsReturned: 12.75K (12750) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.276us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 96.796us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 129.943us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s939ms, non-child: 15.540us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 7.120us - DeserializeRowBatchTimer: 10.704us - FirstBatchArrivalWaitTime: 1s938ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s809ms, non-child: 13.252ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 9.906ms - GetNewBlockTime: 150.116us - GetResultsTime: 861.064us - HTResizeTime: 1.169ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.68 MB (11200352) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.15K (9155) - RowsReturnedRate: 158.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.024us EXCHANGE_NODE (id=19):(Total: 57s796ms, non-child: 7.889ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 83.37 KB, 83.37 KB, 433.14 KB, 1.18 MB, 1.45 MB, 1.49 MB, 1.54 MB, 1.59 MB, 1.59 MB, 1.59 MB, 1.59 MB, 1.59 MB - BytesReceived: 1.67 MB (1756311) - ConvertRowBatchTime: 2.944ms - DeserializeRowBatchTimer: 10.270ms - FirstBatchArrivalWaitTime: 45s589ms - PeakMemoryUsage: 0 - RowsReturned: 70.76K (70761) - RowsReturnedRate: 1.22 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:1b (host=d2403.halxg.cloudera.com:22000):(Total: 58s463ms, non-child: 5.698ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.78 MB, 7.78 MB, 12.06 MB, 16.32 MB, 16.30 MB, 16.28 MB, 16.28 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.46 MB (17261384) - PerHostPeakMemUsage: 373.40 MB (391534926) - RowsProduced: 13.20K (13200) - TotalCpuTime: 3s885ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.026ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 17.275ms - ExecTreeExecTime: 2.886ms - OpenTime: 58s423ms - ExecTreeOpenTime: 57s808ms - PrepareTime: 40.056ms - ExecTreePrepareTime: 21.148ms CodeGen:(Total: 636.427ms, non-child: 636.427ms, % non-child: 100.00%) - CodegenTime: 3.660ms - CompileTime: 190.442ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 422.583ms - PrepareTime: 22.891ms DataStreamSender (dst_id=28):(Total: 7.997ms, non-child: 7.997ms, % non-child: 100.00%) - BytesSent: 508.80 KB (521008) - NetworkThroughput(*): 177.69 MB/sec - OverallThroughput: 62.13 MB/sec - RowsReturned: 13.20K (13200) - SerializeBatchTime: 4.475ms - TransmitDataRPCTime: 2.796ms - UncompressedRowBatchSize: 2.52 MB (2640205) HASH_JOIN_NODE (id=7):(Total: 57s813ms, non-child: 1.409ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.318ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.22K (13221) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 444.532us - RowsReturned: 13.20K (13200) - RowsReturnedRate: 228.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 200.540us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 80.660us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 104.044us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s940ms, non-child: 51.032us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 34.568us - DeserializeRowBatchTimer: 150.796us - FirstBatchArrivalWaitTime: 1s939ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 695.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s811ms, non-child: 2.147ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.496ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.45K (9450) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 537.984us - RowsReturned: 13.22K (13221) - RowsReturnedRate: 228.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.832us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 185.680us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 159.760us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s940ms, non-child: 18.516us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 9.288us - DeserializeRowBatchTimer: 10.144us - FirstBatchArrivalWaitTime: 1s940ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s809ms, non-child: 14.005ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.893ms - GetNewBlockTime: 278.544us - GetResultsTime: 803.800us - HTResizeTime: 1.297ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11695968) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.45K (9450) - RowsReturnedRate: 163.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.164us EXCHANGE_NODE (id=19):(Total: 57s795ms, non-child: 9.947ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 87.33 KB, 87.33 KB, 443.78 KB, 1.21 MB, 1.49 MB, 1.54 MB, 1.58 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB - BytesReceived: 1.72 MB (1803486) - ConvertRowBatchTime: 3.772ms - DeserializeRowBatchTimer: 12.376ms - FirstBatchArrivalWaitTime: 45s592ms - PeakMemoryUsage: 0 - RowsReturned: 72.72K (72717) - RowsReturnedRate: 1.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:1d (host=d2404.halxg.cloudera.com:22000):(Total: 58s462ms, non-child: 1.637ms, % non-child: 0.00%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.78 MB, 7.78 MB, 8.09 MB, 16.30 MB, 16.28 MB, 16.32 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB, 16.31 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.49 MB (17294152) - PerHostPeakMemUsage: 446.16 MB (467827573) - RowsProduced: 12.76K (12755) - TotalCpuTime: 3s929ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 2.762ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 20.389ms - ExecTreeExecTime: 4.331ms - OpenTime: 58s425ms - ExecTreeOpenTime: 57s831ms - PrepareTime: 37.801ms - ExecTreePrepareTime: 20.344ms CodeGen:(Total: 615.113ms, non-child: 615.113ms, % non-child: 100.00%) - CodegenTime: 3.343ms - CompileTime: 188.468ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 403.977ms - PrepareTime: 22.127ms DataStreamSender (dst_id=28):(Total: 8.976ms, non-child: 8.976ms, % non-child: 100.00%) - BytesSent: 492.51 KB (504327) - NetworkThroughput(*): 164.15 MB/sec - OverallThroughput: 53.58 MB/sec - RowsReturned: 12.76K (12755) - SerializeBatchTime: 5.577ms - TransmitDataRPCTime: 2.929ms - UncompressedRowBatchSize: 2.43 MB (2551254) HASH_JOIN_NODE (id=7):(Total: 57s837ms, non-child: 1.612ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.225ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.76K (12762) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 514.192us - RowsReturned: 12.76K (12755) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 219.288us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 95.832us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 115.408us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s961ms, non-child: 47.588us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 31.520us - DeserializeRowBatchTimer: 193.888us - FirstBatchArrivalWaitTime: 1s961ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 688.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s835ms, non-child: 2.227ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.868ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.30K (9300) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 728.248us - RowsReturned: 12.76K (12762) - RowsReturnedRate: 220.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.248us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 84.040us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 129.759us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s963ms, non-child: 16.111us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 7.928us - DeserializeRowBatchTimer: 7.500us - FirstBatchArrivalWaitTime: 1s963ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 185.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s833ms, non-child: 14.102ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.421ms - GetNewBlockTime: 159.928us - GetResultsTime: 1.124ms - HTResizeTime: 1.629ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11696508) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.30K (9300) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 844.000ns EXCHANGE_NODE (id=19):(Total: 57s819ms, non-child: 4.703ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 86.53 KB, 86.53 KB, 333.21 KB, 1.15 MB, 1.47 MB, 1.52 MB, 1.57 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB - BytesReceived: 1.70 MB (1782970) - ConvertRowBatchTime: 1.847ms - DeserializeRowBatchTimer: 10.314ms - FirstBatchArrivalWaitTime: 45s614ms - PeakMemoryUsage: 0 - RowsReturned: 71.99K (71987) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:19 (host=d2414.halxg.cloudera.com:22000):(Total: 58s462ms, non-child: 4.126ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.77 MB, 7.78 MB, 11.55 MB, 15.80 MB, 15.78 MB, 15.78 MB, 15.78 MB, 15.77 MB, 15.77 MB, 15.77 MB, 15.77 MB, 15.77 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 15.99 MB (16761672) - PerHostPeakMemUsage: 452.28 MB (474247758) - RowsProduced: 12.80K (12800) - TotalCpuTime: 3s924ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.941ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 18.575ms - ExecTreeExecTime: 3.155ms - OpenTime: 58s423ms - ExecTreeOpenTime: 57s827ms - PrepareTime: 39.055ms - ExecTreePrepareTime: 20.860ms CodeGen:(Total: 618.388ms, non-child: 618.388ms, % non-child: 100.00%) - CodegenTime: 3.276ms - CompileTime: 185.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 409.590ms - PrepareTime: 22.653ms DataStreamSender (dst_id=28):(Total: 8.358ms, non-child: 8.358ms, % non-child: 100.00%) - BytesSent: 494.27 KB (506131) - NetworkThroughput(*): 154.37 MB/sec - OverallThroughput: 57.74 MB/sec - RowsReturned: 12.80K (12800) - SerializeBatchTime: 4.737ms - TransmitDataRPCTime: 3.126ms - UncompressedRowBatchSize: 2.44 MB (2560602) HASH_JOIN_NODE (id=7):(Total: 57s831ms, non-child: 1.275ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 1.876ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.81K (12807) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 427.004us - RowsReturned: 12.80K (12800) - RowsReturnedRate: 221.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 187.812us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 72.270us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 98.326us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s958ms, non-child: 46.094us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 22.766us - DeserializeRowBatchTimer: 144.268us - FirstBatchArrivalWaitTime: 1s958ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 689.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s830ms, non-child: 1.960ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.818ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.26K (9258) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 585.690us - RowsReturned: 12.81K (12807) - RowsReturnedRate: 221.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.166us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 122.944us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 140.020us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s962ms, non-child: 16.100us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.784us - DeserializeRowBatchTimer: 19.860us - FirstBatchArrivalWaitTime: 1s960ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s828ms, non-child: 14.044ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.602ms - GetNewBlockTime: 142.772us - GetResultsTime: 771.328us - HTResizeTime: 1.492ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.66 MB (11174904) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.26K (9258) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 894.000ns EXCHANGE_NODE (id=19):(Total: 57s814ms, non-child: 7.056ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 85.16 KB, 124.01 KB, 454.05 KB, 1.21 MB, 1.51 MB, 1.51 MB, 1.56 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB - BytesReceived: 1.69 MB (1775014) - ConvertRowBatchTime: 2.680ms - DeserializeRowBatchTimer: 11.333ms - FirstBatchArrivalWaitTime: 45s612ms - PeakMemoryUsage: 0 - RowsReturned: 71.62K (71616) - RowsReturnedRate: 1.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:18 (host=d2413.halxg.cloudera.com:22000):(Total: 58s462ms, non-child: 3.140ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.61 MB, 7.77 MB, 7.75 MB, 16.25 MB, 16.25 MB, 16.23 MB, 16.28 MB, 16.33 MB, 16.33 MB, 16.33 MB, 16.33 MB, 16.33 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.44 MB (17240904) - PerHostPeakMemUsage: 434.44 MB (455541136) - RowsProduced: 12.71K (12709) - TotalCpuTime: 3s895ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.696ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 18.017ms - ExecTreeExecTime: 3.131ms - OpenTime: 58s424ms - ExecTreeOpenTime: 57s811ms - PrepareTime: 37.826ms - ExecTreePrepareTime: 21.139ms CodeGen:(Total: 635.160ms, non-child: 635.160ms, % non-child: 100.00%) - CodegenTime: 3.288ms - CompileTime: 194.248ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 417.705ms - PrepareTime: 22.676ms DataStreamSender (dst_id=28):(Total: 7.784ms, non-child: 7.784ms, % non-child: 100.00%) - BytesSent: 491.17 KB (502957) - NetworkThroughput(*): 157.04 MB/sec - OverallThroughput: 61.62 MB/sec - RowsReturned: 12.71K (12709) - SerializeBatchTime: 4.296ms - TransmitDataRPCTime: 3.054ms - UncompressedRowBatchSize: 2.42 MB (2541791) HASH_JOIN_NODE (id=7):(Total: 57s816ms, non-child: 1.258ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.346ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.72K (12716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 401.428us - RowsReturned: 12.71K (12709) - RowsReturnedRate: 219.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 194.332us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 79.320us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 129.768us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s944ms, non-child: 37.764us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.524us - DeserializeRowBatchTimer: 159.484us - FirstBatchArrivalWaitTime: 1s943ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 694.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s815ms, non-child: 2.050ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 2.040ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.35K (9349) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 505.844us - RowsReturned: 12.72K (12716) - RowsReturnedRate: 219.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 31.964us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 105.316us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 127.732us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s946ms, non-child: 19.380us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 9.520us - DeserializeRowBatchTimer: 8.144us - FirstBatchArrivalWaitTime: 1s945ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s813ms, non-child: 15.777ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 12.504ms - GetNewBlockTime: 188.840us - GetResultsTime: 772.816us - HTResizeTime: 1.916ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11695968) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.35K (9349) - RowsReturnedRate: 161.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 984.000ns EXCHANGE_NODE (id=19):(Total: 57s797ms, non-child: 9.316ms, % non-child: 0.02%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42.65 KB, 85.29 KB, 218.39 KB, 1.10 MB, 1.48 MB, 1.53 MB, 1.57 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB - BytesReceived: 1.71 MB (1792342) - ConvertRowBatchTime: 3.451ms - DeserializeRowBatchTimer: 11.457ms - FirstBatchArrivalWaitTime: 45s597ms - PeakMemoryUsage: 0 - RowsReturned: 72.19K (72189) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:1a (host=d2402.halxg.cloudera.com:22000):(Total: 58s462ms, non-child: 2.977ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.61 MB, 7.77 MB, 7.78 MB, 16.26 MB, 16.30 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB ThreadUsage(1s000ms): 1, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.05 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.47 MB (17269576) - PerHostPeakMemUsage: 470.56 MB (493413990) - RowsProduced: 13.35K (13348) - TotalCpuTime: 3s885ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.518ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 20.042ms - ExecTreeExecTime: 3.809ms - OpenTime: 58s424ms - ExecTreeOpenTime: 57s808ms - PrepareTime: 38.064ms - ExecTreePrepareTime: 20.750ms CodeGen:(Total: 637.660ms, non-child: 637.660ms, % non-child: 100.00%) - CodegenTime: 3.295ms - CompileTime: 193.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 421.221ms - PrepareTime: 22.664ms DataStreamSender (dst_id=28):(Total: 8.110ms, non-child: 8.110ms, % non-child: 100.00%) - BytesSent: 515.36 KB (527724) - NetworkThroughput(*): 176.68 MB/sec - OverallThroughput: 62.06 MB/sec - RowsReturned: 13.35K (13348) - SerializeBatchTime: 4.807ms - TransmitDataRPCTime: 2.848ms - UncompressedRowBatchSize: 2.55 MB (2670184) HASH_JOIN_NODE (id=7):(Total: 57s813ms, non-child: 1.300ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.100ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.35K (13348) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 506.108us - RowsReturned: 13.35K (13348) - RowsReturnedRate: 230.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 196.832us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 92.912us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 114.296us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s939ms, non-child: 50.456us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 29.088us - DeserializeRowBatchTimer: 195.060us - FirstBatchArrivalWaitTime: 1s939ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 695.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s812ms, non-child: 1.891ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.963ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.31K (9315) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 710.184us - RowsReturned: 13.35K (13348) - RowsReturnedRate: 230.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 23.736us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 104.160us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 138.992us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s941ms, non-child: 22.788us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.552us - DeserializeRowBatchTimer: 7.800us - FirstBatchArrivalWaitTime: 1s941ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 187.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s810ms, non-child: 15.753ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.972ms - GetNewBlockTime: 178.568us - GetResultsTime: 954.260us - HTResizeTime: 1.713ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11696020) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.31K (9315) - RowsReturnedRate: 161.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.096us EXCHANGE_NODE (id=19):(Total: 57s794ms, non-child: 6.564ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 42.16 KB, 84.31 KB, 212.76 KB, 1.07 MB, 1.47 MB, 1.51 MB, 1.56 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB - BytesReceived: 1.69 MB (1775458) - ConvertRowBatchTime: 2.560ms - DeserializeRowBatchTimer: 10.794ms - FirstBatchArrivalWaitTime: 45s593ms - PeakMemoryUsage: 0 - RowsReturned: 71.70K (71699) - RowsReturnedRate: 1.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:1c (host=d2418.halxg.cloudera.com:22000):(Total: 58s462ms, non-child: 4.900ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.77 MB, 7.77 MB, 11.23 MB, 15.57 MB, 15.79 MB, 15.83 MB, 15.83 MB, 15.83 MB, 15.83 MB, 15.83 MB, 15.83 MB, 15.83 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 15.94 MB (16712520) - PerHostPeakMemUsage: 434.49 MB (455591858) - RowsProduced: 12.80K (12797) - TotalCpuTime: 3s879ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.410ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 17.601ms - ExecTreeExecTime: 3.022ms - OpenTime: 58s421ms - ExecTreeOpenTime: 57s805ms - PrepareTime: 41.211ms - ExecTreePrepareTime: 22.746ms CodeGen:(Total: 639.317ms, non-child: 639.317ms, % non-child: 100.00%) - CodegenTime: 3.187ms - CompileTime: 197.157ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 417.119ms - PrepareTime: 24.533ms DataStreamSender (dst_id=28):(Total: 8.097ms, non-child: 8.097ms, % non-child: 100.00%) - BytesSent: 494.43 KB (506292) - NetworkThroughput(*): 158.55 MB/sec - OverallThroughput: 59.62 MB/sec - RowsReturned: 12.80K (12797) - SerializeBatchTime: 4.603ms - TransmitDataRPCTime: 3.045ms - UncompressedRowBatchSize: 2.44 MB (2559859) HASH_JOIN_NODE (id=7):(Total: 57s810ms, non-child: 1.177ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.243ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 12.81K (12811) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 397.512us - RowsReturned: 12.80K (12797) - RowsReturnedRate: 221.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 251.428us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 85.700us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 106.756us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s935ms, non-child: 45.988us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 24.792us - DeserializeRowBatchTimer: 145.780us - FirstBatchArrivalWaitTime: 1s935ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 697.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s809ms, non-child: 1.864ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.921ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.26K (9257) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 504.748us - RowsReturned: 12.81K (12811) - RowsReturnedRate: 221.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 35.504us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 60.168us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 162.008us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s939ms, non-child: 14.780us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 6.612us - DeserializeRowBatchTimer: 8.752us - FirstBatchArrivalWaitTime: 1s938ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 188.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s807ms, non-child: 15.194ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.757ms - GetNewBlockTime: 187.772us - GetResultsTime: 727.760us - HTResizeTime: 2.016ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.66 MB (11175636) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.26K (9257) - RowsReturnedRate: 160.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 900.000ns EXCHANGE_NODE (id=19):(Total: 57s791ms, non-child: 7.786ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 84.59 KB, 84.59 KB, 431.11 KB, 1.19 MB, 1.48 MB, 1.52 MB, 1.57 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB, 1.62 MB - BytesReceived: 1.70 MB (1783421) - ConvertRowBatchTime: 2.793ms - DeserializeRowBatchTimer: 12.839ms - FirstBatchArrivalWaitTime: 45s590ms - PeakMemoryUsage: 0 - RowsReturned: 71.96K (71960) - RowsReturnedRate: 1.25 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:1f (host=d2401.halxg.cloudera.com:22000):(Total: 58s462ms, non-child: 13.106ms, % non-child: 0.02%) MemoryUsage(1s000ms): 2.38 MB, 2.41 MB, 2.41 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.62 MB, 7.78 MB, 7.75 MB, 16.27 MB, 16.30 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB ThreadUsage(1s000ms): 1, 3, 3, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.45 MB (17245000) - PerHostPeakMemUsage: 373.14 MB (391262307) - RowsProduced: 13.38K (13377) - TotalCpuTime: 3s629ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.353ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 18.813ms - ExecTreeExecTime: 3.751ms - OpenTime: 58s384ms - ExecTreeOpenTime: 57s680ms - PrepareTime: 76.651ms - ExecTreePrepareTime: 48.088ms CodeGen:(Total: 754.392ms, non-child: 754.392ms, % non-child: 100.00%) - CodegenTime: 6.486ms - CompileTime: 215.901ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 485.494ms - PrepareTime: 52.199ms DataStreamSender (dst_id=28):(Total: 8.540ms, non-child: 8.540ms, % non-child: 100.00%) - BytesSent: 516.57 KB (528964) - NetworkThroughput(*): 165.32 MB/sec - OverallThroughput: 59.06 MB/sec - RowsReturned: 13.38K (13377) - SerializeBatchTime: 4.820ms - TransmitDataRPCTime: 3.051ms - UncompressedRowBatchSize: 2.55 MB (2675950) HASH_JOIN_NODE (id=7):(Total: 57s686ms, non-child: 1.278ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.464ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.39K (13391) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 441.478us - RowsReturned: 13.38K (13377) - RowsReturnedRate: 231.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 191.527us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 77.298us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 157.308us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s810ms, non-child: 35.064us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.561us - DeserializeRowBatchTimer: 161.130us - FirstBatchArrivalWaitTime: 1s809ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 745.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s684ms, non-child: 2.165ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 4.100ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.42K (9421) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 618.267us - RowsReturned: 13.39K (13391) - RowsReturnedRate: 232.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 44.632us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 148.239us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 1.268ms - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s812ms, non-child: 22.414us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 0, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 10.385us - DeserializeRowBatchTimer: 12.322us - FirstBatchArrivalWaitTime: 1s811ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 201.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s682ms, non-child: 15.439ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 11.155ms - GetNewBlockTime: 244.364us - GetResultsTime: 846.281us - HTResizeTime: 1.367ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.15 MB (11695968) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.42K (9421) - RowsReturnedRate: 163.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.882us EXCHANGE_NODE (id=19):(Total: 57s667ms, non-child: 6.158ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 43.60 KB, 87.20 KB, 218.99 KB, 1.00 MB, 1.44 MB, 1.53 MB, 1.58 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB, 1.63 MB - BytesReceived: 1.72 MB (1801271) - ConvertRowBatchTime: 2.242ms - DeserializeRowBatchTimer: 13.050ms - FirstBatchArrivalWaitTime: 45s463ms - PeakMemoryUsage: 0 - RowsReturned: 72.71K (72712) - RowsReturnedRate: 1.26 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:17 (host=d2406.halxg.cloudera.com:22000):(Total: 58s461ms, non-child: 4.131ms, % non-child: 0.01%) MemoryUsage(1s000ms): 2.41 MB, 2.41 MB, 4.93 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.60 MB, 7.76 MB, 7.79 MB, 16.00 MB, 16.29 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB, 16.27 MB ThreadUsage(1s000ms): 2, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 16.47 MB (17269576) - PerHostPeakMemUsage: 404.25 MB (423884539) - RowsProduced: 13.07K (13075) - TotalCpuTime: 3s920ms - TotalNetworkReceiveTime: 1m1s - TotalNetworkSendTime: 3.353ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 17.976ms - ExecTreeExecTime: 3.469ms - OpenTime: 58s423ms - ExecTreeOpenTime: 57s823ms - PrepareTime: 38.364ms - ExecTreePrepareTime: 20.375ms CodeGen:(Total: 620.802ms, non-child: 620.802ms, % non-child: 100.00%) - CodegenTime: 3.323ms - CompileTime: 186.536ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 117 (117) - NumInstructions: 5.72K (5719) - OptimizationTime: 411.368ms - PrepareTime: 22.358ms DataStreamSender (dst_id=28):(Total: 7.991ms, non-child: 7.991ms, % non-child: 100.00%) - BytesSent: 505.46 KB (517588) - NetworkThroughput(*): 169.47 MB/sec - OverallThroughput: 61.76 MB/sec - RowsReturned: 13.07K (13075) - SerializeBatchTime: 4.596ms - TransmitDataRPCTime: 2.912ms - UncompressedRowBatchSize: 2.49 MB (2615095) HASH_JOIN_NODE (id=7):(Total: 57s828ms, non-child: 1.175ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.795ms - PeakMemoryUsage: 1.11 MB (1168676) - ProbeRows: 13.12K (13124) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 434.570us - RowsReturned: 13.07K (13075) - RowsReturnedRate: 226.00 /sec Hash Join Builder (join_node_id=7): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 205.830us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 82.674us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 188.358us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=22):(Total: 1s957ms, non-child: 35.660us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 18.50 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB, 37.01 KB - BytesReceived: 37.01 KB (37897) - ConvertRowBatchTime: 23.262us - DeserializeRowBatchTimer: 151.144us - FirstBatchArrivalWaitTime: 1s955ms - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 689.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=6):(Total: 57s827ms, non-child: 1.619ms, % non-child: 0.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 365 (365) - BuildTime: 1.848ms - PeakMemoryUsage: 2.05 MB (2151680) - ProbeRows: 9.25K (9246) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 592.736us - RowsReturned: 13.12K (13124) - RowsReturnedRate: 226.00 /sec Hash Join Builder (join_node_id=6): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.400us - BuildRowsPartitioned: 365 (365) - GetNewBlockTime: 74.080us - HashBuckets: 704 (704) - HashCollisions: 0 (0) - HashTablesBuildTime: 157.338us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=21):(Total: 1s958ms, non-child: 13.008us, % non-child: 0.00%) BytesReceived(1s000ms): 0, 0, 985.00 B, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB, 1.92 KB - BytesReceived: 1.92 KB (1970) - ConvertRowBatchTime: 7.036us - DeserializeRowBatchTimer: 7.412us - FirstBatchArrivalWaitTime: 1s958ms - PeakMemoryUsage: 0 - RowsReturned: 365 (365) - RowsReturnedRate: 186.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=20):(Total: 57s825ms, non-child: 14.365ms, % non-child: 0.02%) ExecOption: Codegen Enabled - BuildTime: 10.819ms - GetNewBlockTime: 178.482us - GetResultsTime: 1.284ms - HTResizeTime: 1.421ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.16 MB (11698948) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 9.25K (9246) - RowsReturnedRate: 159.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.044us EXCHANGE_NODE (id=19):(Total: 57s811ms, non-child: 4.576ms, % non-child: 0.01%) BytesReceived(1s000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 41.49 KB, 82.98 KB, 214.43 KB, 1.09 MB, 1.47 MB, 1.51 MB, 1.56 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB, 1.61 MB - BytesReceived: 1.70 MB (1778991) - ConvertRowBatchTime: 1.734ms - DeserializeRowBatchTimer: 12.016ms - FirstBatchArrivalWaitTime: 45s610ms - PeakMemoryUsage: 0 - RowsReturned: 71.61K (71609) - RowsReturnedRate: 1.24 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 2s603ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 19.64 GB, max: 19.97 GB, avg: 19.81 GB, stddev: 89.46 MB completion times: min:46s177ms max:58s353ms mean: 49s634ms stddev:2s370ms execution rates: min:345.63 MB/sec max:439.40 MB/sec mean:409.65 MB/sec stddev:17.99 MB/sec num instances: 19 - AverageThreadTokens: 14.16 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 242.69 MB (254478612) - PerHostPeakMemUsage: 425.19 MB (445846248) - RowsProduced: 72.01K (72011) - TotalCpuTime: 11m40s - TotalNetworkReceiveTime: 1s993ms - TotalNetworkSendTime: 3.394ms - TotalStorageWaitTime: 1s114ms Fragment Instance Lifecycle Timings: - ExecTime: 47s022ms - ExecTreeExecTime: 46s980ms - OpenTime: 2s561ms - ExecTreeOpenTime: 2s031ms - PrepareTime: 42.174ms - ExecTreePrepareTime: 24.408ms CodeGen:(Total: 553.209ms, non-child: 553.209ms, % non-child: 100.00%) - CodegenTime: 5.040ms - CompileTime: 163.273ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 364.945ms - PrepareTime: 24.348ms DataStreamSender (dst_id=19):(Total: 25.970ms, non-child: 25.970ms, % non-child: 100.00%) - BytesSent: 1.70 MB (1785230) - NetworkThroughput(*): 192.44 MB/sec - OverallThroughput: 65.83 MB/sec - RowsReturned: 72.01K (72011) - SerializeBatchTime: 16.947ms - TransmitDataRPCTime: 8.913ms - UncompressedRowBatchSize: 8.66 MB (9075676) AGGREGATION_NODE (id=3):(Total: 49s015ms, non-child: 32s643ms, % non-child: 66.60%) - GetNewBlockTime: 249.372us - GetResultsTime: 5.158ms - HTResizeTime: 3.610ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 24.73 MB (25935866) - PinTime: 0.000ns - ReductionFactorEstimate: 258034.46 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 72.01K (72011) - RowsReturnedRate: 1.47 K/sec - StreamingTime: 31s362ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s371ms, non-child: 12s856ms, % non-child: 78.53%) - BuildRows: 73.05K (73049) - BuildTime: 14.804ms - PeakMemoryUsage: 11.20 MB (11738930) - ProbeRows: 434.22M (434217072) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s433ms - RowsReturned: 434.22M (434217072) - RowsReturnedRate: 26.58 M/sec Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 9.680ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 107.964us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.166ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s994ms, non-child: 1s994ms, % non-child: 100.00%) - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.414ms - DeserializeRowBatchTimer: 5.194ms - FirstBatchArrivalWaitTime: 1s957ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.64 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s520ms, non-child: 1s520ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 13.30 - BytesRead: 973.90 MB (1021204737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 973.90 MB (1021204737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 973.90 MB (1021204737) - DecompressionTime: 752.221ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 23 (23) - NumRowGroups: 136 (136) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 207.56 MB (217639044) - PerReadThreadRawHdfsThroughput: 1.76 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.528ms - RowBatchQueuePutWaitTime: 10m5s - RowsRead: 434.27M (434269704) - RowsReturned: 434.22M (434217072) - RowsReturnedRate: 289.07 M/sec - ScanRangesComplete: 139 (139) - ScannerThreadsInvoluntaryContextSwitches: 14.17K (14169) - ScannerThreadsTotalWallClockTime: 10m51s - MaterializeTupleTime(*): 23s709ms - ScannerThreadsSysTime: 12s900ms - ScannerThreadsUserTime: 33s280ms - ScannerThreadsVoluntaryContextSwitches: 924.39K (924389) - TotalRawHdfsReadTime(*): 542.446ms - TotalReadThroughput: 19.72 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.23M (2234123) - Rows rejected: 52.63K (52632) - Rows total: 2.23M (2234260) Filter 4 (1.00 MB): - Files processed: 139 (139) - Files rejected: 3 (3) - Files total: 139 (139) - RowGroups processed: 424.02K (424024) - RowGroups rejected: 0 (0) - RowGroups total: 424.02K (424024) - Rows processed: 2.23M (2234123) - Rows rejected: 0 (0) - Rows total: 2.23M (2234260) - Splits processed: 136 (136) - Splits rejected: 0 (0) - Splits total: 136 (136) Fragment F00: Instance 594518549f864a64:c (host=d2415.halxg.cloudera.com:22000):(Total: 2s633ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:3/384.69 MB 2:4/878.08 MB 10:6/1.05 GB 0:5/892.23 MB 3:8/1.15 GB 7:9/1.43 GB 23:4/606.13 MB 13:6/977.29 MB 16:5/551.91 MB 15:5/859.69 MB 6:8/1.05 GB 11:3/282.23 MB 5:3/521.45 MB 22:10/1.31 GB 14:6/395.84 MB 9:6/976.53 MB 12:8/732.95 MB 19:7/1.20 GB 4:5/892.36 MB 21:4/503.47 MB 17:7/1.00 GB 1:4/502.40 MB 18:7/1.23 GB 20:4/640.10 MB Filter 2 arrival: 2s562ms Filter 4 arrival: 2s600ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 92.90 MB, 189.45 MB, 189.54 MB, 189.38 MB, 175.04 MB, 207.18 MB, 214.22 MB, 202.54 MB, 196.59 MB, 214.40 MB, 226.38 MB, 222.49 MB, 198.61 MB, 195.64 MB, 219.05 MB, 202.69 MB, 190.82 MB, 211.43 MB, 210.02 MB, 215.39 MB, 201.52 MB, 196.51 MB, 200.49 MB, 195.61 MB, 179.67 MB, 179.97 MB, 206.37 MB, 203.68 MB, 193.96 MB, 208.40 MB, 221.36 MB, 233.40 MB, 225.54 MB, 205.56 MB, 195.62 MB, 202.61 MB, 201.60 MB, 183.60 MB, 176.10 MB, 193.04 MB, 198.99 MB, 198.98 MB, 201.61 MB, 204.59 MB, 189.80 MB, 171.08 MB, 144.62 MB, 89.41 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.35 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 233.69 MB (245046066) - PerHostPeakMemUsage: 428.23 MB (449029818) - RowsProduced: 71.66K (71656) - TotalCpuTime: 11m57s - TotalNetworkReceiveTime: 2s024ms - TotalNetworkSendTime: 3.408ms - TotalStorageWaitTime: 1s080ms Fragment Instance Lifecycle Timings: - ExecTime: 47s801ms - ExecTreeExecTime: 47s764ms - OpenTime: 2s591ms - ExecTreeOpenTime: 2s066ms - PrepareTime: 41.848ms - ExecTreePrepareTime: 24.582ms CodeGen:(Total: 548.069ms, non-child: 548.069ms, % non-child: 100.00%) - CodegenTime: 4.889ms - CompileTime: 163.310ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 359.033ms - PrepareTime: 24.836ms DataStreamSender (dst_id=19):(Total: 24.542ms, non-child: 24.542ms, % non-child: 100.00%) - BytesSent: 1.70 MB (1779789) - NetworkThroughput(*): 195.86 MB/sec - OverallThroughput: 69.16 MB/sec - RowsReturned: 71.66K (71656) - SerializeBatchTime: 15.779ms - TransmitDataRPCTime: 8.666ms - UncompressedRowBatchSize: 8.61 MB (9030832) AGGREGATION_NODE (id=3):(Total: 49s833ms, non-child: 33s042ms, % non-child: 66.31%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 296.804us - GetResultsTime: 4.557ms - HTResizeTime: 3.693ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11822657) - PinTime: 0.000ns - ReductionFactorEstimate: 258295.12 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 71.66K (71656) - RowsReturnedRate: 1.44 K/sec - StreamingTime: 31s722ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s791ms, non-child: 13s119ms, % non-child: 78.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 14.395ms - PeakMemoryUsage: 11.20 MB (11744991) - ProbeRows: 433.25M (433253151) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s652ms - RowsReturned: 433.25M (433253151) - RowsReturnedRate: 25.80 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.525ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 98.228us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.931ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s025ms, non-child: 1.699ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.383ms - DeserializeRowBatchTimer: 4.876ms - FirstBatchArrivalWaitTime: 1s987ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s646ms, non-child: 1s646ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:3/384.69 MB 2:4/878.08 MB 10:6/1.05 GB 0:5/892.23 MB 3:8/1.15 GB 7:9/1.43 GB 23:4/606.13 MB 13:6/977.29 MB 16:5/551.91 MB 15:5/859.69 MB 6:8/1.05 GB 11:3/282.23 MB 5:3/521.45 MB 22:10/1.31 GB 14:6/395.84 MB 9:6/976.53 MB 12:8/732.95 MB 19:7/1.20 GB 4:5/892.36 MB 21:4/503.47 MB 17:7/1.00 GB 1:4/502.40 MB 18:7/1.23 GB 20:4/640.10 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 134 out of 134 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:268 BytesRead(1s000ms): 0, 0, 51.97 MB, 103.93 MB, 103.93 MB, 103.93 MB, 128.12 MB, 193.34 MB, 202.55 MB, 202.55 MB, 218.06 MB, 261.26 MB, 295.55 MB, 295.55 MB, 298.47 MB, 334.42 MB, 372.88 MB, 379.18 MB, 385.04 MB, 437.42 MB, 452.44 MB, 460.33 MB, 472.93 MB, 498.93 MB, 528.64 MB, 539.15 MB, 544.99 MB, 558.36 MB, 614.93 MB, 639.68 MB, 650.45 MB, 672.19 MB, 704.06 MB, 729.25 MB, 729.25 MB, 740.95 MB, 752.67 MB, 781.57 MB, 792.04 MB, 808.70 MB, 832.47 MB, 869.79 MB, 891.91 MB, 901.09 MB, 919.89 MB, 945.00 MB, 961.67 MB, 970.89 MB, 970.89 MB, 970.89 MB - FooterProcessingTime: (Avg: 2.410ms ; Min: 1.017ms ; Max: 10.224ms ; Number of samples: 134) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.44 - BytesRead: 970.89 MB (1018051846) - BytesReadDataNodeCache: 0 - BytesReadLocal: 970.89 MB (1018051846) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 970.89 MB (1018051846) - DecompressionTime: 731.369ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 134 (134) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.55 MB (219726370) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 19.980ms - RowBatchQueuePutWaitTime: 10m18s - RowsRead: 433.30M (433304865) - RowsReturned: 433.25M (433253151) - RowsReturnedRate: 263.17 M/sec - ScanRangesComplete: 137 (137) - ScannerThreadsInvoluntaryContextSwitches: 18.04K (18040) - ScannerThreadsTotalWallClockTime: 11m8s - MaterializeTupleTime(*): 24s910ms - ScannerThreadsSysTime: 14s838ms - ScannerThreadsUserTime: 35s673ms - ScannerThreadsVoluntaryContextSwitches: 987.65K (987653) - TotalRawHdfsReadTime(*): 543.127ms - TotalReadThroughput: 19.23 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.20M (2195322) - Rows rejected: 51.71K (51714) - Rows total: 2.20M (2195456) Filter 4 (1.00 MB): - Files processed: 137 (137) - Files rejected: 3 (3) - Files total: 137 (137) - RowGroups processed: 423.08K (423084) - RowGroups rejected: 0 (0) - RowGroups total: 423.08K (423084) - Rows processed: 2.20M (2195322) - Rows rejected: 0 (0) - Rows total: 2.20M (2195456) - Splits processed: 134 (134) - Splits rejected: 0 (0) - Splits total: 134 (134) Instance 594518549f864a64:5 (host=d2402.halxg.cloudera.com:22000):(Total: 2s631ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:2/371.14 MB 8:5/960.24 MB 21:3/760.89 MB 14:6/1009.76 MB 23:5/620.70 MB 1:5/859.84 MB 20:4/878.22 MB 6:5/652.06 MB 11:6/1.02 GB 13:3/624.72 MB 18:6/906.15 MB 16:5/723.32 MB 15:8/1.22 GB 3:8/1.25 GB 4:7/1.13 GB 0:7/783.89 MB 17:5/755.77 MB 12:6/737.26 MB 10:6/906.20 MB 22:3/282.26 MB 5:5/651.80 MB 2:9/1.26 GB 19:5/723.59 MB 7:6/1.12 GB Filter 2 arrival: 2s555ms Filter 4 arrival: 2s599ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 6.89 MB, 208.42 MB, 208.49 MB, 208.35 MB, 214.42 MB, 223.39 MB, 226.48 MB, 182.83 MB, 187.83 MB, 228.46 MB, 232.28 MB, 216.43 MB, 208.72 MB, 214.14 MB, 226.45 MB, 190.57 MB, 174.38 MB, 201.00 MB, 209.30 MB, 201.52 MB, 193.61 MB, 208.46 MB, 223.43 MB, 203.54 MB, 191.76 MB, 213.07 MB, 221.48 MB, 208.65 MB, 191.66 MB, 190.11 MB, 221.42 MB, 209.63 MB, 192.76 MB, 203.40 MB, 197.05 MB, 201.56 MB, 195.59 MB, 185.17 MB, 207.41 MB, 215.42 MB, 217.50 MB, 213.42 MB, 207.43 MB, 193.58 MB, 177.37 MB, 143.82 MB, 70.14 MB ThreadUsage(1s000ms): 1, 2, 2, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.19 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 232.77 MB (244079834) - PerHostPeakMemUsage: 470.56 MB (493413990) - RowsProduced: 69.63K (69628) - TotalCpuTime: 11m36s - TotalNetworkReceiveTime: 2s035ms - TotalNetworkSendTime: 2.933ms - TotalStorageWaitTime: 1s136ms Fragment Instance Lifecycle Timings: - ExecTime: 46s399ms - ExecTreeExecTime: 46s361ms - OpenTime: 2s593ms - ExecTreeOpenTime: 2s076ms - PrepareTime: 38.659ms - ExecTreePrepareTime: 22.852ms CodeGen:(Total: 537.602ms, non-child: 537.602ms, % non-child: 100.00%) - CodegenTime: 4.686ms - CompileTime: 158.959ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 355.212ms - PrepareTime: 22.838ms DataStreamSender (dst_id=19):(Total: 24.421ms, non-child: 24.421ms, % non-child: 100.00%) - BytesSent: 1.63 MB (1704157) - NetworkThroughput(*): 199.48 MB/sec - OverallThroughput: 66.55 MB/sec - RowsReturned: 69.63K (69628) - SerializeBatchTime: 16.167ms - TransmitDataRPCTime: 8.147ms - UncompressedRowBatchSize: 8.37 MB (8775248) AGGREGATION_NODE (id=3):(Total: 48s441ms, non-child: 32s207ms, % non-child: 66.49%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 119.052us - GetResultsTime: 5.131ms - HTResizeTime: 3.784ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.26 MB (11802544) - PinTime: 0.000ns - ReductionFactorEstimate: 255508.67 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 69.63K (69628) - RowsReturnedRate: 1.44 K/sec - StreamingTime: 31s023ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s234ms, non-child: 12s776ms, % non-child: 78.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 14.400ms - PeakMemoryUsage: 11.19 MB (11737426) - ProbeRows: 441.91M (441913238) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s380ms - RowsReturned: 441.91M (441913238) - RowsReturnedRate: 27.22 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.503ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 96.848us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.029ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s036ms, non-child: 1.769ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 601.96 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.338ms - DeserializeRowBatchTimer: 5.014ms - FirstBatchArrivalWaitTime: 1s999ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 35.86 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s420ms, non-child: 1s420ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:2/371.14 MB 8:5/960.24 MB 21:3/760.89 MB 14:6/1009.76 MB 23:5/620.70 MB 1:5/859.84 MB 20:4/878.22 MB 6:5/652.06 MB 11:6/1.02 GB 13:3/624.72 MB 18:6/906.15 MB 16:5/723.32 MB 15:8/1.22 GB 3:8/1.25 GB 4:7/1.13 GB 0:7/783.89 MB 17:5/755.77 MB 12:6/737.26 MB 10:6/906.20 MB 22:3/282.26 MB 5:5/651.80 MB 2:9/1.26 GB 19:5/723.59 MB 7:6/1.12 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 128 out of 128 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:98.97% 1:1.031% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:256 BytesRead(1s000ms): 0, 0, 0, 125.68 MB, 125.68 MB, 125.68 MB, 150.84 MB, 188.14 MB, 194.43 MB, 194.43 MB, 217.10 MB, 298.46 MB, 307.70 MB, 307.70 MB, 307.70 MB, 342.86 MB, 364.62 MB, 364.62 MB, 380.54 MB, 449.61 MB, 466.76 MB, 466.76 MB, 485.66 MB, 530.01 MB, 555.56 MB, 563.09 MB, 579.36 MB, 620.38 MB, 632.53 MB, 638.83 MB, 654.78 MB, 689.09 MB, 733.14 MB, 733.14 MB, 741.94 MB, 779.60 MB, 793.76 MB, 797.51 MB, 831.49 MB, 853.64 MB, 894.67 MB, 916.07 MB, 934.50 MB, 945.01 MB, 958.38 MB, 971.69 MB, 987.17 MB, 990.09 MB, 990.09 MB - FooterProcessingTime: (Avg: 1.841ms ; Min: 1.023ms ; Max: 6.623ms ; Number of samples: 128) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 13.28 - BytesRead: 990.09 MB (1038189212) - BytesReadDataNodeCache: 0 - BytesReadLocal: 990.09 MB (1038189212) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 990.09 MB (1038189212) - DecompressionTime: 718.111ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 128 (128) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.63 MB (219816906) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 22.195ms - RowBatchQueuePutWaitTime: 10m4s - RowsRead: 441.96M (441962629) - RowsReturned: 441.91M (441913238) - RowsReturnedRate: 311.01 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 13.43K (13431) - ScannerThreadsTotalWallClockTime: 10m48s - MaterializeTupleTime(*): 23s815ms - ScannerThreadsSysTime: 11s350ms - ScannerThreadsUserTime: 32s622ms - ScannerThreadsVoluntaryContextSwitches: 808.17K (808168) - TotalRawHdfsReadTime(*): 540.479ms - TotalReadThroughput: 20.21 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.10M (2097024) - Rows rejected: 49.39K (49391) - Rows total: 2.10M (2097152) Filter 4 (1.00 MB): - Files processed: 130 (130) - Files rejected: 2 (2) - Files total: 130 (130) - RowGroups processed: 431.54K (431536) - RowGroups rejected: 0 (0) - RowGroups total: 431.54K (431536) - Rows processed: 2.10M (2097024) - Rows rejected: 0 (0) - Rows total: 2.10M (2097152) - Splits processed: 128 (128) - Splits rejected: 0 (0) - Splits total: 128 (128) Instance 594518549f864a64:6 (host=d2403.halxg.cloudera.com:22000):(Total: 2s627ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:5/790.61 MB 14:6/528.89 MB 2:7/1.10 GB 3:9/1.36 GB 21:6/803.79 MB 17:5/790.19 MB 20:5/892.41 MB 10:6/1010.58 MB 8:8/1.08 GB 15:7/1.10 GB 7:8/967.34 MB 0:6/803.80 MB 18:5/891.92 MB 1:7/680.92 MB 11:4/158.59 MB 13:5/550.13 MB 23:8/1.05 GB 6:6/1008.99 MB 22:6/633.67 MB 5:4/639.28 MB 4:11/1.46 GB 16:4/639.46 MB 19:4/502.35 MB 12:6/737.25 MB Filter 2 arrival: 2s553ms Filter 4 arrival: 2s600ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 66.34 MB, 191.97 MB, 196.51 MB, 196.32 MB, 199.37 MB, 199.44 MB, 215.75 MB, 212.41 MB, 191.75 MB, 200.49 MB, 220.50 MB, 207.91 MB, 203.59 MB, 192.05 MB, 203.46 MB, 203.48 MB, 196.66 MB, 198.54 MB, 197.86 MB, 201.36 MB, 201.28 MB, 185.00 MB, 185.25 MB, 178.66 MB, 193.38 MB, 189.08 MB, 198.46 MB, 193.99 MB, 213.31 MB, 206.16 MB, 213.46 MB, 216.38 MB, 219.45 MB, 215.68 MB, 187.33 MB, 197.49 MB, 184.71 MB, 193.04 MB, 187.76 MB, 208.50 MB, 203.00 MB, 204.53 MB, 201.44 MB, 199.93 MB, 171.89 MB, 114.28 MB, 39.15 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 8 - AverageThreadTokens: 14.18 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 221.47 MB (232223325) - PerHostPeakMemUsage: 373.40 MB (391534926) - RowsProduced: 73.01K (73008) - TotalCpuTime: 11m33s - TotalNetworkReceiveTime: 2s006ms - TotalNetworkSendTime: 4.400ms - TotalStorageWaitTime: 1s094ms Fragment Instance Lifecycle Timings: - ExecTime: 46s223ms - ExecTreeExecTime: 46s180ms - OpenTime: 2s584ms - ExecTreeOpenTime: 2s043ms - PrepareTime: 42.631ms - ExecTreePrepareTime: 24.772ms CodeGen:(Total: 564.155ms, non-child: 564.155ms, % non-child: 100.00%) - CodegenTime: 5.020ms - CompileTime: 164.513ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 373.773ms - PrepareTime: 25.239ms DataStreamSender (dst_id=19):(Total: 27.089ms, non-child: 27.089ms, % non-child: 100.00%) - BytesSent: 1.75 MB (1832072) - NetworkThroughput(*): 194.85 MB/sec - OverallThroughput: 64.50 MB/sec - RowsReturned: 73.01K (73008) - SerializeBatchTime: 18.009ms - TransmitDataRPCTime: 8.967ms - UncompressedRowBatchSize: 8.77 MB (9201232) AGGREGATION_NODE (id=3):(Total: 48s228ms, non-child: 32s440ms, % non-child: 67.26%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 133.368us - GetResultsTime: 5.568ms - HTResizeTime: 3.877ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.28 MB (11826174) - PinTime: 0.000ns - ReductionFactorEstimate: 258738.58 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 73.01K (73008) - RowsReturnedRate: 1.51 K/sec - StreamingTime: 31s295ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 15s788ms, non-child: 12s425ms, % non-child: 78.70%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 15.828ms - PeakMemoryUsage: 11.20 MB (11744949) - ProbeRows: 429.95M (429949825) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s024ms - RowsReturned: 429.95M (429949825) - RowsReturnedRate: 27.23 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.519ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 116.264us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.237ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s008ms, non-child: 1.967ms, % non-child: 0.10%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.432ms - DeserializeRowBatchTimer: 5.490ms - FirstBatchArrivalWaitTime: 1s971ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.37 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s354ms, non-child: 1s354ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:5/790.61 MB 14:6/528.89 MB 2:7/1.10 GB 3:9/1.36 GB 21:6/803.79 MB 17:5/790.19 MB 20:5/892.41 MB 10:6/1010.58 MB 8:8/1.08 GB 15:7/1.10 GB 7:8/967.34 MB 0:6/803.80 MB 18:5/891.92 MB 1:7/680.92 MB 11:4/158.59 MB 13:5/550.13 MB 23:8/1.05 GB 6:6/1008.99 MB 22:6/633.67 MB 5:4/639.28 MB 4:11/1.46 GB 16:4/639.46 MB 19:4/502.35 MB 12:6/737.25 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 144 out of 144 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:288 BytesRead(1s000ms): 0, 0, 34.18 MB, 116.51 MB, 119.44 MB, 119.44 MB, 134.50 MB, 174.58 MB, 208.43 MB, 212.20 MB, 224.35 MB, 259.47 MB, 290.47 MB, 293.79 MB, 309.26 MB, 324.71 MB, 361.52 MB, 377.03 MB, 395.91 MB, 419.78 MB, 438.98 MB, 464.12 MB, 477.11 MB, 494.29 MB, 523.10 MB, 542.27 MB, 564.43 MB, 574.89 MB, 624.65 MB, 641.77 MB, 673.24 MB, 683.25 MB, 704.19 MB, 734.80 MB, 741.10 MB, 757.45 MB, 773.36 MB, 806.38 MB, 813.02 MB, 830.12 MB, 860.66 MB, 901.29 MB, 919.62 MB, 928.40 MB, 934.26 MB, 956.05 MB, 965.25 MB, 965.25 MB - FooterProcessingTime: (Avg: 2.312ms ; Min: 991.940us ; Max: 10.859ms ; Number of samples: 144) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 965.25 MB (1012134057) - BytesReadDataNodeCache: 0 - BytesReadLocal: 965.25 MB (1012134057) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 965.25 MB (1012134057) - DecompressionTime: 688.554ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 144 (144) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 197.62 MB (207221269) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.178ms - RowBatchQueuePutWaitTime: 10m3s - RowsRead: 430.01M (430005209) - RowsReturned: 429.95M (429949825) - RowsReturnedRate: 317.52 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 14.19K (14186) - ScannerThreadsTotalWallClockTime: 10m46s - MaterializeTupleTime(*): 22s843ms - ScannerThreadsSysTime: 11s027ms - ScannerThreadsUserTime: 31s673ms - ScannerThreadsVoluntaryContextSwitches: 801.80K (801799) - TotalRawHdfsReadTime(*): 502.625ms - TotalReadThroughput: 19.90 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.36M (2359152) - Rows rejected: 55.38K (55384) - Rows total: 2.36M (2359296) Filter 4 (1.00 MB): - Files processed: 148 (148) - Files rejected: 4 (4) - Files total: 148 (148) - RowGroups processed: 419.86K (419855) - RowGroups rejected: 0 (0) - RowGroups total: 419.86K (419855) - Rows processed: 2.36M (2359152) - Rows rejected: 0 (0) - Rows total: 2.36M (2359296) - Splits processed: 144 (144) - Splits rejected: 0 (0) - Splits total: 144 (144) Instance 594518549f864a64:b (host=d2411.halxg.cloudera.com:22000):(Total: 2s626ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:4/606.15 MB 10:3/488.63 MB 7:4/742.26 MB 5:3/520.83 MB 0:7/818.28 MB 6:3/657.67 MB 14:5/548.85 MB 15:8/1.08 GB 9:3/248.85 MB 17:5/1.01 GB 12:6/497.11 MB 22:8/1.01 GB 2:3/384.75 MB 19:7/1.00 GB 23:10/1.58 GB 1:2/267.42 MB 18:9/1.60 GB 16:3/624.38 MB 20:8/1.48 GB 3:5/859.66 MB 21:13/1.92 GB 4:6/872.71 MB 13:4/535.11 MB 11:4/637.49 MB Filter 2 arrival: 2s560ms Filter 4 arrival: 2s597ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 90.08 MB, 202.32 MB, 202.39 MB, 202.36 MB, 206.83 MB, 220.34 MB, 226.34 MB, 190.67 MB, 192.93 MB, 206.29 MB, 226.39 MB, 202.61 MB, 207.39 MB, 231.59 MB, 238.66 MB, 226.67 MB, 207.22 MB, 226.32 MB, 232.27 MB, 231.76 MB, 211.93 MB, 202.34 MB, 217.60 MB, 225.70 MB, 200.15 MB, 202.38 MB, 210.28 MB, 217.73 MB, 219.47 MB, 211.59 MB, 202.42 MB, 215.86 MB, 203.79 MB, 208.68 MB, 219.66 MB, 225.52 MB, 228.73 MB, 227.62 MB, 203.42 MB, 210.84 MB, 225.69 MB, 211.76 MB, 208.73 MB, 169.66 MB, 124.95 MB, 85.56 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16, 16 - AverageThreadTokens: 15.02 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 242.87 MB (254663463) - PerHostPeakMemUsage: 458.45 MB (480717922) - RowsProduced: 66.92K (66924) - TotalCpuTime: 11m59s - TotalNetworkReceiveTime: 2s027ms - TotalNetworkSendTime: 3.059ms - TotalStorageWaitTime: 1s067ms Fragment Instance Lifecycle Timings: - ExecTime: 45s652ms - ExecTreeExecTime: 45s612ms - OpenTime: 2s587ms - ExecTreeOpenTime: 2s066ms - PrepareTime: 39.484ms - ExecTreePrepareTime: 23.077ms CodeGen:(Total: 542.447ms, non-child: 542.447ms, % non-child: 100.00%) - CodegenTime: 4.941ms - CompileTime: 156.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 361.752ms - PrepareTime: 23.144ms DataStreamSender (dst_id=19):(Total: 27.174ms, non-child: 27.174ms, % non-child: 100.00%) - BytesSent: 1.59 MB (1669436) - NetworkThroughput(*): 158.66 MB/sec - OverallThroughput: 58.59 MB/sec - RowsReturned: 66.92K (66924) - SerializeBatchTime: 17.020ms - TransmitDataRPCTime: 10.034ms - UncompressedRowBatchSize: 8.04 MB (8434460) AGGREGATION_NODE (id=3):(Total: 47s681ms, non-child: 31s720ms, % non-child: 66.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 135.948us - GetResultsTime: 5.287ms - HTResizeTime: 3.340ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.24 MB (11788528) - PinTime: 0.000ns - ReductionFactorEstimate: 254800.99 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 66.92K (66924) - RowsReturnedRate: 1.40 K/sec - StreamingTime: 30s441ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 15s961ms, non-child: 12s457ms, % non-child: 78.05%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 15.429ms - PeakMemoryUsage: 11.20 MB (11745069) - ProbeRows: 433.36M (433361231) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s035ms - RowsReturned: 433.36M (433361231) - RowsReturnedRate: 27.15 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.145ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 95.956us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.251ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s029ms, non-child: 1.709ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.353ms - DeserializeRowBatchTimer: 5.053ms - FirstBatchArrivalWaitTime: 1s991ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s474ms, non-child: 1s474ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:4/606.15 MB 10:3/488.63 MB 7:4/742.26 MB 5:3/520.83 MB 0:7/818.28 MB 6:3/657.67 MB 14:5/548.85 MB 15:8/1.08 GB 9:3/248.85 MB 17:5/1.01 GB 12:6/497.11 MB 22:8/1.01 GB 2:3/384.75 MB 19:7/1.00 GB 23:10/1.58 GB 1:2/267.42 MB 18:9/1.60 GB 16:3/624.38 MB 20:8/1.48 GB 3:5/859.66 MB 21:13/1.92 GB 4:6/872.71 MB 13:4/535.11 MB 11:4/637.49 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 130 out of 130 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:97.89% 1:2.105% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:260 BytesRead(1s000ms): 0, 0, 50.23 MB, 120.63 MB, 120.63 MB, 120.63 MB, 150.74 MB, 189.64 MB, 205.17 MB, 205.17 MB, 217.76 MB, 274.24 MB, 298.92 MB, 298.92 MB, 305.95 MB, 367.14 MB, 385.57 MB, 391.87 MB, 400.67 MB, 460.97 MB, 474.69 MB, 488.02 MB, 496.81 MB, 517.29 MB, 550.38 MB, 565.90 MB, 581.43 MB, 597.32 MB, 647.50 MB, 666.37 MB, 672.81 MB, 678.11 MB, 702.79 MB, 740.12 MB, 756.78 MB, 783.63 MB, 821.37 MB, 842.32 MB, 854.49 MB, 860.79 MB, 876.09 MB, 918.49 MB, 952.91 MB, 958.78 MB, 961.71 MB, 971.30 MB, 971.30 MB, 971.30 MB - FooterProcessingTime: (Avg: 2.313ms ; Min: 940.724us ; Max: 10.909ms ; Number of samples: 130) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 14.13 - BytesRead: 971.30 MB (1018484735) - BytesReadDataNodeCache: 0 - BytesReadLocal: 971.30 MB (1018484735) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 971.30 MB (1018484735) - DecompressionTime: 694.224ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 130 (130) - NumScannerThreadsStarted: 15 (15) - PeakMemoryUsage: 219.72 MB (230392343) - PerReadThreadRawHdfsThroughput: 1.84 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.205ms - RowBatchQueuePutWaitTime: 10m23s - RowsRead: 433.41M (433411155) - RowsReturned: 433.36M (433361231) - RowsReturnedRate: 293.94 M/sec - ScanRangesComplete: 133 (133) - ScannerThreadsInvoluntaryContextSwitches: 14.46K (14455) - ScannerThreadsTotalWallClockTime: 11m12s - MaterializeTupleTime(*): 23s178ms - ScannerThreadsSysTime: 16s496ms - ScannerThreadsUserTime: 32s073ms - ScannerThreadsVoluntaryContextSwitches: 1.00M (1004511) - TotalRawHdfsReadTime(*): 515.011ms - TotalReadThroughput: 20.24 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.13M (2129790) - Rows rejected: 49.92K (49924) - Rows total: 2.13M (2129920) Filter 4 (1.00 MB): - Files processed: 133 (133) - Files rejected: 3 (3) - Files total: 133 (133) - RowGroups processed: 423.20K (423197) - RowGroups rejected: 0 (0) - RowGroups total: 423.20K (423197) - Rows processed: 2.13M (2129790) - Rows rejected: 0 (0) - Rows total: 2.13M (2129920) - Splits processed: 130 (130) - Splits rejected: 0 (0) - Splits total: 130 (130) Instance 594518549f864a64:3 (host=d2413.halxg.cloudera.com:22000):(Total: 2s626ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:6/601.49 MB 18:3/657.96 MB 5:6/1.02 GB 17:3/488.54 MB 8:4/365.78 MB 22:5/823.14 MB 14:7/1.23 GB 15:5/1.00 GB 9:9/1017.64 MB 7:4/469.75 MB 16:6/908.59 MB 11:5/789.98 MB 13:8/934.65 MB 10:5/756.97 MB 12:5/1.00 GB 3:4/637.36 MB 20:12/1.77 GB 23:4/639.67 MB 6:8/1.48 GB 1:5/517.08 MB 2:6/907.55 MB 19:3/624.64 MB 21:7/958.81 MB 4:5/652.83 MB Filter 2 arrival: 2s554ms Filter 4 arrival: 2s599ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 6.99 MB, 190.47 MB, 190.36 MB, 190.39 MB, 199.36 MB, 207.02 MB, 205.82 MB, 212.69 MB, 196.56 MB, 216.69 MB, 233.91 MB, 222.07 MB, 206.04 MB, 217.57 MB, 224.45 MB, 206.55 MB, 183.39 MB, 200.62 MB, 209.49 MB, 195.82 MB, 191.50 MB, 200.12 MB, 215.20 MB, 207.50 MB, 191.52 MB, 194.12 MB, 198.49 MB, 201.44 MB, 185.56 MB, 186.10 MB, 209.33 MB, 212.35 MB, 207.46 MB, 201.12 MB, 194.97 MB, 201.55 MB, 187.50 MB, 179.59 MB, 191.57 MB, 191.56 MB, 195.32 MB, 197.97 MB, 213.42 MB, 195.92 MB, 169.83 MB, 139.39 MB, 83.47 MB ThreadUsage(1s000ms): 1, 2, 2, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.19 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 238.66 MB (250250355) - PerHostPeakMemUsage: 434.44 MB (455541136) - RowsProduced: 75.04K (75036) - TotalCpuTime: 11m35s - TotalNetworkReceiveTime: 2s046ms - TotalNetworkSendTime: 3.083ms - TotalStorageWaitTime: 1s108ms Fragment Instance Lifecycle Timings: - ExecTime: 46s366ms - ExecTreeExecTime: 46s317ms - OpenTime: 2s587ms - ExecTreeOpenTime: 2s080ms - PrepareTime: 38.605ms - ExecTreePrepareTime: 22.987ms CodeGen:(Total: 528.633ms, non-child: 528.633ms, % non-child: 100.00%) - CodegenTime: 4.347ms - CompileTime: 158.655ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 347.022ms - PrepareTime: 22.386ms DataStreamSender (dst_id=19):(Total: 26.948ms, non-child: 26.948ms, % non-child: 100.00%) - BytesSent: 1.74 MB (1822644) - NetworkThroughput(*): 189.44 MB/sec - OverallThroughput: 64.50 MB/sec - RowsReturned: 75.04K (75036) - SerializeBatchTime: 17.659ms - TransmitDataRPCTime: 9.175ms - UncompressedRowBatchSize: 9.02 MB (9456816) AGGREGATION_NODE (id=3):(Total: 48s400ms, non-child: 32s231ms, % non-child: 66.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 152.156us - GetResultsTime: 5.268ms - HTResizeTime: 3.697ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.26 MB (11806224) - PinTime: 0.000ns - ReductionFactorEstimate: 257881.33 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 75.04K (75036) - RowsReturnedRate: 1.55 K/sec - StreamingTime: 31s164ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s168ms, non-child: 12s593ms, % non-child: 77.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.177ms - PeakMemoryUsage: 11.19 MB (11737055) - ProbeRows: 437.86M (437855496) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s191ms - RowsReturned: 437.86M (437855496) - RowsReturnedRate: 27.08 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.360ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 95.056us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.010ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s047ms, non-child: 1.595ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.274ms - DeserializeRowBatchTimer: 4.357ms - FirstBatchArrivalWaitTime: 2s007ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 35.68 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s528ms, non-child: 1s528ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:6/601.49 MB 18:3/657.96 MB 5:6/1.02 GB 17:3/488.54 MB 8:4/365.78 MB 22:5/823.14 MB 14:7/1.23 GB 15:5/1.00 GB 9:9/1017.64 MB 7:4/469.75 MB 16:6/908.59 MB 11:5/789.98 MB 13:8/934.65 MB 10:5/756.97 MB 12:5/1.00 GB 3:4/637.36 MB 20:12/1.77 GB 23:4/639.67 MB 6:8/1.48 GB 1:5/517.08 MB 2:6/907.55 MB 19:3/624.64 MB 21:7/958.81 MB 4:5/652.83 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 132 out of 132 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:264 BytesRead(1s000ms): 0, 0, 0, 108.03 MB, 108.03 MB, 108.03 MB, 139.46 MB, 183.85 MB, 197.94 MB, 210.91 MB, 210.91 MB, 257.50 MB, 298.59 MB, 304.24 MB, 308.40 MB, 340.67 MB, 367.48 MB, 373.34 MB, 376.27 MB, 419.47 MB, 447.92 MB, 460.85 MB, 476.76 MB, 508.57 MB, 540.40 MB, 550.03 MB, 557.53 MB, 588.50 MB, 615.73 MB, 631.25 MB, 640.47 MB, 668.52 MB, 721.79 MB, 728.08 MB, 737.30 MB, 756.14 MB, 786.65 MB, 798.76 MB, 808.41 MB, 820.98 MB, 862.96 MB, 892.68 MB, 911.17 MB, 930.03 MB, 965.67 MB, 981.63 MB, 981.63 MB, 981.63 MB, 981.63 MB - FooterProcessingTime: (Avg: 2.102ms ; Min: 825.004us ; Max: 8.937ms ; Number of samples: 132) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.28 - BytesRead: 981.63 MB (1029315404) - BytesReadDataNodeCache: 0 - BytesReadLocal: 981.63 MB (1029315404) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 981.63 MB (1029315404) - DecompressionTime: 732.666ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 132 (132) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.49 MB (225952987) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.574ms - RowBatchQueuePutWaitTime: 9m59s - RowsRead: 437.91M (437906697) - RowsReturned: 437.86M (437855496) - RowsReturnedRate: 286.53 M/sec - ScanRangesComplete: 135 (135) - ScannerThreadsInvoluntaryContextSwitches: 13.99K (13992) - ScannerThreadsTotalWallClockTime: 10m48s - MaterializeTupleTime(*): 22s817ms - ScannerThreadsSysTime: 13s737ms - ScannerThreadsUserTime: 34s006ms - ScannerThreadsVoluntaryContextSwitches: 1.02M (1020389) - TotalRawHdfsReadTime(*): 534.866ms - TotalReadThroughput: 20.03 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.16M (2162556) - Rows rejected: 51.20K (51201) - Rows total: 2.16M (2162688) Filter 4 (1.00 MB): - Files processed: 135 (135) - Files rejected: 3 (3) - Files total: 135 (135) - RowGroups processed: 427.57K (427574) - RowGroups rejected: 0 (0) - RowGroups total: 427.57K (427574) - Rows processed: 2.16M (2162556) - Rows rejected: 0 (0) - Rows total: 2.16M (2162688) - Splits processed: 132 (132) - Splits rejected: 0 (0) - Splits total: 132 (132) Instance 594518549f864a64:7 (host=d2418.halxg.cloudera.com:22000):(Total: 2s625ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:5/756.08 MB 9:4/911.58 MB 7:5/276.58 MB 19:8/1.11 GB 14:4/741.35 MB 22:7/1.23 GB 17:6/873.33 MB 15:7/992.23 MB 5:5/653.57 MB 12:6/529.24 MB 0:6/836.59 MB 21:5/925.77 MB 2:6/909.00 MB 18:4/775.46 MB 1:8/902.66 MB 10:9/1.10 GB 13:8/1.11 GB 8:7/887.34 MB 23:7/784.73 MB 6:5/484.15 MB 3:6/907.72 MB 20:8/832.28 MB 11:7/1.23 GB 16:4/398.18 MB Filter 2 arrival: 2s552ms Filter 4 arrival: 2s598ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 75.03 MB, 179.97 MB, 184.11 MB, 184.47 MB, 189.08 MB, 196.55 MB, 208.40 MB, 192.57 MB, 198.41 MB, 197.50 MB, 217.40 MB, 204.57 MB, 188.61 MB, 190.66 MB, 210.89 MB, 199.53 MB, 195.51 MB, 190.52 MB, 210.99 MB, 223.43 MB, 207.49 MB, 204.46 MB, 208.45 MB, 205.32 MB, 189.68 MB, 165.58 MB, 182.69 MB, 188.64 MB, 197.59 MB, 198.88 MB, 203.32 MB, 203.36 MB, 197.44 MB, 180.20 MB, 195.27 MB, 219.51 MB, 219.39 MB, 220.48 MB, 217.41 MB, 213.55 MB, 209.45 MB, 195.18 MB, 179.88 MB, 163.80 MB, 146.28 MB, 141.15 MB, 88.35 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.19 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 227.78 MB (238840942) - PerHostPeakMemUsage: 434.49 MB (455591858) - RowsProduced: 74.36K (74360) - TotalCpuTime: 11m41s - TotalNetworkReceiveTime: 2s030ms - TotalNetworkSendTime: 3.043ms - TotalStorageWaitTime: 1s091ms Fragment Instance Lifecycle Timings: - ExecTime: 46s724ms - ExecTreeExecTime: 46s684ms - OpenTime: 2s588ms - ExecTreeOpenTime: 2s067ms - PrepareTime: 37.250ms - ExecTreePrepareTime: 23.730ms CodeGen:(Total: 543.381ms, non-child: 543.381ms, % non-child: 100.00%) - CodegenTime: 4.217ms - CompileTime: 158.406ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 361.034ms - PrepareTime: 23.361ms DataStreamSender (dst_id=19):(Total: 25.727ms, non-child: 25.727ms, % non-child: 100.00%) - BytesSent: 1.77 MB (1850875) - NetworkThroughput(*): 196.39 MB/sec - OverallThroughput: 68.61 MB/sec - RowsReturned: 74.36K (74360) - SerializeBatchTime: 16.624ms - TransmitDataRPCTime: 8.987ms - UncompressedRowBatchSize: 8.94 MB (9371616) AGGREGATION_NODE (id=3):(Total: 48s755ms, non-child: 32s545ms, % non-child: 66.75%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 112.172us - GetResultsTime: 5.670ms - HTResizeTime: 3.312ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11816622) - PinTime: 0.000ns - ReductionFactorEstimate: 258078.54 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 74.36K (74360) - RowsReturnedRate: 1.52 K/sec - StreamingTime: 31s306ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s209ms, non-child: 12s630ms, % non-child: 77.92%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.997ms - PeakMemoryUsage: 11.20 MB (11745322) - ProbeRows: 428.92M (428920978) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s224ms - RowsReturned: 428.92M (428920978) - RowsReturnedRate: 26.46 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.345ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 92.968us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.783ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s031ms, non-child: 1.702ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.313ms - DeserializeRowBatchTimer: 5.337ms - FirstBatchArrivalWaitTime: 1s993ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 35.96 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s547ms, non-child: 1s547ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:5/756.08 MB 9:4/911.58 MB 7:5/276.58 MB 19:8/1.11 GB 14:4/741.35 MB 22:7/1.23 GB 17:6/873.33 MB 15:7/992.23 MB 5:5/653.57 MB 12:6/529.24 MB 0:6/836.59 MB 21:5/925.77 MB 2:6/909.00 MB 18:4/775.46 MB 1:8/902.66 MB 10:9/1.10 GB 13:8/1.11 GB 8:7/887.34 MB 23:7/784.73 MB 6:5/484.15 MB 3:6/907.72 MB 20:8/832.28 MB 11:7/1.23 GB 16:4/398.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 143 out of 143 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:286 BytesRead(1s000ms): 0, 0, 38.42 MB, 98.94 MB, 102.72 MB, 102.72 MB, 131.60 MB, 186.76 MB, 202.69 MB, 205.62 MB, 218.20 MB, 246.62 MB, 281.33 MB, 293.47 MB, 293.47 MB, 339.44 MB, 371.21 MB, 377.07 MB, 380.83 MB, 416.77 MB, 459.87 MB, 487.54 MB, 487.54 MB, 496.33 MB, 518.54 MB, 539.48 MB, 539.48 MB, 554.55 MB, 600.24 MB, 632.07 MB, 655.54 MB, 672.27 MB, 695.58 MB, 704.38 MB, 722.79 MB, 732.78 MB, 783.85 MB, 834.99 MB, 845.07 MB, 851.77 MB, 867.30 MB, 876.10 MB, 882.39 MB, 901.66 MB, 928.03 MB, 960.00 MB, 962.93 MB, 962.93 MB, 962.93 MB - FooterProcessingTime: (Avg: 1.848ms ; Min: 1.037ms ; Max: 7.202ms ; Number of samples: 143) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 962.93 MB (1009703915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 962.93 MB (1009703915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 962.93 MB (1009703915) - DecompressionTime: 702.348ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 143 (143) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 203.63 MB (213521246) - PerReadThreadRawHdfsThroughput: 1.84 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 18.019ms - RowBatchQueuePutWaitTime: 10m1s - RowsRead: 428.98M (428976248) - RowsReturned: 428.92M (428920978) - RowsReturnedRate: 277.13 M/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 16.18K (16184) - ScannerThreadsTotalWallClockTime: 10m53s - MaterializeTupleTime(*): 23s902ms - ScannerThreadsSysTime: 16s907ms - ScannerThreadsUserTime: 34s515ms - ScannerThreadsVoluntaryContextSwitches: 1.30M (1304321) - TotalRawHdfsReadTime(*): 511.338ms - TotalReadThroughput: 19.65 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.34M (2342769) - Rows rejected: 55.27K (55270) - Rows total: 2.34M (2342912) Filter 4 (1.00 MB): - Files processed: 147 (147) - Files rejected: 4 (4) - Files total: 147 (147) - RowGroups processed: 418.85K (418851) - RowGroups rejected: 0 (0) - RowGroups total: 418.85K (418851) - Rows processed: 2.34M (2342769) - Rows rejected: 0 (0) - Rows total: 2.34M (2342912) - Splits processed: 143 (143) - Splits rejected: 0 (0) - Splits total: 143 (143) Instance 594518549f864a64:8 (host=d2404.halxg.cloudera.com:22000):(Total: 2s625ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/522.96 MB 22:6/805.56 MB 20:3/489.00 MB 2:5/688.40 MB 21:4/639.71 MB 13:6/770.39 MB 11:4/742.04 MB 8:7/1.13 GB 17:5/756.44 MB 0:5/619.97 MB 10:8/935.46 MB 12:3/352.34 MB 16:7/991.33 MB 4:8/1.61 GB 6:6/635.93 MB 3:6/873.30 MB 7:6/907.77 MB 15:9/1.26 GB 14:8/1.22 GB 9:9/1.13 GB 19:11/1.46 GB 18:5/620.79 MB 5:6/1010.23 MB Filter 2 arrival: 2s550ms Filter 4 arrival: 2s597ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 93.38 MB, 196.48 MB, 196.40 MB, 196.24 MB, 193.67 MB, 215.87 MB, 220.17 MB, 204.57 MB, 188.75 MB, 197.09 MB, 212.93 MB, 212.36 MB, 191.76 MB, 205.62 MB, 214.35 MB, 210.41 MB, 194.59 MB, 187.90 MB, 195.98 MB, 203.57 MB, 191.49 MB, 205.28 MB, 211.04 MB, 211.62 MB, 195.56 MB, 193.66 MB, 208.25 MB, 218.88 MB, 203.14 MB, 203.10 MB, 212.50 MB, 229.52 MB, 209.60 MB, 197.71 MB, 197.55 MB, 208.45 MB, 200.45 MB, 179.30 MB, 194.92 MB, 198.07 MB, 195.36 MB, 195.48 MB, 189.45 MB, 187.05 MB, 160.82 MB, 130.43 MB, 65.08 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.33 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 233.66 MB (245014834) - PerHostPeakMemUsage: 446.16 MB (467827573) - RowsProduced: 75.04K (75036) - TotalCpuTime: 11m38s - TotalNetworkReceiveTime: 2s022ms - TotalNetworkSendTime: 3.271ms - TotalStorageWaitTime: 1s061ms Fragment Instance Lifecycle Timings: - ExecTime: 46s507ms - ExecTreeExecTime: 46s460ms - OpenTime: 2s583ms - ExecTreeOpenTime: 2s057ms - PrepareTime: 41.642ms - ExecTreePrepareTime: 24.055ms CodeGen:(Total: 548.030ms, non-child: 548.030ms, % non-child: 100.00%) - CodegenTime: 4.959ms - CompileTime: 165.090ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 358.278ms - PrepareTime: 24.038ms DataStreamSender (dst_id=19):(Total: 26.316ms, non-child: 26.316ms, % non-child: 100.00%) - BytesSent: 1.74 MB (1820612) - NetworkThroughput(*): 195.69 MB/sec - OverallThroughput: 65.98 MB/sec - RowsReturned: 75.04K (75036) - SerializeBatchTime: 17.327ms - TransmitDataRPCTime: 8.872ms - UncompressedRowBatchSize: 9.02 MB (9456820) AGGREGATION_NODE (id=3):(Total: 48s521ms, non-child: 32s330ms, % non-child: 66.63%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 221.284us - GetResultsTime: 5.548ms - HTResizeTime: 3.350ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11813456) - PinTime: 0.000ns - ReductionFactorEstimate: 257775.51 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 75.04K (75036) - RowsReturnedRate: 1.55 K/sec - StreamingTime: 31s128ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s190ms, non-child: 12s672ms, % non-child: 78.27%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.625ms - PeakMemoryUsage: 11.20 MB (11742295) - ProbeRows: 430.16M (430155841) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s265ms - RowsReturned: 430.16M (430155841) - RowsReturnedRate: 26.57 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.798ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 108.084us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.949ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s023ms, non-child: 1.685ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.270ms - DeserializeRowBatchTimer: 5.044ms - FirstBatchArrivalWaitTime: 1s985ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s494ms, non-child: 1s494ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/522.96 MB 22:6/805.56 MB 20:3/489.00 MB 2:5/688.40 MB 21:4/639.71 MB 13:6/770.39 MB 11:4/742.04 MB 8:7/1.13 GB 17:5/756.44 MB 0:5/619.97 MB 10:8/935.46 MB 12:3/352.34 MB 16:7/991.33 MB 4:8/1.61 GB 6:6/635.93 MB 3:6/873.30 MB 7:6/907.77 MB 15:9/1.26 GB 14:8/1.22 GB 9:9/1.13 GB 19:11/1.46 GB 18:5/620.79 MB 5:6/1010.23 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 136 out of 136 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:97.94% 1:2.062% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:272 BytesRead(1s000ms): 0, 0, 52.83 MB, 111.51 MB, 111.51 MB, 111.51 MB, 137.47 MB, 192.31 MB, 202.80 MB, 202.80 MB, 202.80 MB, 239.66 MB, 279.36 MB, 293.15 MB, 299.44 MB, 333.42 MB, 360.24 MB, 366.11 MB, 372.00 MB, 388.29 MB, 431.52 MB, 459.17 MB, 465.00 MB, 510.72 MB, 535.85 MB, 545.86 MB, 552.56 MB, 577.31 MB, 619.59 MB, 648.87 MB, 655.97 MB, 672.66 MB, 698.96 MB, 730.36 MB, 730.36 MB, 745.45 MB, 775.61 MB, 800.32 MB, 809.55 MB, 820.36 MB, 872.70 MB, 891.95 MB, 901.16 MB, 904.09 MB, 923.80 MB, 946.33 MB, 964.78 MB, 964.78 MB, 964.78 MB - FooterProcessingTime: (Avg: 1.782ms ; Min: 971.912us ; Max: 5.420ms ; Number of samples: 136) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 964.78 MB (1011646891) - BytesReadDataNodeCache: 0 - BytesReadLocal: 964.78 MB (1011646891) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 964.78 MB (1011646891) - DecompressionTime: 713.022ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 23 (23) - NumRowGroups: 136 (136) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.52 MB (219695138) - PerReadThreadRawHdfsThroughput: 1.89 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.715ms - RowBatchQueuePutWaitTime: 10m4s - RowsRead: 430.21M (430208224) - RowsReturned: 430.16M (430155841) - RowsReturnedRate: 287.82 M/sec - ScanRangesComplete: 140 (140) - ScannerThreadsInvoluntaryContextSwitches: 15.64K (15638) - ScannerThreadsTotalWallClockTime: 10m50s - MaterializeTupleTime(*): 23s045ms - ScannerThreadsSysTime: 14s276ms - ScannerThreadsUserTime: 32s179ms - ScannerThreadsVoluntaryContextSwitches: 940.53K (940532) - TotalRawHdfsReadTime(*): 498.244ms - TotalReadThroughput: 19.69 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.23M (2228088) - Rows rejected: 52.38K (52383) - Rows total: 2.23M (2228224) Filter 4 (1.00 MB): - Files processed: 140 (140) - Files rejected: 4 (4) - Files total: 140 (140) - RowGroups processed: 420.06K (420055) - RowGroups rejected: 0 (0) - RowGroups total: 420.06K (420055) - Rows processed: 2.23M (2228088) - Rows rejected: 0 (0) - Rows total: 2.23M (2228224) - Splits processed: 136 (136) - Splits rejected: 0 (0) - Splits total: 136 (136) Instance 594518549f864a64:2 (host=d2406.halxg.cloudera.com:22000):(Total: 2s624ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 22:2/268.65 MB 23:3/624.50 MB 0:5/723.22 MB 1:3/352.67 MB 14:8/1.01 GB 8:8/1.11 GB 7:8/1.18 GB 6:6/873.45 MB 4:4/504.15 MB 21:4/502.27 MB 3:9/1.23 GB 20:9/1.40 GB 11:4/605.44 MB 5:4/638.84 MB 16:8/902.51 MB 17:4/742.10 MB 10:6/874.04 MB 12:7/922.35 MB 9:10/1.38 GB 18:9/1.20 GB 15:5/413.97 MB 2:4/640.56 MB 19:9/1.29 GB 13:4/606.07 MB Filter 2 arrival: 2s550ms Filter 4 arrival: 2s596ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 6.88 MB, 180.02 MB, 184.37 MB, 184.45 MB, 162.02 MB, 189.03 MB, 197.91 MB, 194.52 MB, 185.04 MB, 214.52 MB, 214.41 MB, 210.37 MB, 194.45 MB, 192.58 MB, 191.98 MB, 177.62 MB, 166.48 MB, 179.36 MB, 191.06 MB, 197.32 MB, 206.47 MB, 203.51 MB, 215.39 MB, 211.39 MB, 199.62 MB, 197.59 MB, 201.77 MB, 203.64 MB, 195.02 MB, 206.52 MB, 215.30 MB, 227.46 MB, 203.58 MB, 202.66 MB, 210.33 MB, 205.56 MB, 201.62 MB, 188.87 MB, 189.60 MB, 213.30 MB, 211.32 MB, 195.08 MB, 193.62 MB, 256.33 MB, 321.15 MB, 321.69 MB, 269.84 MB, 202.12 MB ThreadUsage(1s000ms): 1, 2, 2, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.21 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 337.77 MB (354172356) - PerHostPeakMemUsage: 404.25 MB (423884539) - RowsProduced: 79.09K (79092) - TotalCpuTime: 11m50s - TotalNetworkReceiveTime: 2s021ms - TotalNetworkSendTime: 3.437ms - TotalStorageWaitTime: 1s129ms Fragment Instance Lifecycle Timings: - ExecTime: 47s336ms - ExecTreeExecTime: 47s286ms - OpenTime: 2s582ms - ExecTreeOpenTime: 2s058ms - PrepareTime: 42.320ms - ExecTreePrepareTime: 24.757ms CodeGen:(Total: 547.095ms, non-child: 547.095ms, % non-child: 100.00%) - CodegenTime: 5.110ms - CompileTime: 162.661ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 358.812ms - PrepareTime: 24.998ms DataStreamSender (dst_id=19):(Total: 29.509ms, non-child: 29.509ms, % non-child: 100.00%) - BytesSent: 1.83 MB (1920623) - NetworkThroughput(*): 175.34 MB/sec - OverallThroughput: 62.07 MB/sec - RowsReturned: 79.09K (79092) - SerializeBatchTime: 18.927ms - TransmitDataRPCTime: 10.445ms - UncompressedRowBatchSize: 9.51 MB (9968000) AGGREGATION_NODE (id=3):(Total: 49s348ms, non-child: 32s831ms, % non-child: 66.53%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 895.520us - GetResultsTime: 5.657ms - HTResizeTime: 3.877ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 139.22 MB (145985407) - PinTime: 0.000ns - ReductionFactorEstimate: 258833.13 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 79.09K (79092) - RowsReturnedRate: 1.60 K/sec - StreamingTime: 31s570ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s516ms, non-child: 12s934ms, % non-child: 78.32%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.659ms - PeakMemoryUsage: 11.19 MB (11737022) - ProbeRows: 438.56M (438564853) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s483ms - RowsReturned: 438.56M (438564853) - RowsReturnedRate: 26.55 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.763ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 116.708us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.909ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s023ms, non-child: 1.651ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 811.83 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.293ms - DeserializeRowBatchTimer: 5.198ms - FirstBatchArrivalWaitTime: 1s985ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s558ms, non-child: 1s558ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 22:2/268.65 MB 23:3/624.50 MB 0:5/723.22 MB 1:3/352.67 MB 14:8/1.01 GB 8:8/1.11 GB 7:8/1.18 GB 6:6/873.45 MB 4:4/504.15 MB 21:4/502.27 MB 3:9/1.23 GB 20:9/1.40 GB 11:4/605.44 MB 5:4/638.84 MB 16:8/902.51 MB 17:4/742.10 MB 10:6/874.04 MB 12:7/922.35 MB 9:10/1.38 GB 18:9/1.20 GB 15:5/413.97 MB 2:4/640.56 MB 19:9/1.29 GB 13:4/606.07 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:97.98% 1:2.02% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:282 BytesRead(1s000ms): 0, 0, 0, 100.81 MB, 103.74 MB, 103.74 MB, 111.55 MB, 166.27 MB, 200.94 MB, 203.86 MB, 210.53 MB, 280.13 MB, 286.00 MB, 297.75 MB, 298.31 MB, 318.22 MB, 344.56 MB, 360.44 MB, 364.56 MB, 405.68 MB, 440.90 MB, 466.96 MB, 488.78 MB, 511.33 MB, 529.72 MB, 541.45 MB, 547.31 MB, 572.05 MB, 602.65 MB, 632.84 MB, 642.87 MB, 668.46 MB, 696.52 MB, 727.55 MB, 731.32 MB, 741.38 MB, 782.38 MB, 800.83 MB, 807.13 MB, 819.66 MB, 837.69 MB, 893.46 MB, 899.32 MB, 910.54 MB, 932.72 MB, 960.40 MB, 973.33 MB, 980.02 MB, 983.77 MB, 983.77 MB - FooterProcessingTime: (Avg: 2.333ms ; Min: 1.032ms ; Max: 10.782ms ; Number of samples: 141) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 13.29 - BytesRead: 983.77 MB (1031561738) - BytesReadDataNodeCache: 0 - BytesReadLocal: 983.77 MB (1031561738) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 983.77 MB (1031561738) - DecompressionTime: 739.416ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 141 (141) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 203.54 MB (213422505) - PerReadThreadRawHdfsThroughput: 1.78 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.542ms - RowBatchQueuePutWaitTime: 10m19s - RowsRead: 438.62M (438619350) - RowsReturned: 438.56M (438564853) - RowsReturnedRate: 281.38 M/sec - ScanRangesComplete: 143 (143) - ScannerThreadsInvoluntaryContextSwitches: 16.19K (16192) - ScannerThreadsTotalWallClockTime: 11m1s - MaterializeTupleTime(*): 24s066ms - ScannerThreadsSysTime: 10s541ms - ScannerThreadsUserTime: 31s838ms - ScannerThreadsVoluntaryContextSwitches: 761.07K (761072) - TotalRawHdfsReadTime(*): 539.588ms - TotalReadThroughput: 19.68 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.31M (2310003) - Rows rejected: 54.50K (54497) - Rows total: 2.31M (2310144) Filter 4 (1.00 MB): - Files processed: 143 (143) - Files rejected: 2 (2) - Files total: 143 (143) - RowGroups processed: 428.27K (428274) - RowGroups rejected: 0 (0) - RowGroups total: 428.27K (428274) - Rows processed: 2.31M (2310003) - Rows rejected: 0 (0) - Rows total: 2.31M (2310144) - Splits processed: 141 (141) - Splits rejected: 0 (0) - Splits total: 141 (141) Instance 594518549f864a64:d (host=d2409.halxg.cloudera.com:22000):(Total: 2s624ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:3/384.91 MB 22:4/639.73 MB 0:5/685.93 MB 3:5/653.64 MB 1:6/665.64 MB 16:5/859.61 MB 2:5/756.05 MB 5:7/1.23 GB 12:8/639.93 MB 15:6/770.87 MB 9:6/907.61 MB 8:6/1010.86 MB 18:6/1.02 GB 20:5/756.86 MB 17:5/549.90 MB 13:7/817.94 MB 19:8/1003.04 MB 23:8/1.12 GB 21:6/873.43 MB 4:7/1.13 GB 14:7/1023.78 MB 10:6/738.30 MB 11:6/801.91 MB 7:8/1.15 GB Filter 2 arrival: 2s555ms Filter 4 arrival: 2s590ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 104.96 MB, 208.38 MB, 208.44 MB, 208.45 MB, 211.40 MB, 217.42 MB, 220.32 MB, 172.77 MB, 175.79 MB, 208.39 MB, 208.50 MB, 200.39 MB, 187.55 MB, 219.41 MB, 216.27 MB, 187.51 MB, 192.24 MB, 204.86 MB, 209.36 MB, 185.55 MB, 169.76 MB, 182.57 MB, 192.53 MB, 183.40 MB, 201.51 MB, 227.35 MB, 223.40 MB, 226.45 MB, 201.59 MB, 199.22 MB, 191.11 MB, 184.19 MB, 183.71 MB, 185.13 MB, 195.50 MB, 201.52 MB, 203.36 MB, 194.05 MB, 194.69 MB, 216.33 MB, 200.23 MB, 205.54 MB, 207.34 MB, 193.85 MB, 174.75 MB, 112.19 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.32 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 227.79 MB (238851775) - PerHostPeakMemUsage: 416.66 MB (436898048) - RowsProduced: 73.01K (73008) - TotalCpuTime: 11m31s - TotalNetworkReceiveTime: 2s017ms - TotalNetworkSendTime: 3.384ms - TotalStorageWaitTime: 1s154ms Fragment Instance Lifecycle Timings: - ExecTime: 46s040ms - ExecTreeExecTime: 46s002ms - OpenTime: 2s582ms - ExecTreeOpenTime: 2s058ms - PrepareTime: 41.694ms - ExecTreePrepareTime: 24.446ms CodeGen:(Total: 546.140ms, non-child: 546.140ms, % non-child: 100.00%) - CodegenTime: 4.857ms - CompileTime: 162.274ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 358.573ms - PrepareTime: 24.681ms DataStreamSender (dst_id=19):(Total: 23.946ms, non-child: 23.946ms, % non-child: 100.00%) - BytesSent: 1.72 MB (1803591) - NetworkThroughput(*): 215.66 MB/sec - OverallThroughput: 71.83 MB/sec - RowsReturned: 73.01K (73008) - SerializeBatchTime: 15.869ms - TransmitDataRPCTime: 7.975ms - UncompressedRowBatchSize: 8.77 MB (9201232) AGGREGATION_NODE (id=3):(Total: 48s064ms, non-child: 32s099ms, % non-child: 66.78%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 176.480us - GetResultsTime: 4.847ms - HTResizeTime: 3.319ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.28 MB (11823709) - PinTime: 0.000ns - ReductionFactorEstimate: 258753.81 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 73.01K (73008) - RowsReturnedRate: 1.52 K/sec - StreamingTime: 30s648ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 15s965ms, non-child: 12s508ms, % non-child: 78.35%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 14.669ms - PeakMemoryUsage: 11.19 MB (11732227) - ProbeRows: 434.36M (434363297) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s108ms - RowsReturned: 434.36M (434363297) - RowsReturnedRate: 27.21 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.628ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 95.892us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.122ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s018ms, non-child: 1.761ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.408ms - DeserializeRowBatchTimer: 4.592ms - FirstBatchArrivalWaitTime: 1s981ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s437ms, non-child: 1s437ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:3/384.91 MB 22:4/639.73 MB 0:5/685.93 MB 3:5/653.64 MB 1:6/665.64 MB 16:5/859.61 MB 2:5/756.05 MB 5:7/1.23 GB 12:8/639.93 MB 15:6/770.87 MB 9:6/907.61 MB 8:6/1010.86 MB 18:6/1.02 GB 20:5/756.86 MB 17:5/549.90 MB 13:7/817.94 MB 19:8/1003.04 MB 23:8/1.12 GB 21:6/873.43 MB 4:7/1.13 GB 14:7/1023.78 MB 10:6/738.30 MB 11:6/801.91 MB 7:8/1.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 141 out of 141 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:282 BytesRead(1s000ms): 0, 0, 63.80 MB, 127.60 MB, 127.60 MB, 127.60 MB, 146.46 MB, 177.48 MB, 189.64 MB, 189.64 MB, 201.80 MB, 278.12 MB, 286.92 MB, 286.92 MB, 308.64 MB, 371.02 MB, 373.95 MB, 380.61 MB, 409.84 MB, 447.04 MB, 453.29 MB, 457.05 MB, 471.22 MB, 528.32 MB, 555.42 MB, 563.25 MB, 585.42 MB, 643.30 MB, 650.05 MB, 659.23 MB, 671.39 MB, 677.63 MB, 711.80 MB, 724.33 MB, 744.82 MB, 774.06 MB, 810.86 MB, 829.30 MB, 835.16 MB, 851.00 MB, 873.96 MB, 917.54 MB, 930.07 MB, 942.19 MB, 968.18 MB, 974.83 MB, 974.83 MB, 974.83 MB - FooterProcessingTime: (Avg: 2.010ms ; Min: 1.038ms ; Max: 8.838ms ; Number of samples: 141) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 974.83 MB (1022179682) - BytesReadDataNodeCache: 0 - BytesReadLocal: 974.83 MB (1022179682) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 974.83 MB (1022179682) - DecompressionTime: 721.893ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 141 (141) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 203.64 MB (213532079) - PerReadThreadRawHdfsThroughput: 1.72 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.688ms - RowBatchQueuePutWaitTime: 10m1s - RowsRead: 434.42M (434418126) - RowsReturned: 434.36M (434363297) - RowsReturnedRate: 302.12 M/sec - ScanRangesComplete: 145 (145) - ScannerThreadsInvoluntaryContextSwitches: 12.92K (12922) - ScannerThreadsTotalWallClockTime: 10m43s - MaterializeTupleTime(*): 22s605ms - ScannerThreadsSysTime: 10s849ms - ScannerThreadsUserTime: 31s437ms - ScannerThreadsVoluntaryContextSwitches: 891.98K (891984) - TotalRawHdfsReadTime(*): 554.904ms - TotalReadThroughput: 20.10 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.31M (2310003) - Rows rejected: 54.83K (54829) - Rows total: 2.31M (2310144) Filter 4 (1.00 MB): - Files processed: 145 (145) - Files rejected: 4 (4) - Files total: 145 (145) - RowGroups processed: 424.17K (424166) - RowGroups rejected: 0 (0) - RowGroups total: 424.17K (424166) - Rows processed: 2.31M (2310003) - Rows rejected: 0 (0) - Rows total: 2.31M (2310144) - Splits processed: 141 (141) - Splits rejected: 0 (0) - Splits total: 141 (141) Instance 594518549f864a64:9 (host=d2421.halxg.cloudera.com:22000):(Total: 2s622ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:3/282.04 MB 3:4/775.20 MB 21:2/268.43 MB 22:4/605.68 MB 16:7/918.89 MB 11:9/1.36 GB 2:3/522.27 MB 14:5/891.83 MB 4:7/304.19 MB 9:4/296.40 MB 17:4/502.65 MB 8:8/1.12 GB 20:11/1.83 GB 13:11/1.26 GB 10:5/892.39 MB 7:7/919.32 MB 1:10/1.17 GB 18:4/775.47 MB 6:8/1.08 GB 23:7/887.75 MB 19:6/770.25 MB 5:7/1.14 GB 15:6/905.87 MB 12:6/737.16 MB Filter 2 arrival: 2s548ms Filter 4 arrival: 2s594ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 80.63 MB, 194.96 MB, 202.46 MB, 202.36 MB, 203.93 MB, 189.99 MB, 211.58 MB, 188.95 MB, 180.60 MB, 189.99 MB, 208.42 MB, 200.49 MB, 192.49 MB, 201.69 MB, 204.44 MB, 221.60 MB, 213.49 MB, 200.59 MB, 211.54 MB, 209.40 MB, 215.39 MB, 195.70 MB, 188.06 MB, 199.98 MB, 201.26 MB, 193.47 MB, 188.13 MB, 208.59 MB, 226.51 MB, 233.46 MB, 224.62 MB, 224.62 MB, 222.03 MB, 217.08 MB, 197.77 MB, 190.72 MB, 186.09 MB, 196.05 MB, 196.93 MB, 194.14 MB, 182.06 MB, 197.96 MB, 194.98 MB, 205.27 MB, 203.61 MB, 211.42 MB, 199.18 MB, 184.92 MB, 139.34 MB, 83.67 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.24 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 233.66 MB (245014946) - PerHostPeakMemUsage: 376.57 MB (394860975) - RowsProduced: 76.39K (76388) - TotalCpuTime: 12m28s - TotalNetworkReceiveTime: 2s007ms - TotalNetworkSendTime: 4.055ms - TotalStorageWaitTime: 1s151ms Fragment Instance Lifecycle Timings: - ExecTime: 49s852ms - ExecTreeExecTime: 49s810ms - OpenTime: 2s573ms - ExecTreeOpenTime: 2s043ms - PrepareTime: 49.936ms - ExecTreePrepareTime: 26.052ms CodeGen:(Total: 553.967ms, non-child: 553.967ms, % non-child: 100.00%) - CodegenTime: 6.201ms - CompileTime: 162.213ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 364.599ms - PrepareTime: 26.529ms DataStreamSender (dst_id=19):(Total: 27.604ms, non-child: 27.604ms, % non-child: 100.00%) - BytesSent: 1.80 MB (1889919) - NetworkThroughput(*): 179.73 MB/sec - OverallThroughput: 65.29 MB/sec - RowsReturned: 76.39K (76388) - SerializeBatchTime: 17.468ms - TransmitDataRPCTime: 10.028ms - UncompressedRowBatchSize: 9.18 MB (9627200) AGGREGATION_NODE (id=3):(Total: 51s857ms, non-child: 34s206ms, % non-child: 65.96%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 453.616us - GetResultsTime: 5.133ms - HTResizeTime: 3.710ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11812886) - PinTime: 0.000ns - ReductionFactorEstimate: 258168.01 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 76.39K (76388) - RowsReturnedRate: 1.47 K/sec - StreamingTime: 32s732ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 17s650ms, non-child: 13s803ms, % non-child: 78.21%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.807ms - PeakMemoryUsage: 11.19 MB (11736147) - ProbeRows: 442.69M (442687537) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 13s315ms - RowsReturned: 442.69M (442687537) - RowsReturnedRate: 25.08 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.006ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 97.232us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.987ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s009ms, non-child: 1.657ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.339ms - DeserializeRowBatchTimer: 4.626ms - FirstBatchArrivalWaitTime: 1s970ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.36 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s837ms, non-child: 1s837ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:3/282.04 MB 3:4/775.20 MB 21:2/268.43 MB 22:4/605.68 MB 16:7/918.89 MB 11:9/1.36 GB 2:3/522.27 MB 14:5/891.83 MB 4:7/304.19 MB 9:4/296.40 MB 17:4/502.65 MB 8:8/1.12 GB 20:11/1.83 GB 13:11/1.26 GB 10:5/892.39 MB 7:7/919.32 MB 1:10/1.17 GB 18:4/775.47 MB 6:8/1.08 GB 23:7/887.75 MB 19:6/770.25 MB 5:7/1.14 GB 15:6/905.87 MB 12:6/737.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 146 out of 146 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:292 BytesRead(1s000ms): 0, 0, 48.07 MB, 124.14 MB, 130.43 MB, 130.43 MB, 150.97 MB, 155.83 MB, 203.82 MB, 209.67 MB, 209.67 MB, 245.24 MB, 292.59 MB, 298.46 MB, 298.46 MB, 335.78 MB, 364.20 MB, 398.06 MB, 398.06 MB, 404.36 MB, 426.18 MB, 459.58 MB, 482.63 MB, 482.63 MB, 497.70 MB, 533.21 MB, 554.99 MB, 557.92 MB, 586.38 MB, 627.07 MB, 667.33 MB, 682.84 MB, 692.06 MB, 704.22 MB, 710.46 MB, 730.94 MB, 737.65 MB, 762.40 MB, 786.66 MB, 815.48 MB, 830.95 MB, 843.43 MB, 860.42 MB, 885.46 MB, 911.40 MB, 930.23 MB, 972.02 MB, 993.72 MB, 993.72 MB, 993.72 MB, 993.72 MB, 993.72 MB - FooterProcessingTime: (Avg: 2.366ms ; Min: 1.158ms ; Max: 10.135ms ; Number of samples: 146) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.46 - BytesRead: 993.72 MB (1041986003) - BytesReadDataNodeCache: 0 - BytesReadLocal: 993.72 MB (1041986003) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 993.72 MB (1041986003) - DecompressionTime: 749.954ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 146 (146) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.52 MB (219695250) - PerReadThreadRawHdfsThroughput: 1.78 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.452ms - RowBatchQueuePutWaitTime: 10m45s - RowsRead: 442.74M (442743496) - RowsReturned: 442.69M (442687537) - RowsReturnedRate: 240.88 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 19.41K (19411) - ScannerThreadsTotalWallClockTime: 11m36s - MaterializeTupleTime(*): 26s242ms - ScannerThreadsSysTime: 14s558ms - ScannerThreadsUserTime: 38s427ms - ScannerThreadsVoluntaryContextSwitches: 996.57K (996566) - TotalRawHdfsReadTime(*): 545.794ms - TotalReadThroughput: 19.11 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.39M (2391918) - Rows rejected: 55.96K (55959) - Rows total: 2.39M (2392064) Filter 4 (1.00 MB): - Files processed: 148 (148) - Files rejected: 2 (2) - Files total: 148 (148) - RowGroups processed: 432.29K (432294) - RowGroups rejected: 0 (0) - RowGroups total: 432.29K (432294) - Rows processed: 2.39M (2391918) - Rows rejected: 0 (0) - Rows total: 2.39M (2392064) - Splits processed: 146 (146) - Splits rejected: 0 (0) - Splits total: 146 (146) Instance 594518549f864a64:4 (host=d2414.halxg.cloudera.com:22000):(Total: 2s621ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:5/995.42 MB 9:2/405.15 MB 22:6/906.03 MB 17:3/384.35 MB 2:7/1023.79 MB 4:6/771.18 MB 16:7/990.42 MB 14:8/1.05 GB 12:8/1005.71 MB 15:6/1009.79 MB 11:7/1023.61 MB 13:5/620.82 MB 10:6/840.91 MB 3:8/1.01 GB 20:5/756.59 MB 7:6/737.94 MB 5:3/624.78 MB 0:6/873.37 MB 1:6/737.64 MB 18:7/990.53 MB 21:4/398.38 MB 8:7/1.06 GB 6:5/788.72 MB 23:9/1.06 GB Filter 2 arrival: 2s548ms Filter 4 arrival: 2s594ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 67.23 MB, 182.99 MB, 190.40 MB, 190.47 MB, 177.56 MB, 205.50 MB, 214.45 MB, 202.46 MB, 190.55 MB, 201.39 MB, 214.36 MB, 214.48 MB, 189.59 MB, 183.78 MB, 215.46 MB, 211.36 MB, 197.61 MB, 211.89 MB, 220.10 MB, 219.42 MB, 203.58 MB, 191.74 MB, 201.66 MB, 199.20 MB, 187.54 MB, 190.14 MB, 229.28 MB, 228.98 MB, 217.08 MB, 217.50 MB, 223.57 MB, 222.46 MB, 189.73 MB, 177.74 MB, 193.05 MB, 209.46 MB, 209.54 MB, 196.93 MB, 195.09 MB, 203.41 MB, 201.51 MB, 188.59 MB, 198.48 MB, 197.30 MB, 168.83 MB, 150.77 MB, 98.49 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.33 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 233.81 MB (245171134) - PerHostPeakMemUsage: 452.28 MB (474247758) - RowsProduced: 70.30K (70304) - TotalCpuTime: 11m44s - TotalNetworkReceiveTime: 2s010ms - TotalNetworkSendTime: 3.108ms - TotalStorageWaitTime: 1s154ms Fragment Instance Lifecycle Timings: - ExecTime: 46s949ms - ExecTreeExecTime: 46s913ms - OpenTime: 2s576ms - ExecTreeOpenTime: 2s045ms - PrepareTime: 45.553ms - ExecTreePrepareTime: 24.165ms CodeGen:(Total: 553.317ms, non-child: 553.317ms, % non-child: 100.00%) - CodegenTime: 6.238ms - CompileTime: 164.865ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 363.019ms - PrepareTime: 24.804ms DataStreamSender (dst_id=19):(Total: 24.095ms, non-child: 24.095ms, % non-child: 100.00%) - BytesSent: 1.69 MB (1776814) - NetworkThroughput(*): 208.53 MB/sec - OverallThroughput: 70.32 MB/sec - RowsReturned: 70.30K (70304) - SerializeBatchTime: 15.831ms - TransmitDataRPCTime: 8.125ms - UncompressedRowBatchSize: 8.45 MB (8860444) AGGREGATION_NODE (id=3):(Total: 48s961ms, non-child: 32s734ms, % non-child: 66.86%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 195.524us - GetResultsTime: 4.830ms - HTResizeTime: 3.322ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11837155) - PinTime: 0.000ns - ReductionFactorEstimate: 257416.11 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 70.30K (70304) - RowsReturnedRate: 1.44 K/sec - StreamingTime: 31s499ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s227ms, non-child: 12s755ms, % non-child: 78.60%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 12.619ms - PeakMemoryUsage: 11.19 MB (11738731) - ProbeRows: 437.18M (437175764) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s352ms - RowsReturned: 437.18M (437175764) - RowsReturnedRate: 26.94 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.127ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 93.696us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.752ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 2s011ms, non-child: 1.828ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.527ms - DeserializeRowBatchTimer: 4.317ms - FirstBatchArrivalWaitTime: 1s971ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.31 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s460ms, non-child: 1s460ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:5/995.42 MB 9:2/405.15 MB 22:6/906.03 MB 17:3/384.35 MB 2:7/1023.79 MB 4:6/771.18 MB 16:7/990.42 MB 14:8/1.05 GB 12:8/1005.71 MB 15:6/1009.79 MB 11:7/1023.61 MB 13:5/620.82 MB 10:6/840.91 MB 3:8/1.01 GB 20:5/756.59 MB 7:6/737.94 MB 5:3/624.78 MB 0:6/873.37 MB 1:6/737.64 MB 18:7/990.53 MB 21:4/398.38 MB 8:7/1.06 GB 6:5/788.72 MB 23:9/1.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 140 out of 140 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:280 BytesRead(1s000ms): 0, 0, 34.98 MB, 109.65 MB, 115.95 MB, 115.95 MB, 136.46 MB, 185.85 MB, 210.58 MB, 210.58 MB, 225.24 MB, 272.90 MB, 290.92 MB, 290.92 MB, 310.61 MB, 334.41 MB, 387.16 MB, 387.16 MB, 399.75 MB, 440.36 MB, 474.63 MB, 480.92 MB, 480.92 MB, 496.77 MB, 541.02 MB, 548.05 MB, 560.21 MB, 588.71 MB, 665.46 MB, 672.16 MB, 682.95 MB, 690.47 MB, 706.41 MB, 724.84 MB, 731.13 MB, 749.60 MB, 798.63 MB, 829.24 MB, 829.24 MB, 835.48 MB, 872.26 MB, 898.65 MB, 904.52 MB, 923.81 MB, 964.47 MB, 980.79 MB, 980.79 MB, 980.79 MB, 980.79 MB - FooterProcessingTime: (Avg: 2.467ms ; Min: 1.117ms ; Max: 24.528ms ; Number of samples: 140) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.43 - BytesRead: 980.79 MB (1028435760) - BytesReadDataNodeCache: 0 - BytesReadLocal: 980.79 MB (1028435760) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 980.79 MB (1028435760) - DecompressionTime: 1s288ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 140 (140) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.67 MB (219851438) - PerReadThreadRawHdfsThroughput: 1.77 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.956ms - RowBatchQueuePutWaitTime: 10m8s - RowsRead: 437.23M (437229755) - RowsReturned: 437.18M (437175764) - RowsReturnedRate: 299.32 M/sec - ScanRangesComplete: 142 (142) - ScannerThreadsInvoluntaryContextSwitches: 13.78K (13782) - ScannerThreadsTotalWallClockTime: 10m56s - MaterializeTupleTime(*): 22s996ms - ScannerThreadsSysTime: 13s476ms - ScannerThreadsUserTime: 33s333ms - ScannerThreadsVoluntaryContextSwitches: 940.86K (940855) - TotalRawHdfsReadTime(*): 542.488ms - TotalReadThroughput: 19.81 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.29M (2293620) - Rows rejected: 53.99K (53991) - Rows total: 2.29M (2293760) Filter 4 (1.00 MB): - Files processed: 142 (142) - Files rejected: 2 (2) - Files total: 142 (142) - RowGroups processed: 426.92K (426916) - RowGroups rejected: 0 (0) - RowGroups total: 426.92K (426916) - Rows processed: 2.29M (2293620) - Rows rejected: 0 (0) - Rows total: 2.29M (2293760) - Splits processed: 140 (140) - Splits rejected: 0 (0) - Splits total: 140 (140) Instance 594518549f864a64:a (host=d2401.halxg.cloudera.com:22000):(Total: 2s610ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:3/280.44 MB 16:4/775.81 MB 0:7/1023.55 MB 3:6/907.10 MB 12:6/529.24 MB 10:8/1001.07 MB 6:5/517.00 MB 15:5/995.65 MB 20:8/933.76 MB 14:4/638.96 MB 1:9/1.26 GB 18:7/1.23 GB 17:8/1.11 GB 2:5/755.58 MB 13:3/248.65 MB 23:4/670.98 MB 11:5/518.44 MB 8:6/562.19 MB 5:6/1.15 GB 22:8/764.62 MB 4:5/893.83 MB 21:10/1.27 GB 7:12/1.60 GB 9:3/384.51 MB Filter 2 arrival: 2s537ms Filter 4 arrival: 2s581ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 95.51 MB, 189.82 MB, 189.73 MB, 189.63 MB, 186.92 MB, 191.37 MB, 132.28 MB, 144.49 MB, 171.84 MB, 163.80 MB, 160.50 MB, 162.87 MB, 165.25 MB, 145.96 MB, 151.96 MB, 172.68 MB, 173.74 MB, 176.93 MB, 172.35 MB, 165.83 MB, 168.91 MB, 158.86 MB, 162.88 MB, 159.17 MB, 171.65 MB, 177.69 MB, 172.86 MB, 172.80 MB, 165.90 MB, 170.29 MB, 161.39 MB, 162.84 MB, 173.84 MB, 170.71 MB, 164.78 MB, 163.68 MB, 163.80 MB, 140.00 MB, 161.45 MB, 174.72 MB, 174.74 MB, 162.84 MB, 167.28 MB, 165.87 MB, 150.99 MB, 130.90 MB, 110.75 MB, 50.88 MB ThreadUsage(1s000ms): 1, 2, 7, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 11.49 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 195.96 MB (205483086) - PerHostPeakMemUsage: 373.14 MB (391262307) - RowsProduced: 72.33K (72332) - TotalCpuTime: 9m30s - TotalNetworkReceiveTime: 1s954ms - TotalNetworkSendTime: 3.788ms - TotalStorageWaitTime: 1s034ms Fragment Instance Lifecycle Timings: - ExecTime: 47s462ms - ExecTreeExecTime: 47s423ms - OpenTime: 2s558ms - ExecTreeOpenTime: 1s991ms - PrepareTime: 51.618ms - ExecTreePrepareTime: 29.832ms CodeGen:(Total: 594.290ms, non-child: 594.290ms, % non-child: 100.00%) - CodegenTime: 7.806ms - CompileTime: 170.824ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 393.429ms - PrepareTime: 29.395ms DataStreamSender (dst_id=19):(Total: 23.951ms, non-child: 23.951ms, % non-child: 100.00%) - BytesSent: 1.74 MB (1826165) - NetworkThroughput(*): 222.75 MB/sec - OverallThroughput: 72.71 MB/sec - RowsReturned: 72.33K (72332) - SerializeBatchTime: 16.033ms - TransmitDataRPCTime: 7.818ms - UncompressedRowBatchSize: 8.69 MB (9116032) AGGREGATION_NODE (id=3):(Total: 49s418ms, non-child: 33s059ms, % non-child: 66.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 147.843us - GetResultsTime: 4.747ms - HTResizeTime: 3.652ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.29 MB (11839286) - PinTime: 0.000ns - ReductionFactorEstimate: 257334.57 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 72.33K (72332) - RowsReturnedRate: 1.46 K/sec - StreamingTime: 31s555ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s359ms, non-child: 12s850ms, % non-child: 78.55%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 15.161ms - PeakMemoryUsage: 11.19 MB (11733435) - ProbeRows: 427.02M (427015415) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s393ms - RowsReturned: 427.02M (427015415) - RowsReturnedRate: 26.10 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 10.067ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 148.141us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.779ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s956ms, non-child: 1.841ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.309ms - DeserializeRowBatchTimer: 7.735ms - FirstBatchArrivalWaitTime: 1s919ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 37.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s553ms, non-child: 1s553ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:3/280.44 MB 16:4/775.81 MB 0:7/1023.55 MB 3:6/907.10 MB 12:6/529.24 MB 10:8/1001.07 MB 6:5/517.00 MB 15:5/995.65 MB 20:8/933.76 MB 14:4/638.96 MB 1:9/1.26 GB 18:7/1.23 GB 17:8/1.11 GB 2:5/755.58 MB 13:3/248.65 MB 23:4/670.98 MB 11:5/518.44 MB 8:6/562.19 MB 5:6/1.15 GB 22:8/764.62 MB 4:5/893.83 MB 21:10/1.27 GB 7:12/1.60 GB 9:3/384.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 143 out of 143 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:98.99% 1:1.01% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:4 PARQUET/SNAPPY:286 BytesRead(1s000ms): 0, 0, 60.66 MB, 121.31 MB, 121.31 MB, 124.25 MB, 140.94 MB, 145.81 MB, 148.74 MB, 189.22 MB, 239.37 MB, 242.29 MB, 248.92 MB, 275.66 MB, 300.24 MB, 306.11 MB, 337.85 MB, 369.65 MB, 392.28 MB, 408.63 MB, 429.09 MB, 436.94 MB, 452.83 MB, 473.80 MB, 501.49 MB, 520.33 MB, 549.60 MB, 574.35 MB, 583.58 MB, 606.94 MB, 632.44 MB, 649.10 MB, 665.76 MB, 678.30 MB, 722.22 MB, 728.08 MB, 736.89 MB, 761.20 MB, 785.53 MB, 790.41 MB, 832.62 MB, 867.89 MB, 873.70 MB, 879.57 MB, 904.27 MB, 928.94 MB, 936.03 MB, 952.64 MB, 958.93 MB, 958.93 MB - FooterProcessingTime: (Avg: 2.037ms ; Min: 1.056ms ; Max: 9.499ms ; Number of samples: 143) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 10.56 - BytesRead: 958.93 MB (1005514954) - BytesReadDataNodeCache: 0 - BytesReadLocal: 958.93 MB (1005514954) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 958.93 MB (1005514954) - DecompressionTime: 729.200ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 143 (143) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 172.82 MB (181211966) - PerReadThreadRawHdfsThroughput: 1.90 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.919ms - RowBatchQueuePutWaitTime: 8m - RowsRead: 427.07M (427070365) - RowsReturned: 427.02M (427015415) - RowsReturnedRate: 274.91 M/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 17.36K (17355) - ScannerThreadsTotalWallClockTime: 8m41s - MaterializeTupleTime(*): 23s871ms - ScannerThreadsSysTime: 9s384ms - ScannerThreadsUserTime: 31s682ms - ScannerThreadsVoluntaryContextSwitches: 843.02K (843023) - TotalRawHdfsReadTime(*): 492.044ms - TotalReadThroughput: 19.18 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.34M (2342769) - Rows rejected: 54.95K (54950) - Rows total: 2.34M (2342912) Filter 4 (1.00 MB): - Files processed: 147 (147) - Files rejected: 4 (4) - Files total: 147 (147) - RowGroups processed: 416.99K (416990) - RowGroups rejected: 0 (0) - RowGroups total: 416.99K (416990) - Rows processed: 2.34M (2342769) - Rows rejected: 0 (0) - Rows total: 2.34M (2342912) - Splits processed: 143 (143) - Splits rejected: 0 (0) - Splits total: 143 (143) Instance 594518549f864a64:e (host=d2407.halxg.cloudera.com:22000):(Total: 2s571ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/117.61 MB 1:5/995.39 MB 19:3/418.52 MB 12:3/556.42 MB 18:4/639.85 MB 23:6/874.03 MB 21:7/1.13 GB 14:5/652.36 MB 7:6/939.42 MB 22:5/995.49 MB 5:4/774.31 MB 3:7/1.10 GB 20:7/1.00 GB 8:5/483.20 MB 16:5/790.16 MB 4:7/1.10 GB 2:5/995.79 MB 9:6/906.23 MB 11:9/1.40 GB 6:10/1.24 GB 13:8/1.25 GB 0:3/383.82 MB 17:6/769.38 MB 15:5/550.33 MB Filter 2 arrival: 2s508ms Filter 4 arrival: 2s543ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 101.90 MB, 202.42 MB, 202.46 MB, 202.41 MB, 215.99 MB, 226.42 MB, 232.35 MB, 192.71 MB, 209.57 MB, 229.66 MB, 232.44 MB, 212.48 MB, 209.03 MB, 227.54 MB, 232.43 MB, 192.78 MB, 174.86 MB, 181.22 MB, 184.76 MB, 181.56 MB, 169.53 MB, 211.45 MB, 214.08 MB, 213.36 MB, 216.40 MB, 227.40 MB, 227.45 MB, 205.61 MB, 189.70 MB, 201.60 MB, 213.09 MB, 215.46 MB, 212.35 MB, 210.46 MB, 207.41 MB, 199.50 MB, 174.11 MB, 180.46 MB, 184.24 MB, 199.32 MB, 203.44 MB, 209.47 MB, 197.01 MB, 179.08 MB, 131.06 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.31 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 244.68 MB (256560447) - PerHostPeakMemUsage: 427.93 MB (448721364) - RowsProduced: 69.63K (69628) - TotalCpuTime: 11m20s - TotalNetworkReceiveTime: 1s984ms - TotalNetworkSendTime: 2.507ms - TotalStorageWaitTime: 1s089ms Fragment Instance Lifecycle Timings: - ExecTime: 45s308ms - ExecTreeExecTime: 45s272ms - OpenTime: 2s531ms - ExecTreeOpenTime: 2s019ms - PrepareTime: 39.462ms - ExecTreePrepareTime: 23.893ms CodeGen:(Total: 534.484ms, non-child: 534.484ms, % non-child: 100.00%) - CodegenTime: 4.518ms - CompileTime: 156.403ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 353.803ms - PrepareTime: 23.702ms DataStreamSender (dst_id=19):(Total: 24.345ms, non-child: 24.345ms, % non-child: 100.00%) - BytesSent: 1.64 MB (1715929) - NetworkThroughput(*): 196.44 MB/sec - OverallThroughput: 67.22 MB/sec - RowsReturned: 69.63K (69628) - SerializeBatchTime: 15.924ms - TransmitDataRPCTime: 8.330ms - UncompressedRowBatchSize: 8.37 MB (8775244) AGGREGATION_NODE (id=3):(Total: 47s295ms, non-child: 31s399ms, % non-child: 66.39%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 152.964us - GetResultsTime: 4.687ms - HTResizeTime: 3.855ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.25 MB (11800165) - PinTime: 0.000ns - ReductionFactorEstimate: 258660.86 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 69.63K (69628) - RowsReturnedRate: 1.47 K/sec - StreamingTime: 30s106ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 15s895ms, non-child: 12s567ms, % non-child: 79.06%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.409ms - PeakMemoryUsage: 11.19 MB (11737980) - ProbeRows: 433.69M (433689805) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s177ms - RowsReturned: 433.69M (433689805) - RowsReturnedRate: 27.28 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.808ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 91.520us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.762ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s985ms, non-child: 1.629ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.303ms - DeserializeRowBatchTimer: 4.650ms - FirstBatchArrivalWaitTime: 1s946ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.79 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s343ms, non-child: 1s343ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/117.61 MB 1:5/995.39 MB 19:3/418.52 MB 12:3/556.42 MB 18:4/639.85 MB 23:6/874.03 MB 21:7/1.13 GB 14:5/652.36 MB 7:6/939.42 MB 22:5/995.49 MB 5:4/774.31 MB 3:7/1.10 GB 20:7/1.00 GB 8:5/483.20 MB 16:5/790.16 MB 4:7/1.10 GB 2:5/995.79 MB 9:6/906.23 MB 11:9/1.40 GB 6:10/1.24 GB 13:8/1.25 GB 0:3/383.82 MB 17:6/769.38 MB 15:5/550.33 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 129 out of 129 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:258 BytesRead(1s000ms): 0, 0, 59.91 MB, 119.81 MB, 119.81 MB, 119.81 MB, 180.93 MB, 207.42 MB, 213.66 MB, 213.66 MB, 241.75 MB, 296.18 MB, 316.70 MB, 316.70 MB, 333.47 MB, 366.12 MB, 379.92 MB, 383.70 MB, 396.63 MB, 431.59 MB, 450.74 MB, 457.46 MB, 471.25 MB, 555.09 MB, 579.70 MB, 585.99 MB, 602.74 MB, 625.31 MB, 634.10 MB, 649.61 MB, 658.82 MB, 707.45 MB, 735.93 MB, 755.19 MB, 761.05 MB, 793.27 MB, 796.20 MB, 802.49 MB, 827.19 MB, 864.40 MB, 890.31 MB, 909.57 MB, 930.51 MB, 968.19 MB, 971.23 MB, 971.90 MB, 971.90 MB - FooterProcessingTime: (Avg: 2.237ms ; Min: 1.008ms ; Max: 9.816ms ; Number of samples: 129) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.40 - BytesRead: 971.90 MB (1019111723) - BytesReadDataNodeCache: 0 - BytesReadLocal: 971.90 MB (1019111723) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 971.90 MB (1019111723) - DecompressionTime: 722.924ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 129 (129) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 221.53 MB (232289327) - PerReadThreadRawHdfsThroughput: 1.73 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.397ms - RowBatchQueuePutWaitTime: 9m52s - RowsRead: 433.74M (433739792) - RowsReturned: 433.69M (433689805) - RowsReturnedRate: 322.92 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 11.68K (11682) - ScannerThreadsTotalWallClockTime: 10m33s - MaterializeTupleTime(*): 22s592ms - ScannerThreadsSysTime: 10s403ms - ScannerThreadsUserTime: 30s315ms - ScannerThreadsVoluntaryContextSwitches: 775.60K (775600) - TotalRawHdfsReadTime(*): 549.276ms - TotalReadThroughput: 20.46 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.11M (2113407) - Rows rejected: 49.99K (49987) - Rows total: 2.11M (2113536) Filter 4 (1.00 MB): - Files processed: 132 (132) - Files rejected: 3 (3) - Files total: 132 (132) - RowGroups processed: 423.52K (423517) - RowGroups rejected: 0 (0) - RowGroups total: 423.52K (423517) - Rows processed: 2.11M (2113407) - Rows rejected: 0 (0) - Rows total: 2.11M (2113536) - Splits processed: 129 (129) - Splits rejected: 0 (0) - Splits total: 129 (129) Instance 594518549f864a64:10 (host=d2405.halxg.cloudera.com:22000):(Total: 2s569ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:5/859.83 MB 18:6/1.12 GB 11:3/658.34 MB 20:7/1.13 GB 8:9/1.23 GB 1:7/1.10 GB 17:6/462.17 MB 0:6/532.07 MB 21:5/789.60 MB 14:8/1.15 GB 7:6/769.29 MB 10:5/788.89 MB 16:6/562.51 MB 6:5/651.40 MB 23:8/934.00 MB 13:4/502.24 MB 15:7/958.63 MB 3:1/253.61 MB 12:8/1.05 GB 9:4/671.83 MB 19:8/1.12 GB 2:7/1.14 GB 5:8/868.73 MB 22:7/818.20 MB Filter 2 arrival: 2s506ms Filter 4 arrival: 2s541ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 79.40 MB, 185.98 MB, 190.42 MB, 190.35 MB, 185.98 MB, 222.93 MB, 238.54 MB, 218.64 MB, 214.57 MB, 224.77 MB, 232.47 MB, 184.90 MB, 174.87 MB, 204.17 MB, 220.49 MB, 212.53 MB, 208.04 MB, 209.05 MB, 221.34 MB, 201.57 MB, 181.85 MB, 189.09 MB, 204.95 MB, 219.51 MB, 216.54 MB, 209.13 MB, 205.13 MB, 197.27 MB, 191.74 MB, 182.10 MB, 200.65 MB, 206.33 MB, 209.39 MB, 196.99 MB, 190.04 MB, 191.55 MB, 177.00 MB, 171.08 MB, 166.21 MB, 184.95 MB, 197.44 MB, 201.92 MB, 278.28 MB, 328.05 MB, 299.90 MB, 259.44 MB, 195.15 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.33 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 343.84 MB (360540348) - PerHostPeakMemUsage: 386.37 MB (405137773) - RowsProduced: 78.42K (78416) - TotalCpuTime: 11m35s - TotalNetworkReceiveTime: 1s968ms - TotalNetworkSendTime: 2.886ms - TotalStorageWaitTime: 1s129ms Fragment Instance Lifecycle Timings: - ExecTime: 46s341ms - ExecTreeExecTime: 46s296ms - OpenTime: 2s527ms - ExecTreeOpenTime: 2s005ms - PrepareTime: 41.817ms - ExecTreePrepareTime: 23.049ms CodeGen:(Total: 543.971ms, non-child: 543.971ms, % non-child: 100.00%) - CodegenTime: 4.597ms - CompileTime: 158.973ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 361.620ms - PrepareTime: 22.768ms DataStreamSender (dst_id=19):(Total: 29.325ms, non-child: 29.325ms, % non-child: 100.00%) - BytesSent: 1.84 MB (1928389) - NetworkThroughput(*): 190.03 MB/sec - OverallThroughput: 62.71 MB/sec - RowsReturned: 78.42K (78416) - SerializeBatchTime: 19.535ms - TransmitDataRPCTime: 9.677ms - UncompressedRowBatchSize: 9.42 MB (9882788) AGGREGATION_NODE (id=3):(Total: 48s304ms, non-child: 32s159ms, % non-child: 66.58%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 811.384us - GetResultsTime: 5.835ms - HTResizeTime: 3.818ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 139.21 MB (145976738) - PinTime: 0.000ns - ReductionFactorEstimate: 259059.49 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 78.42K (78416) - RowsReturnedRate: 1.62 K/sec - StreamingTime: 30s925ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s145ms, non-child: 12s819ms, % non-child: 79.40%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 15.243ms - PeakMemoryUsage: 11.20 MB (11741932) - ProbeRows: 440.59M (440587177) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s403ms - RowsReturned: 440.59M (440587177) - RowsReturnedRate: 27.29 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.917ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 112.664us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.405ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s969ms, non-child: 1.778ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.387ms - DeserializeRowBatchTimer: 4.590ms - FirstBatchArrivalWaitTime: 1s932ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 37.09 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s355ms, non-child: 1s355ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:5/859.83 MB 18:6/1.12 GB 11:3/658.34 MB 20:7/1.13 GB 8:9/1.23 GB 1:7/1.10 GB 17:6/462.17 MB 0:6/532.07 MB 21:5/789.60 MB 14:8/1.15 GB 7:6/769.29 MB 10:5/788.89 MB 16:6/562.51 MB 6:5/651.40 MB 23:8/934.00 MB 13:4/502.24 MB 15:7/958.63 MB 3:1/253.61 MB 12:8/1.05 GB 9:4/671.83 MB 19:8/1.12 GB 2:7/1.14 GB 5:8/868.73 MB 22:7/818.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 144 out of 144 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:96.91% 1:3.093% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:288 BytesRead(1s000ms): 0, 0, 41.78 MB, 105.77 MB, 108.71 MB, 108.71 MB, 132.51 MB, 204.47 MB, 231.77 MB, 231.77 MB, 234.70 MB, 273.65 MB, 282.88 MB, 282.88 MB, 302.56 MB, 372.52 MB, 397.62 MB, 397.62 MB, 406.85 MB, 429.42 MB, 462.90 MB, 462.90 MB, 465.83 MB, 508.16 MB, 552.48 MB, 584.30 MB, 590.90 MB, 601.89 MB, 627.69 MB, 638.49 MB, 654.39 MB, 677.03 MB, 727.30 MB, 748.64 MB, 754.93 MB, 761.76 MB, 790.00 MB, 814.20 MB, 818.71 MB, 839.62 MB, 868.87 MB, 904.00 MB, 932.87 MB, 952.14 MB, 983.13 MB, 988.99 MB, 988.99 MB, 988.99 MB, 988.99 MB - FooterProcessingTime: (Avg: 2.274ms ; Min: 965.516us ; Max: 10.916ms ; Number of samples: 144) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 988.99 MB (1037029361) - BytesReadDataNodeCache: 0 - BytesReadLocal: 988.99 MB (1037029361) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 988.99 MB (1037029361) - DecompressionTime: 708.546ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 144 (144) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.59 MB (226064150) - PerReadThreadRawHdfsThroughput: 1.78 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.895ms - RowBatchQueuePutWaitTime: 10m - RowsRead: 440.64M (440642800) - RowsReturned: 440.59M (440587177) - RowsReturnedRate: 324.96 M/sec - ScanRangesComplete: 146 (146) - ScannerThreadsInvoluntaryContextSwitches: 15.04K (15042) - ScannerThreadsTotalWallClockTime: 10m47s - MaterializeTupleTime(*): 23s571ms - ScannerThreadsSysTime: 13s219ms - ScannerThreadsUserTime: 33s508ms - ScannerThreadsVoluntaryContextSwitches: 961.76K (961759) - TotalRawHdfsReadTime(*): 543.171ms - TotalReadThroughput: 20.18 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.36M (2359152) - Rows rejected: 55.62K (55623) - Rows total: 2.36M (2359296) Filter 4 (1.00 MB): - Files processed: 146 (146) - Files rejected: 2 (2) - Files total: 146 (146) - RowGroups processed: 430.25K (430246) - RowGroups rejected: 0 (0) - RowGroups total: 430.25K (430246) - Rows processed: 2.36M (2359152) - Rows rejected: 0 (0) - Rows total: 2.36M (2359296) - Splits processed: 144 (144) - Splits rejected: 0 (0) - Splits total: 144 (144) Instance 594518549f864a64:12 (host=d2416.halxg.cloudera.com:22000):(Total: 2s569ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 11:2/370.96 MB 20:6/873.33 MB 5:5/790.24 MB 22:6/1.02 GB 12:3/385.11 MB 15:6/939.95 MB 2:5/755.49 MB 14:6/836.89 MB 7:5/790.96 MB 13:5/788.42 MB 10:9/1.60 GB 9:8/1.48 GB 21:6/531.62 MB 4:8/1004.49 MB 1:5/789.98 MB 18:2/371.13 MB 16:5/1.00 GB 23:3/521.78 MB 6:8/1.15 GB 19:8/1.22 GB 8:3/385.21 MB 3:8/1.22 GB 17:5/621.18 MB 0:5/756.67 MB Filter 2 arrival: 2s503ms Filter 4 arrival: 2s537ms MemoryUsage(1s000ms): 680.13 KB, 1.36 MB, 2.88 MB, 193.91 MB, 194.07 MB, 193.94 MB, 196.70 MB, 208.36 MB, 208.43 MB, 168.65 MB, 167.39 MB, 210.04 MB, 220.44 MB, 216.48 MB, 211.05 MB, 232.54 MB, 232.36 MB, 216.61 MB, 180.80 MB, 183.11 MB, 215.50 MB, 199.59 MB, 191.59 MB, 206.07 MB, 226.12 MB, 239.36 MB, 215.64 MB, 207.63 MB, 214.30 MB, 210.02 MB, 185.80 MB, 167.24 MB, 170.85 MB, 205.43 MB, 209.38 MB, 209.42 MB, 197.07 MB, 207.41 MB, 207.58 MB, 187.44 MB, 178.21 MB, 196.33 MB, 206.33 MB, 211.44 MB, 206.54 MB, 198.20 MB, 170.57 MB, 149.67 MB, 91.68 MB ThreadUsage(1s000ms): 1, 2, 2, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.19 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 239.78 MB (251422914) - PerHostPeakMemUsage: 452.30 MB (474274611) - RowsProduced: 71.66K (71656) - TotalCpuTime: 11m40s - TotalNetworkReceiveTime: 1s978ms - TotalNetworkSendTime: 5.846ms - TotalStorageWaitTime: 1s066ms Fragment Instance Lifecycle Timings: - ExecTime: 46s647ms - ExecTreeExecTime: 46s608ms - OpenTime: 2s531ms - ExecTreeOpenTime: 2s019ms - PrepareTime: 37.681ms - ExecTreePrepareTime: 22.810ms CodeGen:(Total: 533.600ms, non-child: 533.600ms, % non-child: 100.00%) - CodegenTime: 4.439ms - CompileTime: 159.234ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 351.108ms - PrepareTime: 22.610ms DataStreamSender (dst_id=19):(Total: 24.263ms, non-child: 24.263ms, % non-child: 100.00%) - BytesSent: 1.68 MB (1763799) - NetworkThroughput(*): 192.45 MB/sec - OverallThroughput: 69.33 MB/sec - RowsReturned: 71.66K (71656) - SerializeBatchTime: 15.423ms - TransmitDataRPCTime: 8.740ms - UncompressedRowBatchSize: 8.61 MB (9030840) AGGREGATION_NODE (id=3):(Total: 48s631ms, non-child: 32s152ms, % non-child: 66.11%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 126.652us - GetResultsTime: 4.853ms - HTResizeTime: 3.296ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11813094) - PinTime: 0.000ns - ReductionFactorEstimate: 261105.19 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 71.66K (71656) - RowsReturnedRate: 1.47 K/sec - StreamingTime: 30s868ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s478ms, non-child: 12s877ms, % non-child: 78.15%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 13.580ms - PeakMemoryUsage: 11.19 MB (11732569) - ProbeRows: 436.92M (436922285) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s465ms - RowsReturned: 436.92M (436922285) - RowsReturnedRate: 26.51 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 8.977ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 85.372us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.879ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s980ms, non-child: 1.600ms, % non-child: 0.08%) BytesReceived(1s000ms): 0, 0, 1.15 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.293ms - DeserializeRowBatchTimer: 4.522ms - FirstBatchArrivalWaitTime: 1s942ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.89 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s621ms, non-child: 1s621ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:2/370.96 MB 20:6/873.33 MB 5:5/790.24 MB 22:6/1.02 GB 12:3/385.11 MB 15:6/939.95 MB 2:5/755.49 MB 14:6/836.89 MB 7:5/790.96 MB 13:5/788.42 MB 10:9/1.60 GB 9:8/1.48 GB 21:6/531.62 MB 4:8/1004.49 MB 1:5/789.98 MB 18:2/371.13 MB 16:5/1.00 GB 23:3/521.78 MB 6:8/1.15 GB 19:8/1.22 GB 8:3/385.21 MB 3:8/1.22 GB 17:5/621.18 MB 0:5/756.67 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 129 out of 129 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:97.94% 1:2.062% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:258 BytesRead(1s000ms): 0, 0, 58.69 MB, 117.38 MB, 117.38 MB, 117.38 MB, 172.14 MB, 180.95 MB, 180.95 MB, 180.95 MB, 238.35 MB, 307.54 MB, 307.54 MB, 307.54 MB, 336.44 MB, 363.67 MB, 369.54 MB, 369.54 MB, 373.68 MB, 451.55 MB, 467.47 MB, 467.47 MB, 473.76 MB, 531.98 MB, 570.12 MB, 576.41 MB, 576.41 MB, 589.81 MB, 615.31 MB, 628.29 MB, 628.29 MB, 654.09 MB, 717.25 MB, 749.52 MB, 749.52 MB, 758.89 MB, 778.34 MB, 807.66 MB, 820.66 MB, 832.78 MB, 873.03 MB, 903.22 MB, 928.41 MB, 942.25 MB, 964.07 MB, 979.13 MB, 979.13 MB, 979.13 MB, 979.13 MB - FooterProcessingTime: (Avg: 2.160ms ; Min: 1.064ms ; Max: 10.185ms ; Number of samples: 129) - AverageHdfsReadThreadConcurrency: 0.02 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 979.13 MB (1026697190) - BytesReadDataNodeCache: 0 - BytesReadLocal: 979.13 MB (1026697190) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 979.13 MB (1026697190) - DecompressionTime: 694.513ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 129 (129) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.63 MB (226103218) - PerReadThreadRawHdfsThroughput: 1.75 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 21.433ms - RowBatchQueuePutWaitTime: 10m1s - RowsRead: 436.97M (436972149) - RowsReturned: 436.92M (436922285) - RowsReturnedRate: 269.49 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 651 (651) - ScannerThreadsTotalWallClockTime: 10m52s - MaterializeTupleTime(*): 23s592ms - ScannerThreadsSysTime: 16s136ms - ScannerThreadsUserTime: 34s147ms - ScannerThreadsVoluntaryContextSwitches: 1.11M (1108401) - TotalRawHdfsReadTime(*): 546.352ms - TotalReadThroughput: 19.98 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.11M (2113407) - Rows rejected: 49.86K (49864) - Rows total: 2.11M (2113536) Filter 4 (1.00 MB): - Files processed: 132 (132) - Files rejected: 3 (3) - Files total: 132 (132) - RowGroups processed: 426.66K (426662) - RowGroups rejected: 0 (0) - RowGroups total: 426.66K (426662) - Rows processed: 2.11M (2113407) - Rows rejected: 0 (0) - Rows total: 2.11M (2113536) - Splits processed: 129 (129) - Splits rejected: 0 (0) - Splits total: 129 (129) Instance 594518549f864a64:13 (host=d2417.halxg.cloudera.com:22000):(Total: 2s567ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/269.30 MB 23:7/1.37 GB 4:3/352.33 MB 21:4/775.20 MB 9:9/1.16 GB 22:1/117.63 MB 11:9/1.16 GB 15:9/1.50 GB 13:5/515.62 MB 6:6/802.90 MB 14:6/737.62 MB 10:8/936.33 MB 16:4/878.34 MB 20:4/367.32 MB 3:6/1.12 GB 1:5/789.06 MB 18:5/653.12 MB 2:6/802.13 MB 19:6/1.15 GB 5:5/619.63 MB 12:5/447.06 MB 0:9/1.13 GB 17:9/1.36 GB 7:7/992.58 MB Filter 2 arrival: 2s507ms Filter 4 arrival: 2s540ms MemoryUsage(1s000ms): 680.13 KB, 1.36 MB, 2.38 MB, 194.04 MB, 202.38 MB, 202.38 MB, 202.38 MB, 197.50 MB, 210.07 MB, 193.09 MB, 180.75 MB, 191.52 MB, 207.03 MB, 214.39 MB, 205.02 MB, 209.08 MB, 212.18 MB, 225.46 MB, 206.61 MB, 192.08 MB, 202.32 MB, 191.54 MB, 175.55 MB, 169.65 MB, 188.88 MB, 210.90 MB, 221.47 MB, 224.34 MB, 227.37 MB, 223.50 MB, 195.22 MB, 180.71 MB, 191.71 MB, 207.54 MB, 217.33 MB, 211.41 MB, 223.06 MB, 227.38 MB, 211.47 MB, 191.65 MB, 194.30 MB, 204.49 MB, 187.64 MB, 198.06 MB, 208.54 MB, 204.88 MB, 180.96 MB, 147.03 MB, 79.41 MB ThreadUsage(1s000ms): 1, 2, 2, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.18 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 227.76 MB (238824845) - PerHostPeakMemUsage: 422.28 MB (442794776) - RowsProduced: 70.30K (70304) - TotalCpuTime: 11m33s - TotalNetworkReceiveTime: 1s962ms - TotalNetworkSendTime: 2.599ms - TotalStorageWaitTime: 1s136ms Fragment Instance Lifecycle Timings: - ExecTime: 46s209ms - ExecTreeExecTime: 46s169ms - OpenTime: 2s528ms - ExecTreeOpenTime: 2s000ms - PrepareTime: 39.369ms - ExecTreePrepareTime: 24.555ms CodeGen:(Total: 551.069ms, non-child: 551.069ms, % non-child: 100.00%) - CodegenTime: 4.336ms - CompileTime: 162.458ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 363.921ms - PrepareTime: 24.065ms DataStreamSender (dst_id=19):(Total: 25.913ms, non-child: 25.913ms, % non-child: 100.00%) - BytesSent: 1.67 MB (1751527) - NetworkThroughput(*): 191.15 MB/sec - OverallThroughput: 64.46 MB/sec - RowsReturned: 70.30K (70304) - SerializeBatchTime: 17.062ms - TransmitDataRPCTime: 8.738ms - UncompressedRowBatchSize: 8.45 MB (8860448) AGGREGATION_NODE (id=3):(Total: 48s172ms, non-child: 32s485ms, % non-child: 67.44%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 138.022us - GetResultsTime: 5.007ms - HTResizeTime: 3.813ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.22 MB (11767702) - PinTime: 0.000ns - ReductionFactorEstimate: 258776.05 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 70.30K (70304) - RowsReturnedRate: 1.46 K/sec - StreamingTime: 31s317ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 15s686ms, non-child: 12s405ms, % non-child: 79.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 14.451ms - PeakMemoryUsage: 11.20 MB (11740896) - ProbeRows: 433.14M (433144139) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s007ms - RowsReturned: 433.14M (433144139) - RowsReturnedRate: 27.61 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.375ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 113.230us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.941ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s964ms, non-child: 1.752ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 999.12 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.419ms - DeserializeRowBatchTimer: 4.521ms - FirstBatchArrivalWaitTime: 1s926ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 37.19 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s317ms, non-child: 1s317ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/269.30 MB 23:7/1.37 GB 4:3/352.33 MB 21:4/775.20 MB 9:9/1.16 GB 22:1/117.63 MB 11:9/1.16 GB 15:9/1.50 GB 13:5/515.62 MB 6:6/802.90 MB 14:6/737.62 MB 10:8/936.33 MB 16:4/878.34 MB 20:4/367.32 MB 3:6/1.12 GB 1:5/789.06 MB 18:5/653.12 MB 2:6/802.13 MB 19:6/1.15 GB 5:5/619.63 MB 12:5/447.06 MB 0:9/1.13 GB 17:9/1.36 GB 7:7/992.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 137 out of 137 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:98.96% 1:1.042% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:274 BytesRead(1s000ms): 0, 0, 58.62 MB, 124.77 MB, 124.77 MB, 124.77 MB, 138.17 MB, 170.40 MB, 189.64 MB, 202.62 MB, 208.48 MB, 271.29 MB, 296.46 MB, 296.46 MB, 316.11 MB, 345.81 MB, 386.92 MB, 392.76 MB, 395.69 MB, 417.80 MB, 440.85 MB, 449.66 MB, 454.56 MB, 510.67 MB, 556.37 MB, 591.84 MB, 597.70 MB, 619.10 MB, 624.96 MB, 633.75 MB, 634.93 MB, 674.20 MB, 713.28 MB, 750.20 MB, 759.41 MB, 782.02 MB, 801.69 MB, 816.70 MB, 820.45 MB, 833.42 MB, 881.22 MB, 897.95 MB, 919.15 MB, 945.97 MB, 962.31 MB, 971.85 MB, 971.85 MB, 971.85 MB - FooterProcessingTime: (Avg: 2.355ms ; Min: 1.148ms ; Max: 10.599ms ; Number of samples: 137) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 971.85 MB (1019054085) - BytesReadDataNodeCache: 0 - BytesReadLocal: 971.85 MB (1019054085) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 971.85 MB (1019054085) - DecompressionTime: 698.412ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 137 (137) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 203.61 MB (213503553) - PerReadThreadRawHdfsThroughput: 1.67 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 17.165ms - RowBatchQueuePutWaitTime: 10m6s - RowsRead: 433.20M (433197569) - RowsReturned: 433.14M (433144139) - RowsReturnedRate: 328.79 M/sec - ScanRangesComplete: 140 (140) - ScannerThreadsInvoluntaryContextSwitches: 13.48K (13477) - ScannerThreadsTotalWallClockTime: 10m46s - MaterializeTupleTime(*): 22s607ms - ScannerThreadsSysTime: 9s262ms - ScannerThreadsUserTime: 30s807ms - ScannerThreadsVoluntaryContextSwitches: 786.46K (786457) - TotalRawHdfsReadTime(*): 568.268ms - TotalReadThroughput: 20.04 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.24M (2244471) - Rows rejected: 53.43K (53430) - Rows total: 2.24M (2244608) Filter 4 (1.00 MB): - Files processed: 140 (140) - Files rejected: 3 (3) - Files total: 140 (140) - RowGroups processed: 422.98K (422979) - RowGroups rejected: 0 (0) - RowGroups total: 422.98K (422979) - Rows processed: 2.24M (2244471) - Rows rejected: 0 (0) - Rows total: 2.24M (2244608) - Splits processed: 137 (137) - Splits rejected: 0 (0) - Splits total: 137 (137) Instance 594518549f864a64:11 (host=d2420.halxg.cloudera.com:22000):(Total: 2s565ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:4/502.10 MB 23:6/874.40 MB 13:7/990.24 MB 9:7/1.10 GB 14:1/117.50 MB 3:5/789.09 MB 16:3/521.25 MB 8:6/1.22 GB 7:6/1.02 GB 20:6/769.57 MB 17:3/385.29 MB 0:9/985.46 MB 11:5/723.91 MB 6:8/1.35 GB 5:6/634.05 MB 22:5/859.79 MB 19:3/352.21 MB 10:13/1.65 GB 15:6/905.42 MB 12:6/874.64 MB 1:6/530.27 MB 18:6/1011.15 MB 4:5/723.96 MB 21:7/1.10 GB Filter 2 arrival: 2s502ms Filter 4 arrival: 2s534ms MemoryUsage(1s000ms): 1.33 MB, 1.36 MB, 82.53 MB, 185.94 MB, 190.35 MB, 190.21 MB, 190.15 MB, 193.61 MB, 204.03 MB, 208.37 MB, 184.57 MB, 186.10 MB, 205.31 MB, 226.37 MB, 222.43 MB, 210.57 MB, 205.57 MB, 217.51 MB, 227.35 MB, 219.31 MB, 198.55 MB, 186.32 MB, 191.07 MB, 210.03 MB, 206.99 MB, 195.54 MB, 188.09 MB, 218.93 MB, 225.23 MB, 221.55 MB, 217.46 MB, 209.60 MB, 212.57 MB, 221.31 MB, 221.41 MB, 185.63 MB, 176.76 MB, 196.16 MB, 213.66 MB, 213.69 MB, 214.64 MB, 205.41 MB, 222.34 MB, 227.55 MB, 219.44 MB, 186.67 MB, 185.42 MB, 192.70 MB, 204.03 MB, 205.33 MB, 189.48 MB, 192.56 MB, 203.41 MB, 199.86 MB, 187.35 MB, 179.27 MB, 151.73 MB, 75.02 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.43 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 233.79 MB (245142893) - PerHostPeakMemUsage: 452.62 MB (474607649) - RowsProduced: 68.95K (68952) - TotalCpuTime: 13m56s - TotalNetworkReceiveTime: 1s821ms - TotalNetworkSendTime: 4.503ms - TotalStorageWaitTime: 1s408ms Fragment Instance Lifecycle Timings: - ExecTime: 55s780ms - ExecTreeExecTime: 55s729ms - OpenTime: 2s515ms - ExecTreeOpenTime: 1s868ms - PrepareTime: 50.055ms - ExecTreePrepareTime: 28.571ms CodeGen:(Total: 672.364ms, non-child: 672.364ms, % non-child: 100.00%) - CodegenTime: 5.860ms - CompileTime: 199.591ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 443.389ms - PrepareTime: 28.429ms DataStreamSender (dst_id=19):(Total: 28.580ms, non-child: 28.580ms, % non-child: 100.00%) - BytesSent: 1.65 MB (1734962) - NetworkThroughput(*): 170.98 MB/sec - OverallThroughput: 57.89 MB/sec - RowsReturned: 68.95K (68952) - SerializeBatchTime: 18.785ms - TransmitDataRPCTime: 9.676ms - UncompressedRowBatchSize: 8.29 MB (8690052) AGGREGATION_NODE (id=3):(Total: 57s601ms, non-child: 38s128ms, % non-child: 66.19%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 196.680us - GetResultsTime: 5.865ms - HTResizeTime: 4.260ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.28 MB (11824148) - PinTime: 0.000ns - ReductionFactorEstimate: 257908.78 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 68.95K (68952) - RowsReturnedRate: 1.20 K/sec - StreamingTime: 36s699ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 19s472ms, non-child: 15s551ms, % non-child: 79.86%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 25.026ms - PeakMemoryUsage: 11.19 MB (11738791) - ProbeRows: 437.16M (437155176) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 15s062ms - RowsReturned: 437.16M (437155176) - RowsReturnedRate: 22.45 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 16.227ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 183.406us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 7.301ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s823ms, non-child: 4.123ms, % non-child: 0.23%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 2.562ms - DeserializeRowBatchTimer: 9.464ms - FirstBatchArrivalWaitTime: 1s793ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 40.05 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 2s097ms, non-child: 2s097ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:4/502.10 MB 23:6/874.40 MB 13:7/990.24 MB 9:7/1.10 GB 14:1/117.50 MB 3:5/789.09 MB 16:3/521.25 MB 8:6/1.22 GB 7:6/1.02 GB 20:6/769.57 MB 17:3/385.29 MB 0:9/985.46 MB 11:5/723.91 MB 6:8/1.35 GB 5:6/634.05 MB 22:5/859.79 MB 19:3/352.21 MB 10:13/1.65 GB 15:6/905.42 MB 12:6/874.64 MB 1:6/530.27 MB 18:6/1011.15 MB 4:5/723.96 MB 21:7/1.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 137 out of 137 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:99.13% 1:0.8696% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:2 PARQUET/SNAPPY:274 BytesRead(1s000ms): 0, 0, 43.51 MB, 102.45 MB, 105.39 MB, 105.39 MB, 105.39 MB, 168.65 MB, 191.21 MB, 194.14 MB, 194.14 MB, 210.03 MB, 260.70 MB, 301.40 MB, 301.40 MB, 301.40 MB, 316.49 MB, 352.88 MB, 372.55 MB, 372.55 MB, 378.85 MB, 397.74 MB, 417.01 MB, 454.32 MB, 464.27 MB, 467.20 MB, 473.44 MB, 533.78 MB, 556.37 MB, 568.49 MB, 578.55 MB, 588.61 MB, 603.27 MB, 624.62 MB, 630.47 MB, 630.47 MB, 639.70 MB, 700.49 MB, 743.63 MB, 743.63 MB, 746.56 MB, 758.72 MB, 786.83 MB, 810.77 MB, 810.77 MB, 811.93 MB, 834.87 MB, 865.81 MB, 893.40 MB, 899.28 MB, 899.28 MB, 914.81 MB, 950.78 MB, 980.53 MB, 980.53 MB, 980.53 MB, 980.53 MB, 980.53 MB - FooterProcessingTime: (Avg: 2.765ms ; Min: 1.594ms ; Max: 8.057ms ; Number of samples: 137) - AverageHdfsReadThreadConcurrency: 0.01 - AverageScannerThreadConcurrency: 13.63 - BytesRead: 980.53 MB (1028160932) - BytesReadDataNodeCache: 0 - BytesReadLocal: 980.53 MB (1028160932) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 980.53 MB (1028160932) - DecompressionTime: 900.798ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 137 (137) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.64 MB (219823197) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.772ms - RowBatchQueuePutWaitTime: 12m6s - RowsRead: 437.21M (437208013) - RowsReturned: 437.16M (437155176) - RowsReturnedRate: 208.39 M/sec - ScanRangesComplete: 139 (139) - ScannerThreadsInvoluntaryContextSwitches: 14.13K (14135) - ScannerThreadsTotalWallClockTime: 12m59s - MaterializeTupleTime(*): 28s057ms - ScannerThreadsSysTime: 13s191ms - ScannerThreadsUserTime: 39s426ms - ScannerThreadsVoluntaryContextSwitches: 804.18K (804184) - TotalRawHdfsReadTime(*): 737.680ms - TotalReadThroughput: 16.76 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.24M (2244471) - Rows rejected: 52.84K (52837) - Rows total: 2.24M (2244608) Filter 4 (1.00 MB): - Files processed: 139 (139) - Files rejected: 2 (2) - Files total: 139 (139) - RowGroups processed: 426.89K (426891) - RowGroups rejected: 0 (0) - RowGroups total: 426.89K (426891) - Rows processed: 2.24M (2244471) - Rows rejected: 0 (0) - Rows total: 2.24M (2244608) - Splits processed: 137 (137) - Splits rejected: 0 (0) - Splits total: 137 (137) Instance 594518549f864a64:f (host=d2410.halxg.cloudera.com:22000):(Total: 2s564ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:6/1.15 GB 1:5/653.07 MB 21:5/756.24 MB 4:10/1.61 GB 17:4/638.58 MB 12:2/370.85 MB 2:2/404.32 MB 16:9/1.50 GB 0:5/619.67 MB 7:5/653.47 MB 15:6/873.61 MB 11:4/741.95 MB 18:3/624.22 MB 19:4/469.42 MB 14:7/919.97 MB 13:6/529.28 MB 10:5/788.88 MB 9:6/940.22 MB 20:2/234.64 MB 3:6/1.02 GB 6:10/1.48 GB 23:8/903.03 MB 22:6/1.02 GB 8:5/1.01 GB Filter 2 arrival: 2s501ms Filter 4 arrival: 2s536ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 104.70 MB, 208.51 MB, 208.23 MB, 208.35 MB, 211.53 MB, 215.95 MB, 226.48 MB, 186.88 MB, 178.84 MB, 182.97 MB, 196.46 MB, 180.39 MB, 184.53 MB, 206.47 MB, 208.11 MB, 214.44 MB, 210.39 MB, 206.95 MB, 215.40 MB, 201.52 MB, 177.78 MB, 194.63 MB, 204.90 MB, 215.33 MB, 211.43 MB, 203.49 MB, 208.92 MB, 207.44 MB, 193.59 MB, 194.66 MB, 213.52 MB, 224.44 MB, 219.40 MB, 207.67 MB, 196.70 MB, 209.83 MB, 191.67 MB, 185.58 MB, 194.10 MB, 207.45 MB, 221.57 MB, 217.43 MB, 214.32 MB, 186.83 MB, 153.79 MB, 109.89 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.32 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 227.65 MB (238703341) - PerHostPeakMemUsage: 446.28 MB (467956828) - RowsProduced: 66.25K (66248) - TotalCpuTime: 11m33s - TotalNetworkReceiveTime: 1s976ms - TotalNetworkSendTime: 2.422ms - TotalStorageWaitTime: 1s050ms Fragment Instance Lifecycle Timings: - ExecTime: 46s209ms - ExecTreeExecTime: 46s169ms - OpenTime: 2s524ms - ExecTreeOpenTime: 2s013ms - PrepareTime: 40.681ms - ExecTreePrepareTime: 23.312ms CodeGen:(Total: 532.765ms, non-child: 532.765ms, % non-child: 100.00%) - CodegenTime: 4.415ms - CompileTime: 157.237ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 352.096ms - PrepareTime: 22.850ms DataStreamSender (dst_id=19):(Total: 27.358ms, non-child: 27.358ms, % non-child: 100.00%) - BytesSent: 1.59 MB (1670256) - NetworkThroughput(*): 163.44 MB/sec - OverallThroughput: 58.22 MB/sec - RowsReturned: 66.25K (66248) - SerializeBatchTime: 17.505ms - TransmitDataRPCTime: 9.746ms - UncompressedRowBatchSize: 7.96 MB (8349272) AGGREGATION_NODE (id=3):(Total: 48s185ms, non-child: 32s087ms, % non-child: 66.59%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 148.556us - GetResultsTime: 5.183ms - HTResizeTime: 3.277ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.27 MB (11814810) - PinTime: 0.000ns - ReductionFactorEstimate: 256946.91 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 66.25K (66248) - RowsReturnedRate: 1.37 K/sec - StreamingTime: 30s749ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 16s098ms, non-child: 12s588ms, % non-child: 78.20%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 14.339ms - PeakMemoryUsage: 11.19 MB (11731272) - ProbeRows: 430.41M (430405929) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 12s147ms - RowsReturned: 430.41M (430405929) - RowsReturnedRate: 26.74 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.254ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 88.848us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 4.142ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s977ms, non-child: 1.683ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.293ms - DeserializeRowBatchTimer: 4.752ms - FirstBatchArrivalWaitTime: 1s939ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.93 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s531ms, non-child: 1s531ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:6/1.15 GB 1:5/653.07 MB 21:5/756.24 MB 4:10/1.61 GB 17:4/638.58 MB 12:2/370.85 MB 2:2/404.32 MB 16:9/1.50 GB 0:5/619.67 MB 7:5/653.47 MB 15:6/873.61 MB 11:4/741.95 MB 18:3/624.22 MB 19:4/469.42 MB 14:7/919.97 MB 13:6/529.28 MB 10:5/788.88 MB 9:6/940.22 MB 20:2/234.64 MB 3:6/1.02 GB 6:10/1.48 GB 23:8/903.03 MB 22:6/1.02 GB 8:5/1.01 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 128 out of 128 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:95.83% 1:4.167% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:3 PARQUET/SNAPPY:256 BytesRead(1s000ms): 0, 0, 63.66 MB, 127.31 MB, 127.31 MB, 127.31 MB, 169.49 MB, 182.40 MB, 198.29 MB, 198.29 MB, 212.95 MB, 255.87 MB, 273.44 MB, 273.44 MB, 284.69 MB, 354.34 MB, 383.14 MB, 395.67 MB, 395.67 MB, 403.21 MB, 441.73 MB, 461.01 MB, 467.30 MB, 499.18 MB, 544.44 MB, 566.76 MB, 569.13 MB, 575.37 MB, 614.21 MB, 640.12 MB, 645.22 MB, 672.90 MB, 713.15 MB, 743.72 MB, 750.01 MB, 759.58 MB, 772.91 MB, 804.21 MB, 810.06 MB, 836.43 MB, 875.80 MB, 903.44 MB, 939.86 MB, 939.86 MB, 949.87 MB, 964.21 MB, 964.21 MB, 964.21 MB - FooterProcessingTime: (Avg: 2.361ms ; Min: 1.104ms ; Max: 11.015ms ; Number of samples: 128) - AverageHdfsReadThreadConcurrency: 0.04 - AverageScannerThreadConcurrency: 13.42 - BytesRead: 964.21 MB (1011047962) - BytesReadDataNodeCache: 0 - BytesReadLocal: 964.21 MB (1011047962) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 964.21 MB (1011047962) - DecompressionTime: 689.127ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 24 (24) - NumRowGroups: 128 (128) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 203.66 MB (213551864) - PerReadThreadRawHdfsThroughput: 1.80 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.831ms - RowBatchQueuePutWaitTime: 9m59s - RowsRead: 430.45M (430454973) - RowsReturned: 430.41M (430405929) - RowsReturnedRate: 280.95 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 14.97K (14969) - ScannerThreadsTotalWallClockTime: 10m46s - MaterializeTupleTime(*): 23s774ms - ScannerThreadsSysTime: 14s074ms - ScannerThreadsUserTime: 33s068ms - ScannerThreadsVoluntaryContextSwitches: 930.60K (930602) - TotalRawHdfsReadTime(*): 524.311ms - TotalReadThroughput: 19.88 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.10M (2097024) - Rows rejected: 49.04K (49044) - Rows total: 2.10M (2097152) Filter 4 (1.00 MB): - Files processed: 131 (131) - Files rejected: 3 (3) - Files total: 131 (131) - RowGroups processed: 420.30K (420301) - RowGroups rejected: 0 (0) - RowGroups total: 420.30K (420301) - Rows processed: 2.10M (2097024) - Rows rejected: 0 (0) - Rows total: 2.10M (2097152) - Splits processed: 128 (128) - Splits rejected: 0 (0) - Splits total: 128 (128) Instance 594518549f864a64:14 (host=d2419.halxg.cloudera.com:22000):(Total: 2s564ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 23:1/253.64 MB 18:6/1.09 GB 15:4/742.83 MB 4:8/1.48 GB 8:8/1.41 GB 13:5/686.88 MB 21:6/633.99 MB 12:6/906.04 MB 0:10/1.88 GB 17:5/756.29 MB 9:4/535.56 MB 14:2/131.35 MB 19:6/939.14 MB 2:8/1.11 GB 10:5/723.63 MB 6:4/638.81 MB 16:6/771.37 MB 1:10/1.38 GB 3:5/653.90 MB 20:5/620.07 MB 5:8/1.11 GB 22:5/789.31 MB 11:7/816.70 MB Filter 2 arrival: 2s509ms Filter 4 arrival: 2s539ms MemoryUsage(1s000ms): 1.34 MB, 1.36 MB, 89.95 MB, 202.41 MB, 202.50 MB, 202.38 MB, 220.39 MB, 220.31 MB, 204.63 MB, 180.63 MB, 188.62 MB, 203.46 MB, 196.58 MB, 184.63 MB, 181.68 MB, 199.51 MB, 200.52 MB, 184.59 MB, 190.11 MB, 201.94 MB, 206.07 MB, 200.60 MB, 210.98 MB, 222.89 MB, 224.97 MB, 217.63 MB, 206.16 MB, 207.45 MB, 196.61 MB, 200.52 MB, 205.51 MB, 216.43 MB, 221.43 MB, 215.52 MB, 212.50 MB, 201.49 MB, 207.60 MB, 199.67 MB, 204.55 MB, 213.46 MB, 212.09 MB, 216.05 MB, 202.26 MB, 179.04 MB, 150.69 MB, 76.45 MB ThreadUsage(1s000ms): 1, 2, 8, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.28 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 233.73 MB (245086742) - PerHostPeakMemUsage: 422.26 MB (442774864) - RowsProduced: 66.25K (66248) - TotalCpuTime: 10m54s - TotalNetworkReceiveTime: 1s974ms - TotalNetworkSendTime: 2.760ms - TotalStorageWaitTime: 1s036ms Fragment Instance Lifecycle Timings: - ExecTime: 43s608ms - ExecTreeExecTime: 43s569ms - OpenTime: 2s523ms - ExecTreeOpenTime: 2s008ms - PrepareTime: 40.998ms - ExecTreePrepareTime: 22.249ms CodeGen:(Total: 535.585ms, non-child: 535.585ms, % non-child: 100.00%) - CodegenTime: 4.326ms - CompileTime: 159.602ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 353.479ms - PrepareTime: 21.947ms DataStreamSender (dst_id=19):(Total: 22.332ms, non-child: 22.332ms, % non-child: 100.00%) - BytesSent: 1.58 MB (1657817) - NetworkThroughput(*): 219.52 MB/sec - OverallThroughput: 70.79 MB/sec - RowsReturned: 66.25K (66248) - SerializeBatchTime: 15.037ms - TransmitDataRPCTime: 7.202ms - UncompressedRowBatchSize: 7.96 MB (8349268) AGGREGATION_NODE (id=3):(Total: 45s581ms, non-child: 30s357ms, % non-child: 66.60%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 124.046us - GetResultsTime: 4.329ms - HTResizeTime: 3.333ms - HashBuckets: 131.07K (131072) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 11.26 MB (11810153) - PinTime: 0.000ns - ReductionFactorEstimate: 258613.17 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 66.25K (66248) - RowsReturnedRate: 1.45 K/sec - StreamingTime: 29s126ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=2):(Total: 15s223ms, non-child: 11s930ms, % non-child: 78.37%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 73.05K (73049) - BuildTime: 14.455ms - PeakMemoryUsage: 11.20 MB (11741563) - ProbeRows: 423.00M (423003243) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 11s547ms - RowsReturned: 423.00M (423003243) - RowsReturnedRate: 27.79 M/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 9.573ms - BuildRowsPartitioned: 73.05K (73049) - GetNewBlockTime: 121.208us - HashBuckets: 131.07K (131072) - HashCollisions: 0 (0) - HashTablesBuildTime: 3.981ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=18):(Total: 1s975ms, non-child: 1.715ms, % non-child: 0.09%) BytesReceived(1s000ms): 0, 0, 876.43 KB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB, 1.71 MB - BytesReceived: 1.71 MB (1794936) - ConvertRowBatchTime: 1.368ms - DeserializeRowBatchTimer: 4.548ms - FirstBatchArrivalWaitTime: 1s938ms - PeakMemoryUsage: 0 - RowsReturned: 73.05K (73049) - RowsReturnedRate: 36.97 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=0):(Total: 1s317ms, non-child: 1s317ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 23:1/253.64 MB 18:6/1.09 GB 15:4/742.83 MB 4:8/1.48 GB 8:8/1.41 GB 13:5/686.88 MB 21:6/633.99 MB 12:6/906.04 MB 0:10/1.88 GB 17:5/756.29 MB 9:4/535.56 MB 14:2/131.35 MB 19:6/939.14 MB 2:8/1.11 GB 10:5/723.63 MB 6:4/638.81 MB 16:6/771.37 MB 1:10/1.38 GB 3:5/653.90 MB 20:5/620.07 MB 5:8/1.11 GB 22:5/789.31 MB 11:7/816.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 129 out of 129 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:5 PARQUET/SNAPPY:258 BytesRead(1s000ms): 0, 0, 52.73 MB, 123.91 MB, 123.91 MB, 123.91 MB, 170.49 MB, 189.30 MB, 199.32 MB, 199.32 MB, 238.15 MB, 280.81 MB, 287.51 MB, 290.45 MB, 331.00 MB, 362.33 MB, 384.89 MB, 384.89 MB, 410.00 MB, 438.06 MB, 478.51 MB, 494.04 MB, 525.85 MB, 554.30 MB, 570.20 MB, 576.45 MB, 592.29 MB, 616.61 MB, 629.60 MB, 661.47 MB, 695.04 MB, 726.12 MB, 738.27 MB, 753.77 MB, 771.31 MB, 788.12 MB, 807.00 MB, 838.04 MB, 871.51 MB, 896.27 MB, 909.64 MB, 923.38 MB, 939.28 MB, 948.51 MB, 948.51 MB, 948.51 MB - FooterProcessingTime: (Avg: 1.764ms ; Min: 1.065ms ; Max: 5.417ms ; Number of samples: 129) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.38 - BytesRead: 948.51 MB (994584556) - BytesReadDataNodeCache: 0 - BytesReadLocal: 948.51 MB (994584556) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 948.51 MB (994584556) - DecompressionTime: 668.153ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 23 (23) - NumRowGroups: 129 (129) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.59 MB (219767046) - PerReadThreadRawHdfsThroughput: 1.79 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.121ms - RowBatchQueuePutWaitTime: 9m26s - RowsRead: 423.05M (423052974) - RowsReturned: 423.00M (423003243) - RowsReturnedRate: 321.02 M/sec - ScanRangesComplete: 134 (134) - ScannerThreadsInvoluntaryContextSwitches: 13.67K (13669) - ScannerThreadsTotalWallClockTime: 10m9s - MaterializeTupleTime(*): 21s987ms - ScannerThreadsSysTime: 11s367ms - ScannerThreadsUserTime: 31s601ms - ScannerThreadsVoluntaryContextSwitches: 895.52K (895519) - TotalRawHdfsReadTime(*): 516.909ms - TotalReadThroughput: 20.62 MB/sec Filter 2 (1.00 MB): - Rows processed: 2.11M (2113407) - Rows rejected: 49.73K (49731) - Rows total: 2.11M (2113536) Filter 4 (1.00 MB): - Files processed: 134 (134) - Files rejected: 5 (5) - Files total: 134 (134) - RowGroups processed: 413.07K (413070) - RowGroups rejected: 0 (0) - RowGroups total: 413.07K (413070) - Rows processed: 2.11M (2113407) - Rows rejected: 0 (0) - Rows total: 2.11M (2113536) - Splits processed: 129 (129) - Splits rejected: 0 (0) - Splits total: 129 (129) Averaged Fragment F01:(Total: 51.334ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:2s594ms max:2s594ms mean: 2s594ms stddev:0.000ns execution rates: min:848.45 KB/sec max:848.45 KB/sec mean:848.45 KB/sec stddev:0.50 B/sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 3.57 MB (3741548) - PerHostPeakMemUsage: 143.49 MB (150460510) - RowsProduced: 73.05K (73049) - TotalCpuTime: 4s903ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.114ms - TotalStorageWaitTime: 3.754ms Fragment Instance Lifecycle Timings: - ExecTime: 2s542ms - ExecTreeExecTime: 2s493ms - OpenTime: 26.493ms - ExecTreeOpenTime: 50.688us - PrepareTime: 24.825ms - ExecTreePrepareTime: 21.653ms CodeGen:(Total: 46.873ms, non-child: 46.873ms, % non-child: 100.00%) - CodegenTime: 370.372us - CompileTime: 7.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 12 (12) - NumInstructions: 215 (215) - OptimizationTime: 16.438ms - PrepareTime: 21.909ms DataStreamSender (dst_id=18):(Total: 38.111ms, non-child: 38.111ms, % non-child: 100.00%) - BytesSent: 32.52 MB (34103784) - NetworkThroughput(*): 1.40 GB/sec - OverallThroughput: 853.39 MB/sec - RowsReturned: 73.05K (73049) - SerializeBatchTime: 15.342ms - TransmitDataRPCTime: 22.719ms - UncompressedRowBatchSize: 47.85 MB (50169272) HDFS_SCAN_NODE (id=1):(Total: 2s494ms, non-child: 2s494ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 586.52 KB (600601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 586.52 KB (600601) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 586.52 KB (600601) - DecompressionTime: 318.440us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.44 MB (3608196) - PerReadThreadRawHdfsThroughput: 944.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4.996ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 73.05K (73049) - RowsReturnedRate: 29.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s338ms - MaterializeTupleTime(*): 4.461ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 125 (125) - TotalRawHdfsReadTime(*): 606.568us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3 (1.00 MB): - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Fragment F01: Instance 594518549f864a64:1 (host=d2403.halxg.cloudera.com:22000):(Total: 51.334ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB Filter 3 arrival: 2s563ms MemoryUsage(500.000ms): 105.23 KB, 105.23 KB, 105.23 KB, 105.23 KB, 105.23 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 3.57 MB (3741548) - PerHostPeakMemUsage: 143.49 MB (150460510) - RowsProduced: 73.05K (73049) - TotalCpuTime: 4s903ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 25.114ms - TotalStorageWaitTime: 3.754ms Fragment Instance Lifecycle Timings: - ExecTime: 2s542ms - ExecTreeExecTime: 2s493ms - OpenTime: 26.493ms - ExecTreeOpenTime: 50.688us - PrepareTime: 24.825ms - ExecTreePrepareTime: 21.653ms CodeGen:(Total: 46.873ms, non-child: 46.873ms, % non-child: 100.00%) - CodegenTime: 370.372us - CompileTime: 7.977ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 12 (12) - NumInstructions: 215 (215) - OptimizationTime: 16.438ms - PrepareTime: 21.909ms DataStreamSender (dst_id=18):(Total: 38.111ms, non-child: 38.111ms, % non-child: 100.00%) - BytesSent: 32.52 MB (34103784) - NetworkThroughput(*): 1.40 GB/sec - OverallThroughput: 853.39 MB/sec - RowsReturned: 73.05K (73049) - SerializeBatchTime: 15.342ms - TransmitDataRPCTime: 22.719ms - UncompressedRowBatchSize: 47.85 MB (50169272) HDFS_SCAN_NODE (id=1):(Total: 2s494ms, non-child: 2s494ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 2s487ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0 - FooterProcessingTime: (Avg: 1.186ms ; Min: 1.186ms ; Max: 1.186ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 586.52 KB (600601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 586.52 KB (600601) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 586.52 KB (600601) - DecompressionTime: 318.440us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.44 MB (3608196) - PerReadThreadRawHdfsThroughput: 944.29 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4.996ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 73.05K (73049) - RowsReturnedRate: 29.28 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s338ms - MaterializeTupleTime(*): 4.461ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 5.999ms - ScannerThreadsVoluntaryContextSwitches: 125 (125) - TotalRawHdfsReadTime(*): 606.568us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Filter 3 (1.00 MB): - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Averaged Fragment F03:(Total: 70.703ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:2s530ms max:2s530ms mean: 2s530ms stddev:0.000ns execution rates: min:869.87 KB/sec max:869.87 KB/sec mean:869.87 KB/sec stddev:0.48 B/sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.34 MB (1406090) - PerHostPeakMemUsage: 129.91 MB (136219643) - RowsProduced: 365 (365) - TotalCpuTime: 4s842ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33.472us - TotalStorageWaitTime: 3.527ms Fragment Instance Lifecycle Timings: - ExecTime: 2s458ms - ExecTreeExecTime: 2s455ms - OpenTime: 39.732ms - ExecTreeOpenTime: 59.524us - PrepareTime: 30.948ms - ExecTreePrepareTime: 25.866ms CodeGen:(Total: 62.855ms, non-child: 62.855ms, % non-child: 100.00%) - CodegenTime: 508.416us - CompileTime: 11.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 24 (24) - NumInstructions: 405 (405) - OptimizationTime: 26.635ms - PrepareTime: 24.145ms DataStreamSender (dst_id=21):(Total: 439.676us, non-child: 439.676us, % non-child: 100.00%) - BytesSent: 36.55 KB (37430) - NetworkThroughput(*): 161.71 MB/sec - OverallThroughput: 81.19 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 25.112us - TransmitDataRPCTime: 220.744us - UncompressedRowBatchSize: 88.12 KB (90231) HDFS_SCAN_NODE (id=5):(Total: 2s462ms, non-child: 2s462ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 237.85 KB (243555) - BytesReadDataNodeCache: 0 - BytesReadLocal: 237.85 KB (243555) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 237.85 KB (243555) - DecompressionTime: 303.228us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.07 MB (1121258) - PerReadThreadRawHdfsThroughput: 389.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 7.824ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 148.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s316ms - MaterializeTupleTime(*): 3.497ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 122 (122) - TotalRawHdfsReadTime(*): 596.408us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Fragment F03: Instance 594518549f864a64:15 (host=d2403.halxg.cloudera.com:22000):(Total: 70.703ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB MemoryUsage(500.000ms): 286.16 KB, 286.16 KB, 286.16 KB, 286.16 KB, 286.16 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.34 MB (1406090) - PerHostPeakMemUsage: 129.91 MB (136219643) - RowsProduced: 365 (365) - TotalCpuTime: 4s842ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 33.472us - TotalStorageWaitTime: 3.527ms Fragment Instance Lifecycle Timings: - ExecTime: 2s458ms - ExecTreeExecTime: 2s455ms - OpenTime: 39.732ms - ExecTreeOpenTime: 59.524us - PrepareTime: 30.948ms - ExecTreePrepareTime: 25.866ms CodeGen:(Total: 62.855ms, non-child: 62.855ms, % non-child: 100.00%) - CodegenTime: 508.416us - CompileTime: 11.136ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 24 (24) - NumInstructions: 405 (405) - OptimizationTime: 26.635ms - PrepareTime: 24.145ms DataStreamSender (dst_id=21):(Total: 439.676us, non-child: 439.676us, % non-child: 100.00%) - BytesSent: 36.55 KB (37430) - NetworkThroughput(*): 161.71 MB/sec - OverallThroughput: 81.19 MB/sec - RowsReturned: 365 (365) - SerializeBatchTime: 25.112us - TransmitDataRPCTime: 220.744us - UncompressedRowBatchSize: 88.12 KB (90231) HDFS_SCAN_NODE (id=5):(Total: 2s462ms, non-child: 2s462ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 2s448ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0, 0, 0, 0, 0 - FooterProcessingTime: (Avg: 1.526ms ; Min: 1.526ms ; Max: 1.526ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 237.85 KB (243555) - BytesReadDataNodeCache: 0 - BytesReadLocal: 237.85 KB (243555) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 237.85 KB (243555) - DecompressionTime: 303.228us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.07 MB (1121258) - PerReadThreadRawHdfsThroughput: 389.45 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 7.824ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 365 (365) - RowsReturnedRate: 148.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s316ms - MaterializeTupleTime(*): 3.497ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 3.999ms - ScannerThreadsVoluntaryContextSwitches: 122 (122) - TotalRawHdfsReadTime(*): 596.408us - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 16.38K (16383) - Rows rejected: 0 (0) - Rows total: 16.38K (16384) Averaged Fragment F04:(Total: 51.114ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 115.36 KB, max: 115.36 KB, avg: 115.36 KB, stddev: 0 completion times: min:2s526ms max:2s526ms mean: 2s526ms stddev:0.000ns execution rates: min:45.65 KB/sec max:45.65 KB/sec mean:45.65 KB/sec stddev:0.61 B/sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 256.16 KB (262308) - PerHostPeakMemUsage: 162.87 MB (170781199) - RowsProduced: 1.35K (1350) - TotalCpuTime: 4s864ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 673.620us - TotalStorageWaitTime: 2.689ms Fragment Instance Lifecycle Timings: - ExecTime: 2s474ms - ExecTreeExecTime: 2s470ms - OpenTime: 19.987ms - ExecTreeOpenTime: 46.028us - PrepareTime: 31.105ms - ExecTreePrepareTime: 21.596ms CodeGen:(Total: 41.217ms, non-child: 41.217ms, % non-child: 100.00%) - CodegenTime: 994.216us - CompileTime: 6.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 8 (8) - NumInstructions: 142 (142) - OptimizationTime: 11.227ms - PrepareTime: 23.192ms DataStreamSender (dst_id=22):(Total: 976.012us, non-child: 976.012us, % non-child: 100.00%) - BytesSent: 703.17 KB (720043) - NetworkThroughput(*): 1.38 GB/sec - OverallThroughput: 703.56 MB/sec - RowsReturned: 1.35K (1350) - SerializeBatchTime: 432.104us - TransmitDataRPCTime: 486.072us - UncompressedRowBatchSize: 1.49 MB (1562636) HDFS_SCAN_NODE (id=4):(Total: 2s470ms, non-child: 2s470ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 112.82 KB (115526) - BytesReadDataNodeCache: 0 - BytesReadLocal: 112.82 KB (115526) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 112.82 KB (115526) - DecompressionTime: 5.484us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 182.55 KB (186932) - PerReadThreadRawHdfsThroughput: 2.52 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3.145ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.35K (1350) - RowsReturned: 1.35K (1350) - RowsReturnedRate: 546.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s342ms - MaterializeTupleTime(*): 159.364us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 126 (126) - TotalRawHdfsReadTime(*): 42.712us - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 1.35K (1350) - Rows rejected: 0 (0) - Rows total: 1.35K (1350) Fragment F04: Instance 594518549f864a64:16 (host=d2421.halxg.cloudera.com:22000):(Total: 51.114ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 21:1/115.36 KB MemoryUsage(500.000ms): 73.61 KB, 73.61 KB, 73.61 KB, 73.61 KB, 73.61 KB ThreadUsage(500.000ms): 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 256.16 KB (262308) - PerHostPeakMemUsage: 162.87 MB (170781199) - RowsProduced: 1.35K (1350) - TotalCpuTime: 4s864ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 673.620us - TotalStorageWaitTime: 2.689ms Fragment Instance Lifecycle Timings: - ExecTime: 2s474ms - ExecTreeExecTime: 2s470ms - OpenTime: 19.987ms - ExecTreeOpenTime: 46.028us - PrepareTime: 31.105ms - ExecTreePrepareTime: 21.596ms CodeGen:(Total: 41.217ms, non-child: 41.217ms, % non-child: 100.00%) - CodegenTime: 994.216us - CompileTime: 6.255ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 8 (8) - NumInstructions: 142 (142) - OptimizationTime: 11.227ms - PrepareTime: 23.192ms DataStreamSender (dst_id=22):(Total: 976.012us, non-child: 976.012us, % non-child: 100.00%) - BytesSent: 703.17 KB (720043) - NetworkThroughput(*): 1.38 GB/sec - OverallThroughput: 703.56 MB/sec - RowsReturned: 1.35K (1350) - SerializeBatchTime: 432.104us - TransmitDataRPCTime: 486.072us - UncompressedRowBatchSize: 1.49 MB (1562636) HDFS_SCAN_NODE (id=4):(Total: 2s470ms, non-child: 2s470ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 21:1/115.36 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: Only following filters arrived: , waited 2s468ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0, 0, 0, 0, 0 - FooterProcessingTime: (Avg: 969.064us ; Min: 969.064us ; Max: 969.064us ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 112.82 KB (115526) - BytesReadDataNodeCache: 0 - BytesReadLocal: 112.82 KB (115526) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 112.82 KB (115526) - DecompressionTime: 5.484us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 182.55 KB (186932) - PerReadThreadRawHdfsThroughput: 2.52 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 3.145ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.35K (1350) - RowsReturned: 1.35K (1350) - RowsReturnedRate: 546.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 2s342ms - MaterializeTupleTime(*): 159.364us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 999.000us - ScannerThreadsVoluntaryContextSwitches: 126 (126) - TotalRawHdfsReadTime(*): 42.712us - TotalReadThroughput: 0.00 /sec Filter 1 (1.00 MB): - Rows processed: 1.35K (1350) - Rows rejected: 0 (0) - Rows total: 1.35K (1350) Averaged Fragment F07:(Total: 15s715ms, non-child: 6.861ms, % non-child: 0.04%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:15s730ms max:15s736ms mean: 15s732ms stddev:1.717ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 19 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.98 MB (8363961) - PerHostPeakMemUsage: 425.19 MB (445846248) - RowsProduced: 13.00K (13002) - TotalCpuTime: 683.880ms - TotalNetworkReceiveTime: 15s050ms - TotalNetworkSendTime: 3.498ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.832ms - ExecTreeExecTime: 2.052ms - OpenTime: 15s673ms - ExecTreeOpenTime: 15s056ms - PrepareTime: 42.101ms - ExecTreePrepareTime: 22.657ms CodeGen:(Total: 640.832ms, non-child: 640.832ms, % non-child: 100.00%) - CodegenTime: 3.606ms - CompileTime: 191.741ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 423.732ms - PrepareTime: 24.620ms DataStreamSender (dst_id=29):(Total: 7.560ms, non-child: 7.560ms, % non-child: 100.00%) - BytesSent: 390.21 KB (399573) - NetworkThroughput(*): 133.41 MB/sec - OverallThroughput: 50.87 MB/sec - RowsReturned: 13.00K (13002) - SerializeBatchTime: 3.836ms - TransmitDataRPCTime: 2.896ms - UncompressedRowBatchSize: 2.23 MB (2342042) HASH_JOIN_NODE (id=15):(Total: 15s060ms, non-child: 1.196ms, % non-child: 0.01%) - BuildRows: 1.35K (1350) - BuildTime: 3.145ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.02K (13021) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 456.005us - RowsReturned: 13.00K (13002) - RowsReturnedRate: 862.00 /sec Hash Join Builder (join_node_id=15): - BuildRowsPartitionTime: 120.218us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 334.360us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 220.371us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 39.266us, non-child: 39.266us, % non-child: 100.00%) - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 26.896us - DeserializeRowBatchTimer: 99.458us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 35.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s058ms, non-child: 1.781ms, % non-child: 0.01%) - BuildRows: 366 (366) - BuildTime: 2.977ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.89K (1885) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 244.407us - RowsReturned: 13.02K (13021) - RowsReturnedRate: 864.00 /sec Hash Join Builder (join_node_id=14): - BuildRowsPartitionTime: 26.747us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 354.802us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 210.661us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 16.657us, non-child: 16.657us, % non-child: 100.00%) - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 8.734us - DeserializeRowBatchTimer: 11.851us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 23.07 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s057ms, non-child: 6.215ms, % non-child: 0.04%) - BuildTime: 3.770ms - GetNewBlockTime: 280.146us - GetResultsTime: 239.736us - HTResizeTime: 516.988us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785543) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.89K (1885) - RowsReturnedRate: 124.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.113us EXCHANGE_NODE (id=24):(Total: 15s050ms, non-child: 15s050ms, % non-child: 100.00%) - BytesReceived: 348.13 KB (356481) - ConvertRowBatchTime: 509.149us - DeserializeRowBatchTimer: 2.766ms - FirstBatchArrivalWaitTime: 6s749ms - PeakMemoryUsage: 0 - RowsReturned: 14.87K (14872) - RowsReturnedRate: 987.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Fragment F07: Instance 594518549f864a64:41 (host=d2413.halxg.cloudera.com:22000):(Total: 15s717ms, non-child: 5.489ms, % non-child: 0.03%) MemoryUsage(500.000ms): 2.41 MB, 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.81 MB, 7.72 MB, 7.83 MB, 7.83 MB, 7.74 MB, 7.83 MB, 7.79 MB, 7.75 MB, 7.75 MB, 7.81 MB, 7.81 MB, 7.74 MB, 7.83 MB, 7.83 MB, 7.83 MB, 7.83 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.97 MB (8356632) - PerHostPeakMemUsage: 434.44 MB (455541136) - RowsProduced: 13.24K (13239) - TotalCpuTime: 670.450ms - TotalNetworkReceiveTime: 15s067ms - TotalNetworkSendTime: 3.223ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 16.946ms - ExecTreeExecTime: 2.266ms - OpenTime: 15s677ms - ExecTreeOpenTime: 15s072ms - PrepareTime: 40.073ms - ExecTreePrepareTime: 21.471ms CodeGen:(Total: 626.921ms, non-child: 626.921ms, % non-child: 100.00%) - CodegenTime: 4.938ms - CompileTime: 187.908ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 414.235ms - PrepareTime: 24.228ms DataStreamSender (dst_id=29):(Total: 7.926ms, non-child: 7.926ms, % non-child: 100.00%) - BytesSent: 398.01 KB (407565) - NetworkThroughput(*): 136.46 MB/sec - OverallThroughput: 49.04 MB/sec - RowsReturned: 13.24K (13239) - SerializeBatchTime: 4.384ms - TransmitDataRPCTime: 2.848ms - UncompressedRowBatchSize: 2.27 MB (2384616) HASH_JOIN_NODE (id=15):(Total: 15s077ms, non-child: 1.574ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.442ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.27K (13267) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 586.944us - RowsReturned: 13.24K (13239) - RowsReturnedRate: 878.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 122.012us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 345.916us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 242.168us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 36.724us, non-child: 36.724us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 24.564us - DeserializeRowBatchTimer: 103.352us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 36.76 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s075ms, non-child: 1.764ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.448ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.92K (1919) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 291.636us - RowsReturned: 13.27K (13267) - RowsReturnedRate: 880.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.524us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 704.064us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 370.612us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 15.032us, non-child: 15.032us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.044us - DeserializeRowBatchTimer: 30.696us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 24.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s073ms, non-child: 5.433ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.362ms - GetNewBlockTime: 156.064us - GetResultsTime: 289.508us - HTResizeTime: 477.552us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.65 MB (2783108) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.92K (1919) - RowsReturnedRate: 127.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 884.000ns EXCHANGE_NODE (id=24):(Total: 15s068ms, non-child: 1.080ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.52 KB, 38.54 KB, 44.91 KB, 67.00 KB, 67.00 KB, 118.96 KB, 138.48 KB, 176.19 KB, 195.22 KB, 217.70 KB, 280.33 KB, 280.33 KB, 317.15 KB, 336.03 KB, 336.03 KB, 336.03 KB, 336.03 KB - BytesReceived: 356.65 KB (365209) - ConvertRowBatchTime: 409.176us - DeserializeRowBatchTimer: 3.009ms - FirstBatchArrivalWaitTime: 6s769ms - PeakMemoryUsage: 0 - RowsReturned: 15.15K (15147) - RowsReturnedRate: 1.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:40 (host=d2406.halxg.cloudera.com:22000):(Total: 15s717ms, non-child: 6.593ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.41 MB, 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.76 MB, 7.84 MB, 7.82 MB, 7.82 MB, 7.72 MB, 7.82 MB, 7.76 MB, 7.84 MB, 7.82 MB, 7.76 MB, 7.76 MB, 7.83 MB, 7.79 MB, 7.79 MB, 7.79 MB, 7.79 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.97 MB (8356632) - PerHostPeakMemUsage: 404.25 MB (423884539) - RowsProduced: 12.89K (12893) - TotalCpuTime: 672.010ms - TotalNetworkReceiveTime: 15s063ms - TotalNetworkSendTime: 3.589ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.581ms - ExecTreeExecTime: 1.573ms - OpenTime: 15s676ms - ExecTreeOpenTime: 15s069ms - PrepareTime: 40.326ms - ExecTreePrepareTime: 22.398ms CodeGen:(Total: 631.424ms, non-child: 631.424ms, % non-child: 100.00%) - CodegenTime: 3.213ms - CompileTime: 189.110ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 417.022ms - PrepareTime: 24.735ms DataStreamSender (dst_id=29):(Total: 7.033ms, non-child: 7.033ms, % non-child: 100.00%) - BytesSent: 387.02 KB (396310) - NetworkThroughput(*): 138.66 MB/sec - OverallThroughput: 53.74 MB/sec - RowsReturned: 12.89K (12893) - SerializeBatchTime: 3.611ms - TransmitDataRPCTime: 2.725ms - UncompressedRowBatchSize: 2.21 MB (2322276) HASH_JOIN_NODE (id=15):(Total: 15s072ms, non-child: 1.043ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.944ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.91K (12914) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 408.202us - RowsReturned: 12.89K (12893) - RowsReturnedRate: 855.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 125.396us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 138.800us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 76.876us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 32.409us, non-child: 32.409us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.100us - DeserializeRowBatchTimer: 116.432us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 41.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s071ms, non-child: 1.438ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.904ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.87K (1872) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 239.906us - RowsReturned: 12.91K (12914) - RowsReturnedRate: 856.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.120us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 218.558us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 133.318us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 17.166us, non-child: 17.166us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.482us - DeserializeRowBatchTimer: 7.636us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 21.32 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s069ms, non-child: 5.755ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.908ms - GetNewBlockTime: 147.834us - GetResultsTime: 227.004us - HTResizeTime: 419.888us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2786906) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.87K (1872) - RowsReturnedRate: 124.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.104us EXCHANGE_NODE (id=24):(Total: 15s064ms, non-child: 1.257ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.30 KB, 28.53 KB, 43.19 KB, 64.86 KB, 64.86 KB, 116.49 KB, 135.20 KB, 170.77 KB, 188.02 KB, 210.30 KB, 270.62 KB, 270.62 KB, 307.89 KB, 327.58 KB, 327.58 KB, 327.58 KB, 327.58 KB - BytesReceived: 346.83 KB (355149) - ConvertRowBatchTime: 488.868us - DeserializeRowBatchTimer: 2.241ms - FirstBatchArrivalWaitTime: 6s766ms - PeakMemoryUsage: 0 - RowsReturned: 14.81K (14809) - RowsReturnedRate: 983.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:42 (host=d2414.halxg.cloudera.com:22000):(Total: 15s716ms, non-child: 11.321ms, % non-child: 0.07%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.76 MB, 7.73 MB, 7.73 MB, 7.84 MB, 7.73 MB, 7.83 MB, 7.83 MB, 7.73 MB, 7.73 MB, 7.81 MB, 7.77 MB, 7.74 MB, 7.82 MB, 7.79 MB, 7.79 MB, 7.79 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.98 MB (8364824) - PerHostPeakMemUsage: 452.28 MB (474247758) - RowsProduced: 13.02K (13019) - TotalCpuTime: 680.346ms - TotalNetworkReceiveTime: 15s056ms - TotalNetworkSendTime: 2.754ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 16.846ms - ExecTreeExecTime: 2.526ms - OpenTime: 15s665ms - ExecTreeOpenTime: 15s061ms - PrepareTime: 50.643ms - ExecTreePrepareTime: 22.323ms CodeGen:(Total: 627.238ms, non-child: 627.238ms, % non-child: 100.00%) - CodegenTime: 5.512ms - CompileTime: 186.600ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 415.159ms - PrepareTime: 24.872ms DataStreamSender (dst_id=29):(Total: 8.885ms, non-child: 8.885ms, % non-child: 100.00%) - BytesSent: 390.18 KB (399541) - NetworkThroughput(*): 114.84 MB/sec - OverallThroughput: 42.88 MB/sec - RowsReturned: 13.02K (13019) - SerializeBatchTime: 4.464ms - TransmitDataRPCTime: 3.317ms - UncompressedRowBatchSize: 2.24 MB (2344980) HASH_JOIN_NODE (id=15):(Total: 15s068ms, non-child: 1.437ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.118ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.04K (13040) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 533.158us - RowsReturned: 13.02K (13019) - RowsReturnedRate: 863.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 114.780us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 103.192us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 531.252us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 34.780us, non-child: 34.780us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.728us - DeserializeRowBatchTimer: 97.804us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 38.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s067ms, non-child: 3.270ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.991ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.89K (1888) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 301.076us - RowsReturned: 13.04K (13040) - RowsReturnedRate: 865.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.704us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 170.806us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 511.226us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 16.536us, non-child: 16.536us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.586us - DeserializeRowBatchTimer: 9.184us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 22.13 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s064ms, non-child: 6.936ms, % non-child: 0.05%) ExecOption: Codegen Enabled - BuildTime: 3.167ms - GetNewBlockTime: 1.182ms - GetResultsTime: 284.378us - HTResizeTime: 392.770us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2788440) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.89K (1888) - RowsReturnedRate: 125.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.370us EXCHANGE_NODE (id=24):(Total: 15s057ms, non-child: 1.347ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 30.54 KB, 44.83 KB, 44.83 KB, 66.38 KB, 92.71 KB, 135.99 KB, 135.99 KB, 189.54 KB, 189.54 KB, 255.43 KB, 272.01 KB, 290.17 KB, 307.46 KB, 327.03 KB, 327.03 KB, 327.03 KB - BytesReceived: 346.84 KB (355166) - ConvertRowBatchTime: 413.052us - DeserializeRowBatchTimer: 2.250ms - FirstBatchArrivalWaitTime: 6s757ms - PeakMemoryUsage: 0 - RowsReturned: 14.82K (14819) - RowsReturnedRate: 984.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:43 (host=d2402.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 4.871ms, % non-child: 0.03%) MemoryUsage(500.000ms): 2.41 MB, 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.76 MB, 7.72 MB, 7.83 MB, 7.83 MB, 7.83 MB, 7.81 MB, 7.80 MB, 7.84 MB, 7.82 MB, 7.74 MB, 7.74 MB, 7.80 MB, 7.77 MB, 7.77 MB, 7.77 MB, 7.77 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.96 MB (8348440) - PerHostPeakMemUsage: 470.56 MB (493413990) - RowsProduced: 12.76K (12764) - TotalCpuTime: 676.786ms - TotalNetworkReceiveTime: 15s058ms - TotalNetworkSendTime: 4.021ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 16.081ms - ExecTreeExecTime: 1.776ms - OpenTime: 15s675ms - ExecTreeOpenTime: 15s063ms - PrepareTime: 40.202ms - ExecTreePrepareTime: 22.304ms CodeGen:(Total: 635.677ms, non-child: 635.677ms, % non-child: 100.00%) - CodegenTime: 3.367ms - CompileTime: 190.492ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 419.884ms - PrepareTime: 24.726ms DataStreamSender (dst_id=29):(Total: 8.041ms, non-child: 8.041ms, % non-child: 100.00%) - BytesSent: 383.34 KB (392536) - NetworkThroughput(*): 133.38 MB/sec - OverallThroughput: 46.55 MB/sec - RowsReturned: 12.76K (12764) - SerializeBatchTime: 3.869ms - TransmitDataRPCTime: 2.806ms - UncompressedRowBatchSize: 2.19 MB (2299080) HASH_JOIN_NODE (id=15):(Total: 15s067ms, non-child: 1.105ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.580ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.77K (12771) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 435.892us - RowsReturned: 12.76K (12764) - RowsReturnedRate: 847.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 113.968us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 540.160us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 179.088us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 33.548us, non-child: 33.548us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.064us - DeserializeRowBatchTimer: 92.068us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 40.24 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s066ms, non-child: 1.802ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.233ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.85K (1850) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 228.984us - RowsReturned: 12.77K (12771) - RowsReturnedRate: 847.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.624us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 235.756us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 192.592us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 25.868us, non-child: 25.868us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 16.444us - DeserializeRowBatchTimer: 6.960us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 14.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s064ms, non-child: 5.468ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.445ms - GetNewBlockTime: 154.508us - GetResultsTime: 225.792us - HTResizeTime: 404.308us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785198) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.85K (1850) - RowsReturnedRate: 122.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.260us EXCHANGE_NODE (id=24):(Total: 15s058ms, non-child: 1.443ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.25 KB, 29.62 KB, 44.75 KB, 66.41 KB, 66.41 KB, 115.16 KB, 134.00 KB, 154.60 KB, 186.86 KB, 209.19 KB, 267.87 KB, 267.87 KB, 303.73 KB, 321.73 KB, 321.73 KB, 321.73 KB, 321.73 KB - BytesReceived: 340.93 KB (349114) - ConvertRowBatchTime: 500.176us - DeserializeRowBatchTimer: 2.835ms - FirstBatchArrivalWaitTime: 6s759ms - PeakMemoryUsage: 0 - RowsReturned: 14.55K (14550) - RowsReturnedRate: 966.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:50 (host=d2416.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 6.173ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.41 MB, 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.76 MB, 7.73 MB, 7.84 MB, 7.72 MB, 7.74 MB, 7.83 MB, 7.81 MB, 7.75 MB, 7.75 MB, 7.82 MB, 7.82 MB, 7.76 MB, 7.73 MB, 7.73 MB, 7.73 MB, 7.73 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.95 MB (8332056) - PerHostPeakMemUsage: 452.30 MB (474274611) - RowsProduced: 13.31K (13306) - TotalCpuTime: 666.624ms - TotalNetworkReceiveTime: 15s065ms - TotalNetworkSendTime: 3.204ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 14.578ms - ExecTreeExecTime: 1.741ms - OpenTime: 15s678ms - ExecTreeOpenTime: 15s070ms - PrepareTime: 37.505ms - ExecTreePrepareTime: 20.147ms CodeGen:(Total: 628.262ms, non-child: 628.262ms, % non-child: 100.00%) - CodegenTime: 3.195ms - CompileTime: 191.907ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 413.722ms - PrepareTime: 22.098ms DataStreamSender (dst_id=29):(Total: 7.129ms, non-child: 7.129ms, % non-child: 100.00%) - BytesSent: 398.93 KB (408506) - NetworkThroughput(*): 142.15 MB/sec - OverallThroughput: 54.64 MB/sec - RowsReturned: 13.31K (13306) - SerializeBatchTime: 3.633ms - TransmitDataRPCTime: 2.740ms - UncompressedRowBatchSize: 2.29 MB (2396688) HASH_JOIN_NODE (id=15):(Total: 15s073ms, non-child: 1.058ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.553ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.31K (13313) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 421.724us - RowsReturned: 13.31K (13306) - RowsReturnedRate: 882.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 115.956us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 152.964us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 171.584us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 34.952us, non-child: 34.952us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 22.948us - DeserializeRowBatchTimer: 93.784us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 38.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s072ms, non-child: 1.455ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.382ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.93K (1927) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 224.716us - RowsReturned: 13.31K (13313) - RowsReturnedRate: 883.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.544us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 193.496us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 144.196us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 12.744us, non-child: 12.744us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 6.900us - DeserializeRowBatchTimer: 7.376us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 28.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s071ms, non-child: 5.334ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.353ms - GetNewBlockTime: 154.064us - GetResultsTime: 218.340us - HTResizeTime: 367.732us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.65 MB (2783246) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.93K (1927) - RowsReturnedRate: 127.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 928.000ns EXCHANGE_NODE (id=24):(Total: 15s066ms, non-child: 1.482ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.09 KB, 30.85 KB, 46.27 KB, 67.35 KB, 67.90 KB, 119.68 KB, 138.68 KB, 157.87 KB, 195.43 KB, 218.56 KB, 280.97 KB, 280.97 KB, 319.13 KB, 338.75 KB, 338.75 KB, 338.75 KB, 338.75 KB - BytesReceived: 359.18 KB (367798) - ConvertRowBatchTime: 494.964us - DeserializeRowBatchTimer: 2.596ms - FirstBatchArrivalWaitTime: 6s761ms - PeakMemoryUsage: 0 - RowsReturned: 15.33K (15330) - RowsReturnedRate: 1.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:4e (host=d2405.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 7.354ms, % non-child: 0.05%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.72 MB, 7.72 MB, 7.83 MB, 7.80 MB, 7.83 MB, 7.83 MB, 7.77 MB, 7.77 MB, 7.73 MB, 7.81 MB, 7.78 MB, 7.74 MB, 7.73 MB, 7.73 MB, 7.73 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 8.01 MB (8397592) - PerHostPeakMemUsage: 386.37 MB (405137773) - RowsProduced: 13.44K (13436) - TotalCpuTime: 675.931ms - TotalNetworkReceiveTime: 15s057ms - TotalNetworkSendTime: 3.657ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.463ms - ExecTreeExecTime: 1.867ms - OpenTime: 15s675ms - ExecTreeOpenTime: 15s063ms - PrepareTime: 40.011ms - ExecTreePrepareTime: 21.181ms CodeGen:(Total: 634.165ms, non-child: 634.165ms, % non-child: 100.00%) - CodegenTime: 3.358ms - CompileTime: 192.490ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 418.081ms - PrepareTime: 23.019ms DataStreamSender (dst_id=29):(Total: 7.275ms, non-child: 7.275ms, % non-child: 100.00%) - BytesSent: 403.08 KB (412759) - NetworkThroughput(*): 138.73 MB/sec - OverallThroughput: 54.11 MB/sec - RowsReturned: 13.44K (13436) - SerializeBatchTime: 3.681ms - TransmitDataRPCTime: 2.837ms - UncompressedRowBatchSize: 2.31 MB (2420088) HASH_JOIN_NODE (id=15):(Total: 15s066ms, non-child: 1.162ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.799ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.46K (13461) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 423.708us - RowsReturned: 13.44K (13436) - RowsReturnedRate: 891.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 116.348us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 310.572us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 208.788us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 32.728us, non-child: 32.728us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.052us - DeserializeRowBatchTimer: 98.280us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 41.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s065ms, non-child: 1.442ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.710ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.95K (1949) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 226.728us - RowsReturned: 13.46K (13461) - RowsReturnedRate: 893.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.232us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 330.376us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 164.048us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 12.836us, non-child: 12.836us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 6.736us - DeserializeRowBatchTimer: 9.464us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 28.51 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s064ms, non-child: 5.120ms, % non-child: 0.03%) ExecOption: Codegen Enabled - BuildTime: 3.052ms - GetNewBlockTime: 155.556us - GetResultsTime: 213.428us - HTResizeTime: 435.116us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2784344) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.95K (1949) - RowsReturnedRate: 129.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 912.000ns EXCHANGE_NODE (id=24):(Total: 15s058ms, non-child: 3.139ms, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.13 KB, 45.53 KB, 45.53 KB, 67.41 KB, 85.58 KB, 139.17 KB, 139.17 KB, 196.17 KB, 196.17 KB, 263.01 KB, 280.67 KB, 298.35 KB, 316.20 KB, 335.42 KB, 335.42 KB, 335.42 KB - BytesReceived: 356.23 KB (364782) - ConvertRowBatchTime: 1.172ms - DeserializeRowBatchTimer: 2.448ms - FirstBatchArrivalWaitTime: 6s755ms - PeakMemoryUsage: 0 - RowsReturned: 15.24K (15239) - RowsReturnedRate: 1.01 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:45 (host=d2418.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 5.961ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.84 MB, 7.84 MB, 7.82 MB, 7.80 MB, 7.83 MB, 7.83 MB, 7.75 MB, 7.75 MB, 7.73 MB, 7.81 MB, 7.76 MB, 7.74 MB, 7.84 MB, 7.84 MB, 7.84 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 8.02 MB (8405784) - PerHostPeakMemUsage: 434.49 MB (455591858) - RowsProduced: 13.03K (13032) - TotalCpuTime: 674.136ms - TotalNetworkReceiveTime: 15s059ms - TotalNetworkSendTime: 3.391ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.144ms - ExecTreeExecTime: 1.896ms - OpenTime: 15s675ms - ExecTreeOpenTime: 15s065ms - PrepareTime: 39.933ms - ExecTreePrepareTime: 22.177ms CodeGen:(Total: 633.059ms, non-child: 633.059ms, % non-child: 100.00%) - CodegenTime: 3.160ms - CompileTime: 190.307ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 418.067ms - PrepareTime: 24.112ms DataStreamSender (dst_id=29):(Total: 7.180ms, non-child: 7.180ms, % non-child: 100.00%) - BytesSent: 391.28 KB (400670) - NetworkThroughput(*): 136.26 MB/sec - OverallThroughput: 53.22 MB/sec - RowsReturned: 13.03K (13032) - SerializeBatchTime: 3.625ms - TransmitDataRPCTime: 2.804ms - UncompressedRowBatchSize: 2.24 MB (2347320) HASH_JOIN_NODE (id=15):(Total: 15s069ms, non-child: 1.057ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.332ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.04K (13039) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 399.792us - RowsReturned: 13.03K (13032) - RowsReturnedRate: 864.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 119.160us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 378.704us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 225.800us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 44.924us, non-child: 44.924us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 32.980us - DeserializeRowBatchTimer: 94.044us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 30.05 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s068ms, non-child: 1.480ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.214ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.89K (1893) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 237.092us - RowsReturned: 13.04K (13039) - RowsReturnedRate: 865.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.540us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 387.496us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 189.688us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 15.700us, non-child: 15.700us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.284us - DeserializeRowBatchTimer: 9.512us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 23.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s066ms, non-child: 6.064ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.884ms - GetNewBlockTime: 159.192us - GetResultsTime: 224.200us - HTResizeTime: 511.656us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785686) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.89K (1893) - RowsReturnedRate: 125.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 940.000ns EXCHANGE_NODE (id=24):(Total: 15s060ms, non-child: 1.433ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.33 KB, 44.50 KB, 44.50 KB, 66.32 KB, 84.63 KB, 137.97 KB, 137.97 KB, 193.32 KB, 193.32 KB, 259.88 KB, 278.15 KB, 295.75 KB, 313.44 KB, 333.43 KB, 333.43 KB, 333.43 KB - BytesReceived: 352.79 KB (361252) - ConvertRowBatchTime: 530.608us - DeserializeRowBatchTimer: 2.587ms - FirstBatchArrivalWaitTime: 6s761ms - PeakMemoryUsage: 0 - RowsReturned: 15.11K (15112) - RowsReturnedRate: 1.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:47 (host=d2421.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 5.764ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.76 MB, 7.72 MB, 7.72 MB, 7.83 MB, 7.77 MB, 7.83 MB, 7.81 MB, 7.73 MB, 7.73 MB, 7.83 MB, 7.79 MB, 7.75 MB, 7.72 MB, 7.82 MB, 7.82 MB, 7.82 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.98 MB (8364824) - PerHostPeakMemUsage: 376.57 MB (394860975) - RowsProduced: 13.05K (13046) - TotalCpuTime: 671.208ms - TotalNetworkReceiveTime: 15s063ms - TotalNetworkSendTime: 3.430ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.385ms - ExecTreeExecTime: 2.047ms - OpenTime: 15s671ms - ExecTreeOpenTime: 15s069ms - PrepareTime: 43.689ms - ExecTreePrepareTime: 24.806ms CodeGen:(Total: 627.859ms, non-child: 627.859ms, % non-child: 100.00%) - CodegenTime: 3.327ms - CompileTime: 184.619ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 416.419ms - PrepareTime: 23.754ms DataStreamSender (dst_id=29):(Total: 7.239ms, non-child: 7.239ms, % non-child: 100.00%) - BytesSent: 392.20 KB (401615) - NetworkThroughput(*): 135.54 MB/sec - OverallThroughput: 52.90 MB/sec - RowsReturned: 13.05K (13046) - SerializeBatchTime: 3.676ms - TransmitDataRPCTime: 2.825ms - UncompressedRowBatchSize: 2.24 MB (2349852) HASH_JOIN_NODE (id=15):(Total: 15s074ms, non-child: 1.278ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.694ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.07K (13074) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 467.148us - RowsReturned: 13.05K (13046) - RowsReturnedRate: 865.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 114.224us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 347.708us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 301.724us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 34.260us, non-child: 34.260us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.180us - DeserializeRowBatchTimer: 103.312us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 39.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s073ms, non-child: 2.254ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.390ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.90K (1899) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 231.884us - RowsReturned: 13.07K (13074) - RowsReturnedRate: 867.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.744us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 356.544us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 132.516us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 17.080us, non-child: 17.080us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.856us - DeserializeRowBatchTimer: 9.900us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 21.43 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s070ms, non-child: 6.911ms, % non-child: 0.05%) ExecOption: Codegen Enabled - BuildTime: 3.765ms - GetNewBlockTime: 744.092us - GetResultsTime: 243.044us - HTResizeTime: 492.436us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.65 MB (2783246) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.90K (1899) - RowsReturnedRate: 126.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.568us EXCHANGE_NODE (id=24):(Total: 15s064ms, non-child: 1.264ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.45 KB, 29.87 KB, 45.27 KB, 45.27 KB, 67.72 KB, 101.68 KB, 137.41 KB, 156.16 KB, 192.34 KB, 192.34 KB, 258.62 KB, 276.23 KB, 294.80 KB, 312.65 KB, 331.74 KB, 331.74 KB, 331.74 KB - BytesReceived: 351.78 KB (360222) - ConvertRowBatchTime: 468.700us - DeserializeRowBatchTimer: 2.553ms - FirstBatchArrivalWaitTime: 6s763ms - PeakMemoryUsage: 0 - RowsReturned: 15.01K (15013) - RowsReturnedRate: 996.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:46 (host=d2404.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 5.182ms, % non-child: 0.03%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.83 MB, 7.83 MB, 7.82 MB, 7.78 MB, 7.81 MB, 7.81 MB, 7.83 MB, 7.83 MB, 7.78 MB, 7.74 MB, 7.83 MB, 7.80 MB, 7.76 MB, 7.76 MB, 7.76 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.91 MB (8299288) - PerHostPeakMemUsage: 446.16 MB (467827573) - RowsProduced: 12.71K (12710) - TotalCpuTime: 677.194ms - TotalNetworkReceiveTime: 15s056ms - TotalNetworkSendTime: 3.860ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 16.127ms - ExecTreeExecTime: 2.097ms - OpenTime: 15s675ms - ExecTreeOpenTime: 15s062ms - PrepareTime: 39.410ms - ExecTreePrepareTime: 22.477ms CodeGen:(Total: 636.660ms, non-child: 636.660ms, % non-child: 100.00%) - CodegenTime: 3.168ms - CompileTime: 194.693ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 417.095ms - PrepareTime: 24.288ms DataStreamSender (dst_id=29):(Total: 6.909ms, non-child: 6.909ms, % non-child: 100.00%) - BytesSent: 381.22 KB (390371) - NetworkThroughput(*): 145.19 MB/sec - OverallThroughput: 53.88 MB/sec - RowsReturned: 12.71K (12710) - SerializeBatchTime: 3.622ms - TransmitDataRPCTime: 2.564ms - UncompressedRowBatchSize: 2.18 MB (2289360) HASH_JOIN_NODE (id=15):(Total: 15s066ms, non-child: 1.154ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.148ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.73K (12731) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 431.672us - RowsReturned: 12.71K (12710) - RowsReturnedRate: 843.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 115.376us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 509.560us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 291.560us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 46.404us, non-child: 46.404us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 33.224us - DeserializeRowBatchTimer: 116.256us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 29.09 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s065ms, non-child: 1.614ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.972ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.84K (1843) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 248.836us - RowsReturned: 12.73K (12731) - RowsReturnedRate: 845.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.888us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 597.036us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 230.976us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 14.968us, non-child: 14.968us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 6.840us - DeserializeRowBatchTimer: 10.092us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 24.45 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s063ms, non-child: 6.435ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 4.056ms - GetNewBlockTime: 172.112us - GetResultsTime: 249.544us - HTResizeTime: 608.780us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785198) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.84K (1843) - RowsReturnedRate: 122.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 988.000ns EXCHANGE_NODE (id=24):(Total: 15s057ms, non-child: 1.202ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.41 KB, 42.49 KB, 42.49 KB, 63.16 KB, 80.01 KB, 132.18 KB, 132.18 KB, 186.16 KB, 186.16 KB, 249.62 KB, 266.34 KB, 284.58 KB, 301.48 KB, 319.60 KB, 319.60 KB, 319.60 KB - BytesReceived: 337.98 KB (346090) - ConvertRowBatchTime: 428.864us - DeserializeRowBatchTimer: 2.566ms - FirstBatchArrivalWaitTime: 6s758ms - PeakMemoryUsage: 0 - RowsReturned: 14.46K (14457) - RowsReturnedRate: 960.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:44 (host=d2403.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 6.828ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.73 MB, 7.73 MB, 7.72 MB, 7.81 MB, 7.74 MB, 7.74 MB, 7.77 MB, 7.77 MB, 7.74 MB, 7.83 MB, 7.80 MB, 7.77 MB, 7.75 MB, 7.75 MB, 7.75 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.95 MB (8340248) - PerHostPeakMemUsage: 373.40 MB (391534926) - RowsProduced: 13.55K (13550) - TotalCpuTime: 691.737ms - TotalNetworkReceiveTime: 15s042ms - TotalNetworkSendTime: 3.726ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 17.139ms - ExecTreeExecTime: 2.245ms - OpenTime: 15s670ms - ExecTreeOpenTime: 15s047ms - PrepareTime: 44.395ms - ExecTreePrepareTime: 23.713ms CodeGen:(Total: 647.218ms, non-child: 647.218ms, % non-child: 100.00%) - CodegenTime: 3.458ms - CompileTime: 193.179ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 428.138ms - PrepareTime: 24.792ms DataStreamSender (dst_id=29):(Total: 8.019ms, non-child: 8.019ms, % non-child: 100.00%) - BytesSent: 406.44 KB (416197) - NetworkThroughput(*): 133.73 MB/sec - OverallThroughput: 49.50 MB/sec - RowsReturned: 13.55K (13550) - SerializeBatchTime: 4.265ms - TransmitDataRPCTime: 2.967ms - UncompressedRowBatchSize: 2.33 MB (2440632) HASH_JOIN_NODE (id=15):(Total: 15s053ms, non-child: 1.384ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.750ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.56K (13564) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 533.952us - RowsReturned: 13.55K (13550) - RowsReturnedRate: 900.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 137.576us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 343.488us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 114.256us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 34.344us, non-child: 34.344us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.564us - DeserializeRowBatchTimer: 105.704us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 39.31 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s051ms, non-child: 2.271ms, % non-child: 0.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.498ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.96K (1961) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 295.420us - RowsReturned: 13.56K (13564) - RowsReturnedRate: 901.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.472us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 186.212us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 123.916us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 16.856us, non-child: 16.856us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.256us - DeserializeRowBatchTimer: 13.204us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 21.71 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s049ms, non-child: 6.574ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.588ms - GetNewBlockTime: 786.588us - GetResultsTime: 294.132us - HTResizeTime: 622.352us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.65 MB (2783108) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.96K (1961) - RowsReturnedRate: 130.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.628us EXCHANGE_NODE (id=24):(Total: 15s042ms, non-child: 1.070ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.12 KB, 46.09 KB, 46.09 KB, 68.37 KB, 86.61 KB, 141.09 KB, 141.09 KB, 197.45 KB, 197.45 KB, 265.75 KB, 283.93 KB, 302.93 KB, 321.30 KB, 341.24 KB, 341.24 KB, 341.24 KB - BytesReceived: 360.77 KB (369430) - ConvertRowBatchTime: 444.792us - DeserializeRowBatchTimer: 2.838ms - FirstBatchArrivalWaitTime: 6s743ms - PeakMemoryUsage: 0 - RowsReturned: 15.38K (15383) - RowsReturnedRate: 1.02 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:4a (host=d2415.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 6.098ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.47 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.84 MB, 7.84 MB, 7.82 MB, 7.79 MB, 7.83 MB, 7.81 MB, 7.84 MB, 7.84 MB, 7.81 MB, 7.76 MB, 7.80 MB, 7.81 MB, 7.79 MB, 7.79 MB, 7.79 MB, 7.79 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.99 MB (8373016) - PerHostPeakMemUsage: 428.23 MB (449029818) - RowsProduced: 12.77K (12767) - TotalCpuTime: 675.590ms - TotalNetworkReceiveTime: 15s057ms - TotalNetworkSendTime: 4.084ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.725ms - ExecTreeExecTime: 2.409ms - OpenTime: 15s674ms - ExecTreeOpenTime: 15s063ms - PrepareTime: 40.291ms - ExecTreePrepareTime: 21.975ms CodeGen:(Total: 634.627ms, non-child: 634.627ms, % non-child: 100.00%) - CodegenTime: 3.211ms - CompileTime: 191.392ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 418.808ms - PrepareTime: 23.846ms DataStreamSender (dst_id=29):(Total: 7.325ms, non-child: 7.325ms, % non-child: 100.00%) - BytesSent: 382.65 KB (391838) - NetworkThroughput(*): 132.95 MB/sec - OverallThroughput: 51.01 MB/sec - RowsReturned: 12.77K (12767) - SerializeBatchTime: 3.535ms - TransmitDataRPCTime: 2.810ms - UncompressedRowBatchSize: 2.19 MB (2299608) HASH_JOIN_NODE (id=15):(Total: 15s067ms, non-child: 1.089ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.001ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.79K (12793) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 480.480us - RowsReturned: 12.77K (12767) - RowsReturnedRate: 847.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 119.052us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 603.344us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 93.920us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 33.948us, non-child: 33.948us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.916us - DeserializeRowBatchTimer: 88.356us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 39.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s066ms, non-child: 1.589ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.751ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.85K (1849) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 240.748us - RowsReturned: 12.79K (12793) - RowsReturnedRate: 849.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.856us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 196.392us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 144.252us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 26.172us, non-child: 26.172us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 15.892us - DeserializeRowBatchTimer: 8.276us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 13.98 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s064ms, non-child: 6.630ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 4.220ms - GetNewBlockTime: 156.404us - GetResultsTime: 217.000us - HTResizeTime: 613.596us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2787168) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.85K (1849) - RowsReturnedRate: 122.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 884.000ns EXCHANGE_NODE (id=24):(Total: 15s057ms, non-child: 1.206ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.53 KB, 43.43 KB, 43.43 KB, 64.73 KB, 81.76 KB, 114.82 KB, 133.83 KB, 187.90 KB, 187.90 KB, 230.49 KB, 270.38 KB, 280.22 KB, 307.72 KB, 326.33 KB, 326.33 KB, 326.33 KB, 326.33 KB - BytesReceived: 344.80 KB (353071) - ConvertRowBatchTime: 406.872us - DeserializeRowBatchTimer: 2.435ms - FirstBatchArrivalWaitTime: 6s757ms - PeakMemoryUsage: 0 - RowsReturned: 14.73K (14735) - RowsReturnedRate: 978.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:51 (host=d2417.halxg.cloudera.com:22000):(Total: 15s715ms, non-child: 9.667ms, % non-child: 0.06%) MemoryUsage(500.000ms): 2.41 MB, 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.76 MB, 7.84 MB, 7.76 MB, 7.82 MB, 7.84 MB, 7.80 MB, 7.78 MB, 7.82 MB, 7.82 MB, 7.75 MB, 7.75 MB, 7.80 MB, 7.77 MB, 7.77 MB, 7.77 MB, 7.77 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.95 MB (8332056) - PerHostPeakMemUsage: 422.28 MB (442794776) - RowsProduced: 12.76K (12759) - TotalCpuTime: 679.357ms - TotalNetworkReceiveTime: 15s053ms - TotalNetworkSendTime: 3.358ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 14.901ms - ExecTreeExecTime: 1.733ms - OpenTime: 15s672ms - ExecTreeOpenTime: 15s059ms - PrepareTime: 42.759ms - ExecTreePrepareTime: 21.092ms CodeGen:(Total: 634.779ms, non-child: 634.779ms, % non-child: 100.00%) - CodegenTime: 3.500ms - CompileTime: 193.527ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 416.605ms - PrepareTime: 24.108ms DataStreamSender (dst_id=29):(Total: 7.585ms, non-child: 7.585ms, % non-child: 100.00%) - BytesSent: 382.53 KB (391712) - NetworkThroughput(*): 134.55 MB/sec - OverallThroughput: 49.25 MB/sec - RowsReturned: 12.76K (12759) - SerializeBatchTime: 3.804ms - TransmitDataRPCTime: 2.776ms - UncompressedRowBatchSize: 2.19 MB (2298144) HASH_JOIN_NODE (id=15):(Total: 15s063ms, non-child: 1.095ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.417ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.78K (12780) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 410.704us - RowsReturned: 12.76K (12759) - RowsReturnedRate: 847.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 119.650us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 538.406us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 295.970us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 45.824us, non-child: 45.824us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 35.244us - DeserializeRowBatchTimer: 88.646us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 29.46 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s061ms, non-child: 1.602ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.880ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.85K (1852) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 218.298us - RowsReturned: 12.78K (12780) - RowsReturnedRate: 848.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.040us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 271.106us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 137.956us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 24.692us, non-child: 24.692us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 18.352us - DeserializeRowBatchTimer: 9.176us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 14.82 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s060ms, non-child: 5.560ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.674ms - GetNewBlockTime: 144.362us - GetResultsTime: 220.922us - HTResizeTime: 616.374us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.65 MB (2783072) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.85K (1852) - RowsReturnedRate: 122.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.018us EXCHANGE_NODE (id=24):(Total: 15s054ms, non-child: 1.880ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.93 KB, 29.11 KB, 42.82 KB, 51.76 KB, 64.01 KB, 114.04 KB, 131.07 KB, 149.59 KB, 185.34 KB, 206.60 KB, 267.51 KB, 267.51 KB, 302.70 KB, 321.34 KB, 321.34 KB, 321.34 KB, 321.34 KB - BytesReceived: 340.87 KB (349053) - ConvertRowBatchTime: 672.180us - DeserializeRowBatchTimer: 2.917ms - FirstBatchArrivalWaitTime: 6s750ms - PeakMemoryUsage: 0 - RowsReturned: 14.59K (14592) - RowsReturnedRate: 969.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:4b (host=d2409.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 4.561ms, % non-child: 0.03%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.84 MB, 7.84 MB, 7.82 MB, 7.79 MB, 7.80 MB, 7.80 MB, 7.84 MB, 7.84 MB, 7.79 MB, 7.76 MB, 7.84 MB, 7.80 MB, 7.77 MB, 7.77 MB, 7.77 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 8.02 MB (8413976) - PerHostPeakMemUsage: 416.66 MB (436898048) - RowsProduced: 12.93K (12926) - TotalCpuTime: 665.386ms - TotalNetworkReceiveTime: 15s068ms - TotalNetworkSendTime: 2.573ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 14.843ms - ExecTreeExecTime: 2.017ms - OpenTime: 15s676ms - ExecTreeOpenTime: 15s074ms - PrepareTime: 38.327ms - ExecTreePrepareTime: 21.930ms CodeGen:(Total: 625.110ms, non-child: 625.110ms, % non-child: 100.00%) - CodegenTime: 3.157ms - CompileTime: 188.521ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 412.244ms - PrepareTime: 23.782ms DataStreamSender (dst_id=29):(Total: 7.234ms, non-child: 7.234ms, % non-child: 100.00%) - BytesSent: 388.08 KB (397399) - NetworkThroughput(*): 140.29 MB/sec - OverallThroughput: 52.38 MB/sec - RowsReturned: 12.93K (12926) - SerializeBatchTime: 3.836ms - TransmitDataRPCTime: 2.701ms - UncompressedRowBatchSize: 2.22 MB (2328252) HASH_JOIN_NODE (id=15):(Total: 15s078ms, non-child: 1.133ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.293ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.93K (12933) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 452.412us - RowsReturned: 12.93K (12926) - RowsReturnedRate: 857.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 114.892us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 181.460us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 258.411us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 35.036us, non-child: 35.036us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 23.704us - DeserializeRowBatchTimer: 89.804us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 38.53 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s076ms, non-child: 1.539ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.122ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.87K (1871) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 244.836us - RowsReturned: 12.93K (12933) - RowsReturnedRate: 857.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.224us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 344.036us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 177.012us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 16.168us, non-child: 16.168us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.332us - DeserializeRowBatchTimer: 7.456us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 22.64 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s075ms, non-child: 6.322ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 4.095ms - GetNewBlockTime: 150.692us - GetResultsTime: 230.724us - HTResizeTime: 597.092us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785320) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.87K (1871) - RowsReturnedRate: 124.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.028us EXCHANGE_NODE (id=24):(Total: 15s069ms, non-child: 1.164ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.11 KB, 43.44 KB, 43.44 KB, 64.69 KB, 82.01 KB, 132.90 KB, 132.90 KB, 186.29 KB, 186.29 KB, 251.26 KB, 267.59 KB, 286.12 KB, 303.93 KB, 322.28 KB, 322.28 KB, 322.28 KB - BytesReceived: 342.04 KB (350254) - ConvertRowBatchTime: 412.688us - DeserializeRowBatchTimer: 2.913ms - FirstBatchArrivalWaitTime: 6s768ms - PeakMemoryUsage: 0 - RowsReturned: 14.62K (14623) - RowsReturnedRate: 970.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:4f (host=d2420.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 7.173ms, % non-child: 0.05%) MemoryUsage(500.000ms): 2.48 MB, 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.84 MB, 7.84 MB, 7.83 MB, 7.79 MB, 7.81 MB, 7.81 MB, 7.73 MB, 7.73 MB, 7.84 MB, 7.78 MB, 7.73 MB, 7.82 MB, 7.79 MB, 7.79 MB, 7.79 MB, 2.22 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.99 MB (8381208) - PerHostPeakMemUsage: 452.62 MB (474607649) - RowsProduced: 12.93K (12930) - TotalCpuTime: 776.584ms - TotalNetworkReceiveTime: 14s960ms - TotalNetworkSendTime: 3.777ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 19.864ms - ExecTreeExecTime: 3.303ms - OpenTime: 15s665ms - ExecTreeOpenTime: 14s968ms - PrepareTime: 49.535ms - ExecTreePrepareTime: 25.917ms CodeGen:(Total: 723.304ms, non-child: 723.304ms, % non-child: 100.00%) - CodegenTime: 3.964ms - CompileTime: 199.794ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 494.412ms - PrepareTime: 28.387ms DataStreamSender (dst_id=29):(Total: 10.282ms, non-child: 10.282ms, % non-child: 100.00%) - BytesSent: 388.76 KB (398088) - NetworkThroughput(*): 84.35 MB/sec - OverallThroughput: 36.92 MB/sec - RowsReturned: 12.93K (12930) - SerializeBatchTime: 4.831ms - TransmitDataRPCTime: 4.501ms - UncompressedRowBatchSize: 2.22 MB (2328960) HASH_JOIN_NODE (id=15):(Total: 14s974ms, non-child: 1.470ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.918ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.94K (12944) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 503.442us - RowsReturned: 12.93K (12930) - RowsReturnedRate: 863.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 122.668us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 313.970us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 204.358us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 40.336us, non-child: 40.336us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 25.948us - DeserializeRowBatchTimer: 107.008us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 33.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 14s972ms, non-child: 1.838ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.775ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.88K (1879) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 276.144us - RowsReturned: 12.94K (12944) - RowsReturnedRate: 864.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.974us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 326.650us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 159.038us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 15.550us, non-child: 15.550us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 8.007us - DeserializeRowBatchTimer: 11.328us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 23.54 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 14s970ms, non-child: 9.576ms, % non-child: 0.06%) ExecOption: Codegen Enabled - BuildTime: 5.904ms - GetNewBlockTime: 179.536us - GetResultsTime: 258.492us - HTResizeTime: 751.442us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785564) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.88K (1879) - RowsReturnedRate: 125.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.326us EXCHANGE_NODE (id=24):(Total: 14s961ms, non-child: 1.606ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.07 KB, 44.16 KB, 44.16 KB, 66.09 KB, 83.37 KB, 135.21 KB, 135.21 KB, 190.00 KB, 190.00 KB, 234.51 KB, 272.59 KB, 290.70 KB, 307.49 KB, 326.44 KB, 326.44 KB, 326.44 KB - BytesReceived: 345.14 KB (353424) - ConvertRowBatchTime: 638.744us - DeserializeRowBatchTimer: 4.375ms - FirstBatchArrivalWaitTime: 6s659ms - PeakMemoryUsage: 0 - RowsReturned: 14.77K (14768) - RowsReturnedRate: 987.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:4c (host=d2407.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 7.609ms, % non-child: 0.05%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.76 MB, 7.84 MB, 7.84 MB, 7.82 MB, 7.77 MB, 7.83 MB, 7.78 MB, 7.73 MB, 7.73 MB, 7.82 MB, 7.78 MB, 7.75 MB, 7.84 MB, 7.81 MB, 7.81 MB, 7.81 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.95 MB (8340248) - PerHostPeakMemUsage: 427.93 MB (448721364) - RowsProduced: 13.10K (13104) - TotalCpuTime: 689.359ms - TotalNetworkReceiveTime: 15s043ms - TotalNetworkSendTime: 2.857ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 14.946ms - ExecTreeExecTime: 1.987ms - OpenTime: 15s673ms - ExecTreeOpenTime: 15s049ms - PrepareTime: 41.441ms - ExecTreePrepareTime: 21.797ms CodeGen:(Total: 646.175ms, non-child: 646.175ms, % non-child: 100.00%) - CodegenTime: 3.636ms - CompileTime: 194.401ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 426.901ms - PrepareTime: 24.307ms DataStreamSender (dst_id=29):(Total: 7.543ms, non-child: 7.543ms, % non-child: 100.00%) - BytesSent: 393.62 KB (403066) - NetworkThroughput(*): 130.74 MB/sec - OverallThroughput: 50.95 MB/sec - RowsReturned: 13.10K (13104) - SerializeBatchTime: 3.807ms - TransmitDataRPCTime: 2.940ms - UncompressedRowBatchSize: 2.25 MB (2360304) HASH_JOIN_NODE (id=15):(Total: 15s053ms, non-child: 1.253ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.961ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.12K (13118) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 438.912us - RowsReturned: 13.10K (13104) - RowsReturnedRate: 870.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 127.968us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 148.588us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 166.312us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 60.248us, non-child: 60.248us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 39.012us - DeserializeRowBatchTimer: 99.180us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 22.41 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s052ms, non-child: 1.552ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.847ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.90K (1898) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 236.628us - RowsReturned: 13.12K (13118) - RowsReturnedRate: 871.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.268us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 510.104us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 163.940us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 13.052us, non-child: 13.052us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.096us - DeserializeRowBatchTimer: 9.056us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 28.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s050ms, non-child: 6.447ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 4.075ms - GetNewBlockTime: 176.212us - GetResultsTime: 250.120us - HTResizeTime: 411.364us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2787168) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.90K (1898) - RowsReturnedRate: 126.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.204us EXCHANGE_NODE (id=24):(Total: 15s044ms, non-child: 1.172ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.17 KB, 29.53 KB, 44.11 KB, 44.11 KB, 65.91 KB, 101.14 KB, 135.88 KB, 151.17 KB, 189.78 KB, 189.78 KB, 256.88 KB, 275.04 KB, 293.87 KB, 311.39 KB, 329.81 KB, 329.81 KB, 329.81 KB - BytesReceived: 350.34 KB (358750) - ConvertRowBatchTime: 429.448us - DeserializeRowBatchTimer: 2.824ms - FirstBatchArrivalWaitTime: 6s742ms - PeakMemoryUsage: 0 - RowsReturned: 14.96K (14957) - RowsReturnedRate: 994.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:48 (host=d2401.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 8.675ms, % non-child: 0.06%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.53 MB, 7.76 MB, 7.84 MB, 7.84 MB, 7.82 MB, 7.75 MB, 7.81 MB, 7.79 MB, 7.84 MB, 7.84 MB, 7.80 MB, 7.76 MB, 7.81 MB, 7.81 MB, 7.79 MB, 7.79 MB, 7.79 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.99 MB (8373016) - PerHostPeakMemUsage: 373.14 MB (391262307) - RowsProduced: 12.91K (12915) - TotalCpuTime: 732.947ms - TotalNetworkReceiveTime: 14s998ms - TotalNetworkSendTime: 3.341ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.344ms - ExecTreeExecTime: 1.860ms - OpenTime: 15s663ms - ExecTreeOpenTime: 15s004ms - PrepareTime: 50.833ms - ExecTreePrepareTime: 29.415ms CodeGen:(Total: 689.525ms, non-child: 689.525ms, % non-child: 100.00%) - CodegenTime: 4.376ms - CompileTime: 204.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 453.083ms - PrepareTime: 31.448ms DataStreamSender (dst_id=29):(Total: 6.908ms, non-child: 6.908ms, % non-child: 100.00%) - BytesSent: 387.50 KB (396798) - NetworkThroughput(*): 144.85 MB/sec - OverallThroughput: 54.77 MB/sec - RowsReturned: 12.91K (12915) - SerializeBatchTime: 3.574ms - TransmitDataRPCTime: 2.612ms - UncompressedRowBatchSize: 2.22 MB (2326284) HASH_JOIN_NODE (id=15):(Total: 15s009ms, non-child: 1.104ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 2.386ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.94K (12936) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 426.933us - RowsReturned: 12.91K (12915) - RowsReturnedRate: 860.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 113.884us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 168.610us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 258.695us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 33.476us, non-child: 33.476us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 24.269us - DeserializeRowBatchTimer: 101.227us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 40.33 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s008ms, non-child: 2.244ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 2.477ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.88K (1875) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 227.232us - RowsReturned: 12.94K (12936) - RowsReturnedRate: 861.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 27.848us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 260.611us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 345.423us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 12.790us, non-child: 12.790us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 6.700us - DeserializeRowBatchTimer: 38.766us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 28.62 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s006ms, non-child: 6.603ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.670ms - GetNewBlockTime: 165.764us - GetResultsTime: 219.528us - HTResizeTime: 512.875us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2787168) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.88K (1875) - RowsReturnedRate: 124.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.197us EXCHANGE_NODE (id=24):(Total: 14s999ms, non-child: 1.136ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.02 KB, 29.60 KB, 44.73 KB, 44.73 KB, 65.23 KB, 99.75 KB, 134.43 KB, 152.60 KB, 187.75 KB, 187.75 KB, 252.60 KB, 269.21 KB, 304.89 KB, 304.89 KB, 324.14 KB, 324.14 KB, 324.14 KB - BytesReceived: 343.59 KB (351833) - ConvertRowBatchTime: 442.228us - DeserializeRowBatchTimer: 2.777ms - FirstBatchArrivalWaitTime: 6s698ms - PeakMemoryUsage: 0 - RowsReturned: 14.68K (14683) - RowsReturnedRate: 978.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:4d (host=d2410.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 8.835ms, % non-child: 0.06%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.76 MB, 7.84 MB, 7.84 MB, 7.83 MB, 7.77 MB, 7.83 MB, 7.81 MB, 7.75 MB, 7.75 MB, 7.84 MB, 7.79 MB, 7.74 MB, 7.83 MB, 7.84 MB, 7.84 MB, 7.84 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.98 MB (8364824) - PerHostPeakMemUsage: 446.28 MB (467956828) - RowsProduced: 13.08K (13083) - TotalCpuTime: 678.460ms - TotalNetworkReceiveTime: 15s055ms - TotalNetworkSendTime: 3.636ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.940ms - ExecTreeExecTime: 2.054ms - OpenTime: 15s672ms - ExecTreeOpenTime: 15s061ms - PrepareTime: 42.117ms - ExecTreePrepareTime: 21.548ms CodeGen:(Total: 633.426ms, non-child: 633.426ms, % non-child: 100.00%) - CodegenTime: 3.432ms - CompileTime: 190.292ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 419.119ms - PrepareTime: 23.461ms DataStreamSender (dst_id=29):(Total: 7.302ms, non-child: 7.302ms, % non-child: 100.00%) - BytesSent: 392.52 KB (401943) - NetworkThroughput(*): 133.28 MB/sec - OverallThroughput: 52.49 MB/sec - RowsReturned: 13.08K (13083) - SerializeBatchTime: 3.674ms - TransmitDataRPCTime: 2.876ms - UncompressedRowBatchSize: 2.25 MB (2356524) HASH_JOIN_NODE (id=15):(Total: 15s064ms, non-child: 1.142ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.656ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.12K (13118) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 486.144us - RowsReturned: 13.08K (13083) - RowsReturnedRate: 868.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 132.600us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 685.740us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 259.396us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 46.564us, non-child: 46.564us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 35.780us - DeserializeRowBatchTimer: 89.844us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 28.99 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s063ms, non-child: 1.825ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.096ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.90K (1896) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 220.252us - RowsReturned: 13.12K (13118) - RowsReturnedRate: 870.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 25.804us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 653.948us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 198.944us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 12.856us, non-child: 12.856us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 6.800us - DeserializeRowBatchTimer: 9.532us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 28.47 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s061ms, non-child: 5.965ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.642ms - GetNewBlockTime: 154.864us - GetResultsTime: 250.360us - HTResizeTime: 654.284us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2787168) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.90K (1896) - RowsReturnedRate: 125.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 908.000ns EXCHANGE_NODE (id=24):(Total: 15s056ms, non-child: 1.399ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.21 KB, 29.07 KB, 44.05 KB, 44.05 KB, 66.21 KB, 101.12 KB, 137.14 KB, 156.92 KB, 192.67 KB, 192.67 KB, 259.87 KB, 276.69 KB, 313.71 KB, 332.29 KB, 333.50 KB, 333.50 KB, 333.50 KB - BytesReceived: 351.79 KB (360231) - ConvertRowBatchTime: 496.200us - DeserializeRowBatchTimer: 2.543ms - FirstBatchArrivalWaitTime: 6s753ms - PeakMemoryUsage: 0 - RowsReturned: 15.03K (15033) - RowsReturnedRate: 998.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:52 (host=d2419.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 6.863ms, % non-child: 0.04%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.81 MB, 7.81 MB, 7.81 MB, 7.78 MB, 7.79 MB, 7.79 MB, 7.80 MB, 7.80 MB, 7.76 MB, 7.84 MB, 7.79 MB, 7.76 MB, 7.74 MB, 7.74 MB, 7.74 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 7.99 MB (8381208) - PerHostPeakMemUsage: 422.26 MB (442774864) - RowsProduced: 12.41K (12406) - TotalCpuTime: 664.712ms - TotalNetworkReceiveTime: 15s066ms - TotalNetworkSendTime: 3.942ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 14.449ms - ExecTreeExecTime: 1.739ms - OpenTime: 15s676ms - ExecTreeOpenTime: 15s071ms - PrepareTime: 38.267ms - ExecTreePrepareTime: 20.879ms CodeGen:(Total: 626.105ms, non-child: 626.105ms, % non-child: 100.00%) - CodegenTime: 3.255ms - CompileTime: 190.467ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 411.912ms - PrepareTime: 23.129ms DataStreamSender (dst_id=29):(Total: 6.634ms, non-child: 6.634ms, % non-child: 100.00%) - BytesSent: 372.30 KB (381235) - NetworkThroughput(*): 144.75 MB/sec - OverallThroughput: 54.80 MB/sec - RowsReturned: 12.41K (12406) - SerializeBatchTime: 3.408ms - TransmitDataRPCTime: 2.511ms - UncompressedRowBatchSize: 2.13 MB (2234544) HASH_JOIN_NODE (id=15):(Total: 15s074ms, non-child: 1.062ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.142ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 12.43K (12427) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 408.894us - RowsReturned: 12.41K (12406) - RowsReturnedRate: 822.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 121.510us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 265.624us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 227.464us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 48.302us, non-child: 48.302us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 24.916us - DeserializeRowBatchTimer: 94.998us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 27.95 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s073ms, non-child: 1.302ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.060ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.80K (1801) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 229.332us - RowsReturned: 12.43K (12427) - RowsReturnedRate: 824.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 26.380us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 360.746us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 185.112us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 14.682us, non-child: 14.682us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 6.976us - DeserializeRowBatchTimer: 9.672us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 24.93 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s072ms, non-child: 5.343ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.433ms - GetNewBlockTime: 141.852us - GetResultsTime: 216.256us - HTResizeTime: 552.184us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2789016) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.80K (1801) - RowsReturnedRate: 119.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 868.000ns EXCHANGE_NODE (id=24):(Total: 15s066ms, non-child: 905.810us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 10.37 KB, 41.22 KB, 41.22 KB, 62.79 KB, 79.92 KB, 129.38 KB, 129.38 KB, 182.04 KB, 182.04 KB, 244.96 KB, 261.40 KB, 278.44 KB, 295.26 KB, 313.63 KB, 313.63 KB, 313.63 KB - BytesReceived: 331.90 KB (339862) - ConvertRowBatchTime: 373.668us - DeserializeRowBatchTimer: 2.642ms - FirstBatchArrivalWaitTime: 6s761ms - PeakMemoryUsage: 0 - RowsReturned: 14.21K (14210) - RowsReturnedRate: 943.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Instance 594518549f864a64:49 (host=d2411.halxg.cloudera.com:22000):(Total: 15s714ms, non-child: 5.344ms, % non-child: 0.03%) MemoryUsage(500.000ms): 2.48 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.45 MB, 7.52 MB, 7.84 MB, 7.84 MB, 7.83 MB, 7.79 MB, 7.83 MB, 7.83 MB, 7.75 MB, 7.75 MB, 7.83 MB, 7.79 MB, 7.76 MB, 7.72 MB, 7.82 MB, 7.82 MB, 7.82 MB ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 8.00 MB (8389400) - PerHostPeakMemUsage: 458.45 MB (480717922) - RowsProduced: 13.16K (13165) - TotalCpuTime: 674.905ms - TotalNetworkReceiveTime: 15s058ms - TotalNetworkSendTime: 4.032ms - TotalStorageWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 15.503ms - ExecTreeExecTime: 1.858ms - OpenTime: 15s673ms - ExecTreeOpenTime: 15s063ms - PrepareTime: 40.160ms - ExecTreePrepareTime: 22.937ms CodeGen:(Total: 634.280ms, non-child: 634.280ms, % non-child: 100.00%) - CodegenTime: 3.280ms - CompileTime: 189.005ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 120 (120) - NumInstructions: 5.77K (5769) - OptimizationTime: 419.997ms - PrepareTime: 24.695ms DataStreamSender (dst_id=29):(Total: 7.191ms, non-child: 7.191ms, % non-child: 100.00%) - BytesSent: 394.29 KB (403750) - NetworkThroughput(*): 134.01 MB/sec - OverallThroughput: 53.54 MB/sec - RowsReturned: 13.16K (13165) - SerializeBatchTime: 3.593ms - TransmitDataRPCTime: 2.873ms - UncompressedRowBatchSize: 2.26 MB (2371296) HASH_JOIN_NODE (id=15):(Total: 15s067ms, non-child: 1.126ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 1.35K (1350) - BuildTime: 3.623ms - PeakMemoryUsage: 1.09 MB (1141790) - ProbeRows: 13.19K (13193) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 413.988us - RowsReturned: 13.16K (13165) - RowsReturnedRate: 873.00 /sec Hash Join Builder (join_node_id=15): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 117.128us - BuildRowsPartitioned: 1.35K (1350) - GetNewBlockTime: 276.044us - HashBuckets: 2.05K (2048) - HashCollisions: 0 (0) - HashTablesBuildTime: 79.436us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=27):(Total: 37.260us, non-child: 37.260us, % non-child: 100.00%) BytesReceived(500.000ms): 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB, 20.24 KB - BytesReceived: 20.24 KB (20724) - ConvertRowBatchTime: 24.848us - DeserializeRowBatchTimer: 109.604us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 1.35K (1350) - RowsReturnedRate: 36.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HASH_JOIN_NODE (id=14):(Total: 15s066ms, non-child: 1.564ms, % non-child: 0.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 366 (366) - BuildTime: 3.813ms - PeakMemoryUsage: 2.05 MB (2151168) - ProbeRows: 1.91K (1906) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 223.992us - RowsReturned: 13.19K (13193) - RowsReturnedRate: 875.00 /sec Hash Join Builder (join_node_id=14): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 29.412us - BuildRowsPartitioned: 366 (366) - GetNewBlockTime: 437.308us - HashBuckets: 672 (672) - HashCollisions: 0 (0) - HashTablesBuildTime: 297.800us - LargestPartitionPercent: 7 (7) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=26):(Total: 15.744us, non-child: 15.744us, % non-child: 100.00%) BytesReceived(500.000ms): 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB, 1.93 KB - BytesReceived: 1.93 KB (1978) - ConvertRowBatchTime: 7.380us - DeserializeRowBatchTimer: 7.888us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 366 (366) - RowsReturnedRate: 23.25 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns AGGREGATION_NODE (id=25):(Total: 15s064ms, non-child: 5.611ms, % non-child: 0.04%) ExecOption: Codegen Enabled - BuildTime: 3.341ms - GetNewBlockTime: 241.044us - GetResultsTime: 222.216us - HTResizeTime: 380.976us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 2.66 MB (2785198) - PinTime: 0.000ns - RowsRepartitioned: 0 (0) - RowsReturned: 1.91K (1906) - RowsReturnedRate: 126.00 /sec - SpilledPartitions: 0 (0) - UnpinTime: 1.132us EXCHANGE_NODE (id=24):(Total: 15s059ms, non-child: 1.194ms, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 11.06 KB, 44.30 KB, 44.30 KB, 66.36 KB, 83.88 KB, 137.59 KB, 137.59 KB, 193.55 KB, 193.55 KB, 260.00 KB, 276.43 KB, 295.87 KB, 313.99 KB, 333.53 KB, 333.53 KB, 333.53 KB - BytesReceived: 353.97 KB (362467) - ConvertRowBatchTime: 450.100us - DeserializeRowBatchTimer: 3.204ms - FirstBatchArrivalWaitTime: 6s757ms - PeakMemoryUsage: 0 - RowsReturned: 15.11K (15108) - RowsReturnedRate: 1.00 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F05:(Total: 603.560ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 19.64 GB, max: 19.97 GB, avg: 19.81 GB, stddev: 89.46 MB completion times: min:7s278ms max:15s586ms mean: 11s003ms stddev:2s150ms execution rates: min:1.26 GB/sec max:2.72 GB/sec mean:1.87 GB/sec stddev:398.43 MB/sec num instances: 19 - AverageThreadTokens: 13.76 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 203.21 MB (213083374) - PerHostPeakMemUsage: 425.19 MB (445846248) - RowsProduced: 14.87K (14872) - TotalCpuTime: 2m31s - TotalNetworkReceiveTime: 17.914ms - TotalNetworkSendTime: 3.193ms - TotalStorageWaitTime: 359.222ms Fragment Instance Lifecycle Timings: - ExecTime: 10s391ms - ExecTreeExecTime: 10s378ms - OpenTime: 561.471ms - ExecTreeOpenTime: 38.372ms - PrepareTime: 42.069ms - ExecTreePrepareTime: 24.296ms CodeGen:(Total: 545.777ms, non-child: 545.777ms, % non-child: 100.00%) - CodegenTime: 4.971ms - CompileTime: 160.529ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 360.291ms - PrepareTime: 24.364ms DataStreamSender (dst_id=24):(Total: 5.955ms, non-child: 5.955ms, % non-child: 100.00%) - BytesSent: 348.13 KB (356481) - NetworkThroughput(*): 152.90 MB/sec - OverallThroughput: 57.54 MB/sec - RowsReturned: 14.87K (14872) - SerializeBatchTime: 3.634ms - TransmitDataRPCTime: 2.270ms - UncompressedRowBatchSize: 1.79 MB (1874356) AGGREGATION_NODE (id=11):(Total: 10s419ms, non-child: 6s928ms, % non-child: 66.49%) - GetNewBlockTime: 157.433us - GetResultsTime: 1.236ms - HTResizeTime: 1.687ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.24 MB (10739469) - PinTime: 0.000ns - ReductionFactorEstimate: 1010274.64 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 14.87K (14872) - RowsReturnedRate: 1.48 K/sec - StreamingTime: 6s640ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s491ms, non-child: 3s082ms, % non-child: 88.28%) - BuildRows: 371 (371) - BuildTime: 993.620us - PeakMemoryUsage: 1.20 MB (1255605) - ProbeRows: 88.78M (88779027) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s981ms - RowsReturned: 88.78M (88779027) - RowsReturnedRate: 25.63 M/sec Hash Join Builder (join_node_id=10): - BuildRowsPartitionTime: 43.650us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 79.848us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.155us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 17.924ms, non-child: 17.924ms, % non-child: 100.00%) - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.190us - DeserializeRowBatchTimer: 53.933us - FirstBatchArrivalWaitTime: 17.382ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 12.86 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 391.558ms, non-child: 391.558ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 13.51 - BytesRead: 199.13 MB (208803287) - BytesReadDataNodeCache: 0 - BytesReadLocal: 199.13 MB (208803287) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 199.13 MB (208803287) - DecompressionTime: 159.521ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 17 (17) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 13 (13) - PeakMemoryUsage: 190.05 MB (199279036) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.771ms - RowBatchQueuePutWaitTime: 1m55s - RowsRead: 88.79M (88789823) - RowsReturned: 88.78M (88779027) - RowsReturnedRate: 231.05 M/sec - ScanRangesComplete: 139 (139) - ScannerThreadsInvoluntaryContextSwitches: 4.65K (4648) - ScannerThreadsTotalWallClockTime: 2m20s - MaterializeTupleTime(*): 5s452ms - ScannerThreadsSysTime: 13s024ms - ScannerThreadsUserTime: 11s406ms - ScannerThreadsVoluntaryContextSwitches: 591.92K (591918) - TotalRawHdfsReadTime(*): 146.876ms - TotalReadThroughput: 18.23 MB/sec Filter 5 (1.00 MB): - Rows processed: 457.86K (457861) - Rows rejected: 10.80K (10796) - Rows total: 457.89K (457889) Filter 7 (1.00 MB): - Files processed: 139 (139) - Files rejected: 111 (111) - Files total: 139 (139) - RowGroups processed: 86.69K (86695) - RowGroups rejected: 0 (0) - RowGroups total: 86.69K (86695) - Rows processed: 457.86K (457861) - Rows rejected: 0 (0) - Rows total: 457.89K (457889) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Fragment F05: Instance 594518549f864a64:3a (host=d2420.halxg.cloudera.com:22000):(Total: 651.401ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:4/502.10 MB 23:6/874.40 MB 13:7/990.24 MB 9:7/1.10 GB 14:1/117.50 MB 3:5/789.09 MB 16:3/521.25 MB 8:6/1.22 GB 7:6/1.02 GB 20:6/769.57 MB 17:3/385.29 MB 0:9/985.46 MB 11:5/723.91 MB 6:8/1.35 GB 5:6/634.05 MB 22:5/859.79 MB 19:3/352.21 MB 10:13/1.65 GB 15:6/905.42 MB 12:6/874.64 MB 1:6/530.27 MB 18:6/1011.15 MB 4:5/723.96 MB 21:7/1.10 GB Filter 5 arrival: 526ms Filter 7 arrival: 625ms MemoryUsage(500.000ms): 1.33 MB, 2.34 MB, 159.77 MB, 198.54 MB, 198.54 MB, 198.33 MB, 198.11 MB, 198.57 MB, 198.24 MB, 198.48 MB, 198.19 MB, 185.46 MB, 222.36 MB, 222.54 MB, 228.43 MB, 228.40 MB, 228.61 MB, 228.54 MB, 196.75 MB, 180.86 MB, 180.82 MB, 174.10 MB, 186.86 MB, 153.63 MB, 137.03 MB, 137.06 MB, 137.13 MB, 105.34 MB, 105.34 MB, 87.11 MB, 43.95 MB ThreadUsage(500.000ms): 1, 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.10 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 228.83 MB (239945574) - PerHostPeakMemUsage: 452.62 MB (474607649) - RowsProduced: 15.55K (15548) - TotalCpuTime: 3m43s - TotalNetworkReceiveTime: 4.724us - TotalNetworkSendTime: 4.094ms - TotalStorageWaitTime: 531.449ms Fragment Instance Lifecycle Timings: - ExecTime: 14s924ms - ExecTreeExecTime: 14s906ms - OpenTime: 596.984ms - ExecTreeOpenTime: 23.138ms - PrepareTime: 54.387ms - ExecTreePrepareTime: 29.457ms CodeGen:(Total: 601.314ms, non-child: 601.314ms, % non-child: 100.00%) - CodegenTime: 6.177ms - CompileTime: 164.970ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 405.889ms - PrepareTime: 29.702ms DataStreamSender (dst_id=24):(Total: 8.883ms, non-child: 8.883ms, % non-child: 100.00%) - BytesSent: 370.86 KB (379761) - NetworkThroughput(*): 87.41 MB/sec - OverallThroughput: 40.77 MB/sec - RowsReturned: 15.55K (15548) - SerializeBatchTime: 4.677ms - TransmitDataRPCTime: 4.143ms - UncompressedRowBatchSize: 1.87 MB (1959560) AGGREGATION_NODE (id=11):(Total: 14s934ms, non-child: 9s910ms, % non-child: 66.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 263.908us - GetResultsTime: 1.565ms - HTResizeTime: 2.056ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10717957) - PinTime: 0.000ns - ReductionFactorEstimate: 1016454.24 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 15.55K (15548) - RowsReturnedRate: 1.04 K/sec - StreamingTime: 9s506ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 5s024ms, non-child: 4s365ms, % non-child: 86.89%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 1.363ms - PeakMemoryUsage: 1.20 MB (1255301) - ProbeRows: 104.90M (104897637) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s221ms - RowsReturned: 104.90M (104897637) - RowsReturnedRate: 20.88 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 50.452us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 91.102us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 52.350us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 19.160us, non-child: 19.160us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 8.420us - DeserializeRowBatchTimer: 33.680us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 19.36 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 658.455ms, non-child: 658.455ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:4/502.10 MB 23:6/874.40 MB 13:7/990.24 MB 9:7/1.10 GB 14:1/117.50 MB 3:5/789.09 MB 16:3/521.25 MB 8:6/1.22 GB 7:6/1.02 GB 20:6/769.57 MB 17:3/385.29 MB 0:9/985.46 MB 11:5/723.91 MB 6:8/1.35 GB 5:6/634.05 MB 22:5/859.79 MB 19:3/352.21 MB 10:13/1.65 GB 15:6/905.42 MB 12:6/874.64 MB 1:6/530.27 MB 18:6/1011.15 MB 4:5/723.96 MB 21:7/1.10 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:96.55% 1:3.448% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:108 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 0, 96.11 MB, 127.12 MB, 127.12 MB, 127.12 MB, 127.12 MB, 127.12 MB, 127.12 MB, 127.12 MB, 127.12 MB, 158.01 MB, 195.79 MB, 195.79 MB, 208.38 MB, 208.38 MB, 208.38 MB, 208.38 MB, 208.38 MB, 208.38 MB, 208.38 MB, 219.07 MB, 235.13 MB, 235.13 MB, 235.13 MB, 235.13 MB, 235.13 MB, 235.13 MB, 235.13 MB, 235.13 MB, 235.13 MB - FooterProcessingTime: (Avg: 7.375ms ; Min: 1.568ms ; Max: 13.987ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 235.13 MB (246548302) - BytesReadDataNodeCache: 0 - BytesReadLocal: 235.13 MB (246548302) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 235.13 MB (246548302) - DecompressionTime: 267.824ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 18 (18) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.61 MB (226083849) - PerReadThreadRawHdfsThroughput: 1.00 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.906ms - RowBatchQueuePutWaitTime: 2m48s - RowsRead: 104.91M (104909709) - RowsReturned: 104.90M (104897637) - RowsReturnedRate: 159.31 M/sec - ScanRangesComplete: 139 (139) - ScannerThreadsInvoluntaryContextSwitches: 6.89K (6889) - ScannerThreadsTotalWallClockTime: 3m28s - MaterializeTupleTime(*): 9s233ms - ScannerThreadsSysTime: 19s600ms - ScannerThreadsUserTime: 18s024ms - ScannerThreadsVoluntaryContextSwitches: 791.45K (791449) - TotalRawHdfsReadTime(*): 229.212ms - TotalReadThroughput: 15.17 MB/sec Filter 5 (1.00 MB): - Rows processed: 507.87K (507873) - Rows rejected: 12.07K (12072) - Rows total: 507.90K (507904) Filter 7 (1.00 MB): - Files processed: 139 (139) - Files rejected: 108 (108) - Files total: 139 (139) - RowGroups processed: 102.44K (102436) - RowGroups rejected: 0 (0) - RowGroups total: 102.44K (102436) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Instance 594518549f864a64:2b (host=d2406.halxg.cloudera.com:22000):(Total: 636.766ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 22:2/268.65 MB 23:3/624.50 MB 0:5/723.22 MB 1:3/352.67 MB 14:8/1.01 GB 8:8/1.11 GB 7:8/1.18 GB 6:6/873.45 MB 4:4/504.15 MB 21:4/502.27 MB 3:9/1.23 GB 20:9/1.40 GB 11:4/605.44 MB 5:4/638.84 MB 16:8/902.51 MB 17:4/742.10 MB 10:6/874.04 MB 12:7/922.35 MB 9:10/1.38 GB 18:9/1.20 GB 15:5/413.97 MB 2:4/640.56 MB 19:9/1.29 GB 13:4/606.07 MB Filter 5 arrival: 600ms Filter 7 arrival: 614ms MemoryUsage(500.000ms): 1.30 MB, 1.33 MB, 179.68 MB, 180.47 MB, 180.29 MB, 180.24 MB, 180.30 MB, 180.35 MB, 180.47 MB, 182.43 MB, 204.48 MB, 204.40 MB, 184.06 MB, 184.03 MB, 176.07 MB, 160.34 MB, 160.13 MB, 139.74 MB, 84.19 MB, 52.50 MB ThreadUsage(500.000ms): 1, 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 13.60 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 204.60 MB (214534513) - PerHostPeakMemUsage: 404.25 MB (423884539) - RowsProduced: 13.52K (13520) - TotalCpuTime: 2m20s - TotalNetworkReceiveTime: 70.192ms - TotalNetworkSendTime: 2.930ms - TotalStorageWaitTime: 378.410ms Fragment Instance Lifecycle Timings: - ExecTime: 9s352ms - ExecTreeExecTime: 9s339ms - OpenTime: 597.794ms - ExecTreeOpenTime: 90.803ms - PrepareTime: 38.953ms - ExecTreePrepareTime: 23.475ms CodeGen:(Total: 529.232ms, non-child: 529.232ms, % non-child: 100.00%) - CodegenTime: 4.953ms - CompileTime: 156.994ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 348.026ms - PrepareTime: 23.667ms DataStreamSender (dst_id=24):(Total: 5.750ms, non-child: 5.750ms, % non-child: 100.00%) - BytesSent: 311.17 KB (318643) - NetworkThroughput(*): 143.74 MB/sec - OverallThroughput: 52.84 MB/sec - RowsReturned: 13.52K (13520) - SerializeBatchTime: 3.587ms - TransmitDataRPCTime: 2.114ms - UncompressedRowBatchSize: 1.63 MB (1703972) AGGREGATION_NODE (id=11):(Total: 9s433ms, non-child: 6s308ms, % non-child: 66.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 144.790us - GetResultsTime: 1.176ms - HTResizeTime: 1.670ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.23 MB (10729994) - PinTime: 0.000ns - ReductionFactorEstimate: 1001204.44 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 13.52K (13520) - RowsReturnedRate: 1.43 K/sec - StreamingTime: 6s030ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s124ms, non-child: 2s710ms, % non-child: 86.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 823.354us - PeakMemoryUsage: 1.21 MB (1267338) - ProbeRows: 85.63M (85629605) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s614ms - RowsReturned: 85.63M (85629605) - RowsReturnedRate: 27.40 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.250us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 77.084us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.004us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 70.203ms, non-child: 15.690us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.280us - DeserializeRowBatchTimer: 27.424us - FirstBatchArrivalWaitTime: 70.187ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 5.28 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 344.928ms, non-child: 344.928ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 22:2/268.65 MB 23:3/624.50 MB 0:5/723.22 MB 1:3/352.67 MB 14:8/1.01 GB 8:8/1.11 GB 7:8/1.18 GB 6:6/873.45 MB 4:4/504.15 MB 21:4/502.27 MB 3:9/1.23 GB 20:9/1.40 GB 11:4/605.44 MB 5:4/638.84 MB 16:8/902.51 MB 17:4/742.10 MB 10:6/874.04 MB 12:7/922.35 MB 9:10/1.38 GB 18:9/1.20 GB 15:5/413.97 MB 2:4/640.56 MB 19:9/1.29 GB 13:4/606.07 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 25 out of 25 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:118 PARQUET/SNAPPY:50 BytesRead(500.000ms): 0, 0, 107.94 MB, 107.94 MB, 107.94 MB, 107.94 MB, 107.94 MB, 107.94 MB, 107.94 MB, 133.21 MB, 185.92 MB, 185.92 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB, 191.77 MB - FooterProcessingTime: (Avg: 6.236ms ; Min: 1.286ms ; Max: 14.254ms ; Number of samples: 25) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 191.77 MB (201086551) - BytesReadDataNodeCache: 0 - BytesReadLocal: 191.77 MB (201086551) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 191.77 MB (201086551) - DecompressionTime: 147.036ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 12 (12) - NumRowGroups: 25 (25) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 191.43 MB (200732769) - PerReadThreadRawHdfsThroughput: 1.48 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.356ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 85.64M (85639372) - RowsReturned: 85.63M (85629605) - RowsReturnedRate: 248.25 M/sec - ScanRangesComplete: 143 (143) - ScannerThreadsInvoluntaryContextSwitches: 4.76K (4760) - ScannerThreadsTotalWallClockTime: 2m10s - MaterializeTupleTime(*): 4s951ms - ScannerThreadsSysTime: 11s467ms - ScannerThreadsUserTime: 12s816ms - ScannerThreadsVoluntaryContextSwitches: 508.02K (508017) - TotalRawHdfsReadTime(*): 126.319ms - TotalReadThroughput: 19.18 MB/sec Filter 5 (1.00 MB): - Rows processed: 409.57K (409575) - Rows rejected: 9.77K (9767) - Rows total: 409.60K (409600) Filter 7 (1.00 MB): - Files processed: 143 (143) - Files rejected: 118 (118) - Files total: 143 (143) - RowGroups processed: 83.62K (83622) - RowGroups rejected: 0 (0) - RowGroups total: 83.62K (83622) - Rows processed: 409.57K (409575) - Rows rejected: 0 (0) - Rows total: 409.60K (409600) - Splits processed: 25 (25) - Splits rejected: 0 (0) - Splits total: 25 (25) Instance 594518549f864a64:2e (host=d2402.halxg.cloudera.com:22000):(Total: 633.603ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:2/371.14 MB 8:5/960.24 MB 21:3/760.89 MB 14:6/1009.76 MB 23:5/620.70 MB 1:5/859.84 MB 20:4/878.22 MB 6:5/652.06 MB 11:6/1.02 GB 13:3/624.72 MB 18:6/906.15 MB 16:5/723.32 MB 15:8/1.22 GB 3:8/1.25 GB 4:7/1.13 GB 0:7/783.89 MB 17:5/755.77 MB 12:6/737.26 MB 10:6/906.20 MB 22:3/282.26 MB 5:5/651.80 MB 2:9/1.26 GB 19:5/723.59 MB 7:6/1.12 GB Filter 5 arrival: 595ms Filter 7 arrival: 612ms MemoryUsage(500.000ms): 0, 1.33 MB, 208.04 MB, 215.62 MB, 215.89 MB, 215.83 MB, 215.84 MB, 215.97 MB, 216.14 MB, 215.84 MB, 216.10 MB, 213.56 MB, 228.52 MB, 228.56 MB, 228.56 MB, 228.40 MB, 228.40 MB, 157.11 MB, 157.04 MB, 168.93 MB, 139.53 MB, 120.86 MB, 121.01 MB, 105.05 MB, 105.02 MB, 67.97 MB, 44.28 MB ThreadUsage(500.000ms): 1, 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 13.96 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 228.69 MB (239797387) - PerHostPeakMemUsage: 470.56 MB (493413990) - RowsProduced: 14.20K (14196) - TotalCpuTime: 3m11s - TotalNetworkReceiveTime: 68.996ms - TotalNetworkSendTime: 3.168ms - TotalStorageWaitTime: 405.936ms Fragment Instance Lifecycle Timings: - ExecTime: 12s788ms - ExecTreeExecTime: 12s774ms - OpenTime: 595.745ms - ExecTreeOpenTime: 89.172ms - PrepareTime: 37.841ms - ExecTreePrepareTime: 23.467ms CodeGen:(Total: 529.072ms, non-child: 529.072ms, % non-child: 100.00%) - CodegenTime: 4.436ms - CompileTime: 157.975ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 346.894ms - PrepareTime: 23.634ms DataStreamSender (dst_id=24):(Total: 5.959ms, non-child: 5.959ms, % non-child: 100.00%) - BytesSent: 335.77 KB (343824) - NetworkThroughput(*): 151.87 MB/sec - OverallThroughput: 55.02 MB/sec - RowsReturned: 14.20K (14196) - SerializeBatchTime: 3.754ms - TransmitDataRPCTime: 2.159ms - UncompressedRowBatchSize: 1.71 MB (1789152) AGGREGATION_NODE (id=11):(Total: 12s866ms, non-child: 8s478ms, % non-child: 65.90%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 136.088us - GetResultsTime: 1.305ms - HTResizeTime: 1.513ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.27 MB (10764412) - PinTime: 0.000ns - ReductionFactorEstimate: 1019631.02 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 14.20K (14196) - RowsReturnedRate: 1.10 K/sec - StreamingTime: 8s134ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 4s388ms, non-child: 3s887ms, % non-child: 88.59%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 855.500us - PeakMemoryUsage: 1.18 MB (1242073) - ProbeRows: 107.47M (107473938) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s766ms - RowsReturned: 107.47M (107473938) - RowsReturnedRate: 24.49 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 49.576us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 69.984us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.712us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 69.006ms, non-child: 15.300us, % non-child: 0.02%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.848us - DeserializeRowBatchTimer: 28.092us - FirstBatchArrivalWaitTime: 66.205ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 5.38 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 431.984ms, non-child: 431.984ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:2/371.14 MB 8:5/960.24 MB 21:3/760.89 MB 14:6/1009.76 MB 23:5/620.70 MB 1:5/859.84 MB 20:4/878.22 MB 6:5/652.06 MB 11:6/1.02 GB 13:3/624.72 MB 18:6/906.15 MB 16:5/723.32 MB 15:8/1.22 GB 3:8/1.25 GB 4:7/1.13 GB 0:7/783.89 MB 17:5/755.77 MB 12:6/737.26 MB 10:6/906.20 MB 22:3/282.26 MB 5:5/651.80 MB 2:9/1.26 GB 19:5/723.59 MB 7:6/1.12 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:103 PARQUET/SNAPPY:54 BytesRead(500.000ms): 0, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 144.08 MB, 176.64 MB, 189.23 MB, 189.23 MB, 189.23 MB, 189.23 MB, 189.23 MB, 189.23 MB, 189.23 MB, 214.40 MB, 240.34 MB, 240.34 MB, 240.34 MB, 240.34 MB, 240.34 MB, 240.34 MB, 240.34 MB - FooterProcessingTime: (Avg: 6.424ms ; Min: 1.074ms ; Max: 11.453ms ; Number of samples: 27) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 240.34 MB (252018459) - BytesReadDataNodeCache: 0 - BytesReadLocal: 240.34 MB (252018459) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 240.34 MB (252018459) - DecompressionTime: 187.690ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 18 (18) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.53 MB (225995643) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.434ms - RowBatchQueuePutWaitTime: 2m22s - RowsRead: 107.48M (107484489) - RowsReturned: 107.47M (107473938) - RowsReturnedRate: 248.79 M/sec - ScanRangesComplete: 130 (130) - ScannerThreadsInvoluntaryContextSwitches: 6.23K (6227) - ScannerThreadsTotalWallClockTime: 2m58s - MaterializeTupleTime(*): 6s575ms - ScannerThreadsSysTime: 20s729ms - ScannerThreadsUserTime: 13s224ms - ScannerThreadsVoluntaryContextSwitches: 816.84K (816842) - TotalRawHdfsReadTime(*): 188.859ms - TotalReadThroughput: 18.49 MB/sec Filter 5 (1.00 MB): - Rows processed: 442.34K (442341) - Rows rejected: 10.55K (10551) - Rows total: 442.37K (442368) Filter 7 (1.00 MB): - Files processed: 130 (130) - Files rejected: 103 (103) - Files total: 130 (130) - RowGroups processed: 104.95K (104952) - RowGroups rejected: 0 (0) - RowGroups total: 104.95K (104952) - Rows processed: 442.34K (442341) - Rows rejected: 0 (0) - Rows total: 442.37K (442368) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Instance 594518549f864a64:2f (host=d2403.halxg.cloudera.com:22000):(Total: 628.755ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:5/790.61 MB 14:6/528.89 MB 2:7/1.10 GB 3:9/1.36 GB 21:6/803.79 MB 17:5/790.19 MB 20:5/892.41 MB 10:6/1010.58 MB 8:8/1.08 GB 15:7/1.10 GB 7:8/967.34 MB 0:6/803.80 MB 18:5/891.92 MB 1:7/680.92 MB 11:4/158.59 MB 13:5/550.13 MB 23:8/1.05 GB 6:6/1008.99 MB 22:6/633.67 MB 5:4/639.28 MB 4:11/1.46 GB 16:4/639.46 MB 19:4/502.35 MB 12:6/737.25 MB Filter 5 arrival: 591ms Filter 7 arrival: 608ms MemoryUsage(500.000ms): 1.33 MB, 104.40 MB, 113.05 MB, 113.07 MB, 113.17 MB, 129.43 MB, 129.23 MB, 102.18 MB, 149.47 MB, 155.52 MB, 155.84 MB, 155.78 MB, 155.84 MB, 146.97 MB, 136.62 MB, 96.66 MB, 96.80 MB, 54.42 MB ThreadUsage(500.000ms): 1, 11, 11, 11, 11, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 11.17 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 156.01 MB (163591627) - PerHostPeakMemUsage: 373.40 MB (391534926) - RowsProduced: 18.25K (18252) - TotalCpuTime: 1m38s - TotalNetworkReceiveTime: 27.617ms - TotalNetworkSendTime: 3.289ms - TotalStorageWaitTime: 259.829ms Fragment Instance Lifecycle Timings: - ExecTime: 8s373ms - ExecTreeExecTime: 8s359ms - OpenTime: 587.691ms - ExecTreeOpenTime: 46.386ms - PrepareTime: 41.044ms - ExecTreePrepareTime: 23.438ms CodeGen:(Total: 562.963ms, non-child: 562.963ms, % non-child: 100.00%) - CodegenTime: 4.330ms - CompileTime: 160.124ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 379.192ms - PrepareTime: 23.042ms DataStreamSender (dst_id=24):(Total: 6.593ms, non-child: 6.593ms, % non-child: 100.00%) - BytesSent: 411.44 KB (421316) - NetworkThroughput(*): 165.23 MB/sec - OverallThroughput: 60.94 MB/sec - RowsReturned: 18.25K (18252) - SerializeBatchTime: 4.112ms - TransmitDataRPCTime: 2.431ms - UncompressedRowBatchSize: 2.19 MB (2300352) AGGREGATION_NODE (id=11):(Total: 8s409ms, non-child: 5s632ms, % non-child: 66.98%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 126.832us - GetResultsTime: 1.398ms - HTResizeTime: 1.494ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.24 MB (10738229) - PinTime: 0.000ns - ReductionFactorEstimate: 1024344.49 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 18.25K (18252) - RowsReturnedRate: 2.17 K/sec - StreamingTime: 5s430ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 2s776ms, non-child: 2s453ms, % non-child: 88.34%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 1.063ms - PeakMemoryUsage: 1.22 MB (1275573) - ProbeRows: 77.17M (77172466) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s377ms - RowsReturned: 77.17M (77172466) - RowsReturnedRate: 27.79 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 40.836us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 90.500us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 55.444us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 27.628ms, non-child: 16.604us, % non-child: 0.06%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.420us - DeserializeRowBatchTimer: 303.212us - FirstBatchArrivalWaitTime: 26.933ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 13.43 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 296.278ms, non-child: 296.278ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:5/790.61 MB 14:6/528.89 MB 2:7/1.10 GB 3:9/1.36 GB 21:6/803.79 MB 17:5/790.19 MB 20:5/892.41 MB 10:6/1010.58 MB 8:8/1.08 GB 15:7/1.10 GB 7:8/967.34 MB 0:6/803.80 MB 18:5/891.92 MB 1:7/680.92 MB 11:4/158.59 MB 13:5/550.13 MB 23:8/1.05 GB 6:6/1008.99 MB 22:6/633.67 MB 5:4/639.28 MB 4:11/1.46 GB 16:4/639.46 MB 19:4/502.35 MB 12:6/737.25 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 30 out of 30 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:118 PARQUET/SNAPPY:60 BytesRead(500.000ms): 0, 56.84 MB, 62.69 MB, 62.69 MB, 62.69 MB, 75.28 MB, 75.28 MB, 97.60 MB, 141.94 MB, 160.38 MB, 160.38 MB, 160.38 MB, 160.38 MB, 167.05 MB, 173.63 MB, 173.63 MB, 173.63 MB, 173.63 MB - FooterProcessingTime: (Avg: 2.625ms ; Min: 1.001ms ; Max: 6.005ms ; Number of samples: 30) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 10.76 - BytesRead: 173.63 MB (182063691) - BytesReadDataNodeCache: 0 - BytesReadLocal: 173.63 MB (182063691) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 173.63 MB (182063691) - DecompressionTime: 130.499ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 20 (20) - NumRowGroups: 30 (30) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 142.85 MB (149787691) - PerReadThreadRawHdfsThroughput: 1.66 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.216ms - RowBatchQueuePutWaitTime: 1m15s - RowsRead: 77.18M (77183868) - RowsReturned: 77.17M (77172466) - RowsReturnedRate: 260.47 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 3.25K (3249) - ScannerThreadsTotalWallClockTime: 1m29s - MaterializeTupleTime(*): 4s227ms - ScannerThreadsSysTime: 5s273ms - ScannerThreadsUserTime: 8s045ms - ScannerThreadsVoluntaryContextSwitches: 338.96K (338958) - TotalRawHdfsReadTime(*): 102.141ms - TotalReadThroughput: 19.29 MB/sec Filter 5 (1.00 MB): - Rows processed: 491.49K (491490) - Rows rejected: 11.40K (11402) - Rows total: 491.52K (491520) Filter 7 (1.00 MB): - Files processed: 148 (148) - Files rejected: 118 (118) - Files total: 148 (148) - RowGroups processed: 75.36K (75361) - RowGroups rejected: 0 (0) - RowGroups total: 75.36K (75361) - Rows processed: 491.49K (491490) - Rows rejected: 0 (0) - Rows total: 491.52K (491520) - Splits processed: 30 (30) - Splits rejected: 0 (0) - Splits total: 30 (30) Instance 594518549f864a64:2d (host=d2414.halxg.cloudera.com:22000):(Total: 626.148ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:5/995.42 MB 9:2/405.15 MB 22:6/906.03 MB 17:3/384.35 MB 2:7/1023.79 MB 4:6/771.18 MB 16:7/990.42 MB 14:8/1.05 GB 12:8/1005.71 MB 15:6/1009.79 MB 11:7/1023.61 MB 13:5/620.82 MB 10:6/840.91 MB 3:8/1.01 GB 20:5/756.59 MB 7:6/737.94 MB 5:3/624.78 MB 0:6/873.37 MB 1:6/737.64 MB 18:7/990.53 MB 21:4/398.38 MB 8:7/1.06 GB 6:5/788.72 MB 23:9/1.06 GB Filter 5 arrival: 588ms Filter 7 arrival: 602ms MemoryUsage(500.000ms): 1.33 MB, 145.29 MB, 179.37 MB, 179.63 MB, 179.07 MB, 179.10 MB, 179.64 MB, 179.41 MB, 179.48 MB, 210.29 MB, 207.70 MB, 222.03 MB, 228.65 MB, 228.47 MB, 228.58 MB, 204.44 MB, 204.66 MB, 204.85 MB, 194.43 MB, 159.22 MB, 149.11 MB, 149.11 MB, 101.56 MB, 85.66 MB, 35.89 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.44 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 228.78 MB (239891511) - PerHostPeakMemUsage: 452.28 MB (474247758) - RowsProduced: 12.84K (12844) - TotalCpuTime: 2m57s - TotalNetworkReceiveTime: 36.736ms - TotalNetworkSendTime: 3.238ms - TotalStorageWaitTime: 403.005ms Fragment Instance Lifecycle Timings: - ExecTime: 11s844ms - ExecTreeExecTime: 11s831ms - OpenTime: 585.292ms - ExecTreeOpenTime: 58.742ms - PrepareTime: 40.835ms - ExecTreePrepareTime: 24.265ms CodeGen:(Total: 549.036ms, non-child: 549.036ms, % non-child: 100.00%) - CodegenTime: 4.765ms - CompileTime: 165.074ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 359.408ms - PrepareTime: 23.983ms DataStreamSender (dst_id=24):(Total: 5.076ms, non-child: 5.076ms, % non-child: 100.00%) - BytesSent: 325.61 KB (333425) - NetworkThroughput(*): 176.22 MB/sec - OverallThroughput: 62.63 MB/sec - RowsReturned: 12.84K (12844) - SerializeBatchTime: 3.213ms - TransmitDataRPCTime: 1.804ms - UncompressedRowBatchSize: 1.54 MB (1618764) AGGREGATION_NODE (id=11):(Total: 11s894ms, non-child: 7s882ms, % non-child: 66.27%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 167.322us - GetResultsTime: 1.108ms - HTResizeTime: 1.241ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.26 MB (10762967) - PinTime: 0.000ns - ReductionFactorEstimate: 1015876.93 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 12.84K (12844) - RowsReturnedRate: 1.08 K/sec - StreamingTime: 7s533ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 4s011ms, non-child: 3s493ms, % non-child: 87.07%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 886.164us - PeakMemoryUsage: 1.20 MB (1253850) - ProbeRows: 101.32M (101315064) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s375ms - RowsReturned: 101.32M (101315064) - RowsReturnedRate: 25.25 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.858us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 72.184us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.098us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 36.747ms, non-child: 15.780us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.438us - DeserializeRowBatchTimer: 27.140us - FirstBatchArrivalWaitTime: 36.470ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 10.10 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 482.352ms, non-child: 482.352ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:5/995.42 MB 9:2/405.15 MB 22:6/906.03 MB 17:3/384.35 MB 2:7/1023.79 MB 4:6/771.18 MB 16:7/990.42 MB 14:8/1.05 GB 12:8/1005.71 MB 15:6/1009.79 MB 11:7/1023.61 MB 13:5/620.82 MB 10:6/840.91 MB 3:8/1.01 GB 20:5/756.59 MB 7:6/737.94 MB 5:3/624.78 MB 0:6/873.37 MB 1:6/737.64 MB 18:7/990.53 MB 21:4/398.38 MB 8:7/1.06 GB 6:5/788.72 MB 23:9/1.06 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 29 out of 29 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:113 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 88.67 MB, 106.22 MB, 106.22 MB, 106.22 MB, 106.22 MB, 106.22 MB, 106.22 MB, 106.22 MB, 182.58 MB, 201.76 MB, 214.34 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB, 226.91 MB - FooterProcessingTime: (Avg: 6.417ms ; Min: 1.464ms ; Max: 11.774ms ; Number of samples: 29) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 226.91 MB (237936156) - BytesReadDataNodeCache: 0 - BytesReadLocal: 226.91 MB (237936156) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 226.91 MB (237936156) - DecompressionTime: 180.305ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 19 (19) - NumRowGroups: 29 (29) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.62 MB (226089767) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.189ms - RowBatchQueuePutWaitTime: 2m20s - RowsRead: 101.33M (101326442) - RowsReturned: 101.32M (101315064) - RowsReturnedRate: 210.04 M/sec - ScanRangesComplete: 142 (142) - ScannerThreadsInvoluntaryContextSwitches: 5.24K (5242) - ScannerThreadsTotalWallClockTime: 2m45s - MaterializeTupleTime(*): 6s084ms - ScannerThreadsSysTime: 11s719ms - ScannerThreadsUserTime: 12s430ms - ScannerThreadsVoluntaryContextSwitches: 632.00K (631997) - TotalRawHdfsReadTime(*): 154.888ms - TotalReadThroughput: 18.15 MB/sec Filter 5 (1.00 MB): - Rows processed: 475.11K (475107) - Rows rejected: 11.38K (11378) - Rows total: 475.14K (475136) Filter 7 (1.00 MB): - Files processed: 142 (142) - Files rejected: 113 (113) - Files total: 142 (142) - RowGroups processed: 98.94K (98938) - RowGroups rejected: 0 (0) - RowGroups total: 98.94K (98938) - Rows processed: 475.11K (475107) - Rows rejected: 0 (0) - Rows total: 475.14K (475136) - Splits processed: 29 (29) - Splits rejected: 0 (0) - Splits total: 29 (29) Instance 594518549f864a64:2c (host=d2413.halxg.cloudera.com:22000):(Total: 623.612ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:6/601.49 MB 18:3/657.96 MB 5:6/1.02 GB 17:3/488.54 MB 8:4/365.78 MB 22:5/823.14 MB 14:7/1.23 GB 15:5/1.00 GB 9:9/1017.64 MB 7:4/469.75 MB 16:6/908.59 MB 11:5/789.98 MB 13:8/934.65 MB 10:5/756.97 MB 12:5/1.00 GB 3:4/637.36 MB 20:12/1.77 GB 23:4/639.67 MB 6:8/1.48 GB 1:5/517.08 MB 2:6/907.55 MB 19:3/624.64 MB 21:7/958.81 MB 4:5/652.83 MB Filter 5 arrival: 585ms Filter 7 arrival: 599ms MemoryUsage(500.000ms): 0, 1.33 MB, 175.49 MB, 192.27 MB, 192.61 MB, 192.20 MB, 192.21 MB, 192.24 MB, 192.23 MB, 192.44 MB, 198.57 MB, 198.47 MB, 198.51 MB, 204.49 MB, 204.55 MB, 204.50 MB, 172.73 MB, 164.76 MB, 164.89 MB, 115.03 MB, 70.29 MB, 43.82 MB ThreadUsage(500.000ms): 1, 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 13.73 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 204.74 MB (214687304) - PerHostPeakMemUsage: 434.44 MB (455541136) - RowsProduced: 15.55K (15548) - TotalCpuTime: 2m33s - TotalNetworkReceiveTime: 38.561ms - TotalNetworkSendTime: 3.190ms - TotalStorageWaitTime: 376.652ms Fragment Instance Lifecycle Timings: - ExecTime: 10s245ms - ExecTreeExecTime: 10s232ms - OpenTime: 582.416ms - ExecTreeOpenTime: 59.741ms - PrepareTime: 41.170ms - ExecTreePrepareTime: 24.482ms CodeGen:(Total: 545.648ms, non-child: 545.648ms, % non-child: 100.00%) - CodegenTime: 4.801ms - CompileTime: 161.629ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 358.980ms - PrepareTime: 24.430ms DataStreamSender (dst_id=24):(Total: 5.746ms, non-child: 5.746ms, % non-child: 100.00%) - BytesSent: 355.62 KB (364156) - NetworkThroughput(*): 150.77 MB/sec - OverallThroughput: 60.43 MB/sec - RowsReturned: 15.55K (15548) - SerializeBatchTime: 3.393ms - TransmitDataRPCTime: 2.303ms - UncompressedRowBatchSize: 1.87 MB (1959548) AGGREGATION_NODE (id=11):(Total: 10s295ms, non-child: 6s771ms, % non-child: 65.77%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 160.900us - GetResultsTime: 1.225ms - HTResizeTime: 1.928ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10717287) - PinTime: 0.000ns - ReductionFactorEstimate: 1008601.57 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 15.55K (15548) - RowsReturnedRate: 1.51 K/sec - StreamingTime: 6s484ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s523ms, non-child: 3s085ms, % non-child: 87.57%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 944.856us - PeakMemoryUsage: 1.20 MB (1254631) - ProbeRows: 83.65M (83652718) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s986ms - RowsReturned: 83.65M (83652718) - RowsReturnedRate: 23.74 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 59.232us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 80.392us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.024us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 38.572ms, non-child: 20.128us, % non-child: 0.05%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.872us - DeserializeRowBatchTimer: 26.424us - FirstBatchArrivalWaitTime: 38.359ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 9.62 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 399.864ms, non-child: 399.864ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:6/601.49 MB 18:3/657.96 MB 5:6/1.02 GB 17:3/488.54 MB 8:4/365.78 MB 22:5/823.14 MB 14:7/1.23 GB 15:5/1.00 GB 9:9/1017.64 MB 7:4/469.75 MB 16:6/908.59 MB 11:5/789.98 MB 13:8/934.65 MB 10:5/756.97 MB 12:5/1.00 GB 3:4/637.36 MB 20:12/1.77 GB 23:4/639.67 MB 6:8/1.48 GB 1:5/517.08 MB 2:6/907.55 MB 19:3/624.64 MB 21:7/958.81 MB 4:5/652.83 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 26 out of 26 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:109 PARQUET/SNAPPY:52 BytesRead(500.000ms): 0, 106.29 MB, 118.88 MB, 118.88 MB, 118.88 MB, 118.88 MB, 118.88 MB, 118.88 MB, 118.88 MB, 168.33 MB, 174.18 MB, 174.18 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 186.76 MB, 187.54 MB, 187.54 MB, 187.54 MB - FooterProcessingTime: (Avg: 5.393ms ; Min: 1.350ms ; Max: 9.518ms ; Number of samples: 26) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 187.54 MB (196647059) - BytesReadDataNodeCache: 0 - BytesReadLocal: 187.54 MB (196647059) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 187.54 MB (196647059) - DecompressionTime: 152.889ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 16 (16) - NumRowGroups: 26 (26) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 191.58 MB (200885560) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.754ms - RowBatchQueuePutWaitTime: 2m3s - RowsRead: 83.66M (83662741) - RowsReturned: 83.65M (83652718) - RowsReturnedRate: 209.20 M/sec - ScanRangesComplete: 135 (135) - ScannerThreadsInvoluntaryContextSwitches: 4.33K (4331) - ScannerThreadsTotalWallClockTime: 2m23s - MaterializeTupleTime(*): 5s318ms - ScannerThreadsSysTime: 10s379ms - ScannerThreadsUserTime: 8s873ms - ScannerThreadsVoluntaryContextSwitches: 395.80K (395803) - TotalRawHdfsReadTime(*): 140.367ms - TotalReadThroughput: 17.86 MB/sec Filter 5 (1.00 MB): - Rows processed: 425.96K (425958) - Rows rejected: 10.02K (10023) - Rows total: 425.98K (425984) Filter 7 (1.00 MB): - Files processed: 135 (135) - Files rejected: 109 (109) - Files total: 135 (135) - RowGroups processed: 81.69K (81688) - RowGroups rejected: 0 (0) - RowGroups total: 81.69K (81688) - Rows processed: 425.96K (425958) - Rows rejected: 0 (0) - Rows total: 425.98K (425984) - Splits processed: 26 (26) - Splits rejected: 0 (0) - Splits total: 26 (26) Instance 594518549f864a64:33 (host=d2401.halxg.cloudera.com:22000):(Total: 613.562ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:3/280.44 MB 16:4/775.81 MB 0:7/1023.55 MB 3:6/907.10 MB 12:6/529.24 MB 10:8/1001.07 MB 6:5/517.00 MB 15:5/995.65 MB 20:8/933.76 MB 14:4/638.96 MB 1:9/1.26 GB 18:7/1.23 GB 17:8/1.11 GB 2:5/755.58 MB 13:3/248.65 MB 23:4/670.98 MB 11:5/518.44 MB 8:6/562.19 MB 5:6/1.15 GB 22:8/764.62 MB 4:5/893.83 MB 21:10/1.27 GB 7:12/1.60 GB 9:3/384.51 MB Filter 5 arrival: 531ms Filter 7 arrival: 592ms MemoryUsage(500.000ms): 1.33 MB, 114.48 MB, 160.57 MB, 160.73 MB, 160.91 MB, 160.69 MB, 160.65 MB, 149.91 MB, 158.69 MB, 158.75 MB, 167.77 MB, 167.95 MB, 128.15 MB, 133.92 MB, 131.19 MB, 153.02 MB, 152.64 MB, 151.52 MB, 133.22 MB, 133.50 MB, 133.27 MB, 94.38 MB, 68.18 MB, 44.29 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 11.54 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 168.02 MB (176179667) - PerHostPeakMemUsage: 373.14 MB (391262307) - RowsProduced: 17.58K (17576) - TotalCpuTime: 2m17s - TotalNetworkReceiveTime: 2.296us - TotalNetworkSendTime: 3.313ms - TotalStorageWaitTime: 317.073ms Fragment Instance Lifecycle Timings: - ExecTime: 11s454ms - ExecTreeExecTime: 11s439ms - OpenTime: 567.834ms - ExecTreeOpenTime: 15.369ms - PrepareTime: 45.706ms - ExecTreePrepareTime: 26.530ms CodeGen:(Total: 576.563ms, non-child: 576.563ms, % non-child: 100.00%) - CodegenTime: 4.791ms - CompileTime: 175.802ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 373.148ms - PrepareTime: 26.985ms DataStreamSender (dst_id=24):(Total: 6.477ms, non-child: 6.477ms, % non-child: 100.00%) - BytesSent: 432.88 KB (443265) - NetworkThroughput(*): 198.27 MB/sec - OverallThroughput: 65.26 MB/sec - RowsReturned: 17.58K (17576) - SerializeBatchTime: 4.289ms - TransmitDataRPCTime: 2.132ms - UncompressedRowBatchSize: 2.11 MB (2215132) AGGREGATION_NODE (id=11):(Total: 11s458ms, non-child: 7s655ms, % non-child: 66.81%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 145.333us - GetResultsTime: 1.384ms - HTResizeTime: 1.369ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10711305) - PinTime: 0.000ns - ReductionFactorEstimate: 1019830.30 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 17.58K (17576) - RowsReturnedRate: 1.53 K/sec - StreamingTime: 7s316ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s803ms, non-child: 3s385ms, % non-child: 89.01%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 713.754us - PeakMemoryUsage: 1.19 MB (1248649) - ProbeRows: 101.28M (101280763) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s276ms - RowsReturned: 101.28M (101280763) - RowsReturnedRate: 26.63 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.236us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 60.040us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.746us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 11.753us, non-child: 11.753us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.762us - DeserializeRowBatchTimer: 45.279us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 31.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 417.914ms, non-child: 417.914ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:3/280.44 MB 16:4/775.81 MB 0:7/1023.55 MB 3:6/907.10 MB 12:6/529.24 MB 10:8/1001.07 MB 6:5/517.00 MB 15:5/995.65 MB 20:8/933.76 MB 14:4/638.96 MB 1:9/1.26 GB 18:7/1.23 GB 17:8/1.11 GB 2:5/755.58 MB 13:3/248.65 MB 23:4/670.98 MB 11:5/518.44 MB 8:6/562.19 MB 5:6/1.15 GB 22:8/764.62 MB 4:5/893.83 MB 21:10/1.27 GB 7:12/1.60 GB 9:3/384.51 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 37 out of 37 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:110 PARQUET/SNAPPY:74 BytesRead(500.000ms): 0, 69.30 MB, 100.32 MB, 100.32 MB, 100.32 MB, 100.32 MB, 100.32 MB, 126.14 MB, 140.29 MB, 141.83 MB, 149.35 MB, 149.35 MB, 149.35 MB, 161.94 MB, 175.29 MB, 221.20 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB, 227.80 MB - FooterProcessingTime: (Avg: 3.343ms ; Min: 1.115ms ; Max: 7.759ms ; Number of samples: 37) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 227.80 MB (238866068) - BytesReadDataNodeCache: 0 - BytesReadLocal: 227.80 MB (238866068) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 227.80 MB (238866068) - DecompressionTime: 179.511ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 22 (22) - NumRowGroups: 37 (37) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 154.86 MB (162377923) - PerReadThreadRawHdfsThroughput: 1.56 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.672ms - RowBatchQueuePutWaitTime: 1m45s - RowsRead: 101.30M (101295002) - RowsReturned: 101.28M (101280763) - RowsReturnedRate: 242.35 M/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 4.85K (4848) - ScannerThreadsTotalWallClockTime: 2m5s - MaterializeTupleTime(*): 5s929ms - ScannerThreadsSysTime: 8s078ms - ScannerThreadsUserTime: 11s333ms - ScannerThreadsVoluntaryContextSwitches: 471.93K (471932) - TotalRawHdfsReadTime(*): 142.162ms - TotalReadThroughput: 18.98 MB/sec Filter 5 (1.00 MB): - Rows processed: 606.17K (606171) - Rows rejected: 14.24K (14239) - Rows total: 606.21K (606208) Filter 7 (1.00 MB): - Files processed: 147 (147) - Files rejected: 110 (110) - Files total: 147 (147) - RowGroups processed: 98.91K (98905) - RowGroups rejected: 0 (0) - RowGroups total: 98.91K (98905) - Rows processed: 606.17K (606171) - Rows rejected: 0 (0) - Rows total: 606.21K (606208) - Splits processed: 37 (37) - Splits rejected: 0 (0) - Splits total: 37 (37) Instance 594518549f864a64:34 (host=d2411.halxg.cloudera.com:22000):(Total: 610.623ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:4/606.15 MB 10:3/488.63 MB 7:4/742.26 MB 5:3/520.83 MB 0:7/818.28 MB 6:3/657.67 MB 14:5/548.85 MB 15:8/1.08 GB 9:3/248.85 MB 17:5/1.01 GB 12:6/497.11 MB 22:8/1.01 GB 2:3/384.75 MB 19:7/1.00 GB 23:10/1.58 GB 1:2/267.42 MB 18:9/1.60 GB 16:3/624.38 MB 20:8/1.48 GB 3:5/859.66 MB 21:13/1.92 GB 4:6/872.71 MB 13:4/535.11 MB 11:4/637.49 MB Filter 7 arrival: 569ms Filter 5 arrival: 572ms MemoryUsage(500.000ms): 1.33 MB, 180.67 MB, 195.67 MB, 210.56 MB, 210.25 MB, 210.38 MB, 210.52 MB, 210.45 MB, 210.16 MB, 222.52 MB, 222.23 MB, 222.49 MB, 222.55 MB, 222.19 MB, 222.25 MB, 174.52 MB, 166.86 MB, 158.84 MB, 164.85 MB, 176.75 MB, 145.36 MB, 137.09 MB, 121.18 MB, 121.23 MB, 102.78 MB, 84.19 MB, 76.31 MB, 44.22 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.50 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 222.85 MB (233672788) - PerHostPeakMemUsage: 458.45 MB (480717922) - RowsProduced: 15.55K (15548) - TotalCpuTime: 3m19s - TotalNetworkReceiveTime: 14.749ms - TotalNetworkSendTime: 2.979ms - TotalStorageWaitTime: 382.043ms Fragment Instance Lifecycle Timings: - ExecTime: 13s295ms - ExecTreeExecTime: 13s282ms - OpenTime: 572.313ms - ExecTreeOpenTime: 54.541ms - PrepareTime: 38.292ms - ExecTreePrepareTime: 22.844ms CodeGen:(Total: 539.385ms, non-child: 539.385ms, % non-child: 100.00%) - CodegenTime: 4.518ms - CompileTime: 161.764ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 354.339ms - PrepareTime: 22.718ms DataStreamSender (dst_id=24):(Total: 5.826ms, non-child: 5.826ms, % non-child: 100.00%) - BytesSent: 362.03 KB (370721) - NetworkThroughput(*): 157.65 MB/sec - OverallThroughput: 60.67 MB/sec - RowsReturned: 15.55K (15548) - SerializeBatchTime: 3.543ms - TransmitDataRPCTime: 2.242ms - UncompressedRowBatchSize: 1.87 MB (1959552) AGGREGATION_NODE (id=11):(Total: 13s339ms, non-child: 8s860ms, % non-child: 66.42%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 106.392us - GetResultsTime: 1.360ms - HTResizeTime: 1.827ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.26 MB (10762787) - PinTime: 0.000ns - ReductionFactorEstimate: 1002103.87 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 15.55K (15548) - RowsReturnedRate: 1.17 K/sec - StreamingTime: 8s466ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 4s479ms, non-child: 3s942ms, % non-child: 88.02%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 1.189ms - PeakMemoryUsage: 1.22 MB (1275693) - ProbeRows: 113.29M (113287232) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s808ms - RowsReturned: 113.29M (113287232) - RowsReturnedRate: 25.29 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 53.588us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 66.612us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.980us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 14.761ms, non-child: 29.532us, % non-child: 0.20%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.324us - DeserializeRowBatchTimer: 28.964us - FirstBatchArrivalWaitTime: 14.028ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 25.13 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 521.896ms, non-child: 521.896ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:4/606.15 MB 10:3/488.63 MB 7:4/742.26 MB 5:3/520.83 MB 0:7/818.28 MB 6:3/657.67 MB 14:5/548.85 MB 15:8/1.08 GB 9:3/248.85 MB 17:5/1.01 GB 12:6/497.11 MB 22:8/1.01 GB 2:3/384.75 MB 19:7/1.00 GB 23:10/1.58 GB 1:2/267.42 MB 18:9/1.60 GB 16:3/624.38 MB 20:8/1.48 GB 3:5/859.66 MB 21:13/1.92 GB 4:6/872.71 MB 13:4/535.11 MB 11:4/637.49 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: All filters arrived. Waited 20ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:102 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 112.17 MB, 125.53 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 138.12 MB, 190.10 MB, 190.10 MB, 190.10 MB, 190.10 MB, 190.10 MB, 190.10 MB, 190.10 MB, 190.10 MB, 190.10 MB, 208.56 MB, 253.69 MB, 253.69 MB, 253.69 MB, 253.69 MB, 253.69 MB, 253.69 MB, 253.69 MB, 253.69 MB, 253.69 MB - FooterProcessingTime: (Avg: 4.328ms ; Min: 1.261ms ; Max: 7.886ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 253.69 MB (266010743) - BytesReadDataNodeCache: 0 - BytesReadLocal: 253.69 MB (266010743) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 253.69 MB (266010743) - DecompressionTime: 203.005ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 18 (18) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 209.69 MB (219871044) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.591ms - RowBatchQueuePutWaitTime: 2m27s - RowsRead: 113.30M (113299081) - RowsReturned: 113.29M (113287232) - RowsReturnedRate: 217.07 M/sec - ScanRangesComplete: 133 (133) - ScannerThreadsInvoluntaryContextSwitches: 6.73K (6730) - ScannerThreadsTotalWallClockTime: 3m5s - MaterializeTupleTime(*): 7s043ms - ScannerThreadsSysTime: 20s929ms - ScannerThreadsUserTime: 15s107ms - ScannerThreadsVoluntaryContextSwitches: 927.37K (927368) - TotalRawHdfsReadTime(*): 202.281ms - TotalReadThroughput: 18.12 MB/sec Filter 5 (1.00 MB): - Rows processed: 507.87K (507873) - Rows rejected: 11.85K (11849) - Rows total: 507.90K (507904) Filter 7 (1.00 MB): - Files processed: 133 (133) - Files rejected: 102 (102) - Files total: 133 (133) - RowGroups processed: 110.63K (110631) - RowGroups rejected: 0 (0) - RowGroups total: 110.63K (110631) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Instance 594518549f864a64:31 (host=d2404.halxg.cloudera.com:22000):(Total: 596.162ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:3/522.96 MB 22:6/805.56 MB 20:3/489.00 MB 2:5/688.40 MB 21:4/639.71 MB 13:6/770.39 MB 11:4/742.04 MB 8:7/1.13 GB 17:5/756.44 MB 0:5/619.97 MB 10:8/935.46 MB 12:3/352.34 MB 16:7/991.33 MB 4:8/1.61 GB 6:6/635.93 MB 3:6/873.30 MB 7:6/907.77 MB 15:9/1.26 GB 14:8/1.22 GB 9:9/1.13 GB 19:11/1.46 GB 18:5/620.79 MB 5:6/1010.23 MB Filter 5 arrival: 555ms Filter 7 arrival: 574ms MemoryUsage(500.000ms): 1.33 MB, 168.98 MB, 184.05 MB, 184.45 MB, 183.98 MB, 184.11 MB, 184.26 MB, 184.25 MB, 184.18 MB, 192.61 MB, 204.32 MB, 204.37 MB, 201.47 MB, 201.61 MB, 210.50 MB, 178.59 MB, 170.70 MB, 170.76 MB, 150.28 MB, 117.17 MB, 68.02 MB, 44.26 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.36 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 210.63 MB (220862339) - PerHostPeakMemUsage: 446.16 MB (467827573) - RowsProduced: 14.87K (14872) - TotalCpuTime: 2m35s - TotalNetworkReceiveTime: 32.711ms - TotalNetworkSendTime: 3.428ms - TotalStorageWaitTime: 369.622ms Fragment Instance Lifecycle Timings: - ExecTime: 10s397ms - ExecTreeExecTime: 10s383ms - OpenTime: 557.904ms - ExecTreeOpenTime: 52.275ms - PrepareTime: 38.240ms - ExecTreePrepareTime: 22.498ms CodeGen:(Total: 526.928ms, non-child: 526.928ms, % non-child: 100.00%) - CodegenTime: 5.050ms - CompileTime: 160.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 343.529ms - PrepareTime: 22.373ms DataStreamSender (dst_id=24):(Total: 5.996ms, non-child: 5.996ms, % non-child: 100.00%) - BytesSent: 335.41 KB (343455) - NetworkThroughput(*): 151.92 MB/sec - OverallThroughput: 54.62 MB/sec - RowsReturned: 14.87K (14872) - SerializeBatchTime: 3.793ms - TransmitDataRPCTime: 2.155ms - UncompressedRowBatchSize: 1.79 MB (1874344) AGGREGATION_NODE (id=11):(Total: 10s438ms, non-child: 6s927ms, % non-child: 66.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 119.072us - GetResultsTime: 1.179ms - HTResizeTime: 1.948ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.24 MB (10735575) - PinTime: 0.000ns - ReductionFactorEstimate: 1004209.33 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 14.87K (14872) - RowsReturnedRate: 1.42 K/sec - StreamingTime: 6s645ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s511ms, non-child: 3s080ms, % non-child: 87.75%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 746.276us - PeakMemoryUsage: 1.21 MB (1272919) - ProbeRows: 89.31M (89312236) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s977ms - RowsReturned: 89.31M (89312236) - RowsReturnedRate: 25.44 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.648us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 61.088us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 43.720us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 32.721ms, non-child: 14.396us, % non-child: 0.04%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.092us - DeserializeRowBatchTimer: 64.140us - FirstBatchArrivalWaitTime: 31.216ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 11.34 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 397.704ms, non-child: 397.704ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:3/522.96 MB 22:6/805.56 MB 20:3/489.00 MB 2:5/688.40 MB 21:4/639.71 MB 13:6/770.39 MB 11:4/742.04 MB 8:7/1.13 GB 17:5/756.44 MB 0:5/619.97 MB 10:8/935.46 MB 12:3/352.34 MB 16:7/991.33 MB 4:8/1.61 GB 6:6/635.93 MB 3:6/873.30 MB 7:6/907.77 MB 15:9/1.26 GB 14:8/1.22 GB 9:9/1.13 GB 19:11/1.46 GB 18:5/620.79 MB 5:6/1010.23 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:113 PARQUET/SNAPPY:54 BytesRead(500.000ms): 0, 109.01 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 121.59 MB, 166.79 MB, 174.34 MB, 174.34 MB, 193.53 MB, 194.37 MB, 200.22 MB, 200.22 MB, 200.22 MB, 200.22 MB, 200.22 MB, 200.22 MB, 200.22 MB, 200.22 MB - FooterProcessingTime: (Avg: 4.733ms ; Min: 1.126ms ; Max: 8.660ms ; Number of samples: 27) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 200.22 MB (209950116) - BytesReadDataNodeCache: 0 - BytesReadLocal: 200.22 MB (209950116) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 200.22 MB (209950116) - DecompressionTime: 157.131ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 18 (18) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 197.47 MB (207060595) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.068ms - RowBatchQueuePutWaitTime: 2m2s - RowsRead: 89.32M (89322651) - RowsReturned: 89.31M (89312236) - RowsReturnedRate: 224.57 M/sec - ScanRangesComplete: 140 (140) - ScannerThreadsInvoluntaryContextSwitches: 5.09K (5094) - ScannerThreadsTotalWallClockTime: 2m25s - MaterializeTupleTime(*): 5s489ms - ScannerThreadsSysTime: 11s316ms - ScannerThreadsUserTime: 10s118ms - ScannerThreadsVoluntaryContextSwitches: 428.11K (428107) - TotalRawHdfsReadTime(*): 158.734ms - TotalReadThroughput: 18.20 MB/sec Filter 5 (1.00 MB): - Rows processed: 442.34K (442341) - Rows rejected: 10.41K (10415) - Rows total: 442.37K (442368) Filter 7 (1.00 MB): - Files processed: 140 (140) - Files rejected: 113 (113) - Files total: 140 (140) - RowGroups processed: 87.22K (87215) - RowGroups rejected: 0 (0) - RowGroups total: 87.22K (87215) - Rows processed: 442.34K (442341) - Rows rejected: 0 (0) - Rows total: 442.37K (442368) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Instance 594518549f864a64:35 (host=d2415.halxg.cloudera.com:22000):(Total: 591.868ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:3/384.69 MB 2:4/878.08 MB 10:6/1.05 GB 0:5/892.23 MB 3:8/1.15 GB 7:9/1.43 GB 23:4/606.13 MB 13:6/977.29 MB 16:5/551.91 MB 15:5/859.69 MB 6:8/1.05 GB 11:3/282.23 MB 5:3/521.45 MB 22:10/1.31 GB 14:6/395.84 MB 9:6/976.53 MB 12:8/732.95 MB 19:7/1.20 GB 4:5/892.36 MB 21:4/503.47 MB 17:7/1.00 GB 1:4/502.40 MB 18:7/1.23 GB 20:4/640.10 MB Filter 5 arrival: 567ms Filter 7 arrival: 568ms MemoryUsage(500.000ms): 1.33 MB, 6.29 MB, 198.17 MB, 198.50 MB, 198.47 MB, 198.47 MB, 198.43 MB, 198.54 MB, 198.33 MB, 170.45 MB, 195.46 MB, 204.72 MB, 204.62 MB, 204.41 MB, 204.35 MB, 156.60 MB, 156.51 MB, 156.61 MB, 146.55 MB, 86.49 MB, 27.64 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.33 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 204.76 MB (214708268) - PerHostPeakMemUsage: 428.23 MB (449029818) - RowsProduced: 15.55K (15548) - TotalCpuTime: 2m22s - TotalNetworkReceiveTime: 17.384ms - TotalNetworkSendTime: 3.069ms - TotalStorageWaitTime: 371.669ms Fragment Instance Lifecycle Timings: - ExecTime: 9s538ms - ExecTreeExecTime: 9s525ms - OpenTime: 551.859ms - ExecTreeOpenTime: 40.872ms - PrepareTime: 39.991ms - ExecTreePrepareTime: 23.548ms CodeGen:(Total: 532.656ms, non-child: 532.656ms, % non-child: 100.00%) - CodegenTime: 4.595ms - CompileTime: 158.697ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 350.213ms - PrepareTime: 23.191ms DataStreamSender (dst_id=24):(Total: 6.124ms, non-child: 6.124ms, % non-child: 100.00%) - BytesSent: 359.48 KB (368112) - NetworkThroughput(*): 154.85 MB/sec - OverallThroughput: 57.32 MB/sec - RowsReturned: 15.55K (15548) - SerializeBatchTime: 3.805ms - TransmitDataRPCTime: 2.267ms - UncompressedRowBatchSize: 1.87 MB (1959564) AGGREGATION_NODE (id=11):(Total: 9s569ms, non-child: 6s454ms, % non-child: 67.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 138.808us - GetResultsTime: 1.328ms - HTResizeTime: 1.406ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10717030) - PinTime: 0.000ns - ReductionFactorEstimate: 1006219.73 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 15.55K (15548) - RowsReturnedRate: 1.62 K/sec - StreamingTime: 6s194ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s114ms, non-child: 2s774ms, % non-child: 89.08%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 2.426ms - PeakMemoryUsage: 1.20 MB (1254374) - ProbeRows: 83.90M (83902954) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s683ms - RowsReturned: 83.90M (83902954) - RowsReturnedRate: 26.94 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 41.216us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 211.680us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.288us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 17.394ms, non-child: 16.236us, % non-child: 0.09%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.268us - DeserializeRowBatchTimer: 27.204us - FirstBatchArrivalWaitTime: 17.251ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 21.33 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 323.018ms, non-child: 323.018ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:3/384.69 MB 2:4/878.08 MB 10:6/1.05 GB 0:5/892.23 MB 3:8/1.15 GB 7:9/1.43 GB 23:4/606.13 MB 13:6/977.29 MB 16:5/551.91 MB 15:5/859.69 MB 6:8/1.05 GB 11:3/282.23 MB 5:3/521.45 MB 22:10/1.31 GB 14:6/395.84 MB 9:6/976.53 MB 12:8/732.95 MB 19:7/1.20 GB 4:5/892.36 MB 21:4/503.47 MB 17:7/1.00 GB 1:4/502.40 MB 18:7/1.23 GB 20:4/640.10 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 27 out of 27 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:110 PARQUET/SNAPPY:54 BytesRead(500.000ms): 0, 0, 123.88 MB, 123.88 MB, 123.88 MB, 123.88 MB, 123.88 MB, 123.88 MB, 123.88 MB, 132.93 MB, 182.37 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB, 188.23 MB - FooterProcessingTime: (Avg: 6.580ms ; Min: 1.338ms ; Max: 11.555ms ; Number of samples: 27) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 188.23 MB (197377726) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.23 MB (197377726) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.23 MB (197377726) - DecompressionTime: 142.319ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 17 (17) - NumRowGroups: 27 (27) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 191.60 MB (200906524) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.738ms - RowBatchQueuePutWaitTime: 1m59s - RowsRead: 83.91M (83913437) - RowsReturned: 83.90M (83902954) - RowsReturnedRate: 259.75 M/sec - ScanRangesComplete: 137 (137) - ScannerThreadsInvoluntaryContextSwitches: 3.81K (3806) - ScannerThreadsTotalWallClockTime: 2m13s - MaterializeTupleTime(*): 4s838ms - ScannerThreadsSysTime: 6s108ms - ScannerThreadsUserTime: 7s384ms - ScannerThreadsVoluntaryContextSwitches: 254.41K (254405) - TotalRawHdfsReadTime(*): 134.972ms - TotalReadThroughput: 17.93 MB/sec Filter 5 (1.00 MB): - Rows processed: 442.34K (442341) - Rows rejected: 10.48K (10483) - Rows total: 442.37K (442368) Filter 7 (1.00 MB): - Files processed: 137 (137) - Files rejected: 110 (110) - Files total: 137 (137) - RowGroups processed: 81.93K (81933) - RowGroups rejected: 0 (0) - RowGroups total: 81.93K (81933) - Rows processed: 442.34K (442341) - Rows rejected: 0 (0) - Rows total: 442.37K (442368) - Splits processed: 27 (27) - Splits rejected: 0 (0) - Splits total: 27 (27) Instance 594518549f864a64:30 (host=d2418.halxg.cloudera.com:22000):(Total: 591.506ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:5/756.08 MB 9:4/911.58 MB 7:5/276.58 MB 19:8/1.11 GB 14:4/741.35 MB 22:7/1.23 GB 17:6/873.33 MB 15:7/992.23 MB 5:5/653.57 MB 12:6/529.24 MB 0:6/836.59 MB 21:5/925.77 MB 2:6/909.00 MB 18:4/775.46 MB 1:8/902.66 MB 10:9/1.10 GB 13:8/1.11 GB 8:7/887.34 MB 23:7/784.73 MB 6:5/484.15 MB 3:6/907.72 MB 20:8/832.28 MB 11:7/1.23 GB 16:4/398.18 MB Filter 5 arrival: 551ms Filter 7 arrival: 569ms MemoryUsage(500.000ms): 1.33 MB, 160.14 MB, 191.95 MB, 192.01 MB, 191.86 MB, 192.16 MB, 191.93 MB, 191.93 MB, 191.80 MB, 180.53 MB, 195.54 MB, 195.55 MB, 186.59 MB, 201.59 MB, 210.52 MB, 178.53 MB, 170.94 MB, 170.60 MB, 140.12 MB, 88.46 MB, 68.19 MB, 52.19 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.36 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 210.68 MB (220913163) - PerHostPeakMemUsage: 434.49 MB (455591858) - RowsProduced: 13.52K (13520) - TotalCpuTime: 2m36s - TotalNetworkReceiveTime: 17.428ms - TotalNetworkSendTime: 2.965ms - TotalStorageWaitTime: 423.765ms Fragment Instance Lifecycle Timings: - ExecTime: 10s448ms - ExecTreeExecTime: 10s436ms - OpenTime: 552.714ms - ExecTreeOpenTime: 38.132ms - PrepareTime: 38.776ms - ExecTreePrepareTime: 22.335ms CodeGen:(Total: 535.422ms, non-child: 535.422ms, % non-child: 100.00%) - CodegenTime: 5.305ms - CompileTime: 160.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 351.514ms - PrepareTime: 22.443ms DataStreamSender (dst_id=24):(Total: 5.274ms, non-child: 5.274ms, % non-child: 100.00%) - BytesSent: 347.24 KB (355569) - NetworkThroughput(*): 173.15 MB/sec - OverallThroughput: 64.29 MB/sec - RowsReturned: 13.52K (13520) - SerializeBatchTime: 3.267ms - TransmitDataRPCTime: 1.958ms - UncompressedRowBatchSize: 1.63 MB (1703976) AGGREGATION_NODE (id=11):(Total: 10s477ms, non-child: 7s111ms, % non-child: 67.87%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 128.539us - GetResultsTime: 1.091ms - HTResizeTime: 1.647ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.23 MB (10729012) - PinTime: 0.000ns - ReductionFactorEstimate: 1009625.83 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 13.52K (13520) - RowsReturnedRate: 1.29 K/sec - StreamingTime: 6s834ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s366ms, non-child: 3s017ms, % non-child: 89.63%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 1.207ms - PeakMemoryUsage: 1.21 MB (1266356) - ProbeRows: 89.90M (89904140) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s923ms - RowsReturned: 89.90M (89904140) - RowsReturnedRate: 26.71 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 56.276us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 68.620us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 44.796us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 17.440ms, non-child: 21.512us, % non-child: 0.12%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.420us - DeserializeRowBatchTimer: 94.700us - FirstBatchArrivalWaitTime: 14.984ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 21.27 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 332.028ms, non-child: 332.028ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:5/756.08 MB 9:4/911.58 MB 7:5/276.58 MB 19:8/1.11 GB 14:4/741.35 MB 22:7/1.23 GB 17:6/873.33 MB 15:7/992.23 MB 5:5/653.57 MB 12:6/529.24 MB 0:6/836.59 MB 21:5/925.77 MB 2:6/909.00 MB 18:4/775.46 MB 1:8/902.66 MB 10:9/1.10 GB 13:8/1.11 GB 8:7/887.34 MB 23:7/784.73 MB 6:5/484.15 MB 3:6/907.72 MB 20:8/832.28 MB 11:7/1.23 GB 16:4/398.18 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 32 out of 32 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:115 PARQUET/SNAPPY:64 BytesRead(500.000ms): 0, 103.75 MB, 122.19 MB, 122.19 MB, 122.19 MB, 122.19 MB, 122.19 MB, 122.19 MB, 122.19 MB, 148.04 MB, 167.23 MB, 168.02 MB, 182.90 MB, 196.26 MB, 202.11 MB, 202.11 MB, 202.11 MB, 202.11 MB, 202.11 MB, 202.11 MB, 202.11 MB, 202.11 MB - FooterProcessingTime: (Avg: 5.824ms ; Min: 1.117ms ; Max: 11.633ms ; Number of samples: 32) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 202.11 MB (211932722) - BytesReadDataNodeCache: 0 - BytesReadLocal: 202.11 MB (211932722) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 202.11 MB (211932722) - DecompressionTime: 153.467ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 19 (19) - NumRowGroups: 32 (32) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 197.52 MB (207111419) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.821ms - RowBatchQueuePutWaitTime: 2m2s - RowsRead: 89.92M (89916492) - RowsReturned: 89.90M (89904140) - RowsReturnedRate: 270.77 M/sec - ScanRangesComplete: 147 (147) - ScannerThreadsInvoluntaryContextSwitches: 4.17K (4169) - ScannerThreadsTotalWallClockTime: 2m25s - MaterializeTupleTime(*): 5s111ms - ScannerThreadsSysTime: 12s359ms - ScannerThreadsUserTime: 9s700ms - ScannerThreadsVoluntaryContextSwitches: 462.60K (462600) - TotalRawHdfsReadTime(*): 141.509ms - TotalReadThroughput: 18.37 MB/sec Filter 5 (1.00 MB): - Rows processed: 524.26K (524256) - Rows rejected: 12.35K (12352) - Rows total: 524.29K (524288) Filter 7 (1.00 MB): - Files processed: 147 (147) - Files rejected: 115 (115) - Files total: 147 (147) - RowGroups processed: 87.79K (87791) - RowGroups rejected: 0 (0) - RowGroups total: 87.79K (87791) - Rows processed: 524.26K (524256) - Rows rejected: 0 (0) - Rows total: 524.29K (524288) - Splits processed: 32 (32) - Splits rejected: 0 (0) - Splits total: 32 (32) Instance 594518549f864a64:36 (host=d2409.halxg.cloudera.com:22000):(Total: 589.838ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:3/384.91 MB 22:4/639.73 MB 0:5/685.93 MB 3:5/653.64 MB 1:6/665.64 MB 16:5/859.61 MB 2:5/756.05 MB 5:7/1.23 GB 12:8/639.93 MB 15:6/770.87 MB 9:6/907.61 MB 8:6/1010.86 MB 18:6/1.02 GB 20:5/756.86 MB 17:5/549.90 MB 13:7/817.94 MB 19:8/1003.04 MB 23:8/1.12 GB 21:6/873.43 MB 4:7/1.13 GB 14:7/1023.78 MB 10:6/738.30 MB 11:6/801.91 MB 7:8/1.15 GB Filter 5 arrival: 565ms Filter 7 arrival: 567ms MemoryUsage(500.000ms): 1.33 MB, 121.49 MB, 163.01 MB, 180.66 MB, 180.41 MB, 180.51 MB, 180.62 MB, 180.36 MB, 180.34 MB, 192.20 MB, 183.55 MB, 161.95 MB, 151.41 MB, 151.66 MB, 151.52 MB, 127.84 MB, 127.75 MB, 70.27 MB, 35.94 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 193.09 MB (202465458) - PerHostPeakMemUsage: 416.66 MB (436898048) - RowsProduced: 13.52K (13520) - TotalCpuTime: 2m13s - TotalNetworkReceiveTime: 15.961ms - TotalNetworkSendTime: 3.177ms - TotalStorageWaitTime: 375.957ms Fragment Instance Lifecycle Timings: - ExecTime: 8s948ms - ExecTreeExecTime: 8s935ms - OpenTime: 549.363ms - ExecTreeOpenTime: 37.880ms - PrepareTime: 40.458ms - ExecTreePrepareTime: 23.258ms CodeGen:(Total: 533.523ms, non-child: 533.523ms, % non-child: 100.00%) - CodegenTime: 4.980ms - CompileTime: 159.952ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 349.793ms - PrepareTime: 23.230ms DataStreamSender (dst_id=24):(Total: 5.588ms, non-child: 5.588ms, % non-child: 100.00%) - BytesSent: 330.73 KB (338667) - NetworkThroughput(*): 165.36 MB/sec - OverallThroughput: 57.79 MB/sec - RowsReturned: 13.52K (13520) - SerializeBatchTime: 3.585ms - TransmitDataRPCTime: 1.953ms - UncompressedRowBatchSize: 1.63 MB (1703972) AGGREGATION_NODE (id=11):(Total: 8s976ms, non-child: 5s883ms, % non-child: 65.54%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 118.880us - GetResultsTime: 1.136ms - HTResizeTime: 1.557ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10712016) - PinTime: 0.000ns - ReductionFactorEstimate: 1019198.88 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 13.52K (13520) - RowsReturnedRate: 1.51 K/sec - StreamingTime: 5s655ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s093ms, non-child: 2s767ms, % non-child: 89.47%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 1.345ms - PeakMemoryUsage: 1.19 MB (1249360) - ProbeRows: 73.78M (73781577) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s677ms - RowsReturned: 73.78M (73781577) - RowsReturnedRate: 23.85 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 48.476us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 77.616us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 56.760us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 15.972ms, non-child: 17.704us, % non-child: 0.11%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.272us - DeserializeRowBatchTimer: 54.544us - FirstBatchArrivalWaitTime: 14.631ms - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 23.23 K/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 309.955ms, non-child: 309.955ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:3/384.91 MB 22:4/639.73 MB 0:5/685.93 MB 3:5/653.64 MB 1:6/665.64 MB 16:5/859.61 MB 2:5/756.05 MB 5:7/1.23 GB 12:8/639.93 MB 15:6/770.87 MB 9:6/907.61 MB 8:6/1010.86 MB 18:6/1.02 GB 20:5/756.86 MB 17:5/549.90 MB 13:7/817.94 MB 19:8/1003.04 MB 23:8/1.12 GB 21:6/873.43 MB 4:7/1.13 GB 14:7/1023.78 MB 10:6/738.30 MB 11:6/801.91 MB 7:8/1.15 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 29 out of 29 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:116 PARQUET/SNAPPY:58 BytesRead(500.000ms): 0, 71.69 MB, 97.45 MB, 109.18 MB, 109.18 MB, 109.18 MB, 109.18 MB, 109.18 MB, 109.18 MB, 159.51 MB, 166.13 MB, 166.13 MB, 166.13 MB, 166.13 MB, 166.13 MB, 166.13 MB, 166.13 MB, 166.13 MB, 166.13 MB - FooterProcessingTime: (Avg: 7.036ms ; Min: 1.345ms ; Max: 13.199ms ; Number of samples: 29) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 166.13 MB (174198965) - BytesReadDataNodeCache: 0 - BytesReadLocal: 166.13 MB (174198965) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 166.13 MB (174198965) - DecompressionTime: 127.985ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 18 (18) - NumRowGroups: 29 (29) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 179.92 MB (188663714) - PerReadThreadRawHdfsThroughput: 1.39 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 16.817ms - RowBatchQueuePutWaitTime: 1m35s - RowsRead: 73.79M (73792946) - RowsReturned: 73.78M (73781577) - RowsReturnedRate: 238.04 M/sec - ScanRangesComplete: 145 (145) - ScannerThreadsInvoluntaryContextSwitches: 4.84K (4836) - ScannerThreadsTotalWallClockTime: 2m4s - MaterializeTupleTime(*): 4s528ms - ScannerThreadsSysTime: 15s761ms - ScannerThreadsUserTime: 11s643ms - ScannerThreadsVoluntaryContextSwitches: 768.47K (768470) - TotalRawHdfsReadTime(*): 116.423ms - TotalReadThroughput: 17.49 MB/sec Filter 5 (1.00 MB): - Rows processed: 475.11K (475107) - Rows rejected: 11.37K (11369) - Rows total: 475.14K (475136) Filter 7 (1.00 MB): - Files processed: 145 (145) - Files rejected: 116 (116) - Files total: 145 (145) - RowGroups processed: 72.05K (72050) - RowGroups rejected: 0 (0) - RowGroups total: 72.05K (72050) - Rows processed: 475.11K (475107) - Rows rejected: 0 (0) - Rows total: 475.14K (475136) - Splits processed: 29 (29) - Splits rejected: 0 (0) - Splits total: 29 (29) Instance 594518549f864a64:32 (host=d2421.halxg.cloudera.com:22000):(Total: 587.780ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:3/282.04 MB 3:4/775.20 MB 21:2/268.43 MB 22:4/605.68 MB 16:7/918.89 MB 11:9/1.36 GB 2:3/522.27 MB 14:5/891.83 MB 4:7/304.19 MB 9:4/296.40 MB 17:4/502.65 MB 8:8/1.12 GB 20:11/1.83 GB 13:11/1.26 GB 10:5/892.39 MB 7:7/919.32 MB 1:10/1.17 GB 18:4/775.47 MB 6:8/1.08 GB 23:7/887.75 MB 19:6/770.25 MB 5:7/1.14 GB 15:6/905.87 MB 12:6/737.16 MB Filter 5 arrival: 555ms Filter 7 arrival: 568ms MemoryUsage(500.000ms): 1.33 MB, 147.49 MB, 147.44 MB, 147.28 MB, 147.38 MB, 147.32 MB, 147.22 MB, 152.83 MB, 158.99 MB, 147.33 MB, 147.23 MB, 131.45 MB, 115.64 MB, 105.31 MB, 51.79 MB, 35.94 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 11.31 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 159.02 MB (166747580) - PerHostPeakMemUsage: 376.57 MB (394860975) - RowsProduced: 12.84K (12844) - TotalCpuTime: 1m28s - TotalNetworkReceiveTime: 2.784us - TotalNetworkSendTime: 2.981ms - TotalStorageWaitTime: 243.961ms Fragment Instance Lifecycle Timings: - ExecTime: 7s400ms - ExecTreeExecTime: 7s389ms - OpenTime: 542.953ms - ExecTreeOpenTime: 15.723ms - PrepareTime: 44.809ms - ExecTreePrepareTime: 25.150ms CodeGen:(Total: 550.486ms, non-child: 550.486ms, % non-child: 100.00%) - CodegenTime: 4.964ms - CompileTime: 158.372ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 366.393ms - PrepareTime: 25.110ms DataStreamSender (dst_id=24):(Total: 4.794ms, non-child: 4.794ms, % non-child: 100.00%) - BytesSent: 282.68 KB (289469) - NetworkThroughput(*): 147.47 MB/sec - OverallThroughput: 57.58 MB/sec - RowsReturned: 12.84K (12844) - SerializeBatchTime: 2.875ms - TransmitDataRPCTime: 1.871ms - UncompressedRowBatchSize: 1.54 MB (1618768) AGGREGATION_NODE (id=11):(Total: 7s408ms, non-child: 4s843ms, % non-child: 65.38%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 148.596us - GetResultsTime: 1.052ms - HTResizeTime: 1.670ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10711401) - PinTime: 0.000ns - ReductionFactorEstimate: 995472.83 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 12.84K (12844) - RowsReturnedRate: 1.73 K/sec - StreamingTime: 4s632ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 2s565ms, non-child: 2s237ms, % non-child: 87.22%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 696.700us - PeakMemoryUsage: 1.18 MB (1241588) - ProbeRows: 62.91M (62910120) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s155ms - RowsReturned: 62.91M (62910120) - RowsReturnedRate: 24.53 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 39.292us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 73.132us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 50.672us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 12.780us, non-child: 12.780us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.864us - DeserializeRowBatchTimer: 27.440us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 29.03 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 327.888ms, non-child: 327.888ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:3/282.04 MB 3:4/775.20 MB 21:2/268.43 MB 22:4/605.68 MB 16:7/918.89 MB 11:9/1.36 GB 2:3/522.27 MB 14:5/891.83 MB 4:7/304.19 MB 9:4/296.40 MB 17:4/502.65 MB 8:8/1.12 GB 20:11/1.83 GB 13:11/1.26 GB 10:5/892.39 MB 7:7/919.32 MB 1:10/1.17 GB 18:4/775.47 MB 6:8/1.08 GB 23:7/887.75 MB 19:6/770.25 MB 5:7/1.14 GB 15:6/905.87 MB 12:6/737.16 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 21 out of 21 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:127 PARQUET/SNAPPY:42 BytesRead(500.000ms): 0, 94.50 MB, 94.50 MB, 94.50 MB, 94.50 MB, 94.50 MB, 94.50 MB, 121.25 MB, 140.44 MB, 141.23 MB, 141.23 MB, 141.23 MB, 141.23 MB, 141.23 MB, 141.23 MB, 141.23 MB - FooterProcessingTime: (Avg: 5.493ms ; Min: 1.587ms ; Max: 9.824ms ; Number of samples: 21) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 141.23 MB (148087642) - BytesReadDataNodeCache: 0 - BytesReadLocal: 141.23 MB (148087642) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 141.23 MB (148087642) - DecompressionTime: 110.008ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 13 (13) - NumRowGroups: 21 (21) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 145.86 MB (152945836) - PerReadThreadRawHdfsThroughput: 1.41 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.284ms - RowBatchQueuePutWaitTime: 1m3s - RowsRead: 62.92M (62918216) - RowsReturned: 62.91M (62910120) - RowsReturnedRate: 191.86 M/sec - ScanRangesComplete: 148 (148) - ScannerThreadsInvoluntaryContextSwitches: 3.64K (3642) - ScannerThreadsTotalWallClockTime: 1m21s - MaterializeTupleTime(*): 3s819ms - ScannerThreadsSysTime: 6s420ms - ScannerThreadsUserTime: 10s093ms - ScannerThreadsVoluntaryContextSwitches: 311.96K (311962) - TotalRawHdfsReadTime(*): 97.855ms - TotalReadThroughput: 17.65 MB/sec Filter 5 (1.00 MB): - Rows processed: 344.04K (344043) - Rows rejected: 8.10K (8096) - Rows total: 344.06K (344064) Filter 7 (1.00 MB): - Files processed: 148 (148) - Files rejected: 127 (127) - Files total: 148 (148) - RowGroups processed: 61.43K (61432) - RowGroups rejected: 0 (0) - RowGroups total: 61.43K (61432) - Rows processed: 344.04K (344043) - Rows rejected: 0 (0) - Rows total: 344.06K (344064) - Splits processed: 21 (21) - Splits rejected: 0 (0) - Splits total: 21 (21) Instance 594518549f864a64:39 (host=d2405.halxg.cloudera.com:22000):(Total: 583.603ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:5/859.83 MB 18:6/1.12 GB 11:3/658.34 MB 20:7/1.13 GB 8:9/1.23 GB 1:7/1.10 GB 17:6/462.17 MB 0:6/532.07 MB 21:5/789.60 MB 14:8/1.15 GB 7:6/769.29 MB 10:5/788.89 MB 16:6/562.51 MB 6:5/651.40 MB 23:8/934.00 MB 13:4/502.24 MB 15:7/958.63 MB 3:1/253.61 MB 12:8/1.05 GB 9:4/671.83 MB 19:8/1.12 GB 2:7/1.14 GB 5:8/868.73 MB 22:7/818.20 MB Filter 5 arrival: 550ms Filter 7 arrival: 561ms MemoryUsage(500.000ms): 1.33 MB, 162.50 MB, 180.29 MB, 180.23 MB, 180.40 MB, 180.36 MB, 180.33 MB, 180.47 MB, 180.52 MB, 162.67 MB, 161.34 MB, 129.41 MB, 119.01 MB, 95.26 MB, 95.29 MB, 54.46 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.12 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 180.72 MB (189503743) - PerHostPeakMemUsage: 386.37 MB (405137773) - RowsProduced: 15.55K (15548) - TotalCpuTime: 1m47s - TotalNetworkReceiveTime: 2.692us - TotalNetworkSendTime: 3.043ms - TotalStorageWaitTime: 317.708ms Fragment Instance Lifecycle Timings: - ExecTime: 7s190ms - ExecTreeExecTime: 7s177ms - OpenTime: 540.023ms - ExecTreeOpenTime: 18.857ms - PrepareTime: 43.560ms - ExecTreePrepareTime: 24.641ms CodeGen:(Total: 544.571ms, non-child: 544.571ms, % non-child: 100.00%) - CodegenTime: 5.300ms - CompileTime: 158.606ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 359.975ms - PrepareTime: 25.365ms DataStreamSender (dst_id=24):(Total: 5.548ms, non-child: 5.548ms, % non-child: 100.00%) - BytesSent: 340.18 KB (348344) - NetworkThroughput(*): 153.30 MB/sec - OverallThroughput: 59.87 MB/sec - RowsReturned: 15.55K (15548) - SerializeBatchTime: 3.331ms - TransmitDataRPCTime: 2.167ms - UncompressedRowBatchSize: 1.87 MB (1959556) AGGREGATION_NODE (id=11):(Total: 7s200ms, non-child: 4s706ms, % non-child: 65.36%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 151.576us - GetResultsTime: 1.281ms - HTResizeTime: 1.993ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.24 MB (10742237) - PinTime: 0.000ns - ReductionFactorEstimate: 993005.49 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 15.55K (15548) - RowsReturnedRate: 2.16 K/sec - StreamingTime: 4s485ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 2s493ms, non-child: 2s205ms, % non-child: 88.44%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 759.028us - PeakMemoryUsage: 1.19 MB (1250889) - ProbeRows: 63.83M (63828433) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s128ms - RowsReturned: 63.83M (63828433) - RowsReturnedRate: 25.60 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.180us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 82.156us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 48.580us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 12.920us, non-child: 12.920us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.072us - DeserializeRowBatchTimer: 25.860us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 28.72 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 288.235ms, non-child: 288.235ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:5/859.83 MB 18:6/1.12 GB 11:3/658.34 MB 20:7/1.13 GB 8:9/1.23 GB 1:7/1.10 GB 17:6/462.17 MB 0:6/532.07 MB 21:5/789.60 MB 14:8/1.15 GB 7:6/769.29 MB 10:5/788.89 MB 16:6/562.51 MB 6:5/651.40 MB 23:8/934.00 MB 13:4/502.24 MB 15:7/958.63 MB 3:1/253.61 MB 12:8/1.05 GB 9:4/671.83 MB 19:8/1.12 GB 2:7/1.14 GB 5:8/868.73 MB 22:7/818.20 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:122 PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 97.02 MB, 110.40 MB, 110.40 MB, 110.40 MB, 110.40 MB, 110.40 MB, 110.40 MB, 110.40 MB, 136.98 MB, 143.60 MB, 143.60 MB, 143.60 MB, 143.60 MB, 143.60 MB, 143.60 MB - FooterProcessingTime: (Avg: 5.901ms ; Min: 1.128ms ; Max: 9.493ms ; Number of samples: 24) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 143.60 MB (150578009) - BytesReadDataNodeCache: 0 - BytesReadLocal: 143.60 MB (150578009) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 143.60 MB (150578009) - DecompressionTime: 113.293ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 16 (16) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 167.57 MB (175706700) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.959ms - RowBatchQueuePutWaitTime: 1m20s - RowsRead: 63.84M (63837777) - RowsReturned: 63.83M (63828433) - RowsReturnedRate: 221.45 M/sec - ScanRangesComplete: 146 (146) - ScannerThreadsInvoluntaryContextSwitches: 3.96K (3961) - ScannerThreadsTotalWallClockTime: 1m40s - MaterializeTupleTime(*): 3s916ms - ScannerThreadsSysTime: 9s343ms - ScannerThreadsUserTime: 9s024ms - ScannerThreadsVoluntaryContextSwitches: 522.42K (522416) - TotalRawHdfsReadTime(*): 127.145ms - TotalReadThroughput: 17.95 MB/sec Filter 5 (1.00 MB): - Rows processed: 393.19K (393192) - Rows rejected: 9.34K (9344) - Rows total: 393.22K (393216) Filter 7 (1.00 MB): - Files processed: 146 (146) - Files rejected: 122 (122) - Files total: 146 (146) - RowGroups processed: 62.33K (62331) - RowGroups rejected: 0 (0) - RowGroups total: 62.33K (62331) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Instance 594518549f864a64:38 (host=d2410.halxg.cloudera.com:22000):(Total: 583.266ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:6/1.15 GB 1:5/653.07 MB 21:5/756.24 MB 4:10/1.61 GB 17:4/638.58 MB 12:2/370.85 MB 2:2/404.32 MB 16:9/1.50 GB 0:5/619.67 MB 7:5/653.47 MB 15:6/873.61 MB 11:4/741.95 MB 18:3/624.22 MB 19:4/469.42 MB 14:7/919.97 MB 13:6/529.28 MB 10:5/788.88 MB 9:6/940.22 MB 20:2/234.64 MB 3:6/1.02 GB 6:10/1.48 GB 23:8/903.03 MB 22:6/1.02 GB 8:5/1.01 GB Filter 5 arrival: 546ms Filter 7 arrival: 561ms MemoryUsage(500.000ms): 1.33 MB, 155.31 MB, 180.23 MB, 180.49 MB, 180.46 MB, 180.51 MB, 180.34 MB, 180.45 MB, 180.37 MB, 186.77 MB, 210.52 MB, 210.28 MB, 210.28 MB, 210.30 MB, 194.64 MB, 186.62 MB, 186.49 MB, 162.11 MB, 126.97 MB, 126.80 MB, 126.84 MB, 87.19 MB, 77.00 MB, 27.63 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.42 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 210.76 MB (220999838) - PerHostPeakMemUsage: 446.28 MB (467956828) - RowsProduced: 16.90K (16900) - TotalCpuTime: 2m52s - TotalNetworkReceiveTime: 3.828us - TotalNetworkSendTime: 3.509ms - TotalStorageWaitTime: 349.809ms Fragment Instance Lifecycle Timings: - ExecTime: 11s543ms - ExecTreeExecTime: 11s529ms - OpenTime: 538.686ms - ExecTreeOpenTime: 19.340ms - PrepareTime: 44.562ms - ExecTreePrepareTime: 24.005ms CodeGen:(Total: 541.206ms, non-child: 541.206ms, % non-child: 100.00%) - CodegenTime: 5.798ms - CompileTime: 158.724ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 357.564ms - PrepareTime: 24.348ms DataStreamSender (dst_id=24):(Total: 7.058ms, non-child: 7.058ms, % non-child: 100.00%) - BytesSent: 395.03 KB (404510) - NetworkThroughput(*): 145.61 MB/sec - OverallThroughput: 54.66 MB/sec - RowsReturned: 16.90K (16900) - SerializeBatchTime: 4.362ms - TransmitDataRPCTime: 2.649ms - UncompressedRowBatchSize: 2.03 MB (2129932) AGGREGATION_NODE (id=11):(Total: 11s551ms, non-child: 7s600ms, % non-child: 65.80%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 226.616us - GetResultsTime: 1.229ms - HTResizeTime: 2.071ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.26 MB (10762136) - PinTime: 0.000ns - ReductionFactorEstimate: 1006361.60 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 16.90K (16900) - RowsReturnedRate: 1.46 K/sec - StreamingTime: 7s288ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s951ms, non-child: 3s545ms, % non-child: 89.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 917.168us - PeakMemoryUsage: 1.19 MB (1249226) - ProbeRows: 98.93M (98928085) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s427ms - RowsReturned: 98.93M (98928085) - RowsReturnedRate: 25.04 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 41.332us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 66.472us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 37.376us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 15.500us, non-child: 15.500us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.764us - DeserializeRowBatchTimer: 28.404us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 23.94 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 406.036ms, non-child: 406.036ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:6/1.15 GB 1:5/653.07 MB 21:5/756.24 MB 4:10/1.61 GB 17:4/638.58 MB 12:2/370.85 MB 2:2/404.32 MB 16:9/1.50 GB 0:5/619.67 MB 7:5/653.47 MB 15:6/873.61 MB 11:4/741.95 MB 18:3/624.22 MB 19:4/469.42 MB 14:7/919.97 MB 13:6/529.28 MB 10:5/788.88 MB 9:6/940.22 MB 20:2/234.64 MB 3:6/1.02 GB 6:10/1.48 GB 23:8/903.03 MB 22:6/1.02 GB 8:5/1.01 GB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:100 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 85.25 MB, 103.70 MB, 103.70 MB, 103.70 MB, 103.70 MB, 103.70 MB, 103.70 MB, 103.70 MB, 178.92 MB, 203.20 MB, 203.20 MB, 203.20 MB, 203.20 MB, 203.20 MB, 203.20 MB, 203.20 MB, 221.65 MB, 221.65 MB, 221.65 MB, 221.65 MB, 221.65 MB, 221.65 MB, 221.65 MB - FooterProcessingTime: (Avg: 4.484ms ; Min: 1.219ms ; Max: 8.591ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 221.65 MB (232414921) - BytesReadDataNodeCache: 0 - BytesReadLocal: 221.65 MB (232414921) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 221.65 MB (232414921) - DecompressionTime: 172.703ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 20 (20) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 197.60 MB (207198094) - PerReadThreadRawHdfsThroughput: 1.37 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 11.948ms - RowBatchQueuePutWaitTime: 2m8s - RowsRead: 98.94M (98939977) - RowsReturned: 98.93M (98928085) - RowsReturnedRate: 243.64 M/sec - ScanRangesComplete: 131 (131) - ScannerThreadsInvoluntaryContextSwitches: 5.56K (5560) - ScannerThreadsTotalWallClockTime: 2m41s - MaterializeTupleTime(*): 6s009ms - ScannerThreadsSysTime: 17s862ms - ScannerThreadsUserTime: 12s954ms - ScannerThreadsVoluntaryContextSwitches: 751.89K (751888) - TotalRawHdfsReadTime(*): 157.560ms - TotalReadThroughput: 18.47 MB/sec Filter 5 (1.00 MB): - Rows processed: 507.87K (507873) - Rows rejected: 11.89K (11892) - Rows total: 507.90K (507904) Filter 7 (1.00 MB): - Files processed: 131 (131) - Files rejected: 100 (100) - Files total: 131 (131) - RowGroups processed: 96.61K (96607) - RowGroups rejected: 0 (0) - RowGroups total: 96.61K (96607) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Instance 594518549f864a64:37 (host=d2407.halxg.cloudera.com:22000):(Total: 583.049ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/117.61 MB 1:5/995.39 MB 19:3/418.52 MB 12:3/556.42 MB 18:4/639.85 MB 23:6/874.03 MB 21:7/1.13 GB 14:5/652.36 MB 7:6/939.42 MB 22:5/995.49 MB 5:4/774.31 MB 3:7/1.10 GB 20:7/1.00 GB 8:5/483.20 MB 16:5/790.16 MB 4:7/1.10 GB 2:5/995.79 MB 9:6/906.23 MB 11:9/1.40 GB 6:10/1.24 GB 13:8/1.25 GB 0:3/383.82 MB 17:6/769.38 MB 15:5/550.33 MB Filter 5 arrival: 551ms Filter 7 arrival: 565ms MemoryUsage(500.000ms): 1.33 MB, 148.16 MB, 180.52 MB, 180.21 MB, 180.27 MB, 180.38 MB, 180.27 MB, 180.36 MB, 180.46 MB, 195.44 MB, 200.07 MB, 169.53 MB, 169.61 MB, 169.63 MB, 145.54 MB, 125.23 MB, 108.57 MB, 100.49 MB, 60.76 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.26 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 210.45 MB (220671537) - PerHostPeakMemUsage: 427.93 MB (448721364) - RowsProduced: 14.20K (14196) - TotalCpuTime: 2m17s - TotalNetworkReceiveTime: 2.188us - TotalNetworkSendTime: 2.792ms - TotalStorageWaitTime: 317.485ms Fragment Instance Lifecycle Timings: - ExecTime: 9s207ms - ExecTreeExecTime: 9s195ms - OpenTime: 540.028ms - ExecTreeOpenTime: 15.246ms - PrepareTime: 43.003ms - ExecTreePrepareTime: 25.059ms CodeGen:(Total: 548.297ms, non-child: 548.297ms, % non-child: 100.00%) - CodegenTime: 5.436ms - CompileTime: 160.518ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 361.478ms - PrepareTime: 25.667ms DataStreamSender (dst_id=24):(Total: 5.618ms, non-child: 5.618ms, % non-child: 100.00%) - BytesSent: 324.63 KB (332417) - NetworkThroughput(*): 147.99 MB/sec - OverallThroughput: 56.43 MB/sec - RowsReturned: 14.20K (14196) - SerializeBatchTime: 3.419ms - TransmitDataRPCTime: 2.142ms - UncompressedRowBatchSize: 1.71 MB (1789152) AGGREGATION_NODE (id=11):(Total: 9s213ms, non-child: 6s214ms, % non-child: 67.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 150.792us - GetResultsTime: 1.287ms - HTResizeTime: 1.811ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10720922) - PinTime: 0.000ns - ReductionFactorEstimate: 1004434.76 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 14.20K (14196) - RowsReturnedRate: 1.54 K/sec - StreamingTime: 5s990ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 2s999ms, non-child: 2s673ms, % non-child: 89.13%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 746.492us - PeakMemoryUsage: 1.20 MB (1258266) - ProbeRows: 82.18M (82182404) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 2s582ms - RowsReturned: 82.18M (82182404) - RowsReturnedRate: 27.40 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 38.180us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 70.292us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 45.324us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 12.208us, non-child: 12.208us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 7.000us - DeserializeRowBatchTimer: 96.788us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 30.39 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 326.072ms, non-child: 326.072ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/117.61 MB 1:5/995.39 MB 19:3/418.52 MB 12:3/556.42 MB 18:4/639.85 MB 23:6/874.03 MB 21:7/1.13 GB 14:5/652.36 MB 7:6/939.42 MB 22:5/995.49 MB 5:4/774.31 MB 3:7/1.10 GB 20:7/1.00 GB 8:5/483.20 MB 16:5/790.16 MB 4:7/1.10 GB 2:5/995.79 MB 9:6/906.23 MB 11:9/1.40 GB 6:10/1.24 GB 13:8/1.25 GB 0:3/383.82 MB 17:6/769.38 MB 15:5/550.33 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 24 out of 24 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:108 PARQUET/SNAPPY:48 BytesRead(500.000ms): 0, 90.24 MB, 108.69 MB, 108.69 MB, 108.69 MB, 108.69 MB, 108.69 MB, 108.69 MB, 108.69 MB, 171.50 MB, 184.09 MB, 184.09 MB, 184.09 MB, 184.09 MB, 184.09 MB, 184.09 MB, 184.09 MB, 184.09 MB, 184.09 MB - FooterProcessingTime: (Avg: 5.501ms ; Min: 1.423ms ; Max: 8.641ms ; Number of samples: 24) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 184.09 MB (193031270) - BytesReadDataNodeCache: 0 - BytesReadLocal: 184.09 MB (193031270) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 184.09 MB (193031270) - DecompressionTime: 139.308ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 18 (18) - NumRowGroups: 24 (24) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 197.29 MB (206877985) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.472ms - RowBatchQueuePutWaitTime: 1m36s - RowsRead: 82.19M (82191643) - RowsReturned: 82.18M (82182404) - RowsReturnedRate: 252.04 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 5.30K (5298) - ScannerThreadsTotalWallClockTime: 2m8s - MaterializeTupleTime(*): 4s670ms - ScannerThreadsSysTime: 17s003ms - ScannerThreadsUserTime: 12s919ms - ScannerThreadsVoluntaryContextSwitches: 835.91K (835910) - TotalRawHdfsReadTime(*): 141.840ms - TotalReadThroughput: 19.38 MB/sec Filter 5 (1.00 MB): - Rows processed: 393.19K (393192) - Rows rejected: 9.24K (9239) - Rows total: 393.22K (393216) Filter 7 (1.00 MB): - Files processed: 132 (132) - Files rejected: 108 (108) - Files total: 132 (132) - RowGroups processed: 80.25K (80254) - RowGroups rejected: 0 (0) - RowGroups total: 80.25K (80254) - Rows processed: 393.19K (393192) - Rows rejected: 0 (0) - Rows total: 393.22K (393216) - Splits processed: 24 (24) - Splits rejected: 0 (0) - Splits total: 24 (24) Instance 594518549f864a64:3c (host=d2417.halxg.cloudera.com:22000):(Total: 582.260ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/269.30 MB 23:7/1.37 GB 4:3/352.33 MB 21:4/775.20 MB 9:9/1.16 GB 22:1/117.63 MB 11:9/1.16 GB 15:9/1.50 GB 13:5/515.62 MB 6:6/802.90 MB 14:6/737.62 MB 10:8/936.33 MB 16:4/878.34 MB 20:4/367.32 MB 3:6/1.12 GB 1:5/789.06 MB 18:5/653.12 MB 2:6/802.13 MB 19:6/1.15 GB 5:5/619.63 MB 12:5/447.06 MB 0:9/1.13 GB 17:9/1.36 GB 7:7/992.58 MB Filter 5 arrival: 517ms Filter 7 arrival: 559ms MemoryUsage(500.000ms): 1.33 MB, 171.21 MB, 185.96 MB, 185.99 MB, 185.77 MB, 185.88 MB, 185.73 MB, 185.88 MB, 185.91 MB, 198.40 MB, 198.37 MB, 195.70 MB, 195.44 MB, 204.53 MB, 180.55 MB, 172.61 MB, 172.68 MB, 169.82 MB, 156.63 MB, 114.82 MB, 104.65 MB, 88.78 MB, 44.04 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.39 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 204.74 MB (214688298) - PerHostPeakMemUsage: 422.28 MB (442794776) - RowsProduced: 18.25K (18252) - TotalCpuTime: 2m49s - TotalNetworkReceiveTime: 3.206us - TotalNetworkSendTime: 3.042ms - TotalStorageWaitTime: 393.392ms Fragment Instance Lifecycle Timings: - ExecTime: 11s305ms - ExecTreeExecTime: 11s291ms - OpenTime: 538.775ms - ExecTreeOpenTime: 19.580ms - PrepareTime: 43.468ms - ExecTreePrepareTime: 24.439ms CodeGen:(Total: 541.757ms, non-child: 541.757ms, % non-child: 100.00%) - CodegenTime: 4.706ms - CompileTime: 155.968ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 360.817ms - PrepareTime: 24.377ms DataStreamSender (dst_id=24):(Total: 7.367ms, non-child: 7.367ms, % non-child: 100.00%) - BytesSent: 424.62 KB (434808) - NetworkThroughput(*): 148.63 MB/sec - OverallThroughput: 56.28 MB/sec - RowsReturned: 18.25K (18252) - SerializeBatchTime: 4.525ms - TransmitDataRPCTime: 2.789ms - UncompressedRowBatchSize: 2.19 MB (2300344) AGGREGATION_NODE (id=11):(Total: 11s314ms, non-child: 7s634ms, % non-child: 67.48%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 218.430us - GetResultsTime: 1.476ms - HTResizeTime: 2.078ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.22 MB (10713856) - PinTime: 0.000ns - ReductionFactorEstimate: 1011122.79 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 18.25K (18252) - RowsReturnedRate: 1.61 K/sec - StreamingTime: 7s323ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 3s679ms, non-child: 3s271ms, % non-child: 88.91%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 684.578us - PeakMemoryUsage: 1.20 MB (1257334) - ProbeRows: 100.26M (100258578) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s166ms - RowsReturned: 100.26M (100258578) - RowsReturnedRate: 27.25 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.146us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 58.606us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.508us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 13.200us, non-child: 13.200us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.774us - DeserializeRowBatchTimer: 28.666us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 28.11 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 408.081ms, non-child: 408.081ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/269.30 MB 23:7/1.37 GB 4:3/352.33 MB 21:4/775.20 MB 9:9/1.16 GB 22:1/117.63 MB 11:9/1.16 GB 15:9/1.50 GB 13:5/515.62 MB 6:6/802.90 MB 14:6/737.62 MB 10:8/936.33 MB 16:4/878.34 MB 20:4/367.32 MB 3:6/1.12 GB 1:5/789.06 MB 18:5/653.12 MB 2:6/802.13 MB 19:6/1.15 GB 5:5/619.63 MB 12:5/447.06 MB 0:9/1.13 GB 17:9/1.36 GB 7:7/992.58 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 33 out of 33 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:107 PARQUET/SNAPPY:66 BytesRead(500.000ms): 0, 102.25 MB, 114.85 MB, 114.85 MB, 114.85 MB, 114.85 MB, 114.85 MB, 114.85 MB, 114.85 MB, 172.68 MB, 172.68 MB, 191.87 MB, 192.67 MB, 198.52 MB, 198.52 MB, 198.52 MB, 198.52 MB, 217.72 MB, 225.10 MB, 225.10 MB, 225.10 MB, 225.10 MB, 225.10 MB - FooterProcessingTime: (Avg: 4.643ms ; Min: 1.105ms ; Max: 9.077ms ; Number of samples: 33) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 225.10 MB (236034528) - BytesReadDataNodeCache: 0 - BytesReadLocal: 225.10 MB (236034528) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 225.10 MB (236034528) - DecompressionTime: 175.239ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 20 (20) - NumRowGroups: 33 (33) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 191.58 MB (200886554) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.542ms - RowBatchQueuePutWaitTime: 2m11s - RowsRead: 100.27M (100271247) - RowsReturned: 100.26M (100258578) - RowsReturnedRate: 245.68 M/sec - ScanRangesComplete: 140 (140) - ScannerThreadsInvoluntaryContextSwitches: 5.27K (5266) - ScannerThreadsTotalWallClockTime: 2m37s - MaterializeTupleTime(*): 5s809ms - ScannerThreadsSysTime: 14s910ms - ScannerThreadsUserTime: 10s854ms - ScannerThreadsVoluntaryContextSwitches: 597.07K (597069) - TotalRawHdfsReadTime(*): 177.807ms - TotalReadThroughput: 19.57 MB/sec Filter 5 (1.00 MB): - Rows processed: 540.64K (540639) - Rows rejected: 12.67K (12669) - Rows total: 540.67K (540672) Filter 7 (1.00 MB): - Files processed: 140 (140) - Files rejected: 107 (107) - Files total: 140 (140) - RowGroups processed: 97.91K (97906) - RowGroups rejected: 0 (0) - RowGroups total: 97.91K (97906) - Rows processed: 540.64K (540639) - Rows rejected: 0 (0) - Rows total: 540.67K (540672) - Splits processed: 33 (33) - Splits rejected: 0 (0) - Splits total: 33 (33) Instance 594518549f864a64:3d (host=d2419.halxg.cloudera.com:22000):(Total: 577.266ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 23:1/253.64 MB 18:6/1.09 GB 15:4/742.83 MB 4:8/1.48 GB 8:8/1.41 GB 13:5/686.88 MB 21:6/633.99 MB 12:6/906.04 MB 0:10/1.88 GB 17:5/756.29 MB 9:4/535.56 MB 14:2/131.35 MB 19:6/939.14 MB 2:8/1.11 GB 10:5/723.63 MB 6:4/638.81 MB 16:6/771.37 MB 1:10/1.38 GB 3:5/653.90 MB 20:5/620.07 MB 5:8/1.11 GB 22:5/789.31 MB 11:7/816.70 MB Filter 5 arrival: 524ms Filter 7 arrival: 557ms MemoryUsage(500.000ms): 1.33 MB, 186.03 MB, 204.35 MB, 204.48 MB, 204.44 MB, 204.45 MB, 204.44 MB, 204.37 MB, 204.39 MB, 153.34 MB, 132.89 MB, 132.78 MB, 132.88 MB, 77.33 MB, 60.86 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.07 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 204.94 MB (214891536) - PerHostPeakMemUsage: 422.26 MB (442774864) - RowsProduced: 10.14K (10140) - TotalCpuTime: 1m40s - TotalNetworkReceiveTime: 3.298us - TotalNetworkSendTime: 3.340ms - TotalStorageWaitTime: 272.322ms Fragment Instance Lifecycle Timings: - ExecTime: 6s692ms - ExecTreeExecTime: 6s682ms - OpenTime: 534.945ms - ExecTreeOpenTime: 17.347ms - PrepareTime: 42.301ms - ExecTreePrepareTime: 24.930ms CodeGen:(Total: 540.731ms, non-child: 540.731ms, % non-child: 100.00%) - CodegenTime: 4.816ms - CompileTime: 156.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 359.320ms - PrepareTime: 24.821ms DataStreamSender (dst_id=24):(Total: 4.019ms, non-child: 4.019ms, % non-child: 100.00%) - BytesSent: 217.24 KB (222451) - NetworkThroughput(*): 118.17 MB/sec - OverallThroughput: 52.77 MB/sec - RowsReturned: 10.14K (10140) - SerializeBatchTime: 2.177ms - TransmitDataRPCTime: 1.795ms - UncompressedRowBatchSize: 1.22 MB (1277972) AGGREGATION_NODE (id=11):(Total: 6s703ms, non-child: 4s581ms, % non-child: 68.35%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 187.968us - GetResultsTime: 797.778us - HTResizeTime: 1.524ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.33 MB (10836928) - PinTime: 0.000ns - ReductionFactorEstimate: 1011328.77 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 10.14K (10140) - RowsReturnedRate: 1.51 K/sec - StreamingTime: 4s386ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 2s121ms, non-child: 1s876ms, % non-child: 88.46%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 832.114us - PeakMemoryUsage: 1.19 MB (1244475) - ProbeRows: 58.37M (58369582) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 1s815ms - RowsReturned: 58.37M (58369582) - RowsReturnedRate: 27.51 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 36.680us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 70.362us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 46.576us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 13.922us, non-child: 13.922us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.976us - DeserializeRowBatchTimer: 26.544us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 26.65 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 244.860ms, non-child: 244.860ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 23:1/253.64 MB 18:6/1.09 GB 15:4/742.83 MB 4:8/1.48 GB 8:8/1.41 GB 13:5/686.88 MB 21:6/633.99 MB 12:6/906.04 MB 0:10/1.88 GB 17:5/756.29 MB 9:4/535.56 MB 14:2/131.35 MB 19:6/939.14 MB 2:8/1.11 GB 10:5/723.63 MB 6:4/638.81 MB 16:6/771.37 MB 1:10/1.38 GB 3:5/653.90 MB 20:5/620.07 MB 5:8/1.11 GB 22:5/789.31 MB 11:7/816.70 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:118 PARQUET/SNAPPY:32 BytesRead(500.000ms): 0, 118.94 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB, 130.65 MB - FooterProcessingTime: (Avg: 8.074ms ; Min: 1.595ms ; Max: 10.159ms ; Number of samples: 16) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 130.65 MB (136999191) - BytesReadDataNodeCache: 0 - BytesReadLocal: 130.65 MB (136999191) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 130.65 MB (136999191) - DecompressionTime: 102.152ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 12 (12) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 191.77 MB (201089792) - PerReadThreadRawHdfsThroughput: 1.35 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 13.303ms - RowBatchQueuePutWaitTime: 1m11s - RowsRead: 58.38M (58375684) - RowsReturned: 58.37M (58369582) - RowsReturnedRate: 238.38 M/sec - ScanRangesComplete: 134 (134) - ScannerThreadsInvoluntaryContextSwitches: 3.96K (3960) - ScannerThreadsTotalWallClockTime: 1m33s - MaterializeTupleTime(*): 3s450ms - ScannerThreadsSysTime: 12s449ms - ScannerThreadsUserTime: 8s520ms - ScannerThreadsVoluntaryContextSwitches: 661.63K (661626) - TotalRawHdfsReadTime(*): 94.456ms - TotalReadThroughput: 17.42 MB/sec Filter 5 (1.00 MB): - Rows processed: 262.13K (262128) - Rows rejected: 6.10K (6102) - Rows total: 262.14K (262144) Filter 7 (1.00 MB): - Files processed: 134 (134) - Files rejected: 118 (118) - Files total: 134 (134) - RowGroups processed: 57.00K (57000) - RowGroups rejected: 0 (0) - RowGroups total: 57.00K (57000) - Rows processed: 262.13K (262128) - Rows rejected: 0 (0) - Rows total: 262.14K (262144) - Splits processed: 16 (16) - Splits rejected: 0 (0) - Splits total: 16 (16) Instance 594518549f864a64:3b (host=d2416.halxg.cloudera.com:22000):(Total: 576.562ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 11:2/370.96 MB 20:6/873.33 MB 5:5/790.24 MB 22:6/1.02 GB 12:3/385.11 MB 15:6/939.95 MB 2:5/755.49 MB 14:6/836.89 MB 7:5/790.96 MB 13:5/788.42 MB 10:9/1.60 GB 9:8/1.48 GB 21:6/531.62 MB 4:8/1004.49 MB 1:5/789.98 MB 18:2/371.13 MB 16:5/1.00 GB 23:3/521.78 MB 6:8/1.15 GB 19:8/1.22 GB 8:3/385.21 MB 3:8/1.22 GB 17:5/621.18 MB 0:5/756.67 MB Filter 5 arrival: 547ms Filter 7 arrival: 558ms MemoryUsage(500.000ms): 1.33 MB, 175.87 MB, 216.46 MB, 216.37 MB, 216.54 MB, 216.48 MB, 216.58 MB, 216.51 MB, 216.37 MB, 216.36 MB, 216.08 MB, 222.28 MB, 228.32 MB, 228.35 MB, 172.84 MB, 156.91 MB, 156.99 MB, 157.06 MB, 166.30 MB, 149.82 MB, 129.44 MB, 119.04 MB, 119.14 MB, 111.11 MB, 62.31 MB, 27.66 MB ThreadUsage(500.000ms): 1, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15, 15 - AverageThreadTokens: 14.46 - BloomFilterBytes: 2.00 MB (2097152) - PeakMemoryUsage: 228.72 MB (239831984) - PerHostPeakMemUsage: 452.30 MB (474274611) - RowsProduced: 14.20K (14196) - TotalCpuTime: 3m7s - TotalNetworkReceiveTime: 2.684us - TotalNetworkSendTime: 3.128ms - TotalStorageWaitTime: 335.138ms Fragment Instance Lifecycle Timings: - ExecTime: 12s486ms - ExecTreeExecTime: 12s474ms - OpenTime: 534.629ms - ExecTreeOpenTime: 15.928ms - PrepareTime: 41.915ms - ExecTreePrepareTime: 23.802ms CodeGen:(Total: 540.966ms, non-child: 540.966ms, % non-child: 100.00%) - CodegenTime: 4.726ms - CompileTime: 157.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 141 (141) - NumInstructions: 4.40K (4399) - OptimizationTime: 359.049ms - PrepareTime: 23.838ms DataStreamSender (dst_id=24):(Total: 5.443ms, non-child: 5.443ms, % non-child: 100.00%) - BytesSent: 351.80 KB (360244) - NetworkThroughput(*): 167.48 MB/sec - OverallThroughput: 63.12 MB/sec - RowsReturned: 14.20K (14196) - SerializeBatchTime: 3.348ms - TransmitDataRPCTime: 2.051ms - UncompressedRowBatchSize: 1.71 MB (1789156) AGGREGATION_NODE (id=11):(Total: 12s493ms, non-child: 8s177ms, % non-child: 65.45%) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 150.392us - GetResultsTime: 1.105ms - HTResizeTime: 1.249ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 10.27 MB (10763862) - PinTime: 0.000ns - ReductionFactorEstimate: 1026191.26 - ReductionFactorThresholdToExpand: 1.10 - RowsPassedThrough: 0 (0) - RowsReturned: 14.20K (14196) - RowsReturnedRate: 1.14 K/sec - StreamingTime: 7s825ms - UnpinTime: 0.000ns HASH_JOIN_NODE (id=10):(Total: 4s316ms, non-child: 3s794ms, % non-child: 87.90%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 371 (371) - BuildTime: 677.008us - PeakMemoryUsage: 1.18 MB (1238607) - ProbeRows: 108.71M (108713985) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s673ms - RowsReturned: 108.71M (108713985) - RowsReturnedRate: 25.19 M/sec Hash Join Builder (join_node_id=10): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 37.908us - BuildRowsPartitioned: 371 (371) - GetNewBlockTime: 69.200us - HashBuckets: 1.02K (1024) - HashCollisions: 0 (0) - HashTablesBuildTime: 47.992us - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=23):(Total: 14.032us, non-child: 14.032us, % non-child: 100.00%) BytesReceived(500.000ms): 0, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB, 9.03 KB - BytesReceived: 9.03 KB (9242) - ConvertRowBatchTime: 6.760us - DeserializeRowBatchTimer: 30.232us - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 371 (371) - RowsReturnedRate: 26.44 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=8):(Total: 522.053ms, non-child: 522.053ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 11:2/370.96 MB 20:6/873.33 MB 5:5/790.24 MB 22:6/1.02 GB 12:3/385.11 MB 15:6/939.95 MB 2:5/755.49 MB 14:6/836.89 MB 7:5/790.96 MB 13:5/788.42 MB 10:9/1.60 GB 9:8/1.48 GB 21:6/531.62 MB 4:8/1004.49 MB 1:5/789.98 MB 18:2/371.13 MB 16:5/1.00 GB 23:3/521.78 MB 6:8/1.15 GB 19:8/1.22 GB 8:3/385.21 MB 3:8/1.22 GB 17:5/621.18 MB 0:5/756.67 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 31 out of 31 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/NONE:101 PARQUET/SNAPPY:62 BytesRead(500.000ms): 0, 127.25 MB, 152.30 MB, 152.30 MB, 152.30 MB, 152.30 MB, 152.30 MB, 152.30 MB, 152.30 MB, 159.83 MB, 167.38 MB, 187.49 MB, 200.08 MB, 200.08 MB, 200.08 MB, 200.08 MB, 200.08 MB, 200.08 MB, 243.65 MB, 243.65 MB, 243.65 MB, 243.65 MB, 243.65 MB, 243.65 MB, 243.65 MB, 243.65 MB - FooterProcessingTime: (Avg: 4.265ms ; Min: 1.285ms ; Max: 7.944ms ; Number of samples: 31) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 14.00 - BytesRead: 243.65 MB (255480345) - BytesReadDataNodeCache: 0 - BytesReadLocal: 243.65 MB (255480345) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 243.65 MB (255480345) - DecompressionTime: 188.529ms - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 19 (19) - NumRowGroups: 31 (31) - NumScannerThreadsStarted: 14 (14) - PeakMemoryUsage: 215.56 MB (226030240) - PerReadThreadRawHdfsThroughput: 1.52 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.586ms - RowBatchQueuePutWaitTime: 2m24s - RowsRead: 108.73M (108725874) - RowsReturned: 108.71M (108713985) - RowsReturnedRate: 208.24 M/sec - ScanRangesComplete: 132 (132) - ScannerThreadsInvoluntaryContextSwitches: 450 (450) - ScannerThreadsTotalWallClockTime: 2m54s - MaterializeTupleTime(*): 6s599ms - ScannerThreadsSysTime: 15s754ms - ScannerThreadsUserTime: 13s662ms - ScannerThreadsVoluntaryContextSwitches: 769.64K (769637) - TotalRawHdfsReadTime(*): 156.117ms - TotalReadThroughput: 18.74 MB/sec Filter 5 (1.00 MB): - Rows processed: 507.87K (507873) - Rows rejected: 11.89K (11889) - Rows total: 507.90K (507904) Filter 7 (1.00 MB): - Files processed: 132 (132) - Files rejected: 101 (101) - Files total: 132 (132) - RowGroups processed: 106.16K (106159) - RowGroups rejected: 0 (0) - RowGroups total: 106.16K (106159) - Rows processed: 507.87K (507873) - Rows rejected: 0 (0) - Rows total: 507.90K (507904) - Splits processed: 31 (31) - Splits rejected: 0 (0) - Splits total: 31 (31) Averaged Fragment F06:(Total: 48.779ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:571.200ms max:571.200ms mean: 571.200ms stddev:0.000ns execution rates: min:3.76 MB/sec max:3.76 MB/sec mean:3.76 MB/sec stddev:0.27 B/sec num instances: 1 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 4.15 MB (4351852) - PerHostPeakMemUsage: 18.21 MB (19096676) - RowsProduced: 371 (371) - TotalCpuTime: 1s029ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.196us - TotalStorageWaitTime: 4.224ms Fragment Instance Lifecycle Timings: - ExecTime: 518.026ms - ExecTreeExecTime: 514.062ms - OpenTime: 18.257ms - ExecTreeOpenTime: 54.236us - PrepareTime: 30.502ms - ExecTreePrepareTime: 22.304ms CodeGen:(Total: 40.571ms, non-child: 40.571ms, % non-child: 100.00%) - CodegenTime: 809.080us - CompileTime: 5.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 8 (8) - NumInstructions: 142 (142) - OptimizationTime: 11.493ms - PrepareTime: 23.217ms DataStreamSender (dst_id=23):(Total: 344.876us, non-child: 344.876us, % non-child: 100.00%) - BytesSent: 171.48 KB (175598) - NetworkThroughput(*): 770.13 MB/sec - OverallThroughput: 485.58 MB/sec - RowsReturned: 371 (371) - SerializeBatchTime: 91.176us - TransmitDataRPCTime: 217.448us - UncompressedRowBatchSize: 248.87 KB (254847) HDFS_SCAN_NODE (id=9):(Total: 514.302ms, non-child: 514.302ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 586.52 KB (600601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 586.52 KB (600601) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 586.52 KB (600601) - DecompressionTime: 290.096us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.05 MB (3195524) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.230ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 371 (371) - RowsReturnedRate: 721.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 466.855ms - MaterializeTupleTime(*): 6.742ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 530.384us - TotalReadThroughput: 0.00 /sec Filter 6 (1.00 MB): - Rows processed: 73.05K (73049) - Rows rejected: 72.68K (72678) - Rows total: 73.05K (73049) Fragment F06: Instance 594518549f864a64:2a (host=d2403.halxg.cloudera.com:22000):(Total: 48.779ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB Filter 6 arrival: 549ms MemoryUsage(500.000ms): 105.23 KB ThreadUsage(500.000ms): 2 - AverageThreadTokens: 2.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 4.15 MB (4351852) - PerHostPeakMemUsage: 18.21 MB (19096676) - RowsProduced: 371 (371) - TotalCpuTime: 1s029ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 10.196us - TotalStorageWaitTime: 4.224ms Fragment Instance Lifecycle Timings: - ExecTime: 518.026ms - ExecTreeExecTime: 514.062ms - OpenTime: 18.257ms - ExecTreeOpenTime: 54.236us - PrepareTime: 30.502ms - ExecTreePrepareTime: 22.304ms CodeGen:(Total: 40.571ms, non-child: 40.571ms, % non-child: 100.00%) - CodegenTime: 809.080us - CompileTime: 5.290ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 8 (8) - NumInstructions: 142 (142) - OptimizationTime: 11.493ms - PrepareTime: 23.217ms DataStreamSender (dst_id=23):(Total: 344.876us, non-child: 344.876us, % non-child: 100.00%) - BytesSent: 171.48 KB (175598) - NetworkThroughput(*): 770.13 MB/sec - OverallThroughput: 485.58 MB/sec - RowsReturned: 371 (371) - SerializeBatchTime: 91.176us - TransmitDataRPCTime: 217.448us - UncompressedRowBatchSize: 248.87 KB (254847) HDFS_SCAN_NODE (id=9):(Total: 514.302ms, non-child: 514.302ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Runtime filters: All filters arrived. Waited 501ms Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:3 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 1.466ms ; Min: 1.466ms ; Max: 1.466ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 586.52 KB (600601) - BytesReadDataNodeCache: 0 - BytesReadLocal: 586.52 KB (600601) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 586.52 KB (600601) - DecompressionTime: 290.096us - MaxCompressedTextFileLength: 0 - NumColumns: 3 (3) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 3.05 MB (3195524) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 12.230ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 371 (371) - RowsReturnedRate: 721.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 466.855ms - MaterializeTupleTime(*): 6.742ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 7.998ms - ScannerThreadsVoluntaryContextSwitches: 28 (28) - TotalRawHdfsReadTime(*): 530.384us - TotalReadThroughput: 0.00 /sec Filter 6 (1.00 MB): - Rows processed: 73.05K (73049) - Rows rejected: 72.68K (72678) - Rows total: 73.05K (73049) Averaged Fragment F08:(Total: 78.709ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 2.15 MB, max: 2.15 MB, avg: 2.15 MB, stddev: 0 completion times: min:94.204ms max:94.204ms mean: 94.204ms stddev:0.000ns execution rates: min:22.82 MB/sec max:22.82 MB/sec mean:22.82 MB/sec stddev:0.04 B/sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.34 MB (1406090) - PerHostPeakMemUsage: 9.48 MB (9935288) - RowsProduced: 366 (366) - TotalCpuTime: 96.916ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.736us - TotalStorageWaitTime: 7.668ms Fragment Instance Lifecycle Timings: - ExecTime: 14.929ms - ExecTreeExecTime: 12.005ms - OpenTime: 47.177ms - ExecTreeOpenTime: 53.524us - PrepareTime: 31.516ms - ExecTreePrepareTime: 23.839ms CodeGen:(Total: 69.457ms, non-child: 69.457ms, % non-child: 100.00%) - CodegenTime: 635.860us - CompileTime: 9.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 23 (23) - NumInstructions: 373 (373) - OptimizationTime: 35.652ms - PrepareTime: 23.502ms DataStreamSender (dst_id=26):(Total: 957.204us, non-child: 957.204us, % non-child: 100.00%) - BytesSent: 36.70 KB (37582) - NetworkThroughput(*): 43.51 MB/sec - OverallThroughput: 37.44 MB/sec - RowsReturned: 366 (366) - SerializeBatchTime: 22.516us - TransmitDataRPCTime: 823.732us - UncompressedRowBatchSize: 88.36 KB (90478) HDFS_SCAN_NODE (id=13):(Total: 16.883ms, non-child: 16.883ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 237.85 KB (243555) - BytesReadDataNodeCache: 0 - BytesReadLocal: 237.85 KB (243555) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 237.85 KB (243555) - DecompressionTime: 253.624us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.07 MB (1121258) - PerReadThreadRawHdfsThroughput: 416.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.746ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 21.68 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 10.830ms - MaterializeTupleTime(*): 2.397ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 557.376us - TotalReadThroughput: 0.00 /sec Fragment F08: Instance 594518549f864a64:3e (host=d2403.halxg.cloudera.com:22000):(Total: 78.709ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.34 MB (1406090) - PerHostPeakMemUsage: 9.48 MB (9935288) - RowsProduced: 366 (366) - TotalCpuTime: 96.916ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9.736us - TotalStorageWaitTime: 7.668ms Fragment Instance Lifecycle Timings: - ExecTime: 14.929ms - ExecTreeExecTime: 12.005ms - OpenTime: 47.177ms - ExecTreeOpenTime: 53.524us - PrepareTime: 31.516ms - ExecTreePrepareTime: 23.839ms CodeGen:(Total: 69.457ms, non-child: 69.457ms, % non-child: 100.00%) - CodegenTime: 635.860us - CompileTime: 9.750ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 23 (23) - NumInstructions: 373 (373) - OptimizationTime: 35.652ms - PrepareTime: 23.502ms DataStreamSender (dst_id=26):(Total: 957.204us, non-child: 957.204us, % non-child: 100.00%) - BytesSent: 36.70 KB (37582) - NetworkThroughput(*): 43.51 MB/sec - OverallThroughput: 37.44 MB/sec - RowsReturned: 366 (366) - SerializeBatchTime: 22.516us - TransmitDataRPCTime: 823.732us - UncompressedRowBatchSize: 88.36 KB (90478) HDFS_SCAN_NODE (id=13):(Total: 16.883ms, non-child: 16.883ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 19:1/2.15 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 5.789ms ; Min: 5.789ms ; Max: 5.789ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 237.85 KB (243555) - BytesReadDataNodeCache: 0 - BytesReadLocal: 237.85 KB (243555) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 237.85 KB (243555) - DecompressionTime: 253.624us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 1.07 MB (1121258) - PerReadThreadRawHdfsThroughput: 416.72 MB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 10.746ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 73.05K (73049) - RowsReturned: 366 (366) - RowsReturnedRate: 21.68 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 10.830ms - MaterializeTupleTime(*): 2.397ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 1.999ms - ScannerThreadsVoluntaryContextSwitches: 7 (7) - TotalRawHdfsReadTime(*): 557.376us - TotalReadThroughput: 0.00 /sec Averaged Fragment F09:(Total: 44.687ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 115.36 KB, max: 115.36 KB, avg: 115.36 KB, stddev: 0 completion times: min:65.445ms max:65.445ms mean: 65.445ms stddev:0.000ns execution rates: min:1.72 MB/sec max:1.72 MB/sec mean:1.72 MB/sec stddev:0.47 B/sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 259.78 KB (266016) - PerHostPeakMemUsage: 7.92 MB (8309378) - RowsProduced: 1.35K (1350) - TotalCpuTime: 64.743ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 680.520us - TotalStorageWaitTime: 13.915ms Fragment Instance Lifecycle Timings: - ExecTime: 20.024ms - ExecTreeExecTime: 15.059ms - OpenTime: 19.281ms - ExecTreeOpenTime: 42.184us - PrepareTime: 25.371ms - ExecTreePrepareTime: 21.462ms CodeGen:(Total: 40.489ms, non-child: 40.489ms, % non-child: 100.00%) - CodegenTime: 579.680us - CompileTime: 5.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 8 (8) - NumInstructions: 142 (142) - OptimizationTime: 12.167ms - PrepareTime: 21.812ms DataStreamSender (dst_id=27):(Total: 774.680us, non-child: 774.680us, % non-child: 100.00%) - BytesSent: 384.53 KB (393756) - NetworkThroughput(*): 741.13 MB/sec - OverallThroughput: 484.74 MB/sec - RowsReturned: 1.35K (1350) - SerializeBatchTime: 235.236us - TransmitDataRPCTime: 506.676us - UncompressedRowBatchSize: 1.00 MB (1051802) HDFS_SCAN_NODE (id=12):(Total: 15.294ms, non-child: 15.294ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 112.27 KB (114964) - BytesReadDataNodeCache: 0 - BytesReadLocal: 112.27 KB (114964) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 112.27 KB (114964) - DecompressionTime: 2.308us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 136.00 KB (139264) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.408ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.35K (1350) - RowsReturned: 1.35K (1350) - RowsReturnedRate: 88.27 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 14.513ms - MaterializeTupleTime(*): 112.232us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 56.848us - TotalReadThroughput: 0.00 /sec Fragment F09: Instance 594518549f864a64:3f (host=d2421.halxg.cloudera.com:22000):(Total: 44.687ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 21:1/115.36 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 259.78 KB (266016) - PerHostPeakMemUsage: 7.92 MB (8309378) - RowsProduced: 1.35K (1350) - TotalCpuTime: 64.743ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 680.520us - TotalStorageWaitTime: 13.915ms Fragment Instance Lifecycle Timings: - ExecTime: 20.024ms - ExecTreeExecTime: 15.059ms - OpenTime: 19.281ms - ExecTreeOpenTime: 42.184us - PrepareTime: 25.371ms - ExecTreePrepareTime: 21.462ms CodeGen:(Total: 40.489ms, non-child: 40.489ms, % non-child: 100.00%) - CodegenTime: 579.680us - CompileTime: 5.922ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1995112) - NumFunctions: 8 (8) - NumInstructions: 142 (142) - OptimizationTime: 12.167ms - PrepareTime: 21.812ms DataStreamSender (dst_id=27):(Total: 774.680us, non-child: 774.680us, % non-child: 100.00%) - BytesSent: 384.53 KB (393756) - NetworkThroughput(*): 741.13 MB/sec - OverallThroughput: 484.74 MB/sec - RowsReturned: 1.35K (1350) - SerializeBatchTime: 235.236us - TransmitDataRPCTime: 506.676us - UncompressedRowBatchSize: 1.00 MB (1051802) HDFS_SCAN_NODE (id=12):(Total: 15.294ms, non-child: 15.294ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 21:1/115.36 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% 19:0% 20:0% 21:0% 22:0% 23:0% 24:0% 25:0% 26:0% 27:0% File Formats: PARQUET/SNAPPY:2 - FooterProcessingTime: (Avg: 12.793ms ; Min: 12.793ms ; Max: 12.793ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 112.27 KB (114964) - BytesReadDataNodeCache: 0 - BytesReadLocal: 112.27 KB (114964) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 112.27 KB (114964) - DecompressionTime: 2.308us - MaxCompressedTextFileLength: 0 - NumColumns: 2 (2) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 136.00 KB (139264) - PerReadThreadRawHdfsThroughput: 1.88 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 14.408ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.35K (1350) - RowsReturned: 1.35K (1350) - RowsReturnedRate: 88.27 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 14.513ms - MaterializeTupleTime(*): 112.232us - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 56.848us - TotalReadThroughput: 0.00 /sec