[?1034h+------------------+---------+-------------------+-------------------+-------------------+-------------------+ | i_item_id | s_state | agg1 | agg2 | agg3 | agg4 | +------------------+---------+-------------------+-------------------+-------------------+-------------------+ | AAAAAAAAAAABAAAA | TN | 51.9163179916318 | 76.15309636961965 | 144.0478894821199 | 38.5221009907477 | | AAAAAAAAAAACAAAA | TN | 51.48780487804878 | 74.11991907613962 | 233.2631152182938 | 39.09477550314397 | | AAAAAAAAAAAEAAAA | TN | 50.70281124497992 | 79.9272692581736 | 192.685766439284 | 37.92995970852433 | | AAAAAAAAAAAFAAAA | TN | 50.51612903225806 | 81.46803566132273 | 180.1322501029287 | 37.92725001978022 | | AAAAAAAAAAAHAAAA | TN | 52.3794466403162 | 78.14873012285383 | 220.932054844534 | 38.63760975632535 | | AAAAAAAAAABAAAAA | TN | 51.0156862745098 | 79.58279533226658 | 161.2380723493306 | 39.74862207871253 | | AAAAAAAAAABBAAAA | TN | 47.79166666666666 | 77.35879157235225 | 177.3218678854313 | 37.20528911315828 | | AAAAAAAAAABDAAAA | TN | 49.875 | 73.13100013775485 | 103.564749777317 | 35.50616488522954 | | AAAAAAAAAABEAAAA | TN | 51 | 72.23183691015049 | 231.1246140587087 | 35.19853067464975 | | AAAAAAAAAABGAAAA | TN | 50.24163568773234 | 75.88755564159817 | 159.984185858126 | 38.25711109076661 | | AAAAAAAAAABHAAAA | TN | 51.71102661596958 | 77.51916031300567 | 237.8339840708108 | 38.69613636702751 | | AAAAAAAAAACAAAAA | TN | 51.08203125 | 77.38831369596369 | 230.6561333835125 | 39.53197667597569 | | AAAAAAAAAACCAAAA | TN | 81.66439657903072 | 105.6349781960669 | 5511.740798357774 | 80.50872564264111 | | AAAAAAAAAACDAAAA | TN | 50.93280632411067 | 77.44087314747628 | 188.0150420069695 | 37.68257931803191 | | AAAAAAAAAACFAAAA | TN | 32.74651457541191 | 141.2703092318414 | 2695.047003188212 | 90.02090508850345 | | AAAAAAAAAACGAAAA | TN | 50.65037593984962 | 73.65188000614482 | 192.1434964595881 | 37.99580515982507 | | AAAAAAAAAADBAAAA | TN | 46.76305220883534 | 76.53148581895483 | 169.7409567683341 | 38.74171990856528 | | AAAAAAAAAADCAAAA | TN | 51.63247863247863 | 73.48170212583339 | 78.92059769487788 | 36.37487178862605 | | AAAAAAAAAADEAAAA | TN | 52.36206896551724 | 74.53993107158294 | 197.4142220886521 | 37.98893487284479 | | AAAAAAAAAADFAAAA | TN | 49.11678832116788 | 75.20419702564713 | 243.6113881011949 | 34.49240879246788 | | AAAAAAAAAADHAAAA | TN | 51.19281045751634 | 77.53549006795572 | 179.2230513796404 | 38.01681814884598 | | AAAAAAAAAAEAAAAA | TN | 50.0936329588015 | 76.52152416342696 | 225.6067913112356 | 41.52895508456363 | | AAAAAAAAAAEBAAAA | TN | 50.47325102880659 | 81.7223456936118 | 190.04452252388 | 40.19323666443221 | | AAAAAAAAAAEDAAAA | TN | 50.76666666666667 | 75.70737487276395 | 128.3607495218515 | 37.85087503665903 | | AAAAAAAAAAEEAAAA | TN | 53.07011070110701 | 75.90822215168565 | 209.5175896776495 | 36.59422226708244 | | AAAAAAAAAAEGAAAA | TN | 52.06349206349206 | 73.63521740370588 | 218.9858749064188 | 38.19932820003023 | | AAAAAAAAAAEHAAAA | TN | 49.13899613899614 | 78.77616282581359 | 195.0111137641164 | 38.43750962041 | | AAAAAAAAAAFAAAAA | TN | 49.0919540229885 | 77.10794665242329 | 261.6352871825412 | 41.18138473045367 | | AAAAAAAAAAFCAAAA | TN | 50.86530612244898 | 69.53416329403314 | 190.0284085546221 | 33.95135248220357 | | AAAAAAAAAAFDAAAA | TN | 51.78189300411523 | 79.48884772371363 | 236.9195049380468 | 39.80028807129634 | | AAAAAAAAAAFFAAAA | TN | 50.05555555555556 | 77.08307710875813 | 112.639017453051 | 39.21196581488555 | | AAAAAAAAAAFGAAAA | TN | 48.05054151624549 | 77.36631750630127 | 155.0615919526072 | 40.4705455055562 | | AAAAAAAAAAGBAAAA | TN | 51.47916666666666 | 77.86566678335269 | 149.2523961111534 | 37.06786016384024 | | AAAAAAAAAAGCAAAA | TN | 48.81294964028777 | 76.30284179200372 | 181.8865453156558 | 37.24133090707038 | | AAAAAAAAAAGEAAAA | TN | 50.26712328767123 | 74.98845371347932 | 221.4380336134598 | 39.1906529123226 | | AAAAAAAAAAGFAAAA | TN | 51.12587412587413 | 71.7272916018135 | 260.9777792286542 | 35.17031238905879 | | AAAAAAAAAAGHAAAA | TN | 48.49270072992701 | 77.09010992949699 | 128.6359700676286 | 38.18083944003077 | | AAAAAAAAAAHAAAAA | TN | 52.24291497975708 | 68.10776413262376 | 160.6089837686802 | 33.72165991338762 | | AAAAAAAAAAHBAAAA | TN | 51.76923076923077 | 75.79955271201405 | 142.7585023347183 | 40.17918713410513 | | AAAAAAAAAAHDAAAA | TN | 53.19298245614035 | 78.14687724364431 | 183.0658597527889 | 38.90757897000825 | | AAAAAAAAAAHEAAAA | TN | 48.74806201550388 | 73.88217057229937 | 106.0650759486052 | 35.10638463537281 | | AAAAAAAAAAHGAAAA | TN | 49.63813229571984 | 74.81778208708485 | 199.8842392853726 | 36.679844250243 | | AAAAAAAAAAHHAAAA | TN | 49.41085271317829 | 72.11406981852627 | 213.4735653862473 | 36.35011587349489 | | AAAAAAAAAAIAAAAA | TN | 50.15807560137457 | 73.59920966625214 | 155.1559652254499 | 37.60641373803133 | | AAAAAAAAAAICAAAA | TN | 51.79044117647059 | 80.52819860244499 | 182.6572070126148 | 38.83003669158172 | | AAAAAAAAAAIDAAAA | TN | 51.69512195121951 | 69.95764236673106 | 185.9410289148244 | 33.20532784165173 | | AAAAAAAAAAIFAAAA | TN | 48.9825327510917 | 82.67638782257551 | 244.9430257521178 | 42.11364051438215 | | AAAAAAAAAAIGAAAA | TN | 48.40163934426229 | 70.714754063575 | 132.5343853229138 | 37.21267489040339 | | AAAAAAAAAAJBAAAA | TN | 50.35433070866141 | 72.87145119134118 | 191.7509052133936 | 36.22736220792171 | | AAAAAAAAAAJCAAAA | TN | 49.26530612244898 | 76.47544720453945 | 162.5682997587721 | 35.87020233622658 | | AAAAAAAAAAJEAAAA | TN | 51.91319444444444 | 76.49954862809844 | 198.18013888018 | 40.10446367866543 | | AAAAAAAAAAJFAAAA | TN | 51.48163265306123 | 77.35254098645976 | 220.4090588317543 | 38.59346939155034 | | AAAAAAAAAAJHAAAA | TN | 50.50972762645915 | 77.07359366118908 | 179.884357432447 | 36.93710943980841 | | AAAAAAAAAAKAAAAA | TN | 48.48754448398576 | 73.01590761680195 | 177.2796100881083 | 35.00134267328248 | | AAAAAAAAAAKBAAAA | TN | 50.78048780487805 | 75.2475862794909 | 233.9143435371333 | 38.97427104266697 | | AAAAAAAAAAKDAAAA | TN | 46.33864541832669 | 79.50605583380893 | 240.8140879907305 | 40.08262942309874 | | AAAAAAAAAAKEAAAA | TN | 50.02713178294574 | 72.5463566391967 | 195.6973733924991 | 36.59382240025463 | | AAAAAAAAAAKGAAAA | TN | 51.61133603238866 | 76.00404835422995 | 168.3425406109421 | 39.85591085056062 | | AAAAAAAAAAKHAAAA | TN | 49.59649122807018 | 78.73206110533916 | 233.0576306414186 | 37.67118947234185 | | AAAAAAAAAALAAAAA | TN | 51.74903474903475 | 75.37461254485818 | 170.1029729732676 | 39.79223947976374 | | AAAAAAAAAALCAAAA | TN | 49.93227091633466 | 78.08107594997284 | 255.4824483389835 | 37.46709166175548 | | AAAAAAAAAALDAAAA | TN | 53.93115942028985 | 71.29485495194145 | 109.0701444844405 | 33.72494554665955 | | AAAAAAAAAALFAAAA | TN | 47.02459016393443 | 75.33077862712203 | 128.993975527951 | 37.50424492322669 | | AAAAAAAAAALGAAAA | TN | 53.60727272727273 | 71.84186390736625 | 146.6366790210297 | 37.42454876973956 | | AAAAAAAAAAMBAAAA | TN | 53.50883392226148 | 71.68235908175858 | 92.95155044676552 | 34.30855648964643 | | AAAAAAAAAAMCAAAA | TN | 51.4453125 | 76.7402371738268 | 236.2903140180251 | 37.78098035273599 | | AAAAAAAAAAMEAAAA | TN | 54.05054151624549 | 73.61917265885168 | 220.0257200890844 | 35.93688176721869 | | AAAAAAAAAAMFAAAA | TN | 50.48727272727272 | 80.41864977831388 | 164.2387550788703 | 40.26459843208537 | | AAAAAAAAAAMHAAAA | TN | 51.1123595505618 | 78.47586484421464 | 215.6796596773391 | 37.35833961936944 | | AAAAAAAAAANAAAAA | TN | 49.22064056939502 | 73.78890056474835 | 119.7456367694317 | 35.06070924523874 | | AAAAAAAAAANBAAAA | TN | 48.28301886792453 | 74.88259394634935 | 232.3814016580582 | 38.61928038344239 | | AAAAAAAAAANDAAAA | TN | 48.19512195121951 | 75.36621948664751 | 174.3421145265665 | 40.01882101495455 | | AAAAAAAAAANEAAAA | TN | 51.10112359550562 | 72.51947952247464 | 204.6503408045139 | 36.41606746482827 | | AAAAAAAAAANGAAAA | TN | 49.87044534412956 | 78.29077238910567 | 89.440484407448 | 38.08437236636757 | | AAAAAAAAAANHAAAA | TN | 52.572 | 75.03438254656545 | 145.2160546124219 | 38.65119524967979 | | AAAAAAAAAAOAAAAA | TN | 48.52380952380953 | 71.52000010536011 | 139.082349402971 | 35.63484130492286 | | AAAAAAAAAAOCAAAA | TN | 49.91566265060241 | 75.64425695995729 | 225.3010055741153 | 38.21044356679364 | | AAAAAAAAAAODAAAA | TN | 49.96837944664031 | 74.68098801303758 | 139.4018571710162 | 37.17138353973745 | | AAAAAAAAAAOFAAAA | TN | 50.4306049822064 | 72.539190335173 | 237.8786495427644 | 37.41215538030799 | | AAAAAAAAAAOGAAAA | TN | 51.83985765124555 | 75.34239296274525 | 121.3764896223731 | 38.12067855335772 | | AAAAAAAAAAPBAAAA | TN | 52.02985074626866 | 73.12505555773313 | 175.8563940844128 | 35.67052429135931 | | AAAAAAAAAAPCAAAA | TN | 52.29437229437229 | 76.68186144292096 | 322.3527146680602 | 37.23047845545022 | | AAAAAAAAAAPEAAAA | TN | 52.2875 | 78.7440000380079 | 186.6274699373364 | 38.24095053034873 | | AAAAAAAAAAPFAAAA | TN | 53.38661710037174 | 79.72137526508601 | 302.0819693914577 | 38.95423798335086 | | AAAAAAAAABAAAAAA | TN | 50.1304347826087 | 72.34369997302692 | 220.1429438268062 | 37.15566669334968 | | AAAAAAAAABABAAAA | TN | 51.78571428571428 | 80.39908363809623 | 204.4290893311086 | 42.408214379782 | | AAAAAAAAABADAAAA | TN | 51.03043478260869 | 72.27278277925824 | 130.9484121216213 | 32.7524569055772 | | AAAAAAAAABAEAAAA | TN | 51.57034220532319 | 82.84608346246495 | 177.6681440418417 | 41.30908060630505 | | AAAAAAAAABAGAAAA | TN | 51.12167300380228 | 78.79790091514587 | 238.7626992958127 | 41.00167308538132 | | AAAAAAAAABAHAAAA | TN | 49.94537815126051 | 76.29381753498093 | 240.9303762289385 | 34.94560664206369 | | AAAAAAAAABBAAAAA | TN | 53.84269662921348 | 71.70184181552185 | 191.1807086788007 | 37.86753744229591 | | AAAAAAAAABBCAAAA | TN | 51.45487364620939 | 79.45938397144926 | 204.9072193388259 | 40.50992785079492 | | AAAAAAAAABBDAAAA | TN | 49.16734693877551 | 79.83547335789527 | 209.6702856316858 | 40.75748979493424 | | AAAAAAAAABBFAAAA | TN | 50.10714285714285 | 74.84168664757985 | 104.2081264277616 | 36.17697211874434 | | AAAAAAAAABBGAAAA | TN | 50.25842696629213 | 73.56033706218562 | 145.7982717284135 | 38.43421055202869 | | AAAAAAAAABCBAAAA | TN | 52.79918032786885 | 73.00631172588614 | 190.3207732605691 | 36.07975309418798 | | AAAAAAAAABCCAAAA | TN | 49.30530973451327 | 79.28227643455777 | 246.209645872095 | 36.70493323882421 | | AAAAAAAAABCEAAAA | TN | 50.65909090909091 | 72.56252827644349 | 164.9536215796786 | 35.63706762978065 | | AAAAAAAAABCFAAAA | TN | 52.87218045112782 | 74.39757583809622 | 180.8358719692086 | 36.38596227145842 | | AAAAAAAAABCHAAAA | TN | 50.18367346938776 | 72.11516395260077 | 89.45836041806663 | 33.48118368058788 | +------------------+---------+-------------------+-------------------+-------------------+-------------------+ Query Runtime Profile: Query (id=19410b874827c24d:891b7d58465b70a8): Summary: Session ID: a549e971d88d90c4:6888eb5669f66199 Session Type: BEESWAX Start Time: 2014-10-21 16:04:16.356095000 End Time: 2014-10-21 16:04:36.227964000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.0.0-cdh5 RELEASE (build 977803b2fea2a0f1f321de7eb0adfa48a48b026c) User: drorke Connected User: drorke Delegated User: Network Address: ::ffff:10.50.49.171:51874 Default Db: tpcds15tb_parquet Sql Statement: -- start query 1 in stream 0 using template query27.tpl select i_item_id, s_state, -- grouping(s_state) g_state, avg(ss_quantity) agg1, avg(ss_list_price) agg2, avg(ss_coupon_amt) agg3, avg(ss_sales_price) agg4 from store_sales join store on (store_sales.ss_store_sk = store.s_store_sk) join customer_demographics on (store_sales.ss_cdemo_sk = customer_demographics.cd_demo_sk) join item on (store_sales.ss_item_sk = item.i_item_sk) join date_dim on (store_sales.ss_sold_date_sk = date_dim.d_date_sk) where -- ss_date between '1998-01-01' and '1998-12-31' ss_sold_date_sk between 2450815 and 2451179 -- partition key filter and d_year = 1998 and s_state in ('WI', 'CA', 'TX', 'FL', 'WA', 'TN') and cd_gender = 'F' and cd_marital_status = 'W' and cd_education_status = 'Primary' group by -- rollup(i_item_id, s_state) i_item_id, s_state order by i_item_id, s_state limit 100 Coordinator: perf20-02.cloudera.com:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=636.63MB VCores=5 F06:PLAN FRAGMENT [UNPARTITIONED] 17:MERGING-EXCHANGE [UNPARTITIONED] order by: i_item_id ASC, s_state ASC limit: 100 hosts=19 per-host-mem=unavailable tuple-ids=7 row-size=82B cardinality=100 F05:PLAN FRAGMENT [HASH(i_item_id,s_state)] DATASTREAM SINK [FRAGMENT=F06, EXCHANGE=17, UNPARTITIONED] 10:TOP-N [LIMIT=100] | order by: i_item_id ASC, s_state ASC | hosts=19 per-host-mem=8.01KB | tuple-ids=7 row-size=82B cardinality=100 | 16:AGGREGATE [FINALIZE] | output: avg:merge(ss_quantity), avg:merge(ss_list_price), avg:merge(ss_coupon_amt), avg:merge(ss_sales_price) | group by: i_item_id, s_state | hosts=19 per-host-mem=10.00MB | tuple-ids=6 row-size=82B cardinality=204492 | 15:EXCHANGE [HASH(i_item_id,s_state)] hosts=19 per-host-mem=0B tuple-ids=5 row-size=82B cardinality=204492 F00:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F05, EXCHANGE=15, HASH(i_item_id,s_state)] 09:AGGREGATE | output: avg(ss_quantity), avg(ss_list_price), avg(ss_coupon_amt), avg(ss_sales_price) | group by: i_item_id, s_state | hosts=19 per-host-mem=17.59MB | tuple-ids=5 row-size=82B cardinality=204492 | 08:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_sold_date_sk = date_dim.d_date_sk | hosts=19 per-host-mem=27B | tuple-ids=0,1,2,3,4 row-size=174B cardinality=8200935859 | |--14:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=4 row-size=8B cardinality=3 | 07:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_item_sk = item.i_item_sk | hosts=19 per-host-mem=1.21MB | tuple-ids=0,1,2,3 row-size=166B cardinality=8200935859 | |--13:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=3 row-size=36B cardinality=32000 | 06:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_cdemo_sk = customer_demographics.cd_demo_sk | hosts=19 per-host-mem=1.83MB | tuple-ids=0,1,2 row-size=130B cardinality=8200935859 | |--12:EXCHANGE [BROADCAST] | hosts=19 per-host-mem=0B | tuple-ids=2 row-size=64B cardinality=27440 | 05:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: store_sales.ss_store_sk = store.s_store_sk | hosts=19 per-host-mem=751B | tuple-ids=0,1 row-size=66B cardinality=8200935859 | |--11:EXCHANGE [BROADCAST] | hosts=3 per-host-mem=0B | tuple-ids=1 row-size=22B cardinality=31 | 00:SCAN HDFS [tpcds15tb_parquet.store_sales, RANDOM] partitions=363/1824 size=317.54GB table stats: 43202446268 rows total column stats: all hosts=19 per-host-mem=616.00MB tuple-ids=0 row-size=44B cardinality=8200935859 F04:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=14, BROADCAST] 04:SCAN HDFS [tpcds15tb_parquet.date_dim, RANDOM] partitions=1/1 size=2.41MB predicates: tpcds15tb_parquet.date_dim.d_date_sk >= 2450815, tpcds15tb_parquet.date_dim.d_date_sk <= 2451179, d_year = 1998 table stats: 73049 rows total column stats: all hosts=3 per-host-mem=32.00MB tuple-ids=4 row-size=8B cardinality=3 F03:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=13, BROADCAST] 03:SCAN HDFS [tpcds15tb_parquet.item, RANDOM] partitions=1/1 size=3.14MB table stats: 32000 rows total column stats: all hosts=3 per-host-mem=32.00MB tuple-ids=3 row-size=36B cardinality=32000 F02:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=12, BROADCAST] 02:SCAN HDFS [tpcds15tb_parquet.customer_demographics, RANDOM] partitions=1/1 size=10.04MB predicates: cd_gender = 'F', cd_marital_status = 'W', cd_education_status = 'Primary' table stats: 1920800 rows total column stats: all hosts=19 per-host-mem=64.00MB tuple-ids=2 row-size=64B cardinality=27440 F01:PLAN FRAGMENT [RANDOM] DATASTREAM SINK [FRAGMENT=F00, EXCHANGE=11, BROADCAST] 01:SCAN HDFS [tpcds15tb_parquet.store, RANDOM] partitions=1/1 size=11.89KB predicates: s_state IN ('WI', 'CA', 'TX', 'FL', 'WA', 'TN') table stats: 62 rows total column stats: all hosts=3 per-host-mem=32.00MB tuple-ids=1 row-size=22B cardinality=31 ---------------- Estimated Per-Host Mem: 667554813 Estimated Per-Host VCores: 5 Admission result: Admitted immediately Request Pool: root.drorke ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------------- 17:MERGING-EXCHANGE 1 653.637us 653.637us 1.02K 100 0 -1.00 B UNPARTITIONED 10:TOP-N 19 832.105us 917.118us 1.90K 100 52.00 KB 8.01 KB 16:AGGREGATE 19 195.473ms 199.993ms 16.00K 204.49K 14.50 MB 10.00 MB FINALIZE 15:EXCHANGE 19 1.78ms 1.334ms 304.02K 204.49K 0 0 HASH(i_item_id,s_state) 09:AGGREGATE 19 844.638ms 893.861ms 304.02K 204.49K 38.27 MB 17.59 MB 08:HASH JOIN 19 63.919ms 75.253ms 6.80M 8.20B 20.67 MB 27.00 B INNER JOIN, BROADCAST |--14:EXCHANGE 19 17.452us 19.891us 365 3 0 0 BROADCAST | 04:SCAN HDFS 1 17.229ms 17.229ms 365 3 1.44 MB 32.00 MB tpcds15tb_parquet.date_dim 07:HASH JOIN 19 177.104ms 195.900ms 6.80M 8.20B 15.79 MB 1.21 MB INNER JOIN, BROADCAST |--13:EXCHANGE 19 792.820us 1.107ms 32.00K 32.00K 0 0 BROADCAST | 03:SCAN HDFS 1 8.17ms 8.17ms 32.00K 32.00K 1.94 MB 32.00 MB tpcds15tb_parquet.item 06:HASH JOIN 19 1s373ms 1s712ms 6.80M 8.20B 9.22 MB 1.83 MB INNER JOIN, BROADCAST |--12:EXCHANGE 19 762.11us 1.0ms 27.44K 27.44K 0 0 BROADCAST | 02:SCAN HDFS 16 30.641ms 35.344ms 27.44K 27.44K 4.49 MB 64.00 MB tpcds15tb_parquet.customer_... 05:HASH JOIN 19 2s201ms 2s855ms 501.76M 8.20B 4.02 MB 751.00 B INNER JOIN, BROADCAST |--11:EXCHANGE 19 7.569us 9.906us 6 31 0 0 BROADCAST | 01:SCAN HDFS 1 382.126ms 382.126ms 6 31 62.00 KB 32.00 MB tpcds15tb_parquet.store 00:SCAN HDFS 19 10s231ms 12s925ms 694.31M 8.20B 2.05 GB 616.00 MB tpcds15tb_parquet.store_sales Query Timeline: 19s894ms - Start execution: 55.781us (55.781us) - Planning finished: 27.698ms (27.642ms) - Submit for admission: 44.443ms (16.744ms) - Completed admission: 44.530ms (87.621us) - Ready to start remote fragments: 70.914ms (26.383ms) - Remote fragments started: 755.865ms (684.951ms) - Rows available: 19s453ms (18s697ms) - First row fetched: 19s819ms (366.528ms) - Unregister query: 19s871ms (52.171ms) ImpalaServer: - ClientFetchWaitTimer: 409.39ms - RowMaterializationTimer: 898.95us Execution Profile 19410b874827c24d:891b7d58465b70a8:(Total: 19s413ms, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 57, last: 0.195985, min: 0.00488837, max: 0.217904, mean: 0.144936, stddev: 0.094085 Per Node Peak Memory Usage: perf20-13.cloudera.com:22000(1.97 GB) perf20-15.cloudera.com:22000(1.96 GB) perf20-20.cloudera.com:22000(2.08 GB) perf20-14.cloudera.com:22000(2.05 GB) perf20-17.cloudera.com:22000(2.05 GB) perf20-16.cloudera.com:22000(2.02 GB) perf20-05.cloudera.com:22000(2.00 GB) perf20-03.cloudera.com:22000(1.94 GB) perf20-09.cloudera.com:22000(1.91 GB) perf20-12.cloudera.com:22000(1.93 GB) perf20-19.cloudera.com:22000(2.01 GB) perf20-04.cloudera.com:22000(2.04 GB) perf20-18.cloudera.com:22000(2.10 GB) perf20-11.cloudera.com:22000(1.91 GB) perf20-06.cloudera.com:22000(1.87 GB) perf20-10.cloudera.com:22000(1.91 GB) perf20-07.cloudera.com:22000(1.95 GB) perf20-02.cloudera.com:22000(1.34 GB) perf20-08.cloudera.com:22000(1.89 GB) - FinalizationTimer: 0ns Coordinator Fragment F06:(Total: 18s718ms, non-child: 22.266ms, % non-child: 0.12%) MemoryUsage(500.0ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 326.99 KB ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 326.99 KB (334840) - PerHostPeakMemUsage: 0 - PrepareTime: 48.993us - RowsProduced: 100 - TotalCpuTime: 19s772ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 464 - BlocksRecycled: 88 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 119.66 GB (128480731136) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns EXCHANGE_NODE (id=17):(Total: 18s696ms, non-child: 653.637us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 110.31 KB (112958) - ConvertRowBatchTime: 0ns - DeserializeRowBatchTimer: 666.938us - FirstBatchArrivalWaitTime: 18s695ms - MergeGetNext: 432.138us - MergeGetNextBatch: 0ns - PeakMemoryUsage: 0 - RowsReturned: 1.02K (1024) - RowsReturnedRate: 54.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F05:(Total: 19s081ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:19s150ms max:19s169ms mean: 19s155ms stddev:3.900ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 19 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.65 MB (15362081) - PerHostPeakMemUsage: 1.94 GB (2088190781) - PrepareTime: 190.307ms - RowsProduced: 100 - TotalCpuTime: 499.551ms - TotalNetworkReceiveTime: 18s864ms - TotalNetworkSendTime: 276.299us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 462 - BlocksRecycled: 89 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.12 GB (118236937329) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 467.562ms, non-child: 467.562ms, % non-child: 100.00%) - CodegenTime: 5.211ms - CompileTime: 282.849ms - LoadTime: 183.306ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 73.187us, non-child: 73.187us, % non-child: 100.00%) - BytesSent: 5.81 KB (5945) - NetworkThroughput(*): 26.07 MB/sec - OverallThroughput: 78.08 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 48.15us - ThriftTransmitTime(*): 247.972us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s061ms, non-child: 832.106us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s061ms, non-child: 195.473ms, % non-child: 1.03%) - BuildTime: 3.208ms - GetNewBlockTime: 572.271us - GetResultsTime: 717.815us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.47 MB (15174864) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 842 - RowsReturnedRate: 43.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.699us EXCHANGE_NODE (id=15):(Total: 18s865ms, non-child: 18s865ms, % non-child: 100.00%) - BytesReceived: 1.19 MB (1251608) - ConvertRowBatchTime: 436.394us - DeserializeRowBatchTimer: 4.885ms - FirstBatchArrivalWaitTime: 13s156ms - PeakMemoryUsage: 0 - RowsReturned: 16.00K (16000) - RowsReturnedRate: 847.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment F00:(Total: 14s880ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 16.46 GB, max: 16.91 GB, avg: 16.71 GB, stddev: 107.84 MB completion times: min:13s262ms max:18s938ms mean: 15s209ms stddev:1s235ms execution rates: min:909.05 MB/sec max:1.26 GB/sec mean:1.11 GB/sec stddev:85.28 MB/sec num instances: 19 - AverageThreadTokens: 25.94 - PeakMemoryUsage: 1.93 GB (2073231758) - PerHostPeakMemUsage: 1.94 GB (2088190781) - PrepareTime: 199.30ms - RowsProduced: 16.00K (16000) - TotalCpuTime: 6m28s - TotalNetworkReceiveTime: 194.62us - TotalNetworkSendTime: 3.556ms - TotalStorageWaitTime: 10s940ms CodeGen:(Total: 701.130ms, non-child: 701.130ms, % non-child: 100.00%) - CodegenTime: 5.184ms - CompileTime: 521.804ms - LoadTime: 177.917ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.987ms, non-child: 13.987ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1251608) - NetworkThroughput(*): 45.13 MB/sec - OverallThroughput: 85.37 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.712ms - ThriftTransmitTime(*): 26.528ms - UncompressedRowBatchSize: 2.90 MB (3040632) AGGREGATION_NODE (id=9):(Total: 14s863ms, non-child: 844.638ms, % non-child: 5.68%) - BuildTime: 624.975ms - GetNewBlockTime: 564.941us - GetResultsTime: 24.205ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 32.00 MB (33554224) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16000) - RowsReturnedRate: 1.08 K/sec - SpilledPartitions: 0 - UnpinTime: 2.746us HASH_JOIN_NODE (id=8):(Total: 14s018ms, non-child: 61.52ms, % non-child: 0.44%) - BuildPartitionTime: 19.831us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 45.35us - GetNewBlockTime: 1.849ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 18.96 MB (19884374) - PinTime: 0ns - ProbeRows: 357.65K (357647) - ProbeRowsPartitioned: 0 - ProbeTime: 39.568ms - RowsReturned: 357.65K (357647) - RowsReturnedRate: 25.66 K/sec - SpilledPartitions: 0 - UnpinTime: 2.460us EXCHANGE_NODE (id=14):(Total: 17.452us, non-child: 17.452us, % non-child: 100.00%) - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.300us - DeserializeRowBatchTimer: 17.732us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.96 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s957ms, non-child: 165.422ms, % non-child: 1.19%) - BuildPartitionTime: 3.195ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.122ms - GetNewBlockTime: 1.961ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.12 MB (15859529) - PinTime: 0ns - ProbeRows: 357.65K (357647) - ProbeRowsPartitioned: 0 - ProbeTime: 145.623ms - RowsReturned: 357.65K (357647) - RowsReturnedRate: 25.78 K/sec - SpilledPartitions: 0 - UnpinTime: 2.414us EXCHANGE_NODE (id=13):(Total: 792.820us, non-child: 792.820us, % non-child: 100.00%) - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 643.805us - DeserializeRowBatchTimer: 2.421ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.64 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s791ms, non-child: 1s360ms, % non-child: 9.86%) - BuildPartitionTime: 4.580ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.838ms - GetNewBlockTime: 2.26ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.50 MB (7868281) - PinTime: 0ns - ProbeRows: 26.41M (26408490) - ProbeRowsPartitioned: 0 - ProbeTime: 1s165ms - RowsReturned: 357.65K (357647) - RowsReturnedRate: 26.09 K/sec - SpilledPartitions: 0 - UnpinTime: 2.374us EXCHANGE_NODE (id=12):(Total: 762.11us, non-child: 762.11us, % non-child: 100.00%) - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 560.377us - DeserializeRowBatchTimer: 4.361ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.20 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s430ms, non-child: 2s199ms, % non-child: 17.69%) - BuildPartitionTime: 3.657us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.811us - GetNewBlockTime: 1.941ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 36.54M (36542799) - ProbeRowsPartitioned: 0 - ProbeTime: 2s030ms - RowsReturned: 26.41M (26408490) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 - UnpinTime: 2.276us EXCHANGE_NODE (id=11):(Total: 7.569us, non-child: 7.569us, % non-child: 100.00%) - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.9us - DeserializeRowBatchTimer: 5.471us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 799.61 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s231ms, non-child: 10s231ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 26.33 - BytesRead: 2.97 GB (3192989348) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.97 GB (3192989348) - BytesReadShortCircuit: 2.97 GB (3192989348) - DecompressionTime: 11s197ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 34 - PeakMemoryUsage: 1.89 GB (2032214511) - PerReadThreadRawHdfsThroughput: 784.44 MB/sec - RowsRead: 431.63M (431628203) - RowsReturned: 36.54M (36542799) - RowsReturnedRate: 3.60 M/sec - ScanRangesComplete: 74 - ScannerThreadsInvoluntaryContextSwitches: 32.55K (32552) - ScannerThreadsTotalWallClockTime: 6m24s - MaterializeTupleTime(*): 6m - ScannerThreadsSysTime: 382.30ms - ScannerThreadsUserTime: 4m33s - ScannerThreadsVoluntaryContextSwitches: 2.14K (2140) - TotalRawHdfsReadTime(*): 3s938ms - TotalReadThroughput: 201.74 MB/sec Averaged Fragment F04:(Total: 20.685ms, non-child: 2.614ms, % non-child: 12.64%) split sizes: min: 2.41 MB, max: 2.41 MB, avg: 2.41 MB, stddev: 0 completion times: min:220.932ms max:220.932ms mean: 220.932ms stddev:0ns execution rates: min:10.92 MB/sec max:10.92 MB/sec mean:10.92 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - PeakMemoryUsage: 1.65 MB (1725744) - PerHostPeakMemUsage: 14.42 MB (15115568) - PrepareTime: 81.550us - RowsProduced: 365 - TotalCpuTime: 34.533ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 580.865us - TotalStorageWaitTime: 6.96ms DataStreamSender (dst_id=14):(Total: 841.715us, non-child: 841.715us, % non-child: 100.00%) - BytesSent: 54.64 KB (55955) - NetworkThroughput(*): 6.95 MB/sec - OverallThroughput: 63.40 MB/sec - PeakMemoryUsage: 202.62 KB (207480) - SerializeBatchTime: 42.574us - ThriftTransmitTime(*): 7.682ms - UncompressedRowBatchSize: 108.51 KB (111112) HDFS_SCAN_NODE (id=4):(Total: 17.229ms, non-child: 17.229ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 515.15 KB (527514) - BytesReadDataNodeCache: 0 - BytesReadLocal: 515.15 KB (527514) - BytesReadShortCircuit: 515.15 KB (527514) - DecompressionTime: 33.483us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1.44 MB (1510072) - PerReadThreadRawHdfsThroughput: 963.07 MB/sec - RowsRead: 73.05K (73049) - RowsReturned: 365 - RowsReturnedRate: 21.18 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 16.960ms - MaterializeTupleTime(*): 9.946ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 522.366us - TotalReadThroughput: 0.00 /sec Averaged Fragment F03:(Total: 34.388ms, non-child: 2.445ms, % non-child: 7.11%) split sizes: min: 3.14 MB, max: 3.14 MB, avg: 3.14 MB, stddev: 0 completion times: min:215.173ms max:215.173ms mean: 215.173ms stddev:0ns execution rates: min:14.59 MB/sec max:14.59 MB/sec mean:14.59 MB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.08 MB (2183368) - PerHostPeakMemUsage: 17.02 MB (17843528) - PrepareTime: 54.299us - RowsProduced: 32.00K (32000) - TotalCpuTime: 23.879ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 18.41ms - TotalStorageWaitTime: 6.143ms DataStreamSender (dst_id=13):(Total: 23.925ms, non-child: 23.925ms, % non-child: 100.00%) - BytesSent: 8.60 MB (9012821) - NetworkThroughput(*): 32.29 MB/sec - OverallThroughput: 359.25 MB/sec - PeakMemoryUsage: 101.23 KB (103664) - SerializeBatchTime: 3.984ms - ThriftTransmitTime(*): 266.216ms - UncompressedRowBatchSize: 25.52 MB (26754508) HDFS_SCAN_NODE (id=3):(Total: 8.17ms, non-child: 8.17ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 415.85 KB (425829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 415.85 KB (425829) - BytesReadShortCircuit: 415.85 KB (425829) - DecompressionTime: 91.892us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1.94 MB (2038744) - PerReadThreadRawHdfsThroughput: 2.80 GB/sec - RowsRead: 32.00K (32000) - RowsReturned: 32.00K (32000) - RowsReturnedRate: 3.99 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 10.926ms - MaterializeTupleTime(*): 3.343ms - ScannerThreadsSysTime: 999.0us - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 141.791us - TotalReadThroughput: 0.00 /sec Averaged Fragment F02:(Total: 35.652ms, non-child: 3.83ms, % non-child: 8.65%) split sizes: min: 540.30 KB, max: 1.06 MB, avg: 642.79 KB, stddev: 211.09 KB completion times: min:197.141ms max:200.231ms mean: 198.885ms stddev:859.848us execution rates: min:2.64 MB/sec max:5.31 MB/sec mean:3.15 MB/sec stddev:1.03 MB/sec num instances: 16 - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.78 MB (2918094) - PerHostPeakMemUsage: 26.09 MB (27360075) - PrepareTime: 118.828us - RowsProduced: 1.72K (1715) - TotalCpuTime: 68.151ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.21ms - TotalStorageWaitTime: 7.756ms DataStreamSender (dst_id=12):(Total: 1.928ms, non-child: 1.928ms, % non-child: 100.00%) - BytesSent: 1.02 MB (1069485) - NetworkThroughput(*): 26.66 MB/sec - OverallThroughput: 547.86 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 496.851us - ThriftTransmitTime(*): 38.711ms - UncompressedRowBatchSize: 2.14 MB (2248621) HDFS_SCAN_NODE (id=2):(Total: 30.641ms, non-child: 30.641ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 751.47 KB (769506) - BytesReadDataNodeCache: 0 - BytesReadLocal: 751.47 KB (769506) - BytesReadShortCircuit: 751.47 KB (769506) - DecompressionTime: 256.992us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.69 MB (2823886) - PerReadThreadRawHdfsThroughput: 4.08 GB/sec - RowsRead: 120.05K (120050) - RowsReturned: 1.72K (1715) - RowsReturnedRate: 55.55 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 37.556ms - MaterializeTupleTime(*): 28.238ms - ScannerThreadsSysTime: 62.437us - ScannerThreadsUserTime: 28.620ms - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 177.769us - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 195.956ms, non-child: 0ns, % non-child: 0.00%) split sizes: min: 11.89 KB, max: 11.89 KB, avg: 11.89 KB, stddev: 0 completion times: min:184.235ms max:184.235ms mean: 184.235ms stddev:0ns execution rates: min:64.54 KB/sec max:64.54 KB/sec mean:64.54 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 171.23 KB (175344) - PerHostPeakMemUsage: 25.67 MB (26921496) - PrepareTime: 189.725ms - RowsProduced: 6 - TotalCpuTime: 376.733ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 49.289us - TotalStorageWaitTime: 2.349ms CodeGen:(Total: 366.495ms, non-child: 366.495ms, % non-child: 100.00%) - CodegenTime: 0ns - CompileTime: 177.601ms - LoadTime: 187.421ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=11):(Total: 591.93us, non-child: 591.93us, % non-child: 100.00%) - BytesSent: 2.45 KB (2508) - NetworkThroughput(*): 618.01 KB/sec - OverallThroughput: 4.05 MB/sec - PeakMemoryUsage: 101.23 KB (103664) - SerializeBatchTime: 11.447us - ThriftTransmitTime(*): 3.963ms - UncompressedRowBatchSize: 3.49 KB (3572) HDFS_SCAN_NODE (id=1):(Total: 382.126ms, non-child: 382.126ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 12.36 KB (12657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.36 KB (12657) - BytesReadShortCircuit: 12.36 KB (12657) - DecompressionTime: 3.638us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 62.00 KB (63488) - PerReadThreadRawHdfsThroughput: 625.78 MB/sec - RowsRead: 62 - RowsReturned: 6 - RowsReturnedRate: 15.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2.884ms - MaterializeTupleTime(*): 20.820us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 19.289us - TotalReadThroughput: 0.00 /sec Fragment F05: Instance 19410b874827c24d:891b7d58465b70b9 (host=perf20-14.cloudera.com:22000):(Total: 19s088ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.45 MB, 14.46 MB, 14.47 MB, 14.56 MB, 14.52 MB, 14.59 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB, 14.54 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.65 MB (15362064) - PerHostPeakMemUsage: 2.05 GB (2196377712) - PrepareTime: 190.4ms - RowsProduced: 100 - TotalCpuTime: 494.66ms - TotalNetworkReceiveTime: 18s871ms - TotalNetworkSendTime: 299.594us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 463 - BlocksRecycled: 89 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.95 GB (118054584320) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 460.481ms, non-child: 460.481ms, % non-child: 100.00%) - CodegenTime: 5.235ms - CompileTime: 276.80ms - LoadTime: 182.991ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 71.851us, non-child: 71.851us, % non-child: 100.00%) - BytesSent: 5.79 KB (5932) - NetworkThroughput(*): 20.83 MB/sec - OverallThroughput: 78.74 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 46.48us - ThriftTransmitTime(*): 271.562us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s068ms, non-child: 881.514us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s067ms, non-child: 194.992ms, % non-child: 1.02%) ExecOption: Codegen Enabled - BuildTime: 3.273ms - GetNewBlockTime: 361.784us - GetResultsTime: 685.632us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.47 MB (15169016) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 864 - RowsReturnedRate: 45.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.707us EXCHANGE_NODE (id=15):(Total: 18s872ms, non-child: 1.88ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 66.10 KB, 132.03 KB, 378.11 KB, 726.22 KB, 792.07 KB, 990.33 KB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB, 1.16 MB - BytesReceived: 1.22 MB (1284091) - ConvertRowBatchTime: 435.981us - DeserializeRowBatchTimer: 4.988ms - FirstBatchArrivalWaitTime: 13s161ms - PeakMemoryUsage: 0 - RowsReturned: 16.42K (16416) - RowsReturnedRate: 869.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b0 (host=perf20-18.cloudera.com:22000):(Total: 19s084ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.47 MB, 14.43 MB, 14.42 MB, 14.51 MB, 14.55 MB, 14.59 MB, 14.48 MB, 14.47 MB, 14.47 MB, 14.47 MB, 14.47 MB, 14.47 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.67 MB (15384760) - PerHostPeakMemUsage: 2.10 GB (2252597112) - PrepareTime: 188.722ms - RowsProduced: 100 - TotalCpuTime: 495.670ms - TotalNetworkReceiveTime: 18s867ms - TotalNetworkSendTime: 243.309us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 459 - BlocksRecycled: 93 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.86 GB (117964627968) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 461.330ms, non-child: 461.330ms, % non-child: 100.00%) - CodegenTime: 5.273ms - CompileTime: 278.199ms - LoadTime: 181.737ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 71.623us, non-child: 71.623us, % non-child: 100.00%) - BytesSent: 5.83 KB (5974) - NetworkThroughput(*): 26.13 MB/sec - OverallThroughput: 79.54 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 46.111us - ThriftTransmitTime(*): 218.71us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s063ms, non-child: 819.574us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s063ms, non-child: 194.562ms, % non-child: 1.02%) ExecOption: Codegen Enabled - BuildTime: 3.667ms - GetNewBlockTime: 816.812us - GetResultsTime: 676.916us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.50 MB (15199904) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 851 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.648us EXCHANGE_NODE (id=15):(Total: 18s868ms, non-child: 1.334ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 47.96 KB, 65.18 KB, 195.42 KB, 544.42 KB, 715.77 KB, 845.63 KB, 1.02 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB - BytesReceived: 1.21 MB (1265113) - ConvertRowBatchTime: 519.561us - DeserializeRowBatchTimer: 4.955ms - FirstBatchArrivalWaitTime: 13s161ms - PeakMemoryUsage: 0 - RowsReturned: 16.17K (16169) - RowsReturnedRate: 856.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b8 (host=perf20-17.cloudera.com:22000):(Total: 19s083ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.37 MB, 14.45 MB, 14.45 MB, 14.48 MB, 14.56 MB, 14.54 MB, 14.58 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.65 MB (15366712) - PerHostPeakMemUsage: 2.05 GB (2201234336) - PrepareTime: 192.821ms - RowsProduced: 100 - TotalCpuTime: 503.302ms - TotalNetworkReceiveTime: 18s862ms - TotalNetworkSendTime: 215.543us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 459 - BlocksRecycled: 93 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.79 GB (117882068992) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 469.507ms, non-child: 469.507ms, % non-child: 100.00%) - CodegenTime: 5.283ms - CompileTime: 282.371ms - LoadTime: 185.752ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 74.249us, non-child: 74.249us, % non-child: 100.00%) - BytesSent: 5.88 KB (6023) - NetworkThroughput(*): 30.38 MB/sec - OverallThroughput: 77.36 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 44.127us - ThriftTransmitTime(*): 189.49us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s062ms, non-child: 901.490us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s061ms, non-child: 198.411ms, % non-child: 1.04%) ExecOption: Codegen Enabled - BuildTime: 3.866ms - GetNewBlockTime: 352.575us - GetResultsTime: 721.950us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.48 MB (15181856) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 848 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.487us EXCHANGE_NODE (id=15):(Total: 18s863ms, non-child: 1.110ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 35.82 KB, 64.73 KB, 194.39 KB, 530.13 KB, 712.35 KB, 841.90 KB, 1.01 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB - BytesReceived: 1.20 MB (1260052) - ConvertRowBatchTime: 454.51us - DeserializeRowBatchTimer: 4.856ms - FirstBatchArrivalWaitTime: 13s152ms - PeakMemoryUsage: 0 - RowsReturned: 16.11K (16112) - RowsReturnedRate: 854.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70bc (host=perf20-13.cloudera.com:22000):(Total: 19s082ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.31 MB, 14.43 MB, 14.42 MB, 14.59 MB, 14.42 MB, 14.47 MB, 14.57 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.67 MB (15382152) - PerHostPeakMemUsage: 1.97 GB (2112048264) - PrepareTime: 190.150ms - RowsProduced: 100 - TotalCpuTime: 502.228ms - TotalNetworkReceiveTime: 18s864ms - TotalNetworkSendTime: 212.168us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 464 - BlocksRecycled: 88 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.39 GB (118526894080) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 468.169ms, non-child: 468.169ms, % non-child: 100.00%) - CodegenTime: 5.131ms - CompileTime: 283.586ms - LoadTime: 183.267ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 72.775us, non-child: 72.775us, % non-child: 100.00%) - BytesSent: 5.79 KB (5926) - NetworkThroughput(*): 31.13 MB/sec - OverallThroughput: 77.66 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 48.798us - ThriftTransmitTime(*): 181.520us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s061ms, non-child: 805.174us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s060ms, non-child: 195.542ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 3.15ms - GetNewBlockTime: 764.284us - GetResultsTime: 872.67us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.49 MB (15197296) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 837 - RowsReturnedRate: 43.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.646us EXCHANGE_NODE (id=15):(Total: 18s865ms, non-child: 987.75us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 12.05 KB, 64.17 KB, 192.46 KB, 512.13 KB, 704.00 KB, 815.72 KB, 1019.62 KB, 1.12 MB, 1.12 MB, 1.12 MB, 1.12 MB, 1.12 MB - BytesReceived: 1.19 MB (1244626) - ConvertRowBatchTime: 409.790us - DeserializeRowBatchTimer: 4.695ms - FirstBatchArrivalWaitTime: 13s152ms - PeakMemoryUsage: 0 - RowsReturned: 15.90K (15903) - RowsReturnedRate: 842.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b5 (host=perf20-05.cloudera.com:22000):(Total: 19s082ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.45 MB, 14.54 MB, 14.46 MB, 14.41 MB, 14.41 MB, 14.48 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB, 14.46 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15347368) - PerHostPeakMemUsage: 2.00 GB (2149956408) - PrepareTime: 192.503ms - RowsProduced: 100 - TotalCpuTime: 502.649ms - TotalNetworkReceiveTime: 18s862ms - TotalNetworkSendTime: 208.589us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 466 - BlocksRecycled: 86 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.87 GB (117974827008) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 468.846ms, non-child: 468.846ms, % non-child: 100.00%) - CodegenTime: 5.365ms - CompileTime: 282.121ms - LoadTime: 185.250ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 73.197us, non-child: 73.197us, % non-child: 100.00%) - BytesSent: 5.79 KB (5934) - NetworkThroughput(*): 30.99 MB/sec - OverallThroughput: 77.31 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 47.36us - ThriftTransmitTime(*): 182.635us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s061ms, non-child: 814.230us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s060ms, non-child: 197.850ms, % non-child: 1.04%) ExecOption: Codegen Enabled - BuildTime: 3.107ms - GetNewBlockTime: 813.567us - GetResultsTime: 693.794us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15162512) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 815 - RowsReturnedRate: 42.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.529us EXCHANGE_NODE (id=15):(Total: 18s863ms, non-child: 1.63ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 62.62 KB, 125.00 KB, 312.43 KB, 686.65 KB, 749.03 KB, 936.25 KB, 1.10 MB, 1.10 MB, 1.10 MB, 1.10 MB, 1.10 MB - BytesReceived: 1.16 MB (1213730) - ConvertRowBatchTime: 425.922us - DeserializeRowBatchTimer: 4.728ms - FirstBatchArrivalWaitTime: 13s154ms - PeakMemoryUsage: 0 - RowsReturned: 15.48K (15485) - RowsReturnedRate: 820.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b6 (host=perf20-03.cloudera.com:22000):(Total: 19s081ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.42 MB, 14.43 MB, 14.43 MB, 14.46 MB, 14.43 MB, 14.50 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.65 MB (15366512) - PerHostPeakMemUsage: 1.94 GB (2087957288) - PrepareTime: 191.491ms - RowsProduced: 100 - TotalCpuTime: 501.188ms - TotalNetworkReceiveTime: 18s864ms - TotalNetworkSendTime: 544.316us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 461 - BlocksRecycled: 91 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.00 GB (118111420416) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 469.210ms, non-child: 469.210ms, % non-child: 100.00%) - CodegenTime: 5.114ms - CompileTime: 283.229ms - LoadTime: 184.649ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 73.705us, non-child: 73.705us, % non-child: 100.00%) - BytesSent: 5.95 KB (6094) - NetworkThroughput(*): 11.24 MB/sec - OverallThroughput: 78.85 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 50.904us - ThriftTransmitTime(*): 516.973us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s061ms, non-child: 754.60us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s060ms, non-child: 196.131ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 2.987ms - GetNewBlockTime: 386.119us - GetResultsTime: 614.788us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.48 MB (15181656) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 780 - RowsReturnedRate: 40.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.594us EXCHANGE_NODE (id=15):(Total: 18s864ms, non-child: 999.1us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 59.69 KB, 178.96 KB, 476.53 KB, 654.99 KB, 714.42 KB, 892.64 KB, 1.05 MB, 1.05 MB, 1.05 MB, 1.05 MB, 1.05 MB - BytesReceived: 1.10 MB (1157515) - ConvertRowBatchTime: 401.254us - DeserializeRowBatchTimer: 4.169ms - FirstBatchArrivalWaitTime: 13s152ms - PeakMemoryUsage: 0 - RowsReturned: 14.82K (14820) - RowsReturnedRate: 785.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70ba (host=perf20-20.cloudera.com:22000):(Total: 19s081ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.42 MB, 14.56 MB, 14.44 MB, 14.44 MB, 14.44 MB, 14.60 MB, 14.50 MB, 14.47 MB, 14.47 MB, 14.47 MB, 14.47 MB, 14.47 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.63 MB (15343272) - PerHostPeakMemUsage: 2.08 GB (2234940136) - PrepareTime: 191.596ms - RowsProduced: 100 - TotalCpuTime: 502.549ms - TotalNetworkReceiveTime: 18s863ms - TotalNetworkSendTime: 611.908us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 456 - BlocksRecycled: 96 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.05 GB (118160351232) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 469.827ms, non-child: 469.827ms, % non-child: 100.00%) - CodegenTime: 5.241ms - CompileTime: 283.907ms - LoadTime: 184.516ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 69.105us, non-child: 69.105us, % non-child: 100.00%) - BytesSent: 5.86 KB (6003) - NetworkThroughput(*): 9.75 MB/sec - OverallThroughput: 82.84 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 43.203us - ThriftTransmitTime(*): 587.450us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s061ms, non-child: 797.935us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s060ms, non-child: 196.744ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 3.196ms - GetNewBlockTime: 476.168us - GetResultsTime: 655.303us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15158416) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 804 - RowsReturnedRate: 42.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.963us EXCHANGE_NODE (id=15):(Total: 18s863ms, non-child: 1.56ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 61.41 KB, 121.17 KB, 306.75 KB, 551.75 KB, 686.20 KB, 858.00 KB, 1.02 MB, 1.08 MB, 1.08 MB, 1.08 MB, 1.08 MB, 1.08 MB - BytesReceived: 1.14 MB (1192256) - ConvertRowBatchTime: 419.726us - DeserializeRowBatchTimer: 4.742ms - FirstBatchArrivalWaitTime: 13s152ms - PeakMemoryUsage: 0 - RowsReturned: 15.28K (15276) - RowsReturnedRate: 809.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70bb (host=perf20-15.cloudera.com:22000):(Total: 19s081ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.42 MB, 14.45 MB, 14.56 MB, 14.45 MB, 14.45 MB, 14.42 MB, 14.53 MB, 14.53 MB, 14.53 MB, 14.53 MB, 14.53 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15352384) - PerHostPeakMemUsage: 1.96 GB (2104458656) - PrepareTime: 188.648ms - RowsProduced: 100 - TotalCpuTime: 499.358ms - TotalNetworkReceiveTime: 18s867ms - TotalNetworkSendTime: 278.851us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 464 - BlocksRecycled: 88 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.98 GB (118092619776) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 467.853ms, non-child: 467.853ms, % non-child: 100.00%) - CodegenTime: 4.993ms - CompileTime: 284.602ms - LoadTime: 181.901ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 67.411us, non-child: 67.411us, % non-child: 100.00%) - BytesSent: 5.82 KB (5959) - NetworkThroughput(*): 22.62 MB/sec - OverallThroughput: 84.30 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 43.406us - ThriftTransmitTime(*): 251.254us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s061ms, non-child: 797.428us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s061ms, non-child: 193.427ms, % non-child: 1.01%) ExecOption: Codegen Enabled - BuildTime: 3.39ms - GetNewBlockTime: 377.738us - GetResultsTime: 745.768us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15167528) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 856 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.580us EXCHANGE_NODE (id=15):(Total: 18s867ms, non-child: 1.51ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 65.38 KB, 196.46 KB, 517.98 KB, 719.94 KB, 785.32 KB, 981.57 KB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.21 MB (1273051) - ConvertRowBatchTime: 436.75us - DeserializeRowBatchTimer: 4.904ms - FirstBatchArrivalWaitTime: 13s153ms - PeakMemoryUsage: 0 - RowsReturned: 16.26K (16264) - RowsReturnedRate: 862.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b1 (host=perf20-04.cloudera.com:22000):(Total: 19s080ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.46 MB, 14.46 MB, 14.56 MB, 14.51 MB, 14.51 MB, 14.51 MB, 14.51 MB, 14.51 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.67 MB (15386440) - PerHostPeakMemUsage: 2.04 GB (2191454800) - PrepareTime: 188.541ms - RowsProduced: 100 - TotalCpuTime: 498.974ms - TotalNetworkReceiveTime: 18s865ms - TotalNetworkSendTime: 267.904us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 465 - BlocksRecycled: 87 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.11 GB (118228533248) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 465.590ms, non-child: 465.590ms, % non-child: 100.00%) - CodegenTime: 5.186ms - CompileTime: 282.620ms - LoadTime: 181.593ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 71.258us, non-child: 71.258us, % non-child: 100.00%) - BytesSent: 5.77 KB (5904) - NetworkThroughput(*): 23.91 MB/sec - OverallThroughput: 79.02 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 45.721us - ThriftTransmitTime(*): 235.445us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s060ms, non-child: 853.761us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s059ms, non-child: 193.831ms, % non-child: 1.02%) ExecOption: Codegen Enabled - BuildTime: 3.313ms - GetNewBlockTime: 615.804us - GetResultsTime: 694.745us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.49 MB (15193392) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 879 - RowsReturnedRate: 46.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.649us EXCHANGE_NODE (id=15):(Total: 18s865ms, non-child: 1.108ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 67.33 KB, 201.90 KB, 537.50 KB, 738.96 KB, 805.87 KB, 1007.57 KB, 1.18 MB, 1.18 MB, 1.18 MB, 1.18 MB, 1.18 MB - BytesReceived: 1.25 MB (1306499) - ConvertRowBatchTime: 436.990us - DeserializeRowBatchTimer: 5.458ms - FirstBatchArrivalWaitTime: 13s156ms - PeakMemoryUsage: 0 - RowsReturned: 16.70K (16701) - RowsReturnedRate: 885.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b2 (host=perf20-12.cloudera.com:22000):(Total: 19s080ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.45 MB, 14.50 MB, 14.47 MB, 14.45 MB, 14.42 MB, 14.59 MB, 14.50 MB, 14.50 MB, 14.50 MB, 14.50 MB, 14.50 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.66 MB (15368384) - PerHostPeakMemUsage: 1.93 GB (2073247328) - PrepareTime: 186.729ms - RowsProduced: 100 - TotalCpuTime: 497.446ms - TotalNetworkReceiveTime: 18s866ms - TotalNetworkSendTime: 262.87us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 465 - BlocksRecycled: 87 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.50 GB (118650937344) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 464.666ms, non-child: 464.666ms, % non-child: 100.00%) - CodegenTime: 4.992ms - CompileTime: 283.230ms - LoadTime: 180.107ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 64.151us, non-child: 64.151us, % non-child: 100.00%) - BytesSent: 5.77 KB (5906) - NetworkThroughput(*): 24.17 MB/sec - OverallThroughput: 87.80 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 41.90us - ThriftTransmitTime(*): 233.80us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s059ms, non-child: 820.74us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s058ms, non-child: 191.486ms, % non-child: 1.00%) ExecOption: Codegen Enabled - BuildTime: 2.835ms - GetNewBlockTime: 577.450us - GetResultsTime: 704.584us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.48 MB (15183528) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 850 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.535us EXCHANGE_NODE (id=15):(Total: 18s867ms, non-child: 934.528us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 65.14 KB, 166.02 KB, 432.86 KB, 714.46 KB, 779.57 KB, 974.66 KB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB - BytesReceived: 1.21 MB (1263835) - ConvertRowBatchTime: 412.750us - DeserializeRowBatchTimer: 4.752ms - FirstBatchArrivalWaitTime: 13s157ms - PeakMemoryUsage: 0 - RowsReturned: 16.15K (16150) - RowsReturnedRate: 855.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70af (host=perf20-07.cloudera.com:22000):(Total: 19s080ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.45 MB, 14.58 MB, 14.50 MB, 14.51 MB, 14.51 MB, 14.42 MB, 14.53 MB, 14.53 MB, 14.53 MB, 14.53 MB, 14.53 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.68 MB (15397592) - PerHostPeakMemUsage: 1.95 GB (2097455848) - PrepareTime: 190.789ms - RowsProduced: 100 - TotalCpuTime: 501.904ms - TotalNetworkReceiveTime: 18s861ms - TotalNetworkSendTime: 242.770us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 461 - BlocksRecycled: 91 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.85 GB (117951643648) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 468.437ms, non-child: 468.437ms, % non-child: 100.00%) - CodegenTime: 5.40ms - CompileTime: 283.110ms - LoadTime: 183.929ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 80.838us, non-child: 80.838us, % non-child: 100.00%) - BytesSent: 5.81 KB (5947) - NetworkThroughput(*): 26.65 MB/sec - OverallThroughput: 70.16 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 58.7us - ThriftTransmitTime(*): 212.826us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s059ms, non-child: 834.625us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s058ms, non-child: 196.110ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 3.561ms - GetNewBlockTime: 356.559us - GetResultsTime: 714.850us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.48 MB (15183528) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 850 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.595us EXCHANGE_NODE (id=15):(Total: 18s862ms, non-child: 1.228ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 64.87 KB, 141.81 KB, 372.65 KB, 714.16 KB, 778.96 KB, 973.85 KB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB - BytesReceived: 1.20 MB (1263055) - ConvertRowBatchTime: 474.734us - DeserializeRowBatchTimer: 4.912ms - FirstBatchArrivalWaitTime: 13s155ms - PeakMemoryUsage: 0 - RowsReturned: 16.15K (16150) - RowsReturnedRate: 856.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b3 (host=perf20-19.cloudera.com:22000):(Total: 19s080ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.45 MB, 14.43 MB, 14.45 MB, 14.58 MB, 14.48 MB, 14.59 MB, 14.45 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15351640) - PerHostPeakMemUsage: 2.01 GB (2161606208) - PrepareTime: 194.184ms - RowsProduced: 100 - TotalCpuTime: 506.511ms - TotalNetworkReceiveTime: 18s858ms - TotalNetworkSendTime: 213.110us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 462 - BlocksRecycled: 90 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.27 GB (118400081920) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 472.523ms, non-child: 472.523ms, % non-child: 100.00%) - CodegenTime: 5.431ms - CompileTime: 284.94ms - LoadTime: 186.892ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 73.659us, non-child: 73.659us, % non-child: 100.00%) - BytesSent: 5.68 KB (5817) - NetworkThroughput(*): 29.75 MB/sec - OverallThroughput: 75.31 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 46.698us - ThriftTransmitTime(*): 186.478us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s059ms, non-child: 917.118us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s058ms, non-child: 199.993ms, % non-child: 1.05%) ExecOption: Codegen Enabled - BuildTime: 3.607ms - GetNewBlockTime: 796.378us - GetResultsTime: 778.940us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15166784) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 852 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 3.421us EXCHANGE_NODE (id=15):(Total: 18s858ms, non-child: 1.200ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 65.10 KB, 89.10 KB, 325.69 KB, 585.91 KB, 716.23 KB, 911.08 KB, 1.02 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB - BytesReceived: 1.21 MB (1266087) - ConvertRowBatchTime: 468.190us - DeserializeRowBatchTimer: 5.180ms - FirstBatchArrivalWaitTime: 13s150ms - PeakMemoryUsage: 0 - RowsReturned: 16.19K (16188) - RowsReturnedRate: 858.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b4 (host=perf20-09.cloudera.com:22000):(Total: 19s080ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.45 MB, 14.50 MB, 14.45 MB, 14.48 MB, 14.42 MB, 14.42 MB, 14.51 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB, 14.42 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15351640) - PerHostPeakMemUsage: 1.91 GB (2054669552) - PrepareTime: 191.618ms - RowsProduced: 100 - TotalCpuTime: 502.369ms - TotalNetworkReceiveTime: 18s862ms - TotalNetworkSendTime: 195.991us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 461 - BlocksRecycled: 91 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.08 GB (118195437568) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 470.197ms, non-child: 470.197ms, % non-child: 100.00%) - CodegenTime: 5.266ms - CompileTime: 284.255ms - LoadTime: 184.501ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 98.390us, non-child: 98.390us, % non-child: 100.00%) - BytesSent: 5.71 KB (5848) - NetworkThroughput(*): 32.69 MB/sec - OverallThroughput: 56.68 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 76.63us - ThriftTransmitTime(*): 170.605us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s060ms, non-child: 865.626us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s059ms, non-child: 196.405ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 2.775ms - GetNewBlockTime: 767.290us - GetResultsTime: 710.117us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15166784) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 852 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.567us EXCHANGE_NODE (id=15):(Total: 18s863ms, non-child: 960.565us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 65.06 KB, 112.94 KB, 325.49 KB, 585.26 KB, 715.33 KB, 910.34 KB, 1.04 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB, 1.14 MB - BytesReceived: 1.21 MB (1264846) - ConvertRowBatchTime: 403.406us - DeserializeRowBatchTimer: 4.982ms - FirstBatchArrivalWaitTime: 13s151ms - PeakMemoryUsage: 0 - RowsReturned: 16.19K (16187) - RowsReturnedRate: 858.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70ae (host=perf20-02.cloudera.com:22000):(Total: 19s079ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.41 MB, 14.44 MB, 14.41 MB, 14.41 MB, 14.60 MB, 14.43 MB, 14.43 MB, 14.44 MB, 14.44 MB, 14.44 MB, 14.44 MB, 14.44 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.63 MB (15343272) - PerHostPeakMemUsage: 1.34 GB (1440674248) - PrepareTime: 192.291ms - RowsProduced: 100 - TotalCpuTime: 482.849ms - TotalNetworkReceiveTime: 18s879ms - TotalNetworkSendTime: 245.44us - TotalStorageWaitTime: 0ns CodeGen:(Total: 469.75ms, non-child: 469.75ms, % non-child: 100.00%) - CodegenTime: 5.321ms - CompileTime: 282.561ms - LoadTime: 184.984ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 72.414us, non-child: 72.414us, % non-child: 100.00%) - BytesSent: 5.89 KB (6033) - NetworkThroughput(*): 26.47 MB/sec - OverallThroughput: 79.45 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 45.258us - ThriftTransmitTime(*): 217.365us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s078ms, non-child: 785.414us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s077ms, non-child: 197.123ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 2.755ms - GetNewBlockTime: 866.727us - GetResultsTime: 674.926us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15158416) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 804 - RowsReturnedRate: 42.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.725us EXCHANGE_NODE (id=15):(Total: 18s880ms, non-child: 946.477us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 61.37 KB, 122.73 KB, 306.88 KB, 552.16 KB, 698.75 KB, 870.75 KB, 1.04 MB, 1.08 MB, 1.08 MB, 1.08 MB, 1.08 MB, 1.08 MB - BytesReceived: 1.14 MB (1193434) - ConvertRowBatchTime: 393.98us - DeserializeRowBatchTimer: 4.747ms - FirstBatchArrivalWaitTime: 13s171ms - PeakMemoryUsage: 0 - RowsReturned: 15.28K (15276) - RowsReturnedRate: 809.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70b7 (host=perf20-16.cloudera.com:22000):(Total: 19s079ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.39 MB, 14.41 MB, 14.58 MB, 14.55 MB, 14.42 MB, 14.48 MB, 14.51 MB, 14.50 MB, 14.50 MB, 14.50 MB, 14.50 MB, 14.50 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15352016) - PerHostPeakMemUsage: 2.02 GB (2166671920) - PrepareTime: 189.149ms - RowsProduced: 100 - TotalCpuTime: 502.184ms - TotalNetworkReceiveTime: 18s863ms - TotalNetworkSendTime: 197.41us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 466 - BlocksRecycled: 86 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.94 GB (118042083328) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 469.232ms, non-child: 469.232ms, % non-child: 100.00%) - CodegenTime: 5.297ms - CompileTime: 285.740ms - LoadTime: 182.119ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 78.972us, non-child: 78.972us, % non-child: 100.00%) - BytesSent: 5.88 KB (6022) - NetworkThroughput(*): 33.67 MB/sec - OverallThroughput: 72.72 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 53.166us - ThriftTransmitTime(*): 170.548us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s060ms, non-child: 840.402us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s059ms, non-child: 195.234ms, % non-child: 1.02%) ExecOption: Codegen Enabled - BuildTime: 4.136ms - GetNewBlockTime: 395.845us - GetResultsTime: 762.329us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15167160) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 854 - RowsReturnedRate: 44.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.643us EXCHANGE_NODE (id=15):(Total: 18s864ms, non-child: 1.249ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 48.05 KB, 65.45 KB, 196.00 KB, 546.09 KB, 717.77 KB, 848.34 KB, 1.02 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.21 MB (1269464) - ConvertRowBatchTime: 481.656us - DeserializeRowBatchTimer: 4.838ms - FirstBatchArrivalWaitTime: 13s155ms - PeakMemoryUsage: 0 - RowsReturned: 16.23K (16226) - RowsReturnedRate: 860.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70ad (host=perf20-08.cloudera.com:22000):(Total: 19s079ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.42 MB, 14.41 MB, 14.46 MB, 14.59 MB, 14.49 MB, 14.43 MB, 14.46 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15353504) - PerHostPeakMemUsage: 1.89 GB (2028265056) - PrepareTime: 187.422ms - RowsProduced: 100 - TotalCpuTime: 498.753ms - TotalNetworkReceiveTime: 18s864ms - TotalNetworkSendTime: 409.622us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 466 - BlocksRecycled: 86 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.95 GB (118053232640) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 465.428ms, non-child: 465.428ms, % non-child: 100.00%) - CodegenTime: 5.162ms - CompileTime: 283.477ms - LoadTime: 180.529ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 68.598us, non-child: 68.598us, % non-child: 100.00%) - BytesSent: 5.80 KB (5938) - NetworkThroughput(*): 14.90 MB/sec - OverallThroughput: 82.55 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 43.181us - ThriftTransmitTime(*): 380.134us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s058ms, non-child: 830.405us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s057ms, non-child: 192.303ms, % non-child: 1.01%) ExecOption: Codegen Enabled - BuildTime: 2.968ms - GetNewBlockTime: 587.959us - GetResultsTime: 689.538us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.46 MB (15160456) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 880 - RowsReturnedRate: 46.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.527us EXCHANGE_NODE (id=15):(Total: 18s864ms, non-child: 1.128ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 60.05 KB, 67.42 KB, 202.10 KB, 574.07 KB, 740.02 KB, 874.53 KB, 1.05 MB, 1.18 MB, 1.18 MB, 1.18 MB, 1.18 MB, 1.18 MB - BytesReceived: 1.25 MB (1308125) - ConvertRowBatchTime: 452.164us - DeserializeRowBatchTimer: 4.987ms - FirstBatchArrivalWaitTime: 13s156ms - PeakMemoryUsage: 0 - RowsReturned: 16.72K (16720) - RowsReturnedRate: 886.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70ac (host=perf20-11.cloudera.com:22000):(Total: 19s079ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.41 MB, 14.48 MB, 14.49 MB, 14.62 MB, 14.48 MB, 14.41 MB, 14.48 MB, 14.49 MB, 14.49 MB, 14.49 MB, 14.49 MB, 14.49 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.65 MB (15359656) - PerHostPeakMemUsage: 1.91 GB (2055476632) - PrepareTime: 188.377ms - RowsProduced: 100 - TotalCpuTime: 497.757ms - TotalNetworkReceiveTime: 18s865ms - TotalNetworkSendTime: 203.842us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 462 - BlocksRecycled: 90 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 109.80 GB (117900943360) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 466.151ms, non-child: 466.151ms, % non-child: 100.00%) - CodegenTime: 5.225ms - CompileTime: 283.359ms - LoadTime: 181.437ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 72.516us, non-child: 72.516us, % non-child: 100.00%) - BytesSent: 5.82 KB (5959) - NetworkThroughput(*): 34.93 MB/sec - OverallThroughput: 78.37 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 46.182us - ThriftTransmitTime(*): 162.689us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s059ms, non-child: 843.333us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s059ms, non-child: 193.243ms, % non-child: 1.01%) ExecOption: Codegen Enabled - BuildTime: 3.131ms - GetNewBlockTime: 319.192us - GetResultsTime: 656.639us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.47 MB (15174800) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 809 - RowsReturnedRate: 42.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.919us EXCHANGE_NODE (id=15):(Total: 18s865ms, non-child: 1.154ms, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 61.73 KB, 85.72 KB, 309.42 KB, 556.67 KB, 680.36 KB, 865.62 KB, 989.24 KB, 1.09 MB, 1.09 MB, 1.09 MB, 1.09 MB, 1.09 MB - BytesReceived: 1.15 MB (1202721) - ConvertRowBatchTime: 456.865us - DeserializeRowBatchTimer: 4.861ms - FirstBatchArrivalWaitTime: 13s157ms - PeakMemoryUsage: 0 - RowsReturned: 15.37K (15371) - RowsReturnedRate: 814.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70ab (host=perf20-06.cloudera.com:22000):(Total: 19s078ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 6.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.42 MB, 14.49 MB, 14.58 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB, 14.43 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.64 MB (15350528) - PerHostPeakMemUsage: 1.87 GB (2012847424) - PrepareTime: 189.162ms - RowsProduced: 100 - TotalCpuTime: 498.944ms - TotalNetworkReceiveTime: 18s863ms - TotalNetworkSendTime: 202.643us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 463 - BlocksRecycled: 89 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 111.49 GB (119707770880) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 467.426ms, non-child: 467.426ms, % non-child: 100.00%) - CodegenTime: 5.172ms - CompileTime: 283.859ms - LoadTime: 182.93ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 66.159us, non-child: 66.159us, % non-child: 100.00%) - BytesSent: 5.73 KB (5870) - NetworkThroughput(*): 31.88 MB/sec - OverallThroughput: 84.62 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 42.708us - ThriftTransmitTime(*): 175.609us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s058ms, non-child: 834.442us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s058ms, non-child: 193.916ms, % non-child: 1.02%) ExecOption: Codegen Enabled - BuildTime: 2.839ms - GetNewBlockTime: 540.457us - GetResultsTime: 717.286us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.47 MB (15174600) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 894 - RowsReturnedRate: 46.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.504us EXCHANGE_NODE (id=15):(Total: 18s864ms, non-child: 951.408us, % non-child: 0.01%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 68.45 KB, 136.91 KB, 342.08 KB, 743.37 KB, 820.07 KB, 1.00 MB, 1.20 MB, 1.20 MB, 1.20 MB, 1.20 MB, 1.20 MB - BytesReceived: 1.27 MB (1329313) - ConvertRowBatchTime: 416.396us - DeserializeRowBatchTimer: 5.350ms - FirstBatchArrivalWaitTime: 13s158ms - PeakMemoryUsage: 0 - RowsReturned: 16.99K (16986) - RowsReturnedRate: 900.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Instance 19410b874827c24d:891b7d58465b70aa (host=perf20-10.cloudera.com:22000):(Total: 19s077ms, non-child: 0ns, % non-child: 0.00%) MemoryUsage(500.0ms): 0, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.27 MB, 14.41 MB, 14.41 MB, 14.48 MB, 14.54 MB, 14.45 MB, 14.54 MB, 14.48 MB, 14.41 MB, 14.41 MB, 14.41 MB, 14.41 MB, 14.41 MB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 14.65 MB (15359656) - PerHostPeakMemUsage: 1.91 GB (2053685920) - PrepareTime: 191.639ms - RowsProduced: 100 - TotalCpuTime: 502.761ms - TotalNetworkReceiveTime: 18s859ms - TotalNetworkSendTime: 195.362us - TotalStorageWaitTime: 0ns BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 470 - BlocksRecycled: 82 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 110.24 GB (118366814208) - PeakMemoryUsage: 17.51 MB (18358368) - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 469.736ms, non-child: 469.736ms, % non-child: 100.00%) - CodegenTime: 5.275ms - CompileTime: 283.734ms - LoadTime: 184.574ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=17):(Total: 69.690us, non-child: 69.690us, % non-child: 100.00%) - BytesSent: 5.73 KB (5869) - NetworkThroughput(*): 33.28 MB/sec - OverallThroughput: 80.31 MB/sec - PeakMemoryUsage: 4.00 KB (4096) - SerializeBatchTime: 44.582us - ThriftTransmitTime(*): 168.188us - UncompressedRowBatchSize: 9.18 KB (9404) SORT_NODE (id=10):(Total: 19s057ms, non-child: 813.405us, % non-child: 0.00%) - PeakMemoryUsage: 52.00 KB (53248) - RowsReturned: 100 - RowsReturnedRate: 5.00 /sec AGGREGATION_NODE (id=16):(Total: 19s056ms, non-child: 196.690ms, % non-child: 1.03%) ExecOption: Codegen Enabled - BuildTime: 2.879ms - GetNewBlockTime: 700.443us - GetResultsTime: 868.328us - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.47 MB (15174800) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 822 - RowsReturnedRate: 43.00 /sec - SpilledPartitions: 0 - UnpinTime: 3.47us EXCHANGE_NODE (id=15):(Total: 18s859ms, non-child: 940.677us, % non-child: 0.00%) BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 63.05 KB, 63.05 KB, 188.85 KB, 551.02 KB, 691.49 KB, 817.13 KB, 1005.78 KB, 1.10 MB, 1.10 MB, 1.10 MB, 1.10 MB, 1.10 MB - BytesReceived: 1.17 MB (1222746) - ConvertRowBatchTime: 392.889us - DeserializeRowBatchTimer: 4.709ms - FirstBatchArrivalWaitTime: 13s153ms - PeakMemoryUsage: 0 - RowsReturned: 15.62K (15618) - RowsReturnedRate: 828.00 /sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment F00: Instance 19410b874827c24d:891b7d58465b70c3 (host=perf20-18.cloudera.com:22000):(Total: 18s614ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:3/741.52 MB 5:5/1.15 GB 0:5/1.01 GB 9:11/2.64 GB 8:12/2.58 GB 1:4/936.43 MB 2:7/1.63 GB 7:9/1.79 GB 4:6/1.26 GB 10:6/1.24 GB 6:8/1.88 GB MemoryUsage(500.0ms): 9.81 MB, 931.49 MB, 1.84 GB, 1.88 GB, 1.98 GB, 1.96 GB, 1.95 GB, 1.92 GB, 1.90 GB, 1.97 GB, 2.03 GB, 2.03 GB, 1.99 GB, 2.00 GB, 1.99 GB, 2.01 GB, 2.00 GB, 1.99 GB, 1.99 GB, 1.97 GB, 1.92 GB, 1.68 GB, 1.43 GB, 1.18 GB, 1007.42 MB, 641.51 MB, 537.31 MB, 346.86 MB, 300.94 MB, 213.93 MB, 198.29 MB, 162.38 MB, 164.34 MB, 142.90 MB, 137.35 MB, 102.10 MB, 88.61 MB, 69.94 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 31, 27, 22, 19, 12, 10, 7, 6, 4, 4, 3, 3, 3, 3, 2, 2, 2 - AverageThreadTokens: 23.18 - PeakMemoryUsage: 2.08 GB (2237638520) - PerHostPeakMemUsage: 2.10 GB (2252597112) - PrepareTime: 196.443ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 7m7s - TotalNetworkReceiveTime: 219.8us - TotalNetworkSendTime: 3.365ms - TotalStorageWaitTime: 12s083ms CodeGen:(Total: 691.439ms, non-child: 691.439ms, % non-child: 100.00%) - CodegenTime: 4.986ms - CompileTime: 513.782ms - LoadTime: 176.326ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.642ms, non-child: 13.642ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1249456) - NetworkThroughput(*): 47.33 MB/sec - OverallThroughput: 87.34 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.511ms - ThriftTransmitTime(*): 25.175ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 18s598ms, non-child: 866.707ms, % non-child: 4.66%) ExecOption: Codegen Enabled - BuildTime: 649.520ms - GetNewBlockTime: 808.723us - GetResultsTime: 22.914ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 36.90 MB (38691008) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 860.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.790us HASH_JOIN_NODE (id=8):(Total: 17s731ms, non-child: 73.626ms, % non-child: 0.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 22.822us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 42.922us - GetNewBlockTime: 1.679ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.26 MB (21244256) - PinTime: 0ns - ProbeRows: 398.78K (398778) - ProbeRowsPartitioned: 0 - ProbeTime: 42.532ms - RowsReturned: 398.78K (398778) - RowsReturnedRate: 22.49 K/sec - SpilledPartitions: 0 - UnpinTime: 2.389us EXCHANGE_NODE (id=14):(Total: 17.300us, non-child: 17.300us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.118us - DeserializeRowBatchTimer: 13.192us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 21.10 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 17s660ms, non-child: 195.900ms, % non-child: 1.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.89ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.553ms - GetNewBlockTime: 1.752ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.02 MB (15751192) - PinTime: 0ns - ProbeRows: 398.78K (398778) - ProbeRowsPartitioned: 0 - ProbeTime: 164.27ms - RowsReturned: 398.78K (398778) - RowsReturnedRate: 22.58 K/sec - SpilledPartitions: 0 - UnpinTime: 2.232us EXCHANGE_NODE (id=13):(Total: 801.353us, non-child: 801.353us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 632.488us - DeserializeRowBatchTimer: 2.314ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 39.93 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 17s476ms, non-child: 1s712ms, % non-child: 9.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 5.159ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.302ms - GetNewBlockTime: 1.864ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.40 MB (7760160) - PinTime: 0ns - ProbeRows: 31.22M (31219521) - ProbeRowsPartitioned: 0 - ProbeTime: 1s456ms - RowsReturned: 398.78K (398778) - RowsReturnedRate: 22.82 K/sec - SpilledPartitions: 0 - UnpinTime: 2.202us EXCHANGE_NODE (id=12):(Total: 803.550us, non-child: 803.550us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 587.661us - DeserializeRowBatchTimer: 4.308ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 34.15 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 15s778ms, non-child: 2s855ms, % non-child: 18.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 2.765us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 8.960us - GetNewBlockTime: 1.701ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 42.98M (42984790) - ProbeRowsPartitioned: 0 - ProbeTime: 2s630ms - RowsReturned: 31.22M (31219521) - RowsReturnedRate: 1.98 M/sec - SpilledPartitions: 0 - UnpinTime: 2.71us EXCHANGE_NODE (id=11):(Total: 6.871us, non-child: 6.871us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.52us - DeserializeRowBatchTimer: 4.716us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 873.24 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 12s925ms, non-child: 12s925ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:3/741.52 MB 5:5/1.15 GB 0:5/1.01 GB 9:11/2.64 GB 8:12/2.58 GB 1:4/936.43 MB 2:7/1.63 GB 7:9/1.79 GB 4:6/1.26 GB 10:6/1.24 GB 6:8/1.88 GB Hdfs Read Thread Concurrency Bucket: 0:91.89% 1:5.405% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:2.703% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:532 ExecOption: Codegen enabled: 0 out of 76 BytesRead(500.0ms): 0, 671.02 MB, 1.49 GB, 1.53 GB, 1.63 GB, 1.63 GB, 1.63 GB, 1.73 GB, 1.93 GB, 2.30 GB, 2.43 GB, 2.47 GB, 2.53 GB, 2.65 GB, 2.74 GB, 2.80 GB, 2.84 GB, 2.90 GB, 3.03 GB, 3.08 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB, 3.12 GB - AverageHdfsReadThreadConcurrency: 0.30 - AverageScannerThreadConcurrency: 22.78 - BytesRead: 3.12 GB (3352415919) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.12 GB (3352415919) - BytesReadShortCircuit: 3.12 GB (3352415919) - DecompressionTime: 12s918ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 2.05 GB (2198556816) - PerReadThreadRawHdfsThroughput: 695.50 MB/sec - RowsRead: 487.49M (487486721) - RowsReturned: 42.98M (42984790) - RowsReturnedRate: 3.33 M/sec - ScanRangesComplete: 76 - ScannerThreadsInvoluntaryContextSwitches: 34.12K (34117) - ScannerThreadsTotalWallClockTime: 7m - MaterializeTupleTime(*): 6m33s - ScannerThreadsSysTime: 382.926ms - ScannerThreadsUserTime: 4m52s - ScannerThreadsVoluntaryContextSwitches: 3.44K (3439) - TotalRawHdfsReadTime(*): 4s596ms - TotalReadThroughput: 168.27 MB/sec Instance 19410b874827c24d:891b7d58465b70cc (host=perf20-14.cloudera.com:22000):(Total: 16s067ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:7/1.41 GB 3:8/1.84 GB 9:11/2.48 GB 8:4/758.11 MB 10:3/514.77 MB 7:11/2.65 GB 0:2/504.75 MB 5:6/1.46 GB 6:9/1.97 GB 2:8/1.52 GB 4:8/1.60 GB MemoryUsage(500.0ms): 6.41 MB, 9.82 MB, 1.62 GB, 1.74 GB, 1.82 GB, 1.82 GB, 1.84 GB, 1.80 GB, 1.84 GB, 1.77 GB, 1.80 GB, 1.92 GB, 1.97 GB, 2.00 GB, 2.01 GB, 2.01 GB, 1.99 GB, 1.96 GB, 1.86 GB, 1.79 GB, 1.67 GB, 1.54 GB, 1.52 GB, 1.31 GB, 1.01 GB, 855.89 MB, 605.21 MB, 473.09 MB, 385.49 MB, 316.89 MB, 214.46 MB, 187.06 MB, 82.64 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 32, 30, 27, 27, 24, 19, 15, 11, 8, 6, 6, 4, 4, 2 - AverageThreadTokens: 25.00 - PeakMemoryUsage: 2.03 GB (2181419120) - PerHostPeakMemUsage: 2.05 GB (2196377712) - PrepareTime: 199.942ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m50s - TotalNetworkReceiveTime: 192.854us - TotalNetworkSendTime: 3.642ms - TotalStorageWaitTime: 11s119ms CodeGen:(Total: 694.674ms, non-child: 694.674ms, % non-child: 100.00%) - CodegenTime: 5.88ms - CompileTime: 514.537ms - LoadTime: 178.802ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.793ms, non-child: 13.793ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1250332) - NetworkThroughput(*): 44.49 MB/sec - OverallThroughput: 86.45 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.631ms - ThriftTransmitTime(*): 26.801ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 16s051ms, non-child: 829.270ms, % non-child: 5.17%) ExecOption: Codegen Enabled - BuildTime: 612.501ms - GetNewBlockTime: 359.929us - GetResultsTime: 23.73ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 35.14 MB (36844984) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 996.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.515us HASH_JOIN_NODE (id=8):(Total: 15s222ms, non-child: 68.650ms, % non-child: 0.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 21.775us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 49.160us - GetNewBlockTime: 1.592ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 19.67 MB (20625016) - PinTime: 0ns - ProbeRows: 435.99K (435994) - ProbeRowsPartitioned: 0 - ProbeTime: 44.884ms - RowsReturned: 435.99K (435994) - RowsReturnedRate: 28.64 K/sec - SpilledPartitions: 0 - UnpinTime: 2.230us EXCHANGE_NODE (id=14):(Total: 18.294us, non-child: 18.294us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.101us - DeserializeRowBatchTimer: 13.739us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 19.95 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 15s156ms, non-child: 171.654ms, % non-child: 1.13%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 2.812ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.194ms - GetNewBlockTime: 1.759ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.10 MB (15837800) - PinTime: 0ns - ProbeRows: 435.99K (435994) - ProbeRowsPartitioned: 0 - ProbeTime: 141.611ms - RowsReturned: 435.99K (435994) - RowsReturnedRate: 28.77 K/sec - SpilledPartitions: 0 - UnpinTime: 2.206us EXCHANGE_NODE (id=13):(Total: 754.494us, non-child: 754.494us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 621.474us - DeserializeRowBatchTimer: 2.19ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 42.41 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s995ms, non-child: 1s406ms, % non-child: 9.38%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.337ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.591ms - GetNewBlockTime: 1.870ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.24 MB (7595464) - PinTime: 0ns - ProbeRows: 27.19M (27190052) - ProbeRowsPartitioned: 0 - ProbeTime: 1s230ms - RowsReturned: 435.99K (435994) - RowsReturnedRate: 29.07 K/sec - SpilledPartitions: 0 - UnpinTime: 2.193us EXCHANGE_NODE (id=12):(Total: 758.894us, non-child: 758.894us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 542.830us - DeserializeRowBatchTimer: 4.158ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.16 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 13s600ms, non-child: 2s211ms, % non-child: 16.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.763us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 8.475us - GetNewBlockTime: 1.754ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 37.55M (37551330) - ProbeRowsPartitioned: 0 - ProbeTime: 2s043ms - RowsReturned: 27.19M (27190052) - RowsReturnedRate: 2.00 M/sec - SpilledPartitions: 0 - UnpinTime: 2.181us EXCHANGE_NODE (id=11):(Total: 7.953us, non-child: 7.953us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 909ns - DeserializeRowBatchTimer: 8.963us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 754.43 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 11s391ms, non-child: 11s391ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:7/1.41 GB 3:8/1.84 GB 9:11/2.48 GB 8:4/758.11 MB 10:3/514.77 MB 7:11/2.65 GB 0:2/504.75 MB 5:6/1.46 GB 6:9/1.97 GB 2:8/1.52 GB 4:8/1.60 GB Hdfs Read Thread Concurrency Bucket: 0:96.77% 1:3.226% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:539 ExecOption: Codegen enabled: 0 out of 77 BytesRead(500.0ms): 0, 0, 1.27 GB, 1.38 GB, 1.50 GB, 1.50 GB, 1.54 GB, 1.54 GB, 1.62 GB, 1.79 GB, 2.02 GB, 2.43 GB, 2.64 GB, 2.75 GB, 2.84 GB, 2.88 GB, 2.88 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB - AverageHdfsReadThreadConcurrency: 0.03 - AverageScannerThreadConcurrency: 25.55 - BytesRead: 3.00 GB (3224548487) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.00 GB (3224548487) - BytesReadShortCircuit: 3.00 GB (3224548487) - DecompressionTime: 10s993ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.98 GB (2129546768) - PerReadThreadRawHdfsThroughput: 751.02 MB/sec - RowsRead: 440.72M (440715794) - RowsReturned: 37.55M (37551330) - RowsReturnedRate: 3.30 M/sec - ScanRangesComplete: 77 - ScannerThreadsInvoluntaryContextSwitches: 36.20K (36202) - ScannerThreadsTotalWallClockTime: 6m45s - MaterializeTupleTime(*): 6m21s - ScannerThreadsSysTime: 403.922ms - ScannerThreadsUserTime: 4m50s - ScannerThreadsVoluntaryContextSwitches: 2.23K (2230) - TotalRawHdfsReadTime(*): 4s094ms - TotalReadThroughput: 186.37 MB/sec Instance 19410b874827c24d:891b7d58465b70ca (host=perf20-16.cloudera.com:22000):(Total: 16s056ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:3/757.39 MB 10:4/961.59 MB 3:8/1.70 GB 6:4/1009.74 MB 7:7/1.48 GB 9:8/1.97 GB 0:4/985.35 MB 5:10/2.00 GB 1:8/1.78 GB 2:7/1.73 GB 8:9/2.17 GB MemoryUsage(500.0ms): 9.81 MB, 1.01 GB, 1.71 GB, 1.74 GB, 1.78 GB, 1.78 GB, 1.76 GB, 1.81 GB, 1.74 GB, 1.81 GB, 1.90 GB, 1.84 GB, 1.90 GB, 1.97 GB, 1.98 GB, 1.98 GB, 1.94 GB, 1.92 GB, 1.87 GB, 1.76 GB, 1.46 GB, 1.41 GB, 1.15 GB, 961.75 MB, 818.27 MB, 699.07 MB, 584.92 MB, 433.23 MB, 300.41 MB, 161.51 MB, 95.39 MB, 97.53 MB, 71.84 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 34, 33, 26, 26, 20, 16, 14, 12, 11, 8, 6, 3, 2, 2, 2 - AverageThreadTokens: 25.06 - PeakMemoryUsage: 2.00 GB (2151713328) - PerHostPeakMemUsage: 2.02 GB (2166671920) - PrepareTime: 195.783ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m41s - TotalNetworkReceiveTime: 189.519us - TotalNetworkSendTime: 3.688ms - TotalStorageWaitTime: 10s457ms CodeGen:(Total: 698.64ms, non-child: 698.64ms, % non-child: 100.00%) - CodegenTime: 5.78ms - CompileTime: 521.288ms - LoadTime: 175.330ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.691ms, non-child: 13.691ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1250389) - NetworkThroughput(*): 45.10 MB/sec - OverallThroughput: 87.09 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.460ms - ThriftTransmitTime(*): 26.438ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 16s039ms, non-child: 823.199ms, % non-child: 5.13%) ExecOption: Codegen Enabled - BuildTime: 606.960ms - GetNewBlockTime: 413.511us - GetResultsTime: 23.413ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 31.86 MB (33406392) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 997.00 /sec - SpilledPartitions: 0 - UnpinTime: 2.782us HASH_JOIN_NODE (id=8):(Total: 15s216ms, non-child: 69.3ms, % non-child: 0.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 20.77us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 48.191us - GetNewBlockTime: 1.737ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.30 MB (21284584) - PinTime: 0ns - ProbeRows: 441.95K (441953) - ProbeRowsPartitioned: 0 - ProbeTime: 44.974ms - RowsReturned: 441.95K (441953) - RowsReturnedRate: 29.04 K/sec - SpilledPartitions: 0 - UnpinTime: 2.313us EXCHANGE_NODE (id=14):(Total: 17.199us, non-child: 17.199us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.342us - DeserializeRowBatchTimer: 17.453us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 21.22 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 15s150ms, non-child: 176.187ms, % non-child: 1.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.102ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.190ms - GetNewBlockTime: 1.935ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.96 MB (15690336) - PinTime: 0ns - ProbeRows: 441.95K (441953) - ProbeRowsPartitioned: 0 - ProbeTime: 145.727ms - RowsReturned: 441.95K (441953) - RowsReturnedRate: 29.17 K/sec - SpilledPartitions: 0 - UnpinTime: 2.387us EXCHANGE_NODE (id=13):(Total: 759.679us, non-child: 759.679us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 614.230us - DeserializeRowBatchTimer: 2.507ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 42.12 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s985ms, non-child: 1s324ms, % non-child: 8.84%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.570ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.809ms - GetNewBlockTime: 2.50ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.27 MB (7627896) - PinTime: 0ns - ProbeRows: 26.84M (26841036) - ProbeRowsPartitioned: 0 - ProbeTime: 1s127ms - RowsReturned: 441.95K (441953) - RowsReturnedRate: 29.49 K/sec - SpilledPartitions: 0 - UnpinTime: 2.276us EXCHANGE_NODE (id=12):(Total: 748.684us, non-child: 748.684us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 546.544us - DeserializeRowBatchTimer: 4.871ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.65 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 13s672ms, non-child: 2s180ms, % non-child: 15.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.2us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.335us - GetNewBlockTime: 1.999ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 37.28M (37281046) - ProbeRowsPartitioned: 0 - ProbeTime: 2s010ms - RowsReturned: 26.84M (26841036) - RowsReturnedRate: 1.96 M/sec - SpilledPartitions: 0 - UnpinTime: 2.224us EXCHANGE_NODE (id=11):(Total: 8.144us, non-child: 8.144us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 895ns - DeserializeRowBatchTimer: 6.447us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 736.74 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 11s494ms, non-child: 11s494ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:3/757.39 MB 10:4/961.59 MB 3:8/1.70 GB 6:4/1009.74 MB 7:7/1.48 GB 9:8/1.97 GB 0:4/985.35 MB 5:10/2.00 GB 1:8/1.78 GB 2:7/1.73 GB 8:9/2.17 GB Hdfs Read Thread Concurrency Bucket: 0:87.5% 1:9.375% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:3.125% 11:0% 12:0% File Formats: PARQUET/SNAPPY:504 ExecOption: Codegen enabled: 0 out of 72 BytesRead(500.0ms): 0, 756.64 MB, 1.38 GB, 1.43 GB, 1.47 GB, 1.47 GB, 1.48 GB, 1.59 GB, 1.71 GB, 2.03 GB, 2.27 GB, 2.36 GB, 2.64 GB, 2.82 GB, 2.87 GB, 2.92 GB, 2.92 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 24.81 - BytesRead: 2.96 GB (3182948156) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.96 GB (3182948156) - BytesReadShortCircuit: 2.96 GB (3182948156) - DecompressionTime: 10s954ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.97 GB (2111145024) - PerReadThreadRawHdfsThroughput: 838.44 MB/sec - RowsRead: 442.16M (442156579) - RowsReturned: 37.28M (37281046) - RowsReturnedRate: 3.24 M/sec - ScanRangesComplete: 72 - ScannerThreadsInvoluntaryContextSwitches: 34.49K (34494) - ScannerThreadsTotalWallClockTime: 6m35s - MaterializeTupleTime(*): 6m12s - ScannerThreadsSysTime: 377.926ms - ScannerThreadsUserTime: 4m41s - ScannerThreadsVoluntaryContextSwitches: 2.10K (2104) - TotalRawHdfsReadTime(*): 3s620ms - TotalReadThroughput: 183.97 MB/sec Instance 19410b874827c24d:891b7d58465b70c9 (host=perf20-03.cloudera.com:22000):(Total: 15s903ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:4/1009.69 MB 4:5/792.44 MB 6:5/1.18 GB 2:6/1.34 GB 10:7/1.33 GB 8:5/1.21 GB 3:11/2.13 GB 1:7/1.67 GB 7:6/1.42 GB 5:9/1.68 GB 0:13/3.00 GB MemoryUsage(500.0ms): 9.81 MB, 547.48 MB, 1.81 GB, 1.80 GB, 1.86 GB, 1.87 GB, 1.86 GB, 1.85 GB, 1.82 GB, 1.85 GB, 1.82 GB, 1.80 GB, 1.86 GB, 1.82 GB, 1.91 GB, 1.91 GB, 1.84 GB, 1.91 GB, 1.78 GB, 1.73 GB, 1.60 GB, 1.38 GB, 1.22 GB, 917.32 MB, 708.60 MB, 607.67 MB, 428.47 MB, 282.16 MB, 241.16 MB, 158.41 MB, 104.39 MB, 87.19 MB, 87.71 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 32, 29, 25, 23, 16, 12, 11, 8, 5, 5, 3, 2, 2, 2 - AverageThreadTokens: 24.88 - PeakMemoryUsage: 1.93 GB (2072998696) - PerHostPeakMemUsage: 1.94 GB (2087957288) - PrepareTime: 199.536ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m33s - TotalNetworkReceiveTime: 199.852us - TotalNetworkSendTime: 3.422ms - TotalStorageWaitTime: 10s960ms CodeGen:(Total: 697.951ms, non-child: 697.951ms, % non-child: 100.00%) - CodegenTime: 5.301ms - CompileTime: 518.676ms - LoadTime: 177.900ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.357ms, non-child: 14.357ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1251016) - NetworkThroughput(*): 45.23 MB/sec - OverallThroughput: 83.10 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.853ms - ThriftTransmitTime(*): 26.375ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 15s886ms, non-child: 839.730ms, % non-child: 5.29%) ExecOption: Codegen Enabled - BuildTime: 620.535ms - GetNewBlockTime: 398.483us - GetResultsTime: 24.77ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 31.66 MB (33197752) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.01 K/sec - SpilledPartitions: 0 - UnpinTime: 2.638us HASH_JOIN_NODE (id=8):(Total: 15s046ms, non-child: 63.217ms, % non-child: 0.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.211us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 45.602us - GetNewBlockTime: 1.965ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 18.88 MB (19796360) - PinTime: 0ns - ProbeRows: 365.63K (365631) - ProbeRowsPartitioned: 0 - ProbeTime: 38.788ms - RowsReturned: 365.63K (365631) - RowsReturnedRate: 24.30 K/sec - SpilledPartitions: 0 - UnpinTime: 2.365us EXCHANGE_NODE (id=14):(Total: 16.428us, non-child: 16.428us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 7.830us - DeserializeRowBatchTimer: 14.253us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 22.22 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 14s986ms, non-child: 167.59ms, % non-child: 1.11%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 2.998ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.132ms - GetNewBlockTime: 1.909ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.02 MB (15751064) - PinTime: 0ns - ProbeRows: 365.63K (365631) - ProbeRowsPartitioned: 0 - ProbeTime: 136.678ms - RowsReturned: 365.63K (365631) - RowsReturnedRate: 24.40 K/sec - SpilledPartitions: 0 - UnpinTime: 2.192us EXCHANGE_NODE (id=13):(Total: 765.309us, non-child: 765.309us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 617.81us - DeserializeRowBatchTimer: 2.457ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 41.81 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s829ms, non-child: 1s283ms, % non-child: 8.65%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.382ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.70ms - GetNewBlockTime: 1.969ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.26 MB (7610264) - PinTime: 0ns - ProbeRows: 26.71M (26712405) - ProbeRowsPartitioned: 0 - ProbeTime: 1s083ms - RowsReturned: 365.63K (365631) - RowsReturnedRate: 24.65 K/sec - SpilledPartitions: 0 - UnpinTime: 2.364us EXCHANGE_NODE (id=12):(Total: 751.173us, non-child: 751.173us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 541.323us - DeserializeRowBatchTimer: 4.128ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.53 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 13s559ms, non-child: 2s152ms, % non-child: 15.87%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.777us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.918us - GetNewBlockTime: 1.919ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 36.82M (36818971) - ProbeRowsPartitioned: 0 - ProbeTime: 1s969ms - RowsReturned: 26.71M (26712405) - RowsReturnedRate: 1.97 M/sec - SpilledPartitions: 0 - UnpinTime: 2.154us EXCHANGE_NODE (id=11):(Total: 7.779us, non-child: 7.779us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 991ns - DeserializeRowBatchTimer: 5.148us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 771.31 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 11s409ms, non-child: 11s409ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:4/1009.69 MB 4:5/792.44 MB 6:5/1.18 GB 2:6/1.34 GB 10:7/1.33 GB 8:5/1.21 GB 3:11/2.13 GB 1:7/1.67 GB 7:6/1.42 GB 5:9/1.68 GB 0:13/3.00 GB Hdfs Read Thread Concurrency Bucket: 0:93.75% 1:3.125% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:3.125% 11:0% 12:0% File Formats: PARQUET/SNAPPY:546 ExecOption: Codegen enabled: 0 out of 78 BytesRead(500.0ms): 0, 354.46 MB, 1.47 GB, 1.47 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.58 GB, 1.71 GB, 1.92 GB, 2.00 GB, 2.25 GB, 2.45 GB, 2.50 GB, 2.67 GB, 2.71 GB, 2.83 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB - AverageHdfsReadThreadConcurrency: 0.34 - AverageScannerThreadConcurrency: 24.62 - BytesRead: 2.98 GB (3200546225) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.98 GB (3200546225) - BytesReadShortCircuit: 2.98 GB (3200546225) - DecompressionTime: 11s220ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.89 GB (2032589640) - PerReadThreadRawHdfsThroughput: 816.81 MB/sec - RowsRead: 432.04M (432042691) - RowsReturned: 36.82M (36818971) - RowsReturnedRate: 3.23 M/sec - ScanRangesComplete: 78 - ScannerThreadsInvoluntaryContextSwitches: 33.85K (33853) - ScannerThreadsTotalWallClockTime: 6m27s - MaterializeTupleTime(*): 6m4s - ScannerThreadsSysTime: 398.919ms - ScannerThreadsUserTime: 4m33s - ScannerThreadsVoluntaryContextSwitches: 2.19K (2192) - TotalRawHdfsReadTime(*): 3s736ms - TotalReadThroughput: 184.99 MB/sec Instance 19410b874827c24d:891b7d58465b70c7 (host=perf20-09.cloudera.com:22000):(Total: 15s576ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:6/1.48 GB 9:4/1009.71 MB 10:8/1.97 GB 7:8/1.92 GB 6:4/541.89 MB 3:8/1.73 GB 1:9/2.17 GB 2:7/1.71 GB 5:10/2.45 GB 0:8/1.71 GB 8:2/261.29 MB MemoryUsage(500.0ms): 0, 9.81 MB, 1.30 GB, 1.83 GB, 1.83 GB, 1.83 GB, 1.83 GB, 1.81 GB, 1.82 GB, 1.81 GB, 1.74 GB, 1.75 GB, 1.82 GB, 1.88 GB, 1.88 GB, 1.86 GB, 1.87 GB, 1.84 GB, 1.85 GB, 1.64 GB, 1.42 GB, 1.28 GB, 911.76 MB, 748.70 MB, 698.13 MB, 516.53 MB, 460.82 MB, 337.15 MB, 183.28 MB, 137.20 MB, 141.89 MB, 86.99 MB, 67.45 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 27, 26, 17, 13, 13, 9, 9, 7, 4, 3, 3, 2, 2 - AverageThreadTokens: 23.67 - PeakMemoryUsage: 1.90 GB (2039710960) - PerHostPeakMemUsage: 1.91 GB (2054669552) - PrepareTime: 200.199ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m21s - TotalNetworkReceiveTime: 198.179us - TotalNetworkSendTime: 3.261ms - TotalStorageWaitTime: 11s689ms CodeGen:(Total: 707.564ms, non-child: 707.564ms, % non-child: 100.00%) - CodegenTime: 5.313ms - CompileTime: 527.506ms - LoadTime: 178.583ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.698ms, non-child: 13.698ms, % non-child: 100.00%) - BytesSent: 1.20 MB (1253263) - NetworkThroughput(*): 51.11 MB/sec - OverallThroughput: 87.25 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.475ms - ThriftTransmitTime(*): 23.384ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 15s560ms, non-child: 855.122ms, % non-child: 5.50%) ExecOption: Codegen Enabled - BuildTime: 632.386ms - GetNewBlockTime: 770.396us - GetResultsTime: 25.271ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 25.67 MB (26915712) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.03 K/sec - SpilledPartitions: 0 - UnpinTime: 2.636us HASH_JOIN_NODE (id=8):(Total: 14s705ms, non-child: 57.215ms, % non-child: 0.39%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.415us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 42.876us - GetNewBlockTime: 1.944ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.36 MB (16102272) - PinTime: 0ns - ProbeRows: 265.30K (265298) - ProbeRowsPartitioned: 0 - ProbeTime: 33.365ms - RowsReturned: 265.30K (265298) - RowsReturnedRate: 18.04 K/sec - SpilledPartitions: 0 - UnpinTime: 2.418us EXCHANGE_NODE (id=14):(Total: 17.849us, non-child: 17.849us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.982us - DeserializeRowBatchTimer: 32.283us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.45 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 14s650ms, non-child: 172.459ms, % non-child: 1.18%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.196ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.795ms - GetNewBlockTime: 2.80ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.79 MB (16561024) - PinTime: 0ns - ProbeRows: 265.30K (265298) - ProbeRowsPartitioned: 0 - ProbeTime: 142.557ms - RowsReturned: 265.30K (265298) - RowsReturnedRate: 18.11 K/sec - SpilledPartitions: 0 - UnpinTime: 2.231us EXCHANGE_NODE (id=13):(Total: 774.406us, non-child: 774.406us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 622.853us - DeserializeRowBatchTimer: 2.601ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 41.32 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s488ms, non-child: 1s420ms, % non-child: 9.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.266ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.798ms - GetNewBlockTime: 2.80ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.40 MB (7761936) - PinTime: 0ns - ProbeRows: 24.65M (24645053) - ProbeRowsPartitioned: 0 - ProbeTime: 1s187ms - RowsReturned: 265.30K (265298) - RowsReturnedRate: 18.31 K/sec - SpilledPartitions: 0 - UnpinTime: 2.278us EXCHANGE_NODE (id=12):(Total: 755.828us, non-child: 755.828us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 540.100us - DeserializeRowBatchTimer: 4.745ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.30 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 13s080ms, non-child: 2s180ms, % non-child: 16.67%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.583us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 6.937us - GetNewBlockTime: 1.968ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 34.44M (34441321) - ProbeRowsPartitioned: 0 - ProbeTime: 2s015ms - RowsReturned: 24.65M (24645053) - RowsReturnedRate: 1.88 M/sec - SpilledPartitions: 0 - UnpinTime: 2.161us EXCHANGE_NODE (id=11):(Total: 7.691us, non-child: 7.691us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.203us - DeserializeRowBatchTimer: 5.663us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 780.13 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s902ms, non-child: 10s902ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:6/1.48 GB 9:4/1009.71 MB 10:8/1.97 GB 7:8/1.92 GB 6:4/541.89 MB 3:8/1.73 GB 1:9/2.17 GB 2:7/1.71 GB 5:10/2.45 GB 0:8/1.71 GB 8:2/261.29 MB Hdfs Read Thread Concurrency Bucket: 0:90.32% 1:6.452% 2:3.226% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:518 ExecOption: Codegen enabled: 0 out of 74 BytesRead(500.0ms): 0, 1.01 GB, 1.49 GB, 1.49 GB, 1.49 GB, 1.49 GB, 1.49 GB, 1.49 GB, 1.55 GB, 1.74 GB, 2.13 GB, 2.45 GB, 2.68 GB, 2.72 GB, 2.77 GB, 2.81 GB, 2.81 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB - AverageHdfsReadThreadConcurrency: 0.13 - AverageScannerThreadConcurrency: 24.13 - BytesRead: 2.95 GB (3168045731) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.95 GB (3168045731) - BytesReadShortCircuit: 2.95 GB (3168045731) - DecompressionTime: 11s290ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.86 GB (1999005512) - PerReadThreadRawHdfsThroughput: 767.20 MB/sec - RowsRead: 417.00M (416998791) - RowsReturned: 34.44M (34441321) - RowsReturnedRate: 3.16 M/sec - ScanRangesComplete: 74 - ScannerThreadsInvoluntaryContextSwitches: 32.61K (32609) - ScannerThreadsTotalWallClockTime: 6m16s - MaterializeTupleTime(*): 5m52s - ScannerThreadsSysTime: 379.924ms - ScannerThreadsUserTime: 4m25s - ScannerThreadsVoluntaryContextSwitches: 2.13K (2126) - TotalRawHdfsReadTime(*): 3s938ms - TotalReadThroughput: 188.83 MB/sec Instance 19410b874827c24d:891b7d58465b70c2 (host=perf20-07.cloudera.com:22000):(Total: 15s495ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:6/1.48 GB 1:8/1.79 GB 8:11/2.44 GB 4:6/1.47 GB 10:6/1.19 GB 2:9/2.14 GB 9:9/1.85 GB 0:6/1.42 GB 5:6/1.00 GB 7:4/1000.31 MB 6:4/1008.22 MB MemoryUsage(500.0ms): 6.41 MB, 9.82 MB, 1.69 GB, 1.80 GB, 1.81 GB, 1.86 GB, 1.88 GB, 1.88 GB, 1.87 GB, 1.83 GB, 1.80 GB, 1.84 GB, 1.85 GB, 1.90 GB, 1.92 GB, 1.87 GB, 1.84 GB, 1.91 GB, 1.89 GB, 1.78 GB, 1.66 GB, 1.40 GB, 1.28 GB, 1.07 GB, 998.58 MB, 777.95 MB, 540.11 MB, 410.81 MB, 351.48 MB, 225.23 MB, 130.20 MB, 78.78 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 26, 24, 20, 18, 14, 10, 8, 7, 5, 3, 2 - AverageThreadTokens: 25.56 - PeakMemoryUsage: 1.94 GB (2082497256) - PerHostPeakMemUsage: 1.95 GB (2097455848) - PrepareTime: 201.243ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m46s - TotalNetworkReceiveTime: 185.526us - TotalNetworkSendTime: 3.706ms - TotalStorageWaitTime: 11s265ms CodeGen:(Total: 705.273ms, non-child: 705.273ms, % non-child: 100.00%) - CodegenTime: 5.434ms - CompileTime: 525.155ms - LoadTime: 178.685ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.53ms, non-child: 14.53ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1252239) - NetworkThroughput(*): 44.08 MB/sec - OverallThroughput: 84.97 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.627ms - ThriftTransmitTime(*): 27.94ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 15s479ms, non-child: 829.657ms, % non-child: 5.36%) ExecOption: Codegen Enabled - BuildTime: 611.478ms - GetNewBlockTime: 385.583us - GetResultsTime: 24.810ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 36.90 MB (38690864) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.03 K/sec - SpilledPartitions: 0 - UnpinTime: 2.769us HASH_JOIN_NODE (id=8):(Total: 14s649ms, non-child: 63.414ms, % non-child: 0.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 18.836us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 43.835us - GetNewBlockTime: 1.894ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.21 MB (21189696) - PinTime: 0ns - ProbeRows: 346.86K (346858) - ProbeRowsPartitioned: 0 - ProbeTime: 39.676ms - RowsReturned: 346.86K (346858) - RowsReturnedRate: 23.68 K/sec - SpilledPartitions: 0 - UnpinTime: 2.470us EXCHANGE_NODE (id=14):(Total: 18.213us, non-child: 18.213us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.647us - DeserializeRowBatchTimer: 14.700us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.04 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 14s588ms, non-child: 169.318ms, % non-child: 1.16%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.146ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.786ms - GetNewBlockTime: 1.992ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.12 MB (15858936) - PinTime: 0ns - ProbeRows: 346.86K (346858) - ProbeRowsPartitioned: 0 - ProbeTime: 139.549ms - RowsReturned: 346.86K (346858) - RowsReturnedRate: 23.77 K/sec - SpilledPartitions: 0 - UnpinTime: 2.429us EXCHANGE_NODE (id=13):(Total: 789.753us, non-child: 789.753us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 637.623us - DeserializeRowBatchTimer: 2.338ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.52 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s429ms, non-child: 1s313ms, % non-child: 9.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.208ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.580ms - GetNewBlockTime: 2.16ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.33 MB (7683088) - PinTime: 0ns - ProbeRows: 25.68M (25678023) - ProbeRowsPartitioned: 0 - ProbeTime: 1s130ms - RowsReturned: 346.86K (346858) - RowsReturnedRate: 24.04 K/sec - SpilledPartitions: 0 - UnpinTime: 2.254us EXCHANGE_NODE (id=12):(Total: 721.410us, non-child: 721.410us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 532.482us - DeserializeRowBatchTimer: 5.211ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 38.04 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 13s127ms, non-child: 2s167ms, % non-child: 16.51%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.413us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.880us - GetNewBlockTime: 1.923ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 35.73M (35728386) - ProbeRowsPartitioned: 0 - ProbeTime: 2s005ms - RowsReturned: 25.68M (25678023) - RowsReturnedRate: 1.96 M/sec - SpilledPartitions: 0 - UnpinTime: 2.147us EXCHANGE_NODE (id=11):(Total: 7.542us, non-child: 7.542us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.101us - DeserializeRowBatchTimer: 4.748us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 795.54 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s962ms, non-child: 10s962ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:6/1.48 GB 1:8/1.79 GB 8:11/2.44 GB 4:6/1.47 GB 10:6/1.19 GB 2:9/2.14 GB 9:9/1.85 GB 0:6/1.42 GB 5:6/1.00 GB 7:4/1000.31 MB 6:4/1008.22 MB Hdfs Read Thread Concurrency Bucket: 0:83.33% 1:13.33% 2:0% 3:0% 4:3.333% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:525 ExecOption: Codegen enabled: 0 out of 75 BytesRead(500.0ms): 0, 0, 1.34 GB, 1.45 GB, 1.45 GB, 1.53 GB, 1.57 GB, 1.57 GB, 1.61 GB, 1.64 GB, 1.72 GB, 1.98 GB, 2.27 GB, 2.46 GB, 2.52 GB, 2.60 GB, 2.70 GB, 2.85 GB, 2.87 GB, 2.95 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 26.20 - BytesRead: 2.97 GB (3185729234) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.97 GB (3185729234) - BytesReadShortCircuit: 2.97 GB (3185729234) - DecompressionTime: 11s065ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.90 GB (2042237512) - PerReadThreadRawHdfsThroughput: 741.06 MB/sec - RowsRead: 429.95M (429945150) - RowsReturned: 35.73M (35728386) - RowsReturnedRate: 3.26 M/sec - ScanRangesComplete: 75 - ScannerThreadsInvoluntaryContextSwitches: 33.82K (33818) - ScannerThreadsTotalWallClockTime: 6m42s - MaterializeTupleTime(*): 6m18s - ScannerThreadsSysTime: 370.929ms - ScannerThreadsUserTime: 4m43s - ScannerThreadsVoluntaryContextSwitches: 1.87K (1867) - TotalRawHdfsReadTime(*): 4s099ms - TotalReadThroughput: 189.88 MB/sec Instance 19410b874827c24d:891b7d58465b70cb (host=perf20-17.cloudera.com:22000):(Total: 15s409ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:4/747.14 MB 3:9/2.22 GB 4:10/2.18 GB 8:6/1.47 GB 5:3/757.33 MB 0:8/1.89 GB 1:6/1.36 GB 2:7/1.25 GB 6:7/1.73 GB 9:8/1.71 GB 10:6/1.44 GB MemoryUsage(500.0ms): 9.81 MB, 791.29 MB, 1.90 GB, 1.89 GB, 1.90 GB, 1.90 GB, 1.92 GB, 1.90 GB, 1.87 GB, 1.96 GB, 1.85 GB, 1.96 GB, 1.95 GB, 2.03 GB, 2.00 GB, 1.95 GB, 1.99 GB, 2.03 GB, 2.01 GB, 1.96 GB, 1.83 GB, 1.73 GB, 1.53 GB, 1.42 GB, 1.23 GB, 1.05 GB, 711.23 MB, 455.64 MB, 241.67 MB, 138.48 MB, 81.70 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 31, 27, 26, 23, 20, 14, 10, 5, 3, 2 - AverageThreadTokens: 28.29 - PeakMemoryUsage: 2.04 GB (2186275744) - PerHostPeakMemUsage: 2.05 GB (2201234336) - PrepareTime: 197.168ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 7m4s - TotalNetworkReceiveTime: 190.660us - TotalNetworkSendTime: 3.858ms - TotalStorageWaitTime: 13s216ms CodeGen:(Total: 700.311ms, non-child: 700.311ms, % non-child: 100.00%) - CodegenTime: 5.169ms - CompileTime: 522.398ms - LoadTime: 176.473ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.604ms, non-child: 13.604ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1250843) - NetworkThroughput(*): 46.87 MB/sec - OverallThroughput: 87.68 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.462ms - ThriftTransmitTime(*): 25.452ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 15s392ms, non-child: 851.210ms, % non-child: 5.53%) ExecOption: Codegen Enabled - BuildTime: 631.862ms - GetNewBlockTime: 356.169us - GetResultsTime: 24.570ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 36.17 MB (37925032) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.04 K/sec - SpilledPartitions: 0 - UnpinTime: 2.662us HASH_JOIN_NODE (id=8):(Total: 14s541ms, non-child: 63.216ms, % non-child: 0.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.581us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 40.772us - GetNewBlockTime: 1.925ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.40 MB (21387720) - PinTime: 0ns - ProbeRows: 374.39K (374395) - ProbeRowsPartitioned: 0 - ProbeTime: 39.469ms - RowsReturned: 374.39K (374395) - RowsReturnedRate: 25.75 K/sec - SpilledPartitions: 0 - UnpinTime: 2.431us EXCHANGE_NODE (id=14):(Total: 17.754us, non-child: 17.754us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.247us - DeserializeRowBatchTimer: 13.758us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.56 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 14s481ms, non-child: 175.930ms, % non-child: 1.21%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.55ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.456ms - GetNewBlockTime: 2.112ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.43 MB (16183520) - PinTime: 0ns - ProbeRows: 374.39K (374395) - ProbeRowsPartitioned: 0 - ProbeTime: 145.372ms - RowsReturned: 374.39K (374395) - RowsReturnedRate: 25.85 K/sec - SpilledPartitions: 0 - UnpinTime: 2.256us EXCHANGE_NODE (id=13):(Total: 783.804us, non-child: 783.804us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 641.304us - DeserializeRowBatchTimer: 2.236ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.83 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 14s317ms, non-child: 1s452ms, % non-child: 10.15%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.515ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.180ms - GetNewBlockTime: 2.85ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.30 MB (7656384) - PinTime: 0ns - ProbeRows: 28.03M (28033714) - ProbeRowsPartitioned: 0 - ProbeTime: 1s264ms - RowsReturned: 374.39K (374395) - RowsReturnedRate: 26.15 K/sec - SpilledPartitions: 0 - UnpinTime: 2.178us EXCHANGE_NODE (id=12):(Total: 772.409us, non-child: 772.409us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 567.332us - DeserializeRowBatchTimer: 3.862ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 35.53 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s878ms, non-child: 2s378ms, % non-child: 18.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.916us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 6.707us - GetNewBlockTime: 1.919ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 38.97M (38969944) - ProbeRowsPartitioned: 0 - ProbeTime: 2s203ms - RowsReturned: 28.03M (28033714) - RowsReturnedRate: 2.18 M/sec - SpilledPartitions: 0 - UnpinTime: 2.150us EXCHANGE_NODE (id=11):(Total: 6.569us, non-child: 6.569us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 949ns - DeserializeRowBatchTimer: 5.828us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 913.38 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s502ms, non-child: 10s502ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:4/747.14 MB 3:9/2.22 GB 4:10/2.18 GB 8:6/1.47 GB 5:3/757.33 MB 0:8/1.89 GB 1:6/1.36 GB 2:7/1.25 GB 6:7/1.73 GB 9:8/1.71 GB 10:6/1.44 GB Hdfs Read Thread Concurrency Bucket: 0:93.33% 1:0% 2:3.333% 3:0% 4:0% 5:0% 6:3.333% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:518 ExecOption: Codegen enabled: 0 out of 74 BytesRead(500.0ms): 0, 598.81 MB, 1.54 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.60 GB, 1.64 GB, 1.68 GB, 1.96 GB, 2.11 GB, 2.39 GB, 2.54 GB, 2.66 GB, 2.70 GB, 2.75 GB, 2.90 GB, 3.00 GB, 3.00 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB - AverageHdfsReadThreadConcurrency: 0.27 - AverageScannerThreadConcurrency: 28.20 - BytesRead: 3.04 GB (3261074272) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.04 GB (3261074272) - BytesReadShortCircuit: 3.04 GB (3261074272) - DecompressionTime: 11s572ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 2.00 GB (2146737816) - PerReadThreadRawHdfsThroughput: 675.40 MB/sec - RowsRead: 461.21M (461213696) - RowsReturned: 38.97M (38969944) - RowsReturnedRate: 3.71 M/sec - ScanRangesComplete: 74 - ScannerThreadsInvoluntaryContextSwitches: 34.65K (34646) - ScannerThreadsTotalWallClockTime: 7m1s - MaterializeTupleTime(*): 6m35s - ScannerThreadsSysTime: 398.921ms - ScannerThreadsUserTime: 4m56s - ScannerThreadsVoluntaryContextSwitches: 2.14K (2138) - TotalRawHdfsReadTime(*): 4s604ms - TotalReadThroughput: 200.63 MB/sec Instance 19410b874827c24d:891b7d58465b70cd (host=perf20-20.cloudera.com:22000):(Total: 15s067ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:8/1.95 GB 8:6/1.24 GB 9:4/1005.95 MB 2:3/749.19 MB 7:9/2.00 GB 1:3/757.44 MB 10:6/1.47 GB 4:8/1.96 GB 5:6/1.47 GB 0:7/1.70 GB 6:10/2.45 GB MemoryUsage(500.0ms): 0, 9.81 MB, 1.39 GB, 1.89 GB, 1.93 GB, 1.94 GB, 1.93 GB, 1.93 GB, 1.89 GB, 1.83 GB, 1.88 GB, 1.95 GB, 1.96 GB, 2.02 GB, 2.02 GB, 2.02 GB, 2.00 GB, 1.98 GB, 2.03 GB, 2.02 GB, 1.91 GB, 1.76 GB, 1.64 GB, 1.45 GB, 1.09 GB, 954.01 MB, 744.77 MB, 613.82 MB, 396.65 MB, 244.19 MB, 93.23 MB, 13.98 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 34, 32, 30, 28, 19, 17, 13, 12, 8, 5, 2, 1 - AverageThreadTokens: 26.59 - PeakMemoryUsage: 2.07 GB (2219981544) - PerHostPeakMemUsage: 2.08 GB (2234940136) - PrepareTime: 196.942ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m57s - TotalNetworkReceiveTime: 195.8us - TotalNetworkSendTime: 3.535ms - TotalStorageWaitTime: 11s506ms CodeGen:(Total: 700.285ms, non-child: 700.285ms, % non-child: 100.00%) - CodegenTime: 5.194ms - CompileTime: 522.609ms - LoadTime: 176.274ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.889ms, non-child: 13.889ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1250604) - NetworkThroughput(*): 48.50 MB/sec - OverallThroughput: 85.87 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.633ms - ThriftTransmitTime(*): 24.590ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 15s051ms, non-child: 822.802ms, % non-child: 5.47%) ExecOption: Codegen Enabled - BuildTime: 603.723ms - GetNewBlockTime: 496.63us - GetResultsTime: 23.735ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 34.21 MB (35868368) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.06 K/sec - SpilledPartitions: 0 - UnpinTime: 3.20us HASH_JOIN_NODE (id=8):(Total: 14s228ms, non-child: 66.680ms, % non-child: 0.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 20.135us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 40.632us - GetNewBlockTime: 2.338ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 19.89 MB (20856216) - PinTime: 0ns - ProbeRows: 392.28K (392280) - ProbeRowsPartitioned: 0 - ProbeTime: 42.565ms - RowsReturned: 392.28K (392280) - RowsReturnedRate: 27.57 K/sec - SpilledPartitions: 0 - UnpinTime: 2.736us EXCHANGE_NODE (id=14):(Total: 17.539us, non-child: 17.539us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.234us - DeserializeRowBatchTimer: 17.419us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.81 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 14s165ms, non-child: 181.198ms, % non-child: 1.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.349ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.106ms - GetNewBlockTime: 2.309ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.71 MB (15422800) - PinTime: 0ns - ProbeRows: 392.28K (392280) - ProbeRowsPartitioned: 0 - ProbeTime: 150.722ms - RowsReturned: 392.28K (392280) - RowsReturnedRate: 27.69 K/sec - SpilledPartitions: 0 - UnpinTime: 2.539us EXCHANGE_NODE (id=13):(Total: 796.380us, non-child: 796.380us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 634.356us - DeserializeRowBatchTimer: 2.500ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.18 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s995ms, non-child: 1s291ms, % non-child: 9.23%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.616ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.777ms - GetNewBlockTime: 2.470ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.23 MB (7583864) - PinTime: 0ns - ProbeRows: 27.61M (27607384) - ProbeRowsPartitioned: 0 - ProbeTime: 1s079ms - RowsReturned: 392.28K (392280) - RowsReturnedRate: 28.03 K/sec - SpilledPartitions: 0 - UnpinTime: 2.500us EXCHANGE_NODE (id=12):(Total: 737.217us, non-child: 737.217us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 539.989us - DeserializeRowBatchTimer: 5.72ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 37.22 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s716ms, non-child: 2s118ms, % non-child: 16.66%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.950us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.667us - GetNewBlockTime: 2.279ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 38.26M (38263011) - ProbeRowsPartitioned: 0 - ProbeTime: 1s952ms - RowsReturned: 27.61M (27607384) - RowsReturnedRate: 2.17 M/sec - SpilledPartitions: 0 - UnpinTime: 2.540us EXCHANGE_NODE (id=11):(Total: 8.64us, non-child: 8.64us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.158us - DeserializeRowBatchTimer: 5.393us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 744.05 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s600ms, non-child: 10s600ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:8/1.95 GB 8:6/1.24 GB 9:4/1005.95 MB 2:3/749.19 MB 7:9/2.00 GB 1:3/757.44 MB 10:6/1.47 GB 4:8/1.96 GB 5:6/1.47 GB 0:7/1.70 GB 6:10/2.45 GB Hdfs Read Thread Concurrency Bucket: 0:89.66% 1:3.448% 2:3.448% 3:0% 4:3.448% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:490 ExecOption: Codegen enabled: 0 out of 70 BytesRead(500.0ms): 0, 1.09 GB, 1.54 GB, 1.58 GB, 1.58 GB, 1.58 GB, 1.58 GB, 1.58 GB, 1.79 GB, 2.03 GB, 2.36 GB, 2.48 GB, 2.59 GB, 2.63 GB, 2.68 GB, 2.69 GB, 2.78 GB, 2.91 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB - AverageHdfsReadThreadConcurrency: 0.24 - AverageScannerThreadConcurrency: 28.24 - BytesRead: 3.04 GB (3264848529) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.04 GB (3264848529) - BytesReadShortCircuit: 3.04 GB (3264848529) - DecompressionTime: 11s620ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 2.03 GB (2179616904) - PerReadThreadRawHdfsThroughput: 728.70 MB/sec - RowsRead: 457.23M (457225298) - RowsReturned: 38.26M (38263011) - RowsReturnedRate: 3.61 M/sec - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 38.05K (38045) - ScannerThreadsTotalWallClockTime: 6m52s - MaterializeTupleTime(*): 6m28s - ScannerThreadsSysTime: 397.922ms - ScannerThreadsUserTime: 4m49s - ScannerThreadsVoluntaryContextSwitches: 2.00K (1996) - TotalRawHdfsReadTime(*): 4s272ms - TotalReadThroughput: 207.57 MB/sec Instance 19410b874827c24d:891b7d58465b70c1 (host=perf20-02.cloudera.com:22000):(Total: 14s621ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:5/1.12 GB 1:6/1.48 GB 8:5/1.20 GB 6:7/1.48 GB 3:12/2.90 GB 2:5/1.23 GB 9:5/1.23 GB 5:7/1.49 GB 0:10/2.22 GB 4:7/1.44 GB 10:6/1.04 GB MemoryUsage(500.0ms): 0, 9.81 MB, 1.19 GB, 1.25 GB, 1.28 GB, 1.28 GB, 1.27 GB, 1.20 GB, 1.29 GB, 1.29 GB, 1.29 GB, 1.26 GB, 1.27 GB, 1.24 GB, 1.24 GB, 1.24 GB, 1.12 GB, 1.21 GB, 1.25 GB, 1.25 GB, 1.10 GB, 1.07 GB, 895.27 MB, 737.37 MB, 641.21 MB, 416.43 MB, 270.08 MB, 168.41 MB, 91.38 MB, 81.47 MB, 75.05 MB ThreadUsage(500.0ms): 1, 1, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 24, 21, 21, 17, 14, 13, 8, 5, 4, 2, 2, 2 - AverageThreadTokens: 17.52 - PeakMemoryUsage: 1.33 GB (1425707464) - PerHostPeakMemUsage: 1.34 GB (1440674248) - PrepareTime: 205.588ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 4m27s - TotalNetworkReceiveTime: 183.405us - TotalNetworkSendTime: 3.113ms - TotalStorageWaitTime: 5s039ms CodeGen:(Total: 712.259ms, non-child: 712.259ms, % non-child: 100.00%) - CodegenTime: 5.244ms - CompileTime: 526.321ms - LoadTime: 184.404ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.982ms, non-child: 13.982ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1251938) - NetworkThroughput(*): 41.32 MB/sec - OverallThroughput: 85.39 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 10.36ms - ThriftTransmitTime(*): 28.894ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 14s605ms, non-child: 853.90ms, % non-child: 5.84%) ExecOption: Codegen Enabled - BuildTime: 626.61ms - GetNewBlockTime: 813.822us - GetResultsTime: 24.657ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 25.35 MB (26577232) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.09 K/sec - SpilledPartitions: 0 - UnpinTime: 2.653us HASH_JOIN_NODE (id=8):(Total: 13s752ms, non-child: 62.834ms, % non-child: 0.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.814us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 43.512us - GetNewBlockTime: 1.934ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.03 MB (15763792) - PinTime: 0ns - ProbeRows: 355.01K (355010) - ProbeRowsPartitioned: 0 - ProbeTime: 39.808ms - RowsReturned: 355.01K (355010) - RowsReturnedRate: 25.82 K/sec - SpilledPartitions: 0 - UnpinTime: 2.436us EXCHANGE_NODE (id=14):(Total: 17.46us, non-child: 17.46us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.224us - DeserializeRowBatchTimer: 18.180us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 21.41 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s692ms, non-child: 194.576ms, % non-child: 1.42%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.65ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.637ms - GetNewBlockTime: 2.100ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.47 MB (16222544) - PinTime: 0ns - ProbeRows: 355.01K (355010) - ProbeRowsPartitioned: 0 - ProbeTime: 165.402ms - RowsReturned: 355.01K (355010) - RowsReturnedRate: 25.93 K/sec - SpilledPartitions: 0 - UnpinTime: 2.302us EXCHANGE_NODE (id=13):(Total: 766.505us, non-child: 766.505us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 620.566us - DeserializeRowBatchTimer: 3.238ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 41.75 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s507ms, non-child: 1s556ms, % non-child: 11.52%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.234ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.541ms - GetNewBlockTime: 2.166ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.36 MB (7715816) - PinTime: 0ns - ProbeRows: 26.79M (26793903) - ProbeRowsPartitioned: 0 - ProbeTime: 1s361ms - RowsReturned: 355.01K (355010) - RowsReturnedRate: 26.28 K/sec - SpilledPartitions: 0 - UnpinTime: 2.235us EXCHANGE_NODE (id=12):(Total: 706.11us, non-child: 706.11us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 529.575us - DeserializeRowBatchTimer: 4.646ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 38.87 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s962ms, non-child: 2s357ms, % non-child: 19.71%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.592us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.685us - GetNewBlockTime: 2.61ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 36.73M (36731076) - ProbeRowsPartitioned: 0 - ProbeTime: 2s178ms - RowsReturned: 26.79M (26793903) - RowsReturnedRate: 2.24 M/sec - SpilledPartitions: 0 - UnpinTime: 2.50us EXCHANGE_NODE (id=11):(Total: 6.361us, non-child: 6.361us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 955ns - DeserializeRowBatchTimer: 4.963us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 943.25 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s607ms, non-child: 9s607ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:5/1.12 GB 1:6/1.48 GB 8:5/1.20 GB 6:7/1.48 GB 3:12/2.90 GB 2:5/1.23 GB 9:5/1.23 GB 5:7/1.49 GB 0:10/2.22 GB 4:7/1.44 GB 10:6/1.04 GB Hdfs Read Thread Concurrency Bucket: 0:89.66% 1:6.897% 2:3.448% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:525 ExecOption: Codegen enabled: 0 out of 75 BytesRead(500.0ms): 0, 977.32 MB, 1.01 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.13 GB, 1.40 GB, 1.51 GB, 1.60 GB, 1.74 GB, 1.84 GB, 2.14 GB, 2.19 GB, 2.23 GB, 2.33 GB, 2.51 GB, 2.77 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB, 2.98 GB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 17.66 - BytesRead: 2.98 GB (3201139673) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.98 GB (3201139673) - BytesReadShortCircuit: 2.98 GB (3201139673) - DecompressionTime: 7s772ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 23 - PeakMemoryUsage: 1.29 GB (1385148032) - PerReadThreadRawHdfsThroughput: 1.01 GB/sec - RowsRead: 428.31M (428311037) - RowsReturned: 36.73M (36731076) - RowsReturnedRate: 3.82 M/sec - ScanRangesComplete: 75 - ScannerThreadsInvoluntaryContextSwitches: 8.89K (8891) - ScannerThreadsTotalWallClockTime: 4m16s - MaterializeTupleTime(*): 4m3s - ScannerThreadsSysTime: 362.933ms - ScannerThreadsUserTime: 4m9s - ScannerThreadsVoluntaryContextSwitches: 1.89K (1888) - TotalRawHdfsReadTime(*): 2s938ms - TotalReadThroughput: 203.52 MB/sec Instance 19410b874827c24d:891b7d58465b70bf (host=perf20-11.cloudera.com:22000):(Total: 14s589ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:5/1.16 GB 2:4/905.27 MB 3:7/1.23 GB 1:10/2.24 GB 5:4/766.02 MB 0:4/1008.60 MB 8:7/1.63 GB 7:11/2.32 GB 10:13/2.89 GB 6:7/1.66 GB 4:4/993.22 MB MemoryUsage(500.0ms): 0, 9.81 MB, 1.27 GB, 1.83 GB, 1.83 GB, 1.86 GB, 1.87 GB, 1.85 GB, 1.87 GB, 1.85 GB, 1.82 GB, 1.73 GB, 1.68 GB, 1.76 GB, 1.87 GB, 1.87 GB, 1.88 GB, 1.88 GB, 1.83 GB, 1.82 GB, 1.66 GB, 1.51 GB, 1.20 GB, 1.03 GB, 923.42 MB, 753.44 MB, 529.63 MB, 384.80 MB, 243.26 MB, 136.77 MB, 106.25 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 29, 22, 19, 17, 15, 10, 8, 5, 3, 3 - AverageThreadTokens: 26.23 - PeakMemoryUsage: 1.90 GB (2040518040) - PerHostPeakMemUsage: 1.91 GB (2055476632) - PrepareTime: 196.160ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m34s - TotalNetworkReceiveTime: 194.77us - TotalNetworkSendTime: 3.445ms - TotalStorageWaitTime: 11s803ms CodeGen:(Total: 704.585ms, non-child: 704.585ms, % non-child: 100.00%) - CodegenTime: 5.111ms - CompileTime: 527.583ms - LoadTime: 175.617ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.967ms, non-child: 13.967ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1250876) - NetworkThroughput(*): 44.36 MB/sec - OverallThroughput: 85.41 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.865ms - ThriftTransmitTime(*): 26.889ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 14s573ms, non-child: 836.138ms, % non-child: 5.74%) ExecOption: Codegen Enabled - BuildTime: 617.352ms - GetNewBlockTime: 331.415us - GetResultsTime: 24.824ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 24.84 MB (26049320) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.10 K/sec - SpilledPartitions: 0 - UnpinTime: 3.78us HASH_JOIN_NODE (id=8):(Total: 13s737ms, non-child: 55.513ms, % non-child: 0.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 18.677us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 46.983us - GetNewBlockTime: 1.904ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.53 MB (15235880) - PinTime: 0ns - ProbeRows: 247.38K (247384) - ProbeRowsPartitioned: 0 - ProbeTime: 31.930ms - RowsReturned: 247.38K (247384) - RowsReturnedRate: 18.01 K/sec - SpilledPartitions: 0 - UnpinTime: 2.634us EXCHANGE_NODE (id=14):(Total: 17.376us, non-child: 17.376us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.298us - DeserializeRowBatchTimer: 19.531us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 21.01 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s684ms, non-child: 163.563ms, % non-child: 1.20%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.37ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.643ms - GetNewBlockTime: 1.942ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.97 MB (15694632) - PinTime: 0ns - ProbeRows: 247.38K (247384) - ProbeRowsPartitioned: 0 - ProbeTime: 134.698ms - RowsReturned: 247.38K (247384) - RowsReturnedRate: 18.08 K/sec - SpilledPartitions: 0 - UnpinTime: 2.579us EXCHANGE_NODE (id=13):(Total: 764.660us, non-child: 764.660us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 618.166us - DeserializeRowBatchTimer: 3.115ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 41.85 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s530ms, non-child: 1s278ms, % non-child: 9.45%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.325ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.570ms - GetNewBlockTime: 2.49ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 9.04 MB (9481680) - PinTime: 0ns - ProbeRows: 26.12M (26123258) - ProbeRowsPartitioned: 0 - ProbeTime: 1s097ms - RowsReturned: 247.38K (247384) - RowsReturnedRate: 18.28 K/sec - SpilledPartitions: 0 - UnpinTime: 2.557us EXCHANGE_NODE (id=12):(Total: 748.75us, non-child: 748.75us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 544.646us - DeserializeRowBatchTimer: 4.48ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.68 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s263ms, non-child: 2s087ms, % non-child: 17.02%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.448us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.32us - GetNewBlockTime: 1.966ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 35.75M (35748681) - ProbeRowsPartitioned: 0 - ProbeTime: 1s923ms - RowsReturned: 26.12M (26123258) - RowsReturnedRate: 2.13 M/sec - SpilledPartitions: 0 - UnpinTime: 2.557us EXCHANGE_NODE (id=11):(Total: 7.818us, non-child: 7.818us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.32us - DeserializeRowBatchTimer: 8.401us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 767.46 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s179ms, non-child: 10s179ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:5/1.16 GB 2:4/905.27 MB 3:7/1.23 GB 1:10/2.24 GB 5:4/766.02 MB 0:4/1008.60 MB 8:7/1.63 GB 7:11/2.32 GB 10:13/2.89 GB 6:7/1.66 GB 4:4/993.22 MB Hdfs Read Thread Concurrency Bucket: 0:86.21% 1:10.34% 2:0% 3:0% 4:0% 5:0% 6:3.448% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:532 ExecOption: Codegen enabled: 0 out of 76 BytesRead(500.0ms): 0, 995.48 MB, 1.49 GB, 1.49 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.64 GB, 1.70 GB, 1.74 GB, 1.91 GB, 2.22 GB, 2.42 GB, 2.67 GB, 2.68 GB, 2.73 GB, 2.81 GB, 2.82 GB, 2.91 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB - AverageHdfsReadThreadConcurrency: 0.31 - AverageScannerThreadConcurrency: 26.97 - BytesRead: 2.95 GB (3168233115) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.95 GB (3168233115) - BytesReadShortCircuit: 2.95 GB (3168233115) - DecompressionTime: 10s532ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.86 GB (2000220304) - PerReadThreadRawHdfsThroughput: 711.75 MB/sec - RowsRead: 417.48M (417482776) - RowsReturned: 35.75M (35748681) - RowsReturnedRate: 3.51 M/sec - ScanRangesComplete: 76 - ScannerThreadsInvoluntaryContextSwitches: 33.52K (33524) - ScannerThreadsTotalWallClockTime: 6m31s - MaterializeTupleTime(*): 6m7s - ScannerThreadsSysTime: 392.923ms - ScannerThreadsUserTime: 4m33s - ScannerThreadsVoluntaryContextSwitches: 1.90K (1897) - TotalRawHdfsReadTime(*): 4s245ms - TotalReadThroughput: 201.43 MB/sec Instance 19410b874827c24d:891b7d58465b70be (host=perf20-06.cloudera.com:22000):(Total: 14s448ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:3/658.63 MB 10:9/2.00 GB 2:7/1.44 GB 8:9/1.97 GB 1:3/757.28 MB 9:7/1.60 GB 4:7/1.65 GB 6:8/1.54 GB 0:7/1.44 GB 5:9/2.19 GB 7:7/1.48 GB MemoryUsage(500.0ms): 0, 9.82 MB, 1.57 GB, 1.78 GB, 1.78 GB, 1.78 GB, 1.81 GB, 1.81 GB, 1.70 GB, 1.76 GB, 1.76 GB, 1.77 GB, 1.84 GB, 1.80 GB, 1.82 GB, 1.81 GB, 1.84 GB, 1.82 GB, 1.61 GB, 1.47 GB, 1.27 GB, 1.07 GB, 1.03 GB, 875.98 MB, 646.47 MB, 378.71 MB, 209.86 MB, 156.58 MB, 93.97 MB, 87.07 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 29, 25, 20, 20, 17, 14, 8, 4, 3, 2, 2 - AverageThreadTokens: 25.13 - PeakMemoryUsage: 1.86 GB (1997888832) - PerHostPeakMemUsage: 1.87 GB (2012847424) - PrepareTime: 196.737ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m11s - TotalNetworkReceiveTime: 226.631us - TotalNetworkSendTime: 3.571ms - TotalStorageWaitTime: 10s537ms CodeGen:(Total: 696.275ms, non-child: 696.275ms, % non-child: 100.00%) - CodegenTime: 5.168ms - CompileTime: 518.844ms - LoadTime: 176.17ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.779ms, non-child: 14.779ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1252527) - NetworkThroughput(*): 45.88 MB/sec - OverallThroughput: 80.82 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 10.261ms - ThriftTransmitTime(*): 26.37ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 14s430ms, non-child: 842.925ms, % non-child: 5.84%) ExecOption: Codegen Enabled - BuildTime: 622.550ms - GetNewBlockTime: 550.905us - GetResultsTime: 25.67ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 33.30 MB (34916064) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.11 K/sec - SpilledPartitions: 0 - UnpinTime: 2.686us HASH_JOIN_NODE (id=8):(Total: 13s587ms, non-child: 64.848ms, % non-child: 0.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 20.431us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 42.234us - GetNewBlockTime: 1.847ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.12 MB (21098552) - PinTime: 0ns - ProbeRows: 369.36K (369357) - ProbeRowsPartitioned: 0 - ProbeTime: 40.664ms - RowsReturned: 369.36K (369357) - RowsReturnedRate: 27.18 K/sec - SpilledPartitions: 0 - UnpinTime: 2.436us EXCHANGE_NODE (id=14):(Total: 17.685us, non-child: 17.685us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.592us - DeserializeRowBatchTimer: 47.219us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.64 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s525ms, non-child: 183.88ms, % non-child: 1.35%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.84ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 3.92ms - GetNewBlockTime: 1.930ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.25 MB (15988640) - PinTime: 0ns - ProbeRows: 369.36K (369357) - ProbeRowsPartitioned: 0 - ProbeTime: 150.397ms - RowsReturned: 369.36K (369357) - RowsReturnedRate: 27.31 K/sec - SpilledPartitions: 0 - UnpinTime: 2.220us EXCHANGE_NODE (id=13):(Total: 796.649us, non-child: 796.649us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 633.370us - DeserializeRowBatchTimer: 2.241ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.17 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s354ms, non-child: 1s254ms, % non-child: 9.39%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.244ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.617ms - GetNewBlockTime: 2.81ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.45 MB (7815640) - PinTime: 0ns - ProbeRows: 24.39M (24393892) - ProbeRowsPartitioned: 0 - ProbeTime: 1s059ms - RowsReturned: 369.36K (369357) - RowsReturnedRate: 27.66 K/sec - SpilledPartitions: 0 - UnpinTime: 2.265us EXCHANGE_NODE (id=12):(Total: 769.284us, non-child: 769.284us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 542.357us - DeserializeRowBatchTimer: 4.486ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 35.67 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 12s114ms, non-child: 1s932ms, % non-child: 15.95%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.520us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.892us - GetNewBlockTime: 1.965ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 33.63M (33633491) - ProbeRowsPartitioned: 0 - ProbeTime: 1s775ms - RowsReturned: 24.39M (24393892) - RowsReturnedRate: 2.01 M/sec - SpilledPartitions: 0 - UnpinTime: 2.214us EXCHANGE_NODE (id=11):(Total: 7.670us, non-child: 7.670us, % non-child: 100.00%) BytesReceived(500.0ms): 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 901ns - DeserializeRowBatchTimer: 4.443us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 782.27 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 10s184ms, non-child: 10s184ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:3/658.63 MB 10:9/2.00 GB 2:7/1.44 GB 8:9/1.97 GB 1:3/757.28 MB 9:7/1.60 GB 4:7/1.65 GB 6:8/1.54 GB 0:7/1.44 GB 5:9/2.19 GB 7:7/1.48 GB Hdfs Read Thread Concurrency Bucket: 0:85.71% 1:14.29% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:532 ExecOption: Codegen enabled: 0 out of 76 BytesRead(500.0ms): 0, 1.24 GB, 1.45 GB, 1.45 GB, 1.45 GB, 1.49 GB, 1.49 GB, 1.64 GB, 1.96 GB, 2.27 GB, 2.48 GB, 2.64 GB, 2.64 GB, 2.74 GB, 2.79 GB, 2.82 GB, 2.86 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB, 2.90 GB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 25.86 - BytesRead: 2.90 GB (3116983285) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.90 GB (3116983285) - BytesReadShortCircuit: 2.90 GB (3116983285) - DecompressionTime: 11s101ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.82 GB (1951281488) - PerReadThreadRawHdfsThroughput: 767.99 MB/sec - RowsRead: 405.59M (405593049) - RowsReturned: 33.63M (33633491) - RowsReturnedRate: 3.30 M/sec - ScanRangesComplete: 76 - ScannerThreadsInvoluntaryContextSwitches: 31.31K (31311) - ScannerThreadsTotalWallClockTime: 6m6s - MaterializeTupleTime(*): 5m43s - ScannerThreadsSysTime: 360.926ms - ScannerThreadsUserTime: 4m19s - ScannerThreadsVoluntaryContextSwitches: 2.07K (2074) - TotalRawHdfsReadTime(*): 3s870ms - TotalReadThroughput: 205.01 MB/sec Instance 19410b874827c24d:891b7d58465b70ce (host=perf20-15.cloudera.com:22000):(Total: 14s258ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:4/1009.73 MB 4:11/2.57 GB 1:8/1.65 GB 7:4/976.35 MB 8:10/2.22 GB 5:7/1.71 GB 0:8/1.57 GB 2:7/1.60 GB 6:7/1.57 GB 3:3/757.27 MB 10:5/1014.69 MB MemoryUsage(500.0ms): 9.81 MB, 222.05 MB, 1.80 GB, 1.81 GB, 1.81 GB, 1.85 GB, 1.86 GB, 1.85 GB, 1.86 GB, 1.78 GB, 1.71 GB, 1.88 GB, 1.91 GB, 1.89 GB, 1.90 GB, 1.89 GB, 1.92 GB, 1.89 GB, 1.87 GB, 1.75 GB, 1.58 GB, 1.34 GB, 1.22 GB, 1.09 GB, 949.25 MB, 762.85 MB, 489.04 MB, 302.13 MB, 216.70 MB, 8.46 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 29, 24, 21, 19, 18, 15, 10, 6, 5, 1 - AverageThreadTokens: 27.67 - PeakMemoryUsage: 1.95 GB (2089500064) - PerHostPeakMemUsage: 1.96 GB (2104458656) - PrepareTime: 209.35ms - RowsProduced: 16.00K (16000) - TotalCpuTime: 6m33s - TotalNetworkReceiveTime: 175.477us - TotalNetworkSendTime: 3.267ms - TotalStorageWaitTime: 12s603ms CodeGen:(Total: 712.169ms, non-child: 712.169ms, % non-child: 100.00%) - CodegenTime: 5.575ms - CompileTime: 525.809ms - LoadTime: 184.837ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.85ms, non-child: 14.85ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1250080) - NetworkThroughput(*): 47.61 MB/sec - OverallThroughput: 84.64 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.761ms - ThriftTransmitTime(*): 25.41ms - UncompressedRowBatchSize: 2.90 MB (3040452) AGGREGATION_NODE (id=9):(Total: 14s241ms, non-child: 880.312ms, % non-child: 6.18%) ExecOption: Codegen Enabled - BuildTime: 655.160ms - GetNewBlockTime: 405.833us - GetResultsTime: 24.243ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 30.47 MB (31953904) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16000) - RowsReturnedRate: 1.12 K/sec - SpilledPartitions: 0 - UnpinTime: 2.648us HASH_JOIN_NODE (id=8):(Total: 13s361ms, non-child: 58.648ms, % non-child: 0.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.60us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 42.152us - GetNewBlockTime: 1.842ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.14 MB (21115888) - PinTime: 0ns - ProbeRows: 264.32K (264319) - ProbeRowsPartitioned: 0 - ProbeTime: 33.250ms - RowsReturned: 264.32K (264319) - RowsReturnedRate: 19.78 K/sec - SpilledPartitions: 0 - UnpinTime: 2.392us EXCHANGE_NODE (id=14):(Total: 15.973us, non-child: 15.973us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.257us - DeserializeRowBatchTimer: 14.452us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 22.85 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s305ms, non-child: 170.129ms, % non-child: 1.28%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.88ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.661ms - GetNewBlockTime: 1.957ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.89 MB (15611784) - PinTime: 0ns - ProbeRows: 264.32K (264319) - ProbeRowsPartitioned: 0 - ProbeTime: 139.212ms - RowsReturned: 264.32K (264319) - RowsReturnedRate: 19.86 K/sec - SpilledPartitions: 0 - UnpinTime: 2.476us EXCHANGE_NODE (id=13):(Total: 771.783us, non-child: 771.783us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 631.516us - DeserializeRowBatchTimer: 2.432ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 41.46 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s145ms, non-child: 1s384ms, % non-child: 10.53%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.278ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.537ms - GetNewBlockTime: 2.3ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 9.22 MB (9669768) - PinTime: 0ns - ProbeRows: 25.73M (25726885) - ProbeRowsPartitioned: 0 - ProbeTime: 1s211ms - RowsReturned: 264.32K (264319) - RowsReturnedRate: 20.11 K/sec - SpilledPartitions: 0 - UnpinTime: 2.392us EXCHANGE_NODE (id=12):(Total: 713.315us, non-child: 713.315us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 538.237us - DeserializeRowBatchTimer: 4.23ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 38.47 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s772ms, non-child: 2s213ms, % non-child: 18.80%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.461us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.775us - GetNewBlockTime: 1.934ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 35.85M (35853216) - ProbeRowsPartitioned: 0 - ProbeTime: 2s042ms - RowsReturned: 25.73M (25726885) - RowsReturnedRate: 2.19 M/sec - SpilledPartitions: 0 - UnpinTime: 2.323us EXCHANGE_NODE (id=11):(Total: 7.433us, non-child: 7.433us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 872ns - DeserializeRowBatchTimer: 4.808us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 807.21 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s561ms, non-child: 9s561ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:4/1009.73 MB 4:11/2.57 GB 1:8/1.65 GB 7:4/976.35 MB 8:10/2.22 GB 5:7/1.71 GB 0:8/1.57 GB 2:7/1.60 GB 6:7/1.57 GB 3:3/757.27 MB 10:5/1014.69 MB Hdfs Read Thread Concurrency Bucket: 0:89.29% 1:7.143% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:3.571% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:518 ExecOption: Codegen enabled: 0 out of 74 BytesRead(500.0ms): 0, 117.72 MB, 1.44 GB, 1.46 GB, 1.46 GB, 1.51 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.62 GB, 1.89 GB, 2.32 GB, 2.47 GB, 2.47 GB, 2.56 GB, 2.68 GB, 2.75 GB, 2.81 GB, 2.92 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB, 2.96 GB - AverageHdfsReadThreadConcurrency: 0.39 - AverageScannerThreadConcurrency: 28.57 - BytesRead: 2.96 GB (3180485746) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.96 GB (3180485746) - BytesReadShortCircuit: 2.96 GB (3180485746) - DecompressionTime: 11s313ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.91 GB (2049772728) - PerReadThreadRawHdfsThroughput: 685.93 MB/sec - RowsRead: 434.43M (434432067) - RowsReturned: 35.85M (35853216) - RowsReturnedRate: 3.75 M/sec - ScanRangesComplete: 74 - ScannerThreadsInvoluntaryContextSwitches: 32.75K (32749) - ScannerThreadsTotalWallClockTime: 6m30s - MaterializeTupleTime(*): 6m5s - ScannerThreadsSysTime: 371.927ms - ScannerThreadsUserTime: 4m36s - ScannerThreadsVoluntaryContextSwitches: 2.00K (1996) - TotalRawHdfsReadTime(*): 4s421ms - TotalReadThroughput: 209.18 MB/sec Instance 19410b874827c24d:891b7d58465b70c6 (host=perf20-19.cloudera.com:22000):(Total: 14s216ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:8/1.59 GB 3:5/1.14 GB 10:10/2.16 GB 9:9/2.20 GB 6:7/1.47 GB 7:6/1.24 GB 8:5/1.22 GB 5:3/757.37 MB 0:7/1.66 GB 4:7/1.59 GB 1:7/1.66 GB MemoryUsage(500.0ms): 0, 9.81 MB, 1.27 GB, 1.85 GB, 1.85 GB, 1.85 GB, 1.90 GB, 1.90 GB, 1.92 GB, 1.89 GB, 1.84 GB, 1.85 GB, 1.91 GB, 1.91 GB, 1.91 GB, 1.94 GB, 1.99 GB, 1.97 GB, 1.98 GB, 1.94 GB, 1.90 GB, 1.76 GB, 1.50 GB, 1.16 GB, 927.89 MB, 609.74 MB, 496.08 MB, 326.02 MB, 82.88 MB, 82.38 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 29, 22, 17, 11, 10, 7, 2, 2 - AverageThreadTokens: 27.37 - PeakMemoryUsage: 2.00 GB (2146647616) - PerHostPeakMemUsage: 2.01 GB (2161606208) - PrepareTime: 198.371ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m39s - TotalNetworkReceiveTime: 198.490us - TotalNetworkSendTime: 3.686ms - TotalStorageWaitTime: 11s570ms CodeGen:(Total: 700.113ms, non-child: 700.113ms, % non-child: 100.00%) - CodegenTime: 5.165ms - CompileTime: 520.946ms - LoadTime: 177.765ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.786ms, non-child: 13.786ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1249551) - NetworkThroughput(*): 44.15 MB/sec - OverallThroughput: 86.44 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.581ms - ThriftTransmitTime(*): 26.988ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 14s200ms, non-child: 805.262ms, % non-child: 5.67%) ExecOption: Codegen Enabled - BuildTime: 587.103ms - GetNewBlockTime: 711.180us - GetResultsTime: 23.397ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 38.27 MB (40128288) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.13 K/sec - SpilledPartitions: 0 - UnpinTime: 3.241us HASH_JOIN_NODE (id=8):(Total: 13s395ms, non-child: 61.99ms, % non-child: 0.46%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.447us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 41.587us - GetNewBlockTime: 1.825ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.13 MB (21111424) - PinTime: 0ns - ProbeRows: 350.14K (350140) - ProbeRowsPartitioned: 0 - ProbeTime: 36.811ms - RowsReturned: 350.14K (350140) - RowsReturnedRate: 26.14 K/sec - SpilledPartitions: 0 - UnpinTime: 3.122us EXCHANGE_NODE (id=14):(Total: 16.826us, non-child: 16.826us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 7.977us - DeserializeRowBatchTimer: 14.102us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 21.69 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s336ms, non-child: 167.489ms, % non-child: 1.26%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.142ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.89ms - GetNewBlockTime: 1.932ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.59 MB (16352400) - PinTime: 0ns - ProbeRows: 350.14K (350140) - ProbeRowsPartitioned: 0 - ProbeTime: 124.710ms - RowsReturned: 350.14K (350140) - RowsReturnedRate: 26.25 K/sec - SpilledPartitions: 0 - UnpinTime: 3.194us EXCHANGE_NODE (id=13):(Total: 788.499us, non-child: 788.499us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 645.798us - DeserializeRowBatchTimer: 2.456ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.58 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s180ms, non-child: 1s288ms, % non-child: 9.78%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.563ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.879ms - GetNewBlockTime: 1.990ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.27 MB (7625624) - PinTime: 0ns - ProbeRows: 27.84M (27844887) - ProbeRowsPartitioned: 0 - ProbeTime: 1s075ms - RowsReturned: 350.14K (350140) - RowsReturnedRate: 26.57 K/sec - SpilledPartitions: 0 - UnpinTime: 3.65us EXCHANGE_NODE (id=12):(Total: 794.827us, non-child: 794.827us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 580.546us - DeserializeRowBatchTimer: 4.834ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 34.52 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s904ms, non-child: 2s226ms, % non-child: 18.70%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.803us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 6.359us - GetNewBlockTime: 1.883ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 38.30M (38295025) - ProbeRowsPartitioned: 0 - ProbeTime: 2s057ms - RowsReturned: 27.84M (27844887) - RowsReturnedRate: 2.34 M/sec - SpilledPartitions: 0 - UnpinTime: 2.979us EXCHANGE_NODE (id=11):(Total: 7.9us, non-child: 7.9us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.105us - DeserializeRowBatchTimer: 5.522us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 856.04 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s680ms, non-child: 9s680ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:8/1.59 GB 3:5/1.14 GB 10:10/2.16 GB 9:9/2.20 GB 6:7/1.47 GB 7:6/1.24 GB 8:5/1.22 GB 5:3/757.37 MB 0:7/1.66 GB 4:7/1.59 GB 1:7/1.66 GB Hdfs Read Thread Concurrency Bucket: 0:92.86% 1:3.571% 2:0% 3:3.571% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:518 ExecOption: Codegen enabled: 0 out of 74 BytesRead(500.0ms): 0, 1022.45 MB, 1.50 GB, 1.50 GB, 1.50 GB, 1.57 GB, 1.57 GB, 1.61 GB, 1.64 GB, 1.81 GB, 1.94 GB, 2.22 GB, 2.41 GB, 2.49 GB, 2.62 GB, 2.80 GB, 2.80 GB, 2.88 GB, 2.91 GB, 2.96 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB, 3.00 GB - AverageHdfsReadThreadConcurrency: 0.14 - AverageScannerThreadConcurrency: 28.25 - BytesRead: 3.00 GB (3223795336) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.00 GB (3223795336) - BytesReadShortCircuit: 3.00 GB (3223795336) - DecompressionTime: 11s631ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.96 GB (2105762904) - PerReadThreadRawHdfsThroughput: 745.85 MB/sec - RowsRead: 440.98M (440975856) - RowsReturned: 38.30M (38295025) - RowsReturnedRate: 3.96 M/sec - ScanRangesComplete: 74 - ScannerThreadsInvoluntaryContextSwitches: 36.58K (36577) - ScannerThreadsTotalWallClockTime: 6m36s - MaterializeTupleTime(*): 6m11s - ScannerThreadsSysTime: 406.922ms - ScannerThreadsUserTime: 4m31s - ScannerThreadsVoluntaryContextSwitches: 2.12K (2125) - TotalRawHdfsReadTime(*): 4s122ms - TotalReadThroughput: 212.03 MB/sec Instance 19410b874827c24d:891b7d58465b70c4 (host=perf20-04.cloudera.com:22000):(Total: 14s200ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 3:3/757.30 MB 2:8/1.78 GB 1:6/1.47 GB 10:5/1.22 GB 9:8/1.82 GB 6:6/1.48 GB 8:7/1.45 GB 5:8/1.80 GB 0:9/1.94 GB 7:9/1.96 GB 4:6/1.25 GB MemoryUsage(500.0ms): 9.81 MB, 556.25 MB, 1.84 GB, 1.85 GB, 1.88 GB, 1.90 GB, 1.90 GB, 1.88 GB, 1.85 GB, 1.89 GB, 1.86 GB, 1.90 GB, 1.99 GB, 1.98 GB, 2.00 GB, 2.02 GB, 2.00 GB, 1.90 GB, 1.98 GB, 1.97 GB, 1.93 GB, 1.76 GB, 1.50 GB, 1.33 GB, 1.11 GB, 706.36 MB, 532.08 MB, 356.03 MB, 132.81 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 33, 27, 24, 21, 13, 11, 7, 3 - AverageThreadTokens: 29.66 - PeakMemoryUsage: 2.03 GB (2176496208) - PerHostPeakMemUsage: 2.04 GB (2191454800) - PrepareTime: 199.584ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m54s - TotalNetworkReceiveTime: 183.652us - TotalNetworkSendTime: 3.810ms - TotalStorageWaitTime: 11s801ms CodeGen:(Total: 704.58ms, non-child: 704.58ms, % non-child: 100.00%) - CodegenTime: 5.252ms - CompileTime: 524.937ms - LoadTime: 177.676ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.29ms, non-child: 14.29ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1252281) - NetworkThroughput(*): 44.80 MB/sec - OverallThroughput: 85.13 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.684ms - ThriftTransmitTime(*): 26.657ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 14s183ms, non-child: 838.540ms, % non-child: 5.91%) ExecOption: Codegen Enabled - BuildTime: 620.494ms - GetNewBlockTime: 620.550us - GetResultsTime: 23.553ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 29.94 MB (31390488) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.13 K/sec - SpilledPartitions: 0 - UnpinTime: 2.512us HASH_JOIN_NODE (id=8):(Total: 13s344ms, non-child: 62.465ms, % non-child: 0.47%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 18.965us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 52.337us - GetNewBlockTime: 1.751ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 19.60 MB (20552472) - PinTime: 0ns - ProbeRows: 323.63K (323632) - ProbeRowsPartitioned: 0 - ProbeTime: 37.307ms - RowsReturned: 323.63K (323632) - RowsReturnedRate: 24.25 K/sec - SpilledPartitions: 0 - UnpinTime: 2.376us EXCHANGE_NODE (id=14):(Total: 19.891us, non-child: 19.891us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.577us - DeserializeRowBatchTimer: 10.626us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 18.35 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s285ms, non-child: 174.940ms, % non-child: 1.32%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.57ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.216ms - GetNewBlockTime: 1.876ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.95 MB (15680456) - PinTime: 0ns - ProbeRows: 323.63K (323632) - ProbeRowsPartitioned: 0 - ProbeTime: 137.50ms - RowsReturned: 323.63K (323632) - RowsReturnedRate: 24.36 K/sec - SpilledPartitions: 0 - UnpinTime: 2.351us EXCHANGE_NODE (id=13):(Total: 751.487us, non-child: 751.487us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 615.362us - DeserializeRowBatchTimer: 2.102ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 42.58 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 13s120ms, non-child: 1s442ms, % non-child: 10.99%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.718ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.600ms - GetNewBlockTime: 1.898ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.24 MB (7588248) - PinTime: 0ns - ProbeRows: 26.68M (26683985) - ProbeRowsPartitioned: 0 - ProbeTime: 1s217ms - RowsReturned: 323.63K (323632) - RowsReturnedRate: 24.66 K/sec - SpilledPartitions: 0 - UnpinTime: 2.287us EXCHANGE_NODE (id=12):(Total: 730.716us, non-child: 730.716us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 540.6us - DeserializeRowBatchTimer: 4.0ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 37.55 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s690ms, non-child: 2s257ms, % non-child: 19.31%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.254us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 8.524us - GetNewBlockTime: 1.876ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 37.07M (37069486) - ProbeRowsPartitioned: 0 - ProbeTime: 2s088ms - RowsReturned: 26.68M (26683985) - RowsReturnedRate: 2.28 M/sec - SpilledPartitions: 0 - UnpinTime: 2.190us EXCHANGE_NODE (id=11):(Total: 7.661us, non-child: 7.661us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.68us - DeserializeRowBatchTimer: 4.558us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 783.19 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s435ms, non-child: 9s435ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:3/757.30 MB 2:8/1.78 GB 1:6/1.47 GB 10:5/1.22 GB 9:8/1.82 GB 6:6/1.48 GB 8:7/1.45 GB 5:8/1.80 GB 0:9/1.94 GB 7:9/1.96 GB 4:6/1.25 GB Hdfs Read Thread Concurrency Bucket: 0:89.29% 1:7.143% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:3.571% 11:0% 12:0% File Formats: PARQUET/SNAPPY:525 ExecOption: Codegen enabled: 0 out of 75 BytesRead(500.0ms): 0, 367.01 MB, 1.48 GB, 1.48 GB, 1.52 GB, 1.54 GB, 1.55 GB, 1.55 GB, 1.59 GB, 1.89 GB, 1.95 GB, 2.19 GB, 2.45 GB, 2.50 GB, 2.60 GB, 2.72 GB, 2.72 GB, 2.74 GB, 2.94 GB, 3.03 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB, 3.04 GB - AverageHdfsReadThreadConcurrency: 0.43 - AverageScannerThreadConcurrency: 29.68 - BytesRead: 3.04 GB (3262152199) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.04 GB (3262152199) - BytesReadShortCircuit: 3.04 GB (3262152199) - DecompressionTime: 11s871ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.99 GB (2135969472) - PerReadThreadRawHdfsThroughput: 720.16 MB/sec - RowsRead: 446.63M (446625597) - RowsReturned: 37.07M (37069486) - RowsReturnedRate: 3.93 M/sec - ScanRangesComplete: 75 - ScannerThreadsInvoluntaryContextSwitches: 35.04K (35038) - ScannerThreadsTotalWallClockTime: 6m51s - MaterializeTupleTime(*): 6m26s - ScannerThreadsSysTime: 396.925ms - ScannerThreadsUserTime: 4m43s - ScannerThreadsVoluntaryContextSwitches: 2.20K (2201) - TotalRawHdfsReadTime(*): 4s319ms - TotalReadThroughput: 214.55 MB/sec Instance 19410b874827c24d:891b7d58465b70c0 (host=perf20-08.cloudera.com:22000):(Total: 14s001ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:2/504.90 MB 3:7/1.48 GB 9:6/1.28 GB 1:4/1009.74 MB 4:9/2.22 GB 2:7/1.73 GB 10:7/1.48 GB 7:9/2.05 GB 0:6/1.48 GB 5:8/1.54 GB 6:8/1.91 GB MemoryUsage(500.0ms): 9.81 MB, 1.23 GB, 1.73 GB, 1.73 GB, 1.79 GB, 1.79 GB, 1.80 GB, 1.77 GB, 1.76 GB, 1.76 GB, 1.65 GB, 1.79 GB, 1.80 GB, 1.86 GB, 1.86 GB, 1.84 GB, 1.85 GB, 1.64 GB, 1.49 GB, 1.35 GB, 1.19 GB, 921.33 MB, 595.56 MB, 370.98 MB, 281.23 MB, 240.30 MB, 198.61 MB, 129.89 MB, 120.85 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 32, 29, 26, 23, 18, 12, 7, 5, 4, 4, 3, 3 - AverageThreadTokens: 25.62 - PeakMemoryUsage: 1.88 GB (2013306464) - PerHostPeakMemUsage: 1.89 GB (2028265056) - PrepareTime: 195.549ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m2s - TotalNetworkReceiveTime: 176.319us - TotalNetworkSendTime: 3.268ms - TotalStorageWaitTime: 9s149ms CodeGen:(Total: 702.472ms, non-child: 702.472ms, % non-child: 100.00%) - CodegenTime: 4.949ms - CompileTime: 525.666ms - LoadTime: 175.471ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.111ms, non-child: 14.111ms, % non-child: 100.00%) - BytesSent: 1.20 MB (1254189) - NetworkThroughput(*): 45.03 MB/sec - OverallThroughput: 84.76 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.789ms - ThriftTransmitTime(*): 26.560ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 13s985ms, non-child: 893.861ms, % non-child: 6.39%) ExecOption: Codegen Enabled - BuildTime: 675.19ms - GetNewBlockTime: 590.603us - GetResultsTime: 24.123ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 30.72 MB (32217408) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.14 K/sec - SpilledPartitions: 0 - UnpinTime: 2.609us HASH_JOIN_NODE (id=8):(Total: 13s091ms, non-child: 62.568ms, % non-child: 0.48%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 18.710us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 52.27us - GetNewBlockTime: 2.35ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.39 MB (21379392) - PinTime: 0ns - ProbeRows: 322.72K (322720) - ProbeRowsPartitioned: 0 - ProbeTime: 38.693ms - RowsReturned: 322.72K (322720) - RowsReturnedRate: 24.65 K/sec - SpilledPartitions: 0 - UnpinTime: 2.300us EXCHANGE_NODE (id=14):(Total: 17.692us, non-child: 17.692us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 7.969us - DeserializeRowBatchTimer: 14.984us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.63 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s031ms, non-child: 186.295ms, % non-child: 1.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.192ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.36ms - GetNewBlockTime: 2.161ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.84 MB (15556248) - PinTime: 0ns - ProbeRows: 322.72K (322720) - ProbeRowsPartitioned: 0 - ProbeTime: 155.508ms - RowsReturned: 322.72K (322720) - RowsReturnedRate: 24.76 K/sec - SpilledPartitions: 0 - UnpinTime: 2.160us EXCHANGE_NODE (id=13):(Total: 782.153us, non-child: 782.153us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 638.936us - DeserializeRowBatchTimer: 2.396ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.91 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s856ms, non-child: 1s413ms, % non-child: 11.00%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.480ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.811ms - GetNewBlockTime: 2.209ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.29 MB (7644392) - PinTime: 0ns - ProbeRows: 23.42M (23419139) - ProbeRowsPartitioned: 0 - ProbeTime: 1s154ms - RowsReturned: 322.72K (322720) - RowsReturnedRate: 25.10 K/sec - SpilledPartitions: 0 - UnpinTime: 2.235us EXCHANGE_NODE (id=12):(Total: 716.408us, non-child: 716.408us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 539.196us - DeserializeRowBatchTimer: 4.766ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 38.30 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s455ms, non-child: 2s073ms, % non-child: 18.10%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.353us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 11.156us - GetNewBlockTime: 2.132ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 32.62M (32618473) - ProbeRowsPartitioned: 0 - ProbeTime: 1s926ms - RowsReturned: 23.42M (23419139) - RowsReturnedRate: 2.04 M/sec - SpilledPartitions: 0 - UnpinTime: 2.226us EXCHANGE_NODE (id=11):(Total: 9.906us, non-child: 9.906us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.301us - DeserializeRowBatchTimer: 4.872us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 605.69 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s384ms, non-child: 9s384ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:2/504.90 MB 3:7/1.48 GB 9:6/1.28 GB 1:4/1009.74 MB 4:9/2.22 GB 2:7/1.73 GB 10:7/1.48 GB 7:9/2.05 GB 0:6/1.48 GB 5:8/1.54 GB 6:8/1.91 GB Hdfs Read Thread Concurrency Bucket: 0:92.86% 1:3.571% 2:0% 3:0% 4:0% 5:0% 6:3.571% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:511 ExecOption: Codegen enabled: 0 out of 73 BytesRead(500.0ms): 0, 965.07 MB, 1.38 GB, 1.38 GB, 1.46 GB, 1.46 GB, 1.50 GB, 1.50 GB, 1.66 GB, 1.82 GB, 1.96 GB, 2.26 GB, 2.58 GB, 2.74 GB, 2.78 GB, 2.78 GB, 2.82 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB, 2.86 GB - AverageHdfsReadThreadConcurrency: 0.25 - AverageScannerThreadConcurrency: 25.50 - BytesRead: 2.86 GB (3067034635) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.86 GB (3067034635) - BytesReadShortCircuit: 2.86 GB (3067034635) - DecompressionTime: 11s258ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.84 GB (1972956072) - PerReadThreadRawHdfsThroughput: 958.20 MB/sec - RowsRead: 387.81M (387814461) - RowsReturned: 32.62M (32618473) - RowsReturnedRate: 3.48 M/sec - ScanRangesComplete: 73 - ScannerThreadsInvoluntaryContextSwitches: 27.13K (27130) - ScannerThreadsTotalWallClockTime: 5m56s - MaterializeTupleTime(*): 5m34s - ScannerThreadsSysTime: 335.933ms - ScannerThreadsUserTime: 4m8s - ScannerThreadsVoluntaryContextSwitches: 1.92K (1921) - TotalRawHdfsReadTime(*): 3s052ms - TotalReadThroughput: 201.72 MB/sec Instance 19410b874827c24d:891b7d58465b70c8 (host=perf20-05.cloudera.com:22000):(Total: 13s996ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/421.89 MB 2:13/2.90 GB 4:4/856.64 MB 8:4/813.96 MB 5:9/2.14 GB 0:8/1.71 GB 6:8/1.77 GB 9:5/952.01 MB 10:5/1.23 GB 7:9/1.98 GB 3:8/1.95 GB MemoryUsage(500.0ms): 0, 9.82 MB, 1.50 GB, 1.83 GB, 1.92 GB, 1.91 GB, 1.92 GB, 1.95 GB, 1.95 GB, 1.91 GB, 1.89 GB, 1.89 GB, 1.93 GB, 1.97 GB, 1.91 GB, 1.94 GB, 1.96 GB, 1.97 GB, 1.96 GB, 1.96 GB, 1.90 GB, 1.82 GB, 1.51 GB, 1.29 GB, 972.55 MB, 586.85 MB, 467.86 MB, 273.29 MB, 161.67 MB ThreadUsage(500.0ms): 1, 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 29, 26, 20, 12, 10, 6, 4 - AverageThreadTokens: 28.55 - PeakMemoryUsage: 1.99 GB (2134997816) - PerHostPeakMemUsage: 2.00 GB (2149956408) - PrepareTime: 201.180ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m47s - TotalNetworkReceiveTime: 186.988us - TotalNetworkSendTime: 3.707ms - TotalStorageWaitTime: 12s312ms CodeGen:(Total: 702.74ms, non-child: 702.74ms, % non-child: 100.00%) - CodegenTime: 5.101ms - CompileTime: 520.114ms - LoadTime: 180.627ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.688ms, non-child: 13.688ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1251155) - NetworkThroughput(*): 45.14 MB/sec - OverallThroughput: 87.16 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.543ms - ThriftTransmitTime(*): 26.431ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 13s980ms, non-child: 823.693ms, % non-child: 5.89%) ExecOption: Codegen Enabled - BuildTime: 602.474ms - GetNewBlockTime: 808.528us - GetResultsTime: 23.117ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 24.75 MB (25950488) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.14 K/sec - SpilledPartitions: 0 - UnpinTime: 2.571us HASH_JOIN_NODE (id=8):(Total: 13s156ms, non-child: 52.28ms, % non-child: 0.40%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 18.710us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 43.660us - GetNewBlockTime: 1.784ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.44 MB (15137048) - PinTime: 0ns - ProbeRows: 246.97K (246974) - ProbeRowsPartitioned: 0 - ProbeTime: 28.669ms - RowsReturned: 246.97K (246974) - RowsReturnedRate: 18.77 K/sec - SpilledPartitions: 0 - UnpinTime: 2.313us EXCHANGE_NODE (id=14):(Total: 17.399us, non-child: 17.399us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.139us - DeserializeRowBatchTimer: 14.955us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.98 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 13s107ms, non-child: 162.96ms, % non-child: 1.24%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.94ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.667ms - GetNewBlockTime: 1.925ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.87 MB (15595800) - PinTime: 0ns - ProbeRows: 246.97K (246974) - ProbeRowsPartitioned: 0 - ProbeTime: 133.545ms - RowsReturned: 246.97K (246974) - RowsReturnedRate: 18.84 K/sec - SpilledPartitions: 0 - UnpinTime: 2.205us EXCHANGE_NODE (id=13):(Total: 774.304us, non-child: 774.304us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 633.850us - DeserializeRowBatchTimer: 2.571ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 41.33 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s954ms, non-child: 1s310ms, % non-child: 10.12%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.425ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.533ms - GetNewBlockTime: 2.32ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.32 MB (7674376) - PinTime: 0ns - ProbeRows: 26.26M (26255073) - ProbeRowsPartitioned: 0 - ProbeTime: 1s063ms - RowsReturned: 246.97K (246974) - RowsReturnedRate: 19.06 K/sec - SpilledPartitions: 0 - UnpinTime: 2.205us EXCHANGE_NODE (id=12):(Total: 759.503us, non-child: 759.503us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 558.681us - DeserializeRowBatchTimer: 3.999ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.13 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s655ms, non-child: 2s160ms, % non-child: 18.54%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.392us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.221us - GetNewBlockTime: 1.944ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 36.57M (36567270) - ProbeRowsPartitioned: 0 - ProbeTime: 1s984ms - RowsReturned: 26.26M (26255073) - RowsReturnedRate: 2.25 M/sec - SpilledPartitions: 0 - UnpinTime: 2.60us EXCHANGE_NODE (id=11):(Total: 7.758us, non-child: 7.758us, % non-child: 100.00%) BytesReceived(500.0ms): 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 1.11us - DeserializeRowBatchTimer: 5.28us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 773.39 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s497ms, non-child: 9s497ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:2/421.89 MB 2:13/2.90 GB 4:4/856.64 MB 8:4/813.96 MB 5:9/2.14 GB 0:8/1.71 GB 6:8/1.77 GB 9:5/952.01 MB 10:5/1.23 GB 7:9/1.98 GB 3:8/1.95 GB Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:3.704% 2:3.704% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:525 ExecOption: Codegen enabled: 0 out of 75 BytesRead(500.0ms): 0, 1.20 GB, 1.46 GB, 1.56 GB, 1.56 GB, 1.56 GB, 1.61 GB, 1.65 GB, 1.73 GB, 1.91 GB, 2.19 GB, 2.36 GB, 2.47 GB, 2.47 GB, 2.60 GB, 2.75 GB, 2.85 GB, 2.89 GB, 2.93 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB, 2.97 GB - AverageHdfsReadThreadConcurrency: 0.11 - AverageScannerThreadConcurrency: 29.59 - BytesRead: 2.97 GB (3192663971) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.97 GB (3192663971) - BytesReadShortCircuit: 2.97 GB (3192663971) - DecompressionTime: 12s296ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.95 GB (2096775160) - PerReadThreadRawHdfsThroughput: 716.82 MB/sec - RowsRead: 434.97M (434974138) - RowsReturned: 36.57M (36567270) - RowsReturnedRate: 3.85 M/sec - ScanRangesComplete: 75 - ScannerThreadsInvoluntaryContextSwitches: 35.77K (35768) - ScannerThreadsTotalWallClockTime: 6m45s - MaterializeTupleTime(*): 6m18s - ScannerThreadsSysTime: 396.923ms - ScannerThreadsUserTime: 4m37s - ScannerThreadsVoluntaryContextSwitches: 2.02K (2025) - TotalRawHdfsReadTime(*): 4s247ms - TotalReadThroughput: 217.48 MB/sec Instance 19410b874827c24d:891b7d58465b70c5 (host=perf20-12.cloudera.com:22000):(Total: 13s721ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:5/941.40 MB 4:2/504.67 MB 6:4/617.56 MB 10:14/3.21 GB 5:8/1.55 GB 0:10/2.19 GB 1:9/1.79 GB 3:4/996.70 MB 9:7/1.61 GB 7:9/2.21 GB 8:6/1.24 GB MemoryUsage(500.0ms): 6.41 MB, 29.94 MB, 1.71 GB, 1.79 GB, 1.82 GB, 1.82 GB, 1.85 GB, 1.85 GB, 1.85 GB, 1.77 GB, 1.68 GB, 1.78 GB, 1.76 GB, 1.86 GB, 1.86 GB, 1.87 GB, 1.90 GB, 1.91 GB, 1.90 GB, 1.83 GB, 1.75 GB, 1.38 GB, 1.19 GB, 1.02 GB, 816.44 MB, 516.79 MB, 303.42 MB, 233.13 MB, 12.07 MB ThreadUsage(500.0ms): 1, 12, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 34, 25, 22, 19, 16, 10, 6, 5, 1 - AverageThreadTokens: 27.52 - PeakMemoryUsage: 1.92 GB (2058288736) - PerHostPeakMemUsage: 1.93 GB (2073247328) - PrepareTime: 196.286ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m31s - TotalNetworkReceiveTime: 176.330us - TotalNetworkSendTime: 3.738ms - TotalStorageWaitTime: 11s620ms CodeGen:(Total: 699.817ms, non-child: 699.817ms, % non-child: 100.00%) - CodegenTime: 5.132ms - CompileTime: 523.102ms - LoadTime: 175.358ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 13.969ms, non-child: 13.969ms, % non-child: 100.00%) - BytesSent: 1.19 MB (1253035) - NetworkThroughput(*): 42.20 MB/sec - OverallThroughput: 85.54 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.581ms - ThriftTransmitTime(*): 28.317ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 13s704ms, non-child: 854.470ms, % non-child: 6.23%) ExecOption: Codegen Enabled - BuildTime: 637.816ms - GetNewBlockTime: 548.331us - GetResultsTime: 24.347ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 34.54 MB (36219504) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.17 K/sec - SpilledPartitions: 0 - UnpinTime: 2.821us HASH_JOIN_NODE (id=8):(Total: 12s850ms, non-child: 75.253ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 20.981us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 45.232us - GetNewBlockTime: 1.480ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.67 MB (21673600) - PinTime: 0ns - ProbeRows: 481.48K (481483) - ProbeRowsPartitioned: 0 - ProbeTime: 51.614ms - RowsReturned: 481.48K (481483) - RowsReturnedRate: 37.47 K/sec - SpilledPartitions: 0 - UnpinTime: 2.297us EXCHANGE_NODE (id=14):(Total: 17.417us, non-child: 17.417us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.581us - DeserializeRowBatchTimer: 12.30us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 20.96 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 12s777ms, non-child: 191.745ms, % non-child: 1.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.218ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 1.696ms - GetNewBlockTime: 1.727ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.98 MB (15710904) - PinTime: 0ns - ProbeRows: 481.48K (481483) - ProbeRowsPartitioned: 0 - ProbeTime: 162.890ms - RowsReturned: 481.48K (481483) - RowsReturnedRate: 37.68 K/sec - SpilledPartitions: 0 - UnpinTime: 2.279us EXCHANGE_NODE (id=13):(Total: 749.497us, non-child: 749.497us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 623.848us - DeserializeRowBatchTimer: 1.888ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 42.70 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s595ms, non-child: 1s431ms, % non-child: 11.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.729ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.351ms - GetNewBlockTime: 1.713ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.28 MB (7634176) - PinTime: 0ns - ProbeRows: 25.49M (25493506) - ProbeRowsPartitioned: 0 - ProbeTime: 1s216ms - RowsReturned: 481.48K (481483) - RowsReturnedRate: 38.23 K/sec - SpilledPartitions: 0 - UnpinTime: 2.179us EXCHANGE_NODE (id=12):(Total: 745.332us, non-child: 745.332us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 553.999us - DeserializeRowBatchTimer: 3.626ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.82 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s175ms, non-child: 2s184ms, % non-child: 19.55%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.645us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 6.927us - GetNewBlockTime: 1.665ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 35.27M (35271315) - ProbeRowsPartitioned: 0 - ProbeTime: 2s027ms - RowsReturned: 25.49M (25493506) - RowsReturnedRate: 2.28 M/sec - SpilledPartitions: 0 - UnpinTime: 2.239us EXCHANGE_NODE (id=11):(Total: 6.839us, non-child: 6.839us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 853ns - DeserializeRowBatchTimer: 4.735us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 877.32 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 8s993ms, non-child: 8s993ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:5/941.40 MB 4:2/504.67 MB 6:4/617.56 MB 10:14/3.21 GB 5:8/1.55 GB 0:10/2.19 GB 1:9/1.79 GB 3:4/996.70 MB 9:7/1.61 GB 7:9/2.21 GB 8:6/1.24 GB Hdfs Read Thread Concurrency Bucket: 0:81.48% 1:14.81% 2:3.704% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:546 ExecOption: Codegen enabled: 0 out of 78 BytesRead(500.0ms): 0, 0, 1.37 GB, 1.45 GB, 1.50 GB, 1.50 GB, 1.54 GB, 1.54 GB, 1.54 GB, 1.61 GB, 1.80 GB, 2.01 GB, 2.24 GB, 2.47 GB, 2.60 GB, 2.68 GB, 2.76 GB, 2.85 GB, 2.85 GB, 2.92 GB, 2.94 GB, 2.94 GB, 2.94 GB, 2.94 GB, 2.94 GB, 2.94 GB, 2.94 GB, 2.94 GB - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 28.41 - BytesRead: 2.94 GB (3152838898) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.94 GB (3152838898) - BytesReadShortCircuit: 2.94 GB (3152838898) - DecompressionTime: 11s568ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.88 GB (2018157936) - PerReadThreadRawHdfsThroughput: 760.64 MB/sec - RowsRead: 414.61M (414611251) - RowsReturned: 35.27M (35271315) - RowsReturnedRate: 3.92 M/sec - ScanRangesComplete: 78 - ScannerThreadsInvoluntaryContextSwitches: 34.00K (34001) - ScannerThreadsTotalWallClockTime: 6m28s - MaterializeTupleTime(*): 6m4s - ScannerThreadsSysTime: 361.925ms - ScannerThreadsUserTime: 4m28s - ScannerThreadsVoluntaryContextSwitches: 2.09K (2092) - TotalRawHdfsReadTime(*): 3s952ms - TotalReadThroughput: 214.77 MB/sec Instance 19410b874827c24d:891b7d58465b70cf (host=perf20-13.cloudera.com:22000):(Total: 13s539ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:5/1.22 GB 4:7/1.48 GB 5:4/769.28 MB 0:7/1.73 GB 10:6/1.38 GB 8:7/1.45 GB 6:6/1.29 GB 2:7/1.37 GB 3:6/1.28 GB 9:12/2.69 GB 1:9/2.00 GB MemoryUsage(500.0ms): 9.81 MB, 1.16 GB, 1.80 GB, 1.80 GB, 1.85 GB, 1.85 GB, 1.83 GB, 1.83 GB, 1.77 GB, 1.86 GB, 1.87 GB, 1.83 GB, 1.86 GB, 1.82 GB, 1.92 GB, 1.94 GB, 1.93 GB, 1.93 GB, 1.85 GB, 1.64 GB, 1.36 GB, 1019.29 MB, 686.04 MB, 485.15 MB, 304.76 MB, 214.08 MB, 186.43 MB, 130.23 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 32, 27, 19, 13, 9, 5, 4, 4, 3 - AverageThreadTokens: 27.29 - PeakMemoryUsage: 1.95 GB (2097089672) - PerHostPeakMemUsage: 1.97 GB (2112048264) - PrepareTime: 198.637ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 6m11s - TotalNetworkReceiveTime: 190.448us - TotalNetworkSendTime: 3.578ms - TotalStorageWaitTime: 9s543ms CodeGen:(Total: 698.656ms, non-child: 698.656ms, % non-child: 100.00%) - CodegenTime: 5.195ms - CompileTime: 519.631ms - LoadTime: 177.625ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.387ms, non-child: 14.387ms, % non-child: 100.00%) - BytesSent: 1.20 MB (1253174) - NetworkThroughput(*): 44.18 MB/sec - OverallThroughput: 83.07 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.988ms - ThriftTransmitTime(*): 27.53ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 13s522ms, non-child: 854.416ms, % non-child: 6.32%) ExecOption: Codegen Enabled - BuildTime: 633.698ms - GetNewBlockTime: 764.627us - GetResultsTime: 25.180ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 30.69 MB (32175936) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.18 K/sec - SpilledPartitions: 0 - UnpinTime: 2.668us HASH_JOIN_NODE (id=8):(Total: 12s668ms, non-child: 63.230ms, % non-child: 0.50%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 19.645us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 47.261us - GetNewBlockTime: 1.849ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 20.35 MB (21337920) - PinTime: 0ns - ProbeRows: 343.91K (343911) - ProbeRowsPartitioned: 0 - ProbeTime: 38.604ms - RowsReturned: 343.91K (343911) - RowsReturnedRate: 27.15 K/sec - SpilledPartitions: 0 - UnpinTime: 2.433us EXCHANGE_NODE (id=14):(Total: 17.337us, non-child: 17.337us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.240us - DeserializeRowBatchTimer: 20.914us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 21.05 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 12s607ms, non-child: 171.341ms, % non-child: 1.36%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.118ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 2.117ms - GetNewBlockTime: 2.36ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 14.77 MB (15486280) - PinTime: 0ns - ProbeRows: 343.91K (343911) - ProbeRowsPartitioned: 0 - ProbeTime: 141.202ms - RowsReturned: 343.91K (343911) - RowsReturnedRate: 27.28 K/sec - SpilledPartitions: 0 - UnpinTime: 2.221us EXCHANGE_NODE (id=13):(Total: 785.557us, non-child: 785.557us, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 627.18us - DeserializeRowBatchTimer: 2.449ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 40.74 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 12s446ms, non-child: 1s299ms, % non-child: 10.44%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.457ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 1.739ms - GetNewBlockTime: 2.67ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.45 MB (7811848) - PinTime: 0ns - ProbeRows: 26.32M (26318000) - ProbeRowsPartitioned: 0 - ProbeTime: 1s077ms - RowsReturned: 343.91K (343911) - RowsReturnedRate: 27.63 K/sec - SpilledPartitions: 0 - UnpinTime: 2.220us EXCHANGE_NODE (id=12):(Total: 744.957us, non-child: 744.957us, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 545.670us - DeserializeRowBatchTimer: 4.352ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 36.83 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 11s159ms, non-child: 2s139ms, % non-child: 19.17%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.311us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 7.926us - GetNewBlockTime: 1.989ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 36.34M (36336236) - ProbeRowsPartitioned: 0 - ProbeTime: 1s969ms - RowsReturned: 26.32M (26318000) - RowsReturnedRate: 2.36 M/sec - SpilledPartitions: 0 - UnpinTime: 2.159us EXCHANGE_NODE (id=11):(Total: 7.350us, non-child: 7.350us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 980ns - DeserializeRowBatchTimer: 4.872us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 816.33 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 9s022ms, non-child: 9s022ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:5/1.22 GB 4:7/1.48 GB 5:4/769.28 MB 0:7/1.73 GB 10:6/1.38 GB 8:7/1.45 GB 6:6/1.29 GB 2:7/1.37 GB 3:6/1.28 GB 9:12/2.69 GB 1:9/2.00 GB Hdfs Read Thread Concurrency Bucket: 0:92.59% 1:3.704% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:3.704% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:532 ExecOption: Codegen enabled: 0 out of 76 BytesRead(500.0ms): 0, 891.87 MB, 1.45 GB, 1.45 GB, 1.52 GB, 1.52 GB, 1.53 GB, 1.60 GB, 1.73 GB, 1.97 GB, 2.12 GB, 2.26 GB, 2.44 GB, 2.56 GB, 2.79 GB, 2.86 GB, 2.90 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB, 2.95 GB - AverageHdfsReadThreadConcurrency: 0.37 - AverageScannerThreadConcurrency: 27.26 - BytesRead: 2.95 GB (3163390634) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.95 GB (3163390634) - BytesReadShortCircuit: 2.95 GB (3163390634) - DecompressionTime: 11s472ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.92 GB (2057933920) - PerReadThreadRawHdfsThroughput: 920.76 MB/sec - RowsRead: 422.38M (422382489) - RowsReturned: 36.34M (36336236) - RowsReturnedRate: 4.03 M/sec - ScanRangesComplete: 76 - ScannerThreadsInvoluntaryContextSwitches: 35.86K (35861) - ScannerThreadsTotalWallClockTime: 6m7s - MaterializeTupleTime(*): 5m44s - ScannerThreadsSysTime: 407.918ms - ScannerThreadsUserTime: 4m13s - ScannerThreadsVoluntaryContextSwitches: 2.21K (2215) - TotalRawHdfsReadTime(*): 3s276ms - TotalReadThroughput: 215.49 MB/sec Instance 19410b874827c24d:891b7d58465b70bd (host=perf20-10.cloudera.com:22000):(Total: 12s937ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:9/2.22 GB 3:6/1.47 GB 2:4/802.32 MB 6:3/578.38 MB 4:3/757.26 MB 9:9/2.22 GB 7:8/1.97 GB 5:9/2.06 GB 0:6/1.23 GB 1:10/1.98 GB 8:6/1.48 GB MemoryUsage(500.0ms): 9.81 MB, 1.22 GB, 1.67 GB, 1.74 GB, 1.78 GB, 1.78 GB, 1.78 GB, 1.71 GB, 1.78 GB, 1.74 GB, 1.79 GB, 1.83 GB, 1.80 GB, 1.84 GB, 1.86 GB, 1.81 GB, 1.72 GB, 1.62 GB, 1.49 GB, 1.39 GB, 1.24 GB, 922.98 MB, 658.88 MB, 439.82 MB, 314.75 MB, 161.49 MB ThreadUsage(500.0ms): 1, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 36, 35, 33, 31, 28, 26, 24, 17, 11, 8, 6, 4 - AverageThreadTokens: 28.00 - PeakMemoryUsage: 1.90 GB (2038727328) - PerHostPeakMemUsage: 1.91 GB (2053685920) - PrepareTime: 197.195ms - RowsProduced: 16.00K (16001) - TotalCpuTime: 5m54s - TotalNetworkReceiveTime: 224.762us - TotalNetworkSendTime: 3.906ms - TotalStorageWaitTime: 9s591ms CodeGen:(Total: 693.435ms, non-child: 693.435ms, % non-child: 100.00%) - CodegenTime: 5.48ms - CompileTime: 515.382ms - LoadTime: 176.652ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=15):(Total: 14.244ms, non-child: 14.244ms, % non-child: 100.00%) - BytesSent: 1.20 MB (1253611) - NetworkThroughput(*): 40.03 MB/sec - OverallThroughput: 83.93 MB/sec - PeakMemoryUsage: 804.00 KB (823296) - SerializeBatchTime: 9.786ms - ThriftTransmitTime(*): 29.866ms - UncompressedRowBatchSize: 2.90 MB (3040642) AGGREGATION_NODE (id=9):(Total: 12s920ms, non-child: 847.716ms, % non-child: 6.56%) ExecOption: Codegen Enabled - BuildTime: 627.834ms - GetNewBlockTime: 599.243us - GetResultsTime: 25.524ms - HashBuckets: 32.77K (32768) - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 36.63 MB (38411520) - PinTime: 0ns - RowsRepartitioned: 0 - RowsReturned: 16.00K (16001) - RowsReturnedRate: 1.24 K/sec - SpilledPartitions: 0 - UnpinTime: 2.888us HASH_JOIN_NODE (id=8):(Total: 12s072ms, non-child: 70.964ms, % non-child: 0.59%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 20.510us - BuildRows: 365 - BuildRowsPartitioned: 365 - BuildTime: 44.691us - GetNewBlockTime: 1.802ms - HashBuckets: 1.02K (1024) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 19.94 MB (20911032) - PinTime: 0ns - ProbeRows: 469.19K (469189) - ProbeRowsPartitioned: 0 - ProbeTime: 48.197ms - RowsReturned: 469.19K (469189) - RowsReturnedRate: 38.86 K/sec - SpilledPartitions: 0 - UnpinTime: 2.653us EXCHANGE_NODE (id=14):(Total: 16.380us, non-child: 16.380us, % non-child: 100.00%) BytesReceived(500.0ms): 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB, 2.87 KB - BytesReceived: 2.87 KB (2941) - ConvertRowBatchTime: 8.354us - DeserializeRowBatchTimer: 13.123us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 365 - RowsReturnedRate: 22.28 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=7):(Total: 12s004ms, non-child: 190.14ms, % non-child: 1.58%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 4.865ms - BuildRows: 32.00K (32000) - BuildRowsPartitioned: 32.00K (32000) - BuildTime: 3.251ms - GetNewBlockTime: 1.833ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 15.62 MB (16374696) - PinTime: 0ns - ProbeRows: 469.19K (469189) - ProbeRowsPartitioned: 0 - ProbeTime: 155.979ms - RowsReturned: 469.19K (469189) - RowsReturnedRate: 39.08 K/sec - SpilledPartitions: 0 - UnpinTime: 3.408us EXCHANGE_NODE (id=13):(Total: 1.107ms, non-child: 1.107ms, % non-child: 100.00%) BytesReceived(500.0ms): 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB, 463.24 KB - BytesReceived: 463.24 KB (474355) - ConvertRowBatchTime: 922.458us - DeserializeRowBatchTimer: 2.137ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 32.00K (32000) - RowsReturnedRate: 28.90 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=6):(Total: 11s829ms, non-child: 1s231ms, % non-child: 10.41%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 6.515ms - BuildRows: 27.44K (27440) - BuildRowsPartitioned: 27.44K (27440) - BuildTime: 2.644ms - GetNewBlockTime: 1.889ms - HashBuckets: 65.54K (65536) - LargestPartitionPercent: 3 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 7.21 MB (7556728) - PinTime: 0ns - ProbeRows: 24.78M (24781600) - ProbeRowsPartitioned: 0 - ProbeTime: 1s053ms - RowsReturned: 469.19K (469189) - RowsReturnedRate: 39.66 K/sec - SpilledPartitions: 0 - UnpinTime: 3.234us EXCHANGE_NODE (id=12):(Total: 1.0ms, non-child: 1.0ms, % non-child: 100.00%) BytesReceived(500.0ms): 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB, 879.45 KB - BytesReceived: 879.45 KB (900555) - ConvertRowBatchTime: 775.989us - DeserializeRowBatchTimer: 3.734ms - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 27.44K (27440) - RowsReturnedRate: 27.42 M/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HASH_JOIN_NODE (id=5):(Total: 10s614ms, non-child: 1s956ms, % non-child: 18.43%) ExecOption: Build Side Codegen Enabled, Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously, Build-Side Filter Pushed Down - BuildPartitionTime: 3.541us - BuildRows: 6 - BuildRowsPartitioned: 6 - BuildTime: 8.47us - GetNewBlockTime: 1.998ms - HashBuckets: 12 - LargestPartitionPercent: 16 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 32 - PeakMemoryUsage: 4.02 MB (4214784) - PinTime: 0ns - ProbeRows: 34.15M (34150124) - ProbeRowsPartitioned: 0 - ProbeTime: 1s780ms - RowsReturned: 24.78M (24781600) - RowsReturnedRate: 2.33 M/sec - SpilledPartitions: 0 - UnpinTime: 2.629us EXCHANGE_NODE (id=11):(Total: 7.393us, non-child: 7.393us, % non-child: 100.00%) BytesReceived(500.0ms): 0, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B, 128.00 B - BytesReceived: 128.00 B (128) - ConvertRowBatchTime: 851ns - DeserializeRowBatchTimer: 4.846us - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 6 - RowsReturnedRate: 811.58 K/sec - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns HDFS_SCAN_NODE (id=0):(Total: 8s660ms, non-child: 8s660ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:9/2.22 GB 3:6/1.47 GB 2:4/802.32 MB 6:3/578.38 MB 4:3/757.26 MB 9:9/2.22 GB 7:8/1.97 GB 5:9/2.06 GB 0:6/1.23 GB 1:10/1.98 GB 8:6/1.48 GB Hdfs Read Thread Concurrency Bucket: 0:88% 1:8% 2:0% 3:4% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:511 ExecOption: Codegen enabled: 0 out of 73 BytesRead(500.0ms): 0, 940.82 MB, 1.34 GB, 1.42 GB, 1.47 GB, 1.47 GB, 1.47 GB, 1.51 GB, 1.82 GB, 2.06 GB, 2.36 GB, 2.55 GB, 2.63 GB, 2.77 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB, 2.89 GB - AverageHdfsReadThreadConcurrency: 0.20 - AverageScannerThreadConcurrency: 28.08 - BytesRead: 2.89 GB (3097923583) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.89 GB (3097923583) - BytesReadShortCircuit: 2.89 GB (3097923583) - DecompressionTime: 10s299ms - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 11 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.86 GB (1998661712) - PerReadThreadRawHdfsThroughput: 863.10 MB/sec - RowsRead: 399.95M (399948418) - RowsReturned: 34.15M (34150124) - RowsReturnedRate: 3.94 M/sec - ScanRangesComplete: 73 - ScannerThreadsInvoluntaryContextSwitches: 29.86K (29862) - ScannerThreadsTotalWallClockTime: 5m51s - MaterializeTupleTime(*): 5m29s - ScannerThreadsSysTime: 351.929ms - ScannerThreadsUserTime: 4m8s - ScannerThreadsVoluntaryContextSwitches: 2.14K (2136) - TotalRawHdfsReadTime(*): 3s423ms - TotalReadThroughput: 227.26 MB/sec Fragment F04: Instance 19410b874827c24d:891b7d58465b70d0 (host=perf20-08.cloudera.com:22000):(Total: 20.685ms, non-child: 2.614ms, % non-child: 12.64%) Hdfs split stats (:<# splits>/): 5:1/2.41 MB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 1.65 MB (1725744) - PerHostPeakMemUsage: 14.42 MB (15115568) - PrepareTime: 81.550us - RowsProduced: 365 - TotalCpuTime: 34.533ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 580.865us - TotalStorageWaitTime: 6.96ms DataStreamSender (dst_id=14):(Total: 841.715us, non-child: 841.715us, % non-child: 100.00%) - BytesSent: 54.64 KB (55955) - NetworkThroughput(*): 6.95 MB/sec - OverallThroughput: 63.40 MB/sec - PeakMemoryUsage: 202.62 KB (207480) - SerializeBatchTime: 42.574us - ThriftTransmitTime(*): 7.682ms - UncompressedRowBatchSize: 108.51 KB (111112) HDFS_SCAN_NODE (id=4):(Total: 17.229ms, non-child: 17.229ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/2.41 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 515.15 KB (527514) - BytesReadDataNodeCache: 0 - BytesReadLocal: 515.15 KB (527514) - BytesReadShortCircuit: 515.15 KB (527514) - DecompressionTime: 33.483us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1.44 MB (1510072) - PerReadThreadRawHdfsThroughput: 963.07 MB/sec - RowsRead: 73.05K (73049) - RowsReturned: 365 - RowsReturnedRate: 21.18 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 16.960ms - MaterializeTupleTime(*): 9.946ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 8.998ms - ScannerThreadsVoluntaryContextSwitches: 4 - TotalRawHdfsReadTime(*): 522.366us - TotalReadThroughput: 0.00 /sec Fragment F03: Instance 19410b874827c24d:891b7d58465b70d1 (host=perf20-09.cloudera.com:22000):(Total: 34.388ms, non-child: 2.445ms, % non-child: 7.11%) Hdfs split stats (:<# splits>/): 9:1/3.14 MB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.08 MB (2183368) - PerHostPeakMemUsage: 17.02 MB (17843528) - PrepareTime: 54.299us - RowsProduced: 32.00K (32000) - TotalCpuTime: 23.879ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 18.41ms - TotalStorageWaitTime: 6.143ms DataStreamSender (dst_id=13):(Total: 23.925ms, non-child: 23.925ms, % non-child: 100.00%) - BytesSent: 8.60 MB (9012821) - NetworkThroughput(*): 32.29 MB/sec - OverallThroughput: 359.25 MB/sec - PeakMemoryUsage: 101.23 KB (103664) - SerializeBatchTime: 3.984ms - ThriftTransmitTime(*): 266.216ms - UncompressedRowBatchSize: 25.52 MB (26754508) HDFS_SCAN_NODE (id=3):(Total: 8.17ms, non-child: 8.17ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/3.14 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 415.85 KB (425829) - BytesReadDataNodeCache: 0 - BytesReadLocal: 415.85 KB (425829) - BytesReadShortCircuit: 415.85 KB (425829) - DecompressionTime: 91.892us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1.94 MB (2038744) - PerReadThreadRawHdfsThroughput: 2.80 GB/sec - RowsRead: 32.00K (32000) - RowsReturned: 32.00K (32000) - RowsReturnedRate: 3.99 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 10.926ms - MaterializeTupleTime(*): 3.343ms - ScannerThreadsSysTime: 999.0us - ScannerThreadsUserTime: 2.999ms - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 141.791us - TotalReadThroughput: 0.00 /sec Fragment F02: Instance 19410b874827c24d:891b7d58465b70e0 (host=perf20-02.cloudera.com:22000):(Total: 40.900ms, non-child: 2.330ms, % non-child: 5.70%) Hdfs split stats (:<# splits>/): 7:1/540.84 KB 9:1/540.49 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 4.64 MB (4862760) - PerHostPeakMemUsage: 28.17 MB (29535384) - PrepareTime: 112.631us - RowsProduced: 2.88K (2884) - TotalCpuTime: 99.887ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.855ms - TotalStorageWaitTime: 16.203ms DataStreamSender (dst_id=12):(Total: 3.224ms, non-child: 3.224ms, % non-child: 100.00%) - BytesSent: 1.91 MB (1998743) - NetworkThroughput(*): 36.04 MB/sec - OverallThroughput: 591.06 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 996.967us - ThriftTransmitTime(*): 52.883ms - UncompressedRowBatchSize: 3.61 MB (3781304) HDFS_SCAN_NODE (id=2):(Total: 35.344ms, non-child: 35.344ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/540.84 KB 9:1/540.49 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:8 ExecOption: Codegen enabled: 0 out of 2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.23 MB (1294924) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.23 MB (1294924) - BytesReadShortCircuit: 1.23 MB (1294924) - DecompressionTime: 560.209us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 4.49 MB (4711208) - PerReadThreadRawHdfsThroughput: 3.89 GB/sec - RowsRead: 201.94K (201941) - RowsReturned: 2.88K (2884) - RowsReturnedRate: 81.60 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 74.444ms - MaterializeTupleTime(*): 55.171ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 56.990ms - ScannerThreadsVoluntaryContextSwitches: 20 - TotalRawHdfsReadTime(*): 309.722us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d4 (host=perf20-20.cloudera.com:22000):(Total: 37.680ms, non-child: 3.304ms, % non-child: 8.77%) Hdfs split stats (:<# splits>/): 7:1/541.00 KB 5:1/541.48 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 4.64 MB (4862696) - PerHostPeakMemUsage: 28.02 MB (29382408) - PrepareTime: 103.449us - RowsProduced: 2.88K (2885) - TotalCpuTime: 90.652ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 2.6ms - TotalStorageWaitTime: 14.16ms DataStreamSender (dst_id=12):(Total: 3.245ms, non-child: 3.245ms, % non-child: 100.00%) - BytesSent: 1.62 MB (1695883) - NetworkThroughput(*): 33.80 MB/sec - OverallThroughput: 498.28 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 840.159us - ThriftTransmitTime(*): 47.852ms - UncompressedRowBatchSize: 3.61 MB (3782615) HDFS_SCAN_NODE (id=2):(Total: 31.130ms, non-child: 31.130ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/541.00 KB 5:1/541.48 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:8 ExecOption: Codegen enabled: 0 out of 2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.24 MB (1295756) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.24 MB (1295756) - BytesReadShortCircuit: 1.24 MB (1295756) - DecompressionTime: 449.241us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 4.49 MB (4711144) - PerReadThreadRawHdfsThroughput: 3.90 GB/sec - RowsRead: 202.19K (202195) - RowsReturned: 2.88K (2885) - RowsReturnedRate: 92.67 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 65.980ms - MaterializeTupleTime(*): 48.953ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 16 - TotalRawHdfsReadTime(*): 309.579us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d8 (host=perf20-18.cloudera.com:22000):(Total: 37.675ms, non-child: 2.994ms, % non-child: 7.95%) Hdfs split stats (:<# splits>/): 7:1/541.52 KB 0:1/541.32 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 4.57 MB (4797192) - PerHostPeakMemUsage: 27.92 MB (29275744) - PrepareTime: 144.717us - RowsProduced: 2.89K (2890) - TotalCpuTime: 91.124ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.18ms - TotalStorageWaitTime: 14.485ms DataStreamSender (dst_id=12):(Total: 2.198ms, non-child: 2.198ms, % non-child: 100.00%) - BytesSent: 1.72 MB (1802682) - NetworkThroughput(*): 28.89 MB/sec - OverallThroughput: 781.89 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 784.527us - ThriftTransmitTime(*): 59.511ms - UncompressedRowBatchSize: 3.61 MB (3789170) HDFS_SCAN_NODE (id=2):(Total: 32.482ms, non-child: 32.482ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:1/541.52 KB 0:1/541.32 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:8 ExecOption: Codegen enabled: 0 out of 2 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.24 MB (1296379) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.24 MB (1296379) - BytesReadShortCircuit: 1.24 MB (1296379) - DecompressionTime: 427.191us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 2 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 4.49 MB (4711176) - PerReadThreadRawHdfsThroughput: 3.88 GB/sec - RowsRead: 202.32K (202324) - RowsReturned: 2.89K (2890) - RowsReturnedRate: 88.97 K/sec - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 65.867ms - MaterializeTupleTime(*): 48.563ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 49.992ms - ScannerThreadsVoluntaryContextSwitches: 19 - TotalRawHdfsReadTime(*): 311.359us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d3 (host=perf20-15.cloudera.com:22000):(Total: 36.410ms, non-child: 2.833ms, % non-child: 7.78%) Hdfs split stats (:<# splits>/): 8:1/541.75 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474464) - PerHostPeakMemUsage: 25.68 MB (26922832) - PrepareTime: 82.415us - RowsProduced: 1.43K (1432) - TotalCpuTime: 65.28ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.62ms - TotalStorageWaitTime: 6.169ms DataStreamSender (dst_id=12):(Total: 1.705ms, non-child: 1.705ms, % non-child: 100.00%) - BytesSent: 887.79 KB (909093) - NetworkThroughput(*): 20.99 MB/sec - OverallThroughput: 508.44 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 407.410us - ThriftTransmitTime(*): 41.311ms - UncompressedRowBatchSize: 1.79 MB (1877580) HDFS_SCAN_NODE (id=2):(Total: 31.871ms, non-child: 31.871ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/541.75 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.22 KB (648418) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.22 KB (648418) - BytesReadShortCircuit: 633.22 KB (648418) - DecompressionTime: 225.388us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388448) - PerReadThreadRawHdfsThroughput: 4.15 GB/sec - RowsRead: 101.16K (101163) - RowsReturned: 1.43K (1432) - RowsReturnedRate: 44.93 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 32.1ms - MaterializeTupleTime(*): 24.655ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 24.996ms - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 145.388us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d2 (host=perf20-13.cloudera.com:22000):(Total: 35.966ms, non-child: 2.943ms, % non-child: 8.18%) Hdfs split stats (:<# splits>/): 5:1/540.70 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474152) - PerHostPeakMemUsage: 25.67 MB (26921488) - PrepareTime: 129.813us - RowsProduced: 1.43K (1431) - TotalCpuTime: 63.124ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.55ms - TotalStorageWaitTime: 6.861ms DataStreamSender (dst_id=12):(Total: 1.872ms, non-child: 1.872ms, % non-child: 100.00%) - BytesSent: 767.70 KB (786125) - NetworkThroughput(*): 17.67 MB/sec - OverallThroughput: 400.36 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 579.638us - ThriftTransmitTime(*): 42.418ms - UncompressedRowBatchSize: 1.79 MB (1876269) HDFS_SCAN_NODE (id=2):(Total: 31.150ms, non-child: 31.150ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/540.70 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 632.18 KB (647348) - BytesReadDataNodeCache: 0 - BytesReadLocal: 632.18 KB (647348) - BytesReadShortCircuit: 632.18 KB (647348) - DecompressionTime: 191.306us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388136) - PerReadThreadRawHdfsThroughput: 4.23 GB/sec - RowsRead: 100.91K (100906) - RowsReturned: 1.43K (1431) - RowsReturnedRate: 45.94 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 31.369ms - MaterializeTupleTime(*): 23.254ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 142.668us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70da (host=perf20-06.cloudera.com:22000):(Total: 35.785ms, non-child: 2.775ms, % non-child: 7.75%) Hdfs split stats (:<# splits>/): 3:1/541.18 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474400) - PerHostPeakMemUsage: 25.75 MB (26997000) - PrepareTime: 99.87us - RowsProduced: 1.46K (1462) - TotalCpuTime: 62.554ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 862.831us - TotalStorageWaitTime: 7.62ms DataStreamSender (dst_id=12):(Total: 1.525ms, non-child: 1.525ms, % non-child: 100.00%) - BytesSent: 950.30 KB (973104) - NetworkThroughput(*): 23.88 MB/sec - OverallThroughput: 608.21 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 406.35us - ThriftTransmitTime(*): 38.866ms - UncompressedRowBatchSize: 1.83 MB (1916910) HDFS_SCAN_NODE (id=2):(Total: 31.484ms, non-child: 31.484ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 3:1/541.18 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 632.81 KB (647993) - BytesReadDataNodeCache: 0 - BytesReadLocal: 632.81 KB (647993) - BytesReadShortCircuit: 632.81 KB (647993) - DecompressionTime: 205.102us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388384) - PerReadThreadRawHdfsThroughput: 4.18 GB/sec - RowsRead: 101.03K (101033) - RowsReturned: 1.46K (1462) - RowsReturnedRate: 46.44 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 31.612ms - MaterializeTupleTime(*): 23.277ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 144.275us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d5 (host=perf20-19.cloudera.com:22000):(Total: 35.617ms, non-child: 3.349ms, % non-child: 9.41%) Hdfs split stats (:<# splits>/): 0:1/541.51 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474544) - PerHostPeakMemUsage: 25.60 MB (26848152) - PrepareTime: 101.347us - RowsProduced: 1.43K (1433) - TotalCpuTime: 62.899ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.71ms - TotalStorageWaitTime: 6.289ms DataStreamSender (dst_id=12):(Total: 1.610ms, non-child: 1.610ms, % non-child: 100.00%) - BytesSent: 846.13 KB (866438) - NetworkThroughput(*): 21.55 MB/sec - OverallThroughput: 513.02 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 372.783us - ThriftTransmitTime(*): 38.343ms - UncompressedRowBatchSize: 1.79 MB (1878891) HDFS_SCAN_NODE (id=2):(Total: 30.656ms, non-child: 30.656ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/541.51 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.03 KB (648227) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.03 KB (648227) - BytesReadShortCircuit: 633.03 KB (648227) - DecompressionTime: 291.119us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388528) - PerReadThreadRawHdfsThroughput: 4.34 GB/sec - RowsRead: 101.16K (101161) - RowsReturned: 1.43K (1433) - RowsReturnedRate: 46.74 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 30.661ms - MaterializeTupleTime(*): 23.5ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 138.965us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d9 (host=perf20-11.cloudera.com:22000):(Total: 35.546ms, non-child: 3.253ms, % non-child: 9.15%) Hdfs split stats (:<# splits>/): 8:1/540.64 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474160) - PerHostPeakMemUsage: 25.67 MB (26921496) - PrepareTime: 114.295us - RowsProduced: 1.42K (1424) - TotalCpuTime: 61.849ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.21ms - TotalStorageWaitTime: 6.604ms DataStreamSender (dst_id=12):(Total: 1.677ms, non-child: 1.677ms, % non-child: 100.00%) - BytesSent: 869.55 KB (890416) - NetworkThroughput(*): 21.25 MB/sec - OverallThroughput: 506.33 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 400.434us - ThriftTransmitTime(*): 39.958ms - UncompressedRowBatchSize: 1.78 MB (1867092) HDFS_SCAN_NODE (id=2):(Total: 30.615ms, non-child: 30.615ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 8:1/540.64 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 632.09 KB (647256) - BytesReadDataNodeCache: 0 - BytesReadLocal: 632.09 KB (647256) - BytesReadShortCircuit: 632.09 KB (647256) - DecompressionTime: 229.414us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388144) - PerReadThreadRawHdfsThroughput: 4.05 GB/sec - RowsRead: 100.91K (100906) - RowsReturned: 1.42K (1424) - RowsReturnedRate: 46.51 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 30.728ms - MaterializeTupleTime(*): 22.835ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 6 - TotalRawHdfsReadTime(*): 148.796us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70dd (host=perf20-05.cloudera.com:22000):(Total: 35.215ms, non-child: 3.382ms, % non-child: 9.61%) Hdfs split stats (:<# splits>/): 5:1/541.72 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474376) - PerHostPeakMemUsage: 25.70 MB (26953432) - PrepareTime: 171.474us - RowsProduced: 1.46K (1458) - TotalCpuTime: 61.372ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 966.213us - TotalStorageWaitTime: 6.287ms DataStreamSender (dst_id=12):(Total: 1.587ms, non-child: 1.587ms, % non-child: 100.00%) - BytesSent: 870.07 KB (890948) - NetworkThroughput(*): 21.53 MB/sec - OverallThroughput: 535.17 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 384.685us - ThriftTransmitTime(*): 39.471ms - UncompressedRowBatchSize: 1.82 MB (1911666) HDFS_SCAN_NODE (id=2):(Total: 30.245ms, non-child: 30.245ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/541.72 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.24 KB (648437) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.24 KB (648437) - BytesReadShortCircuit: 633.24 KB (648437) - DecompressionTime: 199.545us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388360) - PerReadThreadRawHdfsThroughput: 4.41 GB/sec - RowsRead: 101.16K (101163) - RowsReturned: 1.46K (1458) - RowsReturnedRate: 48.20 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 30.116ms - MaterializeTupleTime(*): 22.603ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 136.904us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70e1 (host=perf20-07.cloudera.com:22000):(Total: 35.214ms, non-child: 3.143ms, % non-child: 8.93%) Hdfs split stats (:<# splits>/): 0:1/542.02 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474480) - PerHostPeakMemUsage: 25.99 MB (27249304) - PrepareTime: 91.634us - RowsProduced: 1.44K (1440) - TotalCpuTime: 63.217ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 330.361us - TotalStorageWaitTime: 6.76ms DataStreamSender (dst_id=12):(Total: 976.996us, non-child: 976.996us, % non-child: 100.00%) - BytesSent: 769.41 KB (787873) - NetworkThroughput(*): 27.77 MB/sec - OverallThroughput: 769.07 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 390.321us - ThriftTransmitTime(*): 27.57ms - UncompressedRowBatchSize: 1.80 MB (1888068) HDFS_SCAN_NODE (id=2):(Total: 31.93ms, non-child: 31.93ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/542.02 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.42 KB (648621) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.42 KB (648621) - BytesReadShortCircuit: 633.42 KB (648621) - DecompressionTime: 171.256us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388464) - PerReadThreadRawHdfsThroughput: 4.05 GB/sec - RowsRead: 101.29K (101292) - RowsReturned: 1.44K (1440) - RowsReturnedRate: 46.31 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 31.228ms - MaterializeTupleTime(*): 23.944ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 149.183us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70de (host=perf20-16.cloudera.com:22000):(Total: 35.77ms, non-child: 2.818ms, % non-child: 8.04%) Hdfs split stats (:<# splits>/): 1:1/542.05 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474552) - PerHostPeakMemUsage: 25.68 MB (26923424) - PrepareTime: 86.444us - RowsProduced: 1.48K (1476) - TotalCpuTime: 61.690ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.151ms - TotalStorageWaitTime: 6.281ms DataStreamSender (dst_id=12):(Total: 1.720ms, non-child: 1.720ms, % non-child: 100.00%) - BytesSent: 783.81 KB (802617) - NetworkThroughput(*): 18.29 MB/sec - OverallThroughput: 445.01 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 347.65us - ThriftTransmitTime(*): 41.856ms - UncompressedRowBatchSize: 1.85 MB (1935264) HDFS_SCAN_NODE (id=2):(Total: 30.538ms, non-child: 30.538ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/542.05 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.58 KB (648790) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.58 KB (648790) - BytesReadShortCircuit: 633.58 KB (648790) - DecompressionTime: 197.867us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388536) - PerReadThreadRawHdfsThroughput: 4.50 GB/sec - RowsRead: 101.29K (101290) - RowsReturned: 1.48K (1476) - RowsReturnedRate: 48.33 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 30.610ms - MaterializeTupleTime(*): 23.179ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 6 - TotalRawHdfsReadTime(*): 134.340us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70db (host=perf20-09.cloudera.com:22000):(Total: 35.28ms, non-child: 3.677ms, % non-child: 10.50%) Hdfs split stats (:<# splits>/): 6:1/541.23 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474296) - PerHostPeakMemUsage: 25.71 MB (26961024) - PrepareTime: 159.746us - RowsProduced: 1.44K (1436) - TotalCpuTime: 62.639ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.46ms - TotalStorageWaitTime: 4.589ms DataStreamSender (dst_id=12):(Total: 2.783ms, non-child: 2.783ms, % non-child: 100.00%) - BytesSent: 885.69 KB (906946) - NetworkThroughput(*): 26.26 MB/sec - OverallThroughput: 310.78 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 368.630us - ThriftTransmitTime(*): 32.934ms - UncompressedRowBatchSize: 1.80 MB (1882824) HDFS_SCAN_NODE (id=2):(Total: 28.567ms, non-child: 28.567ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/541.23 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 632.66 KB (647840) - BytesReadDataNodeCache: 0 - BytesReadLocal: 632.66 KB (647840) - BytesReadShortCircuit: 632.66 KB (647840) - DecompressionTime: 217.361us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388280) - PerReadThreadRawHdfsThroughput: 3.37 GB/sec - RowsRead: 101.03K (101033) - RowsReturned: 1.44K (1436) - RowsReturnedRate: 50.27 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 29.625ms - MaterializeTupleTime(*): 23.511ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 23.996ms - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 179.131us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d7 (host=perf20-17.cloudera.com:22000):(Total: 34.524ms, non-child: 3.201ms, % non-child: 9.27%) Hdfs split stats (:<# splits>/): 5:1/541.57 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474368) - PerHostPeakMemUsage: 25.54 MB (26784400) - PrepareTime: 202.448us - RowsProduced: 1.46K (1455) - TotalCpuTime: 61.308ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 866.887us - TotalStorageWaitTime: 6.489ms DataStreamSender (dst_id=12):(Total: 1.601ms, non-child: 1.601ms, % non-child: 100.00%) - BytesSent: 983.16 KB (1006753) - NetworkThroughput(*): 33.78 MB/sec - OverallThroughput: 599.43 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 454.771us - ThriftTransmitTime(*): 28.425ms - UncompressedRowBatchSize: 1.82 MB (1907733) HDFS_SCAN_NODE (id=2):(Total: 29.721ms, non-child: 29.721ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 5:1/541.57 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.09 KB (648282) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.09 KB (648282) - BytesReadShortCircuit: 633.09 KB (648282) - DecompressionTime: 198.450us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388352) - PerReadThreadRawHdfsThroughput: 4.08 GB/sec - RowsRead: 101.16K (101162) - RowsReturned: 1.46K (1455) - RowsReturnedRate: 48.95 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 29.763ms - MaterializeTupleTime(*): 22.128ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 148.2us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70dc (host=perf20-03.cloudera.com:22000):(Total: 34.468ms, non-child: 3.209ms, % non-child: 9.31%) Hdfs split stats (:<# splits>/): 6:1/541.80 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474496) - PerHostPeakMemUsage: 25.54 MB (26784536) - PrepareTime: 108.833us - RowsProduced: 1.45K (1445) - TotalCpuTime: 61.489ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 1.69ms - TotalStorageWaitTime: 6.446ms DataStreamSender (dst_id=12):(Total: 1.511ms, non-child: 1.511ms, % non-child: 100.00%) - BytesSent: 948.53 KB (971299) - NetworkThroughput(*): 23.33 MB/sec - OverallThroughput: 612.92 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 396.43us - ThriftTransmitTime(*): 39.696ms - UncompressedRowBatchSize: 1.81 MB (1894623) HDFS_SCAN_NODE (id=2):(Total: 29.747ms, non-child: 29.747ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/541.80 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.21 KB (648405) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.21 KB (648405) - BytesReadShortCircuit: 633.21 KB (648405) - DecompressionTime: 197.563us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388480) - PerReadThreadRawHdfsThroughput: 4.00 GB/sec - RowsRead: 101.16K (101163) - RowsReturned: 1.45K (1445) - RowsReturnedRate: 48.58 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 29.806ms - MaterializeTupleTime(*): 22.136ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 150.790us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70d6 (host=perf20-14.cloudera.com:22000):(Total: 33.795ms, non-child: 2.858ms, % non-child: 8.46%) Hdfs split stats (:<# splits>/): 0:1/541.52 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474352) - PerHostPeakMemUsage: 25.41 MB (26646776) - PrepareTime: 87.212us - RowsProduced: 1.45K (1449) - TotalCpuTime: 61.712ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 528.88us - TotalStorageWaitTime: 6.259ms DataStreamSender (dst_id=12):(Total: 1.200ms, non-child: 1.200ms, % non-child: 100.00%) - BytesSent: 894.48 KB (915952) - NetworkThroughput(*): 38.19 MB/sec - OverallThroughput: 727.62 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 398.120us - ThriftTransmitTime(*): 22.870ms - UncompressedRowBatchSize: 1.81 MB (1899867) HDFS_SCAN_NODE (id=2):(Total: 29.735ms, non-child: 29.735ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/541.52 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 633.15 KB (648347) - BytesReadDataNodeCache: 0 - BytesReadLocal: 633.15 KB (648347) - BytesReadShortCircuit: 633.15 KB (648347) - DecompressionTime: 182.319us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388336) - PerReadThreadRawHdfsThroughput: 4.15 GB/sec - RowsRead: 101.16K (101163) - RowsReturned: 1.45K (1449) - RowsReturnedRate: 48.73 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 29.798ms - MaterializeTupleTime(*): 22.440ms - ScannerThreadsSysTime: 999.0us - ScannerThreadsUserTime: 21.996ms - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 145.374us - TotalReadThroughput: 0.00 /sec Instance 19410b874827c24d:891b7d58465b70df (host=perf20-08.cloudera.com:22000):(Total: 31.542ms, non-child: 3.256ms, % non-child: 10.32%) Hdfs split stats (:<# splits>/): 2:1/540.30 KB - AverageThreadTokens: 0.00 - PeakMemoryUsage: 2.36 MB (2474224) - PerHostPeakMemUsage: 25.42 MB (26653808) - PrepareTime: 105.717us - RowsProduced: 1.44K (1440) - TotalCpuTime: 59.867ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 434.873us - TotalStorageWaitTime: 3.987ms DataStreamSender (dst_id=12):(Total: 2.414ms, non-child: 2.414ms, % non-child: 100.00%) - BytesSent: 885.63 KB (906889) - NetworkThroughput(*): 33.36 MB/sec - OverallThroughput: 358.23 MB/sec - PeakMemoryUsage: 76.00 KB (77824) - SerializeBatchTime: 422.38us - ThriftTransmitTime(*): 25.922ms - UncompressedRowBatchSize: 1.80 MB (1888068) HDFS_SCAN_NODE (id=2):(Total: 25.871ms, non-child: 25.871ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/540.30 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:4 ExecOption: Codegen enabled: 0 out of 1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 631.92 KB (647083) - BytesReadDataNodeCache: 0 - BytesReadLocal: 631.92 KB (647083) - BytesReadShortCircuit: 631.92 KB (647083) - DecompressionTime: 168.556us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2.28 MB (2388208) - PerReadThreadRawHdfsThroughput: 4.02 GB/sec - RowsRead: 100.91K (100905) - RowsReturned: 1.44K (1440) - RowsReturnedRate: 55.66 K/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 27.285ms - MaterializeTupleTime(*): 22.156ms - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 22.996ms - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 149.843us - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 19410b874827c24d:891b7d58465b70e2 (host=perf20-11.cloudera.com:22000):(Total: 195.956ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/11.89 KB MemoryUsage(500.0ms): 109.23 KB ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 171.23 KB (175344) - PerHostPeakMemUsage: 25.67 MB (26921496) - PrepareTime: 189.725ms - RowsProduced: 6 - TotalCpuTime: 376.733ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 49.289us - TotalStorageWaitTime: 2.349ms CodeGen:(Total: 366.495ms, non-child: 366.495ms, % non-child: 100.00%) - CodegenTime: 0ns - CompileTime: 177.601ms - LoadTime: 187.421ms - ModuleFileSize: 1.93 MB (2028756) DataStreamSender (dst_id=11):(Total: 591.93us, non-child: 591.93us, % non-child: 100.00%) - BytesSent: 2.45 KB (2508) - NetworkThroughput(*): 618.01 KB/sec - OverallThroughput: 4.05 MB/sec - PeakMemoryUsage: 101.23 KB (103664) - SerializeBatchTime: 11.447us - ThriftTransmitTime(*): 3.963ms - UncompressedRowBatchSize: 3.49 KB (3572) HDFS_SCAN_NODE (id=1):(Total: 382.126ms, non-child: 382.126ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/11.89 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% File Formats: PARQUET/SNAPPY:2 ExecOption: Codegen enabled: 0 out of 1 BytesRead(500.0ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 12.36 KB (12657) - BytesReadDataNodeCache: 0 - BytesReadLocal: 12.36 KB (12657) - BytesReadShortCircuit: 12.36 KB (12657) - DecompressionTime: 3.638us - MaxCompressedTextFileLength: 0 - NumColumns: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 62.00 KB (63488) - PerReadThreadRawHdfsThroughput: 625.78 MB/sec - RowsRead: 62 - RowsReturned: 6 - RowsReturnedRate: 15.00 /sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 2.884ms - MaterializeTupleTime(*): 20.820us - ScannerThreadsSysTime: 0ns - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 5 - TotalRawHdfsReadTime(*): 19.289us - TotalReadThroughput: 0.00 /sec