Query (id=c74ce10ea42773c1:8f12f6e900000000) Summary Session ID: a845c97d34e77d03:baeb826e01dc6e82 Session Type: BEESWAX Start Time: 2017-05-31 15:21:48.371347000 End Time: 2017-05-31 15:29:28.431240000 Query Type: QUERY Query State: EXCEPTION Query Status: Memory limit exceeded: FunctionContext::Allocate's allocations exceeded memory limits. Exprs could not allocate 384.00 B without exceeding limit. Error occurred on backend vd1337.halxg.cloudera.com:22000 by fragment c74ce10ea42773c1:8f12f6e900000080 Memory left in process limit: -853607.00 B Process: memory limit exceeded. Limit=201.73 GB Total=201.73 GB Peak=201.73 GB RequestPool=root.default: Total=189.29 GB Peak=189.29 GB Query(c74ce10ea42773c1:8f12f6e900000000): Total=189.22 GB Peak=189.22 GB Fragment c74ce10ea42773c1:8f12f6e900000101: Total=10.30 MB Peak=11.02 MB AGGREGATION_NODE (id=2): Total=8.00 KB Peak=8.00 KB Exprs: Total=4.00 KB Peak=4.00 KB AGGREGATION_NODE (id=4): Total=10.27 MB Peak=10.27 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=3): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 DataStreamSender (dst_id=5): Total=7.52 KB Peak=7.52 KB CodeGen: Total=6.79 KB Peak=750.50 KB Block Manager: Limit=161.39 GB Total=13.63 GB Peak=13.63 GB Fragment c74ce10ea42773c1:8f12f6e900000080: Total=189.21 GB Peak=189.21 GB AGGREGATION_NODE (id=1): Total=188.83 GB Peak=188.83 GB Exprs: Total=175.20 GB Peak=175.20 GB HDFS_SCAN_NODE (id=0): Total=385.53 MB Peak=601.23 MB DataStreamSender (dst_id=3): Total=660.12 KB Peak=660.12 KB CodeGen: Total=4.48 KB Peak=610.00 KB Query(8743be49f34a3cb9:8bb6ace100000000): Total=34.30 MB Peak=49.49 MB Fragment 8743be49f34a3cb9:8bb6ace1000000f7: Total=34.30 MB Peak=35.22 MB SORT_NODE (id=2): Total=24.00 MB Peak=24.00 MB AGGREGATION_NODE (id=4): Total=10.29 MB Peak=10.29 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=3): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 DataStreamSender (dst_id=5): Total=1.30 KB Peak=1.30 KB CodeGen: Total=3.53 KB Peak=938.50 KB Block Manager: Limit=161.39 GB Total=32.25 MB Peak=32.77 MB Query(2f47bf67bfc60f0d:5473b95700000000): Total=34.30 MB Peak=50.15 MB Fragment 2f47bf67bfc60f0d:5473b957000000f7: Total=34.30 MB Peak=35.22 MB SORT_NODE (id=2): Total=24.00 MB Peak=24.00 MB AGGREGATION_NODE (id=4): Total=10.29 MB Peak=10.29 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=3): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 DataStreamSender (dst_id=5): Total=1.30 KB Peak=1.30 KB CodeGen: Total=3.53 KB Peak=938.50 KB Block Manager: Limit=161.39 GB Total=32.25 MB Peak=32.77 MB Untracked Memory: Total=12.44 GB Impala Version: impalad version 2.9.0-cdh5.12.0 RELEASE (build d99711f9a7f19bcb7c4fcb58281278acea69a6a2) User: systest@HALXG.CLOUDERA.COM Connected User: systest@HALXG.CLOUDERA.COM Delegated User: Network Address: 10.17.187.37:45530 Default Db: tpch_30000_parquet Sql Statement: select max(a) from (select l_suppkey, appx_median(l_returnflag) as a from lineitem group by l_suppkey)t Coordinator: va1027.halxg.cloudera.com:22000 Query Options (non default): Plan: ---------------- Per-Host Resource Reservation: Memory=272.00MB Per-Host Resource Estimates: Memory=7.23GB F02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 06:AGGREGATE [FINALIZE] | output: max:merge(a) | mem-estimate=10.00MB mem-reservation=0B | tuple-ids=3 row-size=16B cardinality=1 | 05:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=3 row-size=16B cardinality=1 | F01:PLAN FRAGMENT [HASH(l_suppkey)] hosts=132 instances=132 02:AGGREGATE | output: max(appx_median(l_returnflag)) | mem-estimate=10.00MB mem-reservation=0B | tuple-ids=3 row-size=16B cardinality=1 | 04:AGGREGATE [FINALIZE] | output: appx_median:merge(l_returnflag) | group by: l_suppkey | mem-estimate=54.34MB mem-reservation=272.00MB | tuple-ids=1 row-size=24B cardinality=284886208 | 03:EXCHANGE [HASH(l_suppkey)] | mem-estimate=0B mem-reservation=0B | tuple-ids=1 row-size=24B cardinality=284886208 | F00:PLAN FRAGMENT [RANDOM] hosts=132 instances=132 01:AGGREGATE [STREAMING] | output: appx_median(l_returnflag) | group by: l_suppkey | mem-estimate=7.00GB mem-reservation=0B | tuple-ids=1 row-size=24B cardinality=284886208 | 00:SCAN HDFS [tpch_30000_parquet.lineitem, RANDOM] partitions=2526/2526 files=28976 size=6.89TB table stats: 179999978268 rows total column stats: all mem-estimate=176.00MB mem-reservation=0B tuple-ids=0 row-size=25B cardinality=179999978268 ---------------- Estimated Per-Host Mem: 7762522486 Per-Host Memory Reservation: 285212672 Request Pool: root.default Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------ 06:AGGREGATE 1 128.316us 128.316us 0 1 8.00 KB 10.00 MB FINALIZE 05:EXCHANGE 1 0.000ns 0.000ns 0 1 0 0 UNPARTITIONED 02:AGGREGATE 129 98.172us 234.636us 0 1 8.00 KB 10.00 MB 04:AGGREGATE 129 908.285us 2.909ms 0 284.89M 11.99 MB 54.34 MB FINALIZE 03:EXCHANGE 129 12.070us 157.459us 33.41K 284.89M 0 0 HASH(l_suppkey) 01:AGGREGATE 129 3s474ms 7m28s 166.38K 284.89M 190.38 GB 7.00 GB STREAMING 00:SCAN HDFS 129 3s274ms 32s857ms 54.72B 180.00B 3.36 GB 176.00 MB tpch_30000_parquet.lineitem Errors: Memory limit exceeded: FunctionContext::Allocate's allocations exceeded memory limits. Exprs could not allocate 384.00 B without exceeding limit. Error occurred on backend vd1337.halxg.cloudera.com:22000 by fragment c74ce10ea42773c1:8f12f6e900000080 Memory left in process limit: -853607.00 B Process: memory limit exceeded. Limit=201.73 GB Total=201.73 GB Peak=201.73 GB RequestPool=root.default: Total=189.29 GB Peak=189.29 GB Query(c74ce10ea42773c1:8f12f6e900000000): Total=189.22 GB Peak=189.22 GB Fragment c74ce10ea42773c1:8f12f6e900000101: Total=10.30 MB Peak=11.02 MB AGGREGATION_NODE (id=2): Total=8.00 KB Peak=8.00 KB Exprs: Total=4.00 KB Peak=4.00 KB AGGREGATION_NODE (id=4): Total=10.27 MB Peak=10.27 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=3): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 DataStreamSender (dst_id=5): Total=7.52 KB Peak=7.52 KB CodeGen: Total=6.79 KB Peak=750.50 KB Block Manager: Limit=161.39 GB Total=13.63 GB Peak=13.63 GB Fragment c74ce10ea42773c1:8f12f6e900000080: Total=189.21 GB Peak=189.21 GB AGGREGATION_NODE (id=1): Total=188.83 GB Peak=188.83 GB Exprs: Total=175.20 GB Peak=175.20 GB HDFS_SCAN_NODE (id=0): Total=385.53 MB Peak=601.23 MB DataStreamSender (dst_id=3): Total=660.12 KB Peak=660.12 KB CodeGen: Total=4.48 KB Peak=610.00 KB Query(8743be49f34a3cb9:8bb6ace100000000): Total=34.30 MB Peak=49.49 MB Fragment 8743be49f34a3cb9:8bb6ace1000000f7: Total=34.30 MB Peak=35.22 MB SORT_NODE (id=2): Total=24.00 MB Peak=24.00 MB AGGREGATION_NODE (id=4): Total=10.29 MB Peak=10.29 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=3): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 DataStreamSender (dst_id=5): Total=1.30 KB Peak=1.30 KB CodeGen: Total=3.53 KB Peak=938.50 KB Block Manager: Limit=161.39 GB Total=32.25 MB Peak=32.77 MB Query(2f47bf67bfc60f0d:5473b95700000000): Total=34.30 MB Peak=50.15 MB Fragment 2f47bf67bfc60f0d:5473b957000000f7: Total=34.30 MB Peak=35.22 MB SORT_NODE (id=2): Total=24.00 MB Peak=24.00 MB AGGREGATION_NODE (id=4): Total=10.29 MB Peak=10.29 MB Exprs: Total=4.00 KB Peak=4.00 KB EXCHANGE_NODE (id=3): Total=0 Peak=0 DataStreamRecvr: Total=0 Peak=0 DataStreamSender (dst_id=5): Total=1.30 KB Peak=1.30 KB CodeGen: Total=3.53 KB Peak=938.50 KB Block Manager: Limit=161.39 GB Total=32.25 MB Peak=32.77 MB Untracked Memory: Total=12.44 GB (1 of 788 similar) - ComputeScanRangeAssignmentTimer: 42493101 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 7983160 Equivalence classes computed: 8085815 Single node plan created: 81544653 Runtime filters computed: 81575840 Distributed plan created: 82132992 Lineage info computed: 82172854 Planning finished: 87610955 Query Timeline Query submitted: 141783 Planning finished: 196172796 Submit for admission: 270018058 Completed admission: 270930411 Ready to start on 130 backends: 297644919 All 130 execution backends (259 fragment instances) started: 1324407267 Rows available: 459987955310 Unregister query: 460059845796 ImpalaServer - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile c74ce10ea42773c1:8f12f6e900000000 Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 130, min / max: 30ms / 356ms, 25th %-ile: 54ms, 50th %-ile: 62ms, 75th %-ile: 80ms, 90th %-ile: 124ms, 95th %-ile: 134ms, 99.9th %-ile: 356ms Per Node Peak Memory Usage: va1027.halxg.cloudera.com:22000(16.00 KB) va1029.halxg.cloudera.com:22000(181.53 GB) va1030.halxg.cloudera.com:22000(174.27 GB) va1031.halxg.cloudera.com:22000(181.00 GB) va1032.halxg.cloudera.com:22000(175.35 GB) va1033.halxg.cloudera.com:22000(175.44 GB) va1034.halxg.cloudera.com:22000(170.22 GB) va1035.halxg.cloudera.com:22000(185.90 GB) va1036.halxg.cloudera.com:22000(184.46 GB) va1037.halxg.cloudera.com:22000(173.30 GB) va1038.halxg.cloudera.com:22000(182.03 GB) va1039.halxg.cloudera.com:22000(185.97 GB) va1041.halxg.cloudera.com:22000(174.25 GB) va1042.halxg.cloudera.com:22000(188.45 GB) va1043.halxg.cloudera.com:22000(180.11 GB) va1044.halxg.cloudera.com:22000(184.26 GB) va1045.halxg.cloudera.com:22000(173.04 GB) va1046.halxg.cloudera.com:22000(176.44 GB) vc1501.halxg.cloudera.com:22000(185.97 GB) vc1502.halxg.cloudera.com:22000(186.06 GB) vc1503.halxg.cloudera.com:22000(181.55 GB) vc1504.halxg.cloudera.com:22000(175.53 GB) vc1505.halxg.cloudera.com:22000(179.17 GB) vc1507.halxg.cloudera.com:22000(189.78 GB) vc1508.halxg.cloudera.com:22000(177.82 GB) vc1509.halxg.cloudera.com:22000(175.63 GB) vc1510.halxg.cloudera.com:22000(181.23 GB) vc1511.halxg.cloudera.com:22000(176.98 GB) vc1513.halxg.cloudera.com:22000(180.17 GB) vc1514.halxg.cloudera.com:22000(172.69 GB) vc1515.halxg.cloudera.com:22000(176.93 GB) vc1516.halxg.cloudera.com:22000(173.86 GB) vc1517.halxg.cloudera.com:22000(171.02 GB) vc1518.halxg.cloudera.com:22000(172.00 GB) vc1519.halxg.cloudera.com:22000(184.04 GB) vc1520.halxg.cloudera.com:22000(172.15 GB) vc1522.halxg.cloudera.com:22000(179.21 GB) vc1523.halxg.cloudera.com:22000(176.72 GB) vc1524.halxg.cloudera.com:22000(177.24 GB) vc1525.halxg.cloudera.com:22000(174.22 GB) vc1526.halxg.cloudera.com:22000(182.01 GB) vc1527.halxg.cloudera.com:22000(175.07 GB) vc1528.halxg.cloudera.com:22000(182.90 GB) vc1529.halxg.cloudera.com:22000(180.09 GB) vc1530.halxg.cloudera.com:22000(174.07 GB) vc1531.halxg.cloudera.com:22000(174.24 GB) vc1532.halxg.cloudera.com:22000(172.28 GB) vc1533.halxg.cloudera.com:22000(177.36 GB) vc1534.halxg.cloudera.com:22000(175.65 GB) vc1535.halxg.cloudera.com:22000(173.09 GB) vc1536.halxg.cloudera.com:22000(185.92 GB) vc1537.halxg.cloudera.com:22000(177.14 GB) vc1538.halxg.cloudera.com:22000(174.98 GB) vc1539.halxg.cloudera.com:22000(179.73 GB) vc1540.halxg.cloudera.com:22000(175.10 GB) vc1541.halxg.cloudera.com:22000(176.27 GB) vc1542.halxg.cloudera.com:22000(173.24 GB) vd1101.halxg.cloudera.com:22000(179.50 GB) vd1102.halxg.cloudera.com:22000(174.17 GB) vd1103.halxg.cloudera.com:22000(180.93 GB) vd1104.halxg.cloudera.com:22000(183.93 GB) vd1105.halxg.cloudera.com:22000(176.90 GB) vd1107.halxg.cloudera.com:22000(176.35 GB) vd1108.halxg.cloudera.com:22000(176.09 GB) vd1109.halxg.cloudera.com:22000(177.54 GB) vd1110.halxg.cloudera.com:22000(176.73 GB) vd1111.halxg.cloudera.com:22000(178.01 GB) vd1112.halxg.cloudera.com:22000(181.32 GB) vd1113.halxg.cloudera.com:22000(174.44 GB) vd1114.halxg.cloudera.com:22000(179.33 GB) vd1115.halxg.cloudera.com:22000(182.11 GB) vd1116.halxg.cloudera.com:22000(184.22 GB) vd1117.halxg.cloudera.com:22000(185.52 GB) vd1118.halxg.cloudera.com:22000(185.41 GB) vd1119.halxg.cloudera.com:22000(184.45 GB) vd1120.halxg.cloudera.com:22000(182.39 GB) vd1121.halxg.cloudera.com:22000(172.93 GB) vd1122.halxg.cloudera.com:22000(179.29 GB) vd1123.halxg.cloudera.com:22000(177.60 GB) vd1124.halxg.cloudera.com:22000(178.36 GB) vd1125.halxg.cloudera.com:22000(187.04 GB) vd1126.halxg.cloudera.com:22000(183.47 GB) vd1127.halxg.cloudera.com:22000(179.21 GB) vd1129.halxg.cloudera.com:22000(184.93 GB) vd1130.halxg.cloudera.com:22000(180.93 GB) vd1131.halxg.cloudera.com:22000(183.49 GB) vd1132.halxg.cloudera.com:22000(180.85 GB) vd1133.halxg.cloudera.com:22000(182.37 GB) vd1134.halxg.cloudera.com:22000(181.16 GB) vd1135.halxg.cloudera.com:22000(181.13 GB) vd1136.halxg.cloudera.com:22000(183.60 GB) vd1138.halxg.cloudera.com:22000(183.41 GB) vd1139.halxg.cloudera.com:22000(179.30 GB) vd1140.halxg.cloudera.com:22000(177.19 GB) vd1141.halxg.cloudera.com:22000(175.09 GB) vd1142.halxg.cloudera.com:22000(178.42 GB) vd1326.halxg.cloudera.com:22000(175.88 GB) vd1327.halxg.cloudera.com:22000(171.25 GB) vd1328.halxg.cloudera.com:22000(181.23 GB) vd1329.halxg.cloudera.com:22000(181.08 GB) vd1330.halxg.cloudera.com:22000(179.39 GB) vd1331.halxg.cloudera.com:22000(178.05 GB) vd1332.halxg.cloudera.com:22000(180.09 GB) vd1333.halxg.cloudera.com:22000(177.45 GB) vd1334.halxg.cloudera.com:22000(182.00 GB) vd1335.halxg.cloudera.com:22000(178.90 GB) vd1336.halxg.cloudera.com:22000(179.15 GB) vd1337.halxg.cloudera.com:22000(188.29 GB) vd1338.halxg.cloudera.com:22000(176.73 GB) vd1339.halxg.cloudera.com:22000(177.74 GB) vd1340.halxg.cloudera.com:22000(182.07 GB) vd1341.halxg.cloudera.com:22000(181.43 GB) vd1342.halxg.cloudera.com:22000(176.43 GB) ve1125.halxg.cloudera.com:22000(175.15 GB) ve1126.halxg.cloudera.com:22000(177.73 GB) ve1127.halxg.cloudera.com:22000(176.74 GB) ve1128.halxg.cloudera.com:22000(175.55 GB) ve1129.halxg.cloudera.com:22000(176.67 GB) ve1130.halxg.cloudera.com:22000(185.91 GB) ve1131.halxg.cloudera.com:22000(182.30 GB) ve1132.halxg.cloudera.com:22000(186.88 GB) ve1134.halxg.cloudera.com:22000(179.63 GB) ve1135.halxg.cloudera.com:22000(184.03 GB) ve1136.halxg.cloudera.com:22000(190.70 GB) ve1137.halxg.cloudera.com:22000(187.02 GB) ve1138.halxg.cloudera.com:22000(183.81 GB) ve1139.halxg.cloudera.com:22000(176.20 GB) ve1140.halxg.cloudera.com:22000(184.71 GB) ve1141.halxg.cloudera.com:22000(186.95 GB) ve1142.halxg.cloudera.com:22000(184.63 GB) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 459690296882 Averaged Fragment F02 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:7m39s max:7m39s mean: 7m39s stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 16384 - PerHostPeakMemUsage: 16384 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 22945034 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 22901658 - ExecTreePrepareTime: 129087 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 0 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 0 - NumInstructions: 0 - OptimizationTime: 0 - PeakMemoryUsage: 0 - PrepareTime: 21728503 - TotalTime: 22177717 AGGREGATION_NODE (id=6) - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 128316 EXCHANGE_NODE (id=5) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Coordinator Fragment F02 Instance c74ce10ea42773c1:8f12f6e900000000 (host=va1027.halxg.cloudera.com:22000) - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 16384 - PerHostPeakMemUsage: 16384 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 22945034 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 22901658 - ExecTreePrepareTime: 129087 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 PLAN_ROOT_SINK - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 0 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 0 - NumInstructions: 0 - OptimizationTime: 0 - PeakMemoryUsage: 0 - PrepareTime: 21728503 - TotalTime: 22177717 AGGREGATION_NODE (id=6) - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 128316 EXCHANGE_NODE (id=5) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Averaged Fragment F01 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:7m38s max:7m39s mean: 7m39s stddev:277.368ms execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 129 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11671214 - PerHostPeakMemUsage: 192403951363 - RowsProduced: 0 - TotalNetworkReceiveTime: 122808916416 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 68560402 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 68484291 - ExecTreePrepareTime: 1352099 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 747 - BlocksRecycled: 105 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14321741440 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 46024 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11478424 - CompileTime: 78290912 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 252865932 - PeakMemoryUsage: 768512 - PrepareTime: 60961072 - TotalTime: 394118820 AGGREGATION_NODE (id=2) - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1351208 AGGREGATION_NODE (id=4) - BuildTime: 416818 - GetNewBlockTime: 524732 - GetResultsTime: 0 - HTResizeTime: 122706 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10979171 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1253035 - UnpinTime: 1771 EXCHANGE_NODE (id=3) - BytesReceived: 6416 - ConvertRowBatchTime: 14221 - DeserializeRowBatchTimer: 156746 - FirstBatchArrivalWaitTime: 122451177097 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 258 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 122725994096 Fragment F01 Instance c74ce10ea42773c1:8f12f6e90000008d (host=vd1141.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186765558847 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 151209080 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 151115879 - ExecTreePrepareTime: 3020164 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 39227 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 19684511 - CompileTime: 63218871 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 293847287 - PeakMemoryUsage: 768512 - PrepareTime: 125351011 - TotalTime: 486535948 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 3017872 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 2189150 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2909770 - UnpinTime: 1638 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000b4 (host=vc1534.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 188602743694 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 123804350 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 123720671 - ExecTreePrepareTime: 1435291 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 40868 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 21622415 - CompileTime: 111335935 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 325583360 - PeakMemoryUsage: 768512 - PrepareTime: 109523371 - TotalTime: 549872411 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1434420 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 436553 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1231079 - UnpinTime: 1545 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000096 (host=ve1134.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192872762947 - RowsProduced: 0 - TotalNetworkReceiveTime: 451188275182 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 114069954 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 114003063 - ExecTreePrepareTime: 1395782 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 37496 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 20748576 - CompileTime: 60020083 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 216425538 - PeakMemoryUsage: 768512 - PrepareTime: 100882545 - TotalTime: 381753634 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1394953 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 705652 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1303045 - UnpinTime: 1498 EXCHANGE_NODE (id=3) - BytesReceived: 16264 - ConvertRowBatchTime: 40326 - DeserializeRowBatchTimer: 619326 - FirstBatchArrivalWaitTime: 451188248950 - InactiveTotalTime: 451188257892 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451188276417 Instance c74ce10ea42773c1:8f12f6e900000093 (host=vd1127.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192424666671 - RowsProduced: 0 - TotalNetworkReceiveTime: 451428159161 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 109326513 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 109229233 - ExecTreePrepareTime: 1446228 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 40777 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 21666115 - CompileTime: 74639331 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 231149530 - PeakMemoryUsage: 768512 - PrepareTime: 96735277 - TotalTime: 406217416 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1445236 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 585648 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1312254 - UnpinTime: 1807 EXCHANGE_NODE (id=3) - BytesReceived: 16269 - ConvertRowBatchTime: 14711 - DeserializeRowBatchTimer: 342842 - FirstBatchArrivalWaitTime: 451428145397 - InactiveTotalTime: 451428149157 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451428221184 Instance c74ce10ea42773c1:8f12f6e9000000ba (host=vd1124.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 191364315751 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 106679656 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 106607670 - ExecTreePrepareTime: 1188367 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 38522 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 17708671 - CompileTime: 67287065 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 245304307 - PeakMemoryUsage: 768512 - PrepareTime: 97972666 - TotalTime: 413314995 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1187542 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 332708 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1057090 - UnpinTime: 2778 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000092 (host=vc1538.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187488913570 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 106466986 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 106325790 - ExecTreePrepareTime: 2018374 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 736 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14227341312 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 63767 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 17319287 - CompileTime: 113182276 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 272678820 - PeakMemoryUsage: 768512 - PrepareTime: 98089102 - TotalTime: 486080529 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2017521 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 778102 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1871017 - UnpinTime: 2441 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000aa (host=vc1536.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 199633520714 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 102105225 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 101984099 - ExecTreePrepareTime: 2120409 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 67886 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12795327 - CompileTime: 117836974 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 242286321 - PeakMemoryUsage: 768512 - PrepareTime: 92369075 - TotalTime: 455404830 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2119544 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 1086917 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2040034 - UnpinTime: 1651 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ac (host=ve1136.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 204766736029 - RowsProduced: 0 - TotalNetworkReceiveTime: 451087733681 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 101117502 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 100928970 - ExecTreePrepareTime: 2758739 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 786 - BlocksRecycled: 13525 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 52371 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15270659 - CompileTime: 98351734 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 263923638 - PeakMemoryUsage: 768512 - PrepareTime: 90669170 - TotalTime: 454586801 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2757704 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 948415 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2596359 - UnpinTime: 1732 EXCHANGE_NODE (id=3) - BytesReceived: 16316 - ConvertRowBatchTime: 17881 - DeserializeRowBatchTimer: 386446 - FirstBatchArrivalWaitTime: 451087727597 - InactiveTotalTime: 451087728601 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451087734909 Instance c74ce10ea42773c1:8f12f6e9000000c5 (host=vd1126.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 197000083160 - RowsProduced: 0 - TotalNetworkReceiveTime: 451472135320 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 100420314 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 100287043 - ExecTreePrepareTime: 1454720 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 75207 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 19391561 - CompileTime: 60056198 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 254432498 - PeakMemoryUsage: 768512 - PrepareTime: 90455158 - TotalTime: 408556050 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1453905 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 402594 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1311811 - UnpinTime: 1583 EXCHANGE_NODE (id=3) - BytesReceived: 16648 - ConvertRowBatchTime: 19525 - DeserializeRowBatchTimer: 304022 - FirstBatchArrivalWaitTime: 451472128361 - InactiveTotalTime: 451472129788 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451472136644 Instance c74ce10ea42773c1:8f12f6e900000088 (host=vd1132.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194003553876 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 100416084 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 100304624 - ExecTreePrepareTime: 1666327 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 142214 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 17575632 - CompileTime: 60496332 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 257716208 - PeakMemoryUsage: 768512 - PrepareTime: 90410143 - TotalTime: 411453429 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1665405 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 682487 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1492336 - UnpinTime: 1712 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d8 (host=vc1502.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 198419635341 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 100052706 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 99944457 - ExecTreePrepareTime: 1022068 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 72966 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 19040177 - CompileTime: 76977936 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 255087771 - PeakMemoryUsage: 768512 - PrepareTime: 89688124 - TotalTime: 425040631 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1021169 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 384238 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 925024 - UnpinTime: 1464 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a3 (host=vd1118.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 199077331874 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 95306816 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 95119151 - ExecTreePrepareTime: 1443470 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 49267 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 28243917 - CompileTime: 80384567 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 269529045 - PeakMemoryUsage: 768512 - PrepareTime: 83927515 - TotalTime: 436195711 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1442537 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 413157 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1307270 - UnpinTime: 1557 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000097 (host=vc1540.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186481337274 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 95122246 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 95050825 - ExecTreePrepareTime: 1409168 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 38228 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11189346 - CompileTime: 83041974 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 252864891 - PeakMemoryUsage: 768512 - PrepareTime: 86967216 - TotalTime: 425738814 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1406950 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 425545 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1248234 - UnpinTime: 1495 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000008c (host=ve1141.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 200733168389 - RowsProduced: 0 - TotalNetworkReceiveTime: 451030087084 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 94867400 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 94799770 - ExecTreePrepareTime: 1554354 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 40871 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15598832 - CompileTime: 113912042 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 294104575 - PeakMemoryUsage: 768512 - PrepareTime: 85598154 - TotalTime: 495904840 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1553372 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 579310 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1478042 - UnpinTime: 1574 EXCHANGE_NODE (id=3) - BytesReceived: 16363 - ConvertRowBatchTime: 51315 - DeserializeRowBatchTimer: 675895 - FirstBatchArrivalWaitTime: 451030053719 - InactiveTotalTime: 451030063488 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451030107032 Instance c74ce10ea42773c1:8f12f6e9000000c9 (host=vc1519.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 196351814814 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 94430904 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 94347769 - ExecTreePrepareTime: 1376454 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 56704 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 16898269 - CompileTime: 133903527 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 279682005 - PeakMemoryUsage: 768512 - PrepareTime: 85511156 - TotalTime: 501026156 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1375565 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 466385 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1245078 - UnpinTime: 1636 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000fb (host=vd1119.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 198050635153 - RowsProduced: 0 - TotalNetworkReceiveTime: 451504610263 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 94380668 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 94311188 - ExecTreePrepareTime: 1426179 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 51419 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 16345800 - CompileTime: 70418160 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 265614685 - PeakMemoryUsage: 768512 - PrepareTime: 85957435 - TotalTime: 425797530 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1425355 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 451457 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1278956 - UnpinTime: 1482 EXCHANGE_NODE (id=3) - BytesReceived: 16344 - ConvertRowBatchTime: 81592 - DeserializeRowBatchTimer: 649689 - FirstBatchArrivalWaitTime: 451504583411 - InactiveTotalTime: 451504584767 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451504613480 Instance c74ce10ea42773c1:8f12f6e9000000fd (host=vc1504.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 188477423374 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 93564398 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 93499225 - ExecTreePrepareTime: 2244494 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 61157 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12329707 - CompileTime: 46169862 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 244362199 - PeakMemoryUsage: 768512 - PrepareTime: 81685027 - TotalTime: 375522914 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2243679 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 1002826 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 2115093 - UnpinTime: 1597 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ea (host=vc1525.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187064227837 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 93176660 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 93096473 - ExecTreePrepareTime: 1178861 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 58933 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 22872129 - CompileTime: 101454952 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 293776766 - PeakMemoryUsage: 768512 - PrepareTime: 80965484 - TotalTime: 479144578 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1178156 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 388091 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1056803 - UnpinTime: 1582 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000089 (host=va1031.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194345148407 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 92901297 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 92792897 - ExecTreePrepareTime: 1931301 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 130627 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 23791753 - CompileTime: 104131764 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 286935714 - PeakMemoryUsage: 768512 - PrepareTime: 79857988 - TotalTime: 473627382 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1929837 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 620409 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1804405 - UnpinTime: 3359 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000b5 (host=vd1125.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 200831140291 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 91554791 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 91494155 - ExecTreePrepareTime: 1394931 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 100692 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12822298 - CompileTime: 78936161 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 277212653 - PeakMemoryUsage: 768512 - PrepareTime: 82130257 - TotalTime: 442199002 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1394146 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 436459 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1269542 - UnpinTime: 1588 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000009b (host=vd1136.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12673548 - PerHostPeakMemUsage: 197091036822 - RowsProduced: 0 - TotalNetworkReceiveTime: 456795177303 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 90506463 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 90442712 - ExecTreePrepareTime: 1664049 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504443904 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 28659 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 14865443 - CompileTime: 65365759 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 279045953 - PeakMemoryUsage: 768512 - PrepareTime: 86173537 - TotalTime: 432211140 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1663275 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 2994897 - GetNewBlockTime: 912792 - GetResultsTime: 0 - HTResizeTime: 595660 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12442727 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1555009 - UnpinTime: 1543 EXCHANGE_NODE (id=3) - BytesReceived: 32525 - ConvertRowBatchTime: 214654 - DeserializeRowBatchTimer: 697858 - FirstBatchArrivalWaitTime: 451376644205 - InactiveTotalTime: 456795150789 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 456795233691 Instance c74ce10ea42773c1:8f12f6e9000000f9 (host=vd1133.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 195429093299 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 90261481 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 90178650 - ExecTreePrepareTime: 1541042 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 51609 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 14134631 - CompileTime: 67738137 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 302101834 - PeakMemoryUsage: 768512 - PrepareTime: 85385022 - TotalTime: 457134876 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1539973 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 505239 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1434456 - UnpinTime: 8898 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e4 (host=ve1139.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189004820720 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 89541569 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 89421764 - ExecTreePrepareTime: 1811358 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 62706 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12356457 - CompileTime: 67231768 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 237904590 - PeakMemoryUsage: 768512 - PrepareTime: 79996092 - TotalTime: 388712468 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1810562 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 811617 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1673884 - UnpinTime: 1567 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ca (host=vd1330.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12706316 - PerHostPeakMemUsage: 192619391407 - RowsProduced: 0 - TotalNetworkReceiveTime: 451624549399 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 88708061 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 88647590 - ExecTreePrepareTime: 1516603 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14370226176 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 50152 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15883770 - CompileTime: 67487869 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 269535720 - PeakMemoryUsage: 768512 - PrepareTime: 79839917 - TotalTime: 419507005 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1515730 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 4590843 - GetNewBlockTime: 623500 - GetResultsTime: 0 - HTResizeTime: 1322051 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12475495 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1434110 - UnpinTime: 1711 EXCHANGE_NODE (id=3) - BytesReceived: 32344 - ConvertRowBatchTime: 54837 - DeserializeRowBatchTimer: 939834 - FirstBatchArrivalWaitTime: 451212795812 - InactiveTotalTime: 451624524807 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451624622702 Instance c74ce10ea42773c1:8f12f6e9000000cd (host=vc1501.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 199679153465 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 88062660 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 87957892 - ExecTreePrepareTime: 1803257 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 36671 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 16855492 - CompileTime: 97430353 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 253162342 - PeakMemoryUsage: 768512 - PrepareTime: 78022477 - TotalTime: 431729894 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1802448 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 757011 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1648265 - UnpinTime: 1537 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d5 (host=ve1127.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12640780 - PerHostPeakMemUsage: 189769402551 - RowsProduced: 0 - TotalNetworkReceiveTime: 451592865484 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 87356888 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 87242070 - ExecTreePrepareTime: 1331708 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14236008448 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26531 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13744583 - CompileTime: 69563462 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 250173699 - PeakMemoryUsage: 768512 - PrepareTime: 79149893 - TotalTime: 401020362 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1330886 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 4456980 - GetNewBlockTime: 498327 - GetResultsTime: 0 - HTResizeTime: 1194688 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12409959 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1240460 - UnpinTime: 1662 EXCHANGE_NODE (id=3) - BytesReceived: 32332 - ConvertRowBatchTime: 82270 - DeserializeRowBatchTimer: 827162 - FirstBatchArrivalWaitTime: 451189945633 - InactiveTotalTime: 451592799946 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451592957405 Instance c74ce10ea42773c1:8f12f6e9000000b0 (host=ve1132.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 200655525299 - RowsProduced: 0 - TotalNetworkReceiveTime: 451153688203 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 84625192 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 84548522 - ExecTreePrepareTime: 1558812 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 41863 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 16367929 - CompileTime: 65330671 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 234052745 - PeakMemoryUsage: 768512 - PrepareTime: 75392689 - TotalTime: 377689142 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1557994 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 558332 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1443904 - UnpinTime: 1676 EXCHANGE_NODE (id=3) - BytesReceived: 16530 - ConvertRowBatchTime: 50319 - DeserializeRowBatchTimer: 560311 - FirstBatchArrivalWaitTime: 451153659032 - InactiveTotalTime: 451153667424 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451153710065 Instance c74ce10ea42773c1:8f12f6e9000000de (host=vd1327.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 183880478631 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 83569855 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 83482680 - ExecTreePrepareTime: 1719740 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 102200 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13905788 - CompileTime: 59504114 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 257138625 - PeakMemoryUsage: 768512 - PrepareTime: 74580334 - TotalTime: 394111269 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1718732 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 518244 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1484096 - UnpinTime: 1568 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a8 (host=vc1516.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186683906085 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 83250242 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 83192814 - ExecTreePrepareTime: 1195688 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 40491 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15304123 - CompileTime: 143447209 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 297826096 - PeakMemoryUsage: 768512 - PrepareTime: 73619357 - TotalTime: 516712608 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1194823 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 409968 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1105831 - UnpinTime: 1381 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ed (host=vc1514.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 185389546978 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 83170544 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 83079746 - ExecTreePrepareTime: 1165210 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 40306 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15504135 - CompileTime: 54111109 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 244554012 - PeakMemoryUsage: 768512 - PrepareTime: 72702258 - TotalTime: 373541794 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1164315 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 412161 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1087575 - UnpinTime: 1588 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ee (host=va1042.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 202341814224 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 81267813 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 81186553 - ExecTreePrepareTime: 1687462 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 38491 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 20352977 - CompileTime: 113900420 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 222673922 - PeakMemoryUsage: 768512 - PrepareTime: 71942297 - TotalTime: 411638776 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1686426 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 726444 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1602182 - UnpinTime: 1532 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000fe (host=ve1129.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189703107757 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 80639221 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 80566407 - ExecTreePrepareTime: 1487396 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 63690 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12699146 - CompileTime: 51265284 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 219894716 - PeakMemoryUsage: 768512 - PrepareTime: 72108515 - TotalTime: 346099228 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1486668 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 600187 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1378934 - UnpinTime: 1553 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000099 (host=vc1530.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186448599646 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 80634321 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 80567920 - ExecTreePrepareTime: 1323232 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 40921 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 16233759 - CompileTime: 104784644 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 283556048 - PeakMemoryUsage: 768512 - PrepareTime: 71759729 - TotalTime: 463393493 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1322584 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 425330 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1202433 - UnpinTime: 1613 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000009d (host=vc1535.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 185851130540 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 80464048 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 80350744 - ExecTreePrepareTime: 1226959 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 37155 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13099583 - CompileTime: 125110599 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 280847718 - PeakMemoryUsage: 768512 - PrepareTime: 71176006 - TotalTime: 480323448 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1226107 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 408090 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1130574 - UnpinTime: 1553 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000f6 (host=vd1329.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194430642010 - RowsProduced: 0 - TotalNetworkReceiveTime: 451270133014 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 79890891 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 79820135 - ExecTreePrepareTime: 1482435 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 48137 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 14625534 - CompileTime: 64766273 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 256833303 - PeakMemoryUsage: 768512 - PrepareTime: 72946986 - TotalTime: 396385570 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1481606 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 514712 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1327504 - UnpinTime: 1540 EXCHANGE_NODE (id=3) - BytesReceived: 16332 - ConvertRowBatchTime: 42160 - DeserializeRowBatchTimer: 538202 - FirstBatchArrivalWaitTime: 451270119172 - InactiveTotalTime: 451270120110 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451270139057 Instance c74ce10ea42773c1:8f12f6e9000000b3 (host=vd1139.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 191714598810 - RowsProduced: 0 - TotalNetworkReceiveTime: 451414974515 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 79385246 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 79321887 - ExecTreePrepareTime: 1196319 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 65049 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7614460 - CompileTime: 61315515 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 225041200 - PeakMemoryUsage: 768512 - PrepareTime: 73072583 - TotalTime: 360826333 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1195340 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 428760 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1066226 - UnpinTime: 1718 EXCHANGE_NODE (id=3) - BytesReceived: 16370 - ConvertRowBatchTime: 35813 - DeserializeRowBatchTimer: 401569 - FirstBatchArrivalWaitTime: 451414954974 - InactiveTotalTime: 451414963126 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451414981183 Instance c74ce10ea42773c1:8f12f6e9000000a7 (host=vc1523.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189754085394 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 78627202 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 78559894 - ExecTreePrepareTime: 1023379 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 38351 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 16336246 - CompileTime: 88477281 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 275460746 - PeakMemoryUsage: 768512 - PrepareTime: 69092621 - TotalTime: 435354323 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1022611 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 281893 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 949011 - UnpinTime: 1654 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000af (host=vd1104.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 197489962773 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 78313617 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 78229961 - ExecTreePrepareTime: 1337785 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 59564 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11832892 - CompileTime: 73850888 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 276036639 - PeakMemoryUsage: 768512 - PrepareTime: 69798193 - TotalTime: 422136344 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1337109 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 443450 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1221089 - UnpinTime: 1517 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d9 (host=vd1108.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187285189374 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 78193384 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 78137063 - ExecTreePrepareTime: 1173388 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 722 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14109900800 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 34823 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13430164 - CompileTime: 62238968 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 297778805 - PeakMemoryUsage: 768512 - PrepareTime: 68675362 - TotalTime: 431264626 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1172419 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 401203 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1076888 - UnpinTime: 1632 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e1 (host=vc1539.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192979131564 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 77117317 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 77060974 - ExecTreePrepareTime: 1319604 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 86860 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15748882 - CompileTime: 113923348 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 271663252 - PeakMemoryUsage: 768512 - PrepareTime: 66716862 - TotalTime: 456864752 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1318859 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 442804 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1218455 - UnpinTime: 1498 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000b2 (host=vd1103.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192922317798 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 75954237 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 75856642 - ExecTreePrepareTime: 1260010 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 78110 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12840116 - CompileTime: 49356082 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 254667895 - PeakMemoryUsage: 768512 - PrepareTime: 65367650 - TotalTime: 371960170 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1259028 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 376388 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1155616 - UnpinTime: 1451 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000cc (host=vc1522.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192421296681 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 75852391 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 75796188 - ExecTreePrepareTime: 1083808 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 42521 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15859374 - CompileTime: 64111445 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 278185031 - PeakMemoryUsage: 768512 - PrepareTime: 68515168 - TotalTime: 412497115 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1083030 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 438112 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 998365 - UnpinTime: 1516 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ad (host=ve1125.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12542476 - PerHostPeakMemUsage: 188066189507 - RowsProduced: 0 - TotalNetworkReceiveTime: 456662764473 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 75490571 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 75421285 - ExecTreePrepareTime: 1676675 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14236008448 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 27948 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13231056 - CompileTime: 52138183 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 227825944 - PeakMemoryUsage: 768512 - PrepareTime: 66316840 - TotalTime: 349056728 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1675759 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 4413953 - GetNewBlockTime: 823167 - GetResultsTime: 0 - HTResizeTime: 1989423 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12311655 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1573219 - UnpinTime: 1548 EXCHANGE_NODE (id=3) - BytesReceived: 32507 - ConvertRowBatchTime: 58645 - DeserializeRowBatchTimer: 817315 - FirstBatchArrivalWaitTime: 451275940879 - InactiveTotalTime: 456662722135 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 456662831848 Instance c74ce10ea42773c1:8f12f6e900000101 (host=vd1337.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 202178430789 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 75291301 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 75223932 - ExecTreePrepareTime: 1097309 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 51057 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13511249 - CompileTime: 74050679 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 261039636 - PeakMemoryUsage: 768512 - PrepareTime: 67881967 - TotalTime: 405476731 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1096587 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 438670 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1010582 - UnpinTime: 2942 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d7 (host=ve1137.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 200807495423 - RowsProduced: 0 - TotalNetworkReceiveTime: 451137424716 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 75162436 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 75077563 - ExecTreePrepareTime: 1378836 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31256 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11537748 - CompileTime: 59868239 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 209872687 - PeakMemoryUsage: 768512 - PrepareTime: 67258598 - TotalTime: 339213494 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1377814 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 474206 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1300068 - UnpinTime: 1455 EXCHANGE_NODE (id=3) - BytesReceived: 16451 - ConvertRowBatchTime: 66336 - DeserializeRowBatchTimer: 484959 - FirstBatchArrivalWaitTime: 451137386835 - InactiveTotalTime: 451137395926 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451137431953 Instance c74ce10ea42773c1:8f12f6e90000008a (host=vd1328.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194590268428 - RowsProduced: 0 - TotalNetworkReceiveTime: 451376264850 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 74889094 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 74774841 - ExecTreePrepareTime: 1407383 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26922 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 15274048 - CompileTime: 47848485 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 232525913 - PeakMemoryUsage: 768512 - PrepareTime: 64540653 - TotalTime: 347875416 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1406545 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 456153 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1330170 - UnpinTime: 1703 EXCHANGE_NODE (id=3) - BytesReceived: 16279 - ConvertRowBatchTime: 29598 - DeserializeRowBatchTimer: 362702 - FirstBatchArrivalWaitTime: 451376250150 - InactiveTotalTime: 451376251346 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451376265896 Instance c74ce10ea42773c1:8f12f6e9000000c6 (host=vd1333.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190441150084 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 74524547 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 74459949 - ExecTreePrepareTime: 1371218 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 41976 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11672761 - CompileTime: 71936880 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 270794013 - PeakMemoryUsage: 768512 - PrepareTime: 66852672 - TotalTime: 411650444 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1370530 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 445579 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1201658 - UnpinTime: 1538 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ab (host=vc1511.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190030646624 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 74330541 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 74268317 - ExecTreePrepareTime: 1002703 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 58676 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11177878 - CompileTime: 99865610 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 282081579 - PeakMemoryUsage: 768512 - PrepareTime: 66420463 - TotalTime: 450913942 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1001762 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 297851 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 893683 - UnpinTime: 1556 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000086 (host=vc1507.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 202437493248 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 74079004 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 73971407 - ExecTreePrepareTime: 1164397 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 785 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14638383104 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 60562 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12200286 - CompileTime: 112561522 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 284026282 - PeakMemoryUsage: 768512 - PrepareTime: 66673838 - TotalTime: 465317411 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1163646 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 345694 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1081169 - UnpinTime: 1563 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000c0 (host=vc1515.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189547665769 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 72464655 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 72352366 - ExecTreePrepareTime: 1310843 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 68435 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12078631 - CompileTime: 71493966 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 277317195 - PeakMemoryUsage: 768512 - PrepareTime: 64308376 - TotalTime: 415125390 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1310041 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 511104 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1223665 - UnpinTime: 1561 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000dd (host=vc1542.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186015810532 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 71910789 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 71790870 - ExecTreePrepareTime: 1676735 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30754 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13504440 - CompileTime: 104141851 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 231619631 - PeakMemoryUsage: 768512 - PrepareTime: 63747829 - TotalTime: 401729508 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1675917 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 865382 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1598565 - UnpinTime: 1510 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000f0 (host=ve1142.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12739084 - PerHostPeakMemUsage: 198239915020 - RowsProduced: 0 - TotalNetworkReceiveTime: 456509499130 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 71766310 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 71674978 - ExecTreePrepareTime: 1623434 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504443904 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 35793 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6879791 - CompileTime: 66287922 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 212192983 - PeakMemoryUsage: 768512 - PrepareTime: 67087737 - TotalTime: 346336316 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1622542 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 5932172 - GetNewBlockTime: 634537 - GetResultsTime: 0 - HTResizeTime: 2195466 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12508263 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1507073 - UnpinTime: 1470 EXCHANGE_NODE (id=3) - BytesReceived: 32407 - ConvertRowBatchTime: 58790 - DeserializeRowBatchTimer: 1029221 - FirstBatchArrivalWaitTime: 451167730868 - InactiveTotalTime: 456509463317 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 456509555006 Instance c74ce10ea42773c1:8f12f6e9000000c7 (host=vd1332.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 193365012110 - RowsProduced: 0 - TotalNetworkReceiveTime: 451429643563 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 71157404 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 71072438 - ExecTreePrepareTime: 1979908 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 106365 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12449959 - CompileTime: 48168846 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 218221498 - PeakMemoryUsage: 768512 - PrepareTime: 63605541 - TotalTime: 331637923 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1978933 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 686450 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1795567 - UnpinTime: 3683 EXCHANGE_NODE (id=3) - BytesReceived: 16570 - ConvertRowBatchTime: 33294 - DeserializeRowBatchTimer: 637288 - FirstBatchArrivalWaitTime: 451429619096 - InactiveTotalTime: 451429627968 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451429650142 Instance c74ce10ea42773c1:8f12f6e9000000ae (host=vd1101.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192733621340 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 71070696 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 71005370 - ExecTreePrepareTime: 1625065 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 35027 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12108431 - CompileTime: 99359762 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 247894254 - PeakMemoryUsage: 768512 - PrepareTime: 62205853 - TotalTime: 411757440 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1624082 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 581958 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1535953 - UnpinTime: 2312 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d1 (host=vd1105.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189944800523 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 70342965 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 70257091 - ExecTreePrepareTime: 1277091 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31983 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 14660943 - CompileTime: 61977305 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 266051889 - PeakMemoryUsage: 768512 - PrepareTime: 60887751 - TotalTime: 390730590 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1276256 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 438270 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1118983 - UnpinTime: 1508 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000f8 (host=ve1138.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 196717738782 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 70061626 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 70003996 - ExecTreePrepareTime: 1096784 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 35101 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11511015 - CompileTime: 95381414 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 284049534 - PeakMemoryUsage: 768512 - PrepareTime: 62637937 - TotalTime: 443730956 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1094535 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 387828 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 955281 - UnpinTime: 1674 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000f2 (host=vc1513.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 193452984040 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 70035677 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 69962549 - ExecTreePrepareTime: 1979268 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31151 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11137284 - CompileTime: 89925062 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 242811637 - PeakMemoryUsage: 768512 - PrepareTime: 60589947 - TotalTime: 394749133 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1978272 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 858229 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1886568 - UnpinTime: 3116 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e8 (host=vd1140.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189638039999 - RowsProduced: 0 - TotalNetworkReceiveTime: 451370211756 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 70031691 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 69965800 - ExecTreePrepareTime: 1691601 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 53242 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11960782 - CompileTime: 51168806 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 275040349 - PeakMemoryUsage: 768512 - PrepareTime: 60780984 - TotalTime: 388617541 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1690719 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 636202 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1607371 - UnpinTime: 1556 EXCHANGE_NODE (id=3) - BytesReceived: 16267 - ConvertRowBatchTime: 63190 - DeserializeRowBatchTimer: 444120 - FirstBatchArrivalWaitTime: 451370188562 - InactiveTotalTime: 451370197187 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451370212945 Instance c74ce10ea42773c1:8f12f6e90000009a (host=vc1505.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192383548382 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 68768777 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 68703647 - ExecTreePrepareTime: 1085450 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31039 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 14830606 - CompileTime: 103651063 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 298987327 - PeakMemoryUsage: 768512 - PrepareTime: 62442209 - TotalTime: 466709622 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1084751 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 409247 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1006465 - UnpinTime: 1644 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000c1 (host=vc1528.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 196385690827 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 68659820 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 68573491 - ExecTreePrepareTime: 1248058 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 51385 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12770612 - CompileTime: 109609085 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 263399082 - PeakMemoryUsage: 768512 - PrepareTime: 61553206 - TotalTime: 436507992 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1247215 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 464628 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1115803 - UnpinTime: 1520 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000085 (host=va1038.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 195107150686 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 68199481 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 68133854 - ExecTreePrepareTime: 1898079 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 36113 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13234725 - CompileTime: 87254016 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 217308639 - PeakMemoryUsage: 768512 - PrepareTime: 58654576 - TotalTime: 364952610 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1897227 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 962399 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1808098 - UnpinTime: 1575 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000102 (host=vd1114.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192556366811 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 67739533 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 67676831 - ExecTreePrepareTime: 1222725 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 61795 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11636977 - CompileTime: 70775023 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 268566310 - PeakMemoryUsage: 768512 - PrepareTime: 60373674 - TotalTime: 401673544 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1221752 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 311721 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1112160 - UnpinTime: 1710 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e3 (host=vd1340.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12739084 - PerHostPeakMemUsage: 195496582429 - RowsProduced: 0 - TotalNetworkReceiveTime: 456562762254 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 67738896 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 67665145 - ExecTreePrepareTime: 1157736 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14370226176 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 57399 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12161280 - CompileTime: 68679156 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 265242000 - PeakMemoryUsage: 768512 - PrepareTime: 60616433 - TotalTime: 397243280 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1156935 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3226282 - GetNewBlockTime: 406919 - GetResultsTime: 0 - HTResizeTime: 554050 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12508263 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1031821 - UnpinTime: 1469 EXCHANGE_NODE (id=3) - BytesReceived: 32359 - ConvertRowBatchTime: 81538 - DeserializeRowBatchTimer: 662621 - FirstBatchArrivalWaitTime: 451192543291 - InactiveTotalTime: 456562742479 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 456562852326 Instance c74ce10ea42773c1:8f12f6e9000000b8 (host=va1035.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 198489893643 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 66515807 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 66454386 - ExecTreePrepareTime: 1417633 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31603 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13335126 - CompileTime: 94312987 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 216287452 - PeakMemoryUsage: 768512 - PrepareTime: 58501085 - TotalTime: 370561441 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1416654 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 583775 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1342055 - UnpinTime: 1700 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d6 (host=vc1527.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187978212206 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 65917906 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 65860470 - ExecTreePrepareTime: 976887 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 41245 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 13092154 - CompileTime: 120881767 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 264477559 - PeakMemoryUsage: 768512 - PrepareTime: 57124637 - TotalTime: 445675006 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 975909 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 263895 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 902205 - UnpinTime: 1539 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e9 (host=ve1140.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12673548 - PerHostPeakMemUsage: 197412266922 - RowsProduced: 0 - TotalNetworkReceiveTime: 451536624003 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 64582244 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 64521037 - ExecTreePrepareTime: 1107337 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504443904 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31556 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10811744 - CompileTime: 85506081 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 255310239 - PeakMemoryUsage: 768512 - PrepareTime: 58449893 - TotalTime: 400807674 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1106496 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3908874 - GetNewBlockTime: 354830 - GetResultsTime: 0 - HTResizeTime: 1324836 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12442727 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1033891 - UnpinTime: 1617 EXCHANGE_NODE (id=3) - BytesReceived: 32178 - ConvertRowBatchTime: 48342 - DeserializeRowBatchTimer: 618943 - FirstBatchArrivalWaitTime: 451126920644 - InactiveTotalTime: 451536576844 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451536670628 Instance c74ce10ea42773c1:8f12f6e9000000a2 (host=vd1130.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 193395453416 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 64270694 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 64210589 - ExecTreePrepareTime: 1375121 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 53135 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12905522 - CompileTime: 70429919 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 238605771 - PeakMemoryUsage: 768512 - PrepareTime: 57573159 - TotalTime: 369234158 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1374215 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 541602 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1289441 - UnpinTime: 1696 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d0 (host=vc1532.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 183515736957 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 64078522 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 64007823 - ExecTreePrepareTime: 1378146 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 33711 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11830042 - CompileTime: 79963557 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 220011513 - PeakMemoryUsage: 768512 - PrepareTime: 56009969 - TotalTime: 357950798 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1377225 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 628897 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1275768 - UnpinTime: 1487 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ef (host=vd1107.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189133645772 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 64069470 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 64002997 - ExecTreePrepareTime: 1003617 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 171439 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12700684 - CompileTime: 51398697 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 254802938 - PeakMemoryUsage: 768512 - PrepareTime: 54928099 - TotalTime: 363937714 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1002635 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 275553 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 890222 - UnpinTime: 1539 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000100 (host=vd1113.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187304270091 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 63753613 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 63651663 - ExecTreePrepareTime: 1756276 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 51743 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7765164 - CompileTime: 51494802 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 211977266 - PeakMemoryUsage: 768512 - PrepareTime: 57913300 - TotalTime: 322335779 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1755256 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 596544 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1656766 - UnpinTime: 1650 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000cb (host=vd1338.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189478934893 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 63427295 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 63353301 - ExecTreePrepareTime: 1362780 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 36627 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11707191 - CompileTime: 46989050 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 240476245 - PeakMemoryUsage: 768512 - PrepareTime: 55205658 - TotalTime: 345061281 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1361881 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 492619 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1279944 - UnpinTime: 1534 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a9 (host=vc1503.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194941838017 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 63384024 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 63309452 - ExecTreePrepareTime: 1181425 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 34857 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8206790 - CompileTime: 100833075 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 256487158 - PeakMemoryUsage: 768512 - PrepareTime: 59013456 - TotalTime: 417887411 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1180376 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 472999 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1079527 - UnpinTime: 1750 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e2 (host=vd1102.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187009076053 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 62146121 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 62103613 - ExecTreePrepareTime: 781411 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 33738 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11339516 - CompileTime: 51687167 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 224632015 - PeakMemoryUsage: 768512 - PrepareTime: 53182221 - TotalTime: 331648797 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 781043 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 276724 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 730692 - UnpinTime: 602 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000098 (host=va1037.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186077631251 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 61479691 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 61403533 - ExecTreePrepareTime: 1616681 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 39755 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10562693 - CompileTime: 96280930 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 226418912 - PeakMemoryUsage: 768512 - PrepareTime: 54645354 - TotalTime: 379077591 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1615746 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 743534 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1528164 - UnpinTime: 1501 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000009f (host=vc1518.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 184674389506 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 61380244 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 61323552 - ExecTreePrepareTime: 1679835 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 22489 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11204630 - CompileTime: 84750787 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 237641828 - PeakMemoryUsage: 768512 - PrepareTime: 54530359 - TotalTime: 378357810 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1677884 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 751766 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1604383 - UnpinTime: 1217 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a5 (host=vd1121.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 185680063401 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 61367013 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 61288331 - ExecTreePrepareTime: 1093613 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 52555 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10662937 - CompileTime: 70938477 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 270900378 - PeakMemoryUsage: 768512 - PrepareTime: 54650998 - TotalTime: 398237592 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1092958 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 430831 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1016555 - UnpinTime: 1551 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a0 (host=ve1128.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187798287244 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 61015673 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 60955386 - ExecTreePrepareTime: 1237604 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 35442 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10796212 - CompileTime: 70073277 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 268106232 - PeakMemoryUsage: 768512 - PrepareTime: 54123128 - TotalTime: 395021652 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1236692 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 438999 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1153607 - UnpinTime: 1647 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a6 (host=va1045.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 185796747631 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 60354750 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 60298456 - ExecTreePrepareTime: 1201844 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 29341 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 12211926 - CompileTime: 105380852 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 308395935 - PeakMemoryUsage: 768512 - PrepareTime: 53320389 - TotalTime: 468510164 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1201162 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 471531 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1113881 - UnpinTime: 1526 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a4 (host=vd1138.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 195322561116 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 59929965 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 59861133 - ExecTreePrepareTime: 1259088 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 19273 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8016358 - CompileTime: 59806406 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 250769780 - PeakMemoryUsage: 768512 - PrepareTime: 53370700 - TotalTime: 366078672 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1258298 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 424602 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1160526 - UnpinTime: 1780 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000f7 (host=vc1517.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 183629006985 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 59348704 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 59273317 - ExecTreePrepareTime: 1827428 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 25803 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7248961 - CompileTime: 115008410 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 257528251 - PeakMemoryUsage: 768512 - PrepareTime: 52486826 - TotalTime: 426628099 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1826442 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 968016 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1756464 - UnpinTime: 1591 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000c3 (host=vd1115.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 195363109410 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 59174574 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 59104591 - ExecTreePrepareTime: 1076812 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26902 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10619242 - CompileTime: 61380906 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 268064028 - PeakMemoryUsage: 768512 - PrepareTime: 53195824 - TotalTime: 384450270 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1076070 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 324998 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1015620 - UnpinTime: 1618 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d4 (host=vc1508.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190920775555 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 59054955 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 58995521 - ExecTreePrepareTime: 1150669 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30310 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11646491 - CompileTime: 160255919 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 291819845 - PeakMemoryUsage: 768512 - PrepareTime: 52184852 - TotalTime: 506183843 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1150025 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 417262 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1061069 - UnpinTime: 1554 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e7 (host=ve1131.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194306006320 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 57736855 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 57672768 - ExecTreePrepareTime: 1100583 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 29938 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8298479 - CompileTime: 68653570 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 238077944 - PeakMemoryUsage: 768512 - PrepareTime: 52585638 - TotalTime: 360121620 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1099765 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 427608 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1002465 - UnpinTime: 1624 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000c2 (host=vd1331.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12613252 - PerHostPeakMemUsage: 191178740717 - RowsProduced: 0 - TotalNetworkReceiveTime: 457130163975 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 57644232 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 57585351 - ExecTreePrepareTime: 1641592 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14236008448 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30820 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9572248 - CompileTime: 49120582 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 230430845 - PeakMemoryUsage: 768512 - PrepareTime: 51013504 - TotalTime: 332136615 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1640596 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 4299920 - GetNewBlockTime: 564602 - GetResultsTime: 0 - HTResizeTime: 1238039 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12571726 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1540914 - UnpinTime: 1568 EXCHANGE_NODE (id=3) - BytesReceived: 48085 - ConvertRowBatchTime: 81074 - DeserializeRowBatchTimer: 1019120 - FirstBatchArrivalWaitTime: 451412293147 - InactiveTotalTime: 457130127400 - PeakMemoryUsage: 0 - RowsReturned: 1965 - RowsReturnedRate: 4 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451791783867 Instance c74ce10ea42773c1:8f12f6e900000091 (host=vd1135.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194485990205 - RowsProduced: 0 - TotalNetworkReceiveTime: 451447309377 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 57508336 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 57439469 - ExecTreePrepareTime: 1140866 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 63656 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9763540 - CompileTime: 73736597 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 262242624 - PeakMemoryUsage: 768512 - PrepareTime: 50701382 - TotalTime: 387957226 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1140009 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 361930 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1079134 - UnpinTime: 1445 EXCHANGE_NODE (id=3) - BytesReceived: 16311 - ConvertRowBatchTime: 31934 - DeserializeRowBatchTimer: 357284 - FirstBatchArrivalWaitTime: 451447302301 - InactiveTotalTime: 451447303341 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451447315046 Instance c74ce10ea42773c1:8f12f6e9000000e5 (host=vd1341.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194812335107 - RowsProduced: 0 - TotalNetworkReceiveTime: 451281985443 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 57288258 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 57235510 - ExecTreePrepareTime: 995734 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 43276 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11069958 - CompileTime: 72831106 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 262457567 - PeakMemoryUsage: 768512 - PrepareTime: 50849078 - TotalTime: 387797001 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 995096 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 419305 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 916990 - UnpinTime: 1247 EXCHANGE_NODE (id=3) - BytesReceived: 16325 - ConvertRowBatchTime: 39848 - DeserializeRowBatchTimer: 341087 - FirstBatchArrivalWaitTime: 451281974346 - InactiveTotalTime: 451281975189 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451281986717 Instance c74ce10ea42773c1:8f12f6e9000000da (host=vc1533.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190202420641 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 56878500 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 56821227 - ExecTreePrepareTime: 1285473 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 23408 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8233219 - CompileTime: 122919991 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 257091177 - PeakMemoryUsage: 768512 - PrepareTime: 51253531 - TotalTime: 432791040 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1284538 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 592570 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1214707 - UnpinTime: 1493 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000084 (host=vc1537.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189312639484 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 56639892 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 56584638 - ExecTreePrepareTime: 1074371 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30991 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10998451 - CompileTime: 111159236 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 251685223 - PeakMemoryUsage: 768512 - PrepareTime: 50521527 - TotalTime: 415079421 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1073578 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 361811 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1008298 - UnpinTime: 1872 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000d3 (host=vc1531.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187089559307 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 56240324 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 56173580 - ExecTreePrepareTime: 910610 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26592 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9852496 - CompileTime: 136850710 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 259207052 - PeakMemoryUsage: 768512 - PrepareTime: 48801263 - TotalTime: 447284487 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 909487 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 386164 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 824414 - UnpinTime: 1494 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000008b (host=vd1112.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194693105822 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 56170707 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 56101681 - ExecTreePrepareTime: 1124746 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 28461 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 11671659 - CompileTime: 56160520 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 246393541 - PeakMemoryUsage: 768512 - PrepareTime: 47298086 - TotalTime: 351782111 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1124134 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 577358 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1030409 - UnpinTime: 588 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000e0 (host=va1036.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 198060212582 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 56077293 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 56026683 - ExecTreePrepareTime: 1089729 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26935 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9474816 - CompileTime: 94661149 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 295477681 - PeakMemoryUsage: 768512 - PrepareTime: 49105782 - TotalTime: 441238166 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1088924 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 368070 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1012910 - UnpinTime: 1508 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000c4 (host=vd1131.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 196822711794 - RowsProduced: 0 - TotalNetworkReceiveTime: 451503320029 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 55583742 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 55532263 - ExecTreePrepareTime: 992212 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 25869 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10465422 - CompileTime: 68565771 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 252806367 - PeakMemoryUsage: 768512 - PrepareTime: 47241778 - TotalTime: 370895012 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 991443 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 213159 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 915030 - UnpinTime: 14658 EXCHANGE_NODE (id=3) - BytesReceived: 16244 - ConvertRowBatchTime: 25269 - DeserializeRowBatchTimer: 308675 - FirstBatchArrivalWaitTime: 451503313260 - InactiveTotalTime: 451503314541 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451503327427 Instance c74ce10ea42773c1:8f12f6e9000000f5 (host=vc1509.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 188580160913 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 55137716 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 55069454 - ExecTreePrepareTime: 1122001 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 28199 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6631460 - CompileTime: 90766105 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 227691661 - PeakMemoryUsage: 768512 - PrepareTime: 49037471 - TotalTime: 368842004 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1121096 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 300587 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1043512 - UnpinTime: 1631 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000bb (host=va1043.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 193110466441 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 55079531 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 55008183 - ExecTreePrepareTime: 1635999 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 46524 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6585467 - CompileTime: 65885407 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 199496992 - PeakMemoryUsage: 768512 - PrepareTime: 49584918 - TotalTime: 316060826 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1635103 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 611444 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1522080 - UnpinTime: 1507 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000b1 (host=va1046.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189247833770 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 53926500 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 53829747 - ExecTreePrepareTime: 1130368 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 32791 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5962672 - CompileTime: 80562721 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 253727705 - PeakMemoryUsage: 768512 - PrepareTime: 48676445 - TotalTime: 384410023 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1129416 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 379636 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1051991 - UnpinTime: 1471 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000c8 (host=vc1541.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189271126697 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 53388079 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 53298900 - ExecTreePrepareTime: 937857 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26698 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7385024 - CompileTime: 84774854 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 208683590 - PeakMemoryUsage: 768512 - PrepareTime: 48373068 - TotalTime: 342712653 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 937038 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 288694 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 850538 - UnpinTime: 1574 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000b6 (host=ve1135.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12673548 - PerHostPeakMemUsage: 196952307507 - RowsProduced: 0 - TotalNetworkReceiveTime: 451572816813 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 53279840 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 53218442 - ExecTreePrepareTime: 1076117 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504443904 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 28245 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7666958 - CompileTime: 63562047 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 255100091 - PeakMemoryUsage: 768512 - PrepareTime: 46799189 - TotalTime: 367369521 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1075168 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3770322 - GetNewBlockTime: 382749 - GetResultsTime: 0 - HTResizeTime: 1108135 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12442727 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 997328 - UnpinTime: 1473 EXCHANGE_NODE (id=3) - BytesReceived: 32325 - ConvertRowBatchTime: 49735 - DeserializeRowBatchTimer: 652979 - FirstBatchArrivalWaitTime: 451144701273 - InactiveTotalTime: 451572803740 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451572866090 Instance c74ce10ea42773c1:8f12f6e9000000e6 (host=va1033.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187867742832 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 53061894 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 52978308 - ExecTreePrepareTime: 1224540 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 36237 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7974374 - CompileTime: 114567482 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 251762995 - PeakMemoryUsage: 768512 - PrepareTime: 49191610 - TotalTime: 416433460 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1223755 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 382821 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1148701 - UnpinTime: 1538 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000094 (host=va1034.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 182010956344 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 53004199 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 52935785 - ExecTreePrepareTime: 1594674 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 705 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 13967294464 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 29578 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6586166 - CompileTime: 77164540 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 221491766 - PeakMemoryUsage: 768512 - PrepareTime: 46793873 - TotalTime: 347185447 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1593982 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 741771 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1459815 - UnpinTime: 1608 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ec (host=vd1326.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 188846228854 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 52161813 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 52096650 - ExecTreePrepareTime: 1754857 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 27794 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5659744 - CompileTime: 52697090 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 212410854 - PeakMemoryUsage: 768512 - PrepareTime: 46304488 - TotalTime: 313017641 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1754132 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 850926 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1670286 - UnpinTime: 1634 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000b9 (host=vd1342.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12608012 - PerHostPeakMemUsage: 189436036628 - RowsProduced: 0 - TotalNetworkReceiveTime: 456595599023 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 52140875 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 52081429 - ExecTreePrepareTime: 927090 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14236008448 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30029 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6661865 - CompileTime: 67625568 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 262618892 - PeakMemoryUsage: 768512 - PrepareTime: 46239168 - TotalTime: 378167554 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 926158 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3089921 - GetNewBlockTime: 376002 - GetResultsTime: 0 - HTResizeTime: 940384 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12377191 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 847747 - UnpinTime: 1547 EXCHANGE_NODE (id=3) - BytesReceived: 32123 - ConvertRowBatchTime: 44731 - DeserializeRowBatchTimer: 648221 - FirstBatchArrivalWaitTime: 451236647217 - InactiveTotalTime: 456595579256 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 456595646507 Instance c74ce10ea42773c1:8f12f6e9000000b7 (host=va1032.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 188285924629 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 50676716 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 50612451 - ExecTreePrepareTime: 1682216 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 29982 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5346547 - CompileTime: 59639649 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 214508009 - PeakMemoryUsage: 768512 - PrepareTime: 45162617 - TotalTime: 320207793 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1681300 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 854370 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1593014 - UnpinTime: 1534 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000009c (host=vd1336.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192087105467 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 50452562 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 50382969 - ExecTreePrepareTime: 1734782 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31585 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5290661 - CompileTime: 49477381 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 203924582 - PeakMemoryUsage: 768512 - PrepareTime: 44831956 - TotalTime: 298900773 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1733994 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 1052414 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1645701 - UnpinTime: 1558 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000be (host=vd1110.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189760621949 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 50256098 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 50182221 - ExecTreePrepareTime: 1283802 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 147953 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8591147 - CompileTime: 47486205 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 251125108 - PeakMemoryUsage: 768512 - PrepareTime: 44487930 - TotalTime: 344105409 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1282909 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 451417 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1214028 - UnpinTime: 1541 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000df (host=va1029.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194913117370 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 50223692 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 50157424 - ExecTreePrepareTime: 1278095 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 55494 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6351976 - CompileTime: 96655268 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 271619922 - PeakMemoryUsage: 768512 - PrepareTime: 45761135 - TotalTime: 415459902 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1277317 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 420848 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1203391 - UnpinTime: 1621 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000f4 (host=va1044.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 197849392147 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 49974210 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 49894880 - ExecTreePrepareTime: 1236744 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 28439 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6039658 - CompileTime: 86225851 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 222159645 - PeakMemoryUsage: 768512 - PrepareTime: 45319111 - TotalTime: 354724903 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1235746 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 456171 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1140052 - UnpinTime: 1640 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000083 (host=vd1122.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192514786873 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 49418916 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 49363456 - ExecTreePrepareTime: 1069283 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 174420 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7205018 - CompileTime: 58244750 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 254626586 - PeakMemoryUsage: 768512 - PrepareTime: 43482896 - TotalTime: 357559911 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1068499 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 394535 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1002133 - UnpinTime: 1640 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000fa (host=vd1134.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12542476 - PerHostPeakMemUsage: 194518301242 - RowsProduced: 0 - TotalNetworkReceiveTime: 451882801603 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 49117547 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 49012740 - ExecTreePrepareTime: 1083068 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 16680 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9770362 - CompileTime: 57265398 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 219241403 - PeakMemoryUsage: 768512 - PrepareTime: 42350747 - TotalTime: 320717681 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1082229 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 2997729 - GetNewBlockTime: 412705 - GetResultsTime: 0 - HTResizeTime: 333076 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12311655 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1006388 - UnpinTime: 1486 EXCHANGE_NODE (id=3) - BytesReceived: 32198 - ConvertRowBatchTime: 45986 - DeserializeRowBatchTimer: 724274 - FirstBatchArrivalWaitTime: 451481741630 - InactiveTotalTime: 451882774997 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451882850949 Instance c74ce10ea42773c1:8f12f6e900000082 (host=ve1126.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12514948 - PerHostPeakMemUsage: 190841065890 - RowsProduced: 0 - TotalNetworkReceiveTime: 457023487237 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 49044942 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 48994626 - ExecTreePrepareTime: 1280122 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14236008448 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 38766 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6441345 - CompileTime: 58541255 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 263774664 - PeakMemoryUsage: 768512 - PrepareTime: 43858245 - TotalTime: 367021090 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1279163 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3030515 - GetNewBlockTime: 538196 - GetResultsTime: 0 - HTResizeTime: 783179 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12473422 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1167302 - UnpinTime: 1455 EXCHANGE_NODE (id=3) - BytesReceived: 48288 - ConvertRowBatchTime: 70814 - DeserializeRowBatchTimer: 993551 - FirstBatchArrivalWaitTime: 451246616994 - InactiveTotalTime: 457023452310 - PeakMemoryUsage: 0 - RowsReturned: 1965 - RowsReturnedRate: 4 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451663953582 Instance c74ce10ea42773c1:8f12f6e9000000ff (host=vd1109.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 189355617513 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 48786388 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 48707223 - ExecTreePrepareTime: 1036805 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 25856 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4911743 - CompileTime: 49147832 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 234587366 - PeakMemoryUsage: 768512 - PrepareTime: 43484876 - TotalTime: 328250223 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1035980 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 258167 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 961273 - UnpinTime: 1466 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000db (host=vd1335.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12575244 - PerHostPeakMemUsage: 192096020934 - RowsProduced: 0 - TotalNetworkReceiveTime: 456717448684 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 48654448 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 48593094 - ExecTreePrepareTime: 1147485 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14370226176 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26689 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5287712 - CompileTime: 53611119 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 252494218 - PeakMemoryUsage: 768512 - PrepareTime: 44404269 - TotalTime: 351216121 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1146618 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3600695 - GetNewBlockTime: 423121 - GetResultsTime: 0 - HTResizeTime: 1436375 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12344423 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1074812 - UnpinTime: 1521 EXCHANGE_NODE (id=3) - BytesReceived: 32271 - ConvertRowBatchTime: 48635 - DeserializeRowBatchTimer: 760045 - FirstBatchArrivalWaitTime: 451389381941 - InactiveTotalTime: 456717433070 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 456717500170 Instance c74ce10ea42773c1:8f12f6e9000000bd (host=vd1111.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 191133526549 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 48174422 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 48071792 - ExecTreePrepareTime: 1176110 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 25662 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5666162 - CompileTime: 52230218 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 215990469 - PeakMemoryUsage: 768512 - PrepareTime: 44133907 - TotalTime: 313028474 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1175430 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 640705 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1072549 - UnpinTime: 1599 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000ce (host=vd1334.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194444090067 - RowsProduced: 0 - TotalNetworkReceiveTime: 451321807634 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 47594926 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 47525982 - ExecTreePrepareTime: 1154714 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 26949 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4946600 - CompileTime: 52593533 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 250223481 - PeakMemoryUsage: 768512 - PrepareTime: 42578319 - TotalTime: 346321069 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1153615 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 391749 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1083618 - UnpinTime: 1678 EXCHANGE_NODE (id=3) - BytesReceived: 16326 - ConvertRowBatchTime: 43573 - DeserializeRowBatchTimer: 363346 - FirstBatchArrivalWaitTime: 451321793350 - InactiveTotalTime: 451321801311 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451321815632 Instance c74ce10ea42773c1:8f12f6e9000000f1 (host=vd1120.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 195836310026 - RowsProduced: 0 - TotalNetworkReceiveTime: 451540669155 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 47477640 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 47423504 - ExecTreePrepareTime: 1642292 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 27670 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5035438 - CompileTime: 60812757 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 255778642 - PeakMemoryUsage: 768512 - PrepareTime: 42437939 - TotalTime: 359959897 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1641329 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 1032518 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1558963 - UnpinTime: 1527 EXCHANGE_NODE (id=3) - BytesReceived: 16265 - ConvertRowBatchTime: 33998 - DeserializeRowBatchTimer: 352274 - FirstBatchArrivalWaitTime: 451540633918 - InactiveTotalTime: 451540657515 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451540675933 Instance c74ce10ea42773c1:8f12f6e9000000f3 (host=vd1116.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 197597625190 - RowsProduced: 0 - TotalNetworkReceiveTime: 451564732097 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 46171558 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 46125077 - ExecTreePrepareTime: 787859 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 23337 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5242976 - CompileTime: 59759508 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 254388477 - PeakMemoryUsage: 768512 - PrepareTime: 41637405 - TotalTime: 357112463 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 786857 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 290223 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 722499 - UnpinTime: 1586 EXCHANGE_NODE (id=3) - BytesReceived: 16434 - ConvertRowBatchTime: 29231 - DeserializeRowBatchTimer: 272899 - FirstBatchArrivalWaitTime: 451564726047 - InactiveTotalTime: 451564727294 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451564733282 Instance c74ce10ea42773c1:8f12f6e900000087 (host=vc1520.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 184847509744 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 44270061 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 44202980 - ExecTreePrepareTime: 850398 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 24563 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4155883 - CompileTime: 59279112 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 223447767 - PeakMemoryUsage: 768512 - PrepareTime: 40045069 - TotalTime: 323371235 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 849518 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 218096 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 770039 - UnpinTime: 1649 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000bf (host=vc1524.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190312447565 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 43789054 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 43710672 - ExecTreePrepareTime: 895035 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 42008 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7883806 - CompileTime: 76490984 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 254710886 - PeakMemoryUsage: 768512 - PrepareTime: 37411240 - TotalTime: 369915415 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 894653 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 332156 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 818740 - UnpinTime: 654 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000eb (host=va1030.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 187125141529 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 43544469 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 43479024 - ExecTreePrepareTime: 1271912 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 35211 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5527483 - CompileTime: 122112330 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 261600515 - PeakMemoryUsage: 768512 - PrepareTime: 39350870 - TotalTime: 424317830 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1271146 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 426279 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1198021 - UnpinTime: 1574 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000090 (host=va1041.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 186912122816 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 43042284 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 42984347 - ExecTreePrepareTime: 1288138 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 721 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14101512192 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 29248 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9737072 - CompileTime: 96545411 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 251166365 - PeakMemoryUsage: 768512 - PrepareTime: 37142485 - TotalTime: 386439879 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1287353 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 499261 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1202959 - UnpinTime: 1513 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000bc (host=va1039.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 198314777025 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 42716015 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 42657787 - ExecTreePrepareTime: 1113002 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 27551 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5614916 - CompileTime: 96673621 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 253481400 - PeakMemoryUsage: 768512 - PrepareTime: 38383338 - TotalTime: 389514891 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1112327 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 448430 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1047762 - UnpinTime: 1674 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000008e (host=ve1130.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 199615922375 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 42157328 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 42094106 - ExecTreePrepareTime: 1126500 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30393 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6174326 - CompileTime: 58531975 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 245387394 - PeakMemoryUsage: 768512 - PrepareTime: 37873225 - TotalTime: 342484113 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1125634 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 394143 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1055021 - UnpinTime: 1549 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000008f (host=vd1123.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190697534836 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 41166040 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 41114165 - ExecTreePrepareTime: 965168 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 23823 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8763793 - CompileTime: 57258004 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 235668657 - PeakMemoryUsage: 768512 - PrepareTime: 35236259 - TotalTime: 329997554 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 964358 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 278372 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 884638 - UnpinTime: 891 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e900000095 (host=vd1142.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 191414749548 - RowsProduced: 0 - TotalNetworkReceiveTime: 451426540516 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 37525975 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 37467290 - ExecTreePrepareTime: 859651 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 52528 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5620116 - CompileTime: 48782744 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 229469034 - PeakMemoryUsage: 768512 - PrepareTime: 32385747 - TotalTime: 311800732 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 858984 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 213630 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 776219 - UnpinTime: 921 EXCHANGE_NODE (id=3) - BytesReceived: 16406 - ConvertRowBatchTime: 42297 - DeserializeRowBatchTimer: 429620 - FirstBatchArrivalWaitTime: 451426519572 - InactiveTotalTime: 451426526662 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451426548895 Instance c74ce10ea42773c1:8f12f6e9000000dc (host=vd1339.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 190848915222 - RowsProduced: 0 - TotalNetworkReceiveTime: 451352377034 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 36625001 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 36566119 - ExecTreePrepareTime: 1412875 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 737 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14235729920 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 31941 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5025524 - CompileTime: 49967570 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 209132926 - PeakMemoryUsage: 768512 - PrepareTime: 30864871 - TotalTime: 291264027 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1412176 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 655732 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10968167 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1335867 - UnpinTime: 1713 EXCHANGE_NODE (id=3) - BytesReceived: 16202 - ConvertRowBatchTime: 32669 - DeserializeRowBatchTimer: 348041 - FirstBatchArrivalWaitTime: 451352370458 - InactiveTotalTime: 451352371475 - PeakMemoryUsage: 0 - RowsReturned: 655 - RowsReturnedRate: 1 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451352378091 Instance c74ce10ea42773c1:8f12f6e9000000d2 (host=vd1117.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 198606940144 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 34899593 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 34830489 - ExecTreePrepareTime: 1407596 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504165376 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 28445 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4968565 - CompileTime: 48290387 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 234102275 - PeakMemoryUsage: 768512 - PrepareTime: 29570072 - TotalTime: 312980002 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1406734 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 775777 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1332753 - UnpinTime: 1606 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000fc (host=vc1529.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 192958643754 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 34771454 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 34681122 - ExecTreePrepareTime: 1039891 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 24241 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5735271 - CompileTime: 84806846 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 249209564 - PeakMemoryUsage: 768512 - PrepareTime: 29645931 - TotalTime: 365153047 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1039023 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 393754 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 952056 - UnpinTime: 1509 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e90000009e (host=vc1510.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 194572507348 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 34222976 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 34168491 - ExecTreePrepareTime: 1011299 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 15842 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6328850 - CompileTime: 94675452 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 233526073 - PeakMemoryUsage: 768512 - PrepareTime: 29406949 - TotalTime: 358527777 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 1010669 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 307259 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 965202 - UnpinTime: 1492 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000a1 (host=vc1526.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 11553944 - PerHostPeakMemUsage: 195436229972 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 33026581 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 32980937 - ExecTreePrepareTime: 996828 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14369947648 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 116000 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5005326 - CompileTime: 59027710 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 251272775 - PeakMemoryUsage: 768512 - PrepareTime: 27725771 - TotalTime: 339074522 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 996020 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 0 - GetNewBlockTime: 386914 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 10765440 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 923466 - UnpinTime: 1574 EXCHANGE_NODE (id=3) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 0 Instance c74ce10ea42773c1:8f12f6e9000000cf (host=vd1129.halxg.cloudera.com:22000) - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12640780 - PerHostPeakMemUsage: 198568744953 - RowsProduced: 0 - TotalNetworkReceiveTime: 451841575805 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalThreadsInvoluntaryContextSwitches: 0 - TotalThreadsTotalWallClockTime: 0 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 0 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 32229171 Fragment Instance Lifecycle Timings - InactiveTotalTime: 0 - OpenTime: 0 - ExecTreeOpenTime: 0 - PrepareTime: 32171904 - ExecTreePrepareTime: 979339 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 769 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14504443904 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=5) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 7704 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 20235 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4830135 - CompileTime: 83546899 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 72 - NumInstructions: 1501 - OptimizationTime: 283998080 - PeakMemoryUsage: 768512 - PrepareTime: 28007001 - TotalTime: 396879122 AGGREGATION_NODE (id=2) ExecOption: Codegen Enabled - BuildTime: 0 - GetResultsTime: 0 - HTResizeTime: 0 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 0 - PeakMemoryUsage: 8192 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 978679 AGGREGATION_NODE (id=4) ExecOption: Codegen Enabled - BuildTime: 3456535 - GetNewBlockTime: 450458 - GetResultsTime: 0 - HTResizeTime: 813815 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - MaxPartitionLevel: 0 - NumRepartitions: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 12409959 - PinTime: 0 - RowsRepartitioned: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SpilledPartitions: 0 - TotalTime: 923063 - UnpinTime: 1495 EXCHANGE_NODE (id=3) - BytesReceived: 32250 - ConvertRowBatchTime: 69643 - DeserializeRowBatchTimer: 648523 - FirstBatchArrivalWaitTime: 451446243571 - InactiveTotalTime: 451841558437 - PeakMemoryUsage: 0 - RowsReturned: 1310 - RowsReturnedRate: 2 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 451841651711 Averaged Fragment F00 split sizes: min: 54.28 GB, max: 55.05 GB, avg: 54.69 GB, stddev: 176.10 MB completion times: min:7m38s max:7m39s mean: 7m39s stddev:277.351ms execution rates: min:121.07 MB/sec max:122.85 MB/sec mean:121.98 MB/sec stddev:387.16 KB/sec num instances: 129 - AverageThreadTokens: 15.455581808069219 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192415201449 - PerHostPeakMemUsage: 192426225208 - RowsProduced: 1289 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 374 - TotalStorageWaitTime: 21763740555 - TotalThreadsInvoluntaryContextSwitches: 111 - TotalThreadsTotalWallClockTime: 30535606571 - TotalThreadsSysTime: 19012604 - TotalThreadsUserTime: 329918821 - TotalThreadsVoluntaryContextSwitches: 2162 - TotalTime: 268814653 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 3500183973 - InactiveTotalTime: 0 - OpenTime: 135020002 - ExecTreeOpenTime: 313717 - PrepareTime: 133707429 - ExecTreePrepareTime: 3939543 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 20192 - InactiveTotalTime: 0 - NetworkThroughput(*): 989245 - OverallThroughput: 281081 - PeakMemoryUsage: 934008 - RowsReturned: 1288 - SerializeBatchTime: 395874 - TotalTime: 868997 - TransmitDataRPCTime: 158233 - UncompressedRowBatchSize: 244538 CodeGen - CodegenTime: 4572232 - CompileTime: 35482663 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 98025359 - PeakMemoryUsage: 624640 - PrepareTime: 30561228 - TotalTime: 164668376 AGGREGATION_NODE (id=1) - GetNewBlockTime: 97402503 - GetResultsTime: 0 - HTResizeTime: 15097818403 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192062687169 - PinTime: 0 - ReductionFactorEstimate: 355.82973078941046 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 1289 - RowsReturned: 1289 - RowsReturnedRate: 2 - StreamingTime: 441688019898 - TotalTime: 3504429728 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.07390555063449167 - AverageScannerThreadConcurrency: 14.46411387038294 - BytesRead: 2808790309 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10473838343 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 74 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 602410096 - PerReadThreadRawHdfsThroughput: 94692480 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 424317367 - RowsReturned: 424190139 - RowsReturnedRate: 146857697 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 96 - ScannerThreadsTotalWallClockTime: 30400588899 - MaterializeTupleTime(*): 12675719153 - ScannerThreadsSysTime: 15858023 - ScannerThreadsUserTime: 198721697 - ScannerThreadsVoluntaryContextSwitches: 2155 - TotalRawHdfsReadTime(*): 32913925004 - TotalReadThroughput: 6335528 - TotalTime: 3274109416 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14370226176 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 Fragment F00 Instance c74ce10ea42773c1:8f12f6e90000000c (host=vd1141.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:23/5.69 GB 0:28/6.86 GB 1:22/5.33 GB 7:34/8.35 GB 3:35/8.27 GB 5:24/5.91 GB 2:29/7.14 GB 4:30/7.25 GB - AverageThreadTokens: 12.140486725663717 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187991228696 - PerHostPeakMemUsage: 188002233149 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 11442634872 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 135880472 - TotalThreadsSysTime: 10998000 - TotalThreadsUserTime: 123981000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 524547369 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 135882511 - ExecTreeOpenTime: 361813 - PrepareTime: 388583328 - ExecTreePrepareTime: 3896895 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 287064 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3724300 - CompileTime: 37271824 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 97364680 - PeakMemoryUsage: 624640 - PrepareTime: 25764829 - TotalTime: 160858139 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 271759706 - GetResultsTime: 0 - HTResizeTime: 14884773199 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 187784218752 - PinTime: 0 - ReductionFactorEstimate: 355.68050834318956 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 453061490813 - TotalTime: 4255568 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:23/5.69 GB 0:28/6.86 GB 1:22/5.33 GB 7:34/8.35 GB 3:35/8.27 GB 5:24/5.91 GB 2:29/7.14 GB 4:30/7.25 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.044296788482835 - AverageScannerThreadConcurrency: 11.152823920265782 - BytesRead: 2556942607 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9395495704 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 68 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 462518051 - PerReadThreadRawHdfsThroughput: 118025151 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 402086651 - RowsReturned: 401961723 - RowsReturnedRate: 149731331 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11396820242 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 21664387496 - TotalReadThroughput: 5656952 - TotalTime: 2684553177 Instance c74ce10ea42773c1:8f12f6e90000001a (host=vd1136.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:22/5.41 GB 1:34/8.19 GB 2:34/8.15 GB 4:26/6.20 GB 5:22/5.33 GB 0:31/7.51 GB 3:27/6.68 GB 6:31/7.36 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197122598001 - PerHostPeakMemUsage: 197135077014 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17854731050 - TotalThreadsInvoluntaryContextSwitches: 19 - TotalThreadsTotalWallClockTime: 167706788 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 163975000 - TotalThreadsVoluntaryContextSwitches: 18 - TotalTime: 377840004 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 167708952 - ExecTreeOpenTime: 320903 - PrepareTime: 210064367 - ExecTreePrepareTime: 5066095 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 311330 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5077312 - CompileTime: 46076371 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 119479971 - PeakMemoryUsage: 624640 - PrepareTime: 33066192 - TotalTime: 199258501 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 87683896 - GetResultsTime: 0 - HTResizeTime: 13892860257 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 196848109696 - PinTime: 0 - ReductionFactorEstimate: 355.8293839056027 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 454220041932 - TotalTime: 5383499 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:22/5.41 GB 1:34/8.19 GB 2:34/8.15 GB 4:26/6.20 GB 5:22/5.33 GB 0:31/7.51 GB 3:27/6.68 GB 6:31/7.36 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07582417582417582 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2892807629 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11033157255 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 458385992 - PerReadThreadRawHdfsThroughput: 84051178 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 448350028 - RowsReturned: 448226124 - RowsReturnedRate: 147382879 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13705818920 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34417216914 - TotalReadThroughput: 6357804 - TotalTime: 3041236032 Instance c74ce10ea42773c1:8f12f6e900000057 (host=vc1502.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:25/6.15 GB 2:25/6.14 GB 4:28/6.85 GB 6:27/6.68 GB 5:36/8.91 GB 3:23/5.62 GB 1:25/6.19 GB 0:33/8.11 GB - AverageThreadTokens: 13.628668171557562 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199766692929 - PerHostPeakMemUsage: 199777489415 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18019753774 - TotalThreadsInvoluntaryContextSwitches: 24 - TotalThreadsTotalWallClockTime: 167033523 - TotalThreadsSysTime: 13998000 - TotalThreadsUserTime: 151977000 - TotalThreadsVoluntaryContextSwitches: 13 - TotalTime: 333525242 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 167036737 - ExecTreeOpenTime: 504059 - PrepareTime: 166386783 - ExecTreePrepareTime: 5472920 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 293942 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3743380 - CompileTime: 59523049 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 106050955 - PeakMemoryUsage: 624640 - PrepareTime: 31469878 - TotalTime: 197625025 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55577935 - GetResultsTime: 0 - HTResizeTime: 15243588838 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 199563921536 - PinTime: 0 - ReductionFactorEstimate: 355.820683159064 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439433832319 - TotalTime: 5972630 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:25/6.15 GB 2:25/6.14 GB 4:28/6.85 GB 6:27/6.68 GB 5:36/8.91 GB 3:23/5.62 GB 1:25/6.19 GB 0:33/8.11 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08700564971751412 - AverageScannerThreadConcurrency: 12.642937853107345 - BytesRead: 2892267432 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10436423639 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 551438775 - PerReadThreadRawHdfsThroughput: 76087188 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 464242463 - RowsReturned: 464116511 - RowsReturnedRate: 166293596 - ScanRangesComplete: 63 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12613720671 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38012541606 - TotalReadThroughput: 6528790 - TotalTime: 2790946384 Instance c74ce10ea42773c1:8f12f6e900000015 (host=ve1134.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:26/6.36 GB 1:25/6.11 GB 5:29/7.14 GB 3:28/6.89 GB 6:27/6.64 GB 0:31/7.63 GB 7:33/8.09 GB 2:24/5.80 GB - AverageThreadTokens: 14.984392419175029 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192868049950 - PerHostPeakMemUsage: 192879054403 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18740253760 - TotalThreadsInvoluntaryContextSwitches: 18 - TotalThreadsTotalWallClockTime: 156639696 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 152977000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 327384007 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 156642078 - ExecTreeOpenTime: 390378 - PrepareTime: 170680461 - ExecTreePrepareTime: 4279391 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 263841 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4598366 - CompileTime: 43370367 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 111529443 - PeakMemoryUsage: 624640 - PrepareTime: 31700064 - TotalTime: 187214579 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 37272607 - GetResultsTime: 0 - HTResizeTime: 16522688690 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192604522624 - PinTime: 0 - ReductionFactorEstimate: 355.94472618577623 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 449480948729 - TotalTime: 4666608 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:26/6.36 GB 1:25/6.11 GB 5:29/7.14 GB 3:28/6.89 GB 6:27/6.64 GB 0:31/7.63 GB 7:33/8.09 GB 2:24/5.80 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08035714285714286 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2722344551 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10769504465 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 586311269 - PerReadThreadRawHdfsThroughput: 78271568 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 425878296 - RowsReturned: 425751320 - RowsReturnedRate: 152942171 - ScanRangesComplete: 58 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11906662766 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34780759087 - TotalReadThroughput: 6067709 - TotalTime: 2783740515 Instance c74ce10ea42773c1:8f12f6e900000026 (host=vc1523.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:28/6.90 GB 5:38/9.28 GB 3:38/9.33 GB 2:25/6.16 GB 0:22/5.27 GB 6:20/4.91 GB 4:24/5.81 GB 1:29/7.04 GB - AverageThreadTokens: 12.986285714285714 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189264089610 - PerHostPeakMemUsage: 189274886096 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18703241550 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 142503726 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 134980000 - TotalThreadsVoluntaryContextSwitches: 26 - TotalTime: 324426460 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 142505754 - ExecTreeOpenTime: 357314 - PrepareTime: 181865818 - ExecTreePrepareTime: 3967006 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 351653 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8196384 - CompileTime: 36023628 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 103122016 - PeakMemoryUsage: 624640 - PrepareTime: 37246867 - TotalTime: 177275200 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 74636522 - GetResultsTime: 0 - HTResizeTime: 14941159189 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188881029248 - PinTime: 0 - ReductionFactorEstimate: 355.8305578756213 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 438622461238 - TotalTime: 4321023 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:28/6.90 GB 5:38/9.28 GB 3:38/9.33 GB 2:25/6.16 GB 0:22/5.27 GB 6:20/4.91 GB 4:24/5.81 GB 1:29/7.04 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08924485125858124 - AverageScannerThreadConcurrency: 12.0 - BytesRead: 2733636535 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9627051688 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 507566882 - PerReadThreadRawHdfsThroughput: 70560381 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 407513919 - RowsReturned: 407388991 - RowsReturnedRate: 159594319 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12715684160 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38741804877 - TotalReadThroughput: 6248312 - TotalTime: 2552653462 Instance c74ce10ea42773c1:8f12f6e90000006c (host=vc1514.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:33/8.06 GB 6:26/6.15 GB 4:29/7.18 GB 3:24/5.94 GB 5:29/6.81 GB 1:29/7.18 GB 0:32/7.80 GB 7:23/5.69 GB - AverageThreadTokens: 14.671607753705816 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 185411256348 - PerHostPeakMemUsage: 185422052834 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12308065029 - TotalThreadsInvoluntaryContextSwitches: 34 - TotalThreadsTotalWallClockTime: 170379094 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 165975000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 318798601 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 170384489 - ExecTreeOpenTime: 339176 - PrepareTime: 148335535 - ExecTreePrepareTime: 3476978 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 329308 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4799528 - CompileTime: 36915938 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 131879511 - PeakMemoryUsage: 624640 - PrepareTime: 35078739 - TotalTime: 204507876 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 100595562 - GetResultsTime: 0 - HTResizeTime: 16156957226 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185070504064 - PinTime: 0 - ReductionFactorEstimate: 355.8043426150728 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 438936965027 - TotalTime: 3812929 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:33/8.06 GB 6:26/6.15 GB 4:29/7.18 GB 3:24/5.94 GB 5:29/6.81 GB 1:29/7.18 GB 0:32/7.80 GB 7:23/5.69 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05593607305936073 - AverageScannerThreadConcurrency: 13.687214611872147 - BytesRead: 2598977853 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9430598810 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 69 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 557194961 - PerReadThreadRawHdfsThroughput: 105464578 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 389790858 - RowsReturned: 389663882 - RowsReturnedRate: 154296044 - ScanRangesComplete: 55 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11550864974 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 24643135091 - TotalReadThroughput: 5926973 - TotalTime: 2525430137 Instance c74ce10ea42773c1:8f12f6e900000048 (host=vc1519.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:23/5.61 GB 5:31/7.57 GB 0:32/7.84 GB 1:23/5.65 GB 3:30/7.35 GB 6:33/8.09 GB 2:33/8.09 GB 4:19/4.66 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197595505220 - PerHostPeakMemUsage: 197606301706 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14161451588 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 132872340 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 129981000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 314586444 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 132874332 - ExecTreeOpenTime: 379816 - PrepareTime: 181643920 - ExecTreePrepareTime: 4689416 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 354882 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 10539859 - CompileTime: 33782180 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 96501046 - PeakMemoryUsage: 624640 - PrepareTime: 50884656 - TotalTime: 182255952 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 47417281 - GetResultsTime: 0 - HTResizeTime: 14346862071 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197332551808 - PinTime: 0 - ReductionFactorEstimate: 355.7967155813571 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 441231615805 - TotalTime: 5066449 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:23/5.61 GB 5:31/7.57 GB 0:32/7.84 GB 1:23/5.65 GB 3:30/7.35 GB 6:33/8.09 GB 2:33/8.09 GB 4:19/4.66 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0853932584269663 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2910340093 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10357729383 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 459300023 - PerReadThreadRawHdfsThroughput: 78874752 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 451109476 - RowsReturned: 450985572 - RowsReturnedRate: 149241889 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13697723589 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 36898246777 - TotalReadThroughput: 6540090 - TotalTime: 3021843083 Instance c74ce10ea42773c1:8f12f6e900000033 (host=vc1534.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:27/6.38 GB 2:26/6.36 GB 6:29/6.91 GB 5:22/5.45 GB 1:31/7.64 GB 0:27/6.57 GB 4:36/8.87 GB 7:28/6.72 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188591947208 - PerHostPeakMemUsage: 188602743694 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 9361840007 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 121038471 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 116982000 - TotalThreadsVoluntaryContextSwitches: 9 - TotalTime: 304556203 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 121040700 - ExecTreeOpenTime: 394142 - PrepareTime: 183417100 - ExecTreePrepareTime: 5305624 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 281735 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3658288 - CompileTime: 39415349 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 80297303 - PeakMemoryUsage: 624640 - PrepareTime: 27926212 - TotalTime: 148173911 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56251047 - GetResultsTime: 0 - HTResizeTime: 14735635429 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188400781440 - PinTime: 0 - ReductionFactorEstimate: 355.87309860971544 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 437656569191 - TotalTime: 5696826 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:27/6.38 GB 2:26/6.36 GB 6:29/6.91 GB 5:22/5.45 GB 1:31/7.64 GB 0:27/6.57 GB 4:36/8.87 GB 7:28/6.72 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.03775743707093822 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2552580405 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9817789539 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 462229332 - PerReadThreadRawHdfsThroughput: 150140373 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 405116123 - RowsReturned: 404997979 - RowsReturnedRate: 154416006 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12578008096 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 17001292525 - TotalReadThroughput: 5752643 - TotalTime: 2622772010 Instance c74ce10ea42773c1:8f12f6e90000007a (host=vd1119.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:27/6.65 GB 7:24/5.87 GB 1:27/6.57 GB 6:39/9.49 GB 3:19/4.67 GB 5:27/6.41 GB 4:30/7.30 GB 2:32/7.83 GB - AverageThreadTokens: 13.98536036036036 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197913801580 - PerHostPeakMemUsage: 197924598066 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 29621270867 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 120720907 - TotalThreadsSysTime: 999000 - TotalThreadsUserTime: 118982000 - TotalThreadsVoluntaryContextSwitches: 20 - TotalTime: 299323570 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 120722101 - ExecTreeOpenTime: 307597 - PrepareTime: 178501479 - ExecTreePrepareTime: 4541243 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 536889 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 7148382 - CompileTime: 31529821 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 87420855 - PeakMemoryUsage: 624640 - PrepareTime: 47425871 - TotalTime: 167512619 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 44716495 - GetResultsTime: 0 - HTResizeTime: 15849262884 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197598890112 - PinTime: 0 - ReductionFactorEstimate: 355.7323675934769 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439849116595 - TotalTime: 4846416 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:27/6.65 GB 7:24/5.87 GB 1:27/6.57 GB 6:39/9.49 GB 3:19/4.67 GB 5:27/6.41 GB 4:30/7.30 GB 2:32/7.83 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.11499436302142052 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2970607587 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10595664190 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 79 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 544409253 - PerReadThreadRawHdfsThroughput: 57912990 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 452633374 - RowsReturned: 452507422 - RowsReturnedRate: 148530948 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14003318836 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 51294321828 - TotalReadThroughput: 6689518 - TotalTime: 3046553108 Instance c74ce10ea42773c1:8f12f6e900000058 (host=vd1108.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:26/6.40 GB 0:23/5.62 GB 4:28/6.89 GB 5:25/6.04 GB 3:33/8.11 GB 1:32/7.81 GB 2:31/7.59 GB 7:26/6.39 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189069147975 - PerHostPeakMemUsage: 189079944461 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21319693429 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 152138577 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 145977000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 299022852 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 152140476 - ExecTreeOpenTime: 278973 - PrepareTime: 146809999 - ExecTreePrepareTime: 3871153 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 287327 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5276546 - CompileTime: 31912884 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 118723969 - PeakMemoryUsage: 624640 - PrepareTime: 31319761 - TotalTime: 182727260 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55266229 - GetResultsTime: 0 - HTResizeTime: 15761486642 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188770928768 - PinTime: 0 - ReductionFactorEstimate: 355.8380207158238 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 441997599790 - TotalTime: 4146802 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:26/6.40 GB 0:23/5.62 GB 4:28/6.89 GB 5:25/6.04 GB 3:33/8.11 GB 1:32/7.81 GB 2:31/7.59 GB 7:26/6.39 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10067873303167421 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2666745478 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9680831609 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 540153299 - PerReadThreadRawHdfsThroughput: 57131055 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 406971442 - RowsReturned: 406845490 - RowsReturnedRate: 152007623 - ScanRangesComplete: 58 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12096075584 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 46677686297 - TotalReadThroughput: 6033360 - TotalTime: 2676480822 Instance c74ce10ea42773c1:8f12f6e900000063 (host=ve1139.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:22/5.33 GB 6:28/6.93 GB 7:28/6.75 GB 1:33/8.05 GB 4:31/7.48 GB 0:33/7.86 GB 2:27/6.60 GB 3:24/5.86 GB - AverageThreadTokens: 14.98434004474273 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189186962218 - PerHostPeakMemUsage: 189197758704 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12163539206 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 128939815 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 298957616 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 128941405 - ExecTreeOpenTime: 288426 - PrepareTime: 169920283 - ExecTreePrepareTime: 5073467 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 334821 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3672686 - CompileTime: 35100942 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 92463424 - PeakMemoryUsage: 624640 - PrepareTime: 26235757 - TotalTime: 154294773 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 79216286 - GetResultsTime: 0 - HTResizeTime: 15017944677 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188899903616 - PinTime: 0 - ReductionFactorEstimate: 355.87834071477243 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 447688502949 - TotalTime: 5359696 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:22/5.33 GB 6:28/6.93 GB 7:28/6.75 GB 1:33/8.05 GB 4:31/7.48 GB 0:33/7.86 GB 2:27/6.60 GB 3:24/5.86 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04927211646136618 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2634892840 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9903541914 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 588282220 - PerReadThreadRawHdfsThroughput: 121664102 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 407609578 - RowsReturned: 407483626 - RowsReturnedRate: 153514121 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11349521461 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 21657109917 - TotalReadThroughput: 5894614 - TotalTime: 2654372265 Instance c74ce10ea42773c1:8f12f6e900000024 (host=vd1121.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:18/4.34 GB 6:29/7.06 GB 4:34/8.33 GB 3:30/7.34 GB 0:30/7.16 GB 1:35/8.54 GB 7:28/6.85 GB 5:22/5.37 GB - AverageThreadTokens: 12.986394557823129 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 185669266915 - PerHostPeakMemUsage: 185680063401 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16243314822 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 132836203 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 131980000 - TotalThreadsVoluntaryContextSwitches: 20 - TotalTime: 297015980 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 132838383 - ExecTreeOpenTime: 359419 - PrepareTime: 164109356 - ExecTreePrepareTime: 3591857 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 348714 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5781575 - CompileTime: 36518815 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 94226621 - PeakMemoryUsage: 624640 - PrepareTime: 33571363 - TotalTime: 165016396 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 129439642 - GetResultsTime: 0 - HTResizeTime: 14958327720 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185212061824 - PinTime: 0 - ReductionFactorEstimate: 355.9367084372361 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 442178719693 - TotalTime: 3948365 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:18/4.34 GB 6:29/7.06 GB 4:34/8.33 GB 3:30/7.34 GB 0:30/7.16 GB 1:35/8.54 GB 7:28/6.85 GB 5:22/5.37 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0681044267877412 - AverageScannerThreadConcurrency: 12.0 - BytesRead: 2710253724 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9379802813 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 499178305 - PerReadThreadRawHdfsThroughput: 101146055 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 390466717 - RowsReturned: 390341789 - RowsReturnedRate: 145701667 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12133895781 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26795446664 - TotalReadThroughput: 6145700 - TotalTime: 2679048194 Instance c74ce10ea42773c1:8f12f6e90000003c (host=vd1111.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:23/5.62 GB 4:24/5.80 GB 2:31/7.46 GB 5:33/8.12 GB 7:28/6.86 GB 6:30/7.32 GB 3:26/6.44 GB 0:29/6.70 GB - AverageThreadTokens: 14.211670480549198 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190461233456 - PerHostPeakMemUsage: 190472029942 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16644090850 - TotalThreadsInvoluntaryContextSwitches: 23 - TotalThreadsTotalWallClockTime: 180591676 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 178973000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 296918852 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 180593784 - ExecTreeOpenTime: 384385 - PrepareTime: 116265949 - ExecTreePrepareTime: 2713966 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 270553 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4084413 - CompileTime: 49359087 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 129577527 - PeakMemoryUsage: 624640 - PrepareTime: 29782649 - TotalTime: 209365096 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36929135 - GetResultsTime: 0 - HTResizeTime: 15580078279 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 190101571712 - PinTime: 0 - ReductionFactorEstimate: 355.7231800646971 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 435511537600 - TotalTime: 3094913 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:23/5.62 GB 4:24/5.80 GB 2:31/7.46 GB 5:33/8.12 GB 7:28/6.86 GB 6:30/7.32 GB 3:26/6.44 GB 0:29/6.70 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.052691867124856816 - AverageScannerThreadConcurrency: 13.22680412371134 - BytesRead: 2755301967 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9734971395 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 544409354 - PerReadThreadRawHdfsThroughput: 103729893 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 413630552 - RowsReturned: 413502552 - RowsReturnedRate: 149539645 - ScanRangesComplete: 58 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11962474036 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26562275201 - TotalReadThroughput: 6305038 - TotalTime: 2765170063 Instance c74ce10ea42773c1:8f12f6e900000020 (host=vc1526.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:29/7.07 GB 2:20/4.91 GB 6:28/6.93 GB 5:30/7.43 GB 1:37/9.05 GB 3:19/4.58 GB 7:26/6.40 GB 0:35/8.46 GB - AverageThreadTokens: 13.10730593607306 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195244029811 - PerHostPeakMemUsage: 195254826297 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16609765494 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 140555007 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 136979000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 296300942 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 140556924 - ExecTreeOpenTime: 276825 - PrepareTime: 155662719 - ExecTreePrepareTime: 2065216 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 351705 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3821049 - CompileTime: 32753025 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 106171482 - PeakMemoryUsage: 624640 - PrepareTime: 31934188 - TotalTime: 171407864 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66410137 - GetResultsTime: 0 - HTResizeTime: 14484806438 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195042461824 - PinTime: 0 - ReductionFactorEstimate: 356.0059276812784 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 435458528041 - TotalTime: 2338892 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:29/7.07 GB 2:20/4.91 GB 6:28/6.93 GB 5:30/7.43 GB 1:37/9.05 GB 3:19/4.58 GB 7:26/6.40 GB 0:35/8.46 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09474885844748858 - AverageScannerThreadConcurrency: 12.10730593607306 - BytesRead: 2776687503 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10151857331 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 518426949 - PerReadThreadRawHdfsThroughput: 70489594 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 439034877 - RowsReturned: 438908925 - RowsReturnedRate: 155982356 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12174605874 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 39391452249 - TotalReadThroughput: 6339469 - TotalTime: 2813836989 Instance c74ce10ea42773c1:8f12f6e900000051 (host=vd1117.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:28/6.89 GB 0:32/7.89 GB 1:32/7.76 GB 3:29/7.18 GB 2:21/4.92 GB 4:27/6.68 GB 7:27/6.58 GB 6:28/6.72 GB - AverageThreadTokens: 13.985635359116023 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199190686183 - PerHostPeakMemUsage: 199201690636 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19951494875 - TotalThreadsInvoluntaryContextSwitches: 20 - TotalThreadsTotalWallClockTime: 162508469 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 158976000 - TotalThreadsVoluntaryContextSwitches: 70 - TotalTime: 295417055 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 162510602 - ExecTreeOpenTime: 344229 - PrepareTime: 132844456 - ExecTreePrepareTime: 2512174 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 270545 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4360443 - CompileTime: 35952953 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 124624707 - PeakMemoryUsage: 624640 - PrepareTime: 37171647 - TotalTime: 198385801 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 46632913 - GetResultsTime: 0 - HTResizeTime: 14764330091 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 198891784320 - PinTime: 0 - ReductionFactorEstimate: 355.8018788718141 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450400523233 - TotalTime: 2853423 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:28/6.89 GB 0:32/7.89 GB 1:32/7.76 GB 3:29/7.18 GB 2:21/4.92 GB 4:27/6.68 GB 7:27/6.58 GB 6:28/6.72 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08738938053097345 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2962150316 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10895179726 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 79 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 541324753 - PerReadThreadRawHdfsThroughput: 70653275 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 460212112 - RowsReturned: 460086160 - RowsReturnedRate: 163381233 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13914591288 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 41925166336 - TotalReadThroughput: 6546188 - TotalTime: 2816028201 Instance c74ce10ea42773c1:8f12f6e90000002e (host=vd1104.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:19/4.67 GB 0:23/5.65 GB 1:21/5.13 GB 2:29/7.14 GB 3:37/9.11 GB 7:31/7.44 GB 4:33/8.17 GB 5:30/7.39 GB - AverageThreadTokens: 13.09364161849711 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197479166287 - PerHostPeakMemUsage: 197489962773 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19108636579 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 139372359 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 136979000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 295046930 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 139374520 - ExecTreeOpenTime: 286614 - PrepareTime: 155546884 - ExecTreePrepareTime: 3691774 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 307567 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8986057 - CompileTime: 31640257 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 105936551 - PeakMemoryUsage: 624640 - PrepareTime: 47647446 - TotalTime: 186028582 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36354370 - GetResultsTime: 0 - HTResizeTime: 14062052531 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197260200064 - PinTime: 0 - ReductionFactorEstimate: 355.7687116916077 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433747465432 - TotalTime: 3975116 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:19/4.67 GB 0:23/5.65 GB 1:21/5.13 GB 2:29/7.14 GB 3:37/9.11 GB 7:31/7.44 GB 4:33/8.17 GB 5:30/7.39 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08796296296296297 - AverageScannerThreadConcurrency: 12.10763888888889 - BytesRead: 2866516810 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10077896409 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 506457206 - PerReadThreadRawHdfsThroughput: 76922075 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 450653098 - RowsReturned: 450527146 - RowsReturnedRate: 159219204 - ScanRangesComplete: 63 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12703991036 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 37265203724 - TotalReadThroughput: 6627784 - TotalTime: 2829603050 Instance c74ce10ea42773c1:8f12f6e900000060 (host=vc1539.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:29/7.14 GB 7:28/6.83 GB 2:22/5.45 GB 6:24/5.84 GB 4:30/7.26 GB 5:25/6.11 GB 1:31/7.45 GB 0:35/8.46 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192968335078 - PerHostPeakMemUsage: 192979131564 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 23906712432 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131837793 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 124981000 - TotalThreadsVoluntaryContextSwitches: 13 - TotalTime: 293331675 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131839534 - ExecTreeOpenTime: 424003 - PrepareTime: 161386447 - ExecTreePrepareTime: 5521364 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 336328 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3928749 - CompileTime: 43364146 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 87102584 - PeakMemoryUsage: 624640 - PrepareTime: 27762561 - TotalTime: 158736514 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 106307020 - GetResultsTime: 0 - HTResizeTime: 15295693953 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192583551104 - PinTime: 0 - ReductionFactorEstimate: 355.80900401335236 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 438857179646 - TotalTime: 5941085 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:29/7.14 GB 7:28/6.83 GB 2:22/5.45 GB 6:24/5.84 GB 4:30/7.26 GB 5:25/6.11 GB 1:31/7.45 GB 0:35/8.46 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10297482837528604 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2888001220 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9598999043 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 454191771 - PerReadThreadRawHdfsThroughput: 64712453 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 425740283 - RowsReturned: 425616379 - RowsReturnedRate: 153329974 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13689942229 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 44628214082 - TotalReadThroughput: 6608698 - TotalTime: 2775819792 Instance c74ce10ea42773c1:8f12f6e900000061 (host=vd1102.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:30/7.28 GB 0:30/7.14 GB 2:24/5.87 GB 7:36/8.65 GB 4:22/5.45 GB 6:20/4.92 GB 3:30/7.19 GB 1:33/7.97 GB - AverageThreadTokens: 13.673120728929385 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186998279567 - PerHostPeakMemUsage: 187009076053 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15182085564 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 146892254 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 145978000 - TotalThreadsVoluntaryContextSwitches: 37 - TotalTime: 292650035 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 146894402 - ExecTreeOpenTime: 302965 - PrepareTime: 145673153 - ExecTreePrepareTime: 3258524 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 261494 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3260650 - CompileTime: 37553718 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 108277652 - PeakMemoryUsage: 624640 - PrepareTime: 25017481 - TotalTime: 171245142 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 268752237 - GetResultsTime: 0 - HTResizeTime: 15212325761 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186663291008 - PinTime: 0 - ReductionFactorEstimate: 355.7761440462307 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439981846332 - TotalTime: 3558606 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:30/7.28 GB 0:30/7.14 GB 2:24/5.87 GB 7:36/8.65 GB 4:22/5.45 GB 6:20/4.92 GB 3:30/7.19 GB 1:33/7.97 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06271379703534778 - AverageScannerThreadConcurrency: 12.68757126567845 - BytesRead: 2647658014 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9651509335 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 527861564 - PerReadThreadRawHdfsThroughput: 101881068 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 397297108 - RowsReturned: 397171156 - RowsReturnedRate: 153875644 - ScanRangesComplete: 57 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12362893558 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 25987733059 - TotalReadThroughput: 5944857 - TotalTime: 2581117741 Instance c74ce10ea42773c1:8f12f6e90000004e (host=vd1129.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:24/5.85 GB 5:29/7.12 GB 6:28/6.90 GB 7:34/8.30 GB 4:30/7.35 GB 1:26/6.19 GB 0:22/5.24 GB 3:32/7.77 GB - AverageThreadTokens: 10.988950276243093 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 198440857787 - PerHostPeakMemUsage: 198453304032 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14994330794 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 121991875 - TotalThreadsSysTime: 5000000 - TotalThreadsUserTime: 116982000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 291216246 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 121993411 - ExecTreeOpenTime: 381798 - PrepareTime: 169159185 - ExecTreePrepareTime: 2688237 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 368645 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3249166 - CompileTime: 34657426 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 85918794 - PeakMemoryUsage: 624640 - PrepareTime: 25540775 - TotalTime: 146620176 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 89183081 - GetResultsTime: 0 - HTResizeTime: 14821961407 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 198071797888 - PinTime: 0 - ReductionFactorEstimate: 355.7858441572515 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 448323947221 - TotalTime: 3067081 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:24/5.85 GB 5:29/7.12 GB 6:28/6.90 GB 7:34/8.30 GB 4:30/7.35 GB 1:26/6.19 GB 0:22/5.24 GB 3:32/7.77 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06637168141592921 - AverageScannerThreadConcurrency: 10.0 - BytesRead: 3027763255 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10487889539 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 81 - NumScannerThreadsStarted: 10 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 418459174 - PerReadThreadRawHdfsThroughput: 112491808 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 455360693 - RowsReturned: 455237813 - RowsReturnedRate: 108893629 - ScanRangesComplete: 71 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 15849645378 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26915410903 - TotalReadThroughput: 6691189 - TotalTime: 4180573409 Instance c74ce10ea42773c1:8f12f6e900000044 (host=vd1126.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:22/5.40 GB 1:20/4.95 GB 7:23/5.61 GB 0:35/8.53 GB 6:35/8.59 GB 5:30/7.25 GB 3:28/6.89 GB 2:30/7.26 GB - AverageThreadTokens: 12.6484375 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195731661013 - PerHostPeakMemUsage: 195742457499 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18579606729 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131962276 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 32 - TotalTime: 290935200 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131964780 - ExecTreeOpenTime: 410196 - PrepareTime: 158889801 - ExecTreePrepareTime: 4451245 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 355738 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3701406 - CompileTime: 38771113 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91916218 - PeakMemoryUsage: 624640 - PrepareTime: 30653170 - TotalTime: 161775376 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 184308070 - GetResultsTime: 0 - HTResizeTime: 15714538267 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195569895552 - PinTime: 0 - ReductionFactorEstimate: 355.8478326686056 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 444488935869 - TotalTime: 4858287 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:22/5.40 GB 1:20/4.95 GB 7:23/5.61 GB 0:35/8.53 GB 6:35/8.59 GB 5:30/7.25 GB 3:28/6.89 GB 2:30/7.26 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09162011173184358 - AverageScannerThreadConcurrency: 11.66145251396648 - BytesRead: 2766750513 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10136799783 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 494103845 - PerReadThreadRawHdfsThroughput: 73618197 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 441921695 - RowsReturned: 441803868 - RowsReturnedRate: 159237261 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13051001438 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 37582426490 - TotalReadThroughput: 6175782 - TotalTime: 2774500546 Instance c74ce10ea42773c1:8f12f6e900000067 (host=vd1140.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:19/4.61 GB 5:30/7.37 GB 7:21/5.07 GB 6:32/7.74 GB 0:22/5.41 GB 2:34/8.30 GB 3:38/9.26 GB 1:29/6.95 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190245695413 - PerHostPeakMemUsage: 190258076122 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15559662168 - TotalThreadsInvoluntaryContextSwitches: 19 - TotalThreadsTotalWallClockTime: 171134479 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 160976000 - TotalThreadsVoluntaryContextSwitches: 10 - TotalTime: 289790206 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 171136784 - ExecTreeOpenTime: 344170 - PrepareTime: 118527752 - ExecTreePrepareTime: 4390466 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 261930 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3985059 - CompileTime: 48082259 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 121468342 - PeakMemoryUsage: 624640 - PrepareTime: 27642232 - TotalTime: 197611517 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 42143783 - GetResultsTime: 0 - HTResizeTime: 15569200677 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189984131200 - PinTime: 0 - ReductionFactorEstimate: 355.79379426919144 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 453977625348 - TotalTime: 4731211 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:19/4.61 GB 5:30/7.37 GB 7:21/5.07 GB 6:32/7.74 GB 0:22/5.41 GB 2:34/8.30 GB 3:38/9.26 GB 1:29/6.95 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05077262693156733 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2687835123 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10408799979 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 462518677 - PerReadThreadRawHdfsThroughput: 109942806 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 413020341 - RowsReturned: 412896437 - RowsReturnedRate: 146107075 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11851126517 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 24447575976 - TotalReadThroughput: 5932690 - TotalTime: 2825985233 Instance c74ce10ea42773c1:8f12f6e90000007c (host=vc1504.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:26/6.28 GB 4:24/5.90 GB 7:33/8.14 GB 0:28/6.82 GB 6:37/9.01 GB 1:25/6.11 GB 2:25/5.91 GB 5:28/6.82 GB - AverageThreadTokens: 14.066285714285714 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187236878898 - PerHostPeakMemUsage: 187247675384 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 394682217191 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 149300543 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 138979000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 289554009 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 149302881 - ExecTreeOpenTime: 435830 - PrepareTime: 140155380 - ExecTreePrepareTime: 5418719 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 232980 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3906063 - CompileTime: 44625639 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 103315509 - PeakMemoryUsage: 624640 - PrepareTime: 30420051 - TotalTime: 178892909 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 78894374 - GetResultsTime: 0 - HTResizeTime: 16747381877 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186912852096 - PinTime: 0 - ReductionFactorEstimate: 355.7784473386183 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 403703736276 - TotalTime: 5850417 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:26/6.28 GB 4:24/5.90 GB 7:33/8.14 GB 0:28/6.82 GB 6:37/9.01 GB 1:25/6.11 GB 2:25/5.91 GB 5:28/6.82 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06979405034324943 - AverageScannerThreadConcurrency: 13.081235697940503 - BytesRead: 2607986880 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9080973255 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 548541939 - PerReadThreadRawHdfsThroughput: 96817952 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 398526911 - RowsReturned: 398399935 - RowsReturnedRate: 12125224 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11419881154 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26937017629 - TotalReadThroughput: 5960949 - TotalTime: 32857118049 Instance c74ce10ea42773c1:8f12f6e900000010 (host=vd1135.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:19/4.70 GB 3:29/7.10 GB 7:33/7.96 GB 4:30/7.39 GB 2:29/7.14 GB 0:21/5.16 GB 1:33/7.86 GB 5:30/7.35 GB - AverageThreadTokens: 11.029017857142858 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 193131694139 - PerHostPeakMemUsage: 193142490625 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14314504582 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 141633510 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 133980000 - TotalThreadsVoluntaryContextSwitches: 13 - TotalTime: 287564954 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 141636146 - ExecTreeOpenTime: 398498 - PrepareTime: 145861857 - ExecTreePrepareTime: 4312631 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 237333 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3114479 - CompileTime: 44942496 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 95292878 - PeakMemoryUsage: 624640 - PrepareTime: 23990507 - TotalTime: 164652239 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 61419905 - GetResultsTime: 0 - HTResizeTime: 14147589870 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192905463936 - PinTime: 0 - ReductionFactorEstimate: 355.8570890490656 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 447191570238 - TotalTime: 4708046 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:19/4.70 GB 3:29/7.10 GB 7:33/7.96 GB 4:30/7.39 GB 2:29/7.14 GB 0:21/5.16 GB 1:33/7.86 GB 5:30/7.35 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06368715083798883 - AverageScannerThreadConcurrency: 10.04022346368715 - BytesRead: 2738257196 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10063096096 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 424628287 - PerReadThreadRawHdfsThroughput: 102410900 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 427420080 - RowsReturned: 427296176 - RowsReturnedRate: 160875621 - ScanRangesComplete: 62 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 15714526307 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26737946585 - TotalReadThroughput: 6112181 - TotalTime: 2656065433 Instance c74ce10ea42773c1:8f12f6e900000039 (host=vd1124.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:30/7.31 GB 3:28/6.81 GB 4:30/7.36 GB 1:26/6.12 GB 7:26/6.44 GB 2:29/6.90 GB 6:28/6.62 GB 0:29/7.06 GB - AverageThreadTokens: 13.98545861297539 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 191503465503 - PerHostPeakMemUsage: 191514261989 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18058129603 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 119090132 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 115982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 287546711 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 119091645 - ExecTreeOpenTime: 325320 - PrepareTime: 168370332 - ExecTreePrepareTime: 5023204 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 351884 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3334640 - CompileTime: 33874184 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83938332 - PeakMemoryUsage: 624640 - PrepareTime: 31024337 - TotalTime: 149290057 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 64193884 - GetResultsTime: 0 - HTResizeTime: 14480828122 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 190977132672 - PinTime: 0 - ReductionFactorEstimate: 355.9050488201903 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 446496194843 - TotalTime: 5345463 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:30/7.31 GB 3:28/6.81 GB 4:30/7.36 GB 1:26/6.12 GB 7:26/6.44 GB 2:29/6.90 GB 6:28/6.62 GB 0:29/7.06 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07726763717805152 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2962558665 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10581255606 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 541263189 - PerReadThreadRawHdfsThroughput: 90681652 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 418139262 - RowsReturned: 418013310 - RowsReturnedRate: 144215278 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13701416736 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 32669879519 - TotalReadThroughput: 6627648 - TotalTime: 2898536929 Instance c74ce10ea42773c1:8f12f6e90000007d (host=ve1129.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:26/6.32 GB 1:33/7.75 GB 3:28/6.90 GB 6:26/6.09 GB 5:24/5.87 GB 7:29/7.06 GB 0:28/6.85 GB 2:32/7.74 GB - AverageThreadTokens: 15.00447928331467 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189692311271 - PerHostPeakMemUsage: 189703107757 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 24397358163 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 146942548 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 141978000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 287433838 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 146944386 - ExecTreeOpenTime: 394326 - PrepareTime: 140412896 - ExecTreePrepareTime: 4692465 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 310729 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5458292 - CompileTime: 37229243 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 107808334 - PeakMemoryUsage: 624640 - PrepareTime: 44390825 - TotalTime: 190283976 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36330380 - GetResultsTime: 0 - HTResizeTime: 14675082856 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189336111232 - PinTime: 0 - ReductionFactorEstimate: 355.74844876412936 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 447862528062 - TotalTime: 5083542 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:26/6.32 GB 1:33/7.75 GB 3:28/6.90 GB 6:26/6.09 GB 5:24/5.87 GB 7:29/7.06 GB 0:28/6.85 GB 2:32/7.74 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06382978723404255 - AverageScannerThreadConcurrency: 14.00447928331467 - BytesRead: 2682404826 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9703587392 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 589946418 - PerReadThreadRawHdfsThroughput: 45531033 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 409722393 - RowsReturned: 409594393 - RowsReturnedRate: 151491883 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11767639048 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 58913770237 - TotalReadThroughput: 6007625 - TotalTime: 2703738198 Instance c74ce10ea42773c1:8f12f6e900000022 (host=vd1118.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:21/5.16 GB 1:26/6.36 GB 2:31/7.67 GB 3:33/8.10 GB 4:26/6.29 GB 7:29/7.09 GB 5:25/6.12 GB 0:34/8.05 GB - AverageThreadTokens: 14.688989784335982 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199018300892 - PerHostPeakMemUsage: 199029097378 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 20147990456 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 121540224 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 119982000 - TotalThreadsVoluntaryContextSwitches: 23 - TotalTime: 287121121 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 121541500 - ExecTreeOpenTime: 364616 - PrepareTime: 165451554 - ExecTreePrepareTime: 4428447 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 338055 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9412756 - CompileTime: 30764607 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 88882923 - PeakMemoryUsage: 624640 - PrepareTime: 48241639 - TotalTime: 168983725 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 58045342 - GetResultsTime: 0 - HTResizeTime: 14445567107 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 198597134464 - PinTime: 0 - ReductionFactorEstimate: 355.81915901551224 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436334289068 - TotalTime: 4780706 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:21/5.16 GB 1:26/6.36 GB 2:31/7.67 GB 3:33/8.10 GB 4:26/6.29 GB 7:29/7.09 GB 5:25/6.12 GB 0:34/8.05 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10896708286038592 - AverageScannerThreadConcurrency: 13.688989784335982 - BytesRead: 3094484797 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9956937385 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 82 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 577971296 - PerReadThreadRawHdfsThroughput: 68274377 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 458523717 - RowsReturned: 458396741 - RowsReturnedRate: 154285146 - ScanRangesComplete: 68 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12962208924 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 45324247974 - TotalReadThroughput: 7024921 - TotalTime: 2971100921 Instance c74ce10ea42773c1:8f12f6e90000004b (host=vc1522.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:27/6.54 GB 4:32/7.76 GB 6:30/7.32 GB 3:27/6.61 GB 5:23/5.69 GB 7:26/6.35 GB 1:26/6.31 GB 0:33/8.12 GB - AverageThreadTokens: 12.98611111111111 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192409451619 - PerHostPeakMemUsage: 192420248105 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12066563735 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 148658145 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 143979000 - TotalThreadsVoluntaryContextSwitches: 12 - TotalTime: 286858102 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 148660269 - ExecTreeOpenTime: 320564 - PrepareTime: 138099879 - ExecTreePrepareTime: 4137312 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 309085 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9264804 - CompileTime: 31473853 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 115388277 - PeakMemoryUsage: 624640 - PrepareTime: 39429526 - TotalTime: 187237033 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 46073165 - GetResultsTime: 0 - HTResizeTime: 14008453783 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192159926400 - PinTime: 0 - ReductionFactorEstimate: 356.0264261193593 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433287141231 - TotalTime: 4454622 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:27/6.54 GB 4:32/7.76 GB 6:30/7.32 GB 3:27/6.61 GB 5:23/5.69 GB 7:26/6.35 GB 1:26/6.31 GB 0:33/8.12 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05214368482039398 - AverageScannerThreadConcurrency: 12.0 - BytesRead: 2704859881 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10851765391 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 506457082 - PerReadThreadRawHdfsThroughput: 135029791 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 423549877 - RowsReturned: 423424949 - RowsReturnedRate: 147106210 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11551281363 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 20031578545 - TotalReadThroughput: 6261249 - TotalTime: 2878362155 Instance c74ce10ea42773c1:8f12f6e90000002c (host=ve1125.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:26/6.32 GB 6:28/6.85 GB 5:30/7.39 GB 0:33/8.13 GB 7:24/5.86 GB 2:24/5.76 GB 4:34/8.25 GB 1:24/5.75 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186705519059 - PerHostPeakMemUsage: 186715474936 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12069321285 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 141244085 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 133980000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 286556399 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 141245924 - ExecTreeOpenTime: 306074 - PrepareTime: 145215681 - ExecTreePrepareTime: 4573600 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 381265 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5946881 - CompileTime: 35785051 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 103939262 - PeakMemoryUsage: 624640 - PrepareTime: 37412630 - TotalTime: 178016127 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 28189068 - GetResultsTime: 0 - HTResizeTime: 15692002188 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186370738304 - PinTime: 0 - ReductionFactorEstimate: 355.91760510959136 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 448719002627 - TotalTime: 4876302 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:26/6.32 GB 6:28/6.85 GB 5:30/7.39 GB 0:33/8.13 GB 7:24/5.86 GB 2:24/5.76 GB 4:34/8.25 GB 1:24/5.75 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04241071428571429 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2641838824 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9866742239 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 581251698 - PerReadThreadRawHdfsThroughput: 143904438 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 395939935 - RowsReturned: 395812959 - RowsReturnedRate: 145475353 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12295732661 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 18358285897 - TotalReadThroughput: 5896961 - TotalTime: 2720824863 Instance c74ce10ea42773c1:8f12f6e900000078 (host=vd1133.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:30/7.38 GB 6:25/6.15 GB 7:24/5.91 GB 2:20/4.87 GB 3:28/6.83 GB 5:37/8.98 GB 0:29/7.02 GB 4:29/7.14 GB - AverageThreadTokens: 11.987723214285714 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195804172755 - PerHostPeakMemUsage: 195815177208 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 23179510116 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 140786516 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 135979000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 286286794 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 140788745 - ExecTreeOpenTime: 358282 - PrepareTime: 145358422 - ExecTreePrepareTime: 5134357 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 347654 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4098502 - CompileTime: 39209409 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 99733922 - PeakMemoryUsage: 624640 - PrepareTime: 30191054 - TotalTime: 169718257 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 50237935 - GetResultsTime: 0 - HTResizeTime: 14836222012 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195456649344 - PinTime: 0 - ReductionFactorEstimate: 355.75984929420906 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 449358542344 - TotalTime: 5488784 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:30/7.38 GB 6:25/6.15 GB 7:24/5.91 GB 2:20/4.87 GB 3:28/6.83 GB 5:37/8.98 GB 0:29/7.02 GB 4:29/7.14 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.11620111731843576 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2930553860 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10549658418 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 464555345 - PerReadThreadRawHdfsThroughput: 48375620 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 441310832 - RowsReturned: 441186928 - RowsReturnedRate: 155034697 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13486177050 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 60579147531 - TotalReadThroughput: 6541414 - TotalTime: 2845730255 Instance c74ce10ea42773c1:8f12f6e90000003d (host=vd1110.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:30/7.39 GB 5:30/7.35 GB 7:28/6.85 GB 0:24/5.90 GB 2:28/6.85 GB 4:25/5.99 GB 1:31/7.57 GB 6:28/6.75 GB - AverageThreadTokens: 13.985244040862655 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189749732304 - PerHostPeakMemUsage: 189760528790 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 11908868333 - TotalThreadsInvoluntaryContextSwitches: 18 - TotalThreadsTotalWallClockTime: 146757778 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 142978000 - TotalThreadsVoluntaryContextSwitches: 19 - TotalTime: 284603635 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 146760125 - ExecTreeOpenTime: 349303 - PrepareTime: 137778388 - ExecTreePrepareTime: 3120378 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 261389 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3169689 - CompileTime: 40884105 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 104707369 - PeakMemoryUsage: 624640 - PrepareTime: 20843867 - TotalTime: 166936868 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 45446425 - GetResultsTime: 0 - HTResizeTime: 14160836833 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189490251904 - PinTime: 0 - ReductionFactorEstimate: 355.79834303300265 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 440661087861 - TotalTime: 3466766 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:30/7.39 GB 5:30/7.35 GB 7:28/6.85 GB 0:24/5.90 GB 2:28/6.85 GB 4:25/5.99 GB 1:31/7.57 GB 6:28/6.75 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04772727272727273 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2651338103 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10026058516 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 539915586 - PerReadThreadRawHdfsThroughput: 122360860 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 410515088 - RowsReturned: 410400117 - RowsReturnedRate: 153160600 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12939298780 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 21668187830 - TotalReadThroughput: 5854698 - TotalTime: 2679541050 Instance c74ce10ea42773c1:8f12f6e90000005c (host=vc1542.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:31/7.52 GB 6:21/5.12 GB 3:26/6.35 GB 1:35/8.51 GB 5:34/8.39 GB 4:21/5.16 GB 0:29/7.05 GB 2:27/6.65 GB - AverageThreadTokens: 13.993047508690614 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 184829560393 - PerHostPeakMemUsage: 184840356879 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10722828113 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 150191355 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 143978000 - TotalThreadsVoluntaryContextSwitches: 23 - TotalTime: 283783402 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 150192897 - ExecTreeOpenTime: 371856 - PrepareTime: 133505042 - ExecTreePrepareTime: 3254831 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 245320 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3958426 - CompileTime: 45087828 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 103528307 - PeakMemoryUsage: 624640 - PrepareTime: 27851098 - TotalTime: 177028473 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 40175262 - GetResultsTime: 0 - HTResizeTime: 14904316784 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 184599693440 - PinTime: 0 - ReductionFactorEstimate: 355.833864615153 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 432995218643 - TotalTime: 3624175 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:31/7.52 GB 6:21/5.12 GB 3:26/6.35 GB 1:35/8.51 GB 5:34/8.39 GB 4:21/5.16 GB 0:29/7.05 GB 2:27/6.65 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05098493626882966 - AverageScannerThreadConcurrency: 12.993047508690614 - BytesRead: 2493851986 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9266123103 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 66 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 541075132 - PerReadThreadRawHdfsThroughput: 127165217 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 387605756 - RowsReturned: 387479804 - RowsReturnedRate: 161568249 - ScanRangesComplete: 53 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11069356557 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 19611117196 - TotalReadThroughput: 5779494 - TotalTime: 2398242263 Instance c74ce10ea42773c1:8f12f6e90000002a (host=vc1511.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:23/5.65 GB 2:31/7.61 GB 6:32/7.78 GB 5:30/7.30 GB 7:24/5.94 GB 4:25/6.11 GB 1:33/8.12 GB 0:24/5.91 GB - AverageThreadTokens: 13.985040276179516 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190019850138 - PerHostPeakMemUsage: 190030646624 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15921624213 - TotalThreadsInvoluntaryContextSwitches: 21 - TotalThreadsTotalWallClockTime: 149041104 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 143978000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 283764209 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 149043177 - ExecTreeOpenTime: 375235 - PrepareTime: 134658776 - ExecTreePrepareTime: 3803371 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 264309 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4954426 - CompileTime: 36159322 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 110727099 - PeakMemoryUsage: 624640 - PrepareTime: 35302259 - TotalTime: 182809204 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 57171709 - GetResultsTime: 0 - HTResizeTime: 14136119813 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189593012352 - PinTime: 0 - ReductionFactorEstimate: 355.7780820313544 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 435175862406 - TotalTime: 4175316 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:23/5.65 GB 2:31/7.61 GB 6:32/7.78 GB 5:30/7.30 GB 7:24/5.94 GB 4:25/6.11 GB 1:33/8.12 GB 0:24/5.91 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06336405529953917 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2823796034 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9995597230 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 541324643 - PerReadThreadRawHdfsThroughput: 103890284 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 411061945 - RowsReturned: 410935993 - RowsReturnedRate: 162437146 - ScanRangesComplete: 62 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13023263980 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 27180559372 - TotalReadThroughput: 6498955 - TotalTime: 2529815387 Instance c74ce10ea42773c1:8f12f6e900000046 (host=vd1332.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:25/6.07 GB 7:25/6.08 GB 0:24/5.90 GB 2:37/8.75 GB 4:27/6.46 GB 3:32/7.88 GB 6:35/8.21 GB 1:22/5.16 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192399018346 - PerHostPeakMemUsage: 192409814832 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15309459326 - TotalThreadsInvoluntaryContextSwitches: 23 - TotalThreadsTotalWallClockTime: 171061534 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 165975000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 282660675 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 171063701 - ExecTreeOpenTime: 295871 - PrepareTime: 111434685 - ExecTreePrepareTime: 4734928 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 315404 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4768002 - CompileTime: 39104849 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 130164415 - PeakMemoryUsage: 624640 - PrepareTime: 33034056 - TotalTime: 202877907 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 34048323 - GetResultsTime: 0 - HTResizeTime: 16441277245 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192100157568 - PinTime: 0 - ReductionFactorEstimate: 355.866948911179 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445655416092 - TotalTime: 5027137 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:25/6.07 GB 7:25/6.08 GB 0:24/5.90 GB 2:37/8.75 GB 4:27/6.46 GB 3:32/7.88 GB 6:35/8.21 GB 1:22/5.16 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06974128233970754 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2744935785 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9866669472 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 74 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 564213306 - PerReadThreadRawHdfsThroughput: 94671071 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 423218346 - RowsReturned: 423091370 - RowsReturnedRate: 145445254 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12294814310 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28994451582 - TotalReadThroughput: 6174777 - TotalTime: 2908938978 Instance c74ce10ea42773c1:8f12f6e900000007 (host=vd1132.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:26/6.36 GB 3:19/4.70 GB 4:20/4.91 GB 7:33/7.98 GB 5:27/6.60 GB 0:39/9.58 GB 1:29/7.05 GB 2:32/7.77 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194169015730 - PerHostPeakMemUsage: 194181560279 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17404898119 - TotalThreadsInvoluntaryContextSwitches: 18 - TotalThreadsTotalWallClockTime: 142703973 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 137979000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 281527922 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 142706336 - ExecTreeOpenTime: 435490 - PrepareTime: 138637559 - ExecTreePrepareTime: 4777907 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 330551 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4201072 - CompileTime: 42541024 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 98897269 - PeakMemoryUsage: 624640 - PrepareTime: 27550122 - TotalTime: 169573121 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 28522461 - GetResultsTime: 0 - HTResizeTime: 15271254929 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193778927744 - PinTime: 0 - ReductionFactorEstimate: 355.74959472933443 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 448551230841 - TotalTime: 5210123 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:26/6.36 GB 3:19/4.70 GB 4:20/4.91 GB 7:33/7.98 GB 5:27/6.60 GB 0:39/9.58 GB 1:29/7.05 GB 2:32/7.77 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07941834451901567 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2901089391 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13545285043 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 460160717 - PerReadThreadRawHdfsThroughput: 77606622 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 432088091 - RowsReturned: 431964187 - RowsReturnedRate: 151153488 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13833712442 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 37381982105 - TotalReadThroughput: 6489566 - TotalTime: 2857785097 Instance c74ce10ea42773c1:8f12f6e900000050 (host=vd1105.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:31/7.53 GB 4:33/7.91 GB 6:24/5.90 GB 7:28/6.82 GB 1:27/6.68 GB 3:30/7.06 GB 2:27/6.43 GB 5:28/6.71 GB - AverageThreadTokens: 13.617341040462428 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189939246917 - PerHostPeakMemUsage: 189950043403 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21758156725 - TotalThreadsInvoluntaryContextSwitches: 18 - TotalThreadsTotalWallClockTime: 153217012 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 147977000 - TotalThreadsVoluntaryContextSwitches: 10 - TotalTime: 281334230 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 153219109 - ExecTreeOpenTime: 285055 - PrepareTime: 128016737 - ExecTreePrepareTime: 3656672 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 256133 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4473544 - CompileTime: 34933854 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 116919924 - PeakMemoryUsage: 624640 - PrepareTime: 30107225 - TotalTime: 182488143 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 46292408 - GetResultsTime: 0 - HTResizeTime: 14668248042 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189446211712 - PinTime: 0 - ReductionFactorEstimate: 355.74240082913775 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433471206991 - TotalTime: 3938312 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:31/7.53 GB 4:33/7.91 GB 6:24/5.90 GB 7:28/6.82 GB 1:27/6.68 GB 3:30/7.06 GB 2:27/6.43 GB 5:28/6.71 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09027777777777778 - AverageScannerThreadConcurrency: 12.631944444444445 - BytesRead: 2867050903 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9937388111 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 527485164 - PerReadThreadRawHdfsThroughput: 68669684 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 410306289 - RowsReturned: 410180337 - RowsReturnedRate: 151372474 - ScanRangesComplete: 63 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12890652391 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 41751333768 - TotalReadThroughput: 6629019 - TotalTime: 2709741902 Instance c74ce10ea42773c1:8f12f6e900000028 (host=vc1503.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:24/5.86 GB 0:26/6.36 GB 4:33/8.17 GB 5:24/5.94 GB 7:26/6.33 GB 6:32/7.75 GB 1:32/7.76 GB 2:27/6.48 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194929992955 - PerHostPeakMemUsage: 194940789441 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17372082672 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131344339 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 127981000 - TotalThreadsVoluntaryContextSwitches: 9 - TotalTime: 279689398 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131346346 - ExecTreeOpenTime: 410981 - PrepareTime: 148262143 - ExecTreePrepareTime: 4083180 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 396783 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4036893 - CompileTime: 39797106 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 90018424 - PeakMemoryUsage: 624640 - PrepareTime: 26529006 - TotalTime: 156886196 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 58894513 - GetResultsTime: 0 - HTResizeTime: 15197575510 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 194554873984 - PinTime: 0 - ReductionFactorEstimate: 355.88707330373626 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436284017854 - TotalTime: 4491164 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:24/5.86 GB 0:26/6.36 GB 4:33/8.17 GB 5:24/5.94 GB 7:26/6.33 GB 6:32/7.75 GB 1:32/7.76 GB 2:27/6.48 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08695652173913043 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2935871139 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10394030850 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 544409358 - PerReadThreadRawHdfsThroughput: 75326262 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 436373831 - RowsReturned: 436247879 - RowsReturnedRate: 163378527 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13523646898 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38975399252 - TotalReadThroughput: 6718225 - TotalTime: 2670166545 Instance c74ce10ea42773c1:8f12f6e90000001e (host=vc1518.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:32/7.77 GB 0:26/6.18 GB 7:24/5.91 GB 5:25/6.07 GB 3:35/8.41 GB 1:33/8.01 GB 4:23/5.57 GB 2:28/6.59 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 184676175932 - PerHostPeakMemUsage: 184686972418 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10430738303 - TotalThreadsInvoluntaryContextSwitches: 23 - TotalThreadsTotalWallClockTime: 157920578 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 151977000 - TotalThreadsVoluntaryContextSwitches: 11 - TotalTime: 277314658 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 157922949 - ExecTreeOpenTime: 326713 - PrepareTime: 119302963 - ExecTreePrepareTime: 4842164 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 254211 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4047498 - CompileTime: 45936970 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 110612059 - PeakMemoryUsage: 624640 - PrepareTime: 28723053 - TotalTime: 185784221 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 73271398 - GetResultsTime: 0 - HTResizeTime: 15145510085 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 184459184256 - PinTime: 0 - ReductionFactorEstimate: 355.8139712709808 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436986661251 - TotalTime: 5165826 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:32/7.77 GB 0:26/6.18 GB 7:24/5.91 GB 5:25/6.07 GB 3:35/8.41 GB 1:33/8.01 GB 4:23/5.57 GB 2:28/6.59 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.047018348623853214 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2480982082 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9356811067 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 66 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 540215005 - PerReadThreadRawHdfsThroughput: 124804398 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 386959513 - RowsReturned: 386833561 - RowsReturnedRate: 168562880 - ScanRangesComplete: 53 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14698892205 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 19878963554 - TotalReadThroughput: 5690325 - TotalTime: 2294891727 Instance c74ce10ea42773c1:8f12f6e900000040 (host=vc1528.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:28/6.86 GB 7:33/8.03 GB 4:31/7.60 GB 5:22/5.34 GB 1:28/6.85 GB 2:23/5.62 GB 6:37/9.06 GB 0:22/5.40 GB - AverageThreadTokens: 13.985108820160367 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 196350777093 - PerHostPeakMemUsage: 196361573579 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21518416699 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 134078385 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 124981000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 277153872 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 134080460 - ExecTreeOpenTime: 308168 - PrepareTime: 142966696 - ExecTreePrepareTime: 3834836 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 332114 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 8027060 - CompileTime: 32718569 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 99697355 - PeakMemoryUsage: 624640 - PrepareTime: 39444902 - TotalTime: 172838178 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 44839083 - GetResultsTime: 0 - HTResizeTime: 15060932629 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195966257280 - PinTime: 0 - ReductionFactorEstimate: 355.75138895896515 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 432747958293 - TotalTime: 4139881 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:28/6.86 GB 7:33/8.03 GB 4:31/7.60 GB 5:22/5.34 GB 1:28/6.85 GB 2:23/5.62 GB 6:37/9.06 GB 0:22/5.40 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08371559633027523 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2946461556 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10037895074 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 547493989 - PerReadThreadRawHdfsThroughput: 77284597 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 443377545 - RowsReturned: 443251593 - RowsReturnedRate: 169547259 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13232544708 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38124822293 - TotalReadThroughput: 6750198 - TotalTime: 2614324729 Instance c74ce10ea42773c1:8f12f6e90000000a (host=vd1112.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:22/5.29 GB 3:24/5.87 GB 2:32/7.78 GB 5:31/7.55 GB 1:35/8.63 GB 4:24/5.78 GB 6:35/8.50 GB 0:20/4.88 GB - AverageThreadTokens: 13.646383467278989 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194681260760 - PerHostPeakMemUsage: 194692057246 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21677207586 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 134058066 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 128980000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 276451339 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 134060500 - ExecTreeOpenTime: 362807 - PrepareTime: 142312358 - ExecTreePrepareTime: 3901141 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 343993 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6499050 - CompileTime: 31422340 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 101139294 - PeakMemoryUsage: 624640 - PrepareTime: 31132300 - TotalTime: 164413926 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 56889791 - GetResultsTime: 0 - HTResizeTime: 14595828787 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 194350401664 - PinTime: 0 - ReductionFactorEstimate: 355.90760189738313 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436889662193 - TotalTime: 4260450 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:22/5.29 GB 3:24/5.87 GB 2:32/7.78 GB 5:31/7.55 GB 1:35/8.63 GB 4:24/5.78 GB 6:35/8.50 GB 0:20/4.88 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09770114942528736 - AverageScannerThreadConcurrency: 12.660919540229886 - BytesRead: 2870571486 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10083932936 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 529851668 - PerReadThreadRawHdfsThroughput: 70352002 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 435238436 - RowsReturned: 435112484 - RowsReturnedRate: 154149384 - ScanRangesComplete: 63 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13341474108 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 40802982014 - TotalReadThroughput: 6591060 - TotalTime: 2822667665 Instance c74ce10ea42773c1:8f12f6e900000023 (host=vd1138.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:21/5.07 GB 4:34/8.15 GB 2:24/5.86 GB 1:29/7.14 GB 5:28/6.93 GB 3:31/7.61 GB 0:31/7.56 GB 7:27/6.55 GB - AverageThreadTokens: 11.863736263736264 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 196921819724 - PerHostPeakMemUsage: 196934364273 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 29286792552 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 130770468 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 125980000 - TotalThreadsVoluntaryContextSwitches: 28 - TotalTime: 275848681 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 130773233 - ExecTreeOpenTime: 343414 - PrepareTime: 144952110 - ExecTreePrepareTime: 3194957 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 317930 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 2896551 - CompileTime: 38978560 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 90472216 - PeakMemoryUsage: 624640 - PrepareTime: 21291251 - TotalTime: 151140053 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36797941 - GetResultsTime: 0 - HTResizeTime: 17501508646 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 196580722816 - PinTime: 0 - ReductionFactorEstimate: 355.73816626088546 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 453380996423 - TotalTime: 3534417 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:21/5.07 GB 4:34/8.15 GB 2:24/5.86 GB 1:29/7.14 GB 5:28/6.93 GB 3:31/7.61 GB 0:31/7.56 GB 7:27/6.55 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.12087912087912088 - AverageScannerThreadConcurrency: 10.863736263736264 - BytesRead: 2951217748 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10667011748 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 444994254 - PerReadThreadRawHdfsThroughput: 53432534 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 446826970 - RowsReturned: 446699994 - RowsReturnedRate: 162329186 - ScanRangesComplete: 64 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13259770706 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 55232599439 - TotalReadThroughput: 6486192 - TotalTime: 2751815646 Instance c74ce10ea42773c1:8f12f6e900000079 (host=vd1134.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:24/5.86 GB 6:24/5.86 GB 3:26/6.40 GB 4:28/6.74 GB 5:37/9.03 GB 2:28/6.83 GB 7:23/5.62 GB 1:35/8.48 GB - AverageThreadTokens: 12.982261640798226 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194098057232 - PerHostPeakMemUsage: 194110405173 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16061644692 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 133948832 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 133979000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 274637238 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 133950764 - ExecTreeOpenTime: 340725 - PrepareTime: 140613488 - ExecTreePrepareTime: 5055919 - TotalTime: 0 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 753 - BlocksRecycled: 0 - BufferedPins: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 173287063552 - PeakMemoryUsage: 14370226176 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 - ScratchWrites: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 376611 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3603684 - CompileTime: 36770401 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 95900480 - PeakMemoryUsage: 624640 - PrepareTime: 27834609 - TotalTime: 161005649 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 48614181 - GetResultsTime: 0 - HTResizeTime: 15836004354 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193856522368 - PinTime: 0 - ReductionFactorEstimate: 355.6795018017065 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450934952794 - TotalTime: 5394191 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:24/5.86 GB 6:24/5.86 GB 3:26/6.40 GB 4:28/6.74 GB 5:37/9.03 GB 2:28/6.83 GB 7:23/5.62 GB 1:35/8.48 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05543237250554324 - AverageScannerThreadConcurrency: 11.982261640798226 - BytesRead: 2735733356 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10562307319 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 532984886 - PerReadThreadRawHdfsThroughput: 96668184 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 432500830 - RowsReturned: 432374878 - RowsReturnedRate: 147925688 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12282595672 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28300245623 - TotalReadThroughput: 6065927 - TotalTime: 2922919486 Instance c74ce10ea42773c1:8f12f6e900000055 (host=vc1527.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:29/7.01 GB 0:29/7.00 GB 5:27/6.60 GB 4:24/5.84 GB 6:28/6.86 GB 2:29/7.05 GB 3:35/8.60 GB 7:24/5.87 GB - AverageThreadTokens: 12.636363636363637 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187907557572 - PerHostPeakMemUsage: 187918354058 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14583132622 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131843891 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 274359846 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131846215 - ExecTreeOpenTime: 312729 - PrepareTime: 142449784 - ExecTreePrepareTime: 3587674 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 320074 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4706089 - CompileTime: 31146866 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 98774053 - PeakMemoryUsage: 624640 - PrepareTime: 31113347 - TotalTime: 161654658 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 38234605 - GetResultsTime: 0 - HTResizeTime: 14396525667 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 187589183616 - PinTime: 0 - ReductionFactorEstimate: 355.8446991655888 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 430744755494 - TotalTime: 3897378 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:29/7.01 GB 0:29/7.00 GB 5:27/6.60 GB 4:24/5.84 GB 6:28/6.86 GB 2:29/7.05 GB 3:35/8.60 GB 7:24/5.87 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06444188722669736 - AverageScannerThreadConcurrency: 11.636363636363637 - BytesRead: 2643221676 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9449661080 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 494118775 - PerReadThreadRawHdfsThroughput: 84303587 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 401176469 - RowsReturned: 401051541 - RowsReturnedRate: 41750073 - ScanRangesComplete: 58 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12252649309 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 31353608564 - TotalReadThroughput: 6083350 - TotalTime: 9606008020 Instance c74ce10ea42773c1:8f12f6e90000005d (host=vd1327.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:28/6.78 GB 7:12/2.97 GB 3:32/7.68 GB 4:30/7.32 GB 6:30/7.26 GB 0:28/6.93 GB 1:31/7.64 GB 5:33/8.01 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 183869682145 - PerHostPeakMemUsage: 183880478631 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15926522073 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 140554857 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 133980000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 273052604 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 140556568 - ExecTreeOpenTime: 232555 - PrepareTime: 132401692 - ExecTreePrepareTime: 5313800 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 296153 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6023293 - CompileTime: 34969732 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 104123764 - PeakMemoryUsage: 624640 - PrepareTime: 36549613 - TotalTime: 176400180 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 41982528 - GetResultsTime: 0 - HTResizeTime: 16162893228 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 183443114112 - PinTime: 0 - ReductionFactorEstimate: 355.7522899347147 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445638884085 - TotalTime: 5543692 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:28/6.78 GB 7:12/2.97 GB 3:32/7.68 GB 4:30/7.32 GB 6:30/7.26 GB 0:28/6.93 GB 1:31/7.64 GB 5:33/8.01 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.056179775280898875 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2642352924 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9324258839 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 578532610 - PerReadThreadRawHdfsThroughput: 105098497 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 382273114 - RowsReturned: 382146138 - RowsReturnedRate: 148192385 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11887875258 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 25141681325 - TotalReadThroughput: 5937871 - TotalTime: 2578716425 Instance c74ce10ea42773c1:8f12f6e90000006e (host=vd1107.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:28/6.57 GB 4:27/6.65 GB 2:25/6.07 GB 3:28/6.89 GB 1:25/6.19 GB 7:29/7.07 GB 0:29/7.13 GB 6:33/8.10 GB - AverageThreadTokens: 12.888119953863898 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189344047218 - PerHostPeakMemUsage: 189354843704 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16069397802 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 152130331 - TotalThreadsSysTime: 9999000 - TotalThreadsUserTime: 140979000 - TotalThreadsVoluntaryContextSwitches: 15 - TotalTime: 273041117 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 152132511 - ExecTreeOpenTime: 285322 - PrepareTime: 120848484 - ExecTreePrepareTime: 3489982 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 228861 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5264792 - CompileTime: 40165745 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 110646711 - PeakMemoryUsage: 624640 - PrepareTime: 30800894 - TotalTime: 182143426 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 39772041 - GetResultsTime: 0 - HTResizeTime: 14585506963 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189025732736 - PinTime: 0 - ReductionFactorEstimate: 355.7616776509984 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433746916132 - TotalTime: 3772211 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:28/6.57 GB 4:27/6.65 GB 2:25/6.07 GB 3:28/6.89 GB 1:25/6.19 GB 7:29/7.07 GB 0:29/7.13 GB 6:33/8.10 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.053117782909930716 - AverageScannerThreadConcurrency: 11.901847575057737 - BytesRead: 2676692489 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10026935004 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 458386085 - PerReadThreadRawHdfsThroughput: 110456174 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 408226884 - RowsReturned: 408101956 - RowsReturnedRate: 156392606 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 16750027375 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 24233072622 - TotalReadThroughput: 6174607 - TotalTime: 2609470904 Instance c74ce10ea42773c1:8f12f6e900000027 (host=vc1516.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:17/4.16 GB 0:25/6.19 GB 1:33/8.09 GB 5:29/7.14 GB 4:15/3.68 GB 3:35/8.47 GB 2:38/9.29 GB 7:31/7.57 GB - AverageThreadTokens: 13.985142857142858 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186484366072 - PerHostPeakMemUsage: 186495162558 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10690762359 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 139931081 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 135979000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 272573449 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 139933353 - ExecTreeOpenTime: 309072 - PrepareTime: 132535490 - ExecTreePrepareTime: 3722692 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 265609 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5967821 - CompileTime: 32921706 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 105734138 - PeakMemoryUsage: 624640 - PrepareTime: 35110220 - TotalTime: 174412665 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 50805009 - GetResultsTime: 0 - HTResizeTime: 15235838833 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186284755072 - PinTime: 0 - ReductionFactorEstimate: 355.68452165586837 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433509036866 - TotalTime: 4028970 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:17/4.16 GB 0:25/6.19 GB 1:33/8.09 GB 5:29/7.14 GB 4:15/3.68 GB 3:35/8.47 GB 2:38/9.29 GB 7:31/7.57 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.043478260869565216 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2471271044 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12734108629 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 65 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 547494107 - PerReadThreadRawHdfsThroughput: 128017455 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 395488247 - RowsReturned: 395362295 - RowsReturnedRate: 64389427 - ScanRangesComplete: 52 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11306922924 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 19304172486 - TotalReadThroughput: 5648542 - TotalTime: 6140174138 Instance c74ce10ea42773c1:8f12f6e900000002 (host=vd1122.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:36/8.58 GB 1:29/7.10 GB 7:21/4.82 GB 3:28/6.90 GB 0:33/7.99 GB 5:29/7.05 GB 6:18/4.42 GB 4:32/7.92 GB - AverageThreadTokens: 13.985409652076319 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192095045747 - PerHostPeakMemUsage: 192105842233 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21149053823 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 130749542 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 127980000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 272374550 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 130751860 - ExecTreeOpenTime: 342123 - PrepareTime: 141539398 - ExecTreePrepareTime: 2606535 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 262359 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3388767 - CompileTime: 32329181 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 97066005 - PeakMemoryUsage: 624640 - PrepareTime: 30733507 - TotalTime: 160720603 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 105440630 - GetResultsTime: 0 - HTResizeTime: 15170192667 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191620958336 - PinTime: 0 - ReductionFactorEstimate: 355.7585045704555 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 443256627751 - TotalTime: 2930075 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:36/8.58 GB 1:29/7.10 GB 7:21/4.82 GB 3:28/6.90 GB 0:33/7.99 GB 5:29/7.05 GB 6:18/4.42 GB 4:32/7.92 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07752808988764046 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2910433667 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12724500768 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 79 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 544409295 - PerReadThreadRawHdfsThroughput: 80678663 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 420676402 - RowsReturned: 420550450 - RowsReturnedRate: 137256613 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13106667891 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 36074391293 - TotalReadThroughput: 6532197 - TotalTime: 3063972212 Instance c74ce10ea42773c1:8f12f6e900000081 (host=vd1114.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:28/6.81 GB 1:28/6.87 GB 3:40/9.73 GB 5:30/7.15 GB 6:22/5.34 GB 4:31/7.59 GB 0:17/4.13 GB 7:29/7.14 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192544521749 - PerHostPeakMemUsage: 192555318235 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14398671426 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 139170390 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 135980000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 272252875 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 139172427 - ExecTreeOpenTime: 316059 - PrepareTime: 132974698 - ExecTreePrepareTime: 3553151 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 328434 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5801982 - CompileTime: 31784745 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 105772869 - PeakMemoryUsage: 624640 - PrepareTime: 41349526 - TotalTime: 179589067 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 43949152 - GetResultsTime: 0 - HTResizeTime: 14443720114 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192070797440 - PinTime: 0 - ReductionFactorEstimate: 355.86878985837285 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445120926675 - TotalTime: 3866191 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:28/6.81 GB 1:28/6.87 GB 3:40/9.73 GB 5:30/7.15 GB 6:22/5.34 GB 4:31/7.59 GB 0:17/4.13 GB 7:29/7.14 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05855855855855856 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2935796426 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10385287099 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 546322400 - PerReadThreadRawHdfsThroughput: 121297181 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 423075950 - RowsReturned: 422949998 - RowsReturnedRate: 147473141 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13448140478 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 24203335926 - TotalReadThroughput: 6612154 - TotalTime: 2867979840 Instance c74ce10ea42773c1:8f12f6e900000042 (host=vd1115.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:35/8.63 GB 2:34/8.37 GB 1:22/5.45 GB 7:21/5.08 GB 6:29/7.18 GB 4:32/7.89 GB 5:24/5.79 GB 3:26/6.27 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195530570962 - PerHostPeakMemUsage: 195541367448 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 29167035755 - TotalThreadsInvoluntaryContextSwitches: 18 - TotalThreadsTotalWallClockTime: 145007850 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 141979000 - TotalThreadsVoluntaryContextSwitches: 31 - TotalTime: 271949941 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 145009850 - ExecTreeOpenTime: 282039 - PrepareTime: 126873485 - ExecTreePrepareTime: 3360823 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 293008 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4811282 - CompileTime: 30677964 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 112699243 - PeakMemoryUsage: 624640 - PrepareTime: 29137443 - TotalTime: 173252074 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 408511599 - GetResultsTime: 0 - HTResizeTime: 14685184912 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195127396480 - PinTime: 0 - ReductionFactorEstimate: 355.9760369494786 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 447483776340 - TotalTime: 3639040 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:35/8.63 GB 2:34/8.37 GB 1:22/5.45 GB 7:21/5.08 GB 6:29/7.18 GB 4:32/7.89 GB 5:24/5.79 GB 3:26/6.27 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08165548098434004 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2952198863 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10707019099 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 546384136 - PerReadThreadRawHdfsThroughput: 85643804 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 439512095 - RowsReturned: 439386143 - RowsReturnedRate: 158205622 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13544082615 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34470664796 - TotalReadThroughput: 6604471 - TotalTime: 2777310535 Instance c74ce10ea42773c1:8f12f6e90000007e (host=vd1109.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:24/5.94 GB 3:30/7.36 GB 1:28/6.67 GB 6:36/8.79 GB 7:29/7.02 GB 4:25/6.12 GB 5:28/6.89 GB 2:25/5.91 GB - AverageThreadTokens: 14.80751708428246 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190616743869 - PerHostPeakMemUsage: 190627540355 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12407286589 - TotalThreadsInvoluntaryContextSwitches: 21 - TotalThreadsTotalWallClockTime: 151145588 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 145978000 - TotalThreadsVoluntaryContextSwitches: 51 - TotalTime: 271461520 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 151148011 - ExecTreeOpenTime: 342723 - PrepareTime: 120233008 - ExecTreePrepareTime: 3187075 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 277522 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3005780 - CompileTime: 48240359 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 101486972 - PeakMemoryUsage: 624640 - PrepareTime: 22736749 - TotalTime: 172931380 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 85435302 - GetResultsTime: 0 - HTResizeTime: 14892894332 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 190408804480 - PinTime: 0 - ReductionFactorEstimate: 355.7737587050519 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439135254261 - TotalTime: 3526668 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:24/5.94 GB 3:30/7.36 GB 1:28/6.67 GB 6:36/8.79 GB 7:29/7.02 GB 4:25/6.12 GB 5:28/6.89 GB 2:25/5.91 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04214123006833713 - AverageScannerThreadConcurrency: 13.80751708428246 - BytesRead: 2614280655 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9752646779 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 553915227 - PerReadThreadRawHdfsThroughput: 143059256 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 415199086 - RowsReturned: 415072110 - RowsReturnedRate: 153346794 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11058980447 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 18274110399 - TotalReadThroughput: 5955081 - TotalTime: 2706754398 Instance c74ce10ea42773c1:8f12f6e90000004c (host=vc1501.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:31/7.55 GB 4:27/6.68 GB 0:24/5.91 GB 1:33/8.00 GB 5:40/9.79 GB 7:19/4.66 GB 2:22/5.40 GB 6:28/6.75 GB - AverageThreadTokens: 14.669724770642201 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199294015368 - PerHostPeakMemUsage: 199304811854 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21061154934 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 127621256 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 5 - TotalTime: 270790344 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 127623269 - ExecTreeOpenTime: 355245 - PrepareTime: 143059771 - ExecTreePrepareTime: 5632375 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 338293 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3263869 - CompileTime: 37744278 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 88621916 - PeakMemoryUsage: 624640 - PrepareTime: 25300779 - TotalTime: 152124080 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 40276177 - GetResultsTime: 0 - HTResizeTime: 15216914543 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 198873958528 - PinTime: 0 - ReductionFactorEstimate: 355.79508268651637 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 432404607835 - TotalTime: 5984333 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:31/7.55 GB 4:27/6.68 GB 0:24/5.91 GB 1:33/8.00 GB 5:40/9.79 GB 7:19/4.66 GB 2:22/5.40 GB 6:28/6.75 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09873708381171067 - AverageScannerThreadConcurrency: 13.685419058553387 - BytesRead: 3094151735 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10024175658 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 82 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 571725478 - PerReadThreadRawHdfsThroughput: 72316614 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 460134895 - RowsReturned: 460007919 - RowsReturnedRate: 157462307 - ScanRangesComplete: 68 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13191302924 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 42786180848 - TotalReadThroughput: 7096678 - TotalTime: 2921384343 Instance c74ce10ea42773c1:8f12f6e90000002b (host=ve1136.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:25/6.07 GB 5:33/8.06 GB 2:27/6.64 GB 4:26/6.35 GB 3:28/6.86 GB 6:40/9.74 GB 0:24/5.90 GB 1:20/4.78 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 204755731658 - PerHostPeakMemUsage: 204766736029 - RowsProduced: 166381 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 48360 - TotalStorageWaitTime: 32133252722 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 131024933 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 126980000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 270771963 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 451523732626 - InactiveTotalTime: 0 - OpenTime: 131026630 - ExecTreeOpenTime: 325635 - PrepareTime: 139616024 - ExecTreePrepareTime: 7012566 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 2604844 - InactiveTotalTime: 0 - NetworkThroughput(*): 127612651 - OverallThroughput: 36259552 - PeakMemoryUsage: 33964152 - RowsReturned: 166180 - SerializeBatchTime: 51067856 - TotalTime: 71838835 - TransmitDataRPCTime: 20412114 - UncompressedRowBatchSize: 31545440 CodeGen - CodegenTime: 5283394 - CompileTime: 37609457 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91841795 - PeakMemoryUsage: 624640 - PrepareTime: 33674317 - TotalTime: 163822097 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 148793825 - GetResultsTime: 0 - HTResizeTime: 14134721287 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 204423276672 - PinTime: 0 - ReductionFactorEstimate: 355.8493106519822 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 166381 - RowsReturned: 166381 - RowsReturnedRate: 368 - StreamingTime: 447548216077 - TotalTime: 451530492675 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:25/6.07 GB 5:33/8.06 GB 2:27/6.64 GB 4:26/6.35 GB 3:28/6.86 GB 6:40/9.74 GB 0:24/5.90 GB 1:20/4.78 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.1013215859030837 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3183390102 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11301238755 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 584336345 - PerReadThreadRawHdfsThroughput: 68530885 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 494766937 - RowsReturned: 494639961 - RowsReturnedRate: 149739655 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14404026408 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 46451903770 - TotalReadThroughput: 7011486 - TotalTime: 3303333113 Instance c74ce10ea42773c1:8f12f6e900000031 (host=vd1103.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:23/5.62 GB 7:27/6.57 GB 0:27/6.64 GB 1:35/8.29 GB 3:22/5.45 GB 6:25/6.01 GB 5:35/8.62 GB 4:31/7.49 GB - AverageThreadTokens: 14.723863636363637 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194256610416 - PerHostPeakMemUsage: 194267406902 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15972993817 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 142235841 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 134980000 - TotalThreadsVoluntaryContextSwitches: 36 - TotalTime: 270123735 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 142238103 - ExecTreeOpenTime: 404833 - PrepareTime: 127649272 - ExecTreePrepareTime: 4148521 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 229532 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3728018 - CompileTime: 41874728 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 99002513 - PeakMemoryUsage: 624640 - PrepareTime: 26109183 - TotalTime: 167496400 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 173943833 - GetResultsTime: 0 - HTResizeTime: 14953126522 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193881688192 - PinTime: 0 - ReductionFactorEstimate: 355.7882136438693 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439528841089 - TotalTime: 4549892 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:23/5.62 GB 7:27/6.57 GB 0:27/6.64 GB 1:35/8.29 GB 3:22/5.45 GB 6:25/6.01 GB 5:35/8.62 GB 4:31/7.49 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06363636363636363 - AverageScannerThreadConcurrency: 13.723863636363637 - BytesRead: 2894944120 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9509389713 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 570630598 - PerReadThreadRawHdfsThroughput: 105449504 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 432693228 - RowsReturned: 432568300 - RowsReturnedRate: 152891861 - ScanRangesComplete: 64 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12010174707 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 27453368726 - TotalReadThroughput: 6386401 - TotalTime: 2829243459 Instance c74ce10ea42773c1:8f12f6e900000049 (host=vd1330.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:22/5.20 GB 2:24/5.94 GB 5:29/7.07 GB 1:34/8.18 GB 4:35/8.43 GB 6:27/6.62 GB 0:30/7.24 GB 3:26/6.27 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192138166154 - PerHostPeakMemUsage: 192150677935 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12540914712 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 135196390 - TotalThreadsSysTime: 6999000 - TotalThreadsUserTime: 127980000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 269942166 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 135198037 - ExecTreeOpenTime: 265351 - PrepareTime: 134659678 - ExecTreePrepareTime: 5588807 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 369975 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6361589 - CompileTime: 31958293 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 101619562 - PeakMemoryUsage: 624640 - PrepareTime: 33704816 - TotalTime: 167976598 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 41676446 - GetResultsTime: 0 - HTResizeTime: 14403506216 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191930288256 - PinTime: 0 - ReductionFactorEstimate: 355.7402249414683 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450553808710 - TotalTime: 5851477 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:22/5.20 GB 2:24/5.94 GB 5:29/7.07 GB 1:34/8.18 GB 4:35/8.43 GB 6:27/6.62 GB 0:30/7.24 GB 3:26/6.27 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05679287305122494 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2654069283 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10081837835 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 591553455 - PerReadThreadRawHdfsThroughput: 108335436 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 422300212 - RowsReturned: 422173236 - RowsReturnedRate: 151027625 - ScanRangesComplete: 57 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12023548894 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 24498625563 - TotalReadThroughput: 5911067 - TotalTime: 2795337835 Instance c74ce10ea42773c1:8f12f6e900000034 (host=vd1125.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:30/7.31 GB 3:22/5.45 GB 4:25/6.15 GB 0:25/6.08 GB 5:31/7.60 GB 7:32/7.84 GB 1:21/5.09 GB 2:38/9.26 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 200633697277 - PerHostPeakMemUsage: 200644493763 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 22925226278 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 117821614 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 114983000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 269851341 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 117823084 - ExecTreeOpenTime: 377101 - PrepareTime: 151905274 - ExecTreePrepareTime: 4707936 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 389080 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4266251 - CompileTime: 33185348 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83259978 - PeakMemoryUsage: 624640 - PrepareTime: 32388984 - TotalTime: 149350816 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 76474828 - GetResultsTime: 0 - HTResizeTime: 15346534854 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 200394393728 - PinTime: 0 - ReductionFactorEstimate: 355.9574292141405 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445359486364 - TotalTime: 5083183 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:30/7.31 GB 3:22/5.45 GB 4:25/6.15 GB 0:25/6.08 GB 5:31/7.60 GB 7:32/7.84 GB 1:21/5.09 GB 2:38/9.26 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0779510022271715 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2995242842 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10283467844 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 79 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 550578524 - PerReadThreadRawHdfsThroughput: 87169667 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 468468369 - RowsReturned: 468342417 - RowsReturnedRate: 157175230 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12945690651 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34361067589 - TotalReadThroughput: 6670919 - TotalTime: 2979746973 Instance c74ce10ea42773c1:8f12f6e900000006 (host=vc1520.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:18/4.41 GB 6:30/7.43 GB 1:37/9.01 GB 0:22/5.42 GB 2:33/7.95 GB 3:32/7.92 GB 5:21/5.13 GB 4:30/7.31 GB - AverageThreadTokens: 14.624429223744292 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 184836713258 - PerHostPeakMemUsage: 184847509744 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 26323145149 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 140616927 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 137980000 - TotalThreadsVoluntaryContextSwitches: 8 - TotalTime: 269718055 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 140619417 - ExecTreeOpenTime: 318548 - PrepareTime: 129035819 - ExecTreePrepareTime: 2910213 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 228731 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3163989 - CompileTime: 42195858 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 97280340 - PeakMemoryUsage: 624640 - PrepareTime: 23948430 - TotalTime: 164003944 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 74497899 - GetResultsTime: 0 - HTResizeTime: 16542713719 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 184510564480 - PinTime: 0 - ReductionFactorEstimate: 355.8348404194461 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 440605185717 - TotalTime: 3225696 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:18/4.41 GB 6:30/7.43 GB 1:37/9.01 GB 0:22/5.42 GB 2:33/7.95 GB 3:32/7.92 GB 5:21/5.13 GB 4:30/7.31 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.12 - AverageScannerThreadConcurrency: 13.64 - BytesRead: 2579879267 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 12536518997 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 69 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 563352090 - PerReadThreadRawHdfsThroughput: 48640716 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 387205364 - RowsReturned: 387078388 - RowsReturnedRate: 133696534 - ScanRangesComplete: 55 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11283437462 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 53039499302 - TotalReadThroughput: 5890135 - TotalTime: 2895201348 Instance c74ce10ea42773c1:8f12f6e900000019 (host=vc1505.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:25/6.14 GB 4:27/6.56 GB 0:30/7.30 GB 5:26/6.19 GB 7:25/6.19 GB 1:32/7.84 GB 3:34/8.26 GB 6:25/6.11 GB - AverageThreadTokens: 13.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 191965904423 - PerHostPeakMemUsage: 191976700909 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14286786110 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 127980632 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 267210086 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 127982129 - ExecTreeOpenTime: 343992 - PrepareTime: 139146782 - ExecTreePrepareTime: 3711678 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 421862 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4072696 - CompileTime: 37885804 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 88643056 - PeakMemoryUsage: 624640 - PrepareTime: 23712278 - TotalTime: 150815818 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36207379 - GetResultsTime: 0 - HTResizeTime: 14229059200 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191677581440 - PinTime: 0 - ReductionFactorEstimate: 355.8195355720883 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 437667684992 - TotalTime: 4053278 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:25/6.14 GB 4:27/6.56 GB 0:30/7.30 GB 5:26/6.19 GB 7:25/6.19 GB 1:32/7.84 GB 3:34/8.26 GB 6:25/6.11 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06071019473081329 - AverageScannerThreadConcurrency: 12.0 - BytesRead: 2757802606 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10211887234 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 496090094 - PerReadThreadRawHdfsThroughput: 105043677 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 421011247 - RowsReturned: 420886319 - RowsReturnedRate: 162731120 - ScanRangesComplete: 61 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12839640103 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26253865741 - TotalReadThroughput: 6315501 - TotalTime: 2586391089 Instance c74ce10ea42773c1:8f12f6e900000069 (host=vc1525.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:30/7.23 GB 6:22/5.40 GB 2:23/5.61 GB 4:33/8.02 GB 5:26/6.31 GB 0:30/7.31 GB 1:26/6.39 GB 3:35/8.55 GB - AverageThreadTokens: 13.898837209302325 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187053431351 - PerHostPeakMemUsage: 187064227837 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18606230905 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 132958815 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 130981000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 267168434 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 132960879 - ExecTreeOpenTime: 284360 - PrepareTime: 134109402 - ExecTreePrepareTime: 2522386 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 271454 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5767510 - CompileTime: 31068275 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 100448355 - PeakMemoryUsage: 624640 - PrepareTime: 39946376 - TotalTime: 172221205 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 75512188 - GetResultsTime: 0 - HTResizeTime: 14744668612 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186787022976 - PinTime: 0 - ReductionFactorEstimate: 355.7093659741488 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 432498879746 - TotalTime: 2804032 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:30/7.23 GB 6:22/5.40 GB 2:23/5.61 GB 4:33/8.02 GB 5:26/6.31 GB 0:30/7.31 GB 1:26/6.39 GB 3:35/8.55 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09534883720930233 - AverageScannerThreadConcurrency: 12.898837209302325 - BytesRead: 2578224281 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9576092696 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 68 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 545371923 - PerReadThreadRawHdfsThroughput: 60358852 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 397934491 - RowsReturned: 397808539 - RowsReturnedRate: 150261675 - ScanRangesComplete: 55 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11480898352 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 42714932094 - TotalReadThroughput: 5992762 - TotalTime: 2647438466 Instance c74ce10ea42773c1:8f12f6e900000016 (host=vc1540.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:25/6.19 GB 6:25/6.12 GB 3:33/8.14 GB 4:24/5.91 GB 7:28/6.93 GB 2:27/6.61 GB 1:32/7.88 GB 0:29/7.06 GB - AverageThreadTokens: 14.649262202043133 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188004558489 - PerHostPeakMemUsage: 188015354975 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 25062415563 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 130021935 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 267117118 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 130023828 - ExecTreeOpenTime: 397864 - PrepareTime: 136993392 - ExecTreePrepareTime: 4225559 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 247857 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3673956 - CompileTime: 39913304 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 88667210 - PeakMemoryUsage: 624640 - PrepareTime: 29215441 - TotalTime: 158299704 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 59155550 - GetResultsTime: 0 - HTResizeTime: 15481333630 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 187716061312 - PinTime: 0 - ReductionFactorEstimate: 355.65724210370047 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436897622394 - TotalTime: 4620868 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:25/6.19 GB 6:25/6.12 GB 3:33/8.14 GB 4:24/5.91 GB 7:28/6.93 GB 2:27/6.61 GB 1:32/7.88 GB 0:29/7.06 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10227272727272728 - AverageScannerThreadConcurrency: 13.664772727272727 - BytesRead: 2629205291 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11086290605 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 69 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 575947815 - PerReadThreadRawHdfsThroughput: 57810264 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 401747916 - RowsReturned: 401620940 - RowsReturnedRate: 63509241 - ScanRangesComplete: 55 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12123296291 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 45479903982 - TotalReadThroughput: 5968426 - TotalTime: 6323818854 Instance c74ce10ea42773c1:8f12f6e900000005 (host=vc1507.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:23/5.61 GB 3:33/8.11 GB 6:32/7.76 GB 4:27/6.68 GB 7:23/5.59 GB 1:27/6.37 GB 2:33/8.09 GB 0:27/6.37 GB - AverageThreadTokens: 14.104966139954854 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 203767642814 - PerHostPeakMemUsage: 203778439300 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 25239015764 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 147017046 - TotalThreadsSysTime: 7999000 - TotalThreadsUserTime: 138979000 - TotalThreadsVoluntaryContextSwitches: 5 - TotalTime: 266699101 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 147020162 - ExecTreeOpenTime: 405452 - PrepareTime: 119595785 - ExecTreePrepareTime: 4945589 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 277275 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3783664 - CompileTime: 42016778 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 103678792 - PeakMemoryUsage: 624640 - PrepareTime: 26712022 - TotalTime: 172910154 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 48674042 - GetResultsTime: 0 - HTResizeTime: 14242430402 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 203497130112 - PinTime: 0 - ReductionFactorEstimate: 355.82951011008583 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439274285392 - TotalTime: 5346989 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:23/5.61 GB 3:33/8.11 GB 6:32/7.76 GB 4:27/6.68 GB 7:23/5.59 GB 1:27/6.37 GB 2:33/8.09 GB 0:27/6.37 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.1367231638418079 - AverageScannerThreadConcurrency: 13.119774011299436 - BytesRead: 3124660076 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11135465089 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 83 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 547493812 - PerReadThreadRawHdfsThroughput: 54447757 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 487885761 - RowsReturned: 487758785 - RowsReturnedRate: 163485334 - ScanRangesComplete: 69 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13913716459 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 57388223106 - TotalReadThroughput: 7053408 - TotalTime: 2983501769 Instance c74ce10ea42773c1:8f12f6e90000004a (host=vd1338.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:25/6.15 GB 1:27/6.38 GB 5:26/6.39 GB 7:26/6.44 GB 0:28/6.77 GB 6:31/7.60 GB 3:28/6.90 GB 4:33/7.76 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189747059683 - PerHostPeakMemUsage: 189759473160 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16991495438 - TotalThreadsInvoluntaryContextSwitches: 19 - TotalThreadsTotalWallClockTime: 156250823 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 151977000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 266112113 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 156253238 - ExecTreeOpenTime: 321570 - PrepareTime: 109798045 - ExecTreePrepareTime: 3708075 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 259888 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4677104 - CompileTime: 37558652 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 116994877 - PeakMemoryUsage: 624640 - PrepareTime: 30863976 - TotalTime: 185940681 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 34334257 - GetResultsTime: 0 - HTResizeTime: 15560825113 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189407414400 - PinTime: 0 - ReductionFactorEstimate: 355.8617876050647 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450111491233 - TotalTime: 4026906 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:25/6.15 GB 1:27/6.38 GB 5:26/6.39 GB 7:26/6.44 GB 0:28/6.77 GB 6:31/7.60 GB 3:28/6.90 GB 4:33/7.76 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.041294642857142856 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2663269995 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9795151340 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 584336180 - PerReadThreadRawHdfsThroughput: 134169350 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 410109823 - RowsReturned: 409983871 - RowsReturnedRate: 131267828 - ScanRangesComplete: 58 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12149327069 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 19850062582 - TotalReadThroughput: 5944799 - TotalTime: 3123262385 Instance c74ce10ea42773c1:8f12f6e900000071 (host=vc1513.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:31/7.60 GB 6:27/6.52 GB 4:31/7.67 GB 0:31/7.60 GB 2:20/4.87 GB 7:28/6.59 GB 3:23/5.69 GB 5:34/8.14 GB - AverageThreadTokens: 13.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192346428141 - PerHostPeakMemUsage: 192357224627 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17679270279 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 134885806 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 128980000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 265968308 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 134887965 - ExecTreeOpenTime: 377539 - PrepareTime: 131019081 - ExecTreePrepareTime: 5090602 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 271846 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3205278 - CompileTime: 40239378 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 93191941 - PeakMemoryUsage: 624640 - PrepareTime: 23947592 - TotalTime: 157805393 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 53217502 - GetResultsTime: 0 - HTResizeTime: 15280764878 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192064505984 - PinTime: 0 - ReductionFactorEstimate: 355.8035573867011 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433586896229 - TotalTime: 5465222 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:31/7.60 GB 6:27/6.52 GB 4:31/7.67 GB 0:31/7.60 GB 2:20/4.87 GB 7:28/6.59 GB 3:23/5.69 GB 5:34/8.14 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07258064516129033 - AverageScannerThreadConcurrency: 12.0 - BytesRead: 2735885481 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9855734374 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 504482364 - PerReadThreadRawHdfsThroughput: 89541380 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 422997329 - RowsReturned: 422872401 - RowsReturnedRate: 152758418 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 15325486793 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 30554426066 - TotalReadThroughput: 6303462 - TotalTime: 2768242857 Instance c74ce10ea42773c1:8f12f6e90000001b (host=vd1336.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:25/6.15 GB 2:40/9.74 GB 0:28/6.77 GB 3:20/4.92 GB 5:21/5.10 GB 7:23/5.54 GB 4:39/9.58 GB 6:28/6.77 GB - AverageThreadTokens: 15.878048780487806 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192348938670 - PerHostPeakMemUsage: 192359943123 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 37268158282 - TotalThreadsInvoluntaryContextSwitches: 21 - TotalThreadsTotalWallClockTime: 160185495 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 156976000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 265903008 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 160187363 - ExecTreeOpenTime: 297986 - PrepareTime: 105671321 - ExecTreePrepareTime: 2170475 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 336943 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4348045 - CompileTime: 38447863 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 120179409 - PeakMemoryUsage: 624640 - PrepareTime: 30438051 - TotalTime: 189657800 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 41651012 - GetResultsTime: 0 - HTResizeTime: 16851742288 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191961745536 - PinTime: 0 - ReductionFactorEstimate: 355.84783371760903 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 448159550818 - TotalTime: 2465679 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:25/6.15 GB 2:40/9.74 GB 0:28/6.77 GB 3:20/4.92 GB 5:21/5.10 GB 7:23/5.54 GB 4:39/9.58 GB 6:28/6.77 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.1286031042128603 - AverageScannerThreadConcurrency: 14.878048780487806 - BytesRead: 2829123219 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13784463405 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 607103947 - PerReadThreadRawHdfsThroughput: 50030950 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 422454999 - RowsReturned: 422326999 - RowsReturnedRate: 133132139 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13084278471 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 56547461230 - TotalReadThroughput: 6270372 - TotalTime: 3172239248 Instance c74ce10ea42773c1:8f12f6e900000052 (host=vc1531.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:33/7.82 GB 4:18/4.46 GB 5:33/8.13 GB 6:28/6.85 GB 1:31/7.49 GB 0:20/4.83 GB 7:26/6.18 GB 3:36/8.77 GB - AverageThreadTokens: 14.103686635944701 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 185498546919 - PerHostPeakMemUsage: 185509343405 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 13044813117 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 126506222 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 124981000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 265387020 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 126508241 - ExecTreeOpenTime: 297661 - PrepareTime: 138803113 - ExecTreePrepareTime: 2675730 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 298951 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4604541 - CompileTime: 30326480 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 94785589 - PeakMemoryUsage: 624640 - PrepareTime: 27744423 - TotalTime: 153538457 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 52651369 - GetResultsTime: 0 - HTResizeTime: 17035498139 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185272879232 - PinTime: 0 - ReductionFactorEstimate: 355.8450112373567 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433036851544 - TotalTime: 2970672 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:33/7.82 GB 4:18/4.46 GB 5:33/8.13 GB 6:28/6.85 GB 1:31/7.49 GB 0:20/4.83 GB 7:26/6.18 GB 3:36/8.77 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07142857142857142 - AverageScannerThreadConcurrency: 13.103686635944701 - BytesRead: 2495844379 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9711780744 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 67 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 547493965 - PerReadThreadRawHdfsThroughput: 85089679 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 390734703 - RowsReturned: 390608751 - RowsReturnedRate: 155821940 - ScanRangesComplete: 53 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11192629239 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 29331928210 - TotalReadThroughput: 5749232 - TotalTime: 2506763495 Instance c74ce10ea42773c1:8f12f6e90000006b (host=vd1326.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:23/5.62 GB 3:26/6.31 GB 6:38/9.21 GB 1:34/8.22 GB 7:22/5.37 GB 4:26/6.39 GB 0:30/7.36 GB 5:25/6.07 GB - AverageThreadTokens: 14.984357541899442 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188766226352 - PerHostPeakMemUsage: 188777022838 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 18368409828 - TotalThreadsInvoluntaryContextSwitches: 22 - TotalThreadsTotalWallClockTime: 153687306 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 148977000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 264694165 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 153689290 - ExecTreeOpenTime: 364835 - PrepareTime: 110925879 - ExecTreePrepareTime: 3103833 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 448313 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4293528 - CompileTime: 42583823 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 109487421 - PeakMemoryUsage: 624640 - PrepareTime: 26767069 - TotalTime: 179392081 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 77619738 - GetResultsTime: 0 - HTResizeTime: 14929856560 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188454258816 - PinTime: 0 - ReductionFactorEstimate: 355.8254165787717 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 444865089959 - TotalTime: 3465710 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:23/5.62 GB 3:26/6.31 GB 6:38/9.21 GB 1:34/8.22 GB 7:22/5.37 GB 4:26/6.39 GB 0:30/7.36 GB 5:25/6.07 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07158836689038031 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2651373481 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9482046828 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 588286156 - PerReadThreadRawHdfsThroughput: 83544971 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 405386993 - RowsReturned: 405260017 - RowsReturnedRate: 135916636 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13726484671 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 31735883624 - TotalReadThroughput: 5924856 - TotalTime: 2981680738 Instance c74ce10ea42773c1:8f12f6e900000076 (host=vc1517.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:26/6.35 GB 7:15/3.63 GB 2:34/8.26 GB 4:25/6.19 GB 3:30/7.43 GB 1:23/5.59 GB 6:36/8.77 GB 5:35/8.58 GB - AverageThreadTokens: 13.985227272727272 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 183421078136 - PerHostPeakMemUsage: 183431874622 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19710378629 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 132423653 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 8 - TotalTime: 264388005 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 132424975 - ExecTreeOpenTime: 342531 - PrepareTime: 131869901 - ExecTreePrepareTime: 3964641 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 234718 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3438935 - CompileTime: 36922052 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 94112447 - PeakMemoryUsage: 624640 - PrepareTime: 27531728 - TotalTime: 159073301 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 175690620 - GetResultsTime: 0 - HTResizeTime: 15171999149 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 183099181184 - PinTime: 0 - ReductionFactorEstimate: 355.7887033081184 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439776890654 - TotalTime: 4304068 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:26/6.35 GB 7:15/3.63 GB 2:34/8.26 GB 4:25/6.19 GB 3:30/7.43 GB 1:23/5.59 GB 6:36/8.77 GB 5:35/8.58 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09670079635949944 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2486109944 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9143801019 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 66 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 542238719 - PerReadThreadRawHdfsThroughput: 61140668 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 380699643 - RowsReturned: 380573691 - RowsReturnedRate: 152520703 - ScanRangesComplete: 53 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11386548109 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 40662132365 - TotalReadThroughput: 5650249 - TotalTime: 2495226437 Instance c74ce10ea42773c1:8f12f6e900000008 (host=va1031.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:32/7.61 GB 5:29/7.11 GB 7:29/7.02 GB 0:39/9.43 GB 2:25/6.19 GB 1:25/6.16 GB 3:29/6.97 GB 4:18/4.27 GB - AverageThreadTokens: 17.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194107859505 - PerHostPeakMemUsage: 194118655991 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 21717343294 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131457900 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 128980000 - TotalThreadsVoluntaryContextSwitches: 10 - TotalTime: 264270558 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131459154 - ExecTreeOpenTime: 251622 - PrepareTime: 132595002 - ExecTreePrepareTime: 5827758 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 742561 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 9161997 - CompileTime: 32977240 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 96833073 - PeakMemoryUsage: 624640 - PrepareTime: 42329067 - TotalTime: 172845327 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 66144932 - GetResultsTime: 0 - HTResizeTime: 14887778122 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193588086912 - PinTime: 0 - ReductionFactorEstimate: 355.8770402505089 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 432592661030 - TotalTime: 6075844 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:32/7.61 GB 5:29/7.11 GB 7:29/7.02 GB 0:39/9.43 GB 2:25/6.19 GB 1:25/6.16 GB 3:29/6.97 GB 4:18/4.27 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10440835266821345 - AverageScannerThreadConcurrency: 16.0 - BytesRead: 3033744713 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 14671657361 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 80 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 669249900 - PerReadThreadRawHdfsThroughput: 66689171 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 431119995 - RowsReturned: 430990971 - RowsReturnedRate: 153328135 - ScanRangesComplete: 64 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13429732206 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 45490814250 - TotalReadThroughput: 7037724 - TotalTime: 2810905963 Instance c74ce10ea42773c1:8f12f6e900000029 (host=vc1536.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:24/5.94 GB 2:35/8.51 GB 1:29/7.14 GB 5:37/9.09 GB 4:24/5.61 GB 7:23/5.58 GB 6:28/6.74 GB 3:25/5.90 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199383648900 - PerHostPeakMemUsage: 199394445386 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19301856347 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 125385589 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 120982000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 264139341 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 125387001 - ExecTreeOpenTime: 402375 - PrepareTime: 138650308 - ExecTreePrepareTime: 6542285 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 284570 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3689363 - CompileTime: 34587522 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 89301142 - PeakMemoryUsage: 624640 - PrepareTime: 27695357 - TotalTime: 152066987 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 452198782 - GetResultsTime: 0 - HTResizeTime: 14964100494 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 199099402368 - PinTime: 0 - ReductionFactorEstimate: 355.84333737060507 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439205777513 - TotalTime: 6942166 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:24/5.94 GB 2:35/8.51 GB 1:29/7.14 GB 5:37/9.09 GB 4:24/5.61 GB 7:23/5.58 GB 6:28/6.74 GB 3:25/5.90 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08239277652370203 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2954776855 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 26529086307 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 556747687 - PerReadThreadRawHdfsThroughput: 78393134 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 461438109 - RowsReturned: 461312157 - RowsReturnedRate: 156178031 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12685717370 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 37691780927 - TotalReadThroughput: 6669097 - TotalTime: 2953758296 Instance c74ce10ea42773c1:8f12f6e900000001 (host=ve1126.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:26/6.36 GB 4:24/5.78 GB 5:31/7.56 GB 2:37/8.96 GB 3:29/7.14 GB 0:18/4.38 GB 1:26/6.12 GB 6:35/8.51 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189381631348 - PerHostPeakMemUsage: 189392427834 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 22841663984 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 126550226 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 125980000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 263895229 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 126551595 - ExecTreeOpenTime: 207794 - PrepareTime: 137251707 - ExecTreePrepareTime: 3626832 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 326249 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3735569 - CompileTime: 30036123 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 95160738 - PeakMemoryUsage: 624640 - PrepareTime: 30265928 - TotalTime: 156130435 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 103353499 - GetResultsTime: 0 - HTResizeTime: 15195457635 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189034121344 - PinTime: 0 - ReductionFactorEstimate: 356.0203034253083 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 447413354192 - TotalTime: 3830421 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:26/6.36 GB 4:24/5.78 GB 5:31/7.56 GB 2:37/8.96 GB 3:29/7.14 GB 0:18/4.38 GB 1:26/6.12 GB 6:35/8.51 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06904231625835189 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2680876434 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9573222171 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 587420854 - PerReadThreadRawHdfsThroughput: 80646276 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 408321657 - RowsReturned: 408194681 - RowsReturnedRate: 144669588 - ScanRangesComplete: 57 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12265706002 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 33242408004 - TotalReadThroughput: 5970771 - TotalTime: 2821565236 Instance c74ce10ea42773c1:8f12f6e90000003f (host=vc1515.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:22/5.37 GB 4:35/8.52 GB 2:19/4.63 GB 1:28/6.77 GB 6:29/7.03 GB 5:30/7.43 GB 7:29/7.09 GB 3:32/7.66 GB - AverageThreadTokens: 14.820250284414106 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189966785479 - PerHostPeakMemUsage: 189977581965 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17448095974 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 142189456 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 131980000 - TotalThreadsVoluntaryContextSwitches: 43 - TotalTime: 263871078 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 142207094 - ExecTreeOpenTime: 431217 - PrepareTime: 121569688 - ExecTreePrepareTime: 4188381 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 281473 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4249824 - CompileTime: 45001562 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 95522613 - PeakMemoryUsage: 624640 - PrepareTime: 28951000 - TotalTime: 170076200 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 46671364 - GetResultsTime: 0 - HTResizeTime: 14692412549 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189724084352 - PinTime: 0 - ReductionFactorEstimate: 355.8343142348576 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439616645635 - TotalTime: 4616037 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:22/5.37 GB 4:35/8.52 GB 2:19/4.63 GB 1:28/6.77 GB 6:29/7.03 GB 5:30/7.43 GB 7:29/7.09 GB 3:32/7.66 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07053469852104664 - AverageScannerThreadConcurrency: 13.820250284414106 - BytesRead: 2639400541 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9896298771 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 596674644 - PerReadThreadRawHdfsThroughput: 92996258 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 411745101 - RowsReturned: 411618125 - RowsReturnedRate: 152711905 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11504804366 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28381792933 - TotalReadThroughput: 6005461 - TotalTime: 2695389885 Instance c74ce10ea42773c1:8f12f6e90000006d (host=va1042.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:27/6.52 GB 2:28/6.86 GB 6:31/7.63 GB 5:23/5.62 GB 3:27/6.48 GB 7:37/9.09 GB 1:28/6.89 GB 0:23/5.58 GB - AverageThreadTokens: 15.935955056179775 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 202331017738 - PerHostPeakMemUsage: 202341814224 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 28121327253 - TotalThreadsInvoluntaryContextSwitches: 8456 - TotalThreadsTotalWallClockTime: 2641697368442 - TotalThreadsSysTime: 1389786000 - TotalThreadsUserTime: 17585323000 - TotalThreadsVoluntaryContextSwitches: 185254 - TotalTime: 263622147 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 129968931 - ExecTreeOpenTime: 177183 - PrepareTime: 133573893 - ExecTreePrepareTime: 3579373 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 654201 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5116702 - CompileTime: 31769962 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 96787741 - PeakMemoryUsage: 624640 - PrepareTime: 30367393 - TotalTime: 159423263 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 43804179 - GetResultsTime: 0 - HTResizeTime: 13856142731 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 202029123712 - PinTime: 0 - ReductionFactorEstimate: 355.8727652878828 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 441281203828 - TotalTime: 3754621 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:27/6.52 GB 2:28/6.86 GB 6:31/7.63 GB 5:23/5.62 GB 3:27/6.48 GB 7:37/9.09 GB 1:28/6.89 GB 0:23/5.58 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.12134831460674157 - AverageScannerThreadConcurrency: 14.935955056179775 - BytesRead: 3149849500 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10902211601 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 609705512 - PerReadThreadRawHdfsThroughput: 59079406 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 478498372 - RowsReturned: 478376516 - RowsReturnedRate: 160919254 - ScanRangesComplete: 75 - ScannerThreadsInvoluntaryContextSwitches: 8441 - ScannerThreadsTotalWallClockTime: 2641567426499 - MaterializeTupleTime(*): 15712607618 - ScannerThreadsSysTime: 1389786000 - ScannerThreadsUserTime: 17456343000 - ScannerThreadsVoluntaryContextSwitches: 185249 - TotalRawHdfsReadTime(*): 53315523492 - TotalReadThroughput: 7077232 - TotalTime: 2972773625 Instance c74ce10ea42773c1:8f12f6e900000072 (host=vd1116.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:30/7.35 GB 1:28/6.85 GB 7:24/5.79 GB 2:31/7.64 GB 5:33/8.05 GB 0:35/8.43 GB 6:25/6.07 GB 4:19/4.70 GB - AverageThreadTokens: 13.985667034178611 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197790044549 - PerHostPeakMemUsage: 197801049002 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 25268096651 - TotalThreadsInvoluntaryContextSwitches: 26 - TotalThreadsTotalWallClockTime: 150817360 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 148978000 - TotalThreadsVoluntaryContextSwitches: 5 - TotalTime: 263168147 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 150819673 - ExecTreeOpenTime: 376899 - PrepareTime: 112296031 - ExecTreePrepareTime: 2524867 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 240591 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3302930 - CompileTime: 34709254 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 114836166 - PeakMemoryUsage: 624640 - PrepareTime: 26604698 - TotalTime: 176609753 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 106702220 - GetResultsTime: 0 - HTResizeTime: 15009014852 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197506615424 - PinTime: 0 - ReductionFactorEstimate: 355.8166062919462 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450386452281 - TotalTime: 2897716 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:30/7.35 GB 1:28/6.85 GB 7:24/5.79 GB 2:31/7.64 GB 5:33/8.05 GB 0:35/8.43 GB 6:25/6.07 GB 4:19/4.70 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09492273730684327 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2946498289 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10467336445 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 548541844 - PerReadThreadRawHdfsThroughput: 72230758 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 452139388 - RowsReturned: 452013436 - RowsReturnedRate: 159004099 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 15048716418 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 40792846946 - TotalReadThroughput: 6497239 - TotalTime: 2842778502 Instance c74ce10ea42773c1:8f12f6e900000009 (host=vd1328.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:22/5.38 GB 6:24/5.78 GB 7:36/8.79 GB 2:28/6.93 GB 1:31/7.48 GB 4:38/9.28 GB 3:24/5.90 GB 0:21/5.20 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194318168656 - PerHostPeakMemUsage: 194328965142 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 13891867001 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 131112500 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 127980000 - TotalThreadsVoluntaryContextSwitches: 7 - TotalTime: 262112645 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131114007 - ExecTreeOpenTime: 251336 - PrepareTime: 130913308 - ExecTreePrepareTime: 4177292 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 312683 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4003918 - CompileTime: 34450258 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 95443418 - PeakMemoryUsage: 624640 - PrepareTime: 28676154 - TotalTime: 159037394 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 60834071 - GetResultsTime: 0 - HTResizeTime: 14301966499 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 194058897536 - PinTime: 0 - ReductionFactorEstimate: 355.824999250661 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 447659420788 - TotalTime: 4426459 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:22/5.38 GB 6:24/5.78 GB 7:36/8.79 GB 2:28/6.93 GB 1:31/7.48 GB 4:38/9.28 GB 3:24/5.90 GB 0:21/5.20 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.060267857142857144 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2811987268 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9717557425 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 74 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 587421088 - PerReadThreadRawHdfsThroughput: 111273021 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 433628941 - RowsReturned: 433501965 - RowsReturnedRate: 182474288 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 10940429448 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 25271060496 - TotalReadThroughput: 6276757 - TotalTime: 2375687936 Instance c74ce10ea42773c1:8f12f6e90000000b (host=ve1141.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:30/7.31 GB 2:24/5.94 GB 4:22/5.41 GB 5:22/5.29 GB 6:27/6.61 GB 7:36/8.76 GB 1:31/7.63 GB 3:32/7.77 GB - AverageThreadTokens: 14.984444444444444 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 200478894304 - PerHostPeakMemUsage: 200489898757 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19459537130 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 131671495 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 262062759 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131672968 - ExecTreeOpenTime: 219406 - PrepareTime: 130289078 - ExecTreePrepareTime: 6618868 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 282304 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4844519 - CompileTime: 35833708 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 94189936 - PeakMemoryUsage: 624640 - PrepareTime: 29759237 - TotalTime: 160400071 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 38898264 - GetResultsTime: 0 - HTResizeTime: 14747322879 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 200030537856 - PinTime: 0 - ReductionFactorEstimate: 355.8949005398592 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 451708870992 - TotalTime: 6836580 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:30/7.31 GB 2:24/5.94 GB 4:22/5.41 GB 5:22/5.29 GB 6:27/6.61 GB 7:36/8.76 GB 1:31/7.63 GB 3:32/7.77 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07230255839822025 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3181092256 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10883549896 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 586311377 - PerReadThreadRawHdfsThroughput: 92701738 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 467037116 - RowsReturned: 466910140 - RowsReturnedRate: 162830543 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14706480220 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34315346231 - TotalReadThroughput: 7069093 - TotalTime: 2867460430 Instance c74ce10ea42773c1:8f12f6e900000012 (host=vd1127.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:25/5.99 GB 1:24/5.86 GB 7:25/6.12 GB 5:26/6.28 GB 2:25/6.04 GB 3:36/8.88 GB 0:35/8.56 GB 4:28/6.82 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192042271381 - PerHostPeakMemUsage: 192053275834 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14443910748 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 118183196 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 115983000 - TotalThreadsVoluntaryContextSwitches: 9 - TotalTime: 261716426 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 118184873 - ExecTreeOpenTime: 351173 - PrepareTime: 143466495 - ExecTreePrepareTime: 4196830 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 255475 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3936363 - CompileTime: 32681992 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 84294790 - PeakMemoryUsage: 624640 - PrepareTime: 31559658 - TotalTime: 149061887 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 40216166 - GetResultsTime: 0 - HTResizeTime: 14569516092 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191595792512 - PinTime: 0 - ReductionFactorEstimate: 355.79810927169507 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 448536886310 - TotalTime: 4546060 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:25/5.99 GB 1:24/5.86 GB 7:25/6.12 GB 5:26/6.28 GB 2:25/6.04 GB 3:36/8.88 GB 0:35/8.56 GB 4:28/6.82 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05803571428571429 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2896315685 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10142601292 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 459246521 - PerReadThreadRawHdfsThroughput: 108263096 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 420592145 - RowsReturned: 420468241 - RowsReturnedRate: 148210014 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13637833835 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26752566450 - TotalReadThroughput: 6464990 - TotalTime: 2836975908 Instance c74ce10ea42773c1:8f12f6e90000005b (host=vd1339.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:24/5.90 GB 3:33/8.13 GB 6:30/7.25 GB 0:31/7.55 GB 5:28/6.81 GB 7:28/6.86 GB 1:25/6.15 GB 2:24/5.91 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190097518614 - PerHostPeakMemUsage: 190108315100 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 23541250288 - TotalThreadsInvoluntaryContextSwitches: 17 - TotalThreadsTotalWallClockTime: 154002610 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 150977000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 261196017 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 154004719 - ExecTreeOpenTime: 342456 - PrepareTime: 107122992 - ExecTreePrepareTime: 2676640 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 309151 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5203336 - CompileTime: 32381219 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 119852792 - PeakMemoryUsage: 624640 - PrepareTime: 31667265 - TotalTime: 184602423 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 32499289 - GetResultsTime: 0 - HTResizeTime: 16400803398 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189802727552 - PinTime: 0 - ReductionFactorEstimate: 355.97588125463153 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 444102055114 - TotalTime: 3015922 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:24/5.90 GB 3:33/8.13 GB 6:30/7.25 GB 0:31/7.55 GB 5:28/6.81 GB 7:28/6.86 GB 1:25/6.15 GB 2:24/5.91 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0703125 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2646946152 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9824000405 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 592480457 - PerReadThreadRawHdfsThroughput: 72894563 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 412112722 - RowsReturned: 411985746 - RowsReturnedRate: 92254986 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12176449894 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 36311982829 - TotalReadThroughput: 5907307 - TotalTime: 4465728768 Instance c74ce10ea42773c1:8f12f6e900000021 (host=vd1130.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:20/4.73 GB 1:24/5.82 GB 6:27/6.50 GB 7:24/5.94 GB 5:27/6.68 GB 2:36/8.87 GB 0:34/8.34 GB 3:32/7.85 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194262509946 - PerHostPeakMemUsage: 194274956191 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 20832586020 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 118450832 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 116982000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 260994064 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 118452485 - ExecTreeOpenTime: 335371 - PrepareTime: 142447611 - ExecTreePrepareTime: 4487232 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 289081 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4369502 - CompileTime: 31791476 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 85135420 - PeakMemoryUsage: 624640 - PrepareTime: 30115375 - TotalTime: 147637286 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 46335255 - GetResultsTime: 0 - HTResizeTime: 15305130495 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193891125376 - PinTime: 0 - ReductionFactorEstimate: 355.732976641916 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450017631632 - TotalTime: 4819410 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:20/4.73 GB 1:24/5.82 GB 6:27/6.50 GB 7:24/5.94 GB 5:27/6.68 GB 2:36/8.87 GB 0:34/8.34 GB 3:32/7.85 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0779510022271715 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2904245129 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10559186869 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 467639867 - PerReadThreadRawHdfsThroughput: 86039261 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 432718775 - RowsReturned: 432594871 - RowsReturnedRate: 161752850 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 18060340025 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 33754882265 - TotalReadThroughput: 6468251 - TotalTime: 2674418849 Instance c74ce10ea42773c1:8f12f6e900000003 (host=vc1537.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:15/3.68 GB 1:27/6.54 GB 5:30/7.36 GB 3:29/7.10 GB 0:30/7.38 GB 7:33/8.07 GB 4:24/5.91 GB 2:35/8.38 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190194230049 - PerHostPeakMemUsage: 190205026535 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 7258062529 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 114401357 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 109983000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 260955912 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 114402551 - ExecTreeOpenTime: 300003 - PrepareTime: 146478958 - ExecTreePrepareTime: 2717346 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 349576 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3433490 - CompileTime: 29667366 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83365864 - PeakMemoryUsage: 624640 - PrepareTime: 29027790 - TotalTime: 142571934 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 78511083 - GetResultsTime: 0 - HTResizeTime: 14701361442 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189944285312 - PinTime: 0 - ReductionFactorEstimate: 355.83549737026243 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 438719711188 - TotalTime: 3015244 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:15/3.68 GB 1:27/6.54 GB 5:30/7.36 GB 3:29/7.10 GB 0:30/7.38 GB 7:33/8.07 GB 4:24/5.91 GB 2:35/8.38 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.03526734926052332 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2675585000 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9661149455 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 460361027 - PerReadThreadRawHdfsThroughput: 175397940 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 412819852 - RowsReturned: 412695948 - RowsReturnedRate: 160744836 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12016159660 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 15254369529 - TotalReadThroughput: 6087792 - TotalTime: 2567397845 Instance c74ce10ea42773c1:8f12f6e900000035 (host=ve1135.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:23/5.62 GB 6:24/5.94 GB 4:23/5.57 GB 1:36/8.79 GB 5:28/6.76 GB 0:35/8.47 GB 7:26/6.24 GB 3:32/7.64 GB - AverageThreadTokens: 14.984632272228321 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197593188808 - PerHostPeakMemUsage: 197605667821 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 22936008798 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 124014697 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 121982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 259406308 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 124016032 - ExecTreeOpenTime: 239873 - PrepareTime: 135310672 - ExecTreePrepareTime: 2756248 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 217564 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4101655 - CompileTime: 30381736 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91993692 - PeakMemoryUsage: 624640 - PrepareTime: 28001330 - TotalTime: 150929730 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 28076502 - GetResultsTime: 0 - HTResizeTime: 15496057350 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197075650688 - PinTime: 0 - ReductionFactorEstimate: 355.8539314023889 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 452935217999 - TotalTime: 2994110 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:23/5.62 GB 6:24/5.94 GB 4:23/5.57 GB 1:36/8.79 GB 5:28/6.76 GB 0:35/8.47 GB 7:26/6.24 GB 3:32/7.64 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.1 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3139451961 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10226330812 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 578100753 - PerReadThreadRawHdfsThroughput: 72168666 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 449657694 - RowsReturned: 449530718 - RowsReturnedRate: 157190202 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14081981151 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 43501593267 - TotalReadThroughput: 6892320 - TotalTime: 2859788397 Instance c74ce10ea42773c1:8f12f6e900000036 (host=va1032.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:32/7.72 GB 5:34/8.38 GB 7:20/4.91 GB 2:20/4.85 GB 6:30/7.26 GB 0:31/7.64 GB 3:30/7.39 GB 1:28/6.72 GB - AverageThreadTokens: 17.00340522133939 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187658771812 - PerHostPeakMemUsage: 187669568298 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17875015540 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 144355510 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 142979000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 258762895 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 144357164 - ExecTreeOpenTime: 289852 - PrepareTime: 114342725 - ExecTreePrepareTime: 2260101 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 273597 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4740299 - CompileTime: 32771849 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 110106174 - PeakMemoryUsage: 624640 - PrepareTime: 30159823 - TotalTime: 173676600 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 167789989 - GetResultsTime: 0 - HTResizeTime: 16852037007 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 187330185344 - PinTime: 0 - ReductionFactorEstimate: 355.8894083066988 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439191750473 - TotalTime: 2547515 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:32/7.72 GB 5:34/8.38 GB 7:20/4.91 GB 2:20/4.85 GB 6:30/7.26 GB 0:31/7.64 GB 3:30/7.39 GB 1:28/6.72 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07613636363636364 - AverageScannerThreadConcurrency: 16.02159090909091 - BytesRead: 2641421063 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9668856311 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 17 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 665238386 - PerReadThreadRawHdfsThroughput: 80933585 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 399928045 - RowsReturned: 399797997 - RowsReturnedRate: 147299998 - ScanRangesComplete: 53 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11038453177 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 32636896531 - TotalReadThroughput: 5996374 - TotalTime: 2714175168 Instance c74ce10ea42773c1:8f12f6e900000018 (host=vc1530.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:31/7.60 GB 6:27/6.57 GB 1:26/6.37 GB 2:26/6.39 GB 4:20/4.80 GB 7:33/7.96 GB 0:31/7.64 GB 5:31/7.47 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186896030870 - PerHostPeakMemUsage: 186906827356 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14029185129 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 123018016 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 120982000 - TotalThreadsVoluntaryContextSwitches: 5 - TotalTime: 258237555 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 123020403 - ExecTreeOpenTime: 308770 - PrepareTime: 135111410 - ExecTreePrepareTime: 3933621 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 309502 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4796511 - CompileTime: 30685352 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 90177479 - PeakMemoryUsage: 624640 - PrepareTime: 28952782 - TotalTime: 150793462 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 47244524 - GetResultsTime: 0 - HTResizeTime: 15390221770 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186716768384 - PinTime: 0 - ReductionFactorEstimate: 355.8699099242438 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436842841410 - TotalTime: 4239171 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:31/7.60 GB 6:27/6.57 GB 1:26/6.37 GB 2:26/6.39 GB 4:20/4.80 GB 7:33/7.96 GB 0:31/7.64 GB 5:31/7.47 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06077981651376147 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2502406534 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9479368643 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 66 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 463445564 - PerReadThreadRawHdfsThroughput: 93890731 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 397597685 - RowsReturned: 397474805 - RowsReturnedRate: 157451871 - ScanRangesComplete: 55 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11450567016 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26652327564 - TotalReadThroughput: 5739464 - TotalTime: 2524420964 Instance c74ce10ea42773c1:8f12f6e90000000e (host=vd1123.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:27/6.53 GB 1:27/6.61 GB 3:28/6.83 GB 5:30/7.26 GB 6:33/7.91 GB 0:25/6.15 GB 4:22/5.41 GB 7:33/8.07 GB - AverageThreadTokens: 13.79082774049217 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190686738350 - PerHostPeakMemUsage: 190697534836 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19013965190 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 121819519 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 119982000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 258126955 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 121821538 - ExecTreeOpenTime: 313138 - PrepareTime: 136243496 - ExecTreePrepareTime: 3846475 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 271331 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4431631 - CompileTime: 30309255 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 90049681 - PeakMemoryUsage: 624640 - PrepareTime: 28178685 - TotalTime: 149215554 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 35022954 - GetResultsTime: 0 - HTResizeTime: 15007563849 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 190123591808 - PinTime: 0 - ReductionFactorEstimate: 355.86971126147375 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445540842448 - TotalTime: 4156370 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:27/6.53 GB 1:27/6.61 GB 3:28/6.83 GB 5:30/7.26 GB 6:33/7.91 GB 0:25/6.15 GB 4:22/5.41 GB 7:33/8.07 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07838745800671892 - AverageScannerThreadConcurrency: 12.80515117581187 - BytesRead: 2947112240 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9874828318 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 595865904 - PerReadThreadRawHdfsThroughput: 81207976 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 413760003 - RowsReturned: 413632003 - RowsReturnedRate: 152908417 - ScanRangesComplete: 63 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13382680783 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 36290920940 - TotalReadThroughput: 6593092 - TotalTime: 2705096362 Instance c74ce10ea42773c1:8f12f6e900000062 (host=vd1340.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:27/6.56 GB 2:30/7.39 GB 3:24/5.80 GB 4:34/8.37 GB 7:34/8.34 GB 5:25/6.11 GB 6:30/7.18 GB 0:21/4.98 GB - AverageThreadTokens: 14.984581497797357 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195484037880 - PerHostPeakMemUsage: 195496582429 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15968770166 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 133418927 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 127981000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 258036061 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 133420468 - ExecTreeOpenTime: 197874 - PrepareTime: 124522362 - ExecTreePrepareTime: 3648928 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 272972 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4978265 - CompileTime: 32087513 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 99835233 - PeakMemoryUsage: 624640 - PrepareTime: 35141371 - TotalTime: 167659385 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 163334539 - GetResultsTime: 0 - HTResizeTime: 14074095866 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195293071488 - PinTime: 0 - ReductionFactorEstimate: 355.832666162425 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 453898094981 - TotalTime: 3844743 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:27/6.56 GB 2:30/7.39 GB 3:24/5.80 GB 4:34/8.37 GB 7:34/8.34 GB 5:25/6.11 GB 6:30/7.18 GB 0:21/4.98 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05733186328555678 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2734155481 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10736493920 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 589395776 - PerReadThreadRawHdfsThroughput: 102824668 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 440376146 - RowsReturned: 440249170 - RowsReturnedRate: 158448994 - ScanRangesComplete: 58 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12109247673 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26590462306 - TotalReadThroughput: 6022368 - TotalTime: 2778491414 Instance c74ce10ea42773c1:8f12f6e900000075 (host=vd1329.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:40/9.82 GB 1:25/5.93 GB 3:18/4.46 GB 0:24/5.87 GB 7:34/8.34 GB 2:32/7.80 GB 5:31/7.64 GB 6:19/4.58 GB - AverageThreadTokens: 14.984461709211987 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194419637557 - PerHostPeakMemUsage: 194430642010 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17085541630 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 135486577 - TotalThreadsSysTime: 5000000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 257909660 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 135488088 - ExecTreeOpenTime: 251101 - PrepareTime: 122291917 - ExecTreePrepareTime: 5072315 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 323792 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 6031195 - CompileTime: 33360231 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 100590540 - PeakMemoryUsage: 624640 - PrepareTime: 34394515 - TotalTime: 168996509 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 37980497 - GetResultsTime: 0 - HTResizeTime: 15773086433 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 194144880768 - PinTime: 0 - ReductionFactorEstimate: 355.8558541030794 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 451792054618 - TotalTime: 5320967 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:40/9.82 GB 1:25/5.93 GB 3:18/4.46 GB 0:24/5.87 GB 7:34/8.34 GB 2:32/7.80 GB 5:31/7.64 GB 6:19/4.58 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07111111111111111 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2836122950 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10259548222 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 588468909 - PerReadThreadRawHdfsThroughput: 91388492 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 434115402 - RowsReturned: 433988426 - RowsReturnedRate: 155940546 - ScanRangesComplete: 61 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 17917020362 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 31033698683 - TotalReadThroughput: 6294829 - TotalTime: 2783037741 Instance c74ce10ea42773c1:8f12f6e900000080 (host=vd1337.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:28/6.87 GB 5:33/7.80 GB 2:31/7.55 GB 6:23/5.61 GB 1:31/7.63 GB 4:23/5.69 GB 3:27/6.65 GB 0:27/6.56 GB - AverageThreadTokens: 15.760644418872268 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 202168682879 - PerHostPeakMemUsage: 202179479365 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 24707676868 - TotalThreadsInvoluntaryContextSwitches: 3983 - TotalThreadsTotalWallClockTime: 1280234676155 - TotalThreadsSysTime: 655899000 - TotalThreadsUserTime: 8304737000 - TotalThreadsVoluntaryContextSwitches: 92758 - TotalTime: 257774901 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 126153427 - ExecTreeOpenTime: 298531 - PrepareTime: 131536985 - ExecTreePrepareTime: 4232533 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 224677 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5587794 - CompileTime: 31630729 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 93014870 - PeakMemoryUsage: 624640 - PrepareTime: 34087838 - TotalTime: 159411581 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 68099764 - GetResultsTime: 0 - HTResizeTime: 13626615114 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 201747056768 - PinTime: 0 - ReductionFactorEstimate: 355.7224398397665 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 431091904892 - TotalTime: 4528510 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:28/6.87 GB 5:33/7.80 GB 2:31/7.55 GB 6:23/5.61 GB 1:31/7.63 GB 4:23/5.69 GB 3:27/6.65 GB 0:27/6.56 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10126582278481013 - AverageScannerThreadConcurrency: 14.760644418872268 - BytesRead: 3223230441 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11831335283 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 86 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 630432611 - PerReadThreadRawHdfsThroughput: 73693116 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 476786829 - RowsReturned: 476661901 - RowsReturnedRate: 150221638 - ScanRangesComplete: 74 - ScannerThreadsInvoluntaryContextSwitches: 3969 - ScannerThreadsTotalWallClockTime: 1280108541494 - MaterializeTupleTime(*): 15396005547 - ScannerThreadsSysTime: 655899000 - ScannerThreadsUserTime: 8178756000 - ScannerThreadsVoluntaryContextSwitches: 92752 - TotalRawHdfsReadTime(*): 43738555254 - TotalReadThroughput: 7413815 - TotalTime: 3173057521 Instance c74ce10ea42773c1:8f12f6e900000045 (host=vd1333.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:36/8.83 GB 0:19/4.64 GB 4:27/6.54 GB 3:24/5.89 GB 6:29/7.14 GB 1:27/6.62 GB 2:30/7.43 GB 7:32/7.64 GB - AverageThreadTokens: 14.98434004474273 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190520531134 - PerHostPeakMemUsage: 190531327620 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12931116426 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 133715855 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 128981000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 257395779 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 133717817 - ExecTreeOpenTime: 307814 - PrepareTime: 123593213 - ExecTreePrepareTime: 4171781 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 251996 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5074507 - CompileTime: 31525744 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 100602246 - PeakMemoryUsage: 624640 - PrepareTime: 35535400 - TotalTime: 168302495 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 1220084834 - GetResultsTime: 0 - HTResizeTime: 15281126262 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 190312335488 - PinTime: 0 - ReductionFactorEstimate: 355.7630658456729 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 443098243476 - TotalTime: 4476086 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:36/8.83 GB 0:19/4.64 GB 4:27/6.54 GB 3:24/5.89 GB 6:29/7.14 GB 1:27/6.62 GB 2:30/7.43 GB 7:32/7.64 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04143337066069429 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2610479091 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9832710555 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 579032190 - PerReadThreadRawHdfsThroughput: 129825475 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 414693851 - RowsReturned: 414566875 - RowsReturnedRate: 57847081 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 15536470623 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 20107602807 - TotalReadThroughput: 5839997 - TotalTime: 7166599637 Instance c74ce10ea42773c1:8f12f6e90000001c (host=vc1535.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:22/5.17 GB 2:31/7.53 GB 4:29/6.88 GB 3:32/7.84 GB 1:19/4.70 GB 0:27/6.41 GB 5:36/8.68 GB 7:31/7.59 GB - AverageThreadTokens: 14.70554272517321 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 185840334054 - PerHostPeakMemUsage: 185851130540 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 13930281369 - TotalThreadsInvoluntaryContextSwitches: 12 - TotalThreadsTotalWallClockTime: 113960164 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 111983000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 256677403 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 113961728 - ExecTreeOpenTime: 282834 - PrepareTime: 142567729 - ExecTreePrepareTime: 3665802 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 434470 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3543463 - CompileTime: 29643446 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83119592 - PeakMemoryUsage: 624640 - PrepareTime: 32462692 - TotalTime: 145723461 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 95671794 - GetResultsTime: 0 - HTResizeTime: 15432560798 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185527683200 - PinTime: 0 - ReductionFactorEstimate: 355.95954824887497 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433843806832 - TotalTime: 3946233 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:22/5.17 GB 2:31/7.53 GB 4:29/6.88 GB 3:32/7.84 GB 1:19/4.70 GB 0:27/6.41 GB 5:36/8.68 GB 7:31/7.59 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06351039260969978 - AverageScannerThreadConcurrency: 13.70554272517321 - BytesRead: 2589068512 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9546417769 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 69 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 548830930 - PerReadThreadRawHdfsThroughput: 101220402 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 391960074 - RowsReturned: 391833098 - RowsReturnedRate: 155126718 - ScanRangesComplete: 55 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11465300567 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 25578524296 - TotalReadThroughput: 5979373 - TotalTime: 2525890456 Instance c74ce10ea42773c1:8f12f6e900000077 (host=ve1138.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:25/6.14 GB 4:27/6.65 GB 7:23/5.62 GB 1:30/7.30 GB 6:27/6.65 GB 2:33/8.09 GB 3:26/6.36 GB 0:32/7.56 GB - AverageThreadTokens: 15.905764966740577 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197352865112 - PerHostPeakMemUsage: 197363869565 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10112883691 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 121464055 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 120982000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 256229579 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 121465253 - ExecTreeOpenTime: 188059 - PrepareTime: 134689950 - ExecTreePrepareTime: 3604260 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 399524 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4147175 - CompileTime: 32002548 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 88067263 - PeakMemoryUsage: 624640 - PrepareTime: 26051935 - TotalTime: 146650762 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 228366242 - GetResultsTime: 0 - HTResizeTime: 13905988333 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197080893568 - PinTime: 0 - ReductionFactorEstimate: 355.86463848206756 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 448230777030 - TotalTime: 3790507 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:25/6.14 GB 4:27/6.65 GB 7:23/5.62 GB 1:30/7.30 GB 6:27/6.65 GB 2:33/8.09 GB 3:26/6.36 GB 0:32/7.56 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.03991130820399113 - AverageScannerThreadConcurrency: 14.905764966740577 - BytesRead: 2881486230 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10359326117 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 590903866 - PerReadThreadRawHdfsThroughput: 175692369 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 449724105 - RowsReturned: 449596105 - RowsReturnedRate: 142825107 - ScanRangesComplete: 61 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12922232352 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 16400747759 - TotalReadThroughput: 6389104 - TotalTime: 3147878641 Instance c74ce10ea42773c1:8f12f6e900000004 (host=va1038.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:23/5.40 GB 7:31/7.60 GB 4:24/5.91 GB 6:21/5.16 GB 3:32/7.92 GB 2:36/8.83 GB 5:33/8.05 GB 1:24/5.82 GB - AverageThreadTokens: 15.983031674208144 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195437141400 - PerHostPeakMemUsage: 195447937886 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19094094521 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 136888931 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 132980000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 255558105 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 136891174 - ExecTreeOpenTime: 323613 - PrepareTime: 118598564 - ExecTreePrepareTime: 3626561 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 280858 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5827317 - CompileTime: 32359131 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 103124083 - PeakMemoryUsage: 624640 - PrepareTime: 33700508 - TotalTime: 169844984 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 343540899 - GetResultsTime: 0 - HTResizeTime: 14948514191 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195095939200 - PinTime: 0 - ReductionFactorEstimate: 355.8299682978953 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 438685831673 - TotalTime: 3947373 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 0:23/5.40 GB 7:31/7.60 GB 4:24/5.91 GB 6:21/5.16 GB 3:32/7.92 GB 2:36/8.83 GB 5:33/8.05 GB 1:24/5.82 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07814269535673839 - AverageScannerThreadConcurrency: 15.0 - BytesRead: 2845221365 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10389266159 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 629322840 - PerReadThreadRawHdfsThroughput: 83388206 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 439299498 - RowsReturned: 439171498 - RowsReturnedRate: 173582955 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12711047268 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34120188960 - TotalReadThroughput: 6437152 - TotalTime: 2530038135 Instance c74ce10ea42773c1:8f12f6e90000002d (host=vd1101.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:26/6.40 GB 2:21/5.16 GB 4:21/5.20 GB 6:26/6.44 GB 3:25/6.08 GB 7:31/7.61 GB 5:29/7.18 GB 0:44/10.77 GB - AverageThreadTokens: 14.098850574712644 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192277082580 - PerHostPeakMemUsage: 192287879066 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14148859500 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 129429175 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 122981000 - TotalThreadsVoluntaryContextSwitches: 5 - TotalTime: 255195666 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 129431613 - ExecTreeOpenTime: 338961 - PrepareTime: 125695822 - ExecTreePrepareTime: 4784541 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 219628 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3236537 - CompileTime: 42548937 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 85556338 - PeakMemoryUsage: 624640 - PrepareTime: 17362847 - TotalTime: 145881549 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 50253864 - GetResultsTime: 0 - HTResizeTime: 14614285581 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191747836032 - PinTime: 0 - ReductionFactorEstimate: 355.8314495733688 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433713368326 - TotalTime: 5120591 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:26/6.40 GB 2:21/5.16 GB 4:21/5.20 GB 6:26/6.44 GB 3:25/6.08 GB 7:31/7.61 GB 5:29/7.18 GB 0:44/10.77 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05638665132336018 - AverageScannerThreadConcurrency: 13.113924050632912 - BytesRead: 2988991391 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9854073535 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 79 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 561965835 - PerReadThreadRawHdfsThroughput: 112884049 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 421333384 - RowsReturned: 421216648 - RowsReturnedRate: 160295377 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 16215956080 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 26478420971 - TotalReadThroughput: 6871244 - TotalTime: 2627752926 Instance c74ce10ea42773c1:8f12f6e900000032 (host=vd1139.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:26/6.34 GB 0:28/6.81 GB 7:30/7.31 GB 1:19/4.70 GB 2:34/8.23 GB 4:32/7.81 GB 5:28/6.86 GB 3:28/6.65 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 192505901414 - PerHostPeakMemUsage: 192518216587 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12323117290 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 123246826 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 120982000 - TotalThreadsVoluntaryContextSwitches: 32 - TotalTime: 255063425 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 123248581 - ExecTreeOpenTime: 358865 - PrepareTime: 131734820 - ExecTreePrepareTime: 6186282 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 278374 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3133866 - CompileTime: 38365584 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83745754 - PeakMemoryUsage: 624640 - PrepareTime: 27631443 - TotalTime: 150204728 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 45333737 - GetResultsTime: 0 - HTResizeTime: 14840869155 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 192116934784 - PinTime: 0 - ReductionFactorEstimate: 355.9045061703834 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 453433360874 - TotalTime: 6541899 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:26/6.34 GB 0:28/6.81 GB 7:30/7.31 GB 1:19/4.70 GB 2:34/8.23 GB 4:32/7.81 GB 5:28/6.86 GB 3:28/6.65 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05414364640883978 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2875403179 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10213809723 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 433366450 - PerReadThreadRawHdfsThroughput: 132792215 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 423313520 - RowsReturned: 423189616 - RowsReturnedRate: 154017848 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13440739656 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 21653401603 - TotalReadThroughput: 6354482 - TotalTime: 2747666062 Instance c74ce10ea42773c1:8f12f6e90000004f (host=vc1532.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:31/7.67 GB 1:33/8.09 GB 0:27/6.40 GB 2:23/5.62 GB 3:24/5.86 GB 7:30/7.43 GB 4:23/5.47 GB 6:32/7.84 GB - AverageThreadTokens: 14.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 184968947648 - PerHostPeakMemUsage: 184979744134 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10542863553 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 118747425 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 114982000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 254990762 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 118749310 - ExecTreeOpenTime: 317177 - PrepareTime: 136185050 - ExecTreePrepareTime: 3475421 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 284255 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5750073 - CompileTime: 30146401 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 86913953 - PeakMemoryUsage: 624640 - PrepareTime: 30506373 - TotalTime: 148362941 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 45566108 - GetResultsTime: 0 - HTResizeTime: 15988537655 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 184749639808 - PinTime: 0 - ReductionFactorEstimate: 355.7504115431441 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 441906251028 - TotalTime: 3789305 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:31/7.67 GB 1:33/8.09 GB 0:27/6.40 GB 2:23/5.62 GB 3:24/5.86 GB 7:30/7.43 GB 4:23/5.47 GB 6:32/7.84 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07037457434733257 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2472456059 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9148070488 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 65 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 546384239 - PerReadThreadRawHdfsThroughput: 83901665 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 388276795 - RowsReturned: 388150843 - RowsReturnedRate: 160165807 - ScanRangesComplete: 52 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 10773019834 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 29468497981 - TotalReadThroughput: 5612801 - TotalTime: 2423435546 Instance c74ce10ea42773c1:8f12f6e900000059 (host=vc1533.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:18/4.37 GB 1:25/6.12 GB 6:30/7.35 GB 3:33/8.08 GB 4:34/8.32 GB 0:28/6.93 GB 5:32/7.85 GB 7:23/5.58 GB - AverageThreadTokens: 13.645856980703746 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190429650905 - PerHostPeakMemUsage: 190440447391 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14979477019 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 120787966 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 119981000 - TotalThreadsVoluntaryContextSwitches: 8 - TotalTime: 254822439 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 120789491 - ExecTreeOpenTime: 327074 - PrepareTime: 133951296 - ExecTreePrepareTime: 3605943 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 236339 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5140313 - CompileTime: 29767025 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 89594395 - PeakMemoryUsage: 624640 - PrepareTime: 32412969 - TotalTime: 152358693 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 43890505 - GetResultsTime: 0 - HTResizeTime: 14638238783 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189919119488 - PinTime: 0 - ReductionFactorEstimate: 355.8296689115192 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439620603192 - TotalTime: 3929602 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:18/4.37 GB 1:25/6.12 GB 6:30/7.35 GB 3:33/8.08 GB 4:34/8.32 GB 0:28/6.93 GB 5:32/7.85 GB 7:23/5.58 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.060158910329171394 - AverageScannerThreadConcurrency: 12.645856980703746 - BytesRead: 2879471569 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9734126664 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 541128923 - PerReadThreadRawHdfsThroughput: 102714003 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 412696967 - RowsReturned: 412571015 - RowsReturnedRate: 153694171 - ScanRangesComplete: 63 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13021789332 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28033875331 - TotalReadThroughput: 6536825 - TotalTime: 2684363449 Instance c74ce10ea42773c1:8f12f6e90000007b (host=vc1529.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:30/7.34 GB 1:19/4.66 GB 5:24/5.90 GB 2:23/5.66 GB 6:30/7.38 GB 4:33/8.06 GB 0:35/8.32 GB 7:31/7.60 GB - AverageThreadTokens: 12.986332574031891 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 193354643085 - PerHostPeakMemUsage: 193365439571 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 13657314550 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 134502056 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 132979000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 253938732 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 134504070 - ExecTreeOpenTime: 294435 - PrepareTime: 119354550 - ExecTreePrepareTime: 2689078 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 259771 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5141586 - CompileTime: 29960426 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 102837595 - PeakMemoryUsage: 624640 - PrepareTime: 35354776 - TotalTime: 168695281 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 40047836 - GetResultsTime: 0 - HTResizeTime: 16106009657 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193139296384 - PinTime: 0 - ReductionFactorEstimate: 355.8035665516134 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 440887504258 - TotalTime: 2980720 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:30/7.34 GB 1:19/4.66 GB 5:24/5.90 GB 2:23/5.66 GB 6:30/7.38 GB 4:33/8.06 GB 0:35/8.32 GB 7:31/7.60 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07525655644241733 - AverageScannerThreadConcurrency: 12.0 - BytesRead: 2698091400 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9914710508 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 502262894 - PerReadThreadRawHdfsThroughput: 86613399 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 428675377 - RowsReturned: 428550449 - RowsReturnedRate: 167575684 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11883414930 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 31150969847 - TotalReadThroughput: 6145994 - TotalTime: 2557354615 Instance c74ce10ea42773c1:8f12f6e90000005a (host=vd1335.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:24/5.91 GB 3:26/6.39 GB 1:23/5.69 GB 7:25/6.11 GB 4:26/6.37 GB 6:34/8.38 GB 2:31/7.53 GB 0:33/7.97 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 191482708627 - PerHostPeakMemUsage: 191493713080 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14849731670 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 126827675 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 123981000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 253192464 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 126829598 - ExecTreeOpenTime: 314940 - PrepareTime: 126286504 - ExecTreePrepareTime: 2250146 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 268396 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3666608 - CompileTime: 31865887 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 93554121 - PeakMemoryUsage: 624640 - PrepareTime: 28288208 - TotalTime: 154227762 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 205860946 - GetResultsTime: 0 - HTResizeTime: 14645941726 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191279122560 - PinTime: 0 - ReductionFactorEstimate: 355.9026438290321 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 452353005310 - TotalTime: 2562477 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:24/5.91 GB 3:26/6.39 GB 1:23/5.69 GB 7:25/6.11 GB 4:26/6.37 GB 6:34/8.38 GB 2:31/7.53 GB 0:33/7.97 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04415011037527594 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2644423477 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10125996559 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 581251943 - PerReadThreadRawHdfsThroughput: 113116999 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 419660919 - RowsReturned: 419533943 - RowsReturnedRate: 146791264 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12051142626 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 23377772514 - TotalReadThroughput: 5837579 - TotalTime: 2858030712 Instance c74ce10ea42773c1:8f12f6e900000013 (host=va1034.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:21/5.16 GB 0:27/6.57 GB 3:23/5.61 GB 1:29/7.14 GB 4:31/7.60 GB 5:23/5.69 GB 7:38/9.33 GB 6:31/7.64 GB - AverageThreadTokens: 16.98173515981735 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 182762474664 - PerHostPeakMemUsage: 182773271150 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 20977035981 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 142192264 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 140978000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 253001634 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 142194826 - ExecTreeOpenTime: 335659 - PrepareTime: 110730792 - ExecTreePrepareTime: 4093967 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 279120 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4329506 - CompileTime: 34712996 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 106137278 - PeakMemoryUsage: 624640 - PrepareTime: 32265519 - TotalTime: 173743901 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 89722362 - GetResultsTime: 0 - HTResizeTime: 16278383674 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 182506735744 - PinTime: 0 - ReductionFactorEstimate: 355.7936236579137 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 438051655859 - TotalTime: 4426434 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:21/5.16 GB 0:27/6.57 GB 3:23/5.61 GB 1:29/7.14 GB 4:31/7.60 GB 5:23/5.69 GB 7:38/9.33 GB 6:31/7.64 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07542857142857143 - AverageScannerThreadConcurrency: 16.0 - BytesRead: 2444646055 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9403307470 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 64 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 664190267 - PerReadThreadRawHdfsThroughput: 71323216 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 378633572 - RowsReturned: 378504548 - RowsReturnedRate: 149839856 - ScanRangesComplete: 48 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 10615514239 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34275600307 - TotalReadThroughput: 5578721 - TotalTime: 2526060533 Instance c74ce10ea42773c1:8f12f6e900000053 (host=vc1508.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:31/7.54 GB 3:23/5.61 GB 6:26/6.23 GB 0:37/8.72 GB 2:27/6.68 GB 5:28/6.86 GB 1:34/8.03 GB 7:22/5.37 GB - AverageThreadTokens: 14.647326507394768 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190923956157 - PerHostPeakMemUsage: 190934752643 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10608657510 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 139931776 - TotalThreadsSysTime: 8999000 - TotalThreadsUserTime: 130980000 - TotalThreadsVoluntaryContextSwitches: 11 - TotalTime: 252770347 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 139934260 - ExecTreeOpenTime: 364639 - PrepareTime: 112737465 - ExecTreePrepareTime: 3471926 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 227812 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3868412 - CompileTime: 45619583 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 92941846 - PeakMemoryUsage: 624640 - PrepareTime: 28797781 - TotalTime: 167845113 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 52224596 - GetResultsTime: 0 - HTResizeTime: 15133527831 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 190631102592 - PinTime: 0 - ReductionFactorEstimate: 355.8335054749465 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 435539826526 - TotalTime: 3832948 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:31/7.54 GB 3:23/5.61 GB 6:26/6.23 GB 0:37/8.72 GB 2:27/6.68 GB 5:28/6.86 GB 1:34/8.03 GB 7:22/5.37 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04783599088838269 - AverageScannerThreadConcurrency: 13.662870159453304 - BytesRead: 2700052180 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9690328183 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 564523516 - PerReadThreadRawHdfsThroughput: 121925700 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 416292013 - RowsReturned: 416166061 - RowsReturnedRate: 53750719 - ScanRangesComplete: 59 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11667862574 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 22145061795 - TotalReadThroughput: 6123902 - TotalTime: 7742520705 Instance c74ce10ea42773c1:8f12f6e900000074 (host=vc1509.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:28/6.78 GB 0:30/7.32 GB 2:25/6.04 GB 1:29/7.10 GB 6:31/7.67 GB 4:34/7.97 GB 7:30/7.07 GB 3:19/4.64 GB - AverageThreadTokens: 13.984866123399302 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187082483576 - PerHostPeakMemUsage: 187093280062 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 9613465215 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 121634476 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 121981000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 252356122 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 121636340 - ExecTreeOpenTime: 366651 - PrepareTime: 130664278 - ExecTreePrepareTime: 3376334 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 261860 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3485429 - CompileTime: 34751646 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 85612858 - PeakMemoryUsage: 624640 - PrepareTime: 26418592 - TotalTime: 147247424 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 80332802 - GetResultsTime: 0 - HTResizeTime: 14090703200 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186804848768 - PinTime: 0 - ReductionFactorEstimate: 355.80911543623944 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433031446190 - TotalTime: 3740151 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:28/6.78 GB 0:30/7.32 GB 2:25/6.04 GB 1:29/7.10 GB 6:31/7.67 GB 4:34/7.97 GB 7:30/7.07 GB 3:19/4.64 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04195804195804196 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2573248840 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9630570404 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 69 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 541324662 - PerReadThreadRawHdfsThroughput: 140154184 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 398025616 - RowsReturned: 397899664 - RowsReturnedRate: 169768229 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11639672127 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 18360128584 - TotalReadThroughput: 5990903 - TotalTime: 2343781672 Instance c74ce10ea42773c1:8f12f6e90000002f (host=ve1132.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:25/6.11 GB 5:22/5.21 GB 1:29/7.10 GB 6:34/8.38 GB 0:26/6.36 GB 3:23/5.49 GB 2:41/9.98 GB 4:25/6.18 GB - AverageThreadTokens: 16.62962962962963 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199915812299 - PerHostPeakMemUsage: 199926608785 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 22495301799 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 129184202 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 121981000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 251749827 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 129185668 - ExecTreeOpenTime: 362661 - PrepareTime: 122483381 - ExecTreePrepareTime: 5081563 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 308380 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5192862 - CompileTime: 35014773 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 92653921 - PeakMemoryUsage: 624640 - PrepareTime: 29871833 - TotalTime: 158094671 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 37278864 - GetResultsTime: 0 - HTResizeTime: 13705479976 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 199603767424 - PinTime: 0 - ReductionFactorEstimate: 355.90236416897534 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 446377809023 - TotalTime: 5440381 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:25/6.11 GB 5:22/5.21 GB 1:29/7.10 GB 6:34/8.38 GB 0:26/6.36 GB 3:23/5.49 GB 2:41/9.98 GB 4:25/6.18 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10337078651685393 - AverageScannerThreadConcurrency: 15.647191011235956 - BytesRead: 3002377714 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13604052383 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 80 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 679613308 - PerReadThreadRawHdfsThroughput: 65467163 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 464486041 - RowsReturned: 464357017 - RowsReturnedRate: 157186924 - ScanRangesComplete: 64 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12772682533 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 45860818464 - TotalReadThroughput: 6739343 - TotalTime: 2954170765 Instance c74ce10ea42773c1:8f12f6e900000066 (host=ve1131.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:20/4.92 GB 3:28/6.93 GB 2:30/7.26 GB 1:30/7.32 GB 5:27/6.65 GB 4:30/7.34 GB 0:27/6.56 GB 7:33/7.74 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195726163946 - PerHostPeakMemUsage: 195738610191 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 25385066124 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131939061 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 127981000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 249963515 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131940607 - ExecTreeOpenTime: 242764 - PrepareTime: 117953990 - ExecTreePrepareTime: 3645230 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 400545 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4907987 - CompileTime: 33097437 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 97320155 - PeakMemoryUsage: 624640 - PrepareTime: 29854651 - TotalTime: 160929569 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 140126467 - GetResultsTime: 0 - HTResizeTime: 14543094691 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195467135104 - PinTime: 0 - ReductionFactorEstimate: 355.8974294037602 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 454385999509 - TotalTime: 3885380 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:20/4.92 GB 3:28/6.93 GB 2:30/7.26 GB 1:30/7.32 GB 5:27/6.65 GB 4:30/7.34 GB 0:27/6.56 GB 7:33/7.74 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0891089108910891 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2817457087 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13917153834 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 586061640 - PerReadThreadRawHdfsThroughput: 72735150 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 441394040 - RowsReturned: 441267064 - RowsReturnedRate: 148765870 - ScanRangesComplete: 62 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12460174565 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38735839304 - TotalReadThroughput: 6199025 - TotalTime: 2966184802 Instance c74ce10ea42773c1:8f12f6e900000070 (host=vd1120.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:29/7.18 GB 1:27/6.57 GB 7:23/5.55 GB 6:27/6.52 GB 3:30/7.19 GB 2:32/7.83 GB 5:30/7.11 GB 0:28/6.75 GB - AverageThreadTokens: 13.985294117647058 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194102544155 - PerHostPeakMemUsage: 194113340641 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 23183858470 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 135645310 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 134979000 - TotalThreadsVoluntaryContextSwitches: 4 - TotalTime: 249648683 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 135647368 - ExecTreeOpenTime: 327102 - PrepareTime: 113937448 - ExecTreePrepareTime: 2893143 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 282413 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3782174 - CompileTime: 32305035 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 102036258 - PeakMemoryUsage: 624640 - PrepareTime: 31688781 - TotalTime: 166736112 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 550235671 - GetResultsTime: 0 - HTResizeTime: 14080434005 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193733838976 - PinTime: 0 - ReductionFactorEstimate: 355.8944051816952 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 441515884935 - TotalTime: 3216822 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:29/7.18 GB 1:27/6.57 GB 7:23/5.55 GB 6:27/6.52 GB 3:30/7.19 GB 2:32/7.83 GB 5:30/7.11 GB 0:28/6.75 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.09173272933182333 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2902794009 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10181009887 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 535155349 - PerReadThreadRawHdfsThroughput: 66798985 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 431952655 - RowsReturned: 431826703 - RowsReturnedRate: 155371454 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12923178182 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 43455660050 - TotalReadThroughput: 6567407 - TotalTime: 2779318150 Instance c74ce10ea42773c1:8f12f6e90000001f (host=ve1128.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:23/5.60 GB 1:30/7.20 GB 7:21/5.09 GB 2:25/6.16 GB 5:26/6.36 GB 6:28/6.81 GB 4:37/9.12 GB 0:33/8.09 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188482696595 - PerHostPeakMemUsage: 188493701048 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15257831230 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 125222068 - TotalThreadsSysTime: 5999000 - TotalThreadsUserTime: 118982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 249481719 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 125223770 - ExecTreeOpenTime: 258836 - PrepareTime: 124156648 - ExecTreePrepareTime: 4003166 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 351270 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4510403 - CompileTime: 31452088 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 92036278 - PeakMemoryUsage: 624640 - PrepareTime: 31498070 - TotalTime: 155628438 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 302273027 - GetResultsTime: 0 - HTResizeTime: 15280772410 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188170094720 - PinTime: 0 - ReductionFactorEstimate: 355.86593969420505 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445840319524 - TotalTime: 4260077 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:23/5.60 GB 1:30/7.20 GB 7:21/5.09 GB 2:25/6.16 GB 5:26/6.36 GB 6:28/6.81 GB 4:37/9.12 GB 0:33/8.09 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.060066740823136816 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2641084437 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9532518034 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 581007170 - PerReadThreadRawHdfsThroughput: 95325692 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 404003860 - RowsReturned: 403876884 - RowsReturnedRate: 62389065 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11343583212 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 27705903513 - TotalReadThroughput: 5875604 - TotalTime: 6473520373 Instance c74ce10ea42773c1:8f12f6e900000043 (host=vd1131.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:28/6.85 GB 6:24/5.83 GB 5:21/5.11 GB 3:25/6.15 GB 1:32/7.89 GB 7:27/6.65 GB 4:40/9.85 GB 0:26/6.28 GB - AverageThreadTokens: 12.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197009034673 - PerHostPeakMemUsage: 197021415382 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14330510809 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 113399373 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 111983000 - TotalThreadsVoluntaryContextSwitches: 17 - TotalTime: 248160627 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 113400358 - ExecTreeOpenTime: 280511 - PrepareTime: 134690090 - ExecTreePrepareTime: 3167996 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 260250 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3504479 - CompileTime: 28592492 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83235096 - PeakMemoryUsage: 624640 - PrepareTime: 28145043 - TotalTime: 140521887 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 145065405 - GetResultsTime: 0 - HTResizeTime: 14766192958 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 196690823296 - PinTime: 0 - ReductionFactorEstimate: 355.9112663677434 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 454553670022 - TotalTime: 3446457 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:28/6.85 GB 6:24/5.83 GB 5:21/5.11 GB 3:25/6.15 GB 1:32/7.89 GB 7:27/6.65 GB 4:40/9.85 GB 0:26/6.28 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05263157894736842 - AverageScannerThreadConcurrency: 11.0 - BytesRead: 2927430307 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9843726892 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 77 - NumScannerThreadsStarted: 11 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 464555338 - PerReadThreadRawHdfsThroughput: 115035687 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 447507023 - RowsReturned: 447383119 - RowsReturnedRate: 157213449 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12914048126 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 25448018526 - TotalReadThroughput: 6419803 - TotalTime: 2845705130 Instance c74ce10ea42773c1:8f12f6e90000003e (host=vc1524.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:28/6.81 GB 1:32/7.68 GB 7:32/7.89 GB 4:18/4.46 GB 6:30/7.34 GB 2:27/6.46 GB 0:30/7.33 GB 5:28/6.69 GB - AverageThreadTokens: 13.985108820160367 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190018524136 - PerHostPeakMemUsage: 190029320622 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 13710161965 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 135130667 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 14 - TotalTime: 247959057 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 135133704 - ExecTreeOpenTime: 413081 - PrepareTime: 112718870 - ExecTreePrepareTime: 4181040 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 295077 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3512931 - CompileTime: 42702629 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91114173 - PeakMemoryUsage: 624640 - PrepareTime: 29843741 - TotalTime: 164115357 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 22803202 - GetResultsTime: 0 - HTResizeTime: 14171022820 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189578332288 - PinTime: 0 - ReductionFactorEstimate: 355.94744056496194 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436562588273 - TotalTime: 4591272 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:28/6.81 GB 1:32/7.68 GB 7:32/7.89 GB 4:18/4.46 GB 6:30/7.34 GB 2:27/6.46 GB 0:30/7.33 GB 5:28/6.69 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07339449541284404 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2812136692 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9852998071 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 540010007 - PerReadThreadRawHdfsThroughput: 90772685 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 411002864 - RowsReturned: 410877936 - RowsReturnedRate: 150266076 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13212167811 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 30979987945 - TotalReadThroughput: 6180841 - TotalTime: 2734335949 Instance c74ce10ea42773c1:8f12f6e900000011 (host=vc1538.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:20/4.95 GB 0:21/5.20 GB 3:27/6.65 GB 4:31/7.44 GB 6:30/7.34 GB 7:29/7.05 GB 1:37/8.86 GB 2:30/7.34 GB - AverageThreadTokens: 13.985057471264367 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187869235932 - PerHostPeakMemUsage: 187880032418 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14441383695 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 113128770 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 107984000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 247871772 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 113130144 - ExecTreeOpenTime: 344890 - PrepareTime: 134596437 - ExecTreePrepareTime: 5807528 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 308513 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3833156 - CompileTime: 31264175 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 80703733 - PeakMemoryUsage: 624640 - PrepareTime: 28007877 - TotalTime: 140492194 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 42372459 - GetResultsTime: 0 - HTResizeTime: 15207710451 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 187664681088 - PinTime: 0 - ReductionFactorEstimate: 355.7504846857749 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 434809705148 - TotalTime: 6150181 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:20/4.95 GB 0:21/5.20 GB 3:27/6.65 GB 4:31/7.44 GB 6:30/7.34 GB 7:29/7.05 GB 1:37/8.86 GB 2:30/7.34 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05753739930955121 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2537771307 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9646178698 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 67 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 549468833 - PerReadThreadRawHdfsThroughput: 89168887 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 401520947 - RowsReturned: 401394995 - RowsReturnedRate: 159655442 - ScanRangesComplete: 54 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 10931060317 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28460277845 - TotalReadThroughput: 5833957 - TotalTime: 2514132865 Instance c74ce10ea42773c1:8f12f6e900000054 (host=ve1127.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:31/7.60 GB 7:30/7.20 GB 2:24/5.90 GB 0:34/8.30 GB 1:27/6.49 GB 3:27/6.50 GB 5:28/6.80 GB 4:24/5.73 GB - AverageThreadTokens: 15.017977528089888 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188717817371 - PerHostPeakMemUsage: 188728613857 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 11241336187 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 125118933 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 122981000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 247588826 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 125120178 - ExecTreeOpenTime: 205281 - PrepareTime: 122339993 - ExecTreePrepareTime: 4939367 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 344694 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4806203 - CompileTime: 31470070 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91923617 - PeakMemoryUsage: 624640 - PrepareTime: 33225278 - TotalTime: 157384959 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 27026521 - GetResultsTime: 0 - HTResizeTime: 15070197843 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188406024320 - PinTime: 0 - ReductionFactorEstimate: 355.8047602987046 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 446272299148 - TotalTime: 5142744 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:31/7.60 GB 7:30/7.20 GB 2:24/5.90 GB 0:34/8.30 GB 1:27/6.49 GB 3:27/6.50 GB 5:28/6.80 GB 4:24/5.73 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.043820224719101124 - AverageScannerThreadConcurrency: 14.017977528089888 - BytesRead: 2653254213 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9418472955 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 586311104 - PerReadThreadRawHdfsThroughput: 132956701 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 405153713 - RowsReturned: 405025713 - RowsReturnedRate: 150402754 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11310226709 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 19955776468 - TotalReadThroughput: 5962369 - TotalTime: 2692940789 Instance c74ce10ea42773c1:8f12f6e90000003a (host=va1043.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:23/5.64 GB 5:29/7.14 GB 3:20/4.86 GB 2:32/7.81 GB 1:26/6.24 GB 0:29/7.03 GB 4:39/9.45 GB 6:26/6.33 GB - AverageThreadTokens: 15.982837528604119 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 193382785391 - PerHostPeakMemUsage: 193393581877 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14810242183 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 131753912 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 131980000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 246561027 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 131755861 - ExecTreeOpenTime: 306600 - PrepareTime: 114742705 - ExecTreePrepareTime: 3328613 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 263611 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3918914 - CompileTime: 33431996 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 97056263 - PeakMemoryUsage: 624640 - PrepareTime: 33791988 - TotalTime: 164845762 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 83932412 - GetResultsTime: 0 - HTResizeTime: 15899443983 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193070090368 - PinTime: 0 - ReductionFactorEstimate: 355.7462752618468 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433830687353 - TotalTime: 3632078 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:23/5.64 GB 5:29/7.14 GB 3:20/4.86 GB 2:32/7.81 GB 1:26/6.24 GB 0:29/7.03 GB 4:39/9.45 GB 6:26/6.33 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07903780068728522 - AverageScannerThreadConcurrency: 15.0 - BytesRead: 2795412423 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 11796196325 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 623745325 - PerReadThreadRawHdfsThroughput: 88706897 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 428311176 - RowsReturned: 428183176 - RowsReturnedRate: 160298332 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12274448148 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 31512909387 - TotalReadThroughput: 6396824 - TotalTime: 2671164256 Instance c74ce10ea42773c1:8f12f6e90000004d (host=vd1334.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:24/5.79 GB 2:28/6.89 GB 0:30/7.27 GB 5:27/6.57 GB 6:29/7.11 GB 7:28/6.77 GB 4:30/7.30 GB 1:29/7.06 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 195410306801 - PerHostPeakMemUsage: 195421311254 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14433795456 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 133771650 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 21 - TotalTime: 246153378 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 133773162 - ExecTreeOpenTime: 265855 - PrepareTime: 112304520 - ExecTreePrepareTime: 2729044 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 279279 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3603107 - CompileTime: 34038286 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 98204280 - PeakMemoryUsage: 624640 - PrepareTime: 27712162 - TotalTime: 160521941 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 33204755 - GetResultsTime: 0 - HTResizeTime: 15738176605 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 195130542208 - PinTime: 0 - ReductionFactorEstimate: 355.89724698891416 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 452885943868 - TotalTime: 2992649 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:24/5.79 GB 2:28/6.89 GB 0:30/7.27 GB 5:27/6.57 GB 6:29/7.11 GB 7:28/6.77 GB 4:30/7.30 GB 1:29/7.06 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.058305830583058306 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2834284934 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10321049840 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 584336420 - PerReadThreadRawHdfsThroughput: 116742209 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 439433309 - RowsReturned: 439306333 - RowsReturnedRate: 146372278 - ScanRangesComplete: 61 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12273003285 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 24278150545 - TotalReadThroughput: 6236050 - TotalTime: 3001294627 Instance c74ce10ea42773c1:8f12f6e90000005f (host=va1036.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:26/6.35 GB 2:22/5.36 GB 1:29/7.08 GB 4:24/5.83 GB 5:33/8.06 GB 3:27/6.56 GB 0:33/7.93 GB 7:33/7.70 GB - AverageThreadTokens: 17.852064220183486 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197993841539 - PerHostPeakMemUsage: 198004638025 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 46339444047 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 128419639 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 126981000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 244820697 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 128420675 - ExecTreeOpenTime: 212387 - PrepareTime: 116337789 - ExecTreePrepareTime: 2789193 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 309407 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3912898 - CompileTime: 31139334 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 95934267 - PeakMemoryUsage: 624640 - PrepareTime: 29603562 - TotalTime: 157302588 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 32663623 - GetResultsTime: 0 - HTResizeTime: 17153713145 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197390223488 - PinTime: 0 - ReductionFactorEstimate: 355.75571950872086 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 435391586202 - TotalTime: 2999205 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:26/6.35 GB 2:22/5.36 GB 1:29/7.08 GB 4:24/5.83 GB 5:33/8.06 GB 3:27/6.56 GB 0:33/7.93 GB 7:33/7.70 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.13892078071182548 - AverageScannerThreadConcurrency: 16.871412169919633 - BytesRead: 3172703066 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10527969380 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 17 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 697642149 - PerReadThreadRawHdfsThroughput: 52580516 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 451414481 - RowsReturned: 451284433 - RowsReturnedRate: 162815508 - ScanRangesComplete: 67 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13110326803 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 60339899376 - TotalReadThroughput: 7276157 - TotalTime: 2771753357 Instance c74ce10ea42773c1:8f12f6e900000065 (host=va1033.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:27/6.61 GB 7:36/8.83 GB 2:29/7.10 GB 0:23/5.69 GB 1:30/7.32 GB 5:20/4.91 GB 4:34/8.34 GB 3:24/5.59 GB - AverageThreadTokens: 17.642528735632183 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188366408607 - PerHostPeakMemUsage: 188377205093 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16732032161 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 133461368 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 243381211 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 133462544 - ExecTreeOpenTime: 188486 - PrepareTime: 109845645 - ExecTreePrepareTime: 3813278 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 275564 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4961642 - CompileTime: 30916987 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 101005811 - PeakMemoryUsage: 624640 - PrepareTime: 32423366 - TotalTime: 164865078 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 31793442 - GetResultsTime: 0 - HTResizeTime: 14641867336 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188065237120 - PinTime: 0 - ReductionFactorEstimate: 355.93053126867943 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436053981974 - TotalTime: 3999541 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:27/6.61 GB 7:36/8.83 GB 2:29/7.10 GB 0:23/5.69 GB 1:30/7.32 GB 5:20/4.91 GB 4:34/8.34 GB 3:24/5.59 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06789413118527042 - AverageScannerThreadConcurrency: 16.66168009205984 - BytesRead: 2567350641 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9952154679 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 69 - NumScannerThreadsStarted: 17 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 688289780 - PerReadThreadRawHdfsThroughput: 91353878 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 403522866 - RowsReturned: 403394866 - RowsReturnedRate: 96800013 - ScanRangesComplete: 52 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 10768629921 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28103356771 - TotalReadThroughput: 5901408 - TotalTime: 4167301741 Instance c74ce10ea42773c1:8f12f6e900000017 (host=va1037.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:19/4.67 GB 1:23/5.49 GB 5:28/6.81 GB 0:41/10.04 GB 2:25/6.03 GB 3:28/6.85 GB 4:24/5.83 GB 6:39/9.00 GB - AverageThreadTokens: 16.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 186069980493 - PerHostPeakMemUsage: 186080776979 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 20027038986 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 139307783 - TotalThreadsSysTime: 4000000 - TotalThreadsUserTime: 134979000 - TotalThreadsVoluntaryContextSwitches: 6 - TotalTime: 243290140 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 139310283 - ExecTreeOpenTime: 545701 - PrepareTime: 103926323 - ExecTreePrepareTime: 3596982 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 263828 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4924208 - CompileTime: 30756849 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 107076116 - PeakMemoryUsage: 624640 - PrepareTime: 28937156 - TotalTime: 167424009 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 48207043 - GetResultsTime: 0 - HTResizeTime: 19629034573 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185500420224 - PinTime: 0 - ReductionFactorEstimate: 355.8411027065778 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439493432125 - TotalTime: 4138728 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:19/4.67 GB 1:23/5.49 GB 5:28/6.81 GB 0:41/10.04 GB 2:25/6.03 GB 3:28/6.85 GB 4:24/5.83 GB 6:39/9.00 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07411630558722919 - AverageScannerThreadConcurrency: 15.0 - BytesRead: 2821380122 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9634261872 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 633517307 - PerReadThreadRawHdfsThroughput: 85862192 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 391793853 - RowsReturned: 391665853 - RowsReturnedRate: 174455916 - ScanRangesComplete: 61 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12792928555 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 32859399881 - TotalReadThroughput: 6434015 - TotalTime: 2245070619 Instance c74ce10ea42773c1:8f12f6e900000064 (host=vd1341.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:28/6.85 GB 4:22/5.41 GB 2:33/8.07 GB 7:29/7.14 GB 6:34/8.35 GB 0:24/5.69 GB 5:26/6.17 GB 3:29/7.10 GB - AverageThreadTokens: 14.984375 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194048453175 - PerHostPeakMemUsage: 194059249661 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 20766705095 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 126247976 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 124981000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 242269297 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 126249113 - ExecTreeOpenTime: 211100 - PrepareTime: 115939174 - ExecTreePrepareTime: 3879628 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 275891 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 5046606 - CompileTime: 30795231 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 93858399 - PeakMemoryUsage: 624640 - PrepareTime: 32754855 - TotalTime: 158013120 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 28501604 - GetResultsTime: 0 - HTResizeTime: 16079935441 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193692944512 - PinTime: 0 - ReductionFactorEstimate: 355.85348966370435 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445586046913 - TotalTime: 4089129 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:28/6.85 GB 4:22/5.41 GB 2:33/8.07 GB 7:29/7.14 GB 6:34/8.35 GB 0:24/5.69 GB 5:26/6.17 GB 3:29/7.10 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07486033519553073 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2853108635 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9848327359 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 76 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 575996424 - PerReadThreadRawHdfsThroughput: 83095588 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 431677671 - RowsReturned: 431550695 - RowsReturnedRate: 157893065 - ScanRangesComplete: 62 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12431669708 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 34335259788 - TotalReadThroughput: 6302982 - TotalTime: 2733183326 Instance c74ce10ea42773c1:8f12f6e90000006f (host=ve1142.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:26/6.37 GB 4:21/5.09 GB 0:28/6.90 GB 5:30/7.39 GB 3:28/6.75 GB 6:32/7.75 GB 1:32/7.81 GB 7:27/6.50 GB - AverageThreadTokens: 14.984234234234235 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197336885550 - PerHostPeakMemUsage: 197347682036 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 25362420550 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 122208885 - TotalThreadsSysTime: 2000000 - TotalThreadsUserTime: 119982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 241617048 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 122210243 - ExecTreeOpenTime: 290808 - PrepareTime: 119316731 - ExecTreePrepareTime: 5117610 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 262856 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3646912 - CompileTime: 34019048 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 87016234 - PeakMemoryUsage: 624640 - PrepareTime: 25465587 - TotalTime: 147019139 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 55719313 - GetResultsTime: 0 - HTResizeTime: 15028190609 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 196787292288 - PinTime: 0 - ReductionFactorEstimate: 355.83528193661806 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 445521652881 - TotalTime: 5405656 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:26/6.37 GB 4:21/5.09 GB 0:28/6.90 GB 5:30/7.39 GB 3:28/6.75 GB 6:32/7.75 GB 1:32/7.81 GB 7:27/6.50 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0834272829763247 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3169980088 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10156792946 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 584336233 - PerReadThreadRawHdfsThroughput: 83495172 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 448031789 - RowsReturned: 447904813 - RowsReturnedRate: 154664765 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14137078173 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 37966028564 - TotalReadThroughput: 7139594 - TotalTime: 2895971881 Instance c74ce10ea42773c1:8f12f6e900000025 (host=va1045.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:25/6.07 GB 4:15/3.71 GB 5:34/8.05 GB 6:23/5.63 GB 1:37/9.06 GB 2:39/9.46 GB 0:31/7.45 GB 3:23/5.41 GB - AverageThreadTokens: 16.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 185785951145 - PerHostPeakMemUsage: 185796747631 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 26652383534 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 125999760 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 240804717 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 126000741 - ExecTreeOpenTime: 266085 - PrepareTime: 114729357 - ExecTreePrepareTime: 3724514 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 324164 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4302075 - CompileTime: 33325444 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91218072 - PeakMemoryUsage: 624640 - PrepareTime: 31209138 - TotalTime: 156282943 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 36101775 - GetResultsTime: 0 - HTResizeTime: 15625025464 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185234081920 - PinTime: 0 - ReductionFactorEstimate: 355.9546573767854 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 440157240058 - TotalTime: 3988764 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:25/6.07 GB 4:15/3.71 GB 5:34/8.05 GB 6:23/5.63 GB 1:37/9.06 GB 2:39/9.46 GB 0:31/7.45 GB 3:23/5.41 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.13522727272727272 - AverageScannerThreadConcurrency: 15.0 - BytesRead: 2815268473 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9990418136 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 75 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 629206177 - PerReadThreadRawHdfsThroughput: 49969589 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 390561938 - RowsReturned: 390434962 - RowsReturnedRate: 165656898 - ScanRangesComplete: 60 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12381455972 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 56339635310 - TotalReadThroughput: 6397886 - TotalTime: 2356889238 Instance c74ce10ea42773c1:8f12f6e90000005e (host=va1029.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:25/6.11 GB 5:31/7.56 GB 7:30/7.04 GB 1:30/7.22 GB 3:28/6.86 GB 0:26/6.39 GB 6:25/6.07 GB 4:32/7.59 GB - AverageThreadTokens: 17.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 193752984226 - PerHostPeakMemUsage: 193763780712 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17833616940 - TotalThreadsInvoluntaryContextSwitches: 19 - TotalThreadsTotalWallClockTime: 141903236 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 137979000 - TotalThreadsVoluntaryContextSwitches: 42 - TotalTime: 240074309 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 141904308 - ExecTreeOpenTime: 194861 - PrepareTime: 98072524 - ExecTreePrepareTime: 3545914 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 350186 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4488540 - CompileTime: 35530519 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 104211976 - PeakMemoryUsage: 624640 - PrepareTime: 31264800 - TotalTime: 171614026 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 27423454 - GetResultsTime: 0 - HTResizeTime: 14466885147 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 193261979776 - PinTime: 0 - ReductionFactorEstimate: 355.6229577856429 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 431773472577 - TotalTime: 3738811 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:25/6.11 GB 5:31/7.56 GB 7:30/7.04 GB 1:30/7.22 GB 3:28/6.86 GB 0:26/6.39 GB 6:25/6.07 GB 4:32/7.59 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08266360505166476 - AverageScannerThreadConcurrency: 16.0 - BytesRead: 3010678467 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10316731288 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 80 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 662149069 - PerReadThreadRawHdfsThroughput: 96794296 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 429298621 - RowsReturned: 429170621 - RowsReturnedRate: 77896389 - ScanRangesComplete: 64 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13512132924 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 31103883011 - TotalReadThroughput: 6913153 - TotalTime: 5509505957 Instance c74ce10ea42773c1:8f12f6e900000068 (host=ve1140.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:24/5.91 GB 3:31/7.56 GB 1:26/6.40 GB 2:32/7.76 GB 4:26/6.27 GB 7:33/8.03 GB 5:28/6.84 GB 0:24/5.87 GB - AverageThreadTokens: 14.984598459845985 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 198315389721 - PerHostPeakMemUsage: 198328063269 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15191552675 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 119855881 - TotalThreadsSysTime: 1999000 - TotalThreadsUserTime: 116982000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 238590152 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 119857361 - ExecTreeOpenTime: 185503 - PrepareTime: 118647210 - ExecTreePrepareTime: 3860970 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 266852 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4480820 - CompileTime: 30147603 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 88312171 - PeakMemoryUsage: 624640 - PrepareTime: 28389088 - TotalTime: 147341332 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 35559969 - GetResultsTime: 0 - HTResizeTime: 14722466815 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197804411008 - PinTime: 0 - ReductionFactorEstimate: 355.7553152284094 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 454482651089 - TotalTime: 4044284 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:24/5.91 GB 3:31/7.56 GB 1:26/6.40 GB 2:32/7.76 GB 4:26/6.27 GB 7:33/8.03 GB 5:28/6.84 GB 0:24/5.87 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.0671806167400881 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3157276191 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10866133171 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 572757603 - PerReadThreadRawHdfsThroughput: 108933053 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 453837337 - RowsReturned: 453710361 - RowsReturnedRate: 179164667 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14309607291 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 28983638008 - TotalReadThroughput: 6946702 - TotalTime: 2532365159 Instance c74ce10ea42773c1:8f12f6e900000056 (host=ve1137.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:24/5.84 GB 7:30/7.30 GB 6:27/6.57 GB 5:30/7.43 GB 1:30/7.31 GB 3:29/7.09 GB 2:27/6.61 GB 0:28/6.78 GB - AverageThreadTokens: 15.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 200796490970 - PerHostPeakMemUsage: 200807495423 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 32987062190 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 129871498 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 129981000 - TotalThreadsVoluntaryContextSwitches: 2 - TotalTime: 237889274 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 129872708 - ExecTreeOpenTime: 305356 - PrepareTime: 107949630 - ExecTreePrepareTime: 4478422 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 337863 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4346925 - CompileTime: 34538125 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 93863625 - PeakMemoryUsage: 624640 - PrepareTime: 29904025 - TotalTime: 158839095 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 26721546 - GetResultsTime: 0 - HTResizeTime: 14717903202 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 200371325056 - PinTime: 0 - ReductionFactorEstimate: 355.7830830714123 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 449472983000 - TotalTime: 4781540 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:24/5.84 GB 7:30/7.30 GB 6:27/6.57 GB 5:30/7.43 GB 1:30/7.31 GB 3:29/7.09 GB 2:27/6.61 GB 0:28/6.78 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.10825892857142858 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3155977635 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10812090283 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 575947739 - PerReadThreadRawHdfsThroughput: 58645498 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 468270290 - RowsReturned: 468143314 - RowsReturnedRate: 152795922 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14697031922 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 53814490371 - TotalReadThroughput: 7044592 - TotalTime: 3063846903 Instance c74ce10ea42773c1:8f12f6e900000041 (host=vd1331.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:25/6.07 GB 2:20/4.95 GB 1:25/6.11 GB 7:33/8.07 GB 6:32/7.75 GB 0:28/6.65 GB 5:36/8.66 GB 4:27/6.52 GB - AverageThreadTokens: 15.889012208657048 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 190052545054 - PerHostPeakMemUsage: 190064958531 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 12818757372 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 128976697 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 124981000 - TotalThreadsVoluntaryContextSwitches: 12 - TotalTime: 237463232 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 128978099 - ExecTreeOpenTime: 277257 - PrepareTime: 108409063 - ExecTreePrepareTime: 4646687 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 283510 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3692846 - CompileTime: 36081865 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91303818 - PeakMemoryUsage: 624640 - PrepareTime: 25884468 - TotalTime: 153768725 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 33519652 - GetResultsTime: 0 - HTResizeTime: 15109174307 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189641246848 - PinTime: 0 - ReductionFactorEstimate: 355.8677488730297 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 446477869237 - TotalTime: 4921878 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:25/6.07 GB 2:20/4.95 GB 1:25/6.11 GB 7:33/8.07 GB 6:32/7.75 GB 0:28/6.65 GB 5:36/8.66 GB 4:27/6.52 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.03666666666666667 - AverageScannerThreadConcurrency: 14.905555555555555 - BytesRead: 2773027058 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10052960049 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 74 - NumScannerThreadsStarted: 15 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 605310904 - PerReadThreadRawHdfsThroughput: 155469460 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 411320367 - RowsReturned: 411192367 - RowsReturnedRate: 70237288 - ScanRangesComplete: 59 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12494698303 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 17836474478 - TotalReadThroughput: 6155442 - TotalTime: 5854331468 Instance c74ce10ea42773c1:8f12f6e900000047 (host=vc1541.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:35/8.51 GB 3:25/6.16 GB 0:28/6.86 GB 1:26/6.36 GB 6:24/5.89 GB 5:23/5.66 GB 2:32/7.68 GB 7:32/7.57 GB - AverageThreadTokens: 13.98491879350348 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189116675299 - PerHostPeakMemUsage: 189127471785 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 10317133747 - TotalThreadsInvoluntaryContextSwitches: 12 - TotalThreadsTotalWallClockTime: 111673963 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 108984000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 236861830 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 111675395 - ExecTreeOpenTime: 327476 - PrepareTime: 125106138 - ExecTreePrepareTime: 2704672 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 297910 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 2970436 - CompileTime: 28927646 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 81630713 - PeakMemoryUsage: 624640 - PrepareTime: 23062417 - TotalTime: 134006965 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 95564065 - GetResultsTime: 0 - HTResizeTime: 15674104158 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188805531776 - PinTime: 0 - ReductionFactorEstimate: 355.86830039324377 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433957251721 - TotalTime: 3029675 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:35/8.51 GB 3:25/6.16 GB 0:28/6.86 GB 1:26/6.36 GB 6:24/5.89 GB 5:23/5.66 GB 2:32/7.68 GB 7:32/7.57 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04413472706155633 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2677077123 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9360742091 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 72 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 535806930 - PerReadThreadRawHdfsThroughput: 141582784 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 407168317 - RowsReturned: 407042365 - RowsReturnedRate: 158468047 - ScanRangesComplete: 59 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11893594460 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 18908210674 - TotalReadThroughput: 6211315 - TotalTime: 2568608445 Instance c74ce10ea42773c1:8f12f6e90000000d (host=ve1130.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:19/4.63 GB 4:31/7.42 GB 6:25/5.98 GB 3:30/7.38 GB 5:30/7.23 GB 0:28/6.89 GB 1:25/6.11 GB 7:38/9.24 GB - AverageThreadTokens: 14.984427141268077 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199605125889 - PerHostPeakMemUsage: 199615922375 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 19637077549 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 124655847 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 119982000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 233343197 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 124656847 - ExecTreeOpenTime: 154292 - PrepareTime: 108606759 - ExecTreePrepareTime: 2932607 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 381060 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4240332 - CompileTime: 30437642 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 92719491 - PeakMemoryUsage: 624640 - PrepareTime: 30928514 - TotalTime: 154682514 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 35380846 - GetResultsTime: 0 - HTResizeTime: 15272212904 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 199128762496 - PinTime: 0 - ReductionFactorEstimate: 355.8310252677691 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 446154725507 - TotalTime: 3084903 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:19/4.63 GB 4:31/7.42 GB 6:25/5.98 GB 3:30/7.38 GB 5:30/7.23 GB 0:28/6.89 GB 1:25/6.11 GB 7:38/9.24 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08351893095768374 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 3163869470 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 17509937025 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 84 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 574837979 - PerReadThreadRawHdfsThroughput: 82429759 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 461650717 - RowsReturned: 461524765 - RowsReturnedRate: 142545696 - ScanRangesComplete: 70 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 14873317186 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38382611804 - TotalReadThroughput: 7038641 - TotalTime: 3237732014 Instance c74ce10ea42773c1:8f12f6e90000001d (host=vc1510.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 3:24/5.82 GB 7:39/9.58 GB 6:30/7.23 GB 2:27/6.56 GB 1:35/8.59 GB 5:23/5.62 GB 0:25/5.92 GB 4:22/5.34 GB - AverageThreadTokens: 13.98512585812357 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 194578488078 - PerHostPeakMemUsage: 194589284564 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 17754444809 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 119278137 - TotalThreadsSysTime: 2999000 - TotalThreadsUserTime: 114982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 233309736 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 119279880 - ExecTreeOpenTime: 356953 - PrepareTime: 113953477 - ExecTreePrepareTime: 2275823 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 275503 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 2916811 - CompileTime: 34951324 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 83217966 - PeakMemoryUsage: 624640 - PrepareTime: 23979453 - TotalTime: 142581099 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 77437788 - GetResultsTime: 0 - HTResizeTime: 13807037512 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 194172143744 - PinTime: 0 - ReductionFactorEstimate: 356.0280482549833 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 435542300961 - TotalTime: 2629785 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 3:24/5.82 GB 7:39/9.58 GB 6:30/7.23 GB 2:27/6.56 GB 1:35/8.59 GB 5:23/5.62 GB 0:25/5.92 GB 4:22/5.34 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.08018327605956473 - AverageScannerThreadConcurrency: 13.0 - BytesRead: 2936385167 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10243300131 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 13 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 549062933 - PerReadThreadRawHdfsThroughput: 75749165 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 434261372 - RowsReturned: 434135420 - RowsReturnedRate: 160843603 - ScanRangesComplete: 65 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 13524588529 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 38764587779 - TotalReadThroughput: 6719416 - TotalTime: 2699115237 Instance c74ce10ea42773c1:8f12f6e900000030 (host=va1046.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 1:23/5.61 GB 6:21/4.94 GB 0:35/8.62 GB 5:26/6.36 GB 3:29/6.91 GB 7:26/6.35 GB 2:36/8.83 GB 4:29/7.07 GB - AverageThreadTokens: 17.81691772885284 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 189440461028 - PerHostPeakMemUsage: 189451257514 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 16566464005 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 123108078 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 122982000 - TotalThreadsVoluntaryContextSwitches: 3 - TotalTime: 232680862 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 123109087 - ExecTreeOpenTime: 155222 - PrepareTime: 109492300 - ExecTreePrepareTime: 2303704 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 347377 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4003473 - CompileTime: 30909793 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 90654334 - PeakMemoryUsage: 624640 - PrepareTime: 28513115 - TotalTime: 150582568 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 38112040 - GetResultsTime: 0 - HTResizeTime: 14487646800 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 189068724352 - PinTime: 0 - ReductionFactorEstimate: 355.7422134602131 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 434010884217 - TotalTime: 2457255 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 1:23/5.61 GB 6:21/4.94 GB 0:35/8.62 GB 5:26/6.36 GB 3:29/6.91 GB 7:26/6.35 GB 2:36/8.83 GB 4:29/7.07 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06025492468134415 - AverageScannerThreadConcurrency: 16.81691772885284 - BytesRead: 2697645135 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9898396568 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 73 - NumScannerThreadsStarted: 17 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 667939331 - PerReadThreadRawHdfsThroughput: 99751564 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 408424529 - RowsReturned: 408294481 - RowsReturnedRate: 154077068 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11158708355 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 27043637280 - TotalReadThroughput: 6251263 - TotalTime: 2649936715 Instance c74ce10ea42773c1:8f12f6e90000006a (host=va1030.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:31/7.52 GB 7:28/6.89 GB 5:26/6.39 GB 3:22/5.36 GB 4:29/7.11 GB 0:31/7.55 GB 6:26/6.13 GB 1:32/7.92 GB - AverageThreadTokens: 16.98165137614679 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187114345043 - PerHostPeakMemUsage: 187125141529 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 9614554284 - TotalThreadsInvoluntaryContextSwitches: 16 - TotalThreadsTotalWallClockTime: 132534627 - TotalThreadsSysTime: 3000000 - TotalThreadsUserTime: 129980000 - TotalThreadsVoluntaryContextSwitches: 5 - TotalTime: 231431988 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 132536231 - ExecTreeOpenTime: 212587 - PrepareTime: 98817627 - ExecTreePrepareTime: 2687412 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 282458 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4347296 - CompileTime: 31664788 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 99291952 - PeakMemoryUsage: 624640 - PrepareTime: 30772765 - TotalTime: 162393296 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 28535123 - GetResultsTime: 0 - HTResizeTime: 15306306200 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186857277568 - PinTime: 0 - ReductionFactorEstimate: 355.8841192732113 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 436061300680 - TotalTime: 2898126 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:31/7.52 GB 7:28/6.89 GB 5:26/6.39 GB 3:22/5.36 GB 4:29/7.11 GB 0:31/7.55 GB 6:26/6.13 GB 1:32/7.92 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.04477611940298507 - AverageScannerThreadConcurrency: 16.0 - BytesRead: 2564824485 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9705049489 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 68 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 670359678 - PerReadThreadRawHdfsThroughput: 126489876 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 398306595 - RowsReturned: 398177571 - RowsReturnedRate: 151043106 - ScanRangesComplete: 52 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 10532338981 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 20276915100 - TotalReadThroughput: 5881694 - TotalTime: 2636184999 Instance c74ce10ea42773c1:8f12f6e90000003b (host=va1039.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:34/8.19 GB 2:29/7.02 GB 7:24/5.88 GB 4:26/6.44 GB 0:25/6.00 GB 3:30/7.14 GB 6:34/8.38 GB 1:24/5.82 GB - AverageThreadTokens: 17.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199673469618 - PerHostPeakMemUsage: 199684266104 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 38985311611 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 123236194 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 121982000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 230818324 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 123237173 - ExecTreeOpenTime: 138129 - PrepareTime: 107513816 - ExecTreePrepareTime: 2854934 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 320575 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4194617 - CompileTime: 30095086 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 91740868 - PeakMemoryUsage: 624640 - PrepareTime: 29077930 - TotalTime: 151549346 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 792038516 - GetResultsTime: 0 - HTResizeTime: 14571033919 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 199309117568 - PinTime: 0 - ReductionFactorEstimate: 355.8098969874972 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 440289886481 - TotalTime: 2991290 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:34/8.19 GB 2:29/7.02 GB 7:24/5.88 GB 4:26/6.44 GB 0:25/6.00 GB 3:30/7.14 GB 6:34/8.38 GB 1:24/5.82 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.12090395480225989 - AverageScannerThreadConcurrency: 16.0 - BytesRead: 3048980139 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 13680733975 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 82 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 676046193 - PerReadThreadRawHdfsThroughput: 56407280 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 462729215 - RowsReturned: 462600191 - RowsReturnedRate: 158060050 - ScanRangesComplete: 66 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 16112542983 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 54052953798 - TotalReadThroughput: 6889914 - TotalTime: 2926736959 Instance c74ce10ea42773c1:8f12f6e900000037 (host=va1035.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:17/4.16 GB 0:39/9.46 GB 1:26/6.35 GB 3:28/6.71 GB 4:25/6.09 GB 6:32/7.78 GB 5:31/7.64 GB 2:28/6.61 GB - AverageThreadTokens: 88.90011350737798 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 199601976535 - PerHostPeakMemUsage: 199612773021 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 53429871940 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 122160640 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 121981000 - TotalThreadsVoluntaryContextSwitches: 1 - TotalTime: 227460121 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 122161705 - ExecTreeOpenTime: 119644 - PrepareTime: 105200508 - ExecTreePrepareTime: 3746327 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 583297 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4712053 - CompileTime: 30870647 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 89999745 - PeakMemoryUsage: 624640 - PrepareTime: 30485492 - TotalTime: 151889945 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 23625347 - GetResultsTime: 0 - HTResizeTime: 13923360917 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 198194481280 - PinTime: 0 - ReductionFactorEstimate: 355.77919048611255 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439867307050 - TotalTime: 3864304 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:17/4.16 GB 0:39/9.46 GB 1:26/6.35 GB 3:28/6.71 GB 4:25/6.09 GB 6:32/7.78 GB 5:31/7.64 GB 2:28/6.61 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.023863636363636365 - AverageScannerThreadConcurrency: 88.0 - BytesRead: 3324298706 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10953209989 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 88 - NumScannerThreadsStarted: 88 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3611060645 - PerReadThreadRawHdfsThroughput: 251995615 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 456179712 - RowsReturned: 455976960 - RowsReturnedRate: 182914226 - ScanRangesComplete: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 13191891048 - TotalReadThroughput: 7546648 - TotalTime: 2492845792 Instance c74ce10ea42773c1:8f12f6e900000038 (host=vd1342.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 7:27/6.61 GB 1:27/6.64 GB 6:31/7.57 GB 5:24/5.86 GB 4:31/7.52 GB 3:28/6.85 GB 0:31/7.56 GB 2:25/6.19 GB - AverageThreadTokens: 14.984513274336283 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 188656065519 - PerHostPeakMemUsage: 188667069972 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15216708890 - TotalThreadsInvoluntaryContextSwitches: 14 - TotalThreadsTotalWallClockTime: 125880896 - TotalThreadsSysTime: 999000 - TotalThreadsUserTime: 123981000 - TotalThreadsVoluntaryContextSwitches: 7 - TotalTime: 226286899 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 125882952 - ExecTreeOpenTime: 239646 - PrepareTime: 100333812 - ExecTreePrepareTime: 2616884 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 283868 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3906228 - CompileTime: 31970201 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 92585056 - PeakMemoryUsage: 624640 - PrepareTime: 26547049 - TotalTime: 151715762 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 39020186 - GetResultsTime: 0 - HTResizeTime: 15666289219 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 188337866880 - PinTime: 0 - ReductionFactorEstimate: 355.77436614173314 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 450901887318 - TotalTime: 2854114 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 7:27/6.61 GB 1:27/6.64 GB 6:31/7.57 GB 5:24/5.86 GB 4:31/7.52 GB 3:28/6.85 GB 0:31/7.56 GB 2:25/6.19 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.05647840531561462 - AverageScannerThreadConcurrency: 14.0 - BytesRead: 2651681212 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9710622542 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 70 - NumScannerThreadsStarted: 14 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 584336143 - PerReadThreadRawHdfsThroughput: 104955329 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 404826285 - RowsReturned: 404699309 - RowsReturnedRate: 145326825 - ScanRangesComplete: 56 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 11715467166 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 25264855179 - TotalReadThroughput: 5866551 - TotalTime: 2784752970 Instance c74ce10ea42773c1:8f12f6e900000014 (host=vd1142.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 6:28/6.86 GB 2:32/7.89 GB 7:37/8.95 GB 3:22/5.40 GB 0:32/7.71 GB 5:21/5.12 GB 4:29/7.10 GB 1:23/5.46 GB - AverageThreadTokens: 12.633740288568257 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 191570468679 - PerHostPeakMemUsage: 191581473132 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 15631826951 - TotalThreadsInvoluntaryContextSwitches: 15 - TotalThreadsTotalWallClockTime: 132649119 - TotalThreadsSysTime: 4999000 - TotalThreadsUserTime: 125981000 - TotalThreadsVoluntaryContextSwitches: 13 - TotalTime: 224744446 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 132651888 - ExecTreeOpenTime: 450616 - PrepareTime: 92029965 - ExecTreePrepareTime: 3933768 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 208773 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3316441 - CompileTime: 40709486 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 90682887 - PeakMemoryUsage: 624640 - PrepareTime: 20337622 - TotalTime: 152232325 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 347348813 - GetResultsTime: 0 - HTResizeTime: 14562097331 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 191359862912 - PinTime: 0 - ReductionFactorEstimate: 355.9067185401433 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 451290920817 - TotalTime: 4381252 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 6:28/6.86 GB 2:32/7.89 GB 7:37/8.95 GB 3:22/5.40 GB 0:32/7.71 GB 5:21/5.12 GB 4:29/7.10 GB 1:23/5.46 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.06777777777777778 - AverageScannerThreadConcurrency: 11.646666666666667 - BytesRead: 2680512701 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9921552739 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 71 - NumScannerThreadsStarted: 12 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 477474742 - PerReadThreadRawHdfsThroughput: 89957525 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 420033271 - RowsReturned: 419908343 - RowsReturnedRate: 141957560 - ScanRangesComplete: 59 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12249086963 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 29797537136 - TotalReadThroughput: 5950083 - TotalTime: 2957985054 Instance c74ce10ea42773c1:8f12f6e90000000f (host=va1041.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 2:27/6.60 GB 7:21/5.13 GB 1:36/8.65 GB 4:29/7.09 GB 3:32/7.78 GB 5:26/6.32 GB 6:25/6.12 GB 0:29/7.10 GB - AverageThreadTokens: 16.621867881548976 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187093215738 - PerHostPeakMemUsage: 187104012224 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 14836851405 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 120110813 - TotalThreadsSysTime: 0 - TotalThreadsUserTime: 118982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 223357106 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 120112044 - ExecTreeOpenTime: 166555 - PrepareTime: 103181031 - ExecTreePrepareTime: 3673402 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 293024 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4279722 - CompileTime: 29710686 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 89151591 - PeakMemoryUsage: 624640 - PrepareTime: 28137465 - TotalTime: 147649876 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 142800011 - GetResultsTime: 0 - HTResizeTime: 14912329561 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 186451478656 - PinTime: 0 - ReductionFactorEstimate: 355.97246782468267 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 439083484239 - TotalTime: 3838046 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 2:27/6.60 GB 7:21/5.13 GB 1:36/8.65 GB 4:29/7.09 GB 3:32/7.78 GB 5:26/6.32 GB 6:25/6.12 GB 0:29/7.10 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.07525655644241733 - AverageScannerThreadConcurrency: 15.639680729760547 - BytesRead: 2942934777 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 9817847731 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 651345036 - PerReadThreadRawHdfsThroughput: 98372817 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 396311164 - RowsReturned: 396182140 - RowsReturnedRate: 163987885 - ScanRangesComplete: 62 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12996311103 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 29916137859 - TotalReadThroughput: 6703723 - TotalTime: 2415923219 Instance c74ce10ea42773c1:8f12f6e900000073 (host=va1044.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 4:36/8.76 GB 2:19/4.61 GB 6:27/6.65 GB 7:30/7.39 GB 1:22/5.31 GB 0:36/8.75 GB 3:27/6.47 GB 5:29/7.01 GB - AverageThreadTokens: 16.085812356979407 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 197758903882 - PerHostPeakMemUsage: 197769700368 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 25445716530 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 120512843 - TotalThreadsSysTime: 1000000 - TotalThreadsUserTime: 118982000 - TotalThreadsVoluntaryContextSwitches: 27 - TotalTime: 222923181 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 120514177 - ExecTreeOpenTime: 224911 - PrepareTime: 102351983 - ExecTreePrepareTime: 3305281 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 241950 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 3231815 - CompileTime: 29846940 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 89476916 - PeakMemoryUsage: 624640 - PrepareTime: 22231528 - TotalTime: 141996028 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 46194165 - GetResultsTime: 0 - HTResizeTime: 15020488100 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 197487741056 - PinTime: 0 - ReductionFactorEstimate: 355.79946996823554 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 433988298729 - TotalTime: 3528071 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 4:36/8.76 GB 2:19/4.61 GB 6:27/6.65 GB 7:30/7.39 GB 1:22/5.31 GB 0:36/8.75 GB 3:27/6.47 GB 5:29/7.01 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.1156930126002291 - AverageScannerThreadConcurrency: 15.103092783505154 - BytesRead: 2903347113 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 10183233836 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 78 - NumScannerThreadsStarted: 16 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 596911989 - PerReadThreadRawHdfsThroughput: 58987394 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 452049047 - RowsReturned: 451920023 - RowsReturnedRate: 163726216 - ScanRangesComplete: 62 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 12276961107 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 49219789103 - TotalReadThroughput: 6643814 - TotalTime: 2760217843 Instance c74ce10ea42773c1:8f12f6e90000007f (host=vd1113.halxg.cloudera.com:22000) Hdfs split stats (:<# splits>/): 5:35/8.46 GB 6:25/6.11 GB 3:28/6.85 GB 1:37/8.99 GB 7:26/6.34 GB 0:25/6.11 GB 2:21/5.07 GB 4:29/6.87 GB - AverageThreadTokens: 88.90224719101124 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 187293473605 - PerHostPeakMemUsage: 187304270091 - RowsProduced: 0 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 62205397751 - TotalThreadsInvoluntaryContextSwitches: 13 - TotalThreadsTotalWallClockTime: 118397738 - TotalThreadsSysTime: 3999000 - TotalThreadsUserTime: 113982000 - TotalThreadsVoluntaryContextSwitches: 0 - TotalTime: 204889507 Fragment Instance Lifecycle Timings - ExecTime: 0 - ExecTreeExecTime: 0 - InactiveTotalTime: 0 - OpenTime: 118398671 - ExecTreeOpenTime: 122203 - PrepareTime: 86412505 - ExecTreePrepareTime: 4573751 - TotalTime: 0 DataStreamSender (dst_id=3) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 675960 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 931657 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 CodeGen - CodegenTime: 4595344 - CompileTime: 30584410 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 2076164 - NumFunctions: 60 - NumInstructions: 1220 - OptimizationTime: 86480597 - PeakMemoryUsage: 624640 - PrepareTime: 27001899 - TotalTime: 144679833 AGGREGATION_NODE (id=1) ExecOption: Streaming Preaggregation, Codegen Enabled - GetNewBlockTime: 18012428 - GetResultsTime: 0 - HTResizeTime: 14556046688 - HashBuckets: 0 - InactiveTotalTime: 0 - LargestPartitionPercent: 0 - PartitionsCreated: 16 - PeakMemoryUsage: 185850644608 - PinTime: 0 - ReductionFactorEstimate: 355.7154649912362 - ReductionFactorThresholdToExpand: 2.0 - RowsPassedThrough: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - StreamingTime: 417927142945 - TotalTime: 4694365 - UnpinTime: 0 HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): 5:35/8.46 GB 6:25/6.11 GB 3:28/6.85 GB 1:37/8.99 GB 7:26/6.34 GB 0:25/6.11 GB 2:21/5.07 GB 4:29/6.87 GB ExecOption: PARQUET Codegen Enabled - AverageHdfsReadThreadConcurrency: 0.025842696629213482 - AverageScannerThreadConcurrency: 87.90224719101124 - BytesRead: 3387052696 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 8533611244 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 2 - NumDictFilteredRowGroups: 0 - NumDisksAccessed: 0 - NumRowGroups: 90 - NumScannerThreadsStarted: 88 - NumScannersWithNoReads: 0 - NumStatsFilteredRowGroups: 0 - PeakMemoryUsage: 3569020989 - PerReadThreadRawHdfsThroughput: 243274824 - RemoteScanRanges: 0 - RowBatchQueueGetWaitTime: 0 - RowBatchQueuePutWaitTime: 0 - RowsRead: 393520212 - RowsReturned: 393317460 - RowsReturnedRate: 166306476 - ScanRangesComplete: 2 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 0 - MaterializeTupleTime(*): 246521140 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 0 - TotalRawHdfsReadTime(*): 13922742329 - TotalReadThroughput: 7611354 - TotalTime: 2365015895