impalad /backends /catalog /hadoop-varz /logs /memz /metrics /queries /rpcz /sessions /threadz /varz Query 7443557c4a5d9de1:f2c987e700000000 Plan Query Text plan Summary Profile Memory Download Thrift Profile Query (id=7443557c4a5d9de1:f2c987e700000000): Summary: Session ID: aa4ab4cf45b2b118:800a006c290d75ba Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2016-11-16 18:05:35.602870000 End Time: 2016-11-16 18:05:42.779410000 Query Type: DML Query State: FINISHED Query Status: OK Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build 40c0c2f4cf42281003c2278d9c2eb952a070fecf) User: Connected User: Delegated User: Network Address: 172.18.17.95:64826 Default Db: tpch_100_kudu Sql Statement: delete from tpch_100_kudu.lineitem where l_orderkey in (select orderkey from tpch_100_kudu.delete_1) Coordinator: vd0340.halxg.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=2.03GB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. tpch_100_kudu.delete_1 DELETE FROM KUDU [tpch_100_kudu.lineitem] | check keys exist: false | hosts=8 per-host-mem=0B | 02:HASH JOIN [LEFT SEMI JOIN, BROADCAST] | hash predicates: l_orderkey = orderkey | hosts=8 per-host-mem=2.00GB | tuple-ids=0 row-size=42B cardinality=600037902 | |--03:EXCHANGE [BROADCAST] | | hosts=1 per-host-mem=0B | | tuple-ids=1 row-size=8B cardinality=unavailable | | | 01:SCAN HDFS [tpch_100_kudu.delete_1, RANDOM] | partitions=1/1 files=1 size=1.12MB | table stats: unavailable | column stats: unavailable | hosts=1 per-host-mem=32.00MB | tuple-ids=1 row-size=8B cardinality=unavailable | 00:SCAN KUDU [tpch_100_kudu.lineitem] hosts=8 per-host-mem=0B tuple-ids=0 row-size=42B cardinality=600037902 ---------------- Estimated Per-Host Mem: 2181038080 Estimated Per-Host VCores: 2 Tables Missing Stats: tpch_100_kudu.delete_1 Request Pool: root.default Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------------ 02:HASH JOIN 8 4s432ms 4s870ms 600.57K 600.04M 13.14 MB 2.00 GB LEFT SEMI JOIN, BROADCAST |--03:EXCHANGE 8 4.960ms 5.904ms 150.00K -1 0 0 BROADCAST | 01:SCAN HDFS 1 7.010ms 7.010ms 150.00K -1 4.00 MB 32.00 MB tpch_100_kudu.delete_1 00:SCAN KUDU 8 442.010ms 724.523ms 600.64M 600.04M 20.62 MB 0 Planner Timeline: 63.062ms - Analysis finished: 594.507us (594.507us) - Equivalence classes computed: 777.789us (183.282us) - Single node plan created: 56.745ms (55.967ms) - Runtime filters computed: 56.856ms (111.219us) - Distributed plan created: 59.492ms (2.635ms) - Lineage info computed: 60.913ms (1.420ms) - Planning finished: 63.062ms (2.148ms) Query Timeline: 7s183ms - Start execution: 38.728us (38.728us) - Planning finished: 67.446ms (67.408ms) - Submit for admission: 70.569ms (3.123ms) - Completed admission: 73.750ms (3.180ms) - Ready to start 9 fragments: 76.821ms (3.071ms) - All 9 fragments instances started: 80.740ms (3.919ms) - DML data written: 7s143ms (7s062ms) - DML Metastore update finished: 7s143ms (167.024us) - Request finished: 7s143ms (38.056us) - Unregister query: 7s176ms (32.681ms) - ComputeScanRangeAssignmentTimer: 496.920us ImpalaServer: - ClientFetchWaitTimer: 32.603ms - MetastoreUpdateTimer: 187.476us - RowMaterializationTimer: 0.000ns Execution Profile 7443557c4a5d9de1:f2c987e700000000:(Total: 7s067ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 9, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms Insert Stats: Partition: Default NumModifiedRows: 600572 Per Node Peak Memory Usage: vd0342.halxg.cloudera.com:22000(4.12 MB) vd0236.halxg.cloudera.com:22000(49.40 MB) vd0336.halxg.cloudera.com:22000(49.60 MB) vd0240.halxg.cloudera.com:22000(49.60 MB) vd0334.halxg.cloudera.com:22000(49.50 MB) vd0340.halxg.cloudera.com:22000(49.60 MB) vd0238.halxg.cloudera.com:22000(49.60 MB) vd0234.halxg.cloudera.com:22000(49.49 MB) vd0338.halxg.cloudera.com:22000(49.39 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Averaged Fragment F00:(Total: 238.225ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:2562047h47m max:-9223372036854775808.000ns mean: -nanns stddev:0.000ns execution rates: min:8589934592.00 GB/sec max:-9223372036854775808.00 B/sec mean:-nan B/sec stddev:0.00 /sec num instances: 8 - AverageThreadTokens: 11.88 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.52 MB (51928320) - PerHostPeakMemUsage: 49.52 MB (51928320) - RowsProduced: 75.07K (75071) - TotalCpuTime: 1m7s - TotalNetworkReceiveTime: 610.139us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 31s507ms Fragment Instance Lifecycle Timings: - ExecTime: 6s048ms - ExecTreeExecTime: 4s854ms - OpenTime: 212.411ms - ExecTreeOpenTime: 24.225ms - PrepareTime: 25.787ms - ExecTreePrepareTime: 19.861ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 194.280ms, non-child: 194.280ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 54.410ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 117.990ms - PrepareTime: 21.309ms KuduTableSink:(Total: 258.059ms, non-child: 258.059ms, % non-child: 100.00%) - KuduApplyTimer: 175.312ms - RowsWritten: 75.07K (75071) - RowsWrittenRate: 291.19 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 4s877ms, non-child: 4s432ms, % non-child: 90.87%) - BuildRows: 150.00K (150000) - BuildTime: 16.735ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 75.08M (75079734) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s323ms - RowsReturned: 75.07K (75071) - RowsReturnedRate: 15.41 K/sec Hash Join Builder (join_node_id=2): - BuildRowsPartitionTime: 8.797ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 480.396us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 7.349ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 4.960ms, non-child: 4.960ms, % non-child: 100.00%) - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 4.179ms - DeserializeRowBatchTimer: 4.549ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 32.15 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 442.010ms, non-child: 442.010ms, % non-child: 100.00%) - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 20.54 MB (21538816) - RowsRead: 75.08M (75079734) - RowsReturned: 75.08M (75079734) - RowsReturnedRate: 183.49 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 19.97K (19974) - ScannerThreadsTotalWallClockTime: 1m7s - MaterializeTupleTime(*): 427.538ms - ScannerThreadsSysTime: 3s934ms - ScannerThreadsUserTime: 13s529ms - ScannerThreadsVoluntaryContextSwitches: 64.54K (64538) - TotalKuduScanRoundTrips: 3.01K (3008) - TotalReadThroughput: 0.00 /sec Averaged Fragment F01:(Total: 73.597ms, non-child: 1.792ms, % non-child: 2.44%) split sizes: min: 1.12 MB, max: 1.12 MB, avg: 1.12 MB, stddev: 0 completion times: min:111.999ms max:111.999ms mean: 111.999ms stddev:0.000ns execution rates: min:9.98 MB/sec max:9.98 MB/sec mean:9.98 MB/sec stddev:0.55 B/sec num instances: 1 - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.12 MB (4324096) - PerHostPeakMemUsage: 4.12 MB (4324096) - RowsProduced: 150.00K (150000) - TotalCpuTime: 94.673ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22.737ms - TotalStorageWaitTime: 5.787ms Fragment Instance Lifecycle Timings: - ExecTime: 37.508ms - ExecTreeExecTime: 6.824ms - OpenTime: 58.145ms - ExecTreeOpenTime: 34.832us - PrepareTime: 15.435ms - ExecTreePrepareTime: 13.519ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 49.258ms, non-child: 49.258ms, % non-child: 100.00%) - CodegenTime: 984.544us - CompileTime: 10.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 16 (16) - NumInstructions: 294 (294) - OptimizationTime: 23.985ms - PrepareTime: 14.352ms DataStreamSender (dst_id=3):(Total: 15.536ms, non-child: 15.536ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9617560) - NetworkThroughput(*): 858.84 MB/sec - OverallThroughput: 590.37 MB/sec - RowsReturned: 150.00K (150000) - SerializeBatchTime: 4.815ms - TransmitDataRPCTime: 10.679ms - UncompressedRowBatchSize: 14.88 MB (15604704) HDFS_SCAN_NODE (id=1):(Total: 7.010ms, non-child: 7.010ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.12 MB (1172209) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.12 MB (1172209) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.12 MB (1172209) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 4.00 MB (4190208) - PerReadThreadRawHdfsThroughput: 4.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5.891ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 150.00K (150000) - RowsReturned: 150.00K (150000) - RowsReturnedRate: 21.40 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 11.883ms - DelimiterParseTime: 3.384ms - MaterializeTupleTime(*): 2.239ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsReadTime(*): 250.624us - TotalReadThroughput: 0.00 /sec Fragment F00: Instance 7443557c4a5d9de1:f2c987e700000005 (host=vd0336.halxg.cloudera.com:22000):(Total: 257.883ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 49.60 MB, 34.97 MB, 33.96 MB, 44.62 MB, 37.03 MB, 39.65 MB, 23.54 MB, 49.60 MB, 49.13 MB, 49.11 MB, 41.54 MB, 48.73 MB, 41.91 MB, 38.15 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 10 - AverageThreadTokens: 12.79 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.60 MB (52005120) - PerHostPeakMemUsage: 49.60 MB (52005120) - RowsProduced: 79.90K (79904) - TotalCpuTime: 1m19s - TotalNetworkReceiveTime: 558.076us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 35s845ms Fragment Instance Lifecycle Timings: - ExecTime: 6s650ms - ExecTreeExecTime: 5s345ms - OpenTime: 234.039ms - ExecTreeOpenTime: 33.159ms - PrepareTime: 23.816ms - ExecTreePrepareTime: 18.247ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 197.805ms, non-child: 197.805ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.411ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 118.361ms - PrepareTime: 19.461ms KuduTableSink:(Total: 285.153ms, non-child: 285.153ms, % non-child: 100.00%) - KuduApplyTimer: 192.022ms - RowsWritten: 79.90K (79904) - RowsWrittenRate: 280.21 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 5s377ms, non-child: 4s870ms, % non-child: 90.58%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 18.156ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 80.09M (80090716) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s745ms - RowsReturned: 79.90K (79904) - RowsReturnedRate: 14.86 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.123ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 772.424us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 8.144ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 5.019ms, non-child: 5.019ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 4.281ms - DeserializeRowBatchTimer: 5.062ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 29.88 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 503.147ms, non-child: 503.147ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.62 MB (21618688) - RowsRead: 80.09M (80090716) - RowsReturned: 80.09M (80090716) - RowsReturnedRate: 159.18 M/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 21.92K (21918) - ScannerThreadsTotalWallClockTime: 1m19s - MaterializeTupleTime(*): 487.465ms - ScannerThreadsSysTime: 4s430ms - ScannerThreadsUserTime: 14s732ms - ScannerThreadsVoluntaryContextSwitches: 73.98K (73982) - TotalKuduScanRoundTrips: 3.21K (3211) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000002 (host=vd0234.halxg.cloudera.com:22000):(Total: 252.206ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 30.63 MB, 48.62 MB, 37.34 MB, 42.31 MB, 34.78 MB, 49.49 MB, 44.61 MB, 49.49 MB, 45.21 MB, 49.49 MB, 40.68 MB, 43.04 MB ThreadUsage(500.000ms): 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.49 MB (51898624) - PerHostPeakMemUsage: 49.49 MB (51898624) - RowsProduced: 73.08K (73084) - TotalCpuTime: 1m4s - TotalNetworkReceiveTime: 608.076us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 28s513ms Fragment Instance Lifecycle Timings: - ExecTime: 5s950ms - ExecTreeExecTime: 4s781ms - OpenTime: 222.834ms - ExecTreeOpenTime: 22.943ms - PrepareTime: 29.345ms - ExecTreePrepareTime: 23.703ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 204.953ms, non-child: 204.953ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 59.190ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 120.189ms - PrepareTime: 24.987ms KuduTableSink:(Total: 242.601ms, non-child: 242.601ms, % non-child: 100.00%) - KuduApplyTimer: 166.392ms - RowsWritten: 73.08K (73084) - RowsWrittenRate: 301.25 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 4s803ms, non-child: 4s405ms, % non-child: 91.72%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 16.843ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 73.42M (73424816) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s297ms - RowsReturned: 73.08K (73084) - RowsReturnedRate: 15.21 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.143ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 382.316us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 7.252ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 5.484ms, non-child: 5.484ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 4.691ms - DeserializeRowBatchTimer: 3.320ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 27.35 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 393.778ms, non-child: 393.778ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 20.52 MB (21512192) - RowsRead: 73.42M (73424816) - RowsReturned: 73.42M (73424816) - RowsReturnedRate: 186.46 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 19.26K (19262) - ScannerThreadsTotalWallClockTime: 1m4s - MaterializeTupleTime(*): 379.955ms - ScannerThreadsSysTime: 3s649ms - ScannerThreadsUserTime: 12s423ms - ScannerThreadsVoluntaryContextSwitches: 65.75K (65749) - TotalKuduScanRoundTrips: 2.94K (2944) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000004 (host=vd0240.halxg.cloudera.com:22000):(Total: 251.087ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 2.48 MB, 48.47 MB, 39.46 MB, 40.28 MB, 39.00 MB, 35.91 MB, 39.10 MB, 36.47 MB, 35.06 MB, 34.88 MB, 40.97 MB, 47.10 MB, 43.61 MB ThreadUsage(500.000ms): 1, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 12.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.60 MB (52005120) - PerHostPeakMemUsage: 49.60 MB (52005120) - RowsProduced: 80.14K (80143) - TotalCpuTime: 1m13s - TotalNetworkReceiveTime: 257.839us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 34s927ms Fragment Instance Lifecycle Timings: - ExecTime: 6s225ms - ExecTreeExecTime: 4s917ms - OpenTime: 225.155ms - ExecTreeOpenTime: 21.973ms - PrepareTime: 25.900ms - ExecTreePrepareTime: 19.796ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 203.067ms, non-child: 203.067ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 57.609ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 122.988ms - PrepareTime: 21.855ms KuduTableSink:(Total: 281.208ms, non-child: 281.208ms, % non-child: 100.00%) - KuduApplyTimer: 187.578ms - RowsWritten: 80.14K (80143) - RowsWrittenRate: 285.00 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 4s938ms, non-child: 4s584ms, % non-child: 92.83%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 17.349ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 80.10M (80095108) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s468ms - RowsReturned: 80.14K (80143) - RowsReturnedRate: 16.23 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.418ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 479.420us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 8.218ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 4.171ms, non-child: 4.171ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 3.747ms - DeserializeRowBatchTimer: 3.802ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 35.96 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 351.824ms, non-child: 351.824ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.62 MB (21618688) - RowsRead: 80.10M (80095108) - RowsReturned: 80.10M (80095108) - RowsReturnedRate: 227.66 M/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 21.43K (21433) - ScannerThreadsTotalWallClockTime: 1m13s - MaterializeTupleTime(*): 335.909ms - ScannerThreadsSysTime: 4s189ms - ScannerThreadsUserTime: 14s852ms - ScannerThreadsVoluntaryContextSwitches: 68.21K (68212) - TotalKuduScanRoundTrips: 3.21K (3208) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000000 (host=vd0338.halxg.cloudera.com:22000):(Total: 232.710ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 49.39 MB, 49.39 MB, 43.30 MB, 46.13 MB, 34.58 MB, 41.80 MB, 38.05 MB, 39.18 MB, 48.07 MB, 43.71 MB, 45.64 MB ThreadUsage(500.000ms): 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11 - AverageThreadTokens: 11.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.39 MB (51792128) - PerHostPeakMemUsage: 49.39 MB (51792128) - RowsProduced: 67.35K (67353) - TotalCpuTime: 53s229ms - TotalNetworkReceiveTime: 1.076ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 23s452ms Fragment Instance Lifecycle Timings: - ExecTime: 5s337ms - ExecTreeExecTime: 4s245ms - OpenTime: 207.157ms - ExecTreeOpenTime: 24.822ms - PrepareTime: 25.518ms - ExecTreePrepareTime: 19.110ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 180.477ms, non-child: 180.477ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 46.585ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 112.563ms - PrepareTime: 20.708ms KuduTableSink:(Total: 236.758ms, non-child: 236.758ms, % non-child: 100.00%) - KuduApplyTimer: 156.024ms - RowsWritten: 67.35K (67353) - RowsWrittenRate: 284.48 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 4s269ms, non-child: 3s997ms, % non-child: 93.64%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 18.411ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 66.74M (66737226) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s895ms - RowsReturned: 67.35K (67353) - RowsReturnedRate: 15.78 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 9.603ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 643.168us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 8.067ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 5.760ms, non-child: 5.760ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 4.504ms - DeserializeRowBatchTimer: 5.426ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 26.04 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 267.827ms, non-child: 267.827ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 20.41 MB (21405696) - RowsRead: 66.74M (66737226) - RowsReturned: 66.74M (66737226) - RowsReturnedRate: 249.18 M/sec - ScanRangesComplete: 10 (10) - ScannerThreadsInvoluntaryContextSwitches: 18.81K (18811) - ScannerThreadsTotalWallClockTime: 53s205ms - MaterializeTupleTime(*): 254.785ms - ScannerThreadsSysTime: 3s899ms - ScannerThreadsUserTime: 13s278ms - ScannerThreadsVoluntaryContextSwitches: 54.36K (54360) - TotalKuduScanRoundTrips: 2.67K (2674) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000001 (host=vd0238.halxg.cloudera.com:22000):(Total: 231.741ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 49.60 MB, 49.60 MB, 49.50 MB, 34.41 MB, 48.47 MB, 49.60 MB, 44.24 MB, 37.88 MB, 44.35 MB, 42.28 MB, 43.22 MB, 49.60 MB, 46.28 MB, 40.88 MB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13 - AverageThreadTokens: 13.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.60 MB (52005120) - PerHostPeakMemUsage: 49.60 MB (52005120) - RowsProduced: 80.43K (80428) - TotalCpuTime: 1m20s - TotalNetworkReceiveTime: 461.880us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 38s696ms Fragment Instance Lifecycle Timings: - ExecTime: 6s829ms - ExecTreeExecTime: 5s504ms - OpenTime: 203.877ms - ExecTreeOpenTime: 21.232ms - PrepareTime: 27.841ms - ExecTreePrepareTime: 22.089ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 198.662ms, non-child: 198.662ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 57.278ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 117.309ms - PrepareTime: 23.493ms KuduTableSink:(Total: 276.722ms, non-child: 276.722ms, % non-child: 100.00%) - KuduApplyTimer: 191.198ms - RowsWritten: 80.43K (80428) - RowsWrittenRate: 290.64 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 5s524ms, non-child: 4s799ms, % non-child: 86.87%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 12.899ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 80.09M (80088242) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s691ms - RowsReturned: 80.43K (80428) - RowsReturnedRate: 14.56 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 6.003ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 75.352us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 6.781ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 2.667ms, non-child: 2.667ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 2.105ms - DeserializeRowBatchTimer: 4.088ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 56.23 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 724.523ms, non-child: 724.523ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.62 MB (21618688) - RowsRead: 80.09M (80088242) - RowsReturned: 80.09M (80088242) - RowsReturnedRate: 110.54 M/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 21.40K (21401) - ScannerThreadsTotalWallClockTime: 1m20s - MaterializeTupleTime(*): 708.552ms - ScannerThreadsSysTime: 4s292ms - ScannerThreadsUserTime: 14s102ms - ScannerThreadsVoluntaryContextSwitches: 70.96K (70959) - TotalKuduScanRoundTrips: 3.21K (3210) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000003 (host=vd0340.halxg.cloudera.com:22000):(Total: 231.216ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 43.22 MB, 38.35 MB, 49.60 MB, 49.60 MB, 30.10 MB, 35.35 MB, 28.26 MB, 41.06 MB, 22.30 MB, 47.81 MB, 46.49 MB, 49.60 MB, 50.25 KB ThreadUsage(500.000ms): 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 13, 1 - AverageThreadTokens: 12.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.60 MB (52013312) - PerHostPeakMemUsage: 49.60 MB (52013312) - RowsProduced: 80.72K (80722) - TotalCpuTime: 1m13s - TotalNetworkReceiveTime: 620.468us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 32s744ms Fragment Instance Lifecycle Timings: - ExecTime: 6s256ms - ExecTreeExecTime: 5s033ms - OpenTime: 205.729ms - ExecTreeOpenTime: 25.943ms - PrepareTime: 25.462ms - ExecTreePrepareTime: 20.067ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 191.583ms, non-child: 191.583ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 55.681ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 114.136ms - PrepareTime: 21.288ms KuduTableSink:(Total: 273.175ms, non-child: 273.175ms, % non-child: 100.00%) - KuduApplyTimer: 184.324ms - RowsWritten: 80.72K (80722) - RowsWrittenRate: 295.50 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 5s058ms, non-child: 4s710ms, % non-child: 93.11%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 18.963ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 80.09M (80086144) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s598ms - RowsReturned: 80.72K (80722) - RowsReturnedRate: 15.96 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 10.366ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 553.228us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 7.912ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 5.904ms, non-child: 5.904ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 5.091ms - DeserializeRowBatchTimer: 4.947ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 25.40 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 344.114ms, non-child: 344.114ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 12 (12) - PeakMemoryUsage: 20.62 MB (21618688) - RowsRead: 80.09M (80086144) - RowsReturned: 80.09M (80086144) - RowsReturnedRate: 232.73 M/sec - ScanRangesComplete: 12 (12) - ScannerThreadsInvoluntaryContextSwitches: 21.40K (21402) - ScannerThreadsTotalWallClockTime: 1m13s - MaterializeTupleTime(*): 330.431ms - ScannerThreadsSysTime: 4s107ms - ScannerThreadsUserTime: 14s317ms - ScannerThreadsVoluntaryContextSwitches: 73.74K (73739) - TotalKuduScanRoundTrips: 3.21K (3207) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000007 (host=vd0236.halxg.cloudera.com:22000):(Total: 224.872ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 41.27 MB, 40.80 MB, 26.84 MB, 46.55 MB, 29.94 MB, 38.14 MB, 35.35 MB, 41.99 MB, 24.46 MB, 38.42 MB, 23.64 MB ThreadUsage(500.000ms): 11, 11, 11, 11, 11, 11, 11, 11, 11, 11, 11 - AverageThreadTokens: 11.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.40 MB (51800320) - PerHostPeakMemUsage: 49.40 MB (51800320) - RowsProduced: 66.16K (66159) - TotalCpuTime: 53s384ms - TotalNetworkReceiveTime: 551.524us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 26s571ms Fragment Instance Lifecycle Timings: - ExecTime: 5s362ms - ExecTreeExecTime: 4s333ms - OpenTime: 200.180ms - ExecTreeOpenTime: 22.129ms - PrepareTime: 24.666ms - ExecTreePrepareTime: 18.145ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 189.992ms, non-child: 189.992ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 48.896ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 120.869ms - PrepareTime: 19.670ms KuduTableSink:(Total: 225.686ms, non-child: 225.686ms, % non-child: 100.00%) - KuduApplyTimer: 155.819ms - RowsWritten: 66.16K (66159) - RowsWrittenRate: 293.14 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 4s355ms, non-child: 3s962ms, % non-child: 90.99%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 15.827ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 66.74M (66740528) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 3s866ms - RowsReturned: 66.16K (66159) - RowsReturnedRate: 15.19 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.835ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 419.048us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 6.479ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 5.072ms, non-child: 5.072ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 4.347ms - DeserializeRowBatchTimer: 4.776ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 29.57 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 389.109ms, non-child: 389.109ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 10 (10) - PeakMemoryUsage: 20.41 MB (21405696) - RowsRead: 66.74M (66740528) - RowsReturned: 66.74M (66740528) - RowsReturnedRate: 171.52 M/sec - ScanRangesComplete: 10 (10) - ScannerThreadsInvoluntaryContextSwitches: 17.61K (17605) - ScannerThreadsTotalWallClockTime: 53s363ms - MaterializeTupleTime(*): 375.810ms - ScannerThreadsSysTime: 3s521ms - ScannerThreadsUserTime: 12s631ms - ScannerThreadsVoluntaryContextSwitches: 49.65K (49646) - TotalKuduScanRoundTrips: 2.67K (2674) - TotalReadThroughput: 0.00 /sec Instance 7443557c4a5d9de1:f2c987e700000006 (host=vd0334.halxg.cloudera.com:22000):(Total: 224.087ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): MemoryUsage(500.000ms): 2.48 MB, 35.34 MB, 47.74 MB, 46.49 MB, 42.65 MB, 45.65 MB, 42.52 MB, 38.80 MB, 48.58 MB, 48.56 MB, 43.90 MB, 33.42 MB ThreadUsage(500.000ms): 1, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 11.08 - BloomFilterBytes: 0 - PeakMemoryUsage: 49.50 MB (51906816) - PerHostPeakMemUsage: 49.50 MB (51906816) - RowsProduced: 72.78K (72779) - TotalCpuTime: 1m2s - TotalNetworkReceiveTime: 746.872us - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 31s310ms Fragment Instance Lifecycle Timings: - ExecTime: 5s773ms - ExecTreeExecTime: 4s675ms - OpenTime: 200.319ms - ExecTreeOpenTime: 21.598ms - PrepareTime: 23.747ms - ExecTreePrepareTime: 17.730ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 32 (32) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 4.00 MB (4194304) - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 187.705ms, non-child: 187.705ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 50.628ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 57 (57) - NumInstructions: 2.46K (2463) - OptimizationTime: 117.507ms - PrepareTime: 19.012ms KuduTableSink:(Total: 243.166ms, non-child: 243.166ms, % non-child: 100.00%) - KuduApplyTimer: 169.137ms - RowsWritten: 72.78K (72779) - RowsWrittenRate: 299.30 K/sec - TotalKuduFlushErrors: 0 (0) HASH_JOIN_NODE (id=2):(Total: 4s696ms, non-child: 4s130ms, % non-child: 87.97%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 150.00K (150000) - BuildTime: 15.432ms - PeakMemoryUsage: 13.14 MB (13773056) - ProbeRows: 73.38M (73375098) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 4s026ms - RowsReturned: 72.78K (72779) - RowsReturnedRate: 15.50 K/sec Hash Join Builder (join_node_id=2): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 8.882ms - BuildRowsPartitioned: 150.00K (150000) - GetNewBlockTime: 518.216us - HashBuckets: 262.14K (262144) - HashCollisions: 0 (0) - HashTablesBuildTime: 5.940ms - LargestPartitionPercent: 6 (6) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=3):(Total: 5.604ms, non-child: 5.604ms, % non-child: 100.00%) BytesReceived(500.000ms): 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB, 1.15 MB - BytesReceived: 1.15 MB (1202195) - ConvertRowBatchTime: 4.671ms - DeserializeRowBatchTimer: 4.967ms - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 150.00K (150000) - RowsReturnedRate: 26.77 M/sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns KUDU_SCAN_NODE (id=0):(Total: 561.758ms, non-child: 561.758ms, % non-child: 100.00%) BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - KuduRemoteScanTokens: 0 (0) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 20.52 MB (21512192) - RowsRead: 73.38M (73375098) - RowsReturned: 73.38M (73375098) - RowsReturnedRate: 130.62 M/sec - ScanRangesComplete: 11 (11) - ScannerThreadsInvoluntaryContextSwitches: 17.97K (17967) - ScannerThreadsTotalWallClockTime: 1m2s - MaterializeTupleTime(*): 547.393ms - ScannerThreadsSysTime: 3s382ms - ScannerThreadsUserTime: 11s900ms - ScannerThreadsVoluntaryContextSwitches: 59.66K (59664) - TotalKuduScanRoundTrips: 2.94K (2940) - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 7443557c4a5d9de1:f2c987e700000008 (host=vd0342.halxg.cloudera.com:22000):(Total: 73.597ms, non-child: 1.792ms, % non-child: 2.44%) Hdfs split stats (:<# splits>/): 9:1/1.12 MB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 4.12 MB (4324096) - PerHostPeakMemUsage: 4.12 MB (4324096) - RowsProduced: 150.00K (150000) - TotalCpuTime: 94.673ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 22.737ms - TotalStorageWaitTime: 5.787ms Fragment Instance Lifecycle Timings: - ExecTime: 37.508ms - ExecTreeExecTime: 6.824ms - OpenTime: 58.145ms - ExecTreeOpenTime: 34.832us - PrepareTime: 15.435ms - ExecTreePrepareTime: 13.519ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 161.38 GB (173281017856) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 49.258ms, non-child: 49.258ms, % non-child: 100.00%) - CodegenTime: 984.544us - CompileTime: 10.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1993816) - NumFunctions: 16 (16) - NumInstructions: 294 (294) - OptimizationTime: 23.985ms - PrepareTime: 14.352ms DataStreamSender (dst_id=3):(Total: 15.536ms, non-child: 15.536ms, % non-child: 100.00%) - BytesSent: 9.17 MB (9617560) - NetworkThroughput(*): 858.84 MB/sec - OverallThroughput: 590.37 MB/sec - RowsReturned: 150.00K (150000) - SerializeBatchTime: 4.815ms - TransmitDataRPCTime: 10.679ms - UncompressedRowBatchSize: 14.88 MB (15604704) HDFS_SCAN_NODE (id=1):(Total: 7.010ms, non-child: 7.010ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/1.12 MB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% File Formats: TEXT/NONE:1 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 1.12 MB (1172209) - BytesReadDataNodeCache: 0 - BytesReadLocal: 1.12 MB (1172209) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 1.12 MB (1172209) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 4.00 MB (4190208) - PerReadThreadRawHdfsThroughput: 4.36 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 5.891ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 150.00K (150000) - RowsReturned: 150.00K (150000) - RowsReturnedRate: 21.40 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 11.883ms - DelimiterParseTime: 3.384ms - MaterializeTupleTime(*): 2.239ms - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 4.999ms - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsReadTime(*): 250.624us - TotalReadThroughput: 0.00 /sec