Query (id=924509532171e28c:91a57cd500000000): Summary: Session ID: 2148f9bba43ffb3e:2116a8a8d4a6678a Session Type: BEESWAX Start Time: 2016-11-29 22:06:12.339289000 End Time: 2016-11-29 22:06:20.938241000 Query Type: DML Query State: FINISHED Query Status: OK Impala Version: impalad version 2.8.0-SNAPSHOT RELEASE (build f6f910016b442fd621cde4a536c7ce61b02897e0) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.193.10:41267 Default Db: tpcds_1000_parquet Sql Statement: insert into customer2 select * from customer Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=1.17GB VCores=1 WRITE TO HDFS [tpcds_1000_parquet.customer2, OVERWRITE=false] | partitions=1 | hosts=15 per-host-mem=193.26MB | 00:SCAN HDFS [tpcds_1000_parquet.customer, RANDOM] partitions=1/1 files=15 size=619.69MB table stats: 12000000 rows total column stats: all hosts=15 per-host-mem=1008.00MB tuple-ids=0 row-size=253B cardinality=12000000 ---------------- Estimated Per-Host Mem: 1259611888 Estimated Per-Host VCores: 1 Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 13 73.982ms 84.115ms 12.00M 12.00M 151.93 MB 1008.00 MB tpcds_1000_parquet.customer Planner Timeline: 9.733ms - Analysis finished: 1.588ms (1.588ms) - Equivalence classes computed: 2.064ms (475.961us) - Single node plan created: 4.220ms (2.156ms) - Runtime filters computed: 4.249ms (28.377us) - Distributed plan created: 4.923ms (674.587us) - Lineage info computed: 5.484ms (560.355us) - Planning finished: 9.733ms (4.249ms) Query Timeline: 8s611ms - Query submitted: 354.325us (354.325us) - Planning finished: 4s666ms (4s666ms) - Submit for admission: 4s668ms (2.266ms) - Completed admission: 4s668ms (181.269us) - Ready to start 13 fragment instances: 4s669ms (872.553us) - All 13 fragment instances started: 4s674ms (5.039ms) - DML data written: 8s552ms (3s877ms) - DML Metastore update finished: 8s579ms (26.768ms) - Request finished: 8s579ms (77.162us) - Unregister query: 8s598ms (19.453ms) - ComputeScanRangeAssignmentTimer: 280.372us ImpalaServer: - ClientFetchWaitTimer: 19.300ms - MetastoreUpdateTimer: 26.832ms - RowMaterializationTimer: 0.000ns Execution Profile 924509532171e28c:91a57cd500000000:(Total: 3s883ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment instance start latencies: Count: 13, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 2ms, 90th %-ile: 2ms, 95th %-ile: 2ms, 99.9th %-ile: 2ms DML Stats: Partition: Default NumModifiedRows: 12000000 BytesWritten: 613.76 MB Per Column Sizes: c_birth_country: 11.50 MB c_birth_day: 7.70 MB c_birth_month: 6.31 MB c_birth_year: 10.47 MB c_current_addr_sk: 46.79 MB c_current_cdemo_sk: 46.03 MB c_current_hdemo_sk: 19.13 MB c_customer_id: 58.13 MB c_customer_sk: 46.80 MB c_email_address: 267.62 MB c_first_name: 18.90 MB c_first_sales_date_sk: 17.57 MB c_first_shipto_date_sk: 17.57 MB c_last_name: 19.07 MB c_last_review_date: 12.92 MB c_login: 1.24 KB c_preferred_cust_flag: 2.88 MB c_salutation: 4.32 MB Per Node Peak Memory Usage: vb0212.halxg.cloudera.com:22000(206.71 MB) vb0232.halxg.cloudera.com:22000(120.43 MB) vb0204.halxg.cloudera.com:22000(120.43 MB) vb0228.halxg.cloudera.com:22000(120.43 MB) vb0220.halxg.cloudera.com:22000(120.47 MB) vb0206.halxg.cloudera.com:22000(120.43 MB) vb0208.halxg.cloudera.com:22000(117.88 MB) vb0222.halxg.cloudera.com:22000(120.47 MB) vb0224.halxg.cloudera.com:22000(120.46 MB) vb0226.halxg.cloudera.com:22000(208.01 MB) vb0214.halxg.cloudera.com:22000(120.43 MB) vb0234.halxg.cloudera.com:22000(120.47 MB) vb0218.halxg.cloudera.com:22000(120.43 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 81.130ms - FileDeletionTimer: 33.197ms - FileMoveTimer: 29.975ms - Overwrite/PartitionCreationTimer: 1.320ms Averaged Fragment F00:(Total: 38.946ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 39.27 MB, max: 84.67 MB, avg: 47.67 MB, stddev: 15.36 MB completion times: min:2562047h47m max:-9223372036854775808.000ns mean: -nanns stddev:0.000ns execution rates: min:8589934592.00 GB/sec max:-9223372036854775808.00 B/sec mean:-nan B/sec stddev:0.00 /sec num instances: 13 - AverageThreadTokens: 1.83 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 397 (397) - PeakMemoryUsage: 133.62 MB (140110965) - PerHostPeakMemUsage: 133.62 MB (140110965) - RowsProduced: 923.08K (923076) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 53.426ms - TotalWallClockTime: 4s353ms - SysTime: 239.962ms - UserTime: 2s314ms - VoluntaryContextSwitches: 1.52K (1517) Fragment Instance Lifecycle Timings: - ExecTime: 2s294ms - ExecTreeExecTime: 74.614ms - OpenTime: 14.390ms - ExecTreeOpenTime: 37.820us - PrepareTime: 24.490ms - ExecTreePrepareTime: 149.684us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 2s169ms, non-child: 2s169ms, % non-child: 100.00%) - BytesWritten: 47.21 MB (49505546) - CompressTimer: 260.018ms - EncodeTimer: 1s680ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 445.748ms - HdfsWriteTimer: 253.939ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 60.00 MB (62910135) - RowsInserted: 923.08K (923076) - TmpFileCreateTimer: 41.257ms CodeGen:(Total: 37.387ms, non-child: 37.387ms, % non-child: 100.00%) - CodegenTime: 713.228us - CompileTime: 5.631ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.919ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 23.225ms HDFS_SCAN_NODE (id=0):(Total: 73.982ms, non-child: 73.982ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.03 - BytesRead: 47.78 MB (50099521) - BytesReadDataNodeCache: 0 - BytesReadLocal: 47.78 MB (50099521) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 47.78 MB (50099521) - DecompressionTime: 139.115ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 102.18 MB (107145046) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 65.060ms - RowBatchQueuePutWaitTime: 1s334ms - RowsRead: 923.08K (923076) - RowsReturned: 923.08K (923076) - RowsReturnedRate: 12.35 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 196 (196) - ScannerThreadsTotalWallClockTime: 2s044ms - MaterializeTupleTime(*): 483.674ms - ScannerThreadsSysTime: 142.900ms - ScannerThreadsUserTime: 522.919ms - ScannerThreadsVoluntaryContextSwitches: 793 (793) - TotalRawHdfsReadTime(*): 42.058ms - TotalReadThroughput: 24.90 MB/sec Fragment F00: Instance 924509532171e28c:91a57cd500000007 (host=vb0204.halxg.cloudera.com:22000):(Total: 40.756ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/41.31 MB MemoryUsage(500.000ms): 101.23 MB, 108.21 MB, 115.30 MB, 53.54 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 304 (304) - PeakMemoryUsage: 120.43 MB (126283261) - PerHostPeakMemUsage: 120.43 MB (126283261) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 43.968ms - TotalWallClockTime: 3s169ms - SysTime: 151.976ms - UserTime: 1s821ms - VoluntaryContextSwitches: 1.36K (1365) Fragment Instance Lifecycle Timings: - ExecTime: 1s838ms - ExecTreeExecTime: 71.428ms - OpenTime: 13.822ms - ExecTreeOpenTime: 34.735us - PrepareTime: 26.799ms - ExecTreePrepareTime: 114.378us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s735ms, non-child: 1s735ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42969258) - CompressTimer: 221.951ms - EncodeTimer: 1s424ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 268.344ms - HdfsWriteTimer: 228.663ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.53 MB (56133018) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 40.101ms CodeGen:(Total: 39.404ms, non-child: 39.404ms, % non-child: 100.00%) - CodegenTime: 579.411us - CompileTime: 5.370ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.690ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 25.764ms HDFS_SCAN_NODE (id=0):(Total: 70.854ms, non-child: 70.854ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 9.038ms ; Min: 9.038ms ; Max: 9.038ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 41.41 MB (43416962) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43416962) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43416962) - DecompressionTime: 83.877ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.49 MB (98036308) - PerReadThreadRawHdfsThroughput: 1.17 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 64.898ms - RowBatchQueuePutWaitTime: 889.093ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 11.29 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 134 (134) - ScannerThreadsTotalWallClockTime: 1s317ms - MaterializeTupleTime(*): 274.235ms - ScannerThreadsSysTime: 80.987ms - ScannerThreadsUserTime: 305.953ms - ScannerThreadsVoluntaryContextSwitches: 658 (658) - TotalRawHdfsReadTime(*): 34.702ms - TotalReadThroughput: 27.60 MB/sec Instance 924509532171e28c:91a57cd500000001 (host=vb0234.halxg.cloudera.com:22000):(Total: 40.751ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/41.31 MB MemoryUsage(500.000ms): 57.00 KB, 108.49 MB, 116.59 MB, 60.23 MB ThreadUsage(500.000ms): 1, 2, 2, 1 - AverageThreadTokens: 1.50 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 295 (295) - PeakMemoryUsage: 120.47 MB (126317643) - PerHostPeakMemUsage: 120.47 MB (126317643) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 47.360ms - TotalWallClockTime: 3s149ms - SysTime: 151.976ms - UserTime: 1s829ms - VoluntaryContextSwitches: 1.24K (1243) Fragment Instance Lifecycle Timings: - ExecTime: 1s822ms - ExecTreeExecTime: 73.792ms - OpenTime: 14.432ms - ExecTreeOpenTime: 40.344us - PrepareTime: 26.261ms - ExecTreePrepareTime: 142.792us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s710ms, non-child: 1s710ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42970124) - CompressTimer: 218.297ms - EncodeTimer: 1s403ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 263.655ms - HdfsWriteTimer: 215.872ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.53 MB (56132584) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 42.110ms CodeGen:(Total: 39.241ms, non-child: 39.241ms, % non-child: 100.00%) - CodegenTime: 749.540us - CompileTime: 5.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.948ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 25.058ms HDFS_SCAN_NODE (id=0):(Total: 73.288ms, non-child: 73.288ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 41.40 MB, 41.40 MB, 41.40 MB - FooterProcessingTime: (Avg: 6.280ms ; Min: 6.280ms ; Max: 6.280ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 41.40 MB (43415778) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.40 MB (43415778) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.40 MB (43415778) - DecompressionTime: 83.380ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.50 MB (98037643) - PerReadThreadRawHdfsThroughput: 1.06 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.419ms - RowBatchQueuePutWaitTime: 869.528ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 10.92 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 126 (126) - ScannerThreadsTotalWallClockTime: 1s312ms - MaterializeTupleTime(*): 287.939ms - ScannerThreadsSysTime: 74.988ms - ScannerThreadsUserTime: 322.950ms - ScannerThreadsVoluntaryContextSwitches: 662 (662) - TotalRawHdfsReadTime(*): 38.305ms - TotalReadThroughput: 20.70 MB/sec Instance 924509532171e28c:91a57cd500000009 (host=vb0220.halxg.cloudera.com:22000):(Total: 39.930ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/41.32 MB MemoryUsage(500.000ms): 22.45 MB, 101.60 MB, 116.28 MB, 62.12 MB, 53.54 MB ThreadUsage(500.000ms): 2, 2, 2, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 310 (310) - PeakMemoryUsage: 120.47 MB (126317286) - PerHostPeakMemUsage: 120.47 MB (126317286) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 43.821ms - TotalWallClockTime: 3s724ms - SysTime: 268.959ms - UserTime: 2s028ms - VoluntaryContextSwitches: 1.30K (1300) Fragment Instance Lifecycle Timings: - ExecTime: 2s363ms - ExecTreeExecTime: 70.548ms - OpenTime: 14.440ms - ExecTreeOpenTime: 38.460us - PrepareTime: 25.430ms - ExecTreePrepareTime: 145.320us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 2s248ms, non-child: 2s248ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42973755) - CompressTimer: 227.902ms - EncodeTimer: 1s446ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 755.055ms - HdfsWriteTimer: 254.813ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.53 MB (56131393) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 44.587ms CodeGen:(Total: 38.305ms, non-child: 38.305ms, % non-child: 100.00%) - CodegenTime: 746.196us - CompileTime: 5.637ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.896ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 24.135ms HDFS_SCAN_NODE (id=0):(Total: 70.018ms, non-child: 70.018ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/41.32 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 14.60 MB, 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 7.499ms ; Min: 7.499ms ; Max: 7.499ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 41.41 MB (43422430) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43422430) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43422430) - DecompressionTime: 140.562ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.49 MB (98035349) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 61.677ms - RowBatchQueuePutWaitTime: 651.814ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 11.43 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 135 (135) - ScannerThreadsTotalWallClockTime: 1s347ms - MaterializeTupleTime(*): 482.201ms - ScannerThreadsSysTime: 165.974ms - ScannerThreadsUserTime: 491.925ms - ScannerThreadsVoluntaryContextSwitches: 666 (666) - TotalRawHdfsReadTime(*): 32.855ms - TotalReadThroughput: 20.71 MB/sec Instance 924509532171e28c:91a57cd50000000b (host=vb0232.halxg.cloudera.com:22000):(Total: 39.712ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:1/41.31 MB MemoryUsage(500.000ms): 100.37 MB, 106.41 MB, 113.44 MB, 49.94 MB, 53.54 MB ThreadUsage(500.000ms): 2, 2, 2, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 307 (307) - PeakMemoryUsage: 120.43 MB (126285059) - PerHostPeakMemUsage: 120.43 MB (126285059) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 47.533ms - TotalWallClockTime: 3s733ms - SysTime: 250.960ms - UserTime: 2s092ms - VoluntaryContextSwitches: 1.24K (1240) Fragment Instance Lifecycle Timings: - ExecTime: 2s354ms - ExecTreeExecTime: 76.167ms - OpenTime: 13.449ms - ExecTreeOpenTime: 34.536us - PrepareTime: 26.208ms - ExecTreePrepareTime: 129.175us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 2s235ms, non-child: 2s235ms, % non-child: 100.00%) - BytesWritten: 40.99 MB (42977464) - CompressTimer: 230.776ms - EncodeTimer: 1s470ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 724.664ms - HdfsWriteTimer: 224.796ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.54 MB (56137039) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 36.893ms CodeGen:(Total: 38.210ms, non-child: 38.210ms, % non-child: 100.00%) - CodegenTime: 682.184us - CompileTime: 5.092ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.546ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 24.976ms HDFS_SCAN_NODE (id=0):(Total: 75.633ms, non-child: 75.633ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 8.151ms ; Min: 8.151ms ; Max: 8.151ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 41.41 MB (43419715) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43419715) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43419715) - DecompressionTime: 147.938ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.50 MB (98038806) - PerReadThreadRawHdfsThroughput: 1.05 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 67.275ms - RowBatchQueuePutWaitTime: 635.190ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 10.58 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 133 (133) - ScannerThreadsTotalWallClockTime: 1s365ms - MaterializeTupleTime(*): 504.625ms - ScannerThreadsSysTime: 157.975ms - ScannerThreadsUserTime: 530.919ms - ScannerThreadsVoluntaryContextSwitches: 660 (660) - TotalRawHdfsReadTime(*): 38.438ms - TotalReadThroughput: 27.61 MB/sec Instance 924509532171e28c:91a57cd500000006 (host=vb0206.halxg.cloudera.com:22000):(Total: 39.680ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/41.31 MB MemoryUsage(500.000ms): 101.36 MB, 109.40 MB, 115.38 MB, 53.54 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 301 (301) - PeakMemoryUsage: 120.43 MB (126283437) - PerHostPeakMemUsage: 120.43 MB (126283437) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 49.389ms - TotalWallClockTime: 3s193ms - SysTime: 158.975ms - UserTime: 1s848ms - VoluntaryContextSwitches: 1.26K (1259) Fragment Instance Lifecycle Timings: - ExecTime: 1s847ms - ExecTreeExecTime: 76.603ms - OpenTime: 14.392ms - ExecTreeOpenTime: 35.944us - PrepareTime: 25.228ms - ExecTreePrepareTime: 210.468us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s734ms, non-child: 1s734ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42970882) - CompressTimer: 222.319ms - EncodeTimer: 1s427ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 266.482ms - HdfsWriteTimer: 221.787ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.53 MB (56133856) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 38.494ms CodeGen:(Total: 37.993ms, non-child: 37.993ms, % non-child: 100.00%) - CodegenTime: 756.044us - CompileTime: 5.642ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.899ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 23.816ms HDFS_SCAN_NODE (id=0):(Total: 76.282ms, non-child: 76.282ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 7.008ms ; Min: 7.008ms ; Max: 7.008ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 41.41 MB (43419082) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43419082) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43419082) - DecompressionTime: 84.230ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.49 MB (98035318) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 69.248ms - RowBatchQueuePutWaitTime: 888.420ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 10.49 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 129 (129) - ScannerThreadsTotalWallClockTime: 1s331ms - MaterializeTupleTime(*): 284.438ms - ScannerThreadsSysTime: 81.987ms - ScannerThreadsUserTime: 313.952ms - ScannerThreadsVoluntaryContextSwitches: 660 (660) - TotalRawHdfsReadTime(*): 36.835ms - TotalReadThroughput: 27.61 MB/sec Instance 924509532171e28c:91a57cd500000003 (host=vb0226.halxg.cloudera.com:22000):(Total: 39.322ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 4:1/43.37 MB 2:1/41.30 MB MemoryUsage(500.000ms): 161.32 MB, 176.46 MB, 173.80 MB, 188.67 MB, 201.55 MB, 199.61 MB, 93.94 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.71 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 941 (941) - PeakMemoryUsage: 208.01 MB (218109562) - PerHostPeakMemUsage: 208.01 MB (218109562) - RowsProduced: 1.64M (1640000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 95.517ms - TotalWallClockTime: 9s761ms - SysTime: 521.919ms - UserTime: 4s398ms - VoluntaryContextSwitches: 2.88K (2884) Fragment Instance Lifecycle Timings: - ExecTime: 3s756ms - ExecTreeExecTime: 85.419ms - OpenTime: 14.395ms - ExecTreeOpenTime: 35.148us - PrepareTime: 24.872ms - ExecTreePrepareTime: 176.632us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 3s561ms, non-child: 3s561ms, % non-child: 100.00%) - BytesWritten: 83.51 MB (87561429) - CompressTimer: 467.193ms - EncodeTimer: 3s028ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 488.663ms - HdfsWriteTimer: 441.776ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 97.53 MB (102267727) - RowsInserted: 1.64M (1640000) - TmpFileCreateTimer: 39.854ms CodeGen:(Total: 37.673ms, non-child: 37.673ms, % non-child: 100.00%) - CodegenTime: 725.400us - CompileTime: 5.614ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.927ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 23.507ms HDFS_SCAN_NODE (id=0):(Total: 84.115ms, non-child: 84.115ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:1/43.37 MB 2:1/41.30 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 84.86 MB, 84.86 MB, 84.86 MB, 84.86 MB, 84.86 MB, 84.86 MB - FooterProcessingTime: (Avg: 8.215ms ; Min: 8.207ms ; Max: 8.224ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 84.86 MB (88982520) - BytesReadDataNodeCache: 0 - BytesReadLocal: 84.86 MB (88982520) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 84.86 MB (88982520) - DecompressionTime: 310.830ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 151.93 MB (159314141) - PerReadThreadRawHdfsThroughput: 1.08 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.663ms - RowBatchQueuePutWaitTime: 4s407ms - RowsRead: 1.64M (1640000) - RowsReturned: 1.64M (1640000) - RowsReturnedRate: 19.50 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 585 (585) - ScannerThreadsTotalWallClockTime: 5s991ms - MaterializeTupleTime(*): 1s106ms - ScannerThreadsSysTime: 338.947ms - ScannerThreadsUserTime: 1s190ms - ScannerThreadsVoluntaryContextSwitches: 1.53K (1534) - TotalRawHdfsReadTime(*): 77.013ms - TotalReadThroughput: 28.29 MB/sec Instance 924509532171e28c:91a57cd500000008 (host=vb0222.halxg.cloudera.com:22000):(Total: 39.282ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/41.32 MB MemoryUsage(500.000ms): 95.93 MB, 104.55 MB, 119.43 MB, 53.14 MB, 53.55 MB ThreadUsage(500.000ms): 2, 2, 2, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 319 (319) - PeakMemoryUsage: 120.47 MB (126321195) - PerHostPeakMemUsage: 120.47 MB (126321195) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 43.137ms - TotalWallClockTime: 3s756ms - SysTime: 248.961ms - UserTime: 2s127ms - VoluntaryContextSwitches: 1.22K (1219) Fragment Instance Lifecycle Timings: - ExecTime: 2s363ms - ExecTreeExecTime: 70.078ms - OpenTime: 14.377ms - ExecTreeOpenTime: 41.032us - PrepareTime: 24.848ms - ExecTreePrepareTime: 147.904us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 2s251ms, non-child: 2s251ms, % non-child: 100.00%) - BytesWritten: 40.99 MB (42981867) - CompressTimer: 233.304ms - EncodeTimer: 1s486ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 716.928ms - HdfsWriteTimer: 215.910ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.54 MB (56139765) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 45.615ms CodeGen:(Total: 37.670ms, non-child: 37.670ms, % non-child: 100.00%) - CodegenTime: 764.912us - CompileTime: 5.706ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.818ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 23.524ms HDFS_SCAN_NODE (id=0):(Total: 69.537ms, non-child: 69.537ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/41.32 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 6.324ms ; Min: 6.324ms ; Max: 6.324ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 41.41 MB (43426387) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43426387) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43426387) - DecompressionTime: 145.535ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.50 MB (98039227) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 61.230ms - RowBatchQueuePutWaitTime: 651.218ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 11.50 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 138 (138) - ScannerThreadsTotalWallClockTime: 1s378ms - MaterializeTupleTime(*): 509.042ms - ScannerThreadsSysTime: 161.975ms - ScannerThreadsUserTime: 527.919ms - ScannerThreadsVoluntaryContextSwitches: 666 (666) - TotalRawHdfsReadTime(*): 34.079ms - TotalReadThroughput: 20.71 MB/sec Instance 924509532171e28c:91a57cd500000005 (host=vb0208.halxg.cloudera.com:22000):(Total: 38.643ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/39.27 MB MemoryUsage(500.000ms): 101.92 MB, 109.02 MB, 73.80 MB ThreadUsage(500.000ms): 2, 2, 1 - AverageThreadTokens: 1.67 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 296 (296) - PeakMemoryUsage: 117.88 MB (123609272) - PerHostPeakMemUsage: 117.88 MB (123609272) - RowsProduced: 760.00K (760000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 41.459ms - TotalWallClockTime: 3s107ms - SysTime: 225.965ms - UserTime: 2s000ms - VoluntaryContextSwitches: 1.28K (1276) Fragment Instance Lifecycle Timings: - ExecTime: 1s798ms - ExecTreeExecTime: 69.808ms - OpenTime: 14.854ms - ExecTreeOpenTime: 37.168us - PrepareTime: 23.733ms - ExecTreePrepareTime: 154.808us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s688ms, non-child: 1s688ms, % non-child: 100.00%) - BytesWritten: 38.95 MB (40846110) - CompressTimer: 214.689ms - EncodeTimer: 1s396ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 243.475ms - HdfsWriteTimer: 208.766ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 51.53 MB (54037777) - RowsInserted: 760.00K (760000) - TmpFileCreateTimer: 45.374ms CodeGen:(Total: 37.028ms, non-child: 37.028ms, % non-child: 100.00%) - CodegenTime: 712.720us - CompileTime: 5.768ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 8.203ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 22.440ms HDFS_SCAN_NODE (id=0):(Total: 69.334ms, non-child: 69.334ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/39.27 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 39.37 MB, 39.37 MB, 39.37 MB - FooterProcessingTime: (Avg: 6.572ms ; Min: 6.572ms ; Max: 6.572ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.67 - BytesRead: 39.37 MB (41277884) - BytesReadDataNodeCache: 0 - BytesReadLocal: 39.37 MB (41277884) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 39.37 MB (41277884) - DecompressionTime: 139.183ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 91.00 MB (95415427) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 61.479ms - RowBatchQueuePutWaitTime: 604.271ms - RowsRead: 760.00K (760000) - RowsReturned: 760.00K (760000) - RowsReturnedRate: 10.96 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 127 (127) - ScannerThreadsTotalWallClockTime: 1s294ms - MaterializeTupleTime(*): 479.125ms - ScannerThreadsSysTime: 133.979ms - ScannerThreadsUserTime: 518.921ms - ScannerThreadsVoluntaryContextSwitches: 628 (628) - TotalRawHdfsReadTime(*): 33.490ms - TotalReadThroughput: 26.24 MB/sec Instance 924509532171e28c:91a57cd500000004 (host=vb0224.halxg.cloudera.com:22000):(Total: 38.536ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 9:1/41.31 MB MemoryUsage(500.000ms): 83.61 MB, 101.66 MB, 116.47 MB, 56.99 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 330 (330) - PeakMemoryUsage: 120.46 MB (126316479) - PerHostPeakMemUsage: 120.46 MB (126316479) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 49.112ms - TotalWallClockTime: 3s395ms - SysTime: 152.975ms - UserTime: 1s990ms - VoluntaryContextSwitches: 1.17K (1168) Fragment Instance Lifecycle Timings: - ExecTime: 1s963ms - ExecTreeExecTime: 75.712ms - OpenTime: 15.296ms - ExecTreeOpenTime: 41.564us - PrepareTime: 23.183ms - ExecTreePrepareTime: 149.980us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s848ms, non-child: 1s848ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42974164) - CompressTimer: 228.459ms - EncodeTimer: 1s497ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 306.187ms - HdfsWriteTimer: 189.515ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.53 MB (56133128) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 42.805ms CodeGen:(Total: 36.841ms, non-child: 36.841ms, % non-child: 100.00%) - CodegenTime: 757.152us - CompileTime: 5.792ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 8.554ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 21.856ms HDFS_SCAN_NODE (id=0):(Total: 75.181ms, non-child: 75.181ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 9:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 6.803ms ; Min: 6.803ms ; Max: 6.803ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 41.41 MB (43417038) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43417038) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43417038) - DecompressionTime: 96.162ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.49 MB (98035518) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.714ms - RowBatchQueuePutWaitTime: 903.787ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 10.64 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 147 (147) - ScannerThreadsTotalWallClockTime: 1s417ms - MaterializeTupleTime(*): 343.482ms - ScannerThreadsSysTime: 78.987ms - ScannerThreadsUserTime: 385.941ms - ScannerThreadsVoluntaryContextSwitches: 678 (678) - TotalRawHdfsReadTime(*): 36.124ms - TotalReadThroughput: 20.70 MB/sec Instance 924509532171e28c:91a57cd500000002 (host=vb0214.halxg.cloudera.com:22000):(Total: 38.341ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/41.31 MB MemoryUsage(500.000ms): 63.22 MB, 102.47 MB, 117.66 MB, 54.69 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 296 (296) - PeakMemoryUsage: 120.43 MB (126283786) - PerHostPeakMemUsage: 120.43 MB (126283786) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 48.241ms - TotalWallClockTime: 3s210ms - SysTime: 170.973ms - UserTime: 1s861ms - VoluntaryContextSwitches: 1.28K (1279) Fragment Instance Lifecycle Timings: - ExecTime: 1s848ms - ExecTreeExecTime: 74.735ms - OpenTime: 14.864ms - ExecTreeOpenTime: 41.209us - PrepareTime: 23.422ms - ExecTreePrepareTime: 141.022us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s735ms, non-child: 1s735ms, % non-child: 100.00%) - BytesWritten: 40.99 MB (42977367) - CompressTimer: 220.579ms - EncodeTimer: 1s438ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 253.155ms - HdfsWriteTimer: 216.438ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.54 MB (56135891) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 41.400ms CodeGen:(Total: 36.803ms, non-child: 36.803ms, % non-child: 100.00%) - CodegenTime: 755.237us - CompileTime: 5.885ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 8.136ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 22.161ms HDFS_SCAN_NODE (id=0):(Total: 74.172ms, non-child: 74.172ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 5.559ms ; Min: 5.559ms ; Max: 5.559ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.75 - BytesRead: 41.41 MB (43421214) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43421214) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43421214) - DecompressionTime: 86.181ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.50 MB (98038066) - PerReadThreadRawHdfsThroughput: 1.03 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 67.762ms - RowBatchQueuePutWaitTime: 878.686ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 10.79 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 129 (129) - ScannerThreadsTotalWallClockTime: 1s346ms - MaterializeTupleTime(*): 308.169ms - ScannerThreadsSysTime: 84.987ms - ScannerThreadsUserTime: 336.948ms - ScannerThreadsVoluntaryContextSwitches: 657 (657) - TotalRawHdfsReadTime(*): 39.296ms - TotalReadThroughput: 20.70 MB/sec Instance 924509532171e28c:91a57cd50000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 37.279ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/41.31 MB MemoryUsage(500.000ms): 102.43 MB, 109.46 MB, 116.43 MB, 53.54 MB ThreadUsage(500.000ms): 2, 2, 2, 1 - AverageThreadTokens: 1.75 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 303 (303) - PeakMemoryUsage: 120.43 MB (126284736) - PerHostPeakMemUsage: 120.43 MB (126284736) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 42.828ms - TotalWallClockTime: 3s208ms - SysTime: 165.974ms - UserTime: 1s925ms - VoluntaryContextSwitches: 1.31K (1307) Fragment Instance Lifecycle Timings: - ExecTime: 1s866ms - ExecTreeExecTime: 68.049ms - OpenTime: 13.550ms - ExecTreeOpenTime: 37.412us - PrepareTime: 23.635ms - ExecTreePrepareTime: 138.612us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 1s754ms, non-child: 1s754ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42974586) - CompressTimer: 225.942ms - EncodeTimer: 1s429ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 291.214ms - HdfsWriteTimer: 246.965ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.54 MB (56136417) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 31.494ms CodeGen:(Total: 35.768ms, non-child: 35.768ms, % non-child: 100.00%) - CodegenTime: 638.092us - CompileTime: 5.098ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.634ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 22.428ms HDFS_SCAN_NODE (id=0):(Total: 67.537ms, non-child: 67.537ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.41 MB, 41.41 MB, 41.41 MB - FooterProcessingTime: (Avg: 6.549ms ; Min: 6.549ms ; Max: 6.549ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 41.41 MB (43421393) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.41 MB (43421393) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.41 MB (43421393) - DecompressionTime: 100.967ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.50 MB (98038786) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 60.729ms - RowBatchQueuePutWaitTime: 812.811ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 11.85 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 130 (130) - ScannerThreadsTotalWallClockTime: 1s329ms - MaterializeTupleTime(*): 347.365ms - ScannerThreadsSysTime: 79.987ms - ScannerThreadsUserTime: 395.939ms - ScannerThreadsVoluntaryContextSwitches: 664 (664) - TotalRawHdfsReadTime(*): 33.343ms - TotalReadThroughput: 27.61 MB/sec Instance 924509532171e28c:91a57cd500000000 (host=vb0218.halxg.cloudera.com:22000):(Total: 37.227ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/41.31 MB MemoryUsage(500.000ms): 100.29 MB, 107.60 MB, 113.63 MB, 50.94 MB, 53.54 MB ThreadUsage(500.000ms): 2, 2, 2, 1, 1 - AverageThreadTokens: 1.60 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 310 (310) - PeakMemoryUsage: 120.43 MB (126284286) - PerHostPeakMemUsage: 120.43 MB (126284286) - RowsProduced: 800.00K (800000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 49.486ms - TotalWallClockTime: 3s754ms - SysTime: 237.963ms - UserTime: 2s121ms - VoluntaryContextSwitches: 1.31K (1311) Fragment Instance Lifecycle Timings: - ExecTime: 2s367ms - ExecTreeExecTime: 76.827ms - OpenTime: 14.480ms - ExecTreeOpenTime: 37.832us - PrepareTime: 22.691ms - ExecTreePrepareTime: 140.152us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 2s247ms, non-child: 2s247ms, % non-child: 100.00%) - BytesWritten: 40.98 MB (42969508) - CompressTimer: 228.487ms - EncodeTimer: 1s472ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 728.694ms - HdfsWriteTimer: 223.469ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 53.54 MB (56136209) - RowsInserted: 800.00K (800000) - TmpFileCreateTimer: 42.899ms CodeGen:(Total: 35.694ms, non-child: 35.694ms, % non-child: 100.00%) - CodegenTime: 718.504us - CompileTime: 5.674ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.973ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 21.466ms HDFS_SCAN_NODE (id=0):(Total: 76.317ms, non-child: 76.317ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 10:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 41.40 MB, 41.40 MB, 41.40 MB - FooterProcessingTime: (Avg: 7.302ms ; Min: 7.302ms ; Max: 7.302ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 41.40 MB (43414737) - BytesReadDataNodeCache: 0 - BytesReadLocal: 41.40 MB (43414737) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 41.40 MB (43414737) - DecompressionTime: 147.131ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - PeakMemoryUsage: 93.49 MB (98036343) - PerReadThreadRawHdfsThroughput: 1.04 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 66.905ms - RowBatchQueuePutWaitTime: 633.959ms - RowsRead: 800.00K (800000) - RowsReturned: 800.00K (800000) - RowsReturnedRate: 10.48 M/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 131 (131) - ScannerThreadsTotalWallClockTime: 1s372ms - MaterializeTupleTime(*): 512.554ms - ScannerThreadsSysTime: 145.977ms - ScannerThreadsUserTime: 548.916ms - ScannerThreadsVoluntaryContextSwitches: 676 (676) - TotalRawHdfsReadTime(*): 38.801ms - TotalReadThroughput: 27.60 MB/sec Instance 924509532171e28c:91a57cd50000000c (host=vb0212.halxg.cloudera.com:22000):(Total: 36.843ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/41.32 MB 10:1/41.31 MB MemoryUsage(500.000ms): 158.83 MB, 174.21 MB, 172.31 MB, 185.92 MB, 199.85 MB, 197.93 MB, 92.94 MB ThreadUsage(500.000ms): 3, 3, 3, 3, 3, 3, 1 - AverageThreadTokens: 2.71 - BloomFilterBytes: 0 - InvoluntaryContextSwitches: 859 (859) - PeakMemoryUsage: 206.71 MB (216746548) - PerHostPeakMemUsage: 206.71 MB (216746548) - RowsProduced: 1.60M (1600000) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 92.684ms - TotalWallClockTime: 9s423ms - SysTime: 411.935ms - UserTime: 4s038ms - VoluntaryContextSwitches: 2.87K (2872) Fragment Instance Lifecycle Timings: - ExecTime: 3s632ms - ExecTreeExecTime: 80.813ms - OpenTime: 14.725ms - ExecTreeOpenTime: 36.287us - PrepareTime: 22.064ms - ExecTreePrepareTime: 154.660us BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - ScratchFileUsedBytes: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns HdfsTableSink:(Total: 3s456ms, non-child: 3s456ms, % non-child: 100.00%) - BytesWritten: 81.47 MB (85425588) - CompressTimer: 440.329ms - EncodeTimer: 2s919ms - FilesCreated: 1 (1) - FinalizePartitionFileTimer: 488.208ms - HdfsWriteTimer: 412.436ms - PartitionsCreated: 1 (1) - PeakMemoryUsage: 95.54 MB (100176956) - RowsInserted: 1.60M (1600000) - TmpFileCreateTimer: 44.709ms CodeGen:(Total: 35.402ms, non-child: 35.402ms, % non-child: 100.00%) - CodegenTime: 686.576us - CompileTime: 6.280ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.90 MB (1997460) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 7.717ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 20.795ms HDFS_SCAN_NODE (id=0):(Total: 79.493ms, non-child: 79.493ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 1:1/41.32 MB 10:1/41.31 MB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:36 BytesRead(500.000ms): 82.82 MB, 82.82 MB, 82.82 MB, 82.82 MB, 82.82 MB, 82.82 MB - FooterProcessingTime: (Avg: 8.878ms ; Min: 8.651ms ; Max: 9.106ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 2.00 - BytesRead: 82.82 MB (86838645) - BytesReadDataNodeCache: 0 - BytesReadLocal: 82.82 MB (86838645) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 82.82 MB (86838645) - DecompressionTime: 242.514ms - MaxCompressedTextFileLength: 0 - NumColumns: 18 (18) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - PeakMemoryUsage: 150.48 MB (157784673) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 64.776ms - RowBatchQueuePutWaitTime: 4s528ms - RowsRead: 1.60M (1600000) - RowsReturned: 1.60M (1600000) - RowsReturnedRate: 20.13 M/sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 513 (513) - ScannerThreadsTotalWallClockTime: 5s776ms - MaterializeTupleTime(*): 848.197ms - ScannerThreadsSysTime: 270.957ms - ScannerThreadsUserTime: 926.858ms - ScannerThreadsVoluntaryContextSwitches: 1.50K (1502) - TotalRawHdfsReadTime(*): 73.473ms - TotalReadThroughput: 27.61 MB/sec