Query (id=624f3c1550318e89:1c44b0304366096): Summary: Session ID: 474ef2732baa5e75:d022e665b8c86499 Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2015-05-15 10:15:34.773004000 End Time: 2015-05-15 14:20:45.607978000 Query Type: DML Query State: FINISHED Query Status: OK Impala Version: impalad version 2.1.3-cdh5 RELEASE (build 20816e26a150d20d2c92c470aa40b342521b243e) User: Connected User: Delegated User: Network Address: ::ffff:192.168.102.46:50565 Default Db: default Sql Statement: insert into DWH.FactBattleParticipant select * from default.FactBattleParticipant2 Coordinator: hadoop01:22000 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.81GB VCores=1 WARNING: The following tables are missing relevant table and/or column statistics. default.factbattleparticipant2 F00:PLAN FRAGMENT [RANDOM] WRITE TO HDFS [dwh.factbattleparticipant, OVERWRITE=false] | partitions=1 | hosts=1 per-host-mem=186B | 00:SCAN HDFS [default.factbattleparticipant2, RANDOM] partitions=1/1 files=10 size=2.87TB table stats: 0 rows total column stats: unavailable hosts=1 per-host-mem=2.81GB tuple-ids=0 row-size=186B cardinality=0 ---------------- Estimated Per-Host Mem: 3019899066 Estimated Per-Host VCores: 1 Tables Missing Stats: default.factbattleparticipant2 Request Pool: default-pool ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------------- 00:SCAN HDFS 3 30s716ms 31s119ms 15.95B 0 1.04 GB 2.81 GB default.factbattleparticipant2 Query Timeline: 4h5m - Start execution: 48.465us (48.465us) - Planning finished: 4s510ms (4s510ms) - Ready to start remote fragments: 4s543ms (33.20ms) - Remote fragments started: 4s755ms (211.954ms) - DML data written: 4h5m (4h5m) - DML Metastore update finished: 4h5m (4s166ms) - Request finished: 4h5m (2.665ms) - Unregister query: 4h5m (818.742us) ImpalaServer: - ClientFetchWaitTimer: 780.415us - MetastoreUpdateTimer: 4s169ms - RowMaterializationTimer: 0ns Execution Profile 624f3c1550318e89:1c44b0304366096:(Total: 4h5m, non-child: 0ns, % non-child: 0.00%) Fragment start latencies: count: 3, last: 0.208772, min: 0.193985, max: 0.208772, mean: 0.199876, stddev: 0.00639981 Insert Stats: Partition: Default BytesWritten: 107797.23 GB Per Column Sizes: attackunitslossespower: 1524.80 GB attackunitslossesusd: 2035.25 GB basetypeid: 137.21 GB battleid: 17135.69 GB battletypeid: 158.90 GB clanid: 5432.01 GB clusterid: 95.04 GB defendunitslossespower: 3065.61 GB defendunitslossesusd: 2170.17 GB defensepower: 6985.81 GB infestationbaselevel: 423.66 GB infestationtypeid: 88.78 GB isattacker: 138.89 GB isclanchallenge: 59.44 GB isdepositor: 174.88 GB isinitiator: 156.17 GB ismain: 127.05 GB iswon: 159.46 GB level: 1220.18 GB offencepower: 5782.49 GB placeid: 1768.99 GB questprototypeid: 130.63 GB reconunitslossespower: 54.75 GB reconunitslossesusd: 63.19 GB resourceslossusd: 2584.30 GB rewardid: 5493.80 GB time: 25802.70 GB totalresourcerewardusd: 4332.41 GB totalrewardusd: 4823.08 GB totalunitsrewardusd: 481.17 GB userid: 15125.70 GB wasbaseoccupied: 63.16 GB Per Node Peak Memory Usage: hadoop03:22000(1.29 GB) hadoop01:22000(1.28 GB) hadoop02:22000(1.25 GB) - FinalizationTimer: 1s170ms - FileDeletionTimer: 44.555ms - FileMoveTimer: 1s120ms - Overwrite/PartitionCreationTimer: 1.652ms Averaged Fragment F00:(Total: 4h4m, non-child: 7s312ms, % non-child: 0.05%) split sizes: min: 981.05 GB, max: 981.07 GB, avg: 981.06 GB, stddev: 9.11 MB completion times: min:4h3m max:4h5m mean: 4h4m stddev:31s075ms execution rates: min:68.34 MB/sec max:68.69 MB/sec mean:68.52 MB/sec stddev:148.06 KB/sec num instances: 3 - AverageThreadTokens: 27.72 - PeakMemoryUsage: 1.27 GB (1368032661) - PerHostPeakMemUsage: 1.27 GB (1368032661) - PrepareTime: 185.244ms - RowsProduced: 5.32B (5316452590) - TotalCpuTime: 112h14m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 33m24s BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 27.12 GB (29116579157) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 839.203ms, non-child: 839.203ms, % non-child: 100.00%) - CodegenTime: 8.224ms - CompileTime: 215.56ms - LoadTime: 92.965us - ModuleFileSize: 1.95 MB (2047308) - OptimizationTime: 455.80ms - PrepareTime: 167.617ms HdfsTableSink:(Total: 4h3m, non-child: 4h3m, % non-child: 100.00%) - BytesWritten: 132.36 GB (142115705463) - CompressTimer: 20m5s - EncodeTimer: 3h38m - FilesCreated: 541 - FinalizePartitionFileTimer: 24m42s - HdfsWriteTimer: 24m5s - PartitionsCreated: 1 - PeakMemoryUsage: 306.28 MB (321159232) - RowsInserted: 5.32B (5316452590) - TmpFileCreateTimer: 4s435ms HDFS_SCAN_NODE (id=0):(Total: 30s716ms, non-child: 30s716ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.41 - AverageScannerThreadConcurrency: 26.72 - BytesRead: 981.07 GB (1053417053133) - BytesReadDataNodeCache: 0 - BytesReadLocal: 981.07 GB (1053417053133) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 981.07 GB (1053417053133) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.03 GB (1107566592) - PerReadThreadRawHdfsThroughput: 171.29 MB/sec - RemoteScanRanges: 0 - RowsRead: 5.32B (5316452590) - RowsReturned: 5.32B (5316452590) - RowsReturnedRate: 173.13 M/sec - ScanRangesComplete: 7.85K (7850) - ScannerThreadsInvoluntaryContextSwitches: 73.87K (73872) - ScannerThreadsTotalWallClockTime: 108h43m - DelimiterParseTime: 36m4s - MaterializeTupleTime(*): 1h25m - ScannerThreadsSysTime: 43s837ms - ScannerThreadsUserTime: 2h4m - ScannerThreadsVoluntaryContextSwitches: 5.26M (5258822) - TotalRawHdfsReadTime(*): 1h41m - TotalReadThroughput: 68.54 MB/sec Fragment F00: Instance 624f3c1550318e89:1c44b0304366098 (host=hadoop01:22000):(Total: 4h4m, non-child: 7s714ms, % non-child: 0.05%) Hdfs split stats (:<# splits>/): 0:7852/981.07 GB MemoryUsage(4m16s): 1.08 GB, 1.10 GB, 1.10 GB, 1.10 GB, 950.92 MB, 571.98 MB, 572.95 MB, 572.43 MB, 574.38 MB, 574.15 MB, 572.79 MB, 570.77 MB, 571.81 MB, 571.30 MB, 571.81 MB, 571.60 MB, 570.19 MB, 572.90 MB, 571.39 MB, 571.03 MB, 572.60 MB, 573.64 MB, 570.72 MB, 572.21 MB, 572.95 MB, 572.98 MB, 572.46 MB, 573.76 MB, 571.87 MB, 572.24 MB, 573.02 MB, 572.79 MB, 573.02 MB, 572.30 MB, 571.40 MB, 571.43 MB, 572.32 MB, 571.79 MB, 572.54 MB, 572.25 MB, 571.98 MB, 574.39 MB, 572.43 MB, 571.86 MB, 570.96 MB, 571.66 MB, 572.56 MB, 571.95 MB, 572.19 MB, 572.95 MB, 570.02 MB, 571.23 MB, 573.76 MB, 573.17 MB, 571.76 MB, 572.12 MB, 571.46 MB ThreadUsage(4m16s): 35, 36, 36, 36, 28, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12 - AverageThreadTokens: 13.96 - PeakMemoryUsage: 1.28 GB (1369936800) - PerHostPeakMemUsage: 1.28 GB (1369936800) - PrepareTime: 182.559ms - RowsProduced: 5.32B (5317452506) - TotalCpuTime: 56h31m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 28m2s BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 27.12 GB (29116020736) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 836.746ms, non-child: 836.746ms, % non-child: 100.00%) - CodegenTime: 8.32ms - CompileTime: 214.840ms - LoadTime: 99.140us - ModuleFileSize: 1.95 MB (2047308) - OptimizationTime: 455.159ms - PrepareTime: 165.320ms HdfsTableSink:(Total: 4h4m, non-child: 4h4m, % non-child: 100.00%) - BytesWritten: 132.01 GB (141742042211) - CompressTimer: 19m56s - EncodeTimer: 3h39m - FilesCreated: 540 - FinalizePartitionFileTimer: 24m44s - HdfsWriteTimer: 24m7s - PartitionsCreated: 1 - PeakMemoryUsage: 308.24 MB (323212192) - RowsInserted: 5.32B (5317452506) - TmpFileCreateTimer: 4s476ms HDFS_SCAN_NODE (id=0):(Total: 31s017ms, non-child: 31s017ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:7852/981.07 GB Hdfs Read Thread Concurrency Bucket: 0:68.41% 1:31.59% 2:0% 3:0% File Formats: TEXT/NONE:7852 ExecOption: Codegen enabled: 7852 out of 7852 BytesRead(4m16s): 8.81 GB, 25.62 GB, 42.47 GB, 58.96 GB, 75.74 GB, 92.47 GB, 109.11 GB, 126.01 GB, 143.25 GB, 159.86 GB, 176.96 GB, 194.42 GB, 211.24 GB, 228.18 GB, 245.09 GB, 262.04 GB, 279.10 GB, 296.25 GB, 313.15 GB, 330.14 GB, 347.24 GB, 364.09 GB, 380.85 GB, 397.58 GB, 414.56 GB, 431.77 GB, 449.12 GB, 466.12 GB, 483.06 GB, 500.41 GB, 517.78 GB, 535.26 GB, 553.05 GB, 570.72 GB, 588.34 GB, 605.91 GB, 622.90 GB, 640.32 GB, 657.68 GB, 674.50 GB, 692.24 GB, 709.23 GB, 726.33 GB, 743.46 GB, 760.53 GB, 777.80 GB, 794.97 GB, 811.89 GB, 828.68 GB, 845.47 GB, 862.60 GB, 879.72 GB, 896.65 GB, 913.88 GB, 931.12 GB, 948.27 GB, 965.67 GB - AverageHdfsReadThreadConcurrency: 0.32 - AverageScannerThreadConcurrency: 12.96 - BytesRead: 981.08 GB (1053427122870) - BytesReadDataNodeCache: 0 - BytesReadLocal: 981.08 GB (1053427122870) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 981.08 GB (1053427122870) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.04 GB (1121677312) - PerReadThreadRawHdfsThroughput: 217.89 MB/sec - RemoteScanRanges: 0 - RowsRead: 5.32B (5317452506) - RowsReturned: 5.32B (5317452506) - RowsReturnedRate: 171.43 M/sec - ScanRangesComplete: 7.85K (7852) - ScannerThreadsInvoluntaryContextSwitches: 82.32K (82318) - ScannerThreadsTotalWallClockTime: 52h54m - DelimiterParseTime: 35m54s - MaterializeTupleTime(*): 1h25m - ScannerThreadsSysTime: 43s975ms - ScannerThreadsUserTime: 2h4m - ScannerThreadsVoluntaryContextSwitches: 5.26M (5263729) - TotalRawHdfsReadTime(*): 1h16m - TotalReadThroughput: 68.35 MB/sec Instance 624f3c1550318e89:1c44b0304366099 (host=hadoop03:22000):(Total: 4h4m, non-child: 6s901ms, % non-child: 0.05%) Hdfs split stats (:<# splits>/): 0:7849/981.07 GB MemoryUsage(4m16s): 1.07 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.06 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.05 GB, 1.06 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.05 GB, 1.06 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.06 GB, 1.05 GB, 1.06 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB, 1.05 GB ThreadUsage(4m16s): 35, 36, 36, 36, 35, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34, 34 - AverageThreadTokens: 34.13 - PeakMemoryUsage: 1.29 GB (1389959312) - PerHostPeakMemUsage: 1.29 GB (1389959312) - PrepareTime: 192.963ms - RowsProduced: 5.32B (5315283705) - TotalCpuTime: 138h24m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 34m34s BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 27.12 GB (29116858368) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 850.522ms, non-child: 850.522ms, % non-child: 100.00%) - CodegenTime: 8.424ms - CompileTime: 216.351ms - LoadTime: 98.74us - ModuleFileSize: 1.95 MB (2047308) - OptimizationTime: 458.80ms - PrepareTime: 174.592ms HdfsTableSink:(Total: 4h3m, non-child: 4h3m, % non-child: 100.00%) - BytesWritten: 132.59 GB (142372384891) - CompressTimer: 20m11s - EncodeTimer: 3h38m - FilesCreated: 542 - FinalizePartitionFileTimer: 24m24s - HdfsWriteTimer: 23m48s - PartitionsCreated: 1 - PeakMemoryUsage: 303.30 MB (318036112) - RowsInserted: 5.32B (5315283705) - TmpFileCreateTimer: 4s385ms HDFS_SCAN_NODE (id=0):(Total: 30s012ms, non-child: 30s012ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:7849/981.07 GB Hdfs Read Thread Concurrency Bucket: 0:54.9% 1:45.1% 2:0% 3:0% File Formats: TEXT/NONE:7849 ExecOption: Codegen enabled: 7849 out of 7849 BytesRead(4m16s): 8.98 GB, 26.21 GB, 43.34 GB, 60.54 GB, 77.49 GB, 94.34 GB, 111.03 GB, 127.90 GB, 144.70 GB, 162.03 GB, 179.68 GB, 197.19 GB, 214.78 GB, 231.54 GB, 248.52 GB, 264.85 GB, 281.61 GB, 298.54 GB, 315.90 GB, 333.02 GB, 350.33 GB, 367.34 GB, 385.02 GB, 402.46 GB, 420.15 GB, 437.50 GB, 454.84 GB, 472.57 GB, 490.30 GB, 507.90 GB, 525.13 GB, 542.55 GB, 559.91 GB, 577.41 GB, 594.83 GB, 611.93 GB, 628.78 GB, 645.72 GB, 662.68 GB, 679.11 GB, 695.91 GB, 713.07 GB, 730.44 GB, 747.34 GB, 764.41 GB, 781.24 GB, 798.34 GB, 815.37 GB, 832.36 GB, 849.64 GB, 866.59 GB, 883.62 GB, 900.86 GB, 918.22 GB, 935.21 GB, 952.04 GB, 969.18 GB - AverageHdfsReadThreadConcurrency: 0.45 - AverageScannerThreadConcurrency: 33.14 - BytesRead: 981.07 GB (1053419820051) - BytesReadDataNodeCache: 0 - BytesReadLocal: 981.07 GB (1053419820051) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 981.07 GB (1053419820051) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.02 GB (1096122368) - PerReadThreadRawHdfsThroughput: 151.81 MB/sec - RemoteScanRanges: 0 - RowsRead: 5.32B (5315283705) - RowsReturned: 5.32B (5315283705) - RowsReturnedRate: 177.11 M/sec - ScanRangesComplete: 7.85K (7849) - ScannerThreadsInvoluntaryContextSwitches: 69.67K (69669) - ScannerThreadsTotalWallClockTime: 134h54m - DelimiterParseTime: 36m6s - MaterializeTupleTime(*): 1h25m - ScannerThreadsSysTime: 45s123ms - ScannerThreadsUserTime: 2h4m - ScannerThreadsVoluntaryContextSwitches: 5.25M (5253325) - TotalRawHdfsReadTime(*): 1h50m - TotalReadThroughput: 68.55 MB/sec Instance 624f3c1550318e89:1c44b0304366097 (host=hadoop02:22000):(Total: 4h3m, non-child: 7s319ms, % non-child: 0.05%) Hdfs split stats (:<# splits>/): 0:7850/981.05 GB MemoryUsage(4m16s): 1.07 GB, 1.10 GB, 1.10 GB, 1.10 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.07 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.07 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB, 1.08 GB ThreadUsage(4m16s): 35, 36, 36, 36, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 35, 34 - AverageThreadTokens: 35.05 - PeakMemoryUsage: 1.25 GB (1344201872) - PerHostPeakMemUsage: 1.25 GB (1344201872) - PrepareTime: 180.210ms - RowsProduced: 5.32B (5316621560) - TotalCpuTime: 141h46m - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 37m36s BlockMgr: - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 27.12 GB (29116858368) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0ns - TotalEncryptionTime: 0ns - TotalIntegrityCheckTime: 0ns - TotalReadBlockTime: 0ns CodeGen:(Total: 830.343ms, non-child: 830.343ms, % non-child: 100.00%) - CodegenTime: 8.215ms - CompileTime: 213.978ms - LoadTime: 81.682us - ModuleFileSize: 1.95 MB (2047308) - OptimizationTime: 452.1ms - PrepareTime: 162.938ms HdfsTableSink:(Total: 4h2m, non-child: 4h2m, % non-child: 100.00%) - BytesWritten: 132.46 GB (142232689288) - CompressTimer: 20m10s - EncodeTimer: 3h37m - FilesCreated: 542 - FinalizePartitionFileTimer: 24m57s - HdfsWriteTimer: 24m18s - PartitionsCreated: 1 - PeakMemoryUsage: 307.30 MB (322229392) - RowsInserted: 5.32B (5316621560) - TmpFileCreateTimer: 4s445ms HDFS_SCAN_NODE (id=0):(Total: 31s119ms, non-child: 31s119ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:7850/981.05 GB Hdfs Read Thread Concurrency Bucket: 0:52.35% 1:47.65% 2:0% 3:0% File Formats: TEXT/NONE:7850 ExecOption: Codegen enabled: 7850 out of 7850 BytesRead(4m16s): 8.88 GB, 26.12 GB, 43.49 GB, 60.75 GB, 78.27 GB, 95.48 GB, 112.13 GB, 129.32 GB, 146.12 GB, 162.60 GB, 179.90 GB, 197.39 GB, 214.93 GB, 231.73 GB, 249.01 GB, 266.09 GB, 283.14 GB, 300.51 GB, 317.90 GB, 335.22 GB, 352.28 GB, 369.21 GB, 386.16 GB, 403.53 GB, 420.50 GB, 437.94 GB, 455.48 GB, 473.10 GB, 490.28 GB, 507.05 GB, 523.88 GB, 540.48 GB, 557.71 GB, 574.87 GB, 592.40 GB, 609.68 GB, 626.99 GB, 644.51 GB, 662.07 GB, 679.56 GB, 697.30 GB, 714.20 GB, 731.37 GB, 748.94 GB, 766.40 GB, 783.92 GB, 801.25 GB, 818.27 GB, 835.11 GB, 852.09 GB, 869.05 GB, 886.18 GB, 903.35 GB, 920.36 GB, 937.29 GB, 954.36 GB, 971.18 GB - AverageHdfsReadThreadConcurrency: 0.48 - AverageScannerThreadConcurrency: 34.06 - BytesRead: 981.06 GB (1053404216479) - BytesReadDataNodeCache: 0 - BytesReadLocal: 981.06 GB (1053404216479) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 981.06 GB (1053404216479) - DecompressionTime: 0ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 35 - PeakMemoryUsage: 1.03 GB (1104900096) - PerReadThreadRawHdfsThroughput: 144.17 MB/sec - RemoteScanRanges: 0 - RowsRead: 5.32B (5316621560) - RowsReturned: 5.32B (5316621560) - RowsReturnedRate: 170.84 M/sec - ScanRangesComplete: 7.85K (7850) - ScannerThreadsInvoluntaryContextSwitches: 69.63K (69631) - ScannerThreadsTotalWallClockTime: 138h20m - DelimiterParseTime: 36m11s - MaterializeTupleTime(*): 1h26m - ScannerThreadsSysTime: 42s415ms - ScannerThreadsUserTime: 2h5m - ScannerThreadsVoluntaryContextSwitches: 5.26M (5259412) - TotalRawHdfsReadTime(*): 1h56m - TotalReadThroughput: 68.70 MB/sec