Query (id=8e42caaf58ad5a3e:5720018d00000000): Summary: Session ID: a6434d927f67b33e:f71c1036df84b294 Session Type: BEESWAX Start Time: 2018-03-14 19:30:22.135873000 End Time: 2018-03-15 06:48:49.025550000 Query Type: DML Query State: FINISHED Query Status: OK Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE (build 10fd2c77bf623fe3f08e4c416539903e16cc410a) User: mmokhtar Connected User: mmokhtar Delegated User: Network Address: 10.17.235.49:60260 Default Db: default Sql Statement: insert INTO TABLE lineitem_4 SELECT L_SHIPDATE, L_ORDERKEY, L_LINENUMBER, L_PARTKEY, L_SUPPKEY, L_QUANTITY, L_EXTENDEDPRICE, L_DISCOUNT, L_TAX, L_RETURNFLAG, L_LINESTATUS, L_COMMITDATE, L_RECEIPTDATE, L_SHIPINSTRUCT, L_SHIPMODE, L_COMMENT FROM tpch_1000_text.lineitem Coordinator: vd1439.halxg.cloudera.com:22000 Query Options (set by configuration): Query Options (set by configuration and planner): MT_DOP=0 Plan: ---------------- Max Per-Host Resource Reservation: Memory=4.00MB Per-Host Resource Estimates: Memory=7.69GB WARNING: The following tables are missing relevant table and/or column statistics. tpch_1000_text.lineitem F01:PLAN FRAGMENT [KUDU(KuduPartition(L_ORDERKEY))] hosts=6 instances=6 | Per-Host Resources: mem-estimate=128.00MB mem-reservation=4.00MB INSERT INTO KUDU [default.lineitem_4] | mem-estimate=0B mem-reservation=0B 02:PARTIAL SORT | order by: KuduPartition(L_ORDERKEY) ASC NULLS LAST, l_shipdate ASC NULLS LAST, l_orderkey ASC NULLS LAST, l_linenumber ASC NULLS LAST | materialized: KuduPartition(L_ORDERKEY) | mem-estimate=128.00MB mem-reservation=4.00MB spill-buffer=2.00MB | tuple-ids=1 row-size=188B cardinality=unavailable 01:EXCHANGE [KUDU(KuduPartition(L_ORDERKEY))] | mem-estimate=0B mem-reservation=0B | tuple-ids=0 row-size=184B cardinality=unavailable | F00:PLAN FRAGMENT [RANDOM] hosts=6 instances=6 Per-Host Resources: mem-estimate=7.56GB mem-reservation=0B 00:SCAN HDFS [tpch_1000_text.lineitem, RANDOM] partitions=1/1 files=480 size=757.86GB stored statistics: table: rows=unavailable size=757.86GB columns: unavailable extrapolated-rows=disabled mem-estimate=7.56GB mem-reservation=0B tuple-ids=0 row-size=184B cardinality=unavailable ---------------- Estimated Per-Host Mem: 8254390272 Tables Missing Stats: tpch_1000_text.lineitem Per Host Min Reservation: vd1439.foo:22000(4.00 MB) vd1441.foo:22000(4.00 MB) vd1442.foo:22000(4.00 MB) ve1109.foo:22000(4.00 MB) ve1110.foo:22000(4.00 MB) ve1111.foo:22000(4.00 MB) Request Pool: root.mmokhtar Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail --------------------------------------------------------------------------------------------------------------------------- 02:PARTIAL SORT 6 1h10m 1h13m 6.00B -1 161.39 GB 128.00 MB 01:EXCHANGE 6 7h13m 7h17m 6.00B -1 10.02 MB 0 KUDU(KuduPartition(L_ORDERKEY)) 00:SCAN HDFS 6 6s464ms 7s887ms 6.00B -1 2.18 GB 7.56 GB tpch_1000_text.lineitem Errors: Query Compilation: 25.918ms - Metadata of all 2 tables cached: 3.951ms (3.951ms) - Analysis finished: 7.560ms (3.609ms) - Value transfer graph computed: 7.789ms (229.016us) - Single node plan created: 16.312ms (8.522ms) - Runtime filters computed: 16.381ms (68.848us) - Distributed plan created: 18.039ms (1.658ms) - Lineage info computed: 20.344ms (2.304ms) - Planning finished: 25.918ms (5.574ms) Query Timeline: 11h18m - Query submitted: 64.327us (64.327us) - Planning finished: 50.176ms (50.111ms) - Submit for admission: 62.982ms (12.806ms) - Completed admission: 63.232ms (249.261us) - Ready to start on 6 backends: 63.546ms (314.092us) - All 6 execution backends (12 fragment instances) started: 70.054ms (6.508ms) - Released admission control resources: 11h18m (11h18m) - DML data written: 11h18m (3.078ms) - DML Metastore update finished: 11h18m (4.506ms) - Request finished: 11h18m (904.887us) - Unregister query: 11h18m (901.630ms) - ComputeScanRangeAssignmentTimer: 8.274ms ImpalaServer: - ClientFetchWaitTimer: 901.382ms - MetastoreUpdateTimer: 5.397ms - RowMaterializationTimer: 0.000ns Execution Profile 8e42caaf58ad5a3e:5720018d00000000:(Total: 11h18m, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 6, min / max: 3ms / 5ms, 25th %-ile: 4ms, 50th %-ile: 4ms, 75th %-ile: 5ms, 90th %-ile: 5ms, 95th %-ile: 5ms, 99.9th %-ile: 5ms DML Stats: Partition: Default NumModifiedRows: 5999989709 NumRowErrors: 0 BytesWritten: 0 Per Node Peak Memory Usage: vd1439.foo:22000(163.59 GB) vd1441.foo:22000(163.59 GB) vd1442.foo:22000(163.59 GB) ve1109.foo:22000(163.39 GB) ve1110.foo:22000(163.39 GB) ve1111.foo:22000(163.40 GB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns - NumBackends: 6 (6) - NumFragmentInstances: 12 (12) - NumFragments: 2 (2) Averaged Fragment F01:(Total: 11h15m, non-child: 1s968ms, % non-child: 0.00%) split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:11h13m max:11h18m mean: 11h15m stddev:1m43s execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 6 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317354455) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.49 GB (175547412505) - RowsProduced: 1000.00M (999998284) - TotalNetworkReceiveTime: 7h12m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 880.62K (880615) - TotalThreadsTotalWallClockTime: 11h15m - TotalThreadsSysTime: 9m53s - TotalThreadsUserTime: 2h2m - TotalThreadsVoluntaryContextSwitches: 2.71M (2705410) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h15m - ExecTreeExecTime: 8h23m - OpenTime: 162.139ms - ExecTreeOpenTime: 107.048ms - PrepareTime: 14.351ms - ExecTreePrepareTime: 227.766us KuduTableSink:(Total: 2h51m, non-child: 2h51m, % non-child: 100.00%) - KuduApplyTimer: 2h23m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 97.31 K/sec - TotalNumRows: 1000.00M (999998284) SORT_NODE (id=2):(Total: 8h23m, non-child: 1h10m, % non-child: 14.04%) - InMemorySortTime: 46m39s - PeakMemoryUsage: 161.39 GB (173285875911) - RowsReturned: 1000.00M (999998284) - RowsReturnedRate: 33.07 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.98 GB (273784940415) Buffer pool: - AllocTime: 5m55s - CumulativeAllocationBytes: 255.00 GB (273801718442) - CumulativeAllocations: 130.56K (130558) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h13m, non-child: 7h13m, % non-child: 100.00%) - ConvertRowBatchTime: 17s825ms - PeakMemoryUsage: 10.02 MB (10508541) - RowsReturned: 1000.00M (999998284) - RowsReturnedRate: 38.48 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: - BytesReceived: 120.62 GB (129515444819) - DeserializeRowBatchTimer: 12m52s - FirstBatchArrivalWaitTime: 106.857ms - PeakMemoryUsage: 10.02 MB (10508541) - SendersBlockedTimer: 1h30m - SendersBlockedTotalTimer(*): 9h5m CodeGen:(Total: 53.997ms, non-child: 53.997ms, % non-child: 100.00%) - CodegenTime: 1.008ms - CompileTime: 5.443ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.341ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 20.701ms Fragment F01: Instance 8e42caaf58ad5a3e:5720018d00000006 (host=vd1442.foo:22000):(Total: 11h18m, non-child: 1s942ms, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 11h18m - Prepare Finished: 14.266ms (14.266ms) - Open Finished: 176.612ms (162.345ms) - First Batch Produced: 1h9m (1h9m) - First Batch Sent: 1h9m (27.817ms) - ExecInternal Finished: 11h18m (10h8m) MemoryUsage(17m4s): 63.69 GB, 129.19 GB, 159.71 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB ThreadUsage(17m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317362649) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.59 GB (175651547260) - RowsProduced: 1.00B (1000023903) - TotalNetworkReceiveTime: 7h13m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 909.21K (909213) - TotalThreadsTotalWallClockTime: 11h18m - TotalThreadsSysTime: 10m3s - TotalThreadsUserTime: 2h5m - TotalThreadsVoluntaryContextSwitches: 2.63M (2629781) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h18m - ExecTreeExecTime: 8h27m - OpenTime: 162.336ms - ExecTreeOpenTime: 107.569ms - PrepareTime: 13.935ms - ExecTreePrepareTime: 283.791us KuduTableSink:(Total: 2h50m, non-child: 2h50m, % non-child: 100.00%) - KuduApplyTimer: 2h22m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 97.55 K/sec - TotalNumRows: 1.00B (1000023903) SORT_NODE (id=2):(Total: 8h27m, non-child: 1h13m, % non-child: 14.52%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 500.01M (500011951) ; Min: 367.13M (367132699) ; Max: 632.89M (632891204) ; Number of samples: 2) - InMemorySortTime: 48m53s - PeakMemoryUsage: 161.39 GB (173285875954) - RowsReturned: 1.00B (1000023903) - RowsReturnedRate: 32.84 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.99 GB (273791727012) Buffer pool: - AllocTime: 6m20s - CumulativeAllocationBytes: 255.00 GB (273808359424) - CumulativeAllocations: 130.56K (130562) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h13m, non-child: 7h13m, % non-child: 100.00%) - ConvertRowBatchTime: 17s708ms - PeakMemoryUsage: 10.02 MB (10508828) - RowsReturned: 1.00B (1000023903) - RowsReturnedRate: 38.42 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(17m4s): 30.12 GB, 61.10 GB, 75.54 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 76.36 GB, 98.95 GB, 120.62 GB, 120.62 GB, 120.62 GB, 120.62 GB - BytesReceived: 120.62 GB (129518741431) - DeserializeRowBatchTimer: 13m4s - FirstBatchArrivalWaitTime: 107.363ms - PeakMemoryUsage: 10.02 MB (10508828) - SendersBlockedTimer: 2h15m - SendersBlockedTotalTimer(*): 13h31m CodeGen:(Total: 53.846ms, non-child: 53.846ms, % non-child: 100.00%) - CodegenTime: 943.643us - CompileTime: 4.558ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.323ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.475ms Instance 8e42caaf58ad5a3e:5720018d00000008 (host=ve1110.foo:22000):(Total: 11h16m, non-child: 3s010ms, % non-child: 0.01%) Fragment Instance Lifecycle Event Timeline: 11h16m - Prepare Finished: 16.006ms (16.006ms) - Open Finished: 177.468ms (161.461ms) - First Batch Produced: 3h22m (3h22m) - First Batch Sent: 3h22m (1s049ms) - ExecInternal Finished: 11h16m (7h54m) MemoryUsage(17m4s): 63.70 GB, 129.18 GB, 159.70 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB ThreadUsage(17m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317363891) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.39 GB (175442636024) - RowsProduced: 1.00B (1000031055) - TotalNetworkReceiveTime: 7h16m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 856.87K (856872) - TotalThreadsTotalWallClockTime: 11h16m - TotalThreadsSysTime: 10m3s - TotalThreadsUserTime: 2h - TotalThreadsVoluntaryContextSwitches: 2.63M (2630115) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h16m - ExecTreeExecTime: 8h24m - OpenTime: 161.452ms - ExecTreeOpenTime: 104.692ms - PrepareTime: 15.672ms - ExecTreePrepareTime: 185.445us KuduTableSink:(Total: 2h51m, non-child: 2h51m, % non-child: 100.00%) - KuduApplyTimer: 2h23m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 97.16 K/sec - TotalNumRows: 1.00B (1000031055) SORT_NODE (id=2):(Total: 8h24m, non-child: 1h7m, % non-child: 13.30%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 500.02M (500015527) ; Min: 367.14M (367139851) ; Max: 632.89M (632891204) ; Number of samples: 2) - InMemorySortTime: 43m58s - PeakMemoryUsage: 161.39 GB (173285876005) - RowsReturned: 1.00B (1000031055) - RowsReturnedRate: 33.04 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.99 GB (273794030357) Buffer pool: - AllocTime: 5m10s - CumulativeAllocationBytes: 255.01 GB (273810456576) - CumulativeAllocations: 130.56K (130563) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h17m, non-child: 7h17m, % non-child: 100.00%) - ConvertRowBatchTime: 17s451ms - PeakMemoryUsage: 10.02 MB (10509175) - RowsReturned: 1.00B (1000031055) - RowsReturnedRate: 38.11 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(17m4s): 30.12 GB, 61.10 GB, 75.53 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 98.95 GB, 120.62 GB, 120.62 GB, 120.62 GB, 120.62 GB - BytesReceived: 120.62 GB (129519672693) - DeserializeRowBatchTimer: 11m39s - FirstBatchArrivalWaitTime: 104.349ms - PeakMemoryUsage: 10.02 MB (10509175) - SendersBlockedTimer: 2h13m - SendersBlockedTotalTimer(*): 13h20m CodeGen:(Total: 55.438ms, non-child: 55.438ms, % non-child: 100.00%) - CodegenTime: 994.820us - CompileTime: 4.942ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 28.625ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.325ms Instance 8e42caaf58ad5a3e:5720018d00000007 (host=vd1439.foo:22000):(Total: 11h15m, non-child: 1s802ms, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 11h15m - Prepare Finished: 14.489ms (14.489ms) - Open Finished: 177.195ms (162.705ms) - First Batch Produced: 3h24m (3h24m) - First Batch Sent: 3h24m (18.198ms) - ExecInternal Finished: 11h15m (7h51m) MemoryUsage(17m4s): 63.70 GB, 129.18 GB, 159.70 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB ThreadUsage(17m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317348684) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.59 GB (175650036191) - RowsProduced: 999.97M (999966661) - TotalNetworkReceiveTime: 7h12m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 868.79K (868792) - TotalThreadsTotalWallClockTime: 11h15m - TotalThreadsSysTime: 10m9s - TotalThreadsUserTime: 2h2m - TotalThreadsVoluntaryContextSwitches: 2.74M (2736110) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h15m - ExecTreeExecTime: 8h22m - OpenTime: 162.702ms - ExecTreeOpenTime: 107.516ms - PrepareTime: 14.166ms - ExecTreePrepareTime: 173.164us KuduTableSink:(Total: 2h52m, non-child: 2h52m, % non-child: 100.00%) - KuduApplyTimer: 2h25m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 96.43 K/sec - TotalNumRows: 999.97M (999966661) SORT_NODE (id=2):(Total: 8h22m, non-child: 1h9m, % non-child: 13.89%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 499.98M (499983330) ; Min: 367.08M (367075457) ; Max: 632.89M (632891204) ; Number of samples: 2) - InMemorySortTime: 45m55s - PeakMemoryUsage: 161.39 GB (173285875868) - RowsReturned: 999.97M (999966661) - RowsReturnedRate: 33.15 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.97 GB (273776943490) Buffer pool: - AllocTime: 5m51s - CumulativeAllocationBytes: 254.99 GB (273793679360) - CumulativeAllocations: 130.56K (130555) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h12m, non-child: 7h12m, % non-child: 100.00%) - ConvertRowBatchTime: 17s848ms - PeakMemoryUsage: 10.02 MB (10508520) - RowsReturned: 999.97M (999966661) - RowsReturnedRate: 38.49 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(17m4s): 30.12 GB, 61.10 GB, 75.53 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 98.93 GB, 120.62 GB, 120.62 GB, 120.62 GB, 120.62 GB - BytesReceived: 120.62 GB (129511556238) - DeserializeRowBatchTimer: 13m9s - FirstBatchArrivalWaitTime: 107.491ms - PeakMemoryUsage: 10.02 MB (10508520) - SendersBlockedTimer: 3m40s - SendersBlockedTotalTimer(*): 22m4s CodeGen:(Total: 54.211ms, non-child: 54.211ms, % non-child: 100.00%) - CodegenTime: 1.024ms - CompileTime: 4.916ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.309ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 22.509ms Instance 8e42caaf58ad5a3e:5720018d00000009 (host=ve1109.foo:22000):(Total: 11h13m, non-child: 1s581ms, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 11h13m - Prepare Finished: 13.858ms (13.858ms) - Open Finished: 176.415ms (162.556ms) - First Batch Produced: 3h25m (3h25m) - First Batch Sent: 3h25m (13.406ms) - ExecInternal Finished: 11h13m (7h48m) MemoryUsage(17m4s): 63.69 GB, 129.19 GB, 159.69 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.40 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB ThreadUsage(17m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317341668) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.39 GB (175443572195) - RowsProduced: 999.97M (999973138) - TotalNetworkReceiveTime: 7h10m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 861.69K (861692) - TotalThreadsTotalWallClockTime: 11h13m - TotalThreadsSysTime: 9m51s - TotalThreadsUserTime: 2h1m - TotalThreadsVoluntaryContextSwitches: 2.66M (2657965) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h13m - ExecTreeExecTime: 8h21m - OpenTime: 162.546ms - ExecTreeOpenTime: 113.489ms - PrepareTime: 13.526ms - ExecTreePrepareTime: 238.807us KuduTableSink:(Total: 2h51m, non-child: 2h51m, % non-child: 100.00%) - KuduApplyTimer: 2h24m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 96.96 K/sec - TotalNumRows: 999.97M (999973138) SORT_NODE (id=2):(Total: 8h21m, non-child: 1h10m, % non-child: 14.06%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 499.99M (499986569) ; Min: 367.08M (367081934) ; Max: 632.89M (632891204) ; Number of samples: 2) - InMemorySortTime: 46m2s - PeakMemoryUsage: 161.39 GB (173285875789) - RowsReturned: 999.97M (999973138) - RowsReturnedRate: 33.21 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.98 GB (273777906304) Buffer pool: - AllocTime: 6m10s - CumulativeAllocationBytes: 254.99 GB (273795776512) - CumulativeAllocations: 130.56K (130556) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h11m, non-child: 7h11m, % non-child: 100.00%) - ConvertRowBatchTime: 17s935ms - PeakMemoryUsage: 10.02 MB (10508845) - RowsReturned: 999.97M (999973138) - RowsReturnedRate: 38.64 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(17m4s): 30.12 GB, 61.10 GB, 75.53 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 98.92 GB, 120.62 GB, 120.62 GB, 120.62 GB, 120.62 GB - BytesReceived: 120.62 GB (129512103259) - DeserializeRowBatchTimer: 12m44s - FirstBatchArrivalWaitTime: 113.324ms - PeakMemoryUsage: 10.02 MB (10508845) - SendersBlockedTimer: 1m - SendersBlockedTotalTimer(*): 6m1s CodeGen:(Total: 47.944ms, non-child: 47.944ms, % non-child: 100.00%) - CodegenTime: 986.562us - CompileTime: 4.735ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 26.335ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 16.415ms Instance 8e42caaf58ad5a3e:5720018d0000000b (host=ve1111.foo:22000):(Total: 11h13m, non-child: 1s755ms, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 11h13m - Prepare Finished: 15.901ms (15.901ms) - Open Finished: 176.880ms (160.979ms) - First Batch Produced: 7h56m (7h56m) - First Batch Sent: 7h56m (15.153ms) - ExecInternal Finished: 11h13m (3h16m) MemoryUsage(17m4s): 63.71 GB, 129.18 GB, 159.68 GB, 161.38 GB, 161.38 GB, 161.38 GB, 161.38 GB, 161.38 GB, 161.38 GB, 161.38 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB ThreadUsage(17m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317346708) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.40 GB (175446706386) - RowsProduced: 999.98M (999983788) - TotalNetworkReceiveTime: 7h11m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 864.23K (864227) - TotalThreadsTotalWallClockTime: 11h13m - TotalThreadsSysTime: 9m29s - TotalThreadsUserTime: 2h3m - TotalThreadsVoluntaryContextSwitches: 2.66M (2655395) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h13m - ExecTreeExecTime: 8h22m - OpenTime: 160.972ms - ExecTreeOpenTime: 100.061ms - PrepareTime: 15.543ms - ExecTreePrepareTime: 249.827us KuduTableSink:(Total: 2h51m, non-child: 2h51m, % non-child: 100.00%) - KuduApplyTimer: 2h22m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 97.39 K/sec - TotalNumRows: 999.98M (999983788) SORT_NODE (id=2):(Total: 8h22m, non-child: 1h10m, % non-child: 14.11%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 499.99M (499991894) ; Min: 367.09M (367092584) ; Max: 632.89M (632891204) ; Number of samples: 2) - InMemorySortTime: 46m55s - PeakMemoryUsage: 161.39 GB (173285876058) - RowsReturned: 999.98M (999983788) - RowsReturnedRate: 33.16 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.98 GB (273780737269) Buffer pool: - AllocTime: 5m43s - CumulativeAllocationBytes: 254.99 GB (273797873664) - CumulativeAllocations: 130.56K (130557) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h11m, non-child: 7h11m, % non-child: 100.00%) - ConvertRowBatchTime: 18s273ms - PeakMemoryUsage: 10.02 MB (10506848) - RowsReturned: 999.98M (999983788) - RowsReturnedRate: 38.61 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(17m4s): 30.12 GB, 61.10 GB, 75.52 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 98.95 GB, 120.62 GB, 120.62 GB, 120.62 GB, 120.62 GB - BytesReceived: 120.62 GB (129513537646) - DeserializeRowBatchTimer: 13m10s - FirstBatchArrivalWaitTime: 99.881ms - PeakMemoryUsage: 10.02 MB (10506848) - SendersBlockedTimer: 2h18m - SendersBlockedTotalTimer(*): 13h49m CodeGen:(Total: 59.696ms, non-child: 59.696ms, % non-child: 100.00%) - CodegenTime: 1.034ms - CompileTime: 8.572ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 29.004ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 21.528ms Instance 8e42caaf58ad5a3e:5720018d0000000a (host=vd1441.foo:22000):(Total: 11h13m, non-child: 1s716ms, % non-child: 0.00%) Fragment Instance Lifecycle Event Timeline: 11h13m - Prepare Finished: 13.588ms (13.588ms) - Open Finished: 176.430ms (162.841ms) - First Batch Produced: 5h39m (5h39m) - First Batch Sent: 5h39m (24.623ms) - ExecInternal Finished: 11h13m (5h33m) MemoryUsage(17m4s): 63.69 GB, 129.17 GB, 159.69 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.39 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.41 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB, 161.40 GB ThreadUsage(17m4s): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 161.41 GB (173317363133) - PeakReservation: 161.38 GB (173285572608) - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.59 GB (175649976978) - RowsProduced: 1.00B (1000011164) - TotalNetworkReceiveTime: 7h11m - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 922.90K (922899) - TotalThreadsTotalWallClockTime: 11h13m - TotalThreadsSysTime: 9m42s - TotalThreadsUserTime: 2h3m - TotalThreadsVoluntaryContextSwitches: 2.92M (2923095) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 11h13m - ExecTreeExecTime: 8h24m - OpenTime: 162.828ms - ExecTreeOpenTime: 108.961ms - PrepareTime: 13.268ms - ExecTreePrepareTime: 235.564us KuduTableSink:(Total: 2h49m, non-child: 2h49m, % non-child: 100.00%) - KuduApplyTimer: 2h21m - NumRowErrors: 0 (0) - PeakMemoryUsage: 20.00 MB (20971520) - RowsProcessedRate: 98.39 K/sec - TotalNumRows: 1.00B (1000011164) SORT_NODE (id=2):(Total: 8h24m, non-child: 1h12m, % non-child: 14.36%) SortType: Partial ExecOption: Codegen Enabled - NumRowsPerRun: (Avg: 500.01M (500005582) ; Min: 367.12M (367119960) ; Max: 632.89M (632891204) ; Number of samples: 2) - InMemorySortTime: 48m12s - PeakMemoryUsage: 161.39 GB (173285875793) - RowsReturned: 1.00B (1000011164) - RowsReturnedRate: 33.05 K/sec - RunsCreated: 2 (2) - SortDataSize: 254.99 GB (273788298061) Buffer pool: - AllocTime: 6m14s - CumulativeAllocationBytes: 255.00 GB (273804165120) - CumulativeAllocations: 130.56K (130560) - PeakReservation: 161.38 GB (173285572608) - PeakUnpinnedBytes: 0 - PeakUsedReservation: 161.38 GB (173285572608) - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns EXCHANGE_NODE (id=1):(Total: 7h11m, non-child: 7h11m, % non-child: 100.00%) - ConvertRowBatchTime: 17s735ms - PeakMemoryUsage: 10.02 MB (10509032) - RowsReturned: 1.00B (1000011164) - RowsReturnedRate: 38.59 K/sec Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns DataStreamReceiver: BytesReceived(17m4s): 30.12 GB, 61.09 GB, 75.53 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.33 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.34 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 76.35 GB, 98.95 GB, 120.62 GB, 120.62 GB, 120.62 GB, 120.62 GB - BytesReceived: 120.62 GB (129517057649) - DeserializeRowBatchTimer: 13m23s - FirstBatchArrivalWaitTime: 108.736ms - PeakMemoryUsage: 10.02 MB (10509032) - SendersBlockedTimer: 2h13m - SendersBlockedTotalTimer(*): 13h19m CodeGen:(Total: 52.844ms, non-child: 52.844ms, % non-child: 100.00%) - CodegenTime: 1.069ms - CompileTime: 4.937ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 32 (32) - NumInstructions: 612 (612) - OptimizationTime: 27.448ms - PeakMemoryUsage: 306.00 KB (313344) - PrepareTime: 19.950ms Averaged Fragment F00:(Total: 9h53m, non-child: 9h36m, % non-child: 97.13%) split sizes: min: 126.27 GB, max: 126.38 GB, avg: 126.31 GB, stddev: 37.25 MB completion times: min:9h52m max:9h53m mean: 9h53m stddev:30s433ms execution rates: min:3.63 MB/sec max:3.64 MB/sec mean:3.63 MB/sec stddev:3.36 KB/sec num instances: 6 - AverageThreadTokens: 84.94 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.08 GB (2238305873) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.49 GB (175547412505) - RowsProduced: 1000.00M (999998284) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h25m - TotalStorageWaitTime: 4m54s - TotalThreadsInvoluntaryContextSwitches: 568.89K (568891) - TotalThreadsTotalWallClockTime: 840h6m - TotalThreadsSysTime: 4m41s - TotalThreadsUserTime: 42m1s - TotalThreadsVoluntaryContextSwitches: 1.22M (1220925) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h53m - ExecTreeExecTime: 7s265ms - OpenTime: 146.605ms - ExecTreeOpenTime: 56.909us - PrepareTime: 14.411ms - ExecTreePrepareTime: 3.632ms DataStreamSender (dst_id=1):(Total: 16m56s, non-child: 16m56s, % non-child: 100.00%) - BytesSent: 120.62 GB (129515444819) - NetworkThroughput(*): 577.19 MB/sec - OverallThroughput: 121.54 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 1000.00M (999998284) - SerializeBatchTime: 13m21s - TransmitDataRPCTime: 3m34s - UncompressedRowBatchSize: 257.78 GB (276784935270) HDFS_SCAN_NODE (id=0):(Total: 6s464ms, non-child: 6s464ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 83.94 - BytesRead: 126.37 GB (135687215193) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.34 GB (135656588036) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.34 GB (135656588036) - CachedFileHandlesHitCount: 15.97K (15966) - CachedFileHandlesMissCount: 1.21K (1205) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 84 (84) - PeakMemoryUsage: 2.08 GB (2238124714) - PerReadThreadRawHdfsThroughput: 76.32 MB/sec - RemoteScanRanges: 934 (934) - RowBatchQueueGetWaitTime: 29.937ms - RowBatchQueuePutWaitTime: 829h41m - RowsRead: 1000.00M (999998284) - RowsReturned: 1000.00M (999998284) - RowsReturnedRate: 156.16 M/sec - ScanRangesComplete: 1.04K (1040) - ScannerThreadsInvoluntaryContextSwitches: 417.50K (417496) - ScannerThreadsTotalWallClockTime: 830h13m - DelimiterParseTime: 10m33s - MaterializeTupleTime(*): 15m9s - ScannerThreadsSysTime: 3m33s - ScannerThreadsUserTime: 20m24s - ScannerThreadsVoluntaryContextSwitches: 1.05M (1051511) - TotalRawHdfsOpenFileTime(*): 25s450ms - TotalRawHdfsReadTime(*): 28m18s - TotalReadThroughput: 3.63 MB/sec CodeGen:(Total: 145.591ms, non-child: 145.591ms, % non-child: 100.00%) - CodegenTime: 2.375ms - CompileTime: 35.830ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 87.659ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 21.590ms Fragment F00: Instance 8e42caaf58ad5a3e:5720018d00000004 (host=vd1441.foo:22000):(Total: 9h53m, non-child: 9h36m, % non-child: 97.07%) Hdfs split stats (:<# splits>/): 7:135/16.14 GB 4:127/15.47 GB 3:135/16.13 GB 1:134/16.21 GB 6:94/11.47 GB 5:128/15.58 GB 2:142/17.20 GB 0:146/18.07 GB Fragment Instance Lifecycle Event Timeline: 9h53m - Prepare Finished: 13.442ms (13.442ms) - Open Finished: 159.070ms (145.628ms) - First Batch Produced: 180.402ms (21.331ms) - First Batch Sent: 183.478ms (3.076ms) - ExecInternal Finished: 9h53m (9h53m) MemoryUsage(17m4s): 2.05 GB, 2.04 GB, 1.76 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.65 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB, 1.66 GB ThreadUsage(17m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.18 GB (2341402193) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.59 GB (175649976978) - RowsProduced: 999.70M (999702652) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h25m - TotalStorageWaitTime: 4m30s - TotalThreadsInvoluntaryContextSwitches: 572.88K (572881) - TotalThreadsTotalWallClockTime: 880h13m - TotalThreadsSysTime: 4m33s - TotalThreadsUserTime: 42m21s - TotalThreadsVoluntaryContextSwitches: 1.21M (1206816) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h53m - ExecTreeExecTime: 7s108ms - OpenTime: 145.625ms - ExecTreeOpenTime: 63.098us - PrepareTime: 12.957ms - ExecTreePrepareTime: 3.311ms DataStreamSender (dst_id=1):(Total: 17m17s, non-child: 17m17s, % non-child: 100.00%) - BytesSent: 120.58 GB (129476870446) - NetworkThroughput(*): 556.04 MB/sec - OverallThroughput: 119.03 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 999.70M (999702652) - SerializeBatchTime: 13m34s - TransmitDataRPCTime: 3m42s - UncompressedRowBatchSize: 257.70 GB (276703685651) HDFS_SCAN_NODE (id=0):(Total: 6s328ms, non-child: 6s328ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:135/16.14 GB 4:127/15.47 GB 3:135/16.13 GB 1:134/16.21 GB 6:94/11.47 GB 5:128/15.58 GB 2:142/17.20 GB 0:146/18.07 GB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1041 out of 1041 Hdfs Read Thread Concurrency Bucket: 0:97.23% 1:1.587% 2:0.7986% 3:0.2751% 4:0.07579% 5:0.01684% 6:0.005614% 7:0.002807% 8:0.007017% 9:0.002807% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:1041 BytesRead(17m4s): 31.94 GB, 63.28 GB, 76.96 GB, 77.60 GB, 77.60 GB, 77.60 GB, 77.60 GB, 77.60 GB, 77.60 GB, 77.60 GB, 77.62 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB, 77.63 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 87.92 - BytesRead: 126.33 GB (135648902905) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.31 GB (135620919033) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.31 GB (135620919033) - CachedFileHandlesHitCount: 15.95K (15954) - CachedFileHandlesMissCount: 1.21K (1214) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 88 (88) - PeakMemoryUsage: 2.18 GB (2341222400) - PerReadThreadRawHdfsThroughput: 80.28 MB/sec - RemoteScanRanges: 854 (854) - RowBatchQueueGetWaitTime: 14.620ms - RowBatchQueuePutWaitTime: 869h47m - RowsRead: 999.70M (999702652) - RowsReturned: 999.70M (999702652) - RowsReturnedRate: 157.96 M/sec - ScanRangesComplete: 1.04K (1041) - ScannerThreadsInvoluntaryContextSwitches: 420.02K (420017) - ScannerThreadsTotalWallClockTime: 870h19m - DelimiterParseTime: 10m34s - MaterializeTupleTime(*): 15m5s - ScannerThreadsSysTime: 3m27s - ScannerThreadsUserTime: 20m26s - ScannerThreadsVoluntaryContextSwitches: 1.04M (1044608) - TotalRawHdfsOpenFileTime(*): 25s942ms - TotalRawHdfsReadTime(*): 26m51s - TotalReadThroughput: 3.63 MB/sec CodeGen:(Total: 144.608ms, non-child: 144.608ms, % non-child: 100.00%) - CodegenTime: 2.272ms - CompileTime: 35.497ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 88.945ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 19.619ms Instance 8e42caaf58ad5a3e:5720018d00000002 (host=ve1110.foo:22000):(Total: 9h53m, non-child: 9h36m, % non-child: 97.11%) Hdfs split stats (:<# splits>/): 7:157/19.22 GB 4:134/16.37 GB 1:123/14.92 GB 3:118/14.19 GB 5:123/15.00 GB 6:132/15.87 GB 0:122/14.58 GB 2:134/16.16 GB Fragment Instance Lifecycle Event Timeline: 9h53m - Prepare Finished: 16.159ms (16.159ms) - Open Finished: 169.280ms (153.120ms) - First Batch Produced: 190.501ms (21.221ms) - First Batch Sent: 192.989ms (2.487ms) - ExecInternal Finished: 9h53m (9h53m) MemoryUsage(17m4s): 1.85 GB, 1.86 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB, 1.92 GB ThreadUsage(17m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135209553) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.39 GB (175442636024) - RowsProduced: 1.00B (1000009884) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h26m - TotalStorageWaitTime: 5m2s - TotalThreadsInvoluntaryContextSwitches: 588.19K (588194) - TotalThreadsTotalWallClockTime: 801h16m - TotalThreadsSysTime: 4m46s - TotalThreadsUserTime: 42m15s - TotalThreadsVoluntaryContextSwitches: 1.23M (1230877) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h53m - ExecTreeExecTime: 8s661ms - OpenTime: 153.118ms - ExecTreeOpenTime: 87.440us - PrepareTime: 15.680ms - ExecTreePrepareTime: 3.538ms DataStreamSender (dst_id=1):(Total: 17m3s, non-child: 17m3s, % non-child: 100.00%) - BytesSent: 120.62 GB (129517250225) - NetworkThroughput(*): 571.66 MB/sec - OverallThroughput: 120.69 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 1.00B (1000009884) - SerializeBatchTime: 13m26s - TransmitDataRPCTime: 3m36s - UncompressedRowBatchSize: 257.78 GB (276788207621) HDFS_SCAN_NODE (id=0):(Total: 7s887ms, non-child: 7s887ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:157/19.22 GB 4:134/16.37 GB 1:123/14.92 GB 3:118/14.19 GB 5:123/15.00 GB 6:132/15.87 GB 0:122/14.58 GB 2:134/16.16 GB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1043 out of 1043 Hdfs Read Thread Concurrency Bucket: 0:97.04% 1:1.604% 2:0.8393% 3:0.341% 4:0.1207% 5:0.03368% 6:0.008421% 7:0.005614% 8:0.005614% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:1043 BytesRead(17m4s): 31.98 GB, 63.16 GB, 78.88 GB, 79.70 GB, 79.70 GB, 79.70 GB, 79.70 GB, 79.70 GB, 79.70 GB, 79.70 GB, 79.71 GB, 79.71 GB, 79.71 GB, 79.71 GB, 79.71 GB, 79.71 GB, 79.71 GB, 79.71 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB, 79.72 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 79.95 - BytesRead: 126.37 GB (135684732236) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.34 GB (135655830860) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.34 GB (135655830860) - CachedFileHandlesHitCount: 15.96K (15962) - CachedFileHandlesMissCount: 1.21K (1209) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 80 (80) - PeakMemoryUsage: 1.99 GB (2135029760) - PerReadThreadRawHdfsThroughput: 72.29 MB/sec - RemoteScanRanges: 882 (882) - RowBatchQueueGetWaitTime: 15.051ms - RowBatchQueuePutWaitTime: 790h51m - RowsRead: 1.00B (1000009884) - RowsReturned: 1.00B (1000009884) - RowsReturnedRate: 126.78 M/sec - ScanRangesComplete: 1.04K (1043) - ScannerThreadsInvoluntaryContextSwitches: 433.95K (433955) - ScannerThreadsTotalWallClockTime: 791h22m - DelimiterParseTime: 10m33s - MaterializeTupleTime(*): 15m3s - ScannerThreadsSysTime: 3m37s - ScannerThreadsUserTime: 20m27s - ScannerThreadsVoluntaryContextSwitches: 1.06M (1057233) - TotalRawHdfsOpenFileTime(*): 28s281ms - TotalRawHdfsReadTime(*): 29m50s - TotalReadThroughput: 3.63 MB/sec CodeGen:(Total: 151.977ms, non-child: 151.977ms, % non-child: 100.00%) - CodegenTime: 2.507ms - CompileTime: 39.321ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 91.261ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 20.852ms Instance 8e42caaf58ad5a3e:5720018d00000005 (host=ve1111.foo:22000):(Total: 9h53m, non-child: 9h36m, % non-child: 97.09%) Hdfs split stats (:<# splits>/): 4:128/15.51 GB 1:128/15.59 GB 7:121/14.51 GB 3:130/15.70 GB 6:124/15.07 GB 5:140/17.25 GB 2:138/16.93 GB 0:129/15.78 GB Fragment Instance Lifecycle Event Timeline: 9h53m - Prepare Finished: 16.124ms (16.124ms) - Open Finished: 160.352ms (144.227ms) - First Batch Produced: 178.267ms (17.914ms) - First Batch Sent: 179.898ms (1.631ms) - ExecInternal Finished: 9h53m (9h53m) MemoryUsage(17m4s): 1.86 GB, 1.86 GB, 1.73 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.71 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB, 1.70 GB ThreadUsage(17m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135209553) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.40 GB (175446706386) - RowsProduced: 1.00B (1000214929) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h25m - TotalStorageWaitTime: 4m37s - TotalThreadsInvoluntaryContextSwitches: 550.55K (550548) - TotalThreadsTotalWallClockTime: 800h59m - TotalThreadsSysTime: 4m41s - TotalThreadsUserTime: 42m23s - TotalThreadsVoluntaryContextSwitches: 1.22M (1216083) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h53m - ExecTreeExecTime: 7s296ms - OpenTime: 144.227ms - ExecTreeOpenTime: 35.617us - PrepareTime: 15.639ms - ExecTreePrepareTime: 3.732ms DataStreamSender (dst_id=1):(Total: 17m11s, non-child: 17m11s, % non-child: 100.00%) - BytesSent: 120.65 GB (129543471278) - NetworkThroughput(*): 575.08 MB/sec - OverallThroughput: 119.79 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 1.00B (1000214929) - SerializeBatchTime: 13m35s - TransmitDataRPCTime: 3m34s - UncompressedRowBatchSize: 257.83 GB (276844713911) HDFS_SCAN_NODE (id=0):(Total: 6s431ms, non-child: 6s431ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 4:128/15.51 GB 1:128/15.59 GB 7:121/14.51 GB 3:130/15.70 GB 6:124/15.07 GB 5:140/17.25 GB 2:138/16.93 GB 0:129/15.78 GB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1038 out of 1038 Hdfs Read Thread Concurrency Bucket: 0:97.18% 1:1.563% 2:0.7876% 3:0.3271% 4:0.08283% 5:0.04212% 6:0.01123% 7:0.001404% 8:0.008424% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:1038 BytesRead(17m4s): 32.86 GB, 65.33 GB, 80.76 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB, 81.56 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 79.95 - BytesRead: 126.40 GB (135717861847) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.37 GB (135686994391) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.37 GB (135686994391) - CachedFileHandlesHitCount: 15.96K (15961) - CachedFileHandlesMissCount: 1.21K (1214) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 80 (80) - PeakMemoryUsage: 1.99 GB (2135025664) - PerReadThreadRawHdfsThroughput: 76.27 MB/sec - RemoteScanRanges: 942 (942) - RowBatchQueueGetWaitTime: 12.712ms - RowBatchQueuePutWaitTime: 790h33m - RowsRead: 1.00B (1000214929) - RowsReturned: 1.00B (1000214929) - RowsReturnedRate: 155.51 M/sec - ScanRangesComplete: 1.04K (1038) - ScannerThreadsInvoluntaryContextSwitches: 398.09K (398094) - ScannerThreadsTotalWallClockTime: 791h5m - DelimiterParseTime: 10m33s - MaterializeTupleTime(*): 15m14s - ScannerThreadsSysTime: 3m34s - ScannerThreadsUserTime: 20m25s - ScannerThreadsVoluntaryContextSwitches: 1.05M (1051256) - TotalRawHdfsOpenFileTime(*): 23s982ms - TotalRawHdfsReadTime(*): 28m16s - TotalReadThroughput: 3.63 MB/sec CodeGen:(Total: 143.203ms, non-child: 143.203ms, % non-child: 100.00%) - CodegenTime: 2.524ms - CompileTime: 34.189ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 87.091ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 21.461ms Instance 8e42caaf58ad5a3e:5720018d00000001 (host=vd1439.foo:22000):(Total: 9h53m, non-child: 9h36m, % non-child: 97.14%) Hdfs split stats (:<# splits>/): 7:129/15.39 GB 1:145/17.63 GB 5:121/14.94 GB 6:130/15.80 GB 4:119/14.36 GB 3:119/14.57 GB 2:135/16.43 GB 0:141/17.17 GB Fragment Instance Lifecycle Event Timeline: 9h53m - Prepare Finished: 14.935ms (14.935ms) - Open Finished: 158.531ms (143.595ms) - First Batch Produced: 260.489ms (101.958ms) - First Batch Sent: 264.116ms (3.626ms) - ExecInternal Finished: 9h53m (9h53m) MemoryUsage(17m4s): 2.02 GB, 2.07 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.04 GB, 2.03 GB, 2.03 GB, 2.03 GB, 2.03 GB, 2.03 GB, 2.03 GB, 2.03 GB, 2.03 GB ThreadUsage(17m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.18 GB (2341402193) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.59 GB (175650036191) - RowsProduced: 999.77M (999772368) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h25m - TotalStorageWaitTime: 5m34s - TotalThreadsInvoluntaryContextSwitches: 533.76K (533762) - TotalThreadsTotalWallClockTime: 879h44m - TotalThreadsSysTime: 4m48s - TotalThreadsUserTime: 41m55s - TotalThreadsVoluntaryContextSwitches: 1.23M (1226204) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h53m - ExecTreeExecTime: 7s018ms - OpenTime: 143.593ms - ExecTreeOpenTime: 31.460us - PrepareTime: 14.494ms - ExecTreePrepareTime: 3.787ms DataStreamSender (dst_id=1):(Total: 16m52s, non-child: 16m52s, % non-child: 100.00%) - BytesSent: 120.59 GB (129486211762) - NetworkThroughput(*): 593.08 MB/sec - OverallThroughput: 121.93 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 999.77M (999772368) - SerializeBatchTime: 13m23s - TransmitDataRPCTime: 3m28s - UncompressedRowBatchSize: 257.72 GB (276722334162) HDFS_SCAN_NODE (id=0):(Total: 6s245ms, non-child: 6s245ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 7:129/15.39 GB 1:145/17.63 GB 5:121/14.94 GB 6:130/15.80 GB 4:119/14.36 GB 3:119/14.57 GB 2:135/16.43 GB 0:141/17.17 GB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1039 out of 1039 Hdfs Read Thread Concurrency Bucket: 0:97.2% 1:1.547% 2:0.8187% 3:0.2612% 4:0.08706% 5:0.03651% 6:0.01685% 7:0.01264% 8:0.01264% 9:0.004213% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:1039 BytesRead(17m4s): 34.76 GB, 68.16 GB, 83.34 GB, 84.18 GB, 84.18 GB, 84.18 GB, 84.18 GB, 84.18 GB, 84.18 GB, 84.18 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.19 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB, 84.20 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 87.93 - BytesRead: 126.34 GB (135658630492) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.31 GB (135627304284) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.31 GB (135627304284) - CachedFileHandlesHitCount: 15.98K (15985) - CachedFileHandlesMissCount: 1.18K (1184) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 88 (88) - PeakMemoryUsage: 2.18 GB (2341222400) - PerReadThreadRawHdfsThroughput: 75.21 MB/sec - RemoteScanRanges: 956 (956) - RowBatchQueueGetWaitTime: 97.251ms - RowBatchQueuePutWaitTime: 869h18m - RowsRead: 999.77M (999772368) - RowsReturned: 999.77M (999772368) - RowsReturnedRate: 160.08 M/sec - ScanRangesComplete: 1.04K (1039) - ScannerThreadsInvoluntaryContextSwitches: 381.42K (381418) - ScannerThreadsTotalWallClockTime: 869h51m - DelimiterParseTime: 10m29s - MaterializeTupleTime(*): 15m3s - ScannerThreadsSysTime: 3m39s - ScannerThreadsUserTime: 20m12s - ScannerThreadsVoluntaryContextSwitches: 1.05M (1054485) - TotalRawHdfsOpenFileTime(*): 25s596ms - TotalRawHdfsReadTime(*): 28m40s - TotalReadThroughput: 3.63 MB/sec CodeGen:(Total: 142.599ms, non-child: 142.599ms, % non-child: 100.00%) - CodegenTime: 2.432ms - CompileTime: 33.801ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 86.157ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 22.164ms Instance 8e42caaf58ad5a3e:5720018d00000003 (host=ve1109.foo:22000):(Total: 9h53m, non-child: 9h36m, % non-child: 97.17%) Hdfs split stats (:<# splits>/): 6:119/14.43 GB 5:132/16.15 GB 4:123/15.09 GB 7:111/13.64 GB 3:132/15.91 GB 2:140/17.15 GB 1:131/15.73 GB 0:151/18.29 GB Fragment Instance Lifecycle Event Timeline: 9h53m - Prepare Finished: 14.046ms (14.046ms) - Open Finished: 164.095ms (150.048ms) - First Batch Produced: 184.131ms (20.035ms) - First Batch Sent: 186.201ms (2.070ms) - ExecInternal Finished: 9h53m (9h53m) MemoryUsage(17m4s): 1.86 GB, 1.85 GB, 1.64 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.53 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.52 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.51 GB, 1.50 GB, 1.50 GB, 1.50 GB, 1.50 GB, 1.50 GB, 1.50 GB, 1.50 GB ThreadUsage(17m4s): 80, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81, 81 - AverageThreadTokens: 80.95 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.99 GB (2135209553) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.39 GB (175443572195) - RowsProduced: 1.00B (1000529851) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h25m - TotalStorageWaitTime: 4m7s - TotalThreadsInvoluntaryContextSwitches: 566.83K (566829) - TotalThreadsTotalWallClockTime: 800h20m - TotalThreadsSysTime: 4m37s - TotalThreadsUserTime: 41m53s - TotalThreadsVoluntaryContextSwitches: 1.22M (1224166) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h53m - ExecTreeExecTime: 6s922ms - OpenTime: 150.045ms - ExecTreeOpenTime: 92.294us - PrepareTime: 13.541ms - ExecTreePrepareTime: 3.725ms DataStreamSender (dst_id=1):(Total: 16m40s, non-child: 16m40s, % non-child: 100.00%) - BytesSent: 120.68 GB (129584372543) - NetworkThroughput(*): 609.73 MB/sec - OverallThroughput: 123.53 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 1.00B (1000529851) - SerializeBatchTime: 13m16s - TransmitDataRPCTime: 3m22s - UncompressedRowBatchSize: 257.91 GB (276932104686) HDFS_SCAN_NODE (id=0):(Total: 6s124ms, non-child: 6s124ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 6:119/14.43 GB 5:132/16.15 GB 4:123/15.09 GB 7:111/13.64 GB 3:132/15.91 GB 2:140/17.15 GB 1:131/15.73 GB 0:151/18.29 GB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1039 out of 1039 Hdfs Read Thread Concurrency Bucket: 0:97.23% 1:1.555% 2:0.8023% 3:0.288% 4:0.0815% 5:0.02529% 6:0.009836% 7:0.00281% 8:0.00562% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:1039 BytesRead(17m4s): 32.03 GB, 64.40 GB, 79.52 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB, 80.39 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 79.95 - BytesRead: 126.43 GB (135757694333) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.41 GB (135727482237) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.41 GB (135727482237) - CachedFileHandlesHitCount: 15.96K (15957) - CachedFileHandlesMissCount: 1.22K (1224) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 80 (80) - PeakMemoryUsage: 1.99 GB (2135029760) - PerReadThreadRawHdfsThroughput: 80.31 MB/sec - RemoteScanRanges: 922 (922) - RowBatchQueueGetWaitTime: 27.175ms - RowBatchQueuePutWaitTime: 789h56m - RowsRead: 1.00B (1000529851) - RowsReturned: 1.00B (1000529851) - RowsReturnedRate: 163.36 M/sec - ScanRangesComplete: 1.04K (1039) - ScannerThreadsInvoluntaryContextSwitches: 416.44K (416436) - ScannerThreadsTotalWallClockTime: 790h27m - DelimiterParseTime: 10m30s - MaterializeTupleTime(*): 14m59s - ScannerThreadsSysTime: 3m30s - ScannerThreadsUserTime: 20m22s - ScannerThreadsVoluntaryContextSwitches: 1.05M (1053776) - TotalRawHdfsOpenFileTime(*): 24s970ms - TotalRawHdfsReadTime(*): 26m52s - TotalReadThroughput: 3.64 MB/sec CodeGen:(Total: 149.035ms, non-child: 149.035ms, % non-child: 100.00%) - CodegenTime: 2.248ms - CompileTime: 38.436ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 86.881ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 23.186ms Instance 8e42caaf58ad5a3e:5720018d00000000 (host=vd1442.foo:22000):(Total: 9h52m, non-child: 9h35m, % non-child: 97.19%) Hdfs split stats (:<# splits>/): 2:141/17.00 GB 5:128/15.38 GB 0:108/13.24 GB 1:151/18.48 GB 7:133/16.23 GB 6:130/15.88 GB 4:124/15.05 GB 3:125/15.03 GB Fragment Instance Lifecycle Event Timeline: 9h52m - Prepare Finished: 14.638ms (14.638ms) - Open Finished: 157.664ms (143.025ms) - First Batch Produced: 174.906ms (17.242ms) - First Batch Sent: 176.220ms (1.314ms) - ExecInternal Finished: 9h52m (9h52m) MemoryUsage(17m4s): 2.03 GB, 2.04 GB, 1.99 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB, 1.95 GB ThreadUsage(17m4s): 88, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89, 89 - AverageThreadTokens: 88.93 - BloomFilterBytes: 0 - PeakMemoryUsage: 2.18 GB (2341402193) - PeakReservation: 0 - PeakUsedReservation: 0 - PerHostPeakMemUsage: 163.59 GB (175651547260) - RowsProduced: 999.76M (999760025) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 9h24m - TotalStorageWaitTime: 5m34s - TotalThreadsInvoluntaryContextSwitches: 601.13K (601134) - TotalThreadsTotalWallClockTime: 878h6m - TotalThreadsSysTime: 4m39s - TotalThreadsUserTime: 41m20s - TotalThreadsVoluntaryContextSwitches: 1.22M (1221406) Buffer pool: - AllocTime: 0.000ns - CumulativeAllocationBytes: 0 - CumulativeAllocations: 0 (0) - PeakReservation: 0 - PeakUnpinnedBytes: 0 - PeakUsedReservation: 0 - ReadIoBytes: 0 - ReadIoOps: 0 (0) - ReadIoWaitTime: 0.000ns - ReservationLimit: 0 - WriteIoBytes: 0 - WriteIoOps: 0 (0) - WriteIoWaitTime: 0.000ns Fragment Instance Lifecycle Timings: - ExecTime: 9h52m - ExecTreeExecTime: 6s585ms - OpenTime: 143.024ms - ExecTreeOpenTime: 31.547us - PrepareTime: 14.155ms - ExecTreePrepareTime: 3.700ms DataStreamSender (dst_id=1):(Total: 16m33s, non-child: 16m33s, % non-child: 100.00%) - BytesSent: 120.59 GB (129484492662) - NetworkThroughput(*): 557.54 MB/sec - OverallThroughput: 124.26 MB/sec - PeakMemoryUsage: 171.94 KB (176064) - RowsReturned: 999.76M (999760025) - SerializeBatchTime: 12m51s - TransmitDataRPCTime: 3m41s - UncompressedRowBatchSize: 257.71 GB (276718565589) HDFS_SCAN_NODE (id=0):(Total: 5s770ms, non-child: 5s770ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:141/17.00 GB 5:128/15.38 GB 0:108/13.24 GB 1:151/18.48 GB 7:133/16.23 GB 6:130/15.88 GB 4:124/15.05 GB 3:125/15.03 GB ExecOption: TEXT Codegen Enabled, Codegen enabled: 1040 out of 1040 Hdfs Read Thread Concurrency Bucket: 0:97.17% 1:1.493% 2:0.7907% 3:0.3517% 4:0.1238% 5:0.0408% 6:0.01266% 7:0.007034% 8:0.01126% 9:0% 10:0% 11:0% 12:0% File Formats: TEXT/NONE:1040 BytesRead(17m4s): 34.90 GB, 68.89 GB, 83.94 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.75 GB, 84.76 GB, 84.76 GB, 84.76 GB, 84.76 GB, 84.76 GB, 84.76 GB, 84.76 GB, 84.76 GB - AverageHdfsReadThreadConcurrency: 0.05 - AverageScannerThreadConcurrency: 87.93 - BytesRead: 126.34 GB (135655469350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 126.31 GB (135620997414) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 126.31 GB (135620997414) - CachedFileHandlesHitCount: 15.98K (15978) - CachedFileHandlesMissCount: 1.19K (1190) - CollectionItemsRead: 0 (0) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 9 (9) - NumScannerThreadsStarted: 88 (88) - PeakMemoryUsage: 2.18 GB (2341218304) - PerReadThreadRawHdfsThroughput: 73.56 MB/sec - RemoteScanRanges: 1.05K (1052) - RowBatchQueueGetWaitTime: 12.815ms - RowBatchQueuePutWaitTime: 867h40m - RowsRead: 999.76M (999760025) - RowsReturned: 999.76M (999760025) - RowsReturnedRate: 173.25 M/sec - ScanRangesComplete: 1.04K (1040) - ScannerThreadsInvoluntaryContextSwitches: 455.06K (455058) - ScannerThreadsTotalWallClockTime: 868h14m - DelimiterParseTime: 10m36s - MaterializeTupleTime(*): 15m33s - ScannerThreadsSysTime: 3m33s - ScannerThreadsUserTime: 20m30s - ScannerThreadsVoluntaryContextSwitches: 1.05M (1047709) - TotalRawHdfsOpenFileTime(*): 23s928ms - TotalRawHdfsReadTime(*): 29m18s - TotalReadThroughput: 3.64 MB/sec CodeGen:(Total: 142.122ms, non-child: 142.122ms, % non-child: 100.00%) - CodegenTime: 2.270ms - CompileTime: 33.735ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.95 MB (2039936) - NumFunctions: 45 (45) - NumInstructions: 915 (915) - OptimizationTime: 85.618ms - PeakMemoryUsage: 457.50 KB (468480) - PrepareTime: 22.258ms