Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Duplicate
-
Impala 2.12.0
-
None
-
None
-
ghx-label-7
Description
Stacktrace
query_test/test_runtime_filters.py:81: in test_bloom_filters self.run_test_case('QueryTest/bloom_filters', vector) common/impala_test_suite.py:444: in run_test_case verify_runtime_profile(test_section['RUNTIME_PROFILE'], result.runtime_profile) common/test_result_verifier.py:560: in verify_runtime_profile actual)) E AssertionError: Did not find matches for lines in runtime profile: E EXPECTED LINES: E row_regex: .*1 of 1 Runtime Filter Published.* E E ACTUAL PROFILE: E Query (id=a64a18654d28e0c3:e6220f6c00000000): E DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. E Summary: E Session ID: 244e6109f4226b2b:39160855c64ad4a1 E Session Type: BEESWAX E Start Time: 2018-04-23 23:31:59.326883000 E End Time: E Query Type: QUERY E Query State: FINISHED E Query Status: OK E Impala Version: impalad version 2.12.0-cdh5.15.0 DEBUG (build 3d60947b813429cd1db59f9a342498982d341de9) E User: jenkins E Connected User: jenkins E Delegated User: E Network Address: 127.0.0.1:55776 E Default Db: functional E Sql Statement: with l as (select * from tpch.lineitem UNION ALL select * from tpch.lineitem) E select STRAIGHT_JOIN count(*) from (select * from tpch.lineitem a LIMIT 1) a E join (select * from l LIMIT 2000000) b on a.l_orderkey = -b.l_orderkey E Coordinator: ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000 E Query Options (set by configuration): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=30000,RUNTIME_FILTER_MIN_SIZE=65536,DISABLE_CODEGEN_ROWS_THRESHOLD=0 E Query Options (set by configuration and planner): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=30000,MT_DOP=0,RUNTIME_FILTER_MIN_SIZE=65536,DISABLE_CODEGEN_ROWS_THRESHOLD=0 E Plan: E ---------------- E Max Per-Host Resource Reservation: Memory=19.00MB E Per-Host Resource Estimates: Memory=557.00MB E E F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 E | Per-Host Resources: mem-estimate=28.00MB mem-reservation=18.00MB runtime-filters-memory=1.00MB E PLAN-ROOT SINK E | mem-estimate=0B mem-reservation=0B E | E 05:AGGREGATE [FINALIZE] E | output: count(*) E | mem-estimate=10.00MB mem-reservation=0B spill-buffer=2.00MB E | tuple-ids=7 row-size=8B cardinality=1 E | E 04:HASH JOIN [INNER JOIN, BROADCAST] E | hash predicates: a.l_orderkey = -1 * l_orderkey E | fk/pk conjuncts: assumed fk/pk E | runtime filters: RF000[bloom] <- -1 * l_orderkey E | mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB E | tuple-ids=0,4 row-size=16B cardinality=1 E | E |--08:EXCHANGE [UNPARTITIONED] E | | mem-estimate=0B mem-reservation=0B E | | tuple-ids=4 row-size=8B cardinality=2000000 E | | E | F05:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 E | Per-Host Resources: mem-estimate=0B mem-reservation=0B E | 07:EXCHANGE [UNPARTITIONED] E | | limit: 2000000 E | | mem-estimate=0B mem-reservation=0B E | | tuple-ids=4 row-size=8B cardinality=2000000 E | | E | F04:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 E | Per-Host Resources: mem-estimate=264.00MB mem-reservation=0B E | 01:UNION E | | pass-through-operands: all E | | limit: 2000000 E | | mem-estimate=0B mem-reservation=0B E | | tuple-ids=4 row-size=8B cardinality=2000000 E | | E | |--03:SCAN HDFS [tpch.lineitem, RANDOM] E | | partitions=1/1 files=1 size=718.94MB E | | stored statistics: E | | table: rows=6001215 size=718.94MB E | | columns: all E | | extrapolated-rows=disabled E | | mem-estimate=264.00MB mem-reservation=0B E | | tuple-ids=3 row-size=8B cardinality=6001215 E | | E | 02:SCAN HDFS [tpch.lineitem, RANDOM] E | partitions=1/1 files=1 size=718.94MB E | stored statistics: E | table: rows=6001215 size=718.94MB E | columns: all E | extrapolated-rows=disabled E | mem-estimate=264.00MB mem-reservation=0B E | tuple-ids=2 row-size=8B cardinality=6001215 E | E 06:EXCHANGE [UNPARTITIONED] E | limit: 1 E | mem-estimate=0B mem-reservation=0B E | tuple-ids=0 row-size=8B cardinality=1 E | E F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3 E Per-Host Resources: mem-estimate=265.00MB mem-reservation=1.00MB runtime-filters-memory=1.00MB E 00:SCAN HDFS [tpch.lineitem a, RANDOM] E partitions=1/1 files=1 size=718.94MB E runtime filters: RF000[bloom] -> a.l_orderkey E stored statistics: E table: rows=6001215 size=718.94MB E columns: all E extrapolated-rows=disabled E limit: 1 E mem-estimate=264.00MB mem-reservation=0B E tuple-ids=0 row-size=8B cardinality=1 E ---------------- E Estimated Per-Host Mem: 584056832 E Per Host Min Reservation: ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000(19.00 MB) ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22001(1.00 MB) ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22002(1.00 MB) E Request Pool: default-pool E Admission result: Admitted immediately E Query Compilation: 13.010ms E - Metadata of all 1 tables cached: 869.154us (869.154us) E - Analysis finished: 9.193ms (8.324ms) E - Value transfer graph computed: 9.552ms (358.857us) E - Single node plan created: 11.136ms (1.584ms) E - Runtime filters computed: 11.515ms (378.457us) E - Distributed plan created: 11.584ms (69.493us) E - Planning finished: 13.010ms (1.425ms) E Query Timeline: 14s204ms E - Query submitted: 999.978us (999.978us) E - Planning finished: 18.999ms (17.999ms) E - Submit for admission: 29.999ms (10.999ms) E - Completed admission: 31.999ms (1.999ms) E - Ready to start on 3 backends: 42.999ms (10.999ms) E - All 3 execution backends (8 fragment instances) started: 62.998ms (19.999ms) E - First dynamic filter received: 11s008ms (10s945ms) E - Rows available: 13s462ms (2s453ms) E - First row fetched: 13s486ms (23.999ms) E - Last row fetched: 13s488ms (1.999ms) E - Released admission control resources: 14s169ms (680.984ms) E - ComputeScanRangeAssignmentTimer: 3.999ms E ImpalaServer: E - ClientFetchWaitTimer: 24.999ms E - RowMaterializationTimer: 710.984ms E Execution Profile a64a18654d28e0c3:e6220f6c00000000:(Total: 14s129ms, non-child: 0.000ns, % non-child: 0.00%) E Number of filters: 1 E Filter routing table: E ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled E ------------------------------------------------------------------------------------------------------------------- E 0 4 0 REMOTE false 1 (1) N/A N/A true E Backend startup latencies: Count: 3, min / max: 11ms / 11ms, 25th %-ile: 11ms, 50th %-ile: 11ms, 75th %-ile: 11ms, 90th %-ile: 11ms, 95th %-ile: 11ms, 99.9th %-ile: 11ms E Final filter table: E ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled E ------------------------------------------------------------------------------------------------------------------- E 0 4 0 REMOTE false 0 (1) 11s008ms 11s008ms false E Per Node Peak Memory Usage: ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000(249.85 MB) ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22001(98.18 MB) ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22002(98.15 MB) E - FiltersReceived: 1 (1) E - FinalizationTimer: 0.000ns E - NumBackends: 3 (3) E - NumFragmentInstances: 8 (8) E - NumFragments: 4 (4) E Averaged Fragment F01:(Total: 64.998ms, non-child: 0.000ns, % non-child: 0.00%) E split sizes: min: 0, max: 0, avg: 0, stddev: 0 E completion times: min:14s121ms max:14s121ms mean: 14s121ms stddev:0.000ns E execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec E num instances: 1 E - AverageThreadTokens: 0.00 E - BloomFilterBytes: 1.00 MB (1048576) E - PeakMemoryUsage: 28.70 MB (30090656) E - PeakReservation: 18.00 MB (18874368) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 92.99 MB (97505809) E - RowsProduced: 0 (0) E - TotalNetworkReceiveTime: 4s252ms E - TotalNetworkSendTime: 0.000ns E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 0 (0) E - TotalThreadsTotalWallClockTime: 0.000ns E - TotalThreadsSysTime: 0.000ns E - TotalThreadsUserTime: 0.000ns E - TotalThreadsVoluntaryContextSwitches: 0 (0) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 1.00 MB (1048576) E - CumulativeAllocations: 1 (1) E - PeakReservation: 1.00 MB (1048576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 1.00 MB (1048576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 1.00 MB (1048576) E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - OpenTime: 0.000ns E - ExecTreeOpenTime: 0.000ns E - PrepareTime: 58.998ms E - ExecTreePrepareTime: 28.999ms E PLAN_ROOT_SINK: E - PeakMemoryUsage: 0 E AGGREGATION_NODE (id=5):(Total: 28.999ms, non-child: 0.000ns, % non-child: 0.00%) E - BuildTime: 0.000ns E - GetResultsTime: 0.000ns E - HTResizeTime: 0.000ns E - HashBuckets: 0 (0) E - LargestPartitionPercent: 0 (0) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 0 (0) E - PeakMemoryUsage: 4.00 KB (4096) E - RowsRepartitioned: 0 (0) E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E - SpilledPartitions: 0 (0) E HASH_JOIN_NODE (id=4):(Total: 36.999ms, non-child: 45.998ms, % non-child: 100.00%) E - BuildRows: 1.52M (1520640) E - BuildTime: 432.990ms E - NumHashTableBuildsSkipped: 0 (0) E - PeakMemoryUsage: 17.05 MB (17877248) E - ProbeRows: 0 (0) E - ProbeRowsPartitioned: 0 (0) E - ProbeTime: 0.000ns E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E Buffer pool: E - AllocTime: 2.999ms E - CumulativeAllocationBytes: 16.00 MB (16777216) E - CumulativeAllocations: 16 (16) E - PeakReservation: 17.00 MB (17825792) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 16.00 MB (16777216) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Join Builder (join_node_id=4): E - BuildRowsPartitionTime: 403.990ms E - BuildRowsPartitioned: 1.52M (1520640) E - HashBuckets: 0 (0) E - HashCollisions: 0 (0) E - HashTablesBuildTime: 0.000ns E - LargestPartitionPercent: 0 (0) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 17.12 KB (17536) E - RepartitionTime: 0.000ns E - SpilledPartitions: 0 (0) E EXCHANGE_NODE (id=8):(Total: 4s840ms, non-child: 4s840ms, % non-child: 100.00%) E - ConvertRowBatchTime: 458.989ms E - PeakMemoryUsage: 10.62 MB (11132928) E - RowsReturned: 1.52M (1520640) E - RowsReturnedRate: 314.12 K/sec E Buffer pool: E - AllocTime: 55.998ms E - CumulativeAllocationBytes: 34.83 MB (36519936) E - CumulativeAllocations: 2.97K (2972) E - PeakReservation: 10.62 MB (11132928) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 10.62 MB (11132928) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - FirstBatchWaitTime: 0.000ns E - TotalBytesDequeued: 24.67 MB (25868288) E - TotalGetBatchTime: 4s260ms E - DataWaitTime: 4s133ms E Enqueue: E - DeserializeRowBatchTime: 162.996ms E - TotalBatchesEnqueued: 1.49K (1486) E - TotalBatchesReceived: 1.49K (1486) E - TotalBytesReceived: 8.30 MB (8697966) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 0 (0) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E EXCHANGE_NODE (id=6): E - ConvertRowBatchTime: 0.000ns E - PeakMemoryUsage: 0 E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - FirstBatchWaitTime: 0.000ns E - TotalBytesDequeued: 0 E - TotalGetBatchTime: 0.000ns E - DataWaitTime: 0.000ns E Enqueue: E - DeserializeRowBatchTime: 0.000ns E - TotalBatchesEnqueued: 0 (0) E - TotalBatchesReceived: 0 (0) E - TotalBytesReceived: 0 E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 0 (0) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 3s543ms, non-child: 3s543ms, % non-child: 100.00%) E - CodegenTime: 11.999ms E - CompileTime: 286.993ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 87 (87) E - NumInstructions: 2.81K (2815) E - OptimizationTime: 2s990ms E - PeakMemoryUsage: 1.37 MB (1441280) E - PrepareTime: 259.994ms E Coordinator Fragment F01: E Instance a64a18654d28e0c3:e6220f6c00000000 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000):(Total: 64.998ms, non-child: 0.000ns, % non-child: 0.00%) E Fragment Instance Lifecycle Event Timeline: 74.998ms E - Prepare Finished: 74.998ms (74.998ms) E MemoryUsage(500.000ms): 1.05 MB, 2.43 MB, 2.78 MB, 5.59 MB, 7.65 MB, 8.94 MB, 10.94 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB, 28.70 MB E - AverageThreadTokens: 0.00 E - BloomFilterBytes: 1.00 MB (1048576) E - PeakMemoryUsage: 28.70 MB (30090656) E - PeakReservation: 18.00 MB (18874368) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 92.99 MB (97505809) E - RowsProduced: 0 (0) E - TotalNetworkReceiveTime: 4s252ms E - TotalNetworkSendTime: 0.000ns E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 0 (0) E - TotalThreadsTotalWallClockTime: 0.000ns E - TotalThreadsSysTime: 0.000ns E - TotalThreadsUserTime: 0.000ns E - TotalThreadsVoluntaryContextSwitches: 0 (0) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 1.00 MB (1048576) E - CumulativeAllocations: 1 (1) E - PeakReservation: 1.00 MB (1048576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 1.00 MB (1048576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 1.00 MB (1048576) E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - OpenTime: 0.000ns E - ExecTreeOpenTime: 0.000ns E - PrepareTime: 58.998ms E - ExecTreePrepareTime: 28.999ms E PLAN_ROOT_SINK: E - PeakMemoryUsage: 0 E AGGREGATION_NODE (id=5):(Total: 28.999ms, non-child: 0.000ns, % non-child: 0.00%) E ExecOption: Codegen Enabled E - BuildTime: 0.000ns E - GetResultsTime: 0.000ns E - HTResizeTime: 0.000ns E - HashBuckets: 0 (0) E - LargestPartitionPercent: 0 (0) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 0 (0) E - PeakMemoryUsage: 4.00 KB (4096) E - RowsRepartitioned: 0 (0) E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E - SpilledPartitions: 0 (0) E HASH_JOIN_NODE (id=4):(Total: 36.999ms, non-child: 45.998ms, % non-child: 100.00%) E ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously E - BuildRows: 1.52M (1520640) E - BuildTime: 432.990ms E - NumHashTableBuildsSkipped: 0 (0) E - PeakMemoryUsage: 17.05 MB (17877248) E - ProbeRows: 0 (0) E - ProbeRowsPartitioned: 0 (0) E - ProbeTime: 0.000ns E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E Buffer pool: E - AllocTime: 2.999ms E - CumulativeAllocationBytes: 16.00 MB (16777216) E - CumulativeAllocations: 16 (16) E - PeakReservation: 17.00 MB (17825792) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 16.00 MB (16777216) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Hash Join Builder (join_node_id=4): E ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled E - BuildRowsPartitionTime: 403.990ms E - BuildRowsPartitioned: 1.52M (1520640) E - HashBuckets: 0 (0) E - HashCollisions: 0 (0) E - HashTablesBuildTime: 0.000ns E - LargestPartitionPercent: 0 (0) E - MaxPartitionLevel: 0 (0) E - NumRepartitions: 0 (0) E - PartitionsCreated: 16 (16) E - PeakMemoryUsage: 17.12 KB (17536) E - RepartitionTime: 0.000ns E - SpilledPartitions: 0 (0) E EXCHANGE_NODE (id=8):(Total: 4s840ms, non-child: 708.984ms, % non-child: 14.65%) E - ConvertRowBatchTime: 458.989ms E - PeakMemoryUsage: 10.62 MB (11132928) E - RowsReturned: 1.52M (1520640) E - RowsReturnedRate: 314.12 K/sec E Buffer pool: E - AllocTime: 55.998ms E - CumulativeAllocationBytes: 34.83 MB (36519936) E - CumulativeAllocations: 2.97K (2972) E - PeakReservation: 10.62 MB (11132928) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 10.62 MB (11132928) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 2.59 MB, 10.09 MB, 12.07 MB, 13.71 MB, 15.31 MB, 16.97 MB, 18.13 MB, 19.16 MB, 20.29 MB, 21.93 MB, 24.01 MB E - FirstBatchWaitTime: 0.000ns E - TotalBytesDequeued: 24.67 MB (25868288) E - TotalGetBatchTime: 4s260ms E - DataWaitTime: 4s133ms E Enqueue: E BytesReceived(500.000ms): 0, 0, 85.65 KB, 771.69 KB, 1.25 MB, 1.55 MB, 2.03 MB, 2.72 MB, 3.39 MB, 4.06 MB, 4.61 MB, 5.15 MB, 5.71 MB, 6.10 MB, 6.44 MB, 6.82 MB, 7.37 MB, 8.07 MB E DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DispatchTime: (Avg: 601.280us ; Min: 290.853us ; Max: 17.080ms ; Number of samples: 1486) E - DeserializeRowBatchTime: 162.996ms E - TotalBatchesEnqueued: 1.49K (1486) E - TotalBatchesReceived: 1.49K (1486) E - TotalBytesReceived: 8.30 MB (8697966) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 0 (0) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E EXCHANGE_NODE (id=6): E - ConvertRowBatchTime: 0.000ns E - PeakMemoryUsage: 0 E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E BytesDequeued(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - FirstBatchWaitTime: 0.000ns E - TotalBytesDequeued: 0 E - TotalGetBatchTime: 0.000ns E - DataWaitTime: 0.000ns E Enqueue: E BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - DispatchTime: 0.000ns (Number of samples: 0) E - DeserializeRowBatchTime: 0.000ns E - TotalBatchesEnqueued: 0 (0) E - TotalBatchesReceived: 0 (0) E - TotalBytesReceived: 0 E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 0 (0) E - TotalHasDeferredRPCsTime: 0.000ns E - TotalRPCsDeferred: 0 (0) E CodeGen:(Total: 3s543ms, non-child: 3s543ms, % non-child: 100.00%) E - CodegenTime: 11.999ms E - CompileTime: 286.993ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 87 (87) E - NumInstructions: 2.81K (2815) E - OptimizationTime: 2s990ms E - PeakMemoryUsage: 1.37 MB (1441280) E - PrepareTime: 259.994ms E Averaged Fragment F00:(Total: 13s269ms, non-child: 60.998ms, % non-child: 0.46%) E split sizes: min: 206.94 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 23.13 MB E completion times: min:13s084ms max:13s441ms mean: 13s294ms stddev:152.124ms E execution rates: min:15.49 MB/sec max:19.56 MB/sec mean:18.03 MB/sec stddev:1.81 MB/sec E num instances: 3 E - AverageThreadTokens: 2.06 E - BloomFilterBytes: 1.00 MB (1048576) E - PeakMemoryUsage: 49.10 MB (51482410) E - PeakReservation: 1.00 MB (1048576) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 148.73 MB (155950938) E - RowsProduced: 1 (1) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 5.999ms E - TotalStorageWaitTime: 76.331ms E - TotalThreadsInvoluntaryContextSwitches: 1.01K (1007) E - TotalThreadsTotalWallClockTime: 16s483ms E - TotalThreadsSysTime: 25.662ms E - TotalThreadsUserTime: 1s445ms E - TotalThreadsVoluntaryContextSwitches: 575 (575) E Buffer pool: E - AllocTime: 666.651us E - CumulativeAllocationBytes: 1.00 MB (1048576) E - CumulativeAllocations: 1 (1) E - PeakReservation: 1.00 MB (1048576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 1.00 MB (1048576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 1.00 MB (1048576) E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 11s885ms E - ExecTreeExecTime: 11s877ms E - OpenTime: 1s342ms E - ExecTreeOpenTime: 4.333ms E - PrepareTime: 36.999ms E - ExecTreePrepareTime: 5.666ms E KrpcDataStreamSender (dst_id=6):(Total: 9.999ms, non-child: 9.999ms, % non-child: 100.00%) E - EosSent: 0 (0) E - NetworkThroughput: 4.06 KB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 1 (1) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 13.00 B (13) E - UncompressedRowBatchSize: 17.00 B (17) E HDFS_SCAN_NODE (id=0):(Total: 11s894ms, non-child: 11s894ms, % non-child: 100.00%) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 1.16 E - BytesRead: 154.31 MB (161808872) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 151.65 MB (159012669) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 151.65 MB (159012669) E - CachedFileHandlesHitCount: 19 (19) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 1 (1) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 48.07 MB (50405034) E - PerReadThreadRawHdfsThroughput: 1.04 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 2s275ms E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 958.52K (958518) E - RowsReturned: 1 (1) E - RowsReturnedRate: 0 E - ScanRangesComplete: 1 (1) E - ScannerThreadsInvoluntaryContextSwitches: 242 (242) E - ScannerThreadsTotalWallClockTime: 3s255ms E - DelimiterParseTime: 4s426ms E - MaterializeTupleTime(*): 4.666ms E - ScannerThreadsSysTime: 1.666ms E - ScannerThreadsUserTime: 481.926ms E - ScannerThreadsVoluntaryContextSwitches: 97 (97) E - TotalRawHdfsOpenFileTime(*): 1.999ms E - TotalRawHdfsReadTime(*): 146.996ms E - TotalReadThroughput: 9.88 MB/sec E Filter 0 (1.00 MB): E - Files processed: 0 (0) E - Files rejected: 0 (0) E - Files total: 0 (0) E - RowGroups processed: 0 (0) E - RowGroups rejected: 0 (0) E - RowGroups total: 0 (0) E - Rows processed: 0 (0) E - Rows rejected: 0 (0) E - Rows total: 0 (0) E - Splits processed: 0 (0) E - Splits rejected: 0 (0) E - Splits total: 0 (0) E CodeGen:(Total: 1s303ms, non-child: 1s303ms, % non-child: 100.00%) E - CodegenTime: 97.997ms E - CompileTime: 107.330ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 28 (28) E - NumInstructions: 418 (418) E - OptimizationTime: 966.311ms E - PeakMemoryUsage: 209.00 KB (214016) E - PrepareTime: 220.661ms E Fragment F00: E Instance a64a18654d28e0c3:e6220f6c00000003 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000):(Total: 13s400ms, non-child: 117.997ms, % non-child: 0.88%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E Filter 0 arrival: 10s917ms E Fragment Instance Lifecycle Event Timeline: 13s424ms E - Prepare Finished: 102.997ms (102.997ms) E - Open Finished: 1s910ms (1s807ms) E - First Batch Produced: 13s420ms (11s509ms) E - First Batch Sent: 13s421ms (999.977us) E - ExecInternal Finished: 13s424ms (2.999ms) E MemoryUsage(500.000ms): 1.02 MB, 1.23 MB, 1.23 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB E ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 E - AverageThreadTokens: 2.62 E - BloomFilterBytes: 1.00 MB (1048576) E - PeakMemoryUsage: 49.09 MB (51475925) E - PeakReservation: 1.00 MB (1048576) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 249.85 MB (261991194) E - RowsProduced: 1 (1) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 2.999ms E - TotalStorageWaitTime: 66.998ms E - TotalThreadsInvoluntaryContextSwitches: 1.22K (1215) E - TotalThreadsTotalWallClockTime: 13s321ms E - TotalThreadsSysTime: 39.994ms E - TotalThreadsUserTime: 1s151ms E - TotalThreadsVoluntaryContextSwitches: 457 (457) E Buffer pool: E - AllocTime: 999.976us E - CumulativeAllocationBytes: 1.00 MB (1048576) E - CumulativeAllocations: 1 (1) E - PeakReservation: 1.00 MB (1048576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 1.00 MB (1048576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 1.00 MB (1048576) E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 11s513ms E - ExecTreeExecTime: 11s509ms E - OpenTime: 1s807ms E - ExecTreeOpenTime: 3.999ms E - PrepareTime: 70.998ms E - ExecTreePrepareTime: 10.999ms E KrpcDataStreamSender (dst_id=6):(Total: 8.999ms, non-child: 5.999ms, % non-child: 66.67%) E BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - EosSent: 0 (0) E - NetworkThroughput: 4.42 KB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 1 (1) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 13.00 B (13) E - UncompressedRowBatchSize: 17.00 B (17) E HDFS_SCAN_NODE (id=0):(Total: 11s536ms, non-child: 11s536ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E ExecOption: TEXT Codegen Enabled, Codegen enabled: 2 out of 2 E Runtime filters: All filters arrived. Waited 9s064ms E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 64.00 MB, 80.00 MB, 104.00 MB, 128.00 MB E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 1.83 E - BytesRead: 152.00 MB (159383552) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 152.00 MB (159383552) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 152.00 MB (159383552) E - CachedFileHandlesHitCount: 19 (19) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 1 (1) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 48.06 MB (50393088) E - PerReadThreadRawHdfsThroughput: 899.43 MB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 2s441ms E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 965.42K (965416) E - RowsReturned: 1 (1) E - RowsReturnedRate: 0 E - ScanRangesComplete: 2 (2) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - DelimiterParseTime: 4s768ms E - MaterializeTupleTime(*): 4.999ms E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalRawHdfsOpenFileTime(*): 1.999ms E - TotalRawHdfsReadTime(*): 168.996ms E - TotalReadThroughput: 9.85 MB/sec E Filter 0 (1.00 MB): E - Files processed: 0 (0) E - Files rejected: 0 (0) E - Files total: 0 (0) E - RowGroups processed: 0 (0) E - RowGroups rejected: 0 (0) E - RowGroups total: 0 (0) E - Rows processed: 0 (0) E - Rows rejected: 0 (0) E - Rows total: 0 (0) E - Splits processed: 0 (0) E - Splits rejected: 0 (0) E - Splits total: 0 (0) E CodeGen:(Total: 1s736ms, non-child: 1s736ms, % non-child: 100.00%) E - CodegenTime: 139.996ms E - CompileTime: 115.997ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 28 (28) E - NumInstructions: 418 (418) E - OptimizationTime: 1s291ms E - PeakMemoryUsage: 209.00 KB (214016) E - PrepareTime: 312.992ms E Instance a64a18654d28e0c3:e6220f6c00000001 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22002):(Total: 13s338ms, non-child: 35.999ms, % non-child: 0.27%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/78.94 MB 2:1/128.00 MB E Filter 0 arrival: 10s984ms E Fragment Instance Lifecycle Event Timeline: 13s342ms E - Prepare Finished: 27.999ms (27.999ms) E - Open Finished: 1s167ms (1s139ms) E - First Batch Produced: 13s336ms (12s168ms) E - First Batch Sent: 13s337ms (999.977us) E - ExecInternal Finished: 13s342ms (4.999ms) E MemoryUsage(500.000ms): 1.02 MB, 1.23 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 49.06 MB, 49.08 MB, 49.08 MB, 49.08 MB, 49.08 MB E ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 E - AverageThreadTokens: 1.81 E - BloomFilterBytes: 1.00 MB (1048576) E - PeakMemoryUsage: 49.12 MB (51503573) E - PeakReservation: 1.00 MB (1048576) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 98.15 MB (102915450) E - RowsProduced: 1 (1) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 3.999ms E - TotalStorageWaitTime: 99.997ms E - TotalThreadsInvoluntaryContextSwitches: 621 (621) E - TotalThreadsTotalWallClockTime: 13s314ms E - TotalThreadsSysTime: 12.998ms E - TotalThreadsUserTime: 859.869ms E - TotalThreadsVoluntaryContextSwitches: 489 (489) E Buffer pool: E - AllocTime: 999.977us E - CumulativeAllocationBytes: 1.00 MB (1048576) E - CumulativeAllocations: 1 (1) E - PeakReservation: 1.00 MB (1048576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 1.00 MB (1048576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 1.00 MB (1048576) E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 12s174ms E - ExecTreeExecTime: 12s168ms E - OpenTime: 1s139ms E - ExecTreeOpenTime: 1.999ms E - PrepareTime: 19.999ms E - ExecTreePrepareTime: 2.999ms E KrpcDataStreamSender (dst_id=6):(Total: 7.999ms, non-child: 3.999ms, % non-child: 50.00%) E BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - EosSent: 1 (1) E - NetworkThroughput: 4.97 KB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 1 (1) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 13.00 B (13) E - UncompressedRowBatchSize: 17.00 B (17) E HDFS_SCAN_NODE (id=0):(Total: 12s178ms, non-child: 12s178ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/78.94 MB 2:1/128.00 MB E ExecOption: TEXT Codegen Enabled, Codegen enabled: 2 out of 2 E Runtime filters: All filters arrived. Waited 9s844ms E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 56.00 MB, 72.00 MB, 104.00 MB, 120.00 MB, 150.94 MB E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 0.88 E - BytesRead: 158.94 MB (166659512) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 158.94 MB (166659512) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 158.94 MB (166659512) E - CachedFileHandlesHitCount: 20 (20) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 2 (2) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 48.09 MB (50428928) E - PerReadThreadRawHdfsThroughput: 1.06 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 2s321ms E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 988.24K (988238) E - RowsReturned: 1 (1) E - RowsReturnedRate: 0 E - ScanRangesComplete: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - DelimiterParseTime: 4s477ms E - MaterializeTupleTime(*): 7.999ms E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalRawHdfsOpenFileTime(*): 999.978us E - TotalRawHdfsReadTime(*): 145.996ms E - TotalReadThroughput: 11.18 MB/sec E Filter 0 (1.00 MB): E - Files processed: 0 (0) E - Files rejected: 0 (0) E - Files total: 0 (0) E - RowGroups processed: 0 (0) E - RowGroups rejected: 0 (0) E - RowGroups total: 0 (0) E - Rows processed: 0 (0) E - Rows rejected: 0 (0) E - Rows total: 0 (0) E - Splits processed: 0 (0) E - Splits rejected: 0 (0) E - Splits total: 0 (0) E CodeGen:(Total: 1s115ms, non-child: 1s115ms, % non-child: 100.00%) E - CodegenTime: 107.997ms E - CompileTime: 82.998ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 28 (28) E - NumInstructions: 418 (418) E - OptimizationTime: 793.982ms E - PeakMemoryUsage: 209.00 KB (214016) E - PrepareTime: 230.994ms E Instance a64a18654d28e0c3:e6220f6c00000002 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22001):(Total: 13s068ms, non-child: 28.999ms, % non-child: 0.22%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E Filter 0 arrival: 10s974ms E Fragment Instance Lifecycle Event Timeline: 13s072ms E - Prepare Finished: 24.999ms (24.999ms) E - Open Finished: 1s105ms (1s080ms) E - First Batch Produced: 13s060ms (11s954ms) E - First Batch Sent: 13s060ms (0.000ns) E - ExecInternal Finished: 13s072ms (11.999ms) E MemoryUsage(500.000ms): 1.02 MB, 1.23 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 1.02 MB, 49.06 MB, 49.08 MB, 49.08 MB, 49.08 MB, 25.08 MB E ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 E - AverageThreadTokens: 1.74 E - BloomFilterBytes: 1.00 MB (1048576) E - PeakMemoryUsage: 49.08 MB (51467733) E - PeakReservation: 1.00 MB (1048576) E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 98.18 MB (102946170) E - RowsProduced: 1 (1) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 10.999ms E - TotalStorageWaitTime: 61.998ms E - TotalThreadsInvoluntaryContextSwitches: 1.19K (1186) E - TotalThreadsTotalWallClockTime: 22s814ms E - TotalThreadsSysTime: 23.995ms E - TotalThreadsUserTime: 2s323ms E - TotalThreadsVoluntaryContextSwitches: 781 (781) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 1.00 MB (1048576) E - CumulativeAllocations: 1 (1) E - PeakReservation: 1.00 MB (1048576) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 1.00 MB (1048576) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 1.00 MB (1048576) E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 11s967ms E - ExecTreeExecTime: 11s954ms E - OpenTime: 1s079ms E - ExecTreeOpenTime: 6.999ms E - PrepareTime: 19.999ms E - ExecTreePrepareTime: 2.999ms E KrpcDataStreamSender (dst_id=6):(Total: 12.999ms, non-child: 1.999ms, % non-child: 15.38%) E BytesSent(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - EosSent: 1 (1) E - NetworkThroughput: 2.79 KB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 1 (1) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 0.000ns E - TotalBytesSent: 13.00 B (13) E - UncompressedRowBatchSize: 17.00 B (17) E HDFS_SCAN_NODE (id=0):(Total: 11s968ms, non-child: 11s968ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E ExecOption: TEXT Codegen Enabled, Codegen enabled: 2 out of 2 E Runtime filters: All filters arrived. Waited 9s891ms E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 48.00 MB, 64.00 MB, 88.00 MB, 112.00 MB E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 0.78 E - BytesRead: 152.00 MB (159383552) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 144.00 MB (150994944) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 144.00 MB (150994944) E - CachedFileHandlesHitCount: 19 (19) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 1 (1) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 48.06 MB (50393088) E - PerReadThreadRawHdfsThroughput: 1.18 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 2s062ms E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 921.90K (921901) E - RowsReturned: 1 (1) E - RowsReturnedRate: 0 E - ScanRangesComplete: 2 (2) E - ScannerThreadsInvoluntaryContextSwitches: 726 (726) E - ScannerThreadsTotalWallClockTime: 9s767ms E - DelimiterParseTime: 4s032ms E - MaterializeTupleTime(*): 999.978us E - ScannerThreadsSysTime: 4.998ms E - ScannerThreadsUserTime: 1s445ms E - ScannerThreadsVoluntaryContextSwitches: 291 (291) E - TotalRawHdfsOpenFileTime(*): 2.999ms E - TotalRawHdfsReadTime(*): 125.997ms E - TotalReadThroughput: 8.62 MB/sec E Filter 0 (1.00 MB): E - Files processed: 0 (0) E - Files rejected: 0 (0) E - Files total: 0 (0) E - RowGroups processed: 0 (0) E - RowGroups rejected: 0 (0) E - RowGroups total: 0 (0) E - Rows processed: 0 (0) E - Rows rejected: 0 (0) E - Rows total: 0 (0) E - Splits processed: 0 (0) E - Splits rejected: 0 (0) E - Splits total: 0 (0) E CodeGen:(Total: 1s057ms, non-child: 1s057ms, % non-child: 100.00%) E - CodegenTime: 45.998ms E - CompileTime: 122.997ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 28 (28) E - NumInstructions: 418 (418) E - OptimizationTime: 812.981ms E - PeakMemoryUsage: 209.00 KB (214016) E - PrepareTime: 117.997ms E Averaged Fragment F05:(Total: 10s901ms, non-child: 151.996ms, % non-child: 1.39%) E split sizes: min: 0, max: 0, avg: 0, stddev: 0 E completion times: min:10s955ms max:10s955ms mean: 10s955ms stddev:0.000ns E execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec E num instances: 1 E - AverageThreadTokens: 1.00 E - BloomFilterBytes: 0 E - PeakMemoryUsage: 14.19 MB (14876583) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 111.99 MB (117428637) E - RowsProduced: 2.00M (2000000) E - TotalNetworkReceiveTime: 2s627ms E - TotalNetworkSendTime: 2s363ms E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 7.22K (7224) E - TotalThreadsTotalWallClockTime: 10s871ms E - TotalThreadsSysTime: 222.967ms E - TotalThreadsUserTime: 2s931ms E - TotalThreadsVoluntaryContextSwitches: 1.07K (1066) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 9s558ms E - ExecTreeExecTime: 2s746ms E - OpenTime: 1s312ms E - ExecTreeOpenTime: 1s150ms E - PrepareTime: 27.999ms E - ExecTreePrepareTime: 7.999ms E KrpcDataStreamSender (dst_id=8):(Total: 6s714ms, non-child: 6s714ms, % non-child: 100.00%) E - EosSent: 1 (1) E - NetworkThroughput: 2.15 MB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 2.00M (2000000) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 1s890ms E - TotalBytesSent: 10.90 MB (11432317) E - UncompressedRowBatchSize: 32.42 MB (34000000) E EXCHANGE_NODE (id=7):(Total: 3s875ms, non-child: 3s875ms, % non-child: 100.00%) E - ConvertRowBatchTime: 979.977ms E - PeakMemoryUsage: 14.17 MB (14853831) E - RowsReturned: 2.00M (2000000) E - RowsReturnedRate: 516.01 K/sec E Buffer pool: E - AllocTime: 36.999ms E - CumulativeAllocationBytes: 59.91 MB (62816256) E - CumulativeAllocations: 5.11K (5112) E - PeakReservation: 14.15 MB (14835712) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 14.15 MB (14835712) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E - FirstBatchWaitTime: 1s150ms E - TotalBytesDequeued: 32.44 MB (34015232) E - TotalGetBatchTime: 2s622ms E - DataWaitTime: 1s203ms E Enqueue: E - DeserializeRowBatchTime: 264.994ms E - TotalBatchesEnqueued: 2.56K (2556) E - TotalBatchesReceived: 2.56K (2559) E - TotalBytesReceived: 14.28 MB (14978679) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 0 (0) E - TotalHasDeferredRPCsTime: 7s619ms E - TotalRPCsDeferred: 1.65K (1646) E CodeGen:(Total: 158.996ms, non-child: 158.996ms, % non-child: 100.00%) E - CodegenTime: 0.000ns E - CompileTime: 0.000ns E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 0 (0) E - NumInstructions: 0 (0) E - OptimizationTime: 0.000ns E - PeakMemoryUsage: 0 E - PrepareTime: 150.996ms E Fragment F05: E Instance a64a18654d28e0c3:e6220f6c00000007 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000):(Total: 10s901ms, non-child: 151.996ms, % non-child: 1.39%) E Fragment Instance Lifecycle Event Timeline: 10s936ms E - Prepare Finished: 64.998ms (64.998ms) E - Open Finished: 1s377ms (1s312ms) E - First Batch Produced: 1s377ms (0.000ns) E - First Batch Sent: 1s378ms (999.977us) E - ExecInternal Finished: 10s936ms (9s557ms) E MemoryUsage(500.000ms): 22.22 KB, 22.22 KB, 70.22 KB, 2.97 MB, 7.80 MB, 11.83 MB, 14.18 MB, 14.18 MB, 14.18 MB, 14.18 MB, 14.19 MB, 14.18 MB, 14.18 MB, 14.18 MB, 14.19 MB, 14.18 MB, 14.18 MB, 14.19 MB, 14.19 MB, 14.18 MB, 14.19 MB, 14.19 MB E ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 E - AverageThreadTokens: 1.00 E - BloomFilterBytes: 0 E - PeakMemoryUsage: 14.19 MB (14876583) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 111.99 MB (117428637) E - RowsProduced: 2.00M (2000000) E - TotalNetworkReceiveTime: 2s627ms E - TotalNetworkSendTime: 2s363ms E - TotalStorageWaitTime: 0.000ns E - TotalThreadsInvoluntaryContextSwitches: 7.22K (7224) E - TotalThreadsTotalWallClockTime: 10s871ms E - TotalThreadsSysTime: 222.967ms E - TotalThreadsUserTime: 2s931ms E - TotalThreadsVoluntaryContextSwitches: 1.07K (1066) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 9s558ms E - ExecTreeExecTime: 2s746ms E - OpenTime: 1s312ms E - ExecTreeOpenTime: 1s150ms E - PrepareTime: 27.999ms E - ExecTreePrepareTime: 7.999ms E KrpcDataStreamSender (dst_id=8):(Total: 6s714ms, non-child: 4s347ms, % non-child: 64.75%) E BytesSent(500.000ms): 0, 0, 79.92 KB, 766.04 KB, 1.25 MB, 1.55 MB, 2.03 MB, 2.72 MB, 3.39 MB, 4.05 MB, 4.61 MB, 5.15 MB, 5.71 MB, 6.10 MB, 6.44 MB, 6.82 MB, 7.37 MB, 8.07 MB, 8.77 MB, 9.55 MB, 10.35 MB, 10.90 MB E - EosSent: 1 (1) E - NetworkThroughput: 2.15 MB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 2.00M (2000000) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 1s890ms E - TotalBytesSent: 10.90 MB (11432317) E - UncompressedRowBatchSize: 32.42 MB (34000000) E EXCHANGE_NODE (id=7):(Total: 3s875ms, non-child: 2s671ms, % non-child: 68.94%) E - ConvertRowBatchTime: 979.977ms E - PeakMemoryUsage: 14.17 MB (14853831) E - RowsReturned: 2.00M (2000000) E - RowsReturnedRate: 516.01 K/sec E Buffer pool: E - AllocTime: 36.999ms E - CumulativeAllocationBytes: 59.91 MB (62816256) E - CumulativeAllocations: 5.11K (5112) E - PeakReservation: 14.15 MB (14835712) E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 14.15 MB (14835712) E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Dequeue: E BytesDequeued(500.000ms): 0, 0, 272.00 KB, 2.26 MB, 3.74 MB, 4.63 MB, 6.06 MB, 8.10 MB, 10.11 MB, 12.09 MB, 13.71 MB, 15.32 MB, 16.98 MB, 18.15 MB, 19.17 MB, 20.30 MB, 21.95 MB, 24.02 MB, 26.10 MB, 28.44 MB, 30.80 MB, 32.44 MB E - FirstBatchWaitTime: 1s150ms E - TotalBytesDequeued: 32.44 MB (34015232) E - TotalGetBatchTime: 2s622ms E - DataWaitTime: 1s203ms E Enqueue: E BytesReceived(500.000ms): 0, 0, 91.31 KB, 1.45 MB, 3.10 MB, 4.36 MB, 5.41 MB, 6.10 MB, 6.77 MB, 7.44 MB, 7.99 MB, 8.52 MB, 9.08 MB, 9.47 MB, 9.82 MB, 10.20 MB, 10.75 MB, 11.45 MB, 12.15 MB, 12.93 MB, 13.73 MB, 14.28 MB E DeferredQueueSize(500.000ms): 0, 0, 0, 0, 0, 0, 2, 2, 2, 2, 3, 2, 2, 2, 3, 2, 2, 3, 3, 2, 3, 3 E - DispatchTime: (Avg: 653.220us ; Min: 293.156us ; Max: 27.771ms ; Number of samples: 2559) E - DeserializeRowBatchTime: 264.994ms E - TotalBatchesEnqueued: 2.56K (2556) E - TotalBatchesReceived: 2.56K (2559) E - TotalBytesReceived: 14.28 MB (14978679) E - TotalEarlySenders: 0 (0) E - TotalEosReceived: 0 (0) E - TotalHasDeferredRPCsTime: 7s619ms E - TotalRPCsDeferred: 1.65K (1646) E CodeGen:(Total: 158.996ms, non-child: 158.996ms, % non-child: 100.00%) E - CodegenTime: 0.000ns E - CompileTime: 0.000ns E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 0 (0) E - NumInstructions: 0 (0) E - OptimizationTime: 0.000ns E - PeakMemoryUsage: 0 E - PrepareTime: 150.996ms E Averaged Fragment F04:(Total: 13s614ms, non-child: 231.661ms, % non-child: 1.70%) E split sizes: min: 413.88 MB, max: 512.00 MB, avg: 479.29 MB, stddev: 46.26 MB E completion times: min:13s390ms max:14s111ms mean: 13s654ms stddev:324.437ms E execution rates: min:29.33 MB/sec max:38.24 MB/sec mean:35.20 MB/sec stddev:4.15 MB/sec E num instances: 3 E - AverageThreadTokens: 2.71 E - BloomFilterBytes: 0 E - PeakMemoryUsage: 49.09 MB (51476389) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 148.73 MB (155950938) E - RowsProduced: 1.85M (1851818) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 7s548ms E - TotalStorageWaitTime: 57.332ms E - TotalThreadsInvoluntaryContextSwitches: 2.77K (2767) E - TotalThreadsTotalWallClockTime: 24s901ms E - TotalThreadsSysTime: 148.310ms E - TotalThreadsUserTime: 4s560ms E - TotalThreadsVoluntaryContextSwitches: 1.65K (1652) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 11s949ms E - ExecTreeExecTime: 2s199ms E - OpenTime: 1s615ms E - ExecTreeOpenTime: 1.999ms E - PrepareTime: 44.665ms E - ExecTreePrepareTime: 13.999ms E KrpcDataStreamSender (dst_id=7):(Total: 9s602ms, non-child: 9s602ms, % non-child: 100.00%) E - EosSent: 0 (0) E - NetworkThroughput: 2.22 MB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 1.85M (1851477) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 1s460ms E - TotalBytesSent: 4.77 MB (4998782) E - UncompressedRowBatchSize: 30.02 MB (31480917) E UNION_NODE (id=1):(Total: 2s204ms, non-child: 175.329ms, % non-child: 7.95%) E - PeakMemoryUsage: 0 E - RowsReturned: 1.85M (1851818) E - RowsReturnedRate: 844.23 K/sec E HDFS_SCAN_NODE (id=3):(Total: 37.665ms, non-child: 37.665ms, % non-child: 100.00%) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 0.00 E - BytesRead: 24.00 MB (25165824) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 0 E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 0 E - CachedFileHandlesHitCount: 0 (0) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 0 (0) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 16.21 MB (16997717) E - PerReadThreadRawHdfsThroughput: 1.53 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 0.000ns E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 94.89K (94890) E - RowsReturned: 91.82K (91818) E - RowsReturnedRate: 1.12 M/sec E - ScanRangesComplete: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - DelimiterParseTime: 511.988ms E - MaterializeTupleTime(*): 11.333ms E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalRawHdfsOpenFileTime(*): 1.999ms E - TotalRawHdfsReadTime(*): 45.998ms E - TotalReadThroughput: 0.00 /sec E HDFS_SCAN_NODE (id=2):(Total: 1s991ms, non-child: 1s991ms, % non-child: 100.00%) E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 1.95 E - BytesRead: 231.67 MB (242920594) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 69.00 MB (72352232) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 69.00 MB (72352232) E - CachedFileHandlesHitCount: 8 (8) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 1 (1) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 49.07 MB (51448832) E - PerReadThreadRawHdfsThroughput: 1.65 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 638.985ms E - RowBatchQueuePutWaitTime: 5s695ms E - RowsRead: 1.76M (1761372) E - RowsReturned: 1.76M (1760348) E - RowsReturnedRate: 898.16 K/sec E - ScanRangesComplete: 1 (1) E - ScannerThreadsInvoluntaryContextSwitches: 908 (908) E - ScannerThreadsTotalWallClockTime: 15s079ms E - DelimiterParseTime: 4s794ms E - MaterializeTupleTime(*): 329.659ms E - ScannerThreadsSysTime: 30.661ms E - ScannerThreadsUserTime: 1s940ms E - ScannerThreadsVoluntaryContextSwitches: 519 (519) E - TotalRawHdfsOpenFileTime(*): 4.666ms E - TotalRawHdfsReadTime(*): 138.330ms E - TotalReadThroughput: 16.98 MB/sec E CodeGen:(Total: 1s575ms, non-child: 1s575ms, % non-child: 100.00%) E - CodegenTime: 89.331ms E - CompileTime: 124.330ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 33 (33) E - NumInstructions: 559 (559) E - OptimizationTime: 1s270ms E - PeakMemoryUsage: 279.50 KB (286208) E - PrepareTime: 171.329ms E Fragment F04: E Instance a64a18654d28e0c3:e6220f6c00000006 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22002):(Total: 14s080ms, non-child: 213.995ms, % non-child: 1.52%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/157.88 MB 2:2/256.00 MB E Fragment Instance Lifecycle Event Timeline: 14s095ms E - Prepare Finished: 66.998ms (66.998ms) E - Open Finished: 1s500ms (1s433ms) E - First Batch Produced: 1s528ms (27.999ms) E - First Batch Sent: 1s531ms (2.999ms) E - ExecInternal Finished: 14s095ms (12s563ms) E MemoryUsage(500.000ms): 22.22 KB, 301.72 KB, 301.72 KB, 49.06 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 48.58 MB, 32.05 MB, 24.03 MB, 24.05 MB, 24.05 MB, 8.05 MB E ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 2, 2, 2, 2 E - AverageThreadTokens: 2.64 E - BloomFilterBytes: 0 E - PeakMemoryUsage: 49.10 MB (51482533) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 98.15 MB (102915450) E - RowsProduced: 2.00M (2000000) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 7s853ms E - TotalStorageWaitTime: 40.999ms E - TotalThreadsInvoluntaryContextSwitches: 3.83K (3825) E - TotalThreadsTotalWallClockTime: 36s818ms E - TotalThreadsSysTime: 183.971ms E - TotalThreadsUserTime: 6s077ms E - TotalThreadsVoluntaryContextSwitches: 2.24K (2243) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 12s594ms E - ExecTreeExecTime: 2s577ms E - OpenTime: 1s433ms E - ExecTreeOpenTime: 1.999ms E - PrepareTime: 50.998ms E - ExecTreePrepareTime: 18.999ms E KrpcDataStreamSender (dst_id=7):(Total: 9s905ms, non-child: 2s045ms, % non-child: 20.65%) E BytesSent(500.000ms): 0, 0, 0, 211.79 KB, 909.07 KB, 1.44 MB, 1.71 MB, 1.97 MB, 2.19 MB, 2.42 MB, 2.63 MB, 2.81 MB, 2.99 MB, 3.14 MB, 3.27 MB, 3.38 MB, 3.54 MB, 3.75 MB, 3.99 MB, 4.23 MB, 4.49 MB, 4.72 MB, 4.83 MB, 4.83 MB, 4.83 MB, 4.83 MB, 4.83 MB, 4.83 MB E - EosSent: 0 (0) E - NetworkThroughput: 1.95 MB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 2.00M (2000000) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 1s412ms E - TotalBytesSent: 4.83 MB (5064218) E - UncompressedRowBatchSize: 32.42 MB (34000000) E UNION_NODE (id=1):(Total: 2s584ms, non-child: 139.996ms, % non-child: 5.42%) E ExecOption: Codegen Enabled E - PeakMemoryUsage: 0 E - RowsReturned: 2.00M (2000000) E - RowsReturnedRate: 773.71 K/sec E HDFS_SCAN_NODE (id=3):(Total: 81.998ms, non-child: 81.998ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/78.94 MB 2:1/128.00 MB E ExecOption: TEXT Codegen Enabled E BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 0.00 E - BytesRead: 72.00 MB (75497472) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 0 E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 0 E - CachedFileHandlesHitCount: 0 (0) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 0 (0) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 48.63 MB (50993152) E - PerReadThreadRawHdfsThroughput: 1.53 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 0.000ns E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 284.67K (284672) E - RowsReturned: 275.46K (275456) E - RowsReturnedRate: 3.36 M/sec E - ScanRangesComplete: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - DelimiterParseTime: 511.988ms E - MaterializeTupleTime(*): 33.999ms E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalRawHdfsOpenFileTime(*): 1.999ms E - TotalRawHdfsReadTime(*): 45.998ms E - TotalReadThroughput: 0.00 /sec E HDFS_SCAN_NODE (id=2):(Total: 2s362ms, non-child: 2s362ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:1/78.94 MB 2:1/128.00 MB E ExecOption: TEXT Codegen Enabled, Codegen enabled: 2 out of 2 E Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% E File Formats: TEXT/NONE:2 E BytesRead(500.000ms): 0, 0, 0, 48.00 MB, 64.00 MB, 80.00 MB, 88.00 MB, 96.00 MB, 96.00 MB, 96.00 MB, 104.00 MB, 112.00 MB, 112.00 MB, 112.00 MB, 120.00 MB, 120.00 MB, 128.00 MB, 128.00 MB, 136.00 MB, 144.00 MB, 144.00 MB, 150.94 MB, 158.94 MB, 166.94 MB, 174.94 MB, 190.94 MB, 198.94 MB, 206.94 MB E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 1.84 E - BytesRead: 207.00 MB (217056696) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 207.00 MB (217056696) E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 207.00 MB (217056696) E - CachedFileHandlesHitCount: 26 (26) E - CachedFileHandlesMissCount: 1 (1) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 3 (3) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 49.07 MB (51454976) E - PerReadThreadRawHdfsThroughput: 1.76 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 1s916ms E - RowBatchQueuePutWaitTime: 17s085ms E - RowsRead: 1.72M (1724693) E - RowsReturned: 1.72M (1724693) E - RowsReturnedRate: 729.89 K/sec E - ScanRangesComplete: 2 (2) E - ScannerThreadsInvoluntaryContextSwitches: 1.60K (1601) E - ScannerThreadsTotalWallClockTime: 22s789ms E - DelimiterParseTime: 4s188ms E - MaterializeTupleTime(*): 295.993ms E - ScannerThreadsSysTime: 45.992ms E - ScannerThreadsUserTime: 3s014ms E - ScannerThreadsVoluntaryContextSwitches: 841 (841) E - TotalRawHdfsOpenFileTime(*): 9.999ms E - TotalRawHdfsReadTime(*): 114.997ms E - TotalReadThroughput: 14.78 MB/sec E CodeGen:(Total: 1s375ms, non-child: 1s375ms, % non-child: 100.00%) E - CodegenTime: 117.997ms E - CompileTime: 121.997ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 33 (33) E - NumInstructions: 559 (559) E - OptimizationTime: 1s059ms E - PeakMemoryUsage: 279.50 KB (286208) E - PrepareTime: 176.996ms E Instance a64a18654d28e0c3:e6220f6c00000004 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22000):(Total: 13s397ms, non-child: 195.995ms, % non-child: 1.46%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:4/512.00 MB E Fragment Instance Lifecycle Event Timeline: 13s444ms E - Prepare Finished: 108.997ms (108.997ms) E - Open Finished: 2s217ms (2s108ms) E - First Batch Produced: 2s237ms (19.999ms) E - First Batch Sent: 2s239ms (1.999ms) E - ExecInternal Finished: 13s444ms (11s204ms) E MemoryUsage(500.000ms): 301.72 KB, 301.72 KB, 301.72 KB, 301.72 KB, 49.06 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 48.96 MB, 48.07 MB, 48.11 MB, 48.07 MB, 48.05 MB E ThreadUsage(500.000ms): 1, 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 E - AverageThreadTokens: 2.70 E - BloomFilterBytes: 0 E - PeakMemoryUsage: 49.08 MB (51464101) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 249.85 MB (261991194) E - RowsProduced: 1.56M (1555456) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 7s709ms E - TotalStorageWaitTime: 62.998ms E - TotalThreadsInvoluntaryContextSwitches: 2.56K (2562) E - TotalThreadsTotalWallClockTime: 24s557ms E - TotalThreadsSysTime: 123.981ms E - TotalThreadsUserTime: 4s505ms E - TotalThreadsVoluntaryContextSwitches: 1.54K (1537) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 11s227ms E - ExecTreeExecTime: 1s836ms E - OpenTime: 2s107ms E - ExecTreeOpenTime: 1.999ms E - PrepareTime: 50.998ms E - ExecTreePrepareTime: 17.999ms E KrpcDataStreamSender (dst_id=7):(Total: 9s274ms, non-child: 1s563ms, % non-child: 16.86%) E BytesSent(500.000ms): 0, 0, 0, 0, 165.73 KB, 462.80 KB, 749.08 KB, 977.76 KB, 1.18 MB, 1.40 MB, 1.57 MB, 1.75 MB, 1.94 MB, 2.05 MB, 2.17 MB, 2.29 MB, 2.48 MB, 2.71 MB, 2.94 MB, 3.20 MB, 3.47 MB, 3.65 MB, 3.66 MB, 3.66 MB, 3.66 MB, 3.66 MB, 3.66 MB E - EosSent: 0 (0) E - NetworkThroughput: 1.63 MB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 1.55M (1554432) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 1s254ms E - TotalBytesSent: 3.66 MB (3838943) E - UncompressedRowBatchSize: 25.22 MB (26442752) E UNION_NODE (id=1):(Total: 1s853ms, non-child: 198.995ms, % non-child: 10.73%) E ExecOption: Codegen Enabled E - PeakMemoryUsage: 0 E - RowsReturned: 1.56M (1555456) E - RowsReturnedRate: 838.99 K/sec E HDFS_SCAN_NODE (id=3):(Total: 27.999ms, non-child: 27.999ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E ExecOption: TEXT Codegen Enabled E BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - BytesRead: 0 E - CollectionItemsRead: 0 (0) E - PeakMemoryUsage: 0 E - RowBatchQueueGetWaitTime: 0.000ns E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 0 (0) E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - MaterializeTupleTime(*): 0.000ns E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalReadThroughput: 0.00 /sec E HDFS_SCAN_NODE (id=2):(Total: 1s626ms, non-child: 1s626ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E ExecOption: TEXT Codegen Enabled E BytesRead(500.000ms): 0, 0, 0, 0, 48.00 MB, 64.00 MB, 64.00 MB, 64.00 MB, 80.00 MB, 80.00 MB, 80.00 MB, 80.00 MB, 96.00 MB, 96.00 MB, 96.00 MB, 96.00 MB, 96.00 MB, 112.00 MB, 112.00 MB, 112.00 MB, 128.00 MB, 128.00 MB, 144.00 MB, 160.00 MB, 184.00 MB, 200.00 MB, 232.00 MB E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 2.00 E - BytesRead: 232.00 MB (243269632) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 0 E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 0 E - CachedFileHandlesHitCount: 0 (0) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 0 (0) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 49.05 MB (51436544) E - PerReadThreadRawHdfsThroughput: 1.69 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 0.000ns E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 1.56M (1556480) E - RowsReturned: 1.56M (1555456) E - RowsReturnedRate: 956.05 K/sec E - ScanRangesComplete: 2 (2) E - ScannerThreadsInvoluntaryContextSwitches: 1.12K (1125) E - ScannerThreadsTotalWallClockTime: 22s448ms E - DelimiterParseTime: 4s629ms E - MaterializeTupleTime(*): 327.992ms E - ScannerThreadsSysTime: 45.993ms E - ScannerThreadsUserTime: 2s805ms E - ScannerThreadsVoluntaryContextSwitches: 718 (718) E - TotalRawHdfsOpenFileTime(*): 1.999ms E - TotalRawHdfsReadTime(*): 133.996ms E - TotalReadThroughput: 17.18 MB/sec E CodeGen:(Total: 2s072ms, non-child: 2s072ms, % non-child: 100.00%) E - CodegenTime: 89.997ms E - CompileTime: 160.996ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 33 (33) E - NumInstructions: 559 (559) E - OptimizationTime: 1s719ms E - PeakMemoryUsage: 279.50 KB (286208) E - PrepareTime: 185.995ms E Instance a64a18654d28e0c3:e6220f6c00000005 (host=ec2-m2-4xlarge-centos-6-4-0f06.vpc.cloudera.com:22001):(Total: 13s363ms, non-child: 284.993ms, % non-child: 2.13%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:4/512.00 MB E Fragment Instance Lifecycle Event Timeline: 13s375ms E - Prepare Finished: 45.998ms (45.998ms) E - Open Finished: 1s349ms (1s303ms) E - First Batch Produced: 1s374ms (24.999ms) E - First Batch Sent: 1s380ms (5.999ms) E - ExecInternal Finished: 13s375ms (11s994ms) E MemoryUsage(500.000ms): 22.22 KB, 301.72 KB, 301.72 KB, 49.07 MB, 49.07 MB, 49.06 MB, 49.08 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.09 MB, 49.09 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.07 MB, 49.04 MB, 48.78 MB, 48.07 MB, 48.07 MB, 40.07 MB E ThreadUsage(500.000ms): 1, 1, 1, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3 E - AverageThreadTokens: 2.78 E - BloomFilterBytes: 0 E - PeakMemoryUsage: 49.10 MB (51482533) E - PeakReservation: 0 E - PeakUsedReservation: 0 E - PerHostPeakMemUsage: 98.18 MB (102946170) E - RowsProduced: 2.00M (2000000) E - TotalNetworkReceiveTime: 0.000ns E - TotalNetworkSendTime: 7s081ms E - TotalStorageWaitTime: 67.998ms E - TotalThreadsInvoluntaryContextSwitches: 1.91K (1914) E - TotalThreadsTotalWallClockTime: 13s329ms E - TotalThreadsSysTime: 136.979ms E - TotalThreadsUserTime: 3s098ms E - TotalThreadsVoluntaryContextSwitches: 1.18K (1178) E Buffer pool: E - AllocTime: 0.000ns E - CumulativeAllocationBytes: 0 E - CumulativeAllocations: 0 (0) E - PeakReservation: 0 E - PeakUnpinnedBytes: 0 E - PeakUsedReservation: 0 E - ReadIoBytes: 0 E - ReadIoOps: 0 (0) E - ReadIoWaitTime: 0.000ns E - ReservationLimit: 0 E - WriteIoBytes: 0 E - WriteIoOps: 0 (0) E - WriteIoWaitTime: 0.000ns E Fragment Instance Lifecycle Timings: E - ExecTime: 12s025ms E - ExecTreeExecTime: 2s183ms E - OpenTime: 1s303ms E - ExecTreeOpenTime: 1.999ms E - PrepareTime: 31.999ms E - ExecTreePrepareTime: 4.999ms E KrpcDataStreamSender (dst_id=7):(Total: 9s626ms, non-child: 2s543ms, % non-child: 26.43%) E BytesSent(500.000ms): 0, 0, 0, 297.06 KB, 1.09 MB, 1.95 MB, 2.47 MB, 2.88 MB, 3.11 MB, 3.33 MB, 3.56 MB, 3.73 MB, 3.91 MB, 4.09 MB, 4.22 MB, 4.34 MB, 4.47 MB, 4.67 MB, 4.91 MB, 5.15 MB, 5.42 MB, 5.66 MB, 5.81 MB, 5.81 MB, 5.81 MB, 5.81 MB, 5.81 MB E - EosSent: 0 (0) E - NetworkThroughput: 3.08 MB/sec E - PeakMemoryUsage: 14.22 KB (14560) E - RowsSent: 2.00M (2000000) E - RpcFailure: 0 (0) E - RpcRetry: 0 (0) E - SerializeBatchTime: 1s712ms E - TotalBytesSent: 5.81 MB (6093186) E - UncompressedRowBatchSize: 32.42 MB (34000000) E UNION_NODE (id=1):(Total: 2s173ms, non-child: 186.995ms, % non-child: 8.60%) E ExecOption: Codegen Enabled E - PeakMemoryUsage: 0 E - RowsReturned: 2.00M (2000000) E - RowsReturnedRate: 919.98 K/sec E HDFS_SCAN_NODE (id=3):(Total: 2.999ms, non-child: 2.999ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E ExecOption: TEXT Codegen Enabled E BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 E - BytesRead: 0 E - CollectionItemsRead: 0 (0) E - PeakMemoryUsage: 0 E - RowBatchQueueGetWaitTime: 0.000ns E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 0 (0) E - RowsReturned: 0 (0) E - RowsReturnedRate: 0 E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - MaterializeTupleTime(*): 0.000ns E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalReadThroughput: 0.00 /sec E HDFS_SCAN_NODE (id=2):(Total: 1s983ms, non-child: 1s983ms, % non-child: 100.00%) E Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/256.00 MB E ExecOption: TEXT Codegen Enabled E BytesRead(500.000ms): 0, 0, 0, 56.00 MB, 72.00 MB, 96.00 MB, 104.00 MB, 112.00 MB, 112.00 MB, 120.00 MB, 128.00 MB, 128.00 MB, 128.00 MB, 136.00 MB, 144.00 MB, 144.00 MB, 144.00 MB, 152.00 MB, 160.00 MB, 160.00 MB, 168.00 MB, 176.00 MB, 176.00 MB, 200.00 MB, 224.00 MB, 248.00 MB, 256.00 MB E - AverageHdfsReadThreadConcurrency: 0.00 E - AverageScannerThreadConcurrency: 2.00 E - BytesRead: 256.00 MB (268435456) E - BytesReadDataNodeCache: 0 E - BytesReadLocal: 0 E - BytesReadRemoteUnexpected: 0 E - BytesReadShortCircuit: 0 E - CachedFileHandlesHitCount: 0 (0) E - CachedFileHandlesMissCount: 0 (0) E - CollectionItemsRead: 0 (0) E - DecompressionTime: 0.000ns E - MaxCompressedTextFileLength: 0 E - NumDisksAccessed: 0 (0) E - NumScannerThreadsStarted: 2 (2) E - PeakMemoryUsage: 49.07 MB (51454976) E - PerReadThreadRawHdfsThroughput: 1.51 GB/sec E - RemoteScanRanges: 0 (0) E - RowBatchQueueGetWaitTime: 0.000ns E - RowBatchQueuePutWaitTime: 0.000ns E - RowsRead: 2.00M (2002944) E - RowsReturned: 2.00M (2000896) E - RowsReturnedRate: 1.01 M/sec E - ScanRangesComplete: 0 (0) E - ScannerThreadsInvoluntaryContextSwitches: 0 (0) E - ScannerThreadsTotalWallClockTime: 0.000ns E - DelimiterParseTime: 5s564ms E - MaterializeTupleTime(*): 364.991ms E - ScannerThreadsSysTime: 0.000ns E - ScannerThreadsUserTime: 0.000ns E - ScannerThreadsVoluntaryContextSwitches: 0 (0) E - TotalRawHdfsOpenFileTime(*): 1.999ms E - TotalRawHdfsReadTime(*): 165.996ms E - TotalReadThroughput: 18.96 MB/sec E CodeGen:(Total: 1s277ms, non-child: 1s277ms, % non-child: 100.00%) E - CodegenTime: 59.998ms E - CompileTime: 89.997ms E - LoadTime: 0.000ns E - ModuleBitcodeSize: 1.95 MB (2040248) E - NumFunctions: 33 (33) E - NumInstructions: 559 (559) E - OptimizationTime: 1s030ms E - PeakMemoryUsage: 279.50 KB (286208) E - PrepareTime: 150.996ms
Standard Error
-- connecting to: localhost:21000 -- executing against localhost:21000 use functional; SET batch_size=0; SET num_nodes=0; SET disable_codegen_rows_threshold=0; SET disable_codegen=False; SET abort_on_error=1; SET exec_single_node_rows_threshold=0; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS=30000; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE=GLOBAL; -- executing against localhost:21000 SET RUNTIME_FILTER_MAX_SIZE=64K; -- executing against localhost:21000 with l as (select * from tpch.lineitem UNION ALL select * from tpch.lineitem) select STRAIGHT_JOIN count(*) from (select * from tpch.lineitem a LIMIT 1) a join (select * from l LIMIT 500000) b on a.l_orderkey = -b.l_orderkey; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS="0"; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE="2"; -- executing against localhost:21000 SET RUNTIME_FILTER_MAX_SIZE="16777216"; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE=GLOBAL; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS=30000; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE=64KB; -- executing against localhost:21000 with l as (select * from tpch.lineitem UNION ALL select * from tpch.lineitem) select STRAIGHT_JOIN count(*) from (select * from tpch.lineitem a LIMIT 1) a join (select * from l LIMIT 125000) b on a.l_orderkey = -b.l_orderkey; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE="2"; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS="0"; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE="1048576"; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE=GLOBAL; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS=30000; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE=64KB; -- executing against localhost:21000 with l as (select * from tpch.lineitem UNION ALL select * from tpch.lineitem) select STRAIGHT_JOIN count(*) from (select * from tpch.lineitem a LIMIT 1) a join (select * from l LIMIT 500000) b on a.l_orderkey = -b.l_orderkey; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE="2"; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS="0"; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE="1048576"; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE=GLOBAL; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS=30000; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE=64KB; -- executing against localhost:21000 with l as (select * from tpch.lineitem UNION ALL select * from tpch.lineitem) select STRAIGHT_JOIN count(*) from (select * from tpch.lineitem a LIMIT 1) a join (select * from l LIMIT 1000000) b on a.l_orderkey = -b.l_orderkey; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE="2"; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS="0"; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE="1048576"; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE=GLOBAL; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS=30000; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE=64KB; -- executing against localhost:21000 with l as (select * from tpch.lineitem UNION ALL select * from tpch.lineitem) select STRAIGHT_JOIN count(*) from (select * from tpch.lineitem a LIMIT 1) a join (select * from l LIMIT 2000000) b on a.l_orderkey = -b.l_orderkey; -- executing against localhost:21000 SET RUNTIME_FILTER_MODE="2"; -- executing against localhost:21000 SET RUNTIME_FILTER_WAIT_TIME_MS="0"; -- executing against localhost:21000 SET RUNTIME_FILTER_MIN_SIZE="1048576";