Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 2.10.0
    • Fix Version/s: Impala 2.10.0
    • Component/s: Backend
    • Labels:
    • Epic Color:
      ghx-label-1

      Description

      Seen in an ASAN Jenkins build:

      02:45:29  TestRuntimeFilters.test_basic_filters[exec_option: {'disable_codegen': False, 'abort_on_error': 1, 'exec_single_node_rows_threshold': 0, 'batch_size': 0, 'num_nodes': 0} | table_format: rc/snap/block] 
      02:45:29 [gw3] linux2 -- Python 2.6.6 /data/jenkins/workspace/impala-umbrella-build-and-test/repos/Impala/bin/../infra/python/env/bin/python
      02:45:29 query_test/test_runtime_filters.py:39: in test_basic_filters
      02:45:29     self.run_test_case('QueryTest/runtime_filters', vector)
      02:45:29 common/impala_test_suite.py:430: in run_test_case
      02:45:29     verify_runtime_profile(test_section['RUNTIME_PROFILE'], result.runtime_profile)
      02:45:29 common/test_result_verifier.py:560: in verify_runtime_profile
      02:45:29     actual))
      02:45:29 E   AssertionError: Did not find matches for lines in runtime profile:
      02:45:29 E   EXPECTED LINES:
      02:45:29 E   row_regex: .*Files rejected: 7 .*
      02:45:29 E   
      02:45:29 E   ACTUAL PROFILE:
      02:45:29 E   Query (id=364393521d6edaa6:82f92a0300000000):
      02:45:29 E     DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance.
      02:45:29 E     Summary:
      02:45:29 E       Session ID: be475affeee5db0d:e52699dc51ac26ae
      02:45:29 E       Session Type: BEESWAX
      02:45:29 E       Start Time: 2017-06-05 00:31:12.430322000
      02:45:29 E       End Time: 
      02:45:29 E       Query Type: QUERY
      02:45:29 E       Query State: FINISHED
      02:45:29 E       Query Status: OK
      02:45:29 E       Impala Version: impalad version 2.9.0-SNAPSHOT DEBUG (build cde19ab8c7801436070ce0438e28d5042265dfd1)
      02:45:29 E       User: jenkins
      02:45:29 E       Connected User: jenkins
      02:45:29 E       Delegated User: 
      02:45:29 E       Network Address: 127.0.0.1:40832
      02:45:29 E       Default Db: functional_rc_snap
      02:45:29 E       Sql Statement: with t1 as (select month x, bigint_col y from alltypes limit 7300),
      02:45:29 E        t2 as (select int_col x, bigint_col y from alltypestiny limit 2)
      02:45:29 E        select count(*) from t1, t2 where t1.x = t2.x
      02:45:29 E       Coordinator: impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22000
      02:45:29 E       Query Options (non default): ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=15000
      02:45:29 E       Plan: 
      02:45:29 E   ----------------
      02:45:29 E   Per-Host Resource Reservation: Memory=136.00MB
      02:45:29 E   Per-Host Resource Estimates: Memory=138.00MB
      02:45:29 E   WARNING: The following tables are missing relevant table and/or column statistics.
      02:45:29 E   functional_rc_snap.alltypes, functional_rc_snap.alltypestiny
      02:45:29 E   
      02:45:29 E   F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
      02:45:29 E   PLAN-ROOT SINK
      02:45:29 E   |  mem-estimate=0B mem-reservation=0B
      02:45:29 E   |
      02:45:29 E   03:AGGREGATE [FINALIZE]
      02:45:29 E   |  output: count(*)
      02:45:29 E   |  mem-estimate=10.00MB mem-reservation=0B
      02:45:29 E   |  tuple-ids=4 row-size=8B cardinality=1
      02:45:29 E   |
      02:45:29 E   02:HASH JOIN [INNER JOIN, BROADCAST]
      02:45:29 E   |  hash predicates: month = int_col
      02:45:29 E   |  runtime filters: RF000 <- int_col
      02:45:29 E   |  mem-estimate=9B mem-reservation=136.00MB
      02:45:29 E   |  tuple-ids=0,2 row-size=8B cardinality=7300
      02:45:29 E   |
      02:45:29 E   |--06:EXCHANGE [UNPARTITIONED]
      02:45:29 E   |  |  mem-estimate=0B mem-reservation=0B
      02:45:29 E   |  |  tuple-ids=2 row-size=4B cardinality=2
      02:45:29 E   |  |
      02:45:29 E   |  F03:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1
      02:45:29 E   |  05:EXCHANGE [UNPARTITIONED]
      02:45:29 E   |  |  limit: 2
      02:45:29 E   |  |  mem-estimate=0B mem-reservation=0B
      02:45:29 E   |  |  tuple-ids=2 row-size=4B cardinality=2
      02:45:29 E   |  |
      02:45:29 E   |  F02:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
      02:45:29 E   |  01:SCAN HDFS [functional_rc_snap.alltypestiny, RANDOM]
      02:45:29 E   |     partitions=4/4 files=4 size=1.38KB
      02:45:29 E   |     stats-rows=unavailable extrapolated-rows=disabled
      02:45:29 E   |     table stats: rows=unavailable size=unavailable
      02:45:29 E   |     column stats: unavailable
      02:45:29 E   |     limit: 2
      02:45:29 E   |     mem-estimate=32.00MB mem-reservation=0B
      02:45:29 E   |     tuple-ids=2 row-size=4B cardinality=2
      02:45:29 E   |
      02:45:29 E   04:EXCHANGE [UNPARTITIONED]
      02:45:29 E   |  limit: 7300
      02:45:29 E   |  mem-estimate=0B mem-reservation=0B
      02:45:29 E   |  tuple-ids=0 row-size=4B cardinality=7300
      02:45:29 E   |
      02:45:29 E   F00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3
      02:45:29 E   00:SCAN HDFS [functional_rc_snap.alltypes, RANDOM]
      02:45:29 E      partitions=24/24 files=24 size=108.20KB
      02:45:29 E      runtime filters: RF000 -> month
      02:45:29 E      stats-rows=unavailable extrapolated-rows=disabled
      02:45:29 E      table stats: rows=unavailable size=unavailable
      02:45:29 E      columns missing stats: bigint_col
      02:45:29 E      limit: 7300
      02:45:29 E      mem-estimate=128.00MB mem-reservation=0B
      02:45:29 E      tuple-ids=0 row-size=4B cardinality=7300
      02:45:29 E   ----------------
      02:45:29 E       Estimated Per-Host Mem: 144703497
      02:45:29 E       Per-Host Memory Reservation: 142606336
      02:45:29 E       Tables Missing Stats: functional_rc_snap.alltypes,functional_rc_snap.alltypestiny
      02:45:29 E       Request Pool: default-pool
      02:45:29 E       Admission result: Admitted immediately
      02:45:29 E       Planner Timeline: 8.840ms
      02:45:29 E          - Analysis finished: 6.444ms (6.444ms)
      02:45:29 E          - Equivalence classes computed: 6.565ms (121.771us)
      02:45:29 E          - Single node plan created: 7.679ms (1.113ms)
      02:45:29 E          - Runtime filters computed: 7.797ms (117.428us)
      02:45:29 E          - Distributed plan created: 7.941ms (144.288us)
      02:45:29 E          - Planning finished: 8.840ms (899.092us)
      02:45:29 E       Query Timeline: 15s804ms
      02:45:29 E          - Query submitted: 10.999ms (10.999ms)
      02:45:29 E          - Planning finished: 66.999ms (55.999ms)
      02:45:29 E          - Submit for admission: 170.997ms (103.998ms)
      02:45:29 E          - Completed admission: 172.997ms (1.999ms)
      02:45:29 E          - Ready to start on 3 backends: 309.995ms (136.998ms)
      02:45:29 E          - All 3 execution backends (8 fragment instances) started: 665.991ms (355.995ms)
      02:45:29 E          - First dynamic filter received: 15s605ms (14s939ms)
      02:45:29 E          - Rows available: 15s625ms (19.999ms)
      02:45:29 E          - First row fetched: 15s662ms (36.999ms)
      02:45:29 E        - ComputeScanRangeAssignmentTimer: 26.999ms
      02:45:29 E     ImpalaServer:
      02:45:29 E        - ClientFetchWaitTimer: 36.999ms
      02:45:29 E        - RowMaterializationTimer: 104.998ms
      02:45:29 E     Execution Profile 364393521d6edaa6:82f92a0300000000:(Total: 15s367ms, non-child: 0.000ns, % non-child: 0.00%)
      02:45:29 E       Number of filters: 1
      02:45:29 E       Filter routing table: 
      02:45:29 E    ID  Src. Node  Tgt. Node(s)  Target type  Partition filter  Pending (Expected)  First arrived  Completed   Enabled
      02:45:29 E   -------------------------------------------------------------------------------------------------------------------
      02:45:29 E     0          2             0       REMOTE              true               1 (1)            N/A        N/A      true
      02:45:29 E       Backend startup latencies: Count: 3, min / max: 74ms / 340ms, 25th %-ile: 74ms, 50th %-ile: 118ms, 75th %-ile: 118ms, 90th %-ile: 340ms, 95th %-ile: 340ms, 99.9th %-ile: 340ms
      02:45:29 E       Final filter table: 
      02:45:29 E    ID  Src. Node  Tgt. Node(s)  Target type  Partition filter  Pending (Expected)  First arrived  Completed   Enabled
      02:45:29 E   -------------------------------------------------------------------------------------------------------------------
      02:45:29 E     0          2             0       REMOTE              true               0 (1)       15s605ms   15s605ms     false
      02:45:29 E       Per Node Peak Memory Usage: impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22000(2.32 MB) impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22001(122.59 KB) impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22002(125.59 KB) 
      02:45:29 E        - FiltersReceived: 1 (1)
      02:45:29 E        - FinalizationTimer: 0.000ns
      02:45:29 E       Averaged Fragment F01:(Total: 14s651ms, non-child: 1s317ms, % non-child: 9.00%)
      02:45:29 E         split sizes:  min: 0, max: 0, avg: 0, stddev: 0
      02:45:29 E         completion times: min:15s088ms  max:15s088ms  mean: 15s088ms  stddev:0.000ns
      02:45:29 E         execution rates: min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  stddev:0.00 /sec
      02:45:29 E         num instances: 1
      02:45:29 E          - AverageThreadTokens: 0.00 
      02:45:29 E          - BloomFilterBytes: 1.00 MB (1048576)
      02:45:29 E          - PeakMemoryUsage: 2.17 MB (2273888)
      02:45:29 E          - PerHostPeakMemUsage: 2.32 MB (2437872)
      02:45:29 E          - RowsProduced: 1 (1)
      02:45:29 E          - TotalNetworkReceiveTime: 15.999ms
      02:45:29 E          - TotalNetworkSendTime: 0.000ns
      02:45:29 E          - TotalStorageWaitTime: 0.000ns
      02:45:29 E          - TotalThreadsInvoluntaryContextSwitches: 52.17K (52173)
      02:45:29 E          - TotalThreadsTotalWallClockTime: 10s686ms
      02:45:29 E            - TotalThreadsSysTime: 194.970ms
      02:45:29 E            - TotalThreadsUserTime: 1s648ms
      02:45:29 E          - TotalThreadsVoluntaryContextSwitches: 222 (222)
      02:45:29 E         Fragment Instance Lifecycle Timings:
      02:45:29 E            - ExecTime: 39.999ms
      02:45:29 E              - ExecTreeExecTime: 0.000ns
      02:45:29 E            - OpenTime: 10s595ms
      02:45:29 E              - ExecTreeOpenTime: 129.998ms
      02:45:29 E            - PrepareTime: 4s013ms
      02:45:29 E              - ExecTreePrepareTime: 49.999ms
      02:45:29 E         BlockMgr:
      02:45:29 E            - BlockWritesOutstanding: 0 (0)
      02:45:29 E            - BlocksCreated: 16 (16)
      02:45:29 E            - BlocksRecycled: 0 (0)
      02:45:29 E            - BufferedPins: 0 (0)
      02:45:29 E            - MaxBlockSize: 8.00 MB (8388608)
      02:45:29 E            - MemoryLimit: 14.31 GB (15365329920)
      02:45:29 E            - PeakMemoryUsage: 32.00 B (32)
      02:45:29 E            - ScratchBytesRead: 0
      02:45:29 E            - ScratchBytesWritten: 0
      02:45:29 E            - ScratchFileUsedBytes: 0
      02:45:29 E            - ScratchReads: 0 (0)
      02:45:29 E            - ScratchWrites: 0 (0)
      02:45:29 E            - TotalBufferWaitTime: 0.000ns
      02:45:29 E            - TotalEncryptionTime: 0.000ns
      02:45:29 E            - TotalReadBlockTime: 0.000ns
      02:45:29 E         PLAN_ROOT_SINK:
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E         CodeGen:(Total: 13s153ms, non-child: 13s153ms, % non-child: 100.00%)
      02:45:29 E            - CodegenTime: 52.999ms
      02:45:29 E            - CompileTime: 667.991ms
      02:45:29 E            - LoadTime: 0.000ns
      02:45:29 E            - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E            - NumFunctions: 56 (56)
      02:45:29 E            - NumInstructions: 2.44K (2445)
      02:45:29 E            - OptimizationTime: 9s789ms
      02:45:29 E            - PeakMemoryUsage: 1.19 MB (1251840)
      02:45:29 E            - PrepareTime: 2s633ms
      02:45:29 E         AGGREGATION_NODE (id=3):(Total: 179.997ms, non-child: 0.000ns, % non-child: 0.00%)
      02:45:29 E            - BuildTime: 0.000ns
      02:45:29 E            - GetResultsTime: 0.000ns
      02:45:29 E            - HTResizeTime: 0.000ns
      02:45:29 E            - HashBuckets: 0 (0)
      02:45:29 E            - LargestPartitionPercent: 0 (0)
      02:45:29 E            - MaxPartitionLevel: 0 (0)
      02:45:29 E            - NumRepartitions: 0 (0)
      02:45:29 E            - PartitionsCreated: 0 (0)
      02:45:29 E            - PeakMemoryUsage: 88.00 KB (90112)
      02:45:29 E            - RowsRepartitioned: 0 (0)
      02:45:29 E            - RowsReturned: 1 (1)
      02:45:29 E            - RowsReturnedRate: 5.00 /sec
      02:45:29 E            - SpilledPartitions: 0 (0)
      02:45:29 E         HASH_JOIN_NODE (id=2):(Total: 191.997ms, non-child: 171.997ms, % non-child: 89.58%)
      02:45:29 E            - BuildRows: 2 (2)
      02:45:29 E            - BuildTime: 51.999ms
      02:45:29 E            - NumHashTableBuildsSkipped: 0 (0)
      02:45:29 E            - PeakMemoryUsage: 1.04 MB (1087744)
      02:45:29 E            - ProbeRows: 4.87K (4870)
      02:45:29 E            - ProbeRowsPartitioned: 0 (0)
      02:45:29 E            - ProbeTime: 0.000ns
      02:45:29 E            - RowsReturned: 620 (620)
      02:45:29 E            - RowsReturnedRate: 3.23 K/sec
      02:45:29 E           Hash Join Builder (join_node_id=2):
      02:45:29 E              - BuildRowsPartitionTime: 0.000ns
      02:45:29 E              - BuildRowsPartitioned: 2 (2)
      02:45:29 E              - GetNewBlockTime: 999.987us
      02:45:29 E              - HashBuckets: 2 (2)
      02:45:29 E              - HashCollisions: 0 (0)
      02:45:29 E              - HashTablesBuildTime: 999.987us
      02:45:29 E              - LargestPartitionPercent: 50 (50)
      02:45:29 E              - MaxPartitionLevel: 0 (0)
      02:45:29 E              - NumRepartitions: 0 (0)
      02:45:29 E              - PartitionsCreated: 16 (16)
      02:45:29 E              - PeakMemoryUsage: 1.01 MB (1057920)
      02:45:29 E              - PinTime: 0.000ns
      02:45:29 E              - RepartitionTime: 0.000ns
      02:45:29 E              - SpilledPartitions: 0 (0)
      02:45:29 E              - UnpinTime: 0.000ns
      02:45:29 E           EXCHANGE_NODE (id=6):
      02:45:29 E              - BytesReceived: 22.00 B (22)
      02:45:29 E              - ConvertRowBatchTime: 0.000ns
      02:45:29 E              - DeserializeRowBatchTimer: 0.000ns
      02:45:29 E              - FirstBatchArrivalWaitTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - RowsReturnedRate: 0
      02:45:29 E              - SendersBlockedTimer: 0.000ns
      02:45:29 E              - SendersBlockedTotalTimer(*): 0.000ns
      02:45:29 E         EXCHANGE_NODE (id=4):(Total: 19.999ms, non-child: 19.999ms, % non-child: 100.00%)
      02:45:29 E            - BytesReceived: 19.16 KB (19624)
      02:45:29 E            - ConvertRowBatchTime: 2.999ms
      02:45:29 E            - DeserializeRowBatchTimer: 1.999ms
      02:45:29 E            - FirstBatchArrivalWaitTime: 0.000ns
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E            - RowsReturned: 4.87K (4870)
      02:45:29 E            - RowsReturnedRate: 243.50 K/sec
      02:45:29 E            - SendersBlockedTimer: 0.000ns
      02:45:29 E            - SendersBlockedTotalTimer(*): 0.000ns
      02:45:29 E       Coordinator Fragment F01:
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000000 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22000):(Total: 14s651ms, non-child: 1s317ms, % non-child: 9.00%)
      02:45:29 E           MemoryUsage(500.000ms): 38.25 KB, 38.25 KB, 38.25 KB, 38.25 KB, 38.25 KB, 38.25 KB, 38.25 KB, 50.27 KB, 50.27 KB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 1.24 MB, 50.27 KB, 50.27 KB
      02:45:29 E            - AverageThreadTokens: 0.00 
      02:45:29 E            - BloomFilterBytes: 1.00 MB (1048576)
      02:45:29 E            - PeakMemoryUsage: 2.17 MB (2273888)
      02:45:29 E            - PerHostPeakMemUsage: 2.32 MB (2437872)
      02:45:29 E            - RowsProduced: 1 (1)
      02:45:29 E            - TotalNetworkReceiveTime: 15.999ms
      02:45:29 E            - TotalNetworkSendTime: 0.000ns
      02:45:29 E            - TotalStorageWaitTime: 0.000ns
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 52.17K (52173)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 10s686ms
      02:45:29 E              - TotalThreadsSysTime: 194.970ms
      02:45:29 E              - TotalThreadsUserTime: 1s648ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 222 (222)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 39.999ms
      02:45:29 E                - ExecTreeExecTime: 0.000ns
      02:45:29 E              - OpenTime: 10s595ms
      02:45:29 E                - ExecTreeOpenTime: 129.998ms
      02:45:29 E              - PrepareTime: 4s013ms
      02:45:29 E                - ExecTreePrepareTime: 49.999ms
      02:45:29 E           BlockMgr:
      02:45:29 E              - BlockWritesOutstanding: 0 (0)
      02:45:29 E              - BlocksCreated: 16 (16)
      02:45:29 E              - BlocksRecycled: 0 (0)
      02:45:29 E              - BufferedPins: 0 (0)
      02:45:29 E              - MaxBlockSize: 8.00 MB (8388608)
      02:45:29 E              - MemoryLimit: 14.31 GB (15365329920)
      02:45:29 E              - PeakMemoryUsage: 32.00 B (32)
      02:45:29 E              - ScratchBytesRead: 0
      02:45:29 E              - ScratchBytesWritten: 0
      02:45:29 E              - ScratchFileUsedBytes: 0
      02:45:29 E              - ScratchReads: 0 (0)
      02:45:29 E              - ScratchWrites: 0 (0)
      02:45:29 E              - TotalBufferWaitTime: 0.000ns
      02:45:29 E              - TotalEncryptionTime: 0.000ns
      02:45:29 E              - TotalReadBlockTime: 0.000ns
      02:45:29 E           PLAN_ROOT_SINK:
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E           CodeGen:(Total: 13s153ms, non-child: 13s153ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 52.999ms
      02:45:29 E              - CompileTime: 667.991ms
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 56 (56)
      02:45:29 E              - NumInstructions: 2.44K (2445)
      02:45:29 E              - OptimizationTime: 9s789ms
      02:45:29 E              - PeakMemoryUsage: 1.19 MB (1251840)
      02:45:29 E              - PrepareTime: 2s633ms
      02:45:29 E           AGGREGATION_NODE (id=3):(Total: 179.997ms, non-child: 0.000ns, % non-child: 0.00%)
      02:45:29 E             ExecOption: Codegen Enabled
      02:45:29 E              - BuildTime: 0.000ns
      02:45:29 E              - GetResultsTime: 0.000ns
      02:45:29 E              - HTResizeTime: 0.000ns
      02:45:29 E              - HashBuckets: 0 (0)
      02:45:29 E              - LargestPartitionPercent: 0 (0)
      02:45:29 E              - MaxPartitionLevel: 0 (0)
      02:45:29 E              - NumRepartitions: 0 (0)
      02:45:29 E              - PartitionsCreated: 0 (0)
      02:45:29 E              - PeakMemoryUsage: 88.00 KB (90112)
      02:45:29 E              - RowsRepartitioned: 0 (0)
      02:45:29 E              - RowsReturned: 1 (1)
      02:45:29 E              - RowsReturnedRate: 5.00 /sec
      02:45:29 E              - SpilledPartitions: 0 (0)
      02:45:29 E           HASH_JOIN_NODE (id=2):(Total: 191.997ms, non-child: 171.997ms, % non-child: 89.58%)
      02:45:29 E             ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously
      02:45:29 E              - BuildRows: 2 (2)
      02:45:29 E              - BuildTime: 51.999ms
      02:45:29 E              - NumHashTableBuildsSkipped: 0 (0)
      02:45:29 E              - PeakMemoryUsage: 1.04 MB (1087744)
      02:45:29 E              - ProbeRows: 4.87K (4870)
      02:45:29 E              - ProbeRowsPartitioned: 0 (0)
      02:45:29 E              - ProbeTime: 0.000ns
      02:45:29 E              - RowsReturned: 620 (620)
      02:45:29 E              - RowsReturnedRate: 3.23 K/sec
      02:45:29 E             Hash Join Builder (join_node_id=2):
      02:45:29 E               ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled
      02:45:29 E               Runtime filters: 1 of 1 Runtime Filter Published
      02:45:29 E                - BuildRowsPartitionTime: 0.000ns
      02:45:29 E                - BuildRowsPartitioned: 2 (2)
      02:45:29 E                - GetNewBlockTime: 999.987us
      02:45:29 E                - HashBuckets: 2 (2)
      02:45:29 E                - HashCollisions: 0 (0)
      02:45:29 E                - HashTablesBuildTime: 999.987us
      02:45:29 E                - LargestPartitionPercent: 50 (50)
      02:45:29 E                - MaxPartitionLevel: 0 (0)
      02:45:29 E                - NumRepartitions: 0 (0)
      02:45:29 E                - PartitionsCreated: 16 (16)
      02:45:29 E                - PeakMemoryUsage: 1.01 MB (1057920)
      02:45:29 E                - PinTime: 0.000ns
      02:45:29 E                - RepartitionTime: 0.000ns
      02:45:29 E                - SpilledPartitions: 0 (0)
      02:45:29 E                - UnpinTime: 0.000ns
      02:45:29 E             EXCHANGE_NODE (id=6):
      02:45:29 E               BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B, 22.00 B
      02:45:29 E                - BytesReceived: 22.00 B (22)
      02:45:29 E                - ConvertRowBatchTime: 0.000ns
      02:45:29 E                - DeserializeRowBatchTimer: 0.000ns
      02:45:29 E                - FirstBatchArrivalWaitTime: 0.000ns
      02:45:29 E                - PeakMemoryUsage: 0
      02:45:29 E                - RowsReturned: 2 (2)
      02:45:29 E                - RowsReturnedRate: 0
      02:45:29 E                - SendersBlockedTimer: 0.000ns
      02:45:29 E                - SendersBlockedTotalTimer(*): 0.000ns
      02:45:29 E           EXCHANGE_NODE (id=4):(Total: 19.999ms, non-child: 3.999ms, % non-child: 20.00%)
      02:45:29 E             BytesReceived(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
      02:45:29 E              - BytesReceived: 19.16 KB (19624)
      02:45:29 E              - ConvertRowBatchTime: 2.999ms
      02:45:29 E              - DeserializeRowBatchTimer: 1.999ms
      02:45:29 E              - FirstBatchArrivalWaitTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - RowsReturned: 4.87K (4870)
      02:45:29 E              - RowsReturnedRate: 243.50 K/sec
      02:45:29 E              - SendersBlockedTimer: 0.000ns
      02:45:29 E              - SendersBlockedTotalTimer(*): 0.000ns
      02:45:29 E       Averaged Fragment F00:(Total: 14s824ms, non-child: 1s535ms, % non-child: 10.36%)
      02:45:29 E         split sizes:  min: 35.88 KB, max: 36.22 KB, avg: 36.07 KB, stddev: 146.47 B
      02:45:29 E         completion times: min:14s972ms  max:15s142ms  mean: 15s069ms  stddev:71.227ms
      02:45:29 E         execution rates: min:2.37 KB/sec  max:2.41 KB/sec  mean:2.39 KB/sec  stddev:17.91 B/sec
      02:45:29 E         num instances: 3
      02:45:29 E          - AverageThreadTokens: 1.70 
      02:45:29 E          - BloomFilterBytes: 341.33 KB (349525)
      02:45:29 E          - PeakMemoryUsage: 436.59 KB (447072)
      02:45:29 E          - PerHostPeakMemUsage: 876.31 KB (897338)
      02:45:29 E          - RowsProduced: 1.62K (1623)
      02:45:29 E          - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E          - TotalNetworkSendTime: 333.328us
      02:45:29 E          - TotalStorageWaitTime: 1.999ms
      02:45:29 E          - TotalThreadsInvoluntaryContextSwitches: 23 (23)
      02:45:29 E          - TotalThreadsTotalWallClockTime: 22s291ms
      02:45:29 E            - TotalThreadsSysTime: 12.331ms
      02:45:29 E            - TotalThreadsUserTime: 50.325ms
      02:45:29 E          - TotalThreadsVoluntaryContextSwitches: 1.12K (1118)
      02:45:29 E         Fragment Instance Lifecycle Timings:
      02:45:29 E            - ExecTime: 12s041ms
      02:45:29 E              - ExecTreeExecTime: 12s039ms
      02:45:29 E            - OpenTime: 2.999ms
      02:45:29 E              - ExecTreeOpenTime: 2.999ms
      02:45:29 E            - PrepareTime: 2s777ms
      02:45:29 E              - ExecTreePrepareTime: 5.999ms
      02:45:29 E         DataStreamSender (dst_id=4):(Total: 1.666ms, non-child: 1.666ms, % non-child: 100.00%)
      02:45:29 E            - BytesSent: 6.39 KB (6541)
      02:45:29 E            - NetworkThroughput(*): 3.13 MB/sec
      02:45:29 E            - OverallThroughput: 3.12 MB/sec
      02:45:29 E            - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E            - RowsReturned: 1.62K (1623)
      02:45:29 E            - SerializeBatchTime: 999.986us
      02:45:29 E            - TransmitDataRPCTime: 333.329us
      02:45:29 E            - UncompressedRowBatchSize: 6.39 KB (6541)
      02:45:29 E         CodeGen:(Total: 1s230ms, non-child: 1s230ms, % non-child: 100.00%)
      02:45:29 E            - CodegenTime: 0.000ns
      02:45:29 E            - CompileTime: 0.000ns
      02:45:29 E            - LoadTime: 0.000ns
      02:45:29 E            - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E            - NumFunctions: 0 (0)
      02:45:29 E            - NumInstructions: 0 (0)
      02:45:29 E            - OptimizationTime: 0.000ns
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E            - PrepareTime: 1s194ms
      02:45:29 E         HDFS_SCAN_NODE (id=0):(Total: 12s055ms, non-child: 12s055ms, % non-child: 100.00%)
      02:45:29 E            - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E            - AverageScannerThreadConcurrency: 0.86 
      02:45:29 E            - BytesRead: 29.36 KB (30069)
      02:45:29 E            - BytesReadDataNodeCache: 0
      02:45:29 E            - BytesReadLocal: 29.36 KB (30069)
      02:45:29 E            - BytesReadRemoteUnexpected: 0
      02:45:29 E            - BytesReadShortCircuit: 29.36 KB (30069)
      02:45:29 E            - BytesSkipped: 0
      02:45:29 E            - CachedFileHandlesHitCount: 10 (10)
      02:45:29 E            - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E            - DecompressionTime: 0.000ns
      02:45:29 E            - MaxCompressedTextFileLength: 0
      02:45:29 E            - NumDisksAccessed: 2 (2)
      02:45:29 E            - NumScannerThreadsStarted: 1 (1)
      02:45:29 E            - PeakMemoryUsage: 61.67 KB (63146)
      02:45:29 E            - PerReadThreadRawHdfsThroughput: 19.16 MB/sec
      02:45:29 E            - RemoteScanRanges: 0 (0)
      02:45:29 E            - RowBatchQueueGetWaitTime: 8.999ms
      02:45:29 E            - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E            - RowsRead: 1.62K (1623)
      02:45:29 E            - RowsReturned: 1.62K (1623)
      02:45:29 E            - RowsReturnedRate: 126.00 /sec
      02:45:29 E            - ScanRangesComplete: 8 (8)
      02:45:29 E            - ScannerThreadsInvoluntaryContextSwitches: 21 (21)
      02:45:29 E            - ScannerThreadsTotalWallClockTime: 10s246ms
      02:45:29 E              - MaterializeTupleTime(*): 333.329us
      02:45:29 E              - ScannerThreadsSysTime: 3.666ms
      02:45:29 E              - ScannerThreadsUserTime: 35.660ms
      02:45:29 E            - ScannerThreadsVoluntaryContextSwitches: 511 (511)
      02:45:29 E            - TotalRawHdfsReadTime(*): 1.333ms
      02:45:29 E            - TotalReadThroughput: 0.00 /sec
      02:45:29 E           Filter 0 (1.00 MB):
      02:45:29 E              - Files processed: 2 (2)
      02:45:29 E              - Files rejected: 2 (2)
      02:45:29 E              - Files total: 8 (8)
      02:45:29 E              - RowGroups processed: 0 (0)
      02:45:29 E              - RowGroups rejected: 0 (0)
      02:45:29 E              - RowGroups total: 0 (0)
      02:45:29 E              - Rows processed: 0 (0)
      02:45:29 E              - Rows rejected: 0 (0)
      02:45:29 E              - Rows total: 0 (0)
      02:45:29 E              - Splits processed: 0 (0)
      02:45:29 E              - Splits rejected: 0 (0)
      02:45:29 E              - Splits total: 0 (0)
      02:45:29 E         BlockMgr:
      02:45:29 E            - BlockWritesOutstanding: 0 (0)
      02:45:29 E            - BlocksCreated: 0 (0)
      02:45:29 E            - BlocksRecycled: 0 (0)
      02:45:29 E            - BufferedPins: 0 (0)
      02:45:29 E            - MaxBlockSize: 8.00 MB (8388608)
      02:45:29 E            - MemoryLimit: 14.31 GB (15365329920)
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E            - ScratchBytesRead: 0
      02:45:29 E            - ScratchBytesWritten: 0
      02:45:29 E            - ScratchFileUsedBytes: 0
      02:45:29 E            - ScratchReads: 0 (0)
      02:45:29 E            - ScratchWrites: 0 (0)
      02:45:29 E            - TotalBufferWaitTime: 0.000ns
      02:45:29 E            - TotalEncryptionTime: 0.000ns
      02:45:29 E            - TotalReadBlockTime: 0.000ns
      02:45:29 E       Fragment F00:
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000001 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22002):(Total: 15s045ms, non-child: 1s653ms, % non-child: 10.99%)
      02:45:29 E           Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/4.63 KB 0:2/8.60 KB 2:5/22.99 KB 
      02:45:29 E           MemoryUsage(500.000ms): 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
      02:45:29 E            - AverageThreadTokens: 1.70 
      02:45:29 E            - BloomFilterBytes: 0
      02:45:29 E            - PeakMemoryUsage: 125.59 KB (128608)
      02:45:29 E            - PerHostPeakMemUsage: 125.59 KB (128608)
      02:45:29 E            - RowsProduced: 2.44K (2440)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 0.000ns
      02:45:29 E            - TotalStorageWaitTime: 999.987us
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 39 (39)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 22s971ms
      02:45:29 E              - TotalThreadsSysTime: 17.997ms
      02:45:29 E              - TotalThreadsUserTime: 48.992ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 1.16K (1159)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 12s677ms
      02:45:29 E                - ExecTreeExecTime: 12s675ms
      02:45:29 E              - OpenTime: 3.999ms
      02:45:29 E                - ExecTreeOpenTime: 3.999ms
      02:45:29 E              - PrepareTime: 2s362ms
      02:45:29 E                - ExecTreePrepareTime: 2.999ms
      02:45:29 E           BlockMgr:
      02:45:29 E              - BlockWritesOutstanding: 0 (0)
      02:45:29 E              - BlocksCreated: 0 (0)
      02:45:29 E              - BlocksRecycled: 0 (0)
      02:45:29 E              - BufferedPins: 0 (0)
      02:45:29 E              - MaxBlockSize: 8.00 MB (8388608)
      02:45:29 E              - MemoryLimit: 14.31 GB (15365329920)
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - ScratchBytesRead: 0
      02:45:29 E              - ScratchBytesWritten: 0
      02:45:29 E              - ScratchFileUsedBytes: 0
      02:45:29 E              - ScratchReads: 0 (0)
      02:45:29 E              - ScratchWrites: 0 (0)
      02:45:29 E              - TotalBufferWaitTime: 0.000ns
      02:45:29 E              - TotalEncryptionTime: 0.000ns
      02:45:29 E              - TotalReadBlockTime: 0.000ns
      02:45:29 E           DataStreamSender (dst_id=4):(Total: 1.999ms, non-child: 1.999ms, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 9.60 KB (9832)
      02:45:29 E              - NetworkThroughput(*): 9.38 MB/sec
      02:45:29 E              - OverallThroughput: 4.69 MB/sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 2.44K (2440)
      02:45:29 E              - SerializeBatchTime: 999.987us
      02:45:29 E              - TransmitDataRPCTime: 999.987us
      02:45:29 E              - UncompressedRowBatchSize: 9.60 KB (9832)
      02:45:29 E           CodeGen:(Total: 702.990ms, non-child: 702.990ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 680.990ms
      02:45:29 E           HDFS_SCAN_NODE (id=0):(Total: 12s686ms, non-child: 12s686ms, % non-child: 100.00%)
      02:45:29 E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/4.63 KB 0:2/8.60 KB 2:5/22.99 KB 
      02:45:29 E             ExecOption: RC_FILE Codegen Disabled: Not implemented for this format.
      02:45:29 E   , Codegen enabled: 0 out of 16
      02:45:29 E             Runtime filters: Only following filters arrived: , waited 12s662ms
      02:45:29 E             Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 
      02:45:29 E             File Formats: RC_FILE/SNAPPY_BLOCKED:8 
      02:45:29 E             BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
      02:45:29 E              - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E              - AverageScannerThreadConcurrency: 0.81 
      02:45:29 E              - BytesRead: 44.22 KB (45281)
      02:45:29 E              - BytesReadDataNodeCache: 0
      02:45:29 E              - BytesReadLocal: 44.22 KB (45281)
      02:45:29 E              - BytesReadRemoteUnexpected: 0
      02:45:29 E              - BytesReadShortCircuit: 44.22 KB (45281)
      02:45:29 E              - BytesSkipped: 0
      02:45:29 E              - CachedFileHandlesHitCount: 16 (16)
      02:45:29 E              - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E              - DecompressionTime: 0.000ns
      02:45:29 E              - MaxCompressedTextFileLength: 0
      02:45:29 E              - NumDisksAccessed: 4 (4)
      02:45:29 E              - NumScannerThreadsStarted: 1 (1)
      02:45:29 E              - PeakMemoryUsage: 92.00 KB (94208)
      02:45:29 E              - PerReadThreadRawHdfsThroughput: 43.18 MB/sec
      02:45:29 E              - RemoteScanRanges: 0 (0)
      02:45:29 E              - RowBatchQueueGetWaitTime: 11.999ms
      02:45:29 E              - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E              - RowsRead: 2.44K (2440)
      02:45:29 E              - RowsReturned: 2.44K (2440)
      02:45:29 E              - RowsReturnedRate: 192.00 /sec
      02:45:29 E              - ScanRangesComplete: 8 (8)
      02:45:29 E              - ScannerThreadsInvoluntaryContextSwitches: 38 (38)
      02:45:29 E              - ScannerThreadsTotalWallClockTime: 10s289ms
      02:45:29 E                - MaterializeTupleTime(*): 999.987us
      02:45:29 E                - ScannerThreadsSysTime: 10.998ms
      02:45:29 E                - ScannerThreadsUserTime: 35.994ms
      02:45:29 E              - ScannerThreadsVoluntaryContextSwitches: 516 (516)
      02:45:29 E              - TotalRawHdfsReadTime(*): 999.986us
      02:45:29 E              - TotalReadThroughput: 0.00 /sec
      02:45:29 E             Filter 0 (1.00 MB):
      02:45:29 E                - Files processed: 0 (0)
      02:45:29 E                - Files rejected: 0 (0)
      02:45:29 E                - Files total: 8 (8)
      02:45:29 E                - RowGroups processed: 0 (0)
      02:45:29 E                - RowGroups rejected: 0 (0)
      02:45:29 E                - RowGroups total: 0 (0)
      02:45:29 E                - Rows processed: 0 (0)
      02:45:29 E                - Rows rejected: 0 (0)
      02:45:29 E                - Rows total: 0 (0)
      02:45:29 E                - Splits processed: 0 (0)
      02:45:29 E                - Splits rejected: 0 (0)
      02:45:29 E                - Splits total: 0 (0)
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000002 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22001):(Total: 15s026ms, non-child: 1s162ms, % non-child: 7.74%)
      02:45:29 E           Hdfs split stats (<volume id>:<# splits>/<split lengths>): 2:3/13.51 KB 0:5/22.36 KB 
      02:45:29 E           MemoryUsage(500.000ms): 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
      02:45:29 E            - AverageThreadTokens: 1.70 
      02:45:29 E            - BloomFilterBytes: 0
      02:45:29 E            - PeakMemoryUsage: 122.59 KB (125536)
      02:45:29 E            - PerHostPeakMemUsage: 122.59 KB (125536)
      02:45:29 E            - RowsProduced: 2.43K (2430)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 999.986us
      02:45:29 E            - TotalStorageWaitTime: 4.999ms
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 32 (32)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 23s384ms
      02:45:29 E              - TotalThreadsSysTime: 10.998ms
      02:45:29 E              - TotalThreadsUserTime: 52.992ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 1.18K (1177)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 12s995ms
      02:45:29 E                - ExecTreeExecTime: 12s992ms
      02:45:29 E              - OpenTime: 2.999ms
      02:45:29 E                - ExecTreeOpenTime: 2.999ms
      02:45:29 E              - PrepareTime: 2s025ms
      02:45:29 E                - ExecTreePrepareTime: 2.999ms
      02:45:29 E           BlockMgr:
      02:45:29 E              - BlockWritesOutstanding: 0 (0)
      02:45:29 E              - BlocksCreated: 0 (0)
      02:45:29 E              - BlocksRecycled: 0 (0)
      02:45:29 E              - BufferedPins: 0 (0)
      02:45:29 E              - MaxBlockSize: 8.00 MB (8388608)
      02:45:29 E              - MemoryLimit: 14.31 GB (15365329920)
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - ScratchBytesRead: 0
      02:45:29 E              - ScratchBytesWritten: 0
      02:45:29 E              - ScratchFileUsedBytes: 0
      02:45:29 E              - ScratchReads: 0 (0)
      02:45:29 E              - ScratchWrites: 0 (0)
      02:45:29 E              - TotalBufferWaitTime: 0.000ns
      02:45:29 E              - TotalEncryptionTime: 0.000ns
      02:45:29 E              - TotalReadBlockTime: 0.000ns
      02:45:29 E           DataStreamSender (dst_id=4):(Total: 1.999ms, non-child: 1.999ms, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 9.56 KB (9792)
      02:45:29 E              - NetworkThroughput(*): 0.00 /sec
      02:45:29 E              - OverallThroughput: 4.67 MB/sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 2.43K (2430)
      02:45:29 E              - SerializeBatchTime: 1.999ms
      02:45:29 E              - TransmitDataRPCTime: 0.000ns
      02:45:29 E              - UncompressedRowBatchSize: 9.56 KB (9792)
      02:45:29 E           CodeGen:(Total: 858.988ms, non-child: 858.988ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 817.989ms
      02:45:29 E           HDFS_SCAN_NODE (id=0):(Total: 13s002ms, non-child: 13s002ms, % non-child: 100.00%)
      02:45:29 E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 2:3/13.51 KB 0:5/22.36 KB 
      02:45:29 E             ExecOption: RC_FILE Codegen Disabled: Not implemented for this format.
      02:45:29 E   , Codegen enabled: 0 out of 16
      02:45:29 E             Runtime filters: Only following filters arrived: , waited 12s977ms
      02:45:29 E             Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 
      02:45:29 E             File Formats: RC_FILE/SNAPPY_BLOCKED:8 
      02:45:29 E             BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
      02:45:29 E              - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E              - AverageScannerThreadConcurrency: 0.81 
      02:45:29 E              - BytesRead: 43.88 KB (44928)
      02:45:29 E              - BytesReadDataNodeCache: 0
      02:45:29 E              - BytesReadLocal: 43.88 KB (44928)
      02:45:29 E              - BytesReadRemoteUnexpected: 0
      02:45:29 E              - BytesReadShortCircuit: 43.88 KB (44928)
      02:45:29 E              - BytesSkipped: 0
      02:45:29 E              - CachedFileHandlesHitCount: 16 (16)
      02:45:29 E              - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E              - DecompressionTime: 0.000ns
      02:45:29 E              - MaxCompressedTextFileLength: 0
      02:45:29 E              - NumDisksAccessed: 3 (3)
      02:45:29 E              - NumScannerThreadsStarted: 1 (1)
      02:45:29 E              - PeakMemoryUsage: 89.00 KB (91136)
      02:45:29 E              - PerReadThreadRawHdfsThroughput: 14.28 MB/sec
      02:45:29 E              - RemoteScanRanges: 0 (0)
      02:45:29 E              - RowBatchQueueGetWaitTime: 14.999ms
      02:45:29 E              - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E              - RowsRead: 2.43K (2430)
      02:45:29 E              - RowsReturned: 2.43K (2430)
      02:45:29 E              - RowsReturnedRate: 186.00 /sec
      02:45:29 E              - ScanRangesComplete: 8 (8)
      02:45:29 E              - ScannerThreadsInvoluntaryContextSwitches: 27 (27)
      02:45:29 E              - ScannerThreadsTotalWallClockTime: 10s385ms
      02:45:29 E                - MaterializeTupleTime(*): 0.000ns
      02:45:29 E                - ScannerThreadsSysTime: 0.000ns
      02:45:29 E                - ScannerThreadsUserTime: 34.994ms
      02:45:29 E              - ScannerThreadsVoluntaryContextSwitches: 519 (519)
      02:45:29 E              - TotalRawHdfsReadTime(*): 2.999ms
      02:45:29 E              - TotalReadThroughput: 0.00 /sec
      02:45:29 E             Filter 0 (1.00 MB):
      02:45:29 E                - Files processed: 0 (0)
      02:45:29 E                - Files rejected: 0 (0)
      02:45:29 E                - Files total: 8 (8)
      02:45:29 E                - RowGroups processed: 0 (0)
      02:45:29 E                - RowGroups rejected: 0 (0)
      02:45:29 E                - RowGroups total: 0 (0)
      02:45:29 E                - Rows processed: 0 (0)
      02:45:29 E                - Rows rejected: 0 (0)
      02:45:29 E                - Rows total: 0 (0)
      02:45:29 E                - Splits processed: 0 (0)
      02:45:29 E                - Splits rejected: 0 (0)
      02:45:29 E                - Splits total: 0 (0)
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000003 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22000):(Total: 14s399ms, non-child: 1s789ms, % non-child: 12.43%)
      02:45:29 E           Hdfs split stats (<volume id>:<# splits>/<split lengths>): 2:4/18.03 KB 0:4/18.08 KB 
      02:45:29 E           Filter 0 arrival: 14s374ms
      02:45:29 E           MemoryUsage(500.000ms): 0, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB, 37.59 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2
      02:45:29 E            - AverageThreadTokens: 1.69 
      02:45:29 E            - BloomFilterBytes: 1.00 MB (1048576)
      02:45:29 E            - PeakMemoryUsage: 1.04 MB (1087072)
      02:45:29 E            - PerHostPeakMemUsage: 2.32 MB (2437872)
      02:45:29 E            - RowsProduced: 0 (0)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 0.000ns
      02:45:29 E            - TotalStorageWaitTime: 0.000ns
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 0 (0)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 20s516ms
      02:45:29 E              - TotalThreadsSysTime: 7.998ms
      02:45:29 E              - TotalThreadsUserTime: 48.992ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 1.02K (1018)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 10s450ms
      02:45:29 E                - ExecTreeExecTime: 10s449ms
      02:45:29 E              - OpenTime: 1.999ms
      02:45:29 E                - ExecTreeOpenTime: 1.999ms
      02:45:29 E              - PrepareTime: 3s942ms
      02:45:29 E                - ExecTreePrepareTime: 11.999ms
      02:45:29 E           DataStreamSender (dst_id=4):(Total: 999.987us, non-child: 999.987us, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 0
      02:45:29 E              - NetworkThroughput(*): 0.00 /sec
      02:45:29 E              - OverallThroughput: 0.00 /sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 0 (0)
      02:45:29 E              - SerializeBatchTime: 0.000ns
      02:45:29 E              - TransmitDataRPCTime: 0.000ns
      02:45:29 E              - UncompressedRowBatchSize: 0
      02:45:29 E           CodeGen:(Total: 2s130ms, non-child: 2s130ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 2s085ms
      02:45:29 E           HDFS_SCAN_NODE (id=0):(Total: 10s477ms, non-child: 10s477ms, % non-child: 100.00%)
      02:45:29 E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 2:4/18.03 KB 0:4/18.08 KB 
      02:45:29 E             ExecOption: RC_FILE Codegen Disabled: Not implemented for this format.
      02:45:29 E   , Codegen enabled: 0 out of 0
      02:45:29 E             Runtime filters: All filters arrived. Waited 10s448ms
      02:45:29 E             Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 
      02:45:29 E             File Formats: RC_FILE/NONE:8 
      02:45:29 E             BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
      02:45:29 E              - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E              - AverageScannerThreadConcurrency: 0.95 
      02:45:29 E              - BytesRead: 0
      02:45:29 E              - BytesReadDataNodeCache: 0
      02:45:29 E              - BytesReadLocal: 0
      02:45:29 E              - BytesReadRemoteUnexpected: 0
      02:45:29 E              - BytesReadShortCircuit: 0
      02:45:29 E              - CachedFileHandlesHitCount: 0 (0)
      02:45:29 E              - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E              - MaxCompressedTextFileLength: 0
      02:45:29 E              - NumDisksAccessed: 0 (0)
      02:45:29 E              - NumScannerThreadsStarted: 1 (1)
      02:45:29 E              - PeakMemoryUsage: 4.00 KB (4096)
      02:45:29 E              - PerReadThreadRawHdfsThroughput: 0.00 /sec
      02:45:29 E              - RemoteScanRanges: 0 (0)
      02:45:29 E              - RowBatchQueueGetWaitTime: 0.000ns
      02:45:29 E              - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E              - RowsRead: 0 (0)
      02:45:29 E              - RowsReturned: 0 (0)
      02:45:29 E              - RowsReturnedRate: 0
      02:45:29 E              - ScanRangesComplete: 8 (8)
      02:45:29 E              - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
      02:45:29 E              - ScannerThreadsTotalWallClockTime: 10s063ms
      02:45:29 E                - MaterializeTupleTime(*): 0.000ns
      02:45:29 E                - ScannerThreadsSysTime: 0.000ns
      02:45:29 E                - ScannerThreadsUserTime: 35.994ms
      02:45:29 E              - ScannerThreadsVoluntaryContextSwitches: 500 (500)
      02:45:29 E              - TotalRawHdfsReadTime(*): 0.000ns
      02:45:29 E              - TotalReadThroughput: 0.00 /sec
      02:45:29 E             Filter 0 (1.00 MB):
      02:45:29 E                - Files processed: 8 (8)
      02:45:29 E                - Files rejected: 8 (8)
      02:45:29 E                - Files total: 8 (8)
      02:45:29 E                - RowGroups processed: 0 (0)
      02:45:29 E                - RowGroups rejected: 0 (0)
      02:45:29 E                - RowGroups total: 0 (0)
      02:45:29 E                - Rows processed: 0 (0)
      02:45:29 E                - Rows rejected: 0 (0)
      02:45:29 E                - Rows total: 0 (0)
      02:45:29 E                - Splits processed: 0 (0)
      02:45:29 E                - Splits rejected: 0 (0)
      02:45:29 E                - Splits total: 0 (0)
      02:45:29 E       Averaged Fragment F03:(Total: 3s532ms, non-child: 370.995ms, % non-child: 10.50%)
      02:45:29 E         split sizes:  min: 0, max: 0, avg: 0, stddev: 0
      02:45:29 E         completion times: min:4s335ms  max:4s335ms  mean: 4s335ms  stddev:0.000ns
      02:45:29 E         execution rates: min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  stddev:0.00 /sec
      02:45:29 E         num instances: 1
      02:45:29 E          - AverageThreadTokens: 1.00 
      02:45:29 E          - BloomFilterBytes: 0
      02:45:29 E          - PeakMemoryUsage: 41.62 KB (42624)
      02:45:29 E          - PerHostPeakMemUsage: 151.08 KB (154704)
      02:45:29 E          - RowsProduced: 2 (2)
      02:45:29 E          - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E          - TotalNetworkSendTime: 8.999ms
      02:45:29 E          - TotalStorageWaitTime: 0.000ns
      02:45:29 E          - TotalThreadsInvoluntaryContextSwitches: 0 (0)
      02:45:29 E          - TotalThreadsTotalWallClockTime: 62.999ms
      02:45:29 E            - TotalThreadsSysTime: 1.000ms
      02:45:29 E            - TotalThreadsUserTime: 1.000ms
      02:45:29 E          - TotalThreadsVoluntaryContextSwitches: 6 (6)
      02:45:29 E         Fragment Instance Lifecycle Timings:
      02:45:29 E            - ExecTime: 61.999ms
      02:45:29 E              - ExecTreeExecTime: 0.000ns
      02:45:29 E            - OpenTime: 999.987us
      02:45:29 E              - ExecTreeOpenTime: 0.000ns
      02:45:29 E            - PrepareTime: 3s468ms
      02:45:29 E              - ExecTreePrepareTime: 1.999ms
      02:45:29 E         DataStreamSender (dst_id=6):(Total: 52.999ms, non-child: 52.999ms, % non-child: 100.00%)
      02:45:29 E            - BytesSent: 22.00 B (22)
      02:45:29 E            - NetworkThroughput(*): 0.00 /sec
      02:45:29 E            - OverallThroughput: 415.00 B/sec
      02:45:29 E            - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E            - RowsReturned: 2 (2)
      02:45:29 E            - SerializeBatchTime: 51.999ms
      02:45:29 E            - TransmitDataRPCTime: 0.000ns
      02:45:29 E            - UncompressedRowBatchSize: 22.00 B (22)
      02:45:29 E         CodeGen:(Total: 3s108ms, non-child: 3s108ms, % non-child: 100.00%)
      02:45:29 E            - CodegenTime: 0.000ns
      02:45:29 E            - CompileTime: 0.000ns
      02:45:29 E            - LoadTime: 0.000ns
      02:45:29 E            - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E            - NumFunctions: 0 (0)
      02:45:29 E            - NumInstructions: 0 (0)
      02:45:29 E            - OptimizationTime: 0.000ns
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E            - PrepareTime: 3s066ms
      02:45:29 E         EXCHANGE_NODE (id=5):
      02:45:29 E            - BytesReceived: 44.00 B (44)
      02:45:29 E            - ConvertRowBatchTime: 0.000ns
      02:45:29 E            - DeserializeRowBatchTimer: 0.000ns
      02:45:29 E            - FirstBatchArrivalWaitTime: 0.000ns
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E            - RowsReturned: 2 (2)
      02:45:29 E            - RowsReturnedRate: 0
      02:45:29 E            - SendersBlockedTimer: 0.000ns
      02:45:29 E            - SendersBlockedTotalTimer(*): 0.000ns
      02:45:29 E       Fragment F03:
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000007 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22000):(Total: 3s532ms, non-child: 370.995ms, % non-child: 10.50%)
      02:45:29 E           MemoryUsage(500.000ms): 0, 25.59 KB, 25.59 KB, 33.62 KB, 33.62 KB, 33.62 KB, 33.62 KB, 41.62 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1
      02:45:29 E            - AverageThreadTokens: 1.00 
      02:45:29 E            - BloomFilterBytes: 0
      02:45:29 E            - PeakMemoryUsage: 41.62 KB (42624)
      02:45:29 E            - PerHostPeakMemUsage: 151.08 KB (154704)
      02:45:29 E            - RowsProduced: 2 (2)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 8.999ms
      02:45:29 E            - TotalStorageWaitTime: 0.000ns
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 0 (0)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 62.999ms
      02:45:29 E              - TotalThreadsSysTime: 1.000ms
      02:45:29 E              - TotalThreadsUserTime: 1.000ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 6 (6)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 61.999ms
      02:45:29 E                - ExecTreeExecTime: 0.000ns
      02:45:29 E              - OpenTime: 999.987us
      02:45:29 E                - ExecTreeOpenTime: 0.000ns
      02:45:29 E              - PrepareTime: 3s468ms
      02:45:29 E                - ExecTreePrepareTime: 1.999ms
      02:45:29 E           DataStreamSender (dst_id=6):(Total: 52.999ms, non-child: 52.999ms, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 22.00 B (22)
      02:45:29 E              - NetworkThroughput(*): 0.00 /sec
      02:45:29 E              - OverallThroughput: 415.00 B/sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - SerializeBatchTime: 51.999ms
      02:45:29 E              - TransmitDataRPCTime: 0.000ns
      02:45:29 E              - UncompressedRowBatchSize: 22.00 B (22)
      02:45:29 E           CodeGen:(Total: 3s108ms, non-child: 3s108ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 3s066ms
      02:45:29 E           EXCHANGE_NODE (id=5):
      02:45:29 E             BytesReceived(500.000ms): 0, 0, 0, 44.00 B, 44.00 B, 44.00 B, 44.00 B, 44.00 B
      02:45:29 E              - BytesReceived: 44.00 B (44)
      02:45:29 E              - ConvertRowBatchTime: 0.000ns
      02:45:29 E              - DeserializeRowBatchTimer: 0.000ns
      02:45:29 E              - FirstBatchArrivalWaitTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - RowsReturnedRate: 0
      02:45:29 E              - SendersBlockedTimer: 0.000ns
      02:45:29 E              - SendersBlockedTotalTimer(*): 0.000ns
      02:45:29 E       Averaged Fragment F02:(Total: 2s732ms, non-child: 1s304ms, % non-child: 47.74%)
      02:45:29 E         split sizes:  min: 352.00 B, max: 704.00 B, avg: 469.33 B, stddev: 165.93 B
      02:45:29 E         completion times: min:2s456ms  max:4s773ms  mean: 3s250ms  stddev:1s077ms
      02:45:29 E         execution rates: min:139.00 B/sec  max:147.00 B/sec  mean:143.00 B/sec  stddev:2.80 B/sec
      02:45:29 E         num instances: 3
      02:45:29 E          - AverageThreadTokens: 1.00 
      02:45:29 E          - BloomFilterBytes: 0
      02:45:29 E          - PeakMemoryUsage: 70.26 KB (71946)
      02:45:29 E          - PerHostPeakMemUsage: 123.28 KB (126234)
      02:45:29 E          - RowsProduced: 2 (2)
      02:45:29 E          - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E          - TotalNetworkSendTime: 1.999ms
      02:45:29 E          - TotalStorageWaitTime: 333.329us
      02:45:29 E          - TotalThreadsInvoluntaryContextSwitches: 2.71K (2712)
      02:45:29 E          - TotalThreadsTotalWallClockTime: 195.664ms
      02:45:29 E            - TotalThreadsSysTime: 11.331ms
      02:45:29 E            - TotalThreadsUserTime: 7.331ms
      02:45:29 E          - TotalThreadsVoluntaryContextSwitches: 9 (9)
      02:45:29 E         Fragment Instance Lifecycle Timings:
      02:45:29 E            - ExecTime: 156.331ms
      02:45:29 E              - ExecTreeExecTime: 130.998ms
      02:45:29 E            - OpenTime: 3.999ms
      02:45:29 E              - ExecTreeOpenTime: 3.666ms
      02:45:29 E            - PrepareTime: 2s571ms
      02:45:29 E              - ExecTreePrepareTime: 6.666ms
      02:45:29 E         DataStreamSender (dst_id=5):(Total: 17.666ms, non-child: 17.666ms, % non-child: 100.00%)
      02:45:29 E            - BytesSent: 22.00 B (22)
      02:45:29 E            - NetworkThroughput(*): 7.16 KB/sec
      02:45:29 E            - OverallThroughput: 4.26 KB/sec
      02:45:29 E            - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E            - RowsReturned: 2 (2)
      02:45:29 E            - SerializeBatchTime: 16.333ms
      02:45:29 E            - TransmitDataRPCTime: 333.329us
      02:45:29 E            - UncompressedRowBatchSize: 22.00 B (22)
      02:45:29 E         CodeGen:(Total: 1s261ms, non-child: 1s261ms, % non-child: 100.00%)
      02:45:29 E            - CodegenTime: 0.000ns
      02:45:29 E            - CompileTime: 0.000ns
      02:45:29 E            - LoadTime: 0.000ns
      02:45:29 E            - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E            - NumFunctions: 0 (0)
      02:45:29 E            - NumInstructions: 0 (0)
      02:45:29 E            - OptimizationTime: 0.000ns
      02:45:29 E            - PeakMemoryUsage: 0
      02:45:29 E            - PrepareTime: 1s242ms
      02:45:29 E         HDFS_SCAN_NODE (id=1):(Total: 148.664ms, non-child: 148.664ms, % non-child: 100.00%)
      02:45:29 E            - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E            - AverageScannerThreadConcurrency: 0.00 
      02:45:29 E            - BytesRead: 938.00 B (938)
      02:45:29 E            - BytesReadDataNodeCache: 0
      02:45:29 E            - BytesReadLocal: 938.00 B (938)
      02:45:29 E            - BytesReadRemoteUnexpected: 0
      02:45:29 E            - BytesReadShortCircuit: 938.00 B (938)
      02:45:29 E            - BytesSkipped: 0
      02:45:29 E            - CachedFileHandlesHitCount: 2 (2)
      02:45:29 E            - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E            - DecompressionTime: 0.000ns
      02:45:29 E            - MaxCompressedTextFileLength: 0
      02:45:29 E            - NumDisksAccessed: 2 (2)
      02:45:29 E            - NumScannerThreadsStarted: 1 (1)
      02:45:29 E            - PeakMemoryUsage: 36.67 KB (37546)
      02:45:29 E            - PerReadThreadRawHdfsThroughput: 229.17 KB/sec
      02:45:29 E            - RemoteScanRanges: 0 (0)
      02:45:29 E            - RowBatchQueueGetWaitTime: 999.987us
      02:45:29 E            - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E            - RowsRead: 2 (2)
      02:45:29 E            - RowsReturned: 2 (2)
      02:45:29 E            - RowsReturnedRate: 30.00 /sec
      02:45:29 E            - ScanRangesComplete: 1 (1)
      02:45:29 E            - ScannerThreadsInvoluntaryContextSwitches: 3 (3)
      02:45:29 E            - ScannerThreadsTotalWallClockTime: 35.666ms
      02:45:29 E              - MaterializeTupleTime(*): 0.000ns
      02:45:29 E              - ScannerThreadsSysTime: 333.000us
      02:45:29 E              - ScannerThreadsUserTime: 2.665ms
      02:45:29 E            - ScannerThreadsVoluntaryContextSwitches: 4 (4)
      02:45:29 E            - TotalRawHdfsReadTime(*): 333.329us
      02:45:29 E            - TotalReadThroughput: 0.00 /sec
      02:45:29 E       Fragment F02:
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000006 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22000):(Total: 3s675ms, non-child: 1s247ms, % non-child: 33.95%)
      02:45:29 E           Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/704.00 B 
      02:45:29 E           MemoryUsage(500.000ms): 0, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1, 1, 1, 1
      02:45:29 E            - AverageThreadTokens: 1.00 
      02:45:29 E            - BloomFilterBytes: 0
      02:45:29 E            - PeakMemoryUsage: 94.59 KB (96864)
      02:45:29 E            - PerHostPeakMemUsage: 182.45 KB (186832)
      02:45:29 E            - RowsProduced: 2 (2)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 1.999ms
      02:45:29 E            - TotalStorageWaitTime: 0.000ns
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 5.31K (5312)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 233.996ms
      02:45:29 E              - TotalThreadsSysTime: 15.997ms
      02:45:29 E              - TotalThreadsUserTime: 12.997ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 12 (12)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 214.997ms
      02:45:29 E                - ExecTreeExecTime: 176.997ms
      02:45:29 E              - OpenTime: 8.999ms
      02:45:29 E                - ExecTreeOpenTime: 8.999ms
      02:45:29 E              - PrepareTime: 3s450ms
      02:45:29 E                - ExecTreePrepareTime: 14.999ms
      02:45:29 E           DataStreamSender (dst_id=5):(Total: 35.999ms, non-child: 35.999ms, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 22.00 B (22)
      02:45:29 E              - NetworkThroughput(*): 0.00 /sec
      02:45:29 E              - OverallThroughput: 611.00 B/sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - SerializeBatchTime: 34.999ms
      02:45:29 E              - TransmitDataRPCTime: 0.000ns
      02:45:29 E              - UncompressedRowBatchSize: 22.00 B (22)
      02:45:29 E           CodeGen:(Total: 2s175ms, non-child: 2s175ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 2s125ms
      02:45:29 E           HDFS_SCAN_NODE (id=1):(Total: 215.997ms, non-child: 215.997ms, % non-child: 100.00%)
      02:45:29 E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 0:2/704.00 B 
      02:45:29 E             ExecOption: RC_FILE Codegen Disabled: Not implemented for this format.
      02:45:29 E   , Codegen enabled: 0 out of 4
      02:45:29 E             Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 
      02:45:29 E             File Formats: RC_FILE/SNAPPY_BLOCKED:2 
      02:45:29 E             BytesRead(500.000ms): 0, 0, 0, 0, 0, 0, 0
      02:45:29 E              - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E              - AverageScannerThreadConcurrency: 0.00 
      02:45:29 E              - BytesRead: 1.38 KB (1408)
      02:45:29 E              - BytesReadDataNodeCache: 0
      02:45:29 E              - BytesReadLocal: 1.38 KB (1408)
      02:45:29 E              - BytesReadRemoteUnexpected: 0
      02:45:29 E              - BytesReadShortCircuit: 1.38 KB (1408)
      02:45:29 E              - BytesSkipped: 0
      02:45:29 E              - CachedFileHandlesHitCount: 4 (4)
      02:45:29 E              - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E              - DecompressionTime: 0.000ns
      02:45:29 E              - MaxCompressedTextFileLength: 0
      02:45:29 E              - NumDisksAccessed: 2 (2)
      02:45:29 E              - NumScannerThreadsStarted: 1 (1)
      02:45:29 E              - PeakMemoryUsage: 61.00 KB (62464)
      02:45:29 E              - PerReadThreadRawHdfsThroughput: 0.00 /sec
      02:45:29 E              - RemoteScanRanges: 0 (0)
      02:45:29 E              - RowBatchQueueGetWaitTime: 0.000ns
      02:45:29 E              - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E              - RowsRead: 4 (4)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - RowsReturnedRate: 9.00 /sec
      02:45:29 E              - ScanRangesComplete: 2 (2)
      02:45:29 E              - ScannerThreadsInvoluntaryContextSwitches: 2 (2)
      02:45:29 E              - ScannerThreadsTotalWallClockTime: 9.999ms
      02:45:29 E                - MaterializeTupleTime(*): 0.000ns
      02:45:29 E                - ScannerThreadsSysTime: 999.000us
      02:45:29 E                - ScannerThreadsUserTime: 3.999ms
      02:45:29 E              - ScannerThreadsVoluntaryContextSwitches: 6 (6)
      02:45:29 E              - TotalRawHdfsReadTime(*): 0.000ns
      02:45:29 E              - TotalReadThroughput: 0.00 /sec
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000004 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22002):(Total: 2s359ms, non-child: 1s302ms, % non-child: 55.21%)
      02:45:29 E           Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/352.00 B 
      02:45:29 E           MemoryUsage(500.000ms): 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1
      02:45:29 E            - AverageThreadTokens: 1.00 
      02:45:29 E            - BloomFilterBytes: 0
      02:45:29 E            - PeakMemoryUsage: 51.59 KB (52832)
      02:45:29 E            - PerHostPeakMemUsage: 85.19 KB (87232)
      02:45:29 E            - RowsProduced: 2 (2)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 3.999ms
      02:45:29 E            - TotalStorageWaitTime: 999.987us
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 2.64K (2640)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 309.995ms
      02:45:29 E              - TotalThreadsSysTime: 14.998ms
      02:45:29 E              - TotalThreadsUserTime: 3.998ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 14 (14)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 215.997ms
      02:45:29 E                - ExecTreeExecTime: 194.997ms
      02:45:29 E              - OpenTime: 999.986us
      02:45:29 E                - ExecTreeOpenTime: 999.986us
      02:45:29 E              - PrepareTime: 2s141ms
      02:45:29 E                - ExecTreePrepareTime: 2.999ms
      02:45:29 E           DataStreamSender (dst_id=5):(Total: 14.999ms, non-child: 14.999ms, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 22.00 B (22)
      02:45:29 E              - NetworkThroughput(*): 0.00 /sec
      02:45:29 E              - OverallThroughput: 1.43 KB/sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - SerializeBatchTime: 13.999ms
      02:45:29 E              - TransmitDataRPCTime: 0.000ns
      02:45:29 E              - UncompressedRowBatchSize: 22.00 B (22)
      02:45:29 E           CodeGen:(Total: 838.988ms, non-child: 838.988ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 835.988ms
      02:45:29 E           HDFS_SCAN_NODE (id=1):(Total: 202.997ms, non-child: 202.997ms, % non-child: 100.00%)
      02:45:29 E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/352.00 B 
      02:45:29 E             ExecOption: RC_FILE Codegen Disabled: Not implemented for this format.
      02:45:29 E   , Codegen enabled: 0 out of 2
      02:45:29 E             Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 
      02:45:29 E             File Formats: RC_FILE/SNAPPY_BLOCKED:1 
      02:45:29 E             BytesRead(500.000ms): 0, 0, 0, 0
      02:45:29 E              - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E              - AverageScannerThreadConcurrency: 0.00 
      02:45:29 E              - BytesRead: 704.00 B (704)
      02:45:29 E              - BytesReadDataNodeCache: 0
      02:45:29 E              - BytesReadLocal: 704.00 B (704)
      02:45:29 E              - BytesReadRemoteUnexpected: 0
      02:45:29 E              - BytesReadShortCircuit: 704.00 B (704)
      02:45:29 E              - BytesSkipped: 0
      02:45:29 E              - CachedFileHandlesHitCount: 2 (2)
      02:45:29 E              - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E              - DecompressionTime: 0.000ns
      02:45:29 E              - MaxCompressedTextFileLength: 0
      02:45:29 E              - NumDisksAccessed: 2 (2)
      02:45:29 E              - NumScannerThreadsStarted: 1 (1)
      02:45:29 E              - PeakMemoryUsage: 18.00 KB (18432)
      02:45:29 E              - PerReadThreadRawHdfsThroughput: 687.51 KB/sec
      02:45:29 E              - RemoteScanRanges: 0 (0)
      02:45:29 E              - RowBatchQueueGetWaitTime: 0.000ns
      02:45:29 E              - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E              - RowsRead: 2 (2)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - RowsReturnedRate: 9.00 /sec
      02:45:29 E              - ScanRangesComplete: 1 (1)
      02:45:29 E              - ScannerThreadsInvoluntaryContextSwitches: 0 (0)
      02:45:29 E              - ScannerThreadsTotalWallClockTime: 93.998ms
      02:45:29 E                - MaterializeTupleTime(*): 0.000ns
      02:45:29 E                - ScannerThreadsSysTime: 0.000ns
      02:45:29 E                - ScannerThreadsUserTime: 1.999ms
      02:45:29 E              - ScannerThreadsVoluntaryContextSwitches: 7 (7)
      02:45:29 E              - TotalRawHdfsReadTime(*): 999.987us
      02:45:29 E              - TotalReadThroughput: 0.00 /sec
      02:45:29 E         Instance 364393521d6edaa6:82f92a0300000005 (host=impala-boost-static-burst-slave-1fc7.vpc.cloudera.com:22001):(Total: 2s161ms, non-child: 1s362ms, % non-child: 63.04%)
      02:45:29 E           Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/352.00 B 
      02:45:29 E           MemoryUsage(500.000ms): 25.59 KB, 25.59 KB, 25.59 KB, 25.59 KB, 33.59 KB
      02:45:29 E           ThreadUsage(500.000ms): 1, 1, 1, 1, 1
      02:45:29 E            - AverageThreadTokens: 1.00 
      02:45:29 E            - BloomFilterBytes: 0
      02:45:29 E            - PeakMemoryUsage: 64.59 KB (66144)
      02:45:29 E            - PerHostPeakMemUsage: 102.19 KB (104640)
      02:45:29 E            - RowsProduced: 2 (2)
      02:45:29 E            - TotalNetworkReceiveTime: 0.000ns
      02:45:29 E            - TotalNetworkSendTime: 0.000ns
      02:45:29 E            - TotalStorageWaitTime: 0.000ns
      02:45:29 E            - TotalThreadsInvoluntaryContextSwitches: 186 (186)
      02:45:29 E            - TotalThreadsTotalWallClockTime: 42.999ms
      02:45:29 E              - TotalThreadsSysTime: 3.000ms
      02:45:29 E              - TotalThreadsUserTime: 4.998ms
      02:45:29 E            - TotalThreadsVoluntaryContextSwitches: 3 (3)
      02:45:29 E           Fragment Instance Lifecycle Timings:
      02:45:29 E              - ExecTime: 37.999ms
      02:45:29 E                - ExecTreeExecTime: 20.999ms
      02:45:29 E              - OpenTime: 1.999ms
      02:45:29 E                - ExecTreeOpenTime: 999.987us
      02:45:29 E              - PrepareTime: 2s120ms
      02:45:29 E                - ExecTreePrepareTime: 1.999ms
      02:45:29 E           DataStreamSender (dst_id=5):(Total: 1.999ms, non-child: 1.999ms, % non-child: 100.00%)
      02:45:29 E              - BytesSent: 22.00 B (22)
      02:45:29 E              - NetworkThroughput(*): 21.48 KB/sec
      02:45:29 E              - OverallThroughput: 10.74 KB/sec
      02:45:29 E              - PeakMemoryUsage: 25.59 KB (26208)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - SerializeBatchTime: 0.000ns
      02:45:29 E              - TransmitDataRPCTime: 999.987us
      02:45:29 E              - UncompressedRowBatchSize: 22.00 B (22)
      02:45:29 E           CodeGen:(Total: 769.989ms, non-child: 769.989ms, % non-child: 100.00%)
      02:45:29 E              - CodegenTime: 0.000ns
      02:45:29 E              - CompileTime: 0.000ns
      02:45:29 E              - LoadTime: 0.000ns
      02:45:29 E              - ModuleBitcodeSize: 1.98 MB (2077396)
      02:45:29 E              - NumFunctions: 0 (0)
      02:45:29 E              - NumInstructions: 0 (0)
      02:45:29 E              - OptimizationTime: 0.000ns
      02:45:29 E              - PeakMemoryUsage: 0
      02:45:29 E              - PrepareTime: 764.989ms
      02:45:29 E           HDFS_SCAN_NODE (id=1):(Total: 26.999ms, non-child: 26.999ms, % non-child: 100.00%)
      02:45:29 E             Hdfs split stats (<volume id>:<# splits>/<split lengths>): 1:1/352.00 B 
      02:45:29 E             ExecOption: RC_FILE Codegen Disabled: Not implemented for this format.
      02:45:29 E   , Codegen enabled: 0 out of 2
      02:45:29 E             Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 
      02:45:29 E             File Formats: RC_FILE/SNAPPY_BLOCKED:1 
      02:45:29 E             BytesRead(500.000ms): 0, 0, 0, 0, 0
      02:45:29 E              - AverageHdfsReadThreadConcurrency: 0.00 
      02:45:29 E              - AverageScannerThreadConcurrency: 0.00 
      02:45:29 E              - BytesRead: 704.00 B (704)
      02:45:29 E              - BytesReadDataNodeCache: 0
      02:45:29 E              - BytesReadLocal: 704.00 B (704)
      02:45:29 E              - BytesReadRemoteUnexpected: 0
      02:45:29 E              - BytesReadShortCircuit: 704.00 B (704)
      02:45:29 E              - BytesSkipped: 0
      02:45:29 E              - CachedFileHandlesHitCount: 2 (2)
      02:45:29 E              - CachedFileHandlesMissCount: 0 (0)
      02:45:29 E              - DecompressionTime: 0.000ns
      02:45:29 E              - MaxCompressedTextFileLength: 0
      02:45:29 E              - NumDisksAccessed: 2 (2)
      02:45:29 E              - NumScannerThreadsStarted: 1 (1)
      02:45:29 E              - PeakMemoryUsage: 31.00 KB (31744)
      02:45:29 E              - PerReadThreadRawHdfsThroughput: 0.00 /sec
      02:45:29 E              - RemoteScanRanges: 0 (0)
      02:45:29 E              - RowBatchQueueGetWaitTime: 2.999ms
      02:45:29 E              - RowBatchQueuePutWaitTime: 0.000ns
      02:45:29 E              - RowsRead: 2 (2)
      02:45:29 E              - RowsReturned: 2 (2)
      02:45:29 E              - RowsReturnedRate: 74.00 /sec
      02:45:29 E              - ScanRangesComplete: 1 (1)
      02:45:29 E              - ScannerThreadsInvoluntaryContextSwitches: 9 (9)
      02:45:29 E              - ScannerThreadsTotalWallClockTime: 2.999ms
      02:45:29 E                - MaterializeTupleTime(*): 0.000ns
      02:45:29 E                - ScannerThreadsSysTime: 0.000ns
      02:45:29 E                - ScannerThreadsUserTime: 1.999ms
      02:45:29 E              - ScannerThreadsVoluntaryContextSwitches: 1 (1)
      02:45:29 E              - TotalRawHdfsReadTime(*): 0.000ns
      02:45:29 E              - TotalReadThroughput: 0.00 /sec
      

        Attachments

          Activity

            People

            • Assignee:
              henryr Henry Robinson
              Reporter:
              twmarshall Thomas Tauber-Marshall
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: