[IMPALA-6811] test_exchange_delays failed - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: Impala 2.13.0
Fix Version/s: Impala 2.12.0
Component/s: Backend
Labels:
- broken-build

Epic Color:
ghx-label-9

Description

Error Message
AssertionError: Expected exception: timed out waiting for receiver fragment instance
Stacktrace
custom_cluster/test_exchange_delays.py:63: in test_exchange_large_delay
    self.run_test_case('QueryTest/exchange-delays-zero-rows', vector)
common/impala_test_suite.py:413: in run_test_case
    assert False, "Expected exception: %s" % expected_str
E   AssertionError: Expected exception: timed out waiting for receiver fragment instance

profile:

TRuntimeProfileTree(nodes=[TRuntimeProfileNode(info_strings_display_order=['DEBUG MODE WARNING'], indent=True, name='Query (id=a6461a30c2fb8bec:d4c89d2200000000)', time_series_counters=None, info_strings={'DEBUG MODE WARNING': 'Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance.'}, summary_stats_counters=None, num_children=3, child_counters_map={}, event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Session ID', 'Session Type', 'Start Time', 'End Time', 'Query Type', 'Query State', 'Query Status', 'Impala Version', 'User', 'Connected User', 'Delegated User', 'Network Address', 'Default Db', 'Sql Statement', 'Coordinator', 'Query Options (set by configuration)', 'Query Options (set by configuration and planner)', 'Plan', 'Estimated Per-Host Mem', 'Per Host Min Reservation', 'Request Pool', 'Admission result', 'ExecSummary', 'Errors'], indent=True, name='Summary', time_series_counters=None, info_strings={'Errors': '', 'Sql Statement': 'select l_orderkey, count(*)\nfrom tpch.lineitem\nwhere l_linenumber = -1\ngroup by l_orderkey', 'Network Address': '127.0.0.1:43193', 'Impala Version': 'impalad version 2.12.0-SNAPSHOT DEBUG (build 5166270bfcfca424be023b5495e9dcf0d344fca2)', 'Query Options (set by configuration and planner)': 'ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0', 'ExecSummary': '\nOperator       #Hosts  Avg Time  Max Time  #Rows  Est. #Rows  Peak Mem  Est. Peak Mem  Detail           \n--------------------------------------------------------------------------------------------------------\n04:EXCHANGE         1   0.000ns   0.000ns      0     857.32K         0              0  UNPARTITIONED    \n03:AGGREGATE        3  10s003ms  10s004ms      0     857.32K   8.52 MB       10.00 MB  FINALIZE         \n02:EXCHANGE         3   0.000ns   0.000ns      0     857.32K         0              0  HASH(l_orderkey) \n01:AGGREGATE        3   3.333ms   3.999ms      0     857.32K  17.06 MB       17.00 MB  STREAMING        \n00:SCAN HDFS        3  10s775ms  10s908ms      0     857.32K  88.22 MB      320.00 MB  tpch.lineitem    ', 'Admission result': 'Admitted immediately', 'Request Pool': 'default-pool', 'Start Time': '2018-04-04 00:32:34.242692000', 'End Time': '2018-04-04 00:32:45.504165000', 'Plan': '\n----------------\nMax Per-Host Resource Reservation: Memory=25.50MB\nPer-Host Resource Estimates: Memory=347.00MB\n\nF02:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1\n|  Per-Host Resources: mem-estimate=0B mem-reservation=0B\nPLAN-ROOT SINK\n|  mem-estimate=0B mem-reservation=0B\n|\n04:EXCHANGE [UNPARTITIONED]\n|  mem-estimate=0B mem-reservation=0B\n|  tuple-ids=1 row-size=16B cardinality=857316\n|\nF01:PLAN FRAGMENT [HASH(l_orderkey)] hosts=3 instances=3\nPer-Host Resources: mem-estimate=10.00MB mem-reservation=8.50MB\n03:AGGREGATE [FINALIZE]\n|  output: count:merge(*)\n|  group by: l_orderkey\n|  mem-estimate=10.00MB mem-reservation=8.50MB spill-buffer=512.00KB\n|  tuple-ids=1 row-size=16B cardinality=857316\n|\n02:EXCHANGE [HASH(l_orderkey)]\n|  mem-estimate=0B mem-reservation=0B\n|  tuple-ids=1 row-size=16B cardinality=857316\n|\nF00:PLAN FRAGMENT [RANDOM] hosts=3 instances=3\nPer-Host Resources: mem-estimate=337.00MB mem-reservation=17.00MB\n01:AGGREGATE [STREAMING]\n|  output: count(*)\n|  group by: l_orderkey\n|  mem-estimate=17.00MB mem-reservation=17.00MB spill-buffer=1.00MB\n|  tuple-ids=1 row-size=16B cardinality=857316\n|\n00:SCAN HDFS [tpch.lineitem, RANDOM]\n   partitions=1/1 files=1 size=718.94MB\n   predicates: l_linenumber = -1\n   stored statistics:\n     table: rows=6001215 size=718.94MB\n     columns: all\n   extrapolated-rows=disabled\n   parquet dictionary predicates: l_linenumber = -1\n   mem-estimate=320.00MB mem-reservation=0B\n   tuple-ids=0 row-size=12B cardinality=857316\n----------------', 'Query Type': 'QUERY', 'Connected User': 'jenkins', 'Session ID': '75414a6fbddec773:358c37eef8592588', 'User': 'jenkins', 'Default Db': 'functional', 'Per Host Min Reservation': 'ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000(25.50 MB) ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001(25.50 MB) ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002(25.50 MB) ', 'Delegated User': '', 'Query State': 'FINISHED', 'Session Type': 'BEESWAX', 'Query Status': 'OK', 'Query Options (set by configuration)': 'ABORT_ON_ERROR=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0', 'Coordinator': 'ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000', 'Estimated Per-Host Mem': '363855872'}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ComputeScanRangeAssignmentTimer'])}, event_sequences=[TEventSequence(timestamps=[4630648, 7623814, 7882296, 36431063, 37117604, 37192620, 41519526], labels=['Metadata of all 1 tables cached', 'Analysis finished', 'Value transfer graph computed', 'Single node plan created', 'Runtime filters computed', 'Distributed plan created', 'Planning finished'], name='Query Compilation'), TEventSequence(timestamps=[0, 42999903, 43999900, 44999898, 44999898, 46999894, 11236974533, 11246974511, 11246974511, 11246974511, 11260974479], labels=['Query submitted', 'Planning finished', 'Submit for admission', 'Completed admission', 'Ready to start on 3 backends', 'All 3 execution backends (7 fragment instances) started', 'Rows available', 'First row fetched', 'Last row fetched', 'Released admission control resources', 'Unregister query'], name='Query Timeline')], counters=[TCounter(value=0, name='ComputeScanRangeAssignmentTimer', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='ImpalaServer', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ClientFetchWaitTimer', 'RowMaterializationTimer'])}, event_sequences=None, counters=[TCounter(value=20999954, name='ClientFetchWaitTimer', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=2999992, name='RowMaterializationTimer', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Number of filters', 'Filter routing table', 'Backend startup latencies', 'Per Node Peak Memory Usage'], indent=True, name='Execution Profile a6461a30c2fb8bec:d4c89d2200000000', time_series_counters=None, info_strings={'Backend startup latencies': 'Count: 3, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms', 'Filter routing table': '\n ID  Src. Node  Tgt. Node(s)  Target type  Partition filter  Pending (Expected)  First arrived  Completed   Enabled\n-------------------------------------------------------------------------------------------------------------------\n', 'Per Node Peak Memory Usage': 'ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000(97.79 MB) ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001(113.79 MB) ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002(97.74 MB) ', 'Number of filters': '0'}, summary_stats_counters=None, num_children=6, child_counters_map={'': set(['NumBackends', 'FinalizationTimer', 'FiltersReceived', 'NumFragmentInstances', 'NumFragments'])}, event_sequences=None, counters=[TCounter(value=0, name='FiltersReceived', unit=0), TCounter(value=0, name='FinalizationTimer', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=3, name='NumBackends', unit=0), TCounter(value=7, name='NumFragmentInstances', unit=0), TCounter(value=3, name='NumFragments', unit=0), TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['split sizes', 'completion times', 'execution rates', 'num instances'], indent=True, name='Averaged Fragment F02', time_series_counters=None, info_strings={'completion times': 'min:11s191ms  max:11s191ms  mean: 11s191ms  stddev:0.000ns', 'split sizes': ' min: 0, max: 0, avg: 0, stddev: 0', 'execution rates': 'min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  stddev:0.00 /sec', 'num instances': '1'}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8192, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=102539267, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=1133997430, name='TotalNetworkReceiveTime', unit=5), TCounter(value=0, name='TotalNetworkSendTime', unit=5), TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=17, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=3999000, name='TotalThreadsSysTime', unit=5), TCounter(value=1179997326, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=20997000, name='TotalThreadsUserTime', unit=5), TCounter(value=5, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=0, name='ExecTime', unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5), TCounter(value=1133997430, name='ExecTreeOpenTime', unit=5), TCounter(value=9999977335, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=1179997326, name='OpenTime', unit=5), TCounter(value=10008977315, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='PLAN_ROOT_SINK', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='EXCHANGE_NODE (id=4)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={'': set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime', 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='ConvertRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=1133997430, name='TotalTime', unit=5)], metadata=4), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Dequeue', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']), 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None, counters=[TCounter(value=1133997430, name='DataWaitTime', unit=5), TCounter(value=1133997430, name='FirstBatchWaitTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBytesDequeued', unit=3), TCounter(value=1133997430, name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Enqueue', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBatchesEnqueued', unit=0), TCounter(value=0, name='TotalBatchesReceived', unit=0), TCounter(value=0, name='TotalBytesReceived', unit=3), TCounter(value=0, name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived', unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5), TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=0, name='CodegenTime', unit=5), TCounter(value=0, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=0, name='NumFunctions', unit=0), TCounter(value=0, name='NumInstructions', unit=0), TCounter(value=0, name='OptimizationTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=45999896, name='PrepareTime', unit=5), TCounter(value=45999896, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Coordinator Fragment F02', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=1, child_counters_map={}, event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000000 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8192, 8192], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[10009977313, 11189974639, 11189974639, 11189974639, 11189974639], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8192, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=102539267, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=1133997430, name='TotalNetworkReceiveTime', unit=5), TCounter(value=0, name='TotalNetworkSendTime', unit=5), TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=17, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=3999000, name='TotalThreadsSysTime', unit=5), TCounter(value=1179997326, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=20997000, name='TotalThreadsUserTime', unit=5), TCounter(value=5, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=0, name='ExecTime', unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5), TCounter(value=1133997430, name='ExecTreeOpenTime', unit=5), TCounter(value=9999977335, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=1179997326, name='OpenTime', unit=5), TCounter(value=10008977315, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='PLAN_ROOT_SINK', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='EXCHANGE_NODE (id=4)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={'': set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime', 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='ConvertRowBatchTime', unit=5), TCounter(value=1133997430, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=1133997430, name='TotalTime', unit=5)], metadata=4), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesDequeued', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']), 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None, counters=[TCounter(value=1133997430, name='DataWaitTime', unit=5), TCounter(value=1133997430, name='FirstBatchWaitTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBytesDequeued', unit=3), TCounter(value=1133997430, name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Enqueue', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesReceived', unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0], name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=[TSummaryStatsCounter(total_num_values=0, name='DispatchTime', max_value=-9223372036854775808L, sum=0, min_value=9223372036854775807L, unit=5)], num_children=0, child_counters_map={'': set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBatchesEnqueued', unit=0), TCounter(value=0, name='TotalBatchesReceived', unit=0), TCounter(value=0, name='TotalBytesReceived', unit=3), TCounter(value=0, name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived', unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5), TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=0, name='CodegenTime', unit=5), TCounter(value=0, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=0, name='NumFunctions', unit=0), TCounter(value=0, name='NumInstructions', unit=0), TCounter(value=0, name='OptimizationTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=45999896, name='PrepareTime', unit=5), TCounter(value=45999896, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['split sizes', 'completion times', 'execution rates', 'num instances'], indent=True, name='Averaged Fragment F01', time_series_counters=None, info_strings={'completion times': 'min:11s188ms  max:11s190ms  mean: 11s190ms  stddev:942.807us', 'split sizes': ' min: 0, max: 0, avg: 0, stddev: 0', 'execution rates': 'min:0.00 /sec  max:0.00 /sec  mean:0.00 /sec  stddev:0.00 /sec', 'num instances': '3'}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872, name='PeakMemoryUsage', unit=3), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=108113581, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=960331157, name='TotalNetworkReceiveTime', unit=5), TCounter(value=999998, name='TotalNetworkSendTime', unit=5), TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=110, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=10665000, name='TotalThreadsSysTime', unit=5), TCounter(value=1178330662, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=115649333, name='TotalThreadsUserTime', unit=5), TCounter(value=3, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11187641310, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=999998, name='ExecTime', unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5), TCounter(value=963664482, name='ExecTreeOpenTime', unit=5), TCounter(value=10000644000, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=1177330664, name='OpenTime', unit=5), TCounter(value=10009310647, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=4)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=7704, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='AGGREGATION_NODE (id=3)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned', 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions', 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0, name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='SpilledPartitions', unit=0), TCounter(value=10964308482, name='TotalTime', unit=5)], metadata=3), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=524288, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=False, name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={'': set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime', 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='ConvertRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=960331157, name='TotalTime', unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Dequeue', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']), 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None, counters=[TCounter(value=960331157, name='DataWaitTime', unit=5), TCounter(value=960331157, name='FirstBatchWaitTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBytesDequeued', unit=3), TCounter(value=960331157, name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Enqueue', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBatchesEnqueued', unit=0), TCounter(value=0, name='TotalBatchesReceived', unit=0), TCounter(value=0, name='TotalBytesReceived', unit=3), TCounter(value=0, name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived', unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5), TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=8333314, name='CodegenTime', unit=5), TCounter(value=8333314, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions', unit=0), TCounter(value=573, name='NumInstructions', unit=0), TCounter(value=142666343, name='OptimizationTime', unit=5), TCounter(value=293376, name='PeakMemoryUsage', unit=3), TCounter(value=56666538, name='PrepareTime', unit=5), TCounter(value=207999529, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment F01', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={}, event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000006 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 33432, 36784, 36784], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[10010977311, 11188974641, 11188974641, 11188974641, 11189974639], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872, name='PeakMemoryUsage', unit=3), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=119315459, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=902997954, name='TotalNetworkReceiveTime', unit=5), TCounter(value=999998, name='TotalNetworkSendTime', unit=5), TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=50, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=8998000, name='TotalThreadsSysTime', unit=5), TCounter(value=1178997328, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=128981000, name='TotalThreadsUserTime', unit=5), TCounter(value=3, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11188974641, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=999998, name='ExecTime', unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5), TCounter(value=906997944, name='ExecTreeOpenTime', unit=5), TCounter(value=10000977333, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=1177997330, name='OpenTime', unit=5), TCounter(value=10009977313, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=4)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0], name='BytesSent', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0), TCounter(value=999998, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=7704, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True, name='AGGREGATION_NODE (id=3)', time_series_counters=None, info_strings={'ExecOption': 'Codegen Enabled'}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned', 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions', 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0, name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='SpilledPartitions', unit=0), TCounter(value=10907975277, name='TotalTime', unit=5)], metadata=3), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=524288, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=False, name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={'': set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime', 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='ConvertRowBatchTime', unit=5), TCounter(value=902997954, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=902997954, name='TotalTime', unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0], name='BytesDequeued', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']), 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None, counters=[TCounter(value=902997954, name='DataWaitTime', unit=5), TCounter(value=902997954, name='FirstBatchWaitTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBytesDequeued', unit=3), TCounter(value=902997954, name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Enqueue', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0], name='BytesReceived', unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0, 0], name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=[TSummaryStatsCounter(total_num_values=0, name='DispatchTime', max_value=-9223372036854775808L, sum=0, min_value=9223372036854775807L, unit=5)], num_children=0, child_counters_map={'': set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBatchesEnqueued', unit=0), TCounter(value=0, name='TotalBatchesReceived', unit=0), TCounter(value=0, name='TotalBytesReceived', unit=3), TCounter(value=0, name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived', unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5), TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=6999984, name='CodegenTime', unit=5), TCounter(value=8999980, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions', unit=0), TCounter(value=573, name='NumInstructions', unit=0), TCounter(value=190999567, name='OptimizationTime', unit=5), TCounter(value=293376, name='PeakMemoryUsage', unit=3), TCounter(value=65999850, name='PrepareTime', unit=5), TCounter(value=265999397, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000005 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 36784, 36784], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[10012977307, 11187974643, 11187974643, 11187974643, 11188974641], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872, name='PeakMemoryUsage', unit=3), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=102539267, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=968997804, name='TotalNetworkReceiveTime', unit=5), TCounter(value=999998, name='TotalNetworkSendTime', unit=5), TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=182, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=11998000, name='TotalThreadsSysTime', unit=5), TCounter(value=1175997334, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=108984000, name='TotalThreadsUserTime', unit=5), TCounter(value=6, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11186974645, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=999998, name='ExecTime', unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5), TCounter(value=971997796, name='ExecTreeOpenTime', unit=5), TCounter(value=9999977335, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=1174997336, name='OpenTime', unit=5), TCounter(value=10010977311, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=4)', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesSent', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0), TCounter(value=999998, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=7704, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True, name='AGGREGATION_NODE (id=3)', time_series_counters=None, info_strings={'ExecOption': 'Codegen Enabled'}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned', 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions', 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0, name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='SpilledPartitions', unit=0), TCounter(value=10971975131, name='TotalTime', unit=5)], metadata=3), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=524288, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=False, name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={'': set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime', 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='ConvertRowBatchTime', unit=5), TCounter(value=968997804, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=968997804, name='TotalTime', unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesDequeued', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']), 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None, counters=[TCounter(value=968997804, name='DataWaitTime', unit=5), TCounter(value=968997804, name='FirstBatchWaitTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBytesDequeued', unit=3), TCounter(value=968997804, name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Enqueue', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesReceived', unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0], name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=[TSummaryStatsCounter(total_num_values=0, name='DispatchTime', max_value=-9223372036854775808L, sum=0, min_value=9223372036854775807L, unit=5)], num_children=0, child_counters_map={'': set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBatchesEnqueued', unit=0), TCounter(value=0, name='TotalBatchesReceived', unit=0), TCounter(value=0, name='TotalBytesReceived', unit=3), TCounter(value=0, name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived', unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5), TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=9999978, name='CodegenTime', unit=5), TCounter(value=7999982, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions', unit=0), TCounter(value=573, name='NumInstructions', unit=0), TCounter(value=127999710, name='OptimizationTime', unit=5), TCounter(value=293376, name='PeakMemoryUsage', unit=3), TCounter(value=59999864, name='PrepareTime', unit=5), TCounter(value=196999554, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000004 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 36784, 36784], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1], name='ThreadUsage', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[10006977319, 11185974647, 11185974647, 11185974647, 11186974645], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4607182418800017408, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8957872, name='PeakMemoryUsage', unit=3), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=102486019, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=1008997714, name='TotalNetworkReceiveTime', unit=5), TCounter(value=999998, name='TotalNetworkSendTime', unit=5), TCounter(value=0, name='TotalStorageWaitTime', unit=5), TCounter(value=98, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=10999000, name='TotalThreadsSysTime', unit=5), TCounter(value=1179997326, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=108983000, name='TotalThreadsUserTime', unit=5), TCounter(value=2, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11186974645, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=999998, name='ExecTime', unit=5), TCounter(value=0, name='ExecTreeExecTime', unit=5), TCounter(value=1011997706, name='ExecTreeOpenTime', unit=5), TCounter(value=10000977333, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=1178997328, name='OpenTime', unit=5), TCounter(value=10006977319, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=4)', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesSent', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=1, name='EosSent', unit=0), TCounter(value=999998, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=7704, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=999998, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True, name='AGGREGATION_NODE (id=3)', time_series_counters=None, info_strings={'ExecOption': 'Codegen Enabled'}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'HashBuckets', 'BuildTime', 'RowsRepartitioned', 'PeakMemoryUsage', 'MaxPartitionLevel', 'SpilledPartitions', 'PartitionsCreated', 'RowsReturnedRate', 'RowsReturned', 'NumRepartitions', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='BuildTime', unit=5), TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=0, name='MaxPartitionLevel', unit=0), TCounter(value=0, name='NumRepartitions', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=8938624, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsRepartitioned', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='SpilledPartitions', unit=0), TCounter(value=11012975039, name='TotalTime', unit=5)], metadata=3), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=524288, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=8912896, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=524288, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=False, name='EXCHANGE_NODE (id=2)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={'': set(['RowsReturned', 'RowsReturnedRate', 'ConvertRowBatchTime', 'PeakMemoryUsage'])}, event_sequences=None, counters=[TCounter(value=0, name='ConvertRowBatchTime', unit=5), TCounter(value=1008997714, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=1008997714, name='TotalTime', unit=5)], metadata=2), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Dequeue', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesDequeued', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['FirstBatchWaitTime', 'TotalGetBatchTime', 'TotalBytesDequeued']), 'TotalGetBatchTime': set(['DataWaitTime'])}, event_sequences=None, counters=[TCounter(value=1008997714, name='DataWaitTime', unit=5), TCounter(value=1008997714, name='FirstBatchWaitTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBytesDequeued', unit=3), TCounter(value=1008997714, name='TotalGetBatchTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Enqueue', time_series_counters=[TTimeSeriesCounter(values=[0, 0], name='BytesReceived', unit=3, period_ms=500), TTimeSeriesCounter(values=[0, 0], name='DeferredQueueSize', unit=0, period_ms=500)], info_strings={}, summary_stats_counters=[TSummaryStatsCounter(total_num_values=0, name='DispatchTime', max_value=-9223372036854775808L, sum=0, min_value=9223372036854775807L, unit=5)], num_children=0, child_counters_map={'': set(['TotalBatchesEnqueued', 'TotalHasDeferredRPCsTime', 'TotalEosReceived', 'DeserializeRowBatchTime', 'TotalRPCsDeferred', 'TotalBytesReceived', 'TotalEarlySenders', 'TotalBatchesReceived'])}, event_sequences=None, counters=[TCounter(value=0, name='DeserializeRowBatchTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalBatchesEnqueued', unit=0), TCounter(value=0, name='TotalBatchesReceived', unit=0), TCounter(value=0, name='TotalBytesReceived', unit=3), TCounter(value=0, name='TotalEarlySenders', unit=0), TCounter(value=3, name='TotalEosReceived', unit=0), TCounter(value=0, name='TotalHasDeferredRPCsTime', unit=5), TCounter(value=0, name='TotalRPCsDeferred', unit=0), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=7999982, name='CodegenTime', unit=5), TCounter(value=7999982, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=32, name='NumFunctions', unit=0), TCounter(value=573, name='NumInstructions', unit=0), TCounter(value=108999752, name='OptimizationTime', unit=5), TCounter(value=293376, name='PeakMemoryUsage', unit=3), TCounter(value=43999902, name='PrepareTime', unit=5), TCounter(value=160999636, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['split sizes', 'completion times', 'execution rates', 'num instances'], indent=True, name='Averaged Fragment F00', time_series_counters=None, info_strings={'completion times': 'min:10s818ms  max:11s187ms  mean: 11s059ms  stddev:170.082ms', 'split sizes': ' min: 224.00 MB, max: 256.00 MB, avg: 239.65 MB, stddev: 13.07 MB', 'execution rates': 'min:20.05 MB/sec  max:22.88 MB/sec  mean:21.67 MB/sec  stddev:1.19 MB/sec', 'num instances': '3'}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4620083081510138611L, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=99200685, name='PeakMemoryUsage', unit=3), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=108113581, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5), TCounter(value=2666660, name='TotalNetworkSendTime', unit=5), TCounter(value=68093845668, name='TotalStorageWaitTime', unit=5), TCounter(value=2193, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=38990000, name='TotalThreadsSysTime', unit=5), TCounter(value=82459479779, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=2979543333, name='TotalThreadsUserTime', unit=5), TCounter(value=131, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11056308275, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=10778975570, name='ExecTime', unit=5), TCounter(value=10776308910, name='ExecTreeExecTime', unit=5), TCounter(value=2333327, name='ExecTreeOpenTime', unit=5), TCounter(value=333332, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=275332709, name='OpenTime', unit=5), TCounter(value=1999995, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=2)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=23112, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=2666660, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='AGGREGATION_NODE (id=1)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime', 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough', 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate', 'ReductionFactorThresholdToExpand', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='ReductionFactorEstimate', unit=6), TCounter(value=0, name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0, name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10778975570, name='TotalTime', unit=5)], metadata=1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=1048576, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=False, name='HDFS_SCAN_NODE (id=0)', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected', 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput', 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount', 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches', 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate', 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency', 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency', 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal', 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges', 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime', 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']), 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime', 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime', 'ScannerThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4618958876916537987L, name='AverageHdfsReadThreadConcurrency', unit=6), TCounter(value=4619187143780767984L, name='AverageScannerThreadConcurrency', unit=6), TCounter(value=251767954, name='BytesRead', unit=3), TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0, name='BytesReadLocal', unit=3), TCounter(value=0, name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0, name='BytesReadShortCircuit', unit=3), TCounter(value=0, name='CachedFileHandlesHitCount', unit=0), TCounter(value=15, name='CachedFileHandlesMissCount', unit=0), TCounter(value=0, name='CollectionItemsRead', unit=0), TCounter(value=0, name='DecompressionTime', unit=5), TCounter(value=3047993095, name='DelimiterParseTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=115333069, name='MaterializeTupleTime(*)', unit=5), TCounter(value=0, name='MaxCompressedTextFileLength', unit=3), TCounter(value=1, name='NumDisksAccessed', unit=0), TCounter(value=7, name='NumScannerThreadsStarted', unit=0), TCounter(value=81308330, name='PeakMemoryUsage', unit=3), TCounter(value=3680821, name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0, name='RemoteScanRanges', unit=0), TCounter(value=10756642287, name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0, name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=2000405, name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=7, name='ScanRangesComplete', unit=0), TCounter(value=1954, name='ScannerThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=15660666, name='ScannerThreadsSysTime', unit=5), TCounter(value=71405504832, name='ScannerThreadsTotalWallClockTime', unit=5), TCounter(value=2743912333, name='ScannerThreadsUserTime', unit=5), TCounter(value=111, name='ScannerThreadsVoluntaryContextSwitches', unit=0), TCounter(value=1569329775, name='TotalRawHdfsOpenFileTime(*)', unit=5), TCounter(value=68714177598, name='TotalRawHdfsReadTime(*)', unit=5), TCounter(value=22364767, name='TotalReadThroughput', unit=4), TCounter(value=10775642244, name='TotalTime', unit=5)], metadata=0), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=14666633, name='CodegenTime', unit=5), TCounter(value=19666622, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions', unit=0), TCounter(value=1352, name='NumInstructions', unit=0), TCounter(value=207666196, name='OptimizationTime', unit=5), TCounter(value=692224, name='PeakMemoryUsage', unit=3), TCounter(value=37333248, name='PrepareTime', unit=5), TCounter(value=265332731, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment F00', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=3, child_counters_map={}, event_sequences=None, counters=[TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume id>:<# splits>/<split lengths>)'], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000003 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22001)', time_series_counters=[TTimeSeriesCounter(values=[48840, 85075971, 85084163, 85084163, 85101571, 85118979, 85153795, 85171203, 93577219, 85206019, 85206019, 85210115, 85210115, 85210115, 93598723, 85210115, 85210115, 85236739, 76913667, 68408323, 60085251, 34869251, 26310659], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 9, 7, 7, 4, 2], name='ThreadUsage', unit=0, period_ms=500)], info_strings={'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:8/256.00 MB '}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[2999994, 273999379, 11182974655, 11182974655, 11186974645], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4620644265512266173L, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=110402563, name='PeakMemoryUsage', unit=3), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=119315459, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5), TCounter(value=3999990, name='TotalNetworkSendTime', unit=5), TCounter(value=76034827672, name='TotalStorageWaitTime', unit=5), TCounter(value=2343, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=35989000, name='TotalThreadsSysTime', unit=5), TCounter(value=90734794356, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=3187511000, name='TotalThreadsUserTime', unit=5), TCounter(value=138, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11185974647, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=10912975266, name='ExecTime', unit=5), TCounter(value=10908975276, name='ExecTreeExecTime', unit=5), TCounter(value=2999993, name='ExecTreeOpenTime', unit=5), TCounter(value=0, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=270999385, name='OpenTime', unit=5), TCounter(value=1999996, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=2)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], name='BytesSent', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0), TCounter(value=3999990, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=23112, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=3999990, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True, name='AGGREGATION_NODE (id=1)', time_series_counters=None, info_strings={'ExecOption': 'Streaming Preaggregation, Codegen Enabled'}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime', 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough', 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate', 'ReductionFactorThresholdToExpand', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='ReductionFactorEstimate', unit=6), TCounter(value=0, name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0, name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10911975269, name='TotalTime', unit=5)], metadata=1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=1048576, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume id>:<# splits>/<split lengths>)', 'ExecOption', 'Hdfs Read Thread Concurrency Bucket', 'File Formats'], indent=False, name='HDFS_SCAN_NODE (id=0)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 8388608, 16777216, 33554432, 41943040, 58720256, 75497472, 83886080, 100663296, 109051904, 125829120, 134217728, 134217728, 142606336, 176160768, 192937984, 201457664, 226623488, 243597312, 268894208], name='BytesRead', unit=3, period_ms=500)], info_strings={'Hdfs Read Thread Concurrency Bucket': '0:4.545% 1:0% 2:0% 3:4.545% 4:4.545% 5:0% 6:86.36% ', 'ExecOption': 'TEXT Codegen Enabled, Codegen enabled: 8 out of 8', 'File Formats': 'TEXT/NONE:8 ', 'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:8/256.00 MB '}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected', 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput', 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount', 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches', 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate', 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency', 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency', 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal', 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges', 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime', 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']), 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime', 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime', 'ScannerThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4619618495043779119L, name='AverageHdfsReadThreadConcurrency', unit=6), TCounter(value=4619874381386243351L, name='AverageScannerThreadConcurrency', unit=6), TCounter(value=268959744, name='BytesRead', unit=3), TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0, name='BytesReadLocal', unit=3), TCounter(value=0, name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0, name='BytesReadShortCircuit', unit=3), TCounter(value=0, name='CachedFileHandlesHitCount', unit=0), TCounter(value=16, name='CachedFileHandlesMissCount', unit=0), TCounter(value=0, name='CollectionItemsRead', unit=0), TCounter(value=0, name='DecompressionTime', unit=5), TCounter(value=3334992441, name='DelimiterParseTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=118999732, name='MaterializeTupleTime(*)', unit=5), TCounter(value=0, name='MaxCompressedTextFileLength', unit=3), TCounter(value=1, name='NumDisksAccessed', unit=0), TCounter(value=8, name='NumScannerThreadsStarted', unit=0), TCounter(value=92510208, name='PeakMemoryUsage', unit=3), TCounter(value=3510590, name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0, name='RemoteScanRanges', unit=0), TCounter(value=10903975287, name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0, name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=2138019, name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=8, name='ScanRangesComplete', unit=0), TCounter(value=2159, name='ScannerThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=13993000, name='ScannerThreadsSysTime', unit=5), TCounter(value=79550819705, name='ScannerThreadsTotalWallClockTime', unit=5), TCounter(value=2951547000, name='ScannerThreadsUserTime', unit=5), TCounter(value=118, name='ScannerThreadsVoluntaryContextSwitches', unit=0), TCounter(value=1802995915, name='TotalRawHdfsOpenFileTime(*)', unit=5), TCounter(value=76613826357, name='TotalRawHdfsReadTime(*)', unit=5), TCounter(value=23382105, name='TotalReadThroughput', unit=4), TCounter(value=10908975276, name='TotalTime', unit=5)], metadata=0), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=11999974, name='CodegenTime', unit=5), TCounter(value=18999957, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions', unit=0), TCounter(value=1352, name='NumInstructions', unit=0), TCounter(value=209999525, name='OptimizationTime', unit=5), TCounter(value=692224, name='PeakMemoryUsage', unit=3), TCounter(value=31999924, name='PrepareTime', unit=5), TCounter(value=261999404, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume id>:<# splits>/<split lengths>)'], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000001 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22002)', time_series_counters=[TTimeSeriesCounter(values=[741064, 76674051, 76674051, 76674051, 76691459, 76708867, 76708867, 76726275, 76743683, 85163011, 76795907, 76795907, 76795907, 85211139, 85211139, 85211139, 76822531, 68408323, 68434947, 60020739, 51697667, 34816003], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[1, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 7, 6, 6, 4], name='ThreadUsage', unit=0, period_ms=500)], info_strings={'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:7/224.00 MB '}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[2999993, 286999350, 11166974691, 11166974691, 11168974687], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4619823204117750505L, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=93573123, name='PeakMemoryUsage', unit=3), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=102486019, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5), TCounter(value=1999996, name='TotalNetworkSendTime', unit=5), TCounter(value=66904848362, name='TotalStorageWaitTime', unit=5), TCounter(value=1985, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=37991000, name='TotalThreadsSysTime', unit=5), TCounter(value=81285815773, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=2780574000, name='TotalThreadsUserTime', unit=5), TCounter(value=125, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=11167974689, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=10881975337, name='ExecTime', unit=5), TCounter(value=10879975341, name='ExecTreeExecTime', unit=5), TCounter(value=1999996, name='ExecTreeOpenTime', unit=5), TCounter(value=999998, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=283999357, name='OpenTime', unit=5), TCounter(value=1999995, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=2)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], name='BytesSent', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0), TCounter(value=1999996, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=23112, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=1999996, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True, name='AGGREGATION_NODE (id=1)', time_series_counters=None, info_strings={'ExecOption': 'Streaming Preaggregation, Codegen Enabled'}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime', 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough', 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate', 'ReductionFactorThresholdToExpand', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='ReductionFactorEstimate', unit=6), TCounter(value=0, name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0, name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10882975335, name='TotalTime', unit=5)], metadata=1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=1048576, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume id>:<# splits>/<split lengths>)', 'ExecOption', 'Hdfs Read Thread Concurrency Bucket', 'File Formats'], indent=False, name='HDFS_SCAN_NODE (id=0)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 8388608, 16777216, 16777216, 25165824, 41943040, 58720256, 67108864, 67108864, 83886080, 100663296, 109051904, 125829120, 134217728, 142671872, 151060480, 167903232, 184680448, 226754560], name='BytesRead', unit=3, period_ms=500)], info_strings={'Hdfs Read Thread Concurrency Bucket': '0:0% 1:4.762% 2:0% 3:0% 4:4.762% 5:4.762% 6:85.71% ', 'ExecOption': 'TEXT Codegen Enabled, Codegen enabled: 7 out of 7', 'File Formats': 'TEXT/NONE:7 ', 'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:7/224.00 MB '}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected', 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput', 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount', 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches', 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate', 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency', 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency', 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal', 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges', 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime', 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']), 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime', 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime', 'ScannerThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4618870332118669410L, name='AverageHdfsReadThreadConcurrency', unit=6), TCounter(value=4619031174962504070L, name='AverageScannerThreadConcurrency', unit=6), TCounter(value=235339776, name='BytesRead', unit=3), TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0, name='BytesReadLocal', unit=3), TCounter(value=0, name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0, name='BytesReadShortCircuit', unit=3), TCounter(value=0, name='CachedFileHandlesHitCount', unit=0), TCounter(value=14, name='CachedFileHandlesMissCount', unit=0), TCounter(value=0, name='CollectionItemsRead', unit=0), TCounter(value=0, name='DecompressionTime', unit=5), TCounter(value=2783993692, name='DelimiterParseTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=113999742, name='MaterializeTupleTime(*)', unit=5), TCounter(value=0, name='MaxCompressedTextFileLength', unit=3), TCounter(value=1, name='NumDisksAccessed', unit=0), TCounter(value=7, name='NumScannerThreadsStarted', unit=0), TCounter(value=75680768, name='PeakMemoryUsage', unit=3), TCounter(value=3491229, name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0, name='RemoteScanRanges', unit=0), TCounter(value=10832975447, name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0, name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=1869354, name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=7, name='ScanRangesComplete', unit=0), TCounter(value=1636, name='ScannerThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=14995000, name='ScannerThreadsSysTime', unit=5), TCounter(value=70119841079, name='ScannerThreadsTotalWallClockTime', unit=5), TCounter(value=2539610000, name='ScannerThreadsUserTime', unit=5), TCounter(value=104, name='ScannerThreadsVoluntaryContextSwitches', unit=0), TCounter(value=1483996634, name='TotalRawHdfsOpenFileTime(*)', unit=5), TCounter(value=67408847225, name='TotalRawHdfsReadTime(*)', unit=5), TCounter(value=20612177, name='TotalReadThroughput', unit=4), TCounter(value=10879975341, name='TotalTime', unit=5)], metadata=0), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=16999960, name='CodegenTime', unit=5), TCounter(value=18999957, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions', unit=0), TCounter(value=1352, name='NumInstructions', unit=0), TCounter(value=207999529, name='OptimizationTime', unit=5), TCounter(value=692224, name='PeakMemoryUsage', unit=3), TCounter(value=45999896, name='PrepareTime', unit=5), TCounter(value=273999379, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume id>:<# splits>/<split lengths>)'], indent=True, name='Instance a6461a30c2fb8bec:d4c89d2200000002 (host=ec2-m2-4xlarge-centos-6-4-0bb5.vpc.cloudera.com:22000)', time_series_counters=[TTimeSeriesCounter(values=[76674051, 76674051, 93477891, 76726275, 85128195, 76761091, 85163011, 76805123, 76805123, 76805123, 93595651, 76822531, 76822531, 85211139, 76849155, 76914691, 68364291, 51653635, 51553283, 34724867, 26310659], name='MemoryUsage', unit=3, period_ms=500), TTimeSeriesCounter(values=[8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 8, 7, 6, 5, 3, 2], name='ThreadUsage', unit=0, period_ms=500)], info_strings={'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:8/238.94 MB '}, summary_stats_counters=None, num_children=5, child_counters_map={'': set(['TotalNetworkSendTime', 'PerHostPeakMemUsage', 'AverageThreadTokens', 'PeakMemoryUsage', 'TotalStorageWaitTime', 'TotalThreadsInvoluntaryContextSwitches', 'TotalThreadsTotalWallClockTime', 'RowsProduced', 'TotalThreadsVoluntaryContextSwitches', 'TotalNetworkReceiveTime', 'BloomFilterBytes', 'PeakReservation', 'PeakUsedReservation']), 'TotalThreadsTotalWallClockTime': set(['TotalThreadsUserTime', 'TotalThreadsSysTime'])}, event_sequences=[TEventSequence(timestamps=[3999991, 274999376, 10814975489, 10814975489, 10816975485], labels=['Prepare Finished', 'Open Finished', 'First Batch Produced', 'First Batch Sent', 'ExecInternal Finished'], name='Fragment Instance Lifecycle Event Timeline')], counters=[TCounter(value=4619781774900399153L, name='AverageThreadTokens', unit=6), TCounter(value=0, name='BloomFilterBytes', unit=3), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=93626371, name='PeakMemoryUsage', unit=3), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=102539267, name='PerHostPeakMemUsage', unit=3), TCounter(value=0, name='RowsProduced', unit=0), TCounter(value=0, name='TotalNetworkReceiveTime', unit=5), TCounter(value=1999996, name='TotalNetworkSendTime', unit=5), TCounter(value=61341860971, name='TotalStorageWaitTime', unit=5), TCounter(value=2253, name='TotalThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=42990000, name='TotalThreadsSysTime', unit=5), TCounter(value=75357829208, name='TotalThreadsTotalWallClockTime', unit=5), TCounter(value=2970545000, name='TotalThreadsUserTime', unit=5), TCounter(value=132, name='TotalThreadsVoluntaryContextSwitches', unit=0), TCounter(value=10814975489, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'ReservationLimit', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=0, name='CumulativeAllocationBytes', unit=3), TCounter(value=0, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=0, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='ReservationLimit', unit=3), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Fragment Instance Lifecycle Timings', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ExecTime', 'OpenTime', 'PrepareTime']), 'ExecTime': set(['ExecTreeExecTime']), 'OpenTime': set(['ExecTreeOpenTime']), 'PrepareTime': set(['ExecTreePrepareTime'])}, event_sequences=None, counters=[TCounter(value=10541976109, name='ExecTime', unit=5), TCounter(value=10539976113, name='ExecTreeExecTime', unit=5), TCounter(value=1999994, name='ExecTreeOpenTime', unit=5), TCounter(value=0, name='ExecTreePrepareTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=270999385, name='OpenTime', unit=5), TCounter(value=1999995, name='PrepareTime', unit=5), TCounter(value=0, name='TotalTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='KrpcDataStreamSender (dst_id=2)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], name='BytesSent', unit=3, period_ms=500)], info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['SerializeBatchTime', 'UncompressedRowBatchSize', 'RpcFailure', 'PeakMemoryUsage', 'RpcRetry', 'EosSent', 'NetworkThroughput', 'TotalBytesSent', 'RowsSent'])}, event_sequences=None, counters=[TCounter(value=3, name='EosSent', unit=0), TCounter(value=1999996, name='InactiveTotalTime', unit=5), TCounter(value=0, name='NetworkThroughput', unit=4), TCounter(value=23112, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='RowsSent', unit=0), TCounter(value=0, name='RpcFailure', unit=0), TCounter(value=0, name='RpcRetry', unit=0), TCounter(value=0, name='SerializeBatchTime', unit=5), TCounter(value=0, name='TotalBytesSent', unit=3), TCounter(value=1999996, name='TotalTime', unit=5), TCounter(value=0, name='UncompressedRowBatchSize', unit=3)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['ExecOption'], indent=True, name='AGGREGATION_NODE (id=1)', time_series_counters=None, info_strings={'ExecOption': 'Streaming Preaggregation, Codegen Enabled'}, summary_stats_counters=None, num_children=2, child_counters_map={'': set(['LargestPartitionPercent', 'HTResizeTime', 'StreamingTime', 'HashBuckets', 'PeakMemoryUsage', 'PartitionsCreated', 'RowsPassedThrough', 'RowsReturnedRate', 'RowsReturned', 'ReductionFactorEstimate', 'ReductionFactorThresholdToExpand', 'GetResultsTime'])}, event_sequences=None, counters=[TCounter(value=0, name='GetResultsTime', unit=5), TCounter(value=0, name='HTResizeTime', unit=5), TCounter(value=0, name='HashBuckets', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LargestPartitionPercent', unit=0), TCounter(value=16, name='PartitionsCreated', unit=0), TCounter(value=17891456, name='PeakMemoryUsage', unit=3), TCounter(value=0, name='ReductionFactorEstimate', unit=6), TCounter(value=0, name='ReductionFactorThresholdToExpand', unit=6), TCounter(value=0, name='RowsPassedThrough', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=0, name='StreamingTime', unit=5), TCounter(value=10541976107, name='TotalTime', unit=5)], metadata=1), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='Buffer pool', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['ReadIoWaitTime', 'WriteIoOps', 'WriteIoWaitTime', 'CumulativeAllocations', 'ReadIoOps', 'WriteIoBytes', 'PeakUnpinnedBytes', 'AllocTime', 'ReadIoBytes', 'CumulativeAllocationBytes', 'PeakReservation', 'PeakUsedReservation'])}, event_sequences=None, counters=[TCounter(value=0, name='AllocTime', unit=5), TCounter(value=1048576, name='CumulativeAllocationBytes', unit=3), TCounter(value=1, name='CumulativeAllocations', unit=0), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=17825792, name='PeakReservation', unit=3), TCounter(value=0, name='PeakUnpinnedBytes', unit=3), TCounter(value=1048576, name='PeakUsedReservation', unit=3), TCounter(value=0, name='ReadIoBytes', unit=3), TCounter(value=0, name='ReadIoOps', unit=0), TCounter(value=0, name='ReadIoWaitTime', unit=5), TCounter(value=0, name='TotalTime', unit=5), TCounter(value=0, name='WriteIoBytes', unit=3), TCounter(value=0, name='WriteIoOps', unit=0), TCounter(value=0, name='WriteIoWaitTime', unit=5)], metadata=-1), TRuntimeProfileNode(info_strings_display_order=['Hdfs split stats (<volume id>:<# splits>/<split lengths>)', 'ExecOption', 'Hdfs Read Thread Concurrency Bucket', 'File Formats'], indent=False, name='HDFS_SCAN_NODE (id=0)', time_series_counters=[TTimeSeriesCounter(values=[0, 0, 16777216, 25165824, 33554432, 41943040, 50331648, 75497472, 75497472, 83886080, 100663296, 100663296, 125829120, 134217728, 150994944, 167772160, 193069056, 201523200, 225641912, 234096056, 242550200], name='BytesRead', unit=3, period_ms=500)], info_strings={'Hdfs Read Thread Concurrency Bucket': '0:0% 1:9.524% 2:4.762% 3:0% 4:0% 5:9.524% 6:76.19% ', 'ExecOption': 'TEXT Codegen Enabled, Codegen enabled: 8 out of 8', 'File Formats': 'TEXT/NONE:8 ', 'Hdfs split stats (<volume id>:<# splits>/<split lengths>)': '-1:8/238.94 MB '}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['CachedFileHandlesHitCount', 'BytesReadRemoteUnexpected', 'ScanRangesComplete', 'RowsReturned', 'TotalReadThroughput', 'ScannerThreadsTotalWallClockTime', 'CachedFileHandlesMissCount', 'TotalRawHdfsOpenFileTime(*)', 'ScannerThreadsInvoluntaryContextSwitches', 'NumDisksAccessed', 'RowBatchQueueGetWaitTime', 'RowsReturnedRate', 'TotalRawHdfsReadTime(*)', 'AverageHdfsReadThreadConcurrency', 'ScannerThreadsVoluntaryContextSwitches', 'AverageScannerThreadConcurrency', 'CollectionItemsRead', 'NumScannerThreadsStarted', 'BytesReadLocal', 'DecompressionTime', 'PerReadThreadRawHdfsThroughput', 'RemoteScanRanges', 'MaxCompressedTextFileLength', 'PeakMemoryUsage', 'RowBatchQueuePutWaitTime', 'BytesReadShortCircuit', 'BytesReadDataNodeCache', 'BytesRead', 'RowsRead']), 'ScannerThreadsTotalWallClockTime': set(['DelimiterParseTime', 'MaterializeTupleTime(*)', 'ScannerThreadsUserTime', 'ScannerThreadsSysTime'])}, event_sequences=None, counters=[TCounter(value=4618387803587165428L, name='AverageHdfsReadThreadConcurrency', unit=6), TCounter(value=4618655874993556529L, name='AverageScannerThreadConcurrency', unit=6), TCounter(value=251004344, name='BytesRead', unit=3), TCounter(value=0, name='BytesReadDataNodeCache', unit=3), TCounter(value=0, name='BytesReadLocal', unit=3), TCounter(value=0, name='BytesReadRemoteUnexpected', unit=3), TCounter(value=0, name='BytesReadShortCircuit', unit=3), TCounter(value=0, name='CachedFileHandlesHitCount', unit=0), TCounter(value=15, name='CachedFileHandlesMissCount', unit=0), TCounter(value=0, name='CollectionItemsRead', unit=0), TCounter(value=0, name='DecompressionTime', unit=5), TCounter(value=3024993152, name='DelimiterParseTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=112999734, name='MaterializeTupleTime(*)', unit=5), TCounter(value=0, name='MaxCompressedTextFileLength', unit=3), TCounter(value=1, name='NumDisksAccessed', unit=0), TCounter(value=7, name='NumScannerThreadsStarted', unit=0), TCounter(value=75734016, name='PeakMemoryUsage', unit=3), TCounter(value=4040645, name='PerReadThreadRawHdfsThroughput', unit=4), TCounter(value=0, name='RemoteScanRanges', unit=0), TCounter(value=10532976127, name='RowBatchQueueGetWaitTime', unit=5), TCounter(value=0, name='RowBatchQueuePutWaitTime', unit=5), TCounter(value=1993842, name='RowsRead', unit=0), TCounter(value=0, name='RowsReturned', unit=0), TCounter(value=0, name='RowsReturnedRate', unit=1), TCounter(value=8, name='ScanRangesComplete', unit=0), TCounter(value=2069, name='ScannerThreadsInvoluntaryContextSwitches', unit=0), TCounter(value=17994000, name='ScannerThreadsSysTime', unit=5), TCounter(value=64545853712, name='ScannerThreadsTotalWallClockTime', unit=5), TCounter(value=2740580000, name='ScannerThreadsUserTime', unit=5), TCounter(value=113, name='ScannerThreadsVoluntaryContextSwitches', unit=0), TCounter(value=1420996777, name='TotalRawHdfsOpenFileTime(*)', unit=5), TCounter(value=62119859212, name='TotalRawHdfsReadTime(*)', unit=5), TCounter(value=23100019, name='TotalReadThroughput', unit=4), TCounter(value=10537976117, name='TotalTime', unit=5)], metadata=0), TRuntimeProfileNode(info_strings_display_order=[], indent=True, name='CodeGen', time_series_counters=None, info_strings={}, summary_stats_counters=None, num_children=0, child_counters_map={'': set(['OptimizationTime', 'CompileTime', 'LoadTime', 'NumInstructions', 'PeakMemoryUsage', 'ModuleBitcodeSize', 'PrepareTime', 'NumFunctions', 'CodegenTime'])}, event_sequences=None, counters=[TCounter(value=14999965, name='CodegenTime', unit=5), TCounter(value=20999953, name='CompileTime', unit=5), TCounter(value=0, name='InactiveTotalTime', unit=5), TCounter(value=0, name='LoadTime', unit=5), TCounter(value=2370660, name='ModuleBitcodeSize', unit=3), TCounter(value=63, name='NumFunctions', unit=0), TCounter(value=1352, name='NumInstructions', unit=0), TCounter(value=204999535, name='OptimizationTime', unit=5), TCounter(value=692224, name='PeakMemoryUsage', unit=3), TCounter(value=33999924, name='PrepareTime', unit=5), TCounter(value=259999412, name='TotalTime', unit=5)], metadata=-1)])

Attachments

Activity

People

Assignee:: Joe McDonnell

Reporter:: Tianyi Wang

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 05/Apr/18 18:13

Updated:: 07/May/18 16:43

Resolved:: 12/Apr/18 23:12