Container: container_1406566393272_6236_01_000242 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 0 Log Contents: LogType: stdout LogLength: 1380 Log Contents: 3.639: [GC [PSYoungGen: 132862K->17188K(204288K)] 132862K->17260K(2068480K), 0.0351320 secs] [Times: user=0.19 sys=0.02, real=0.04 secs] 6.717: [GC [PSYoungGen: 165665K->28517K(204288K)] 1214313K->1077173K(2068480K), 0.0880910 secs] [Times: user=0.72 sys=0.05, real=0.09 secs] 7.624: [GC [PSYoungGen: 114810K->28659K(204288K)] 1294538K->1211939K(2068480K), 0.0331370 secs] [Times: user=0.40 sys=0.02, real=0.03 secs] Heap PSYoungGen total 204288K, used 105504K [0x00000007e5980000, 0x00000007fe880000, 0x0000000800000000) eden space 175616K, 43% used [0x00000007e5980000,0x00000007ee2311b8,0x00000007f0500000) lgrp 0 space 87808K, 28% used [0x00000007e5980000,0x00000007e719a540,0x00000007eaf40000) lgrp 1 space 87808K, 59% used [0x00000007eaf40000,0x00000007ee2311b8,0x00000007f0500000) from space 28672K, 99% used [0x00000007f0500000,0x00000007f20fcc48,0x00000007f2100000) to space 28672K, 0% used [0x00000007fcc80000,0x00000007fcc80000,0x00000007fe880000) ParOldGen total 1864192K, used 1183280K [0x0000000712800000, 0x0000000784480000, 0x00000007e5980000) object space 1864192K, 63% used [0x0000000712800000,0x000000075ab8c1a0,0x0000000784480000) PSPermGen total 29696K, used 29474K [0x000000070d600000, 0x000000070f300000, 0x0000000712800000) object space 29696K, 99% used [0x000000070d600000,0x000000070f2c89f0,0x000000070f300000) LogType: syslog LogLength: 1114 Log Contents: 2014-09-25 15:25:36,673 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,590 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 27226, container_1406566393272_6236_01_000242 2014-09-25 15:25:37,747 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,908 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,908 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:38,113 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,694 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 1 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_22_000158_0 2014-09-25 15:25:38,695 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_22_000158_0 LogType: syslog_attempt_1406566393272_6236_1_22_000158_0 LogLength: 71581 Log Contents: 2014-09-25 15:25:38,704 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,704 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,705 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,710 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:38,920 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:39,287 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 19, VertexParallelism: 223, TaskAttemptID:attempt_1406566393272_6236_1_22_000158_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=2, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, {{ sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2014-09-25 15:25:39,290 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=2, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:39,317 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_22_000158_0 2014-09-25 15:25:39,317 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:39,317 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,352 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:39,352 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput } 2014-09-25 15:25:39,353 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,353 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput } 2014-09-25 15:25:39,353 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,355 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:39,355 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,355 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,367 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: Map 42 2014-09-25 15:25:39,367 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_sales 2014-09-25 15:25:39,369 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Reducer 20 2014-09-25 15:25:39,370 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_sales 2014-09-25 15:25:39,379 INFO [Initializer 2] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Requested SortBufferSize (io.sort.mb): 1024 2014-09-25 15:25:39,379 INFO [Initializer 2] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1073741824, type: OUTPUT, componentVertexName: Reducer 20 2014-09-25 15:25:39,380 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Reducer 20 2014-09-25 15:25:39,383 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1503238528, type: INPUT, componentVertexName: Map 42 2014-09-25 15:25:39,384 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:39,393 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: Map 42 2014-09-25 15:25:39,407 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:39,428 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:39,441 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:39,442 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:39,442 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,442 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,442 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 3 initializers to finish 2014-09-25 15:25:39,442 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:39,442 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:39,479 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:39,479 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:39,479 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_sales 2014-09-25 15:25:39,479 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,490 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,509 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,510 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,510 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 12, for type: SORTED_OUTPUT 2014-09-25 15:25:39,510 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: UNSORTED_INPUT 2014-09-25 15:25:39,511 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.045, finalReserveFractionUsed=0.345 2014-09-25 15:25:39,511 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 3, numScaledRequests: 14, TotalRequested: 2576980352, TotalRequestedScaled: 1.0277243154285713E9, TotalJVMHeap: 3837263872, TotalAvailable: 2513407836, TotalRequested/TotalJVMHeap:0.67 2014-09-25 15:25:39,511 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_sales, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,512 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Reducer 20, org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput: requested=1073741824, allocated=1073741824 2014-09-25 15:25:39,512 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, Map 42, org.apache.tez.runtime.library.input.UnorderedKVInput: requested=1503238528, allocated=262594844 2014-09-25 15:25:39,512 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,513 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_sales being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,513 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_sales 2014-09-25 15:25:39,513 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_sales 2014-09-25 15:25:39,514 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: Map 42 being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,514 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: Map 42 2014-09-25 15:25:39,514 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 2 2014-09-25 15:25:39,514 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 IOs to start 2014-09-25 15:25:39,515 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,518 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: RequestedMem=1503238528, Allocated: 262594844 2014-09-25 15:25:39,518 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: SimpleInputManager -> MemoryLimit: 262594844, maxSingleMemLimit: 65648712 2014-09-25 15:25:39,531 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: ShuffleManager : numInputs=44, compressionCodec=NoCompressionCodec, numFetchers=30, ifileBufferSize=131072, ifileReadAheadEnabled=true, ifileReadAheadLength=4194304, keepAlive=false, keepAliveMaxConnections=20, connectionTimeout=180000, readTimeout=180000, bufferSize=8192, sslShuffle=false 2014-09-25 15:25:39,546 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: Map 42 2014-09-25 15:25:39,547 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,548 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_22_000158_0 2014-09-25 15:25:39,548 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,548 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_22_000158_0_10001 2014-09-25 15:25:39,711 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,712 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,430 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,431 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@5d2da9f5 2014-09-25 15:25:40,435 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,436 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,436 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_sales, Map 42] 2014-09-25 15:25:40,437 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_sales 2014-09-25 15:25:40,438 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,447 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@4063b180 2014-09-25 15:25:40,461 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,358 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,465 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:41,466 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2452165/000181_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:41,576 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,577 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2452165/000181_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 11739745, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:41,592 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,619 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2452165/000181_0 2014-09-25 15:25:41,619 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@4063b180 2014-09-25 15:25:41,622 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:41,628 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: keySerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@16dbc4bb; valueSerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@3650dcb6; comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@76ca4c95; conf=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2014-09-25 15:25:41,632 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Instantiating Partitioner: [org.apache.tez.mapreduce.partition.MRPartitioner] 2014-09-25 15:25:41,634 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: Using partitioner class: org.apache.tez.mapreduce.partition.MRPartitioner 2014-09-25 15:25:41,636 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: No combiner specified via tez.runtime.combiner.class. Combiner will not be used 2014-09-25 15:25:42,634 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: tez.runtime.io.sort.mb = 1024 2014-09-25 15:25:42,636 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.remaining() = 1073741824 2014-09-25 15:25:42,637 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.size = 16777216 2014-09-25 15:25:42,641 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 19 2014-09-25 15:25:42,750 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 40, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000040_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,753 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 41, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000041_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,753 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,757 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003]] 2014-09-25 15:25:42,779 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,779 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 42, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000042_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,779 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003]] 2014-09-25 15:25:42,792 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,792 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003]] 2014-09-25 15:25:42,950 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000042_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:42,950 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000041_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:42,952 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 309644 : 309644 2014-09-25 15:25:42,953 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000040_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:42,955 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1357296 : 1666940 2014-09-25 15:25:42,955 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] decomp: 309644 len: 309648 to MEMORY 2014-09-25 15:25:43,044 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 629820 : 2296760 2014-09-25 15:25:43,045 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] decomp: 629820 len: 629824 to MEMORY 2014-09-25 15:25:43,044 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] decomp: 1357296 len: 1357300 to MEMORY 2014-09-25 15:25:43,106 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 309644 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] 2014-09-25 15:25:43,107 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] to MEMORY, CompressedSize=309648, DecompressedSize=309644,EndTime=1411673143107, TimeTaken=156, Rate=1.89 MB/s 2014-09-25 15:25:43,107 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(43 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.07 MB/s) 2014-09-25 15:25:43,109 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 2 2014-09-25 15:25:43,135 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 629820 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] 2014-09-25 15:25:43,135 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] to MEMORY, CompressedSize=629824, DecompressedSize=629820,EndTime=1411673143135, TimeTaken=184, Rate=3.26 MB/s 2014-09-25 15:25:43,135 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(42 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.22 MB/s) 2014-09-25 15:25:43,136 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 1 2014-09-25 15:25:43,147 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1357296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] 2014-09-25 15:25:43,148 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] to MEMORY, CompressedSize=1357300, DecompressedSize=1357296,EndTime=1411673143148, TimeTaken=193, Rate=6.71 MB/s 2014-09-25 15:25:43,148 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(41 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.55 MB/s) 2014-09-25 15:25:43,148 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 0 2014-09-25 15:25:43,153 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 43, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000043_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,153 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,153 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003]] 2014-09-25 15:25:43,157 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000043_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,157 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1555518 : 3852278 2014-09-25 15:25:43,157 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] decomp: 1555518 len: 1555522 to MEMORY 2014-09-25 15:25:43,166 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1555518 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] 2014-09-25 15:25:43,166 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] to MEMORY, CompressedSize=1555522, DecompressedSize=1555518,EndTime=1411673143166, TimeTaken=9, Rate=164.83 MB/s 2014-09-25 15:25:43,166 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(40 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.92 MB/s) 2014-09-25 15:25:43,166 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 3 2014-09-25 15:25:43,274 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 38, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000038_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,274 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,274 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003]] 2014-09-25 15:25:43,280 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000038_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,281 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 677484 : 4529762 2014-09-25 15:25:43,281 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] decomp: 677484 len: 677488 to MEMORY 2014-09-25 15:25:43,301 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 677484 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] 2014-09-25 15:25:43,302 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] to MEMORY, CompressedSize=677488, DecompressedSize=677484,EndTime=1411673143302, TimeTaken=22, Rate=29.37 MB/s 2014-09-25 15:25:43,302 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(39 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.08 MB/s) 2014-09-25 15:25:43,302 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 4 2014-09-25 15:25:43,441 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:43,528 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =8 Id =0 Id =1 Id =2 Id =3 Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\RS> <\Children> Id = 4 null<\Parent> <\GBY> <\Children> Id = 3 null<\Parent> <\SEL> <\Children> Id = 2 nullId = 7 Id =7 null <\Children> <\Parent> <\HASHTABLEDUMMY><\Parent> <\MAPJOIN> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 8 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:43,536 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[8] 2014-09-25 15:25:43,537 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:43,537 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:43,537 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:43,537 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:43,537 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:43,538 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:43,538 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:43,538 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:43,538 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:43,571 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 8 MAP 2014-09-25 15:25:43,571 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[7] 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Operator 7 HASHTABLEDUMMY initialized 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing children of 7 HASHTABLEDUMMY 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing Self MAPJOIN[3] 2014-09-25 15:25:43,635 INFO [TezChild] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: JOIN struct<_col0:int,_col2:float,_col5:float,_col6:float,_col7:float> totalsz = 5 2014-09-25 15:25:43,635 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Operator 3 MAPJOIN initialized 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing children of 3 MAPJOIN 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 4 SEL 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[4] 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 4 SEL initialized 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 4 SEL 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing child 5 GBY 2014-09-25 15:25:43,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing Self GBY[5] 2014-09-25 15:25:43,645 WARN [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2014-09-25 15:25:43,651 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Operator 5 GBY initialized 2014-09-25 15:25:43,651 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing children of 5 GBY 2014-09-25 15:25:43,651 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 6 RS 2014-09-25 15:25:43,652 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[6] 2014-09-25 15:25:43,659 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = -1 2014-09-25 15:25:43,659 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 6 RS 2014-09-25 15:25:43,661 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: using hash aggregation processing mode 2014-09-25 15:25:43,662 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initialization Done 5 GBY 2014-09-25 15:25:43,662 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 4 SEL 2014-09-25 15:25:43,664 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Try to retrieve from cache 2014-09-25 15:25:43,664 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Did not find tables in cache 2014-09-25 15:25:43,668 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initialization Done 3 MAPJOIN 2014-09-25 15:25:43,668 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initialization Done 7 HASHTABLEDUMMY 2014-09-25 15:25:43,670 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[6] --> Reducer 20 2014-09-25 15:25:43,670 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:43,732 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_sales for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2452165 2014-09-25 15:25:43,736 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:43,741 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper: Key count from statistics is 7199721; setting map size to 9599628 2014-09-25 15:25:43,900 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 39, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000039_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,901 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,901 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe 2014-09-25 15:25:43,901 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003]] 2014-09-25 15:25:43,905 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Tag found in keys and will be removed. This should not happen. 2014-09-25 15:25:43,912 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000039_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,912 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1822690 : 6352452 2014-09-25 15:25:43,912 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] decomp: 1822690 len: 1822694 to MEMORY 2014-09-25 15:25:44,013 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1822690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] 2014-09-25 15:25:44,013 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] to MEMORY, CompressedSize=1822694, DecompressedSize=1822690,EndTime=1411673144013, TimeTaken=101, Rate=17.21 MB/s 2014-09-25 15:25:44,014 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(38 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.21 MB/s) 2014-09-25 15:25:44,014 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 5 2014-09-25 15:25:44,139 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 309644 : 6042808 2014-09-25 15:25:44,333 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 629820 : 5412988 2014-09-25 15:25:44,385 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1357296 : 4055692 2014-09-25 15:25:44,411 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 37, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000037_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,411 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,411 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003]] 2014-09-25 15:25:44,413 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000037_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,414 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 3583040 : 7638732 2014-09-25 15:25:44,415 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] decomp: 3583040 len: 3583044 to MEMORY 2014-09-25 15:25:44,430 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1555518 : 6083214 2014-09-25 15:25:44,443 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 677484 : 5405730 2014-09-25 15:25:44,477 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1822690 : 3583040 2014-09-25 15:25:44,588 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 3583040 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] 2014-09-25 15:25:44,589 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] to MEMORY, CompressedSize=3583044, DecompressedSize=3583040,EndTime=1411673144588, TimeTaken=174, Rate=19.64 MB/s 2014-09-25 15:25:44,589 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(37 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.58 MB/s) 2014-09-25 15:25:44,589 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 6 2014-09-25 15:25:44,693 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 3583040 : 0 2014-09-25 15:25:44,717 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 36, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000036_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,717 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,717 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003]] 2014-09-25 15:25:44,722 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000036_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,722 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 4541346 : 4541346 2014-09-25 15:25:44,723 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] decomp: 4541346 len: 4541350 to MEMORY 2014-09-25 15:25:45,053 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 4541346 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] 2014-09-25 15:25:45,053 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] to MEMORY, CompressedSize=4541350, DecompressedSize=4541346,EndTime=1411673145053, TimeTaken=331, Rate=13.08 MB/s 2014-09-25 15:25:45,053 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(36 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.30 MB/s) 2014-09-25 15:25:45,054 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 7 2014-09-25 15:25:45,166 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 4541346 : 0 2014-09-25 15:25:46,051 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000158_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 32, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000032_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,051 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,051 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003]] 2014-09-25 15:25:46,057 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000032_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,057 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 12798650 : 12798650 2014-09-25 15:25:46,059 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] decomp: 12798650 len: 12798654 to MEMORY 2014-09-25 15:25:46,152 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Received should die response from AM 2014-09-25 15:25:46,152 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Asked to die via task heartbeat 2014-09-25 15:25:46,152 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Interrupted while waiting for task to complete. Interrupting task 2014-09-25 15:25:46,152 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Shutdown requested... returning 2014-09-25 15:25:46,153 INFO [main] org.apache.tez.runtime.task.TezChild: Got a shouldDie notification via hearbeats. Shutting down 2014-09-25 15:25:46,154 WARN [TezChild] org.apache.tez.runtime.library.common.readers.UnorderedKVReader: Interrupted while waiting for next available input java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput(ShuffleManager.java:621) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:176) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next(UnorderedKVReader.java:117) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:112) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:185) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:211) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1038) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:85) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70) at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:154) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:142) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2014-09-25 15:25:46,170 FATAL [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:121) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:185) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:211) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1038) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:85) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70) at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:154) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:142) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.io.IOException: java.lang.InterruptedException at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:179) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next(UnorderedKVReader.java:117) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:112) ... 25 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput(ShuffleManager.java:621) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:176) ... 27 more 2014-09-25 15:25:46,170 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: 8 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: DESERIALIZE_ERRORS:0 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: 1 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: FILTERED:0 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: PASSED:0 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 2 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 2 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: 1 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: 8 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: 7 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: 3 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 4 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: 5 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: 6 finished. closing... 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: 6 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: 5 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 4 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: 3 Close done 2014-09-25 15:25:46,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: 7 Close done 2014-09-25 15:25:46,172 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: TezProcessor: processed 0 rows/groups: used memory = 1305305840 2014-09-25 15:25:46,177 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:93) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70) at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:154) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:142) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:121) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:185) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:211) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1038) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:85) ... 16 more Caused by: java.io.IOException: java.lang.InterruptedException at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:179) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next(UnorderedKVReader.java:117) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:112) ... 25 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput(ShuffleManager.java:621) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:176) ... 27 more 2014-09-25 15:25:46,178 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Encounted an error while executing task: attempt_1406566393272_6236_1_22_000158_0 java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:177) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:142) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:93) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70) at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:154) ... 13 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:121) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:185) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:211) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1038) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:85) ... 16 more Caused by: java.io.IOException: java.lang.InterruptedException at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:179) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next(UnorderedKVReader.java:117) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:112) ... 25 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput(ShuffleManager.java:621) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:176) ... 27 more 2014-09-25 15:25:46,253 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping TezTask metrics system... 2014-09-25 15:25:46,254 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system stopped. 2014-09-25 15:25:46,254 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system shutdown complete. Container: container_1406566393272_6236_01_000239 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 241 Log Contents: log4j:WARN No appenders could be found for logger (org.apache.hadoop.hive.ql.exec.tez.TezProcessor). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. LogType: stdout LogLength: 1519 Log Contents: 4.379: [GC [PSYoungGen: 153837K->22719K(204288K)] 153837K->22791K(2068480K), 0.0598970 secs] [Times: user=0.24 sys=0.02, real=0.06 secs] 5.827: [GC [PSYoungGen: 114949K->24343K(379904K)] 115021K->24423K(2244096K), 0.0511190 secs] [Times: user=0.19 sys=0.05, real=0.05 secs] 8.014: [GC [PSYoungGen: 155898K->28643K(379904K)] 1204554K->1085097K(2244096K), 0.0412190 secs] [Times: user=0.35 sys=0.04, real=0.04 secs] 8.854: [GC [PSYoungGen: 207484K->28670K(403968K)] 1263937K->1273962K(2268160K), 0.1958070 secs] [Times: user=3.43 sys=0.24, real=0.19 secs] Heap PSYoungGen total 403968K, used 109723K [0x00000007e5980000, 0x0000000800000000, 0x0000000800000000) eden space 375296K, 21% used [0x00000007e5980000,0x00000007f13afaa0,0x00000007fc800000) lgrp 0 space 187648K, 41% used [0x00000007e5980000,0x00000007ea5b7860,0x00000007f10c0000) lgrp 1 space 187648K, 1% used [0x00000007f10c0000,0x00000007f13afaa0,0x00000007fc800000) from space 28672K, 99% used [0x00000007fe400000,0x00000007fffffac0,0x0000000800000000) to space 28672K, 0% used [0x00000007fc800000,0x00000007fc800000,0x00000007fe400000) ParOldGen total 1864192K, used 1245291K [0x0000000712800000, 0x0000000784480000, 0x00000007e5980000) object space 1864192K, 66% used [0x0000000712800000,0x000000075e81af28,0x0000000784480000) PSPermGen total 29696K, used 29419K [0x000000070d600000, 0x000000070f300000, 0x0000000712800000) object space 29696K, 99% used [0x000000070d600000,0x000000070f2bac98,0x000000070f300000) LogType: syslog LogLength: 1114 Log Contents: 2014-09-25 15:25:36,754 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,677 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 27223, container_1406566393272_6236_01_000239 2014-09-25 15:25:37,806 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,962 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,962 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:38,184 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,884 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_22_000138_0 2014-09-25 15:25:38,885 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_22_000138_0 LogType: syslog_attempt_1406566393272_6236_1_22_000138_0 LogLength: 68599 Log Contents: 2014-09-25 15:25:38,895 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,895 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,895 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,901 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:39,080 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:39,364 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 19, VertexParallelism: 223, TaskAttemptID:attempt_1406566393272_6236_1_22_000138_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=2, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, {{ sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2014-09-25 15:25:39,368 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=2, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:39,412 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_22_000138_0 2014-09-25 15:25:39,412 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:39,412 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,447 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:39,448 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput } 2014-09-25 15:25:39,449 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,449 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput } 2014-09-25 15:25:39,449 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,450 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,450 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,452 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:39,460 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: Map 42 2014-09-25 15:25:39,461 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_sales 2014-09-25 15:25:39,463 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_sales 2014-09-25 15:25:39,466 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Reducer 20 2014-09-25 15:25:39,477 INFO [Initializer 2] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Requested SortBufferSize (io.sort.mb): 1024 2014-09-25 15:25:39,477 INFO [Initializer 2] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1073741824, type: OUTPUT, componentVertexName: Reducer 20 2014-09-25 15:25:39,477 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Reducer 20 2014-09-25 15:25:39,485 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1503238528, type: INPUT, componentVertexName: Map 42 2014-09-25 15:25:39,486 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:39,494 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: Map 42 2014-09-25 15:25:39,508 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:39,526 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:39,537 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:39,537 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:39,537 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,537 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,537 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 3 initializers to finish 2014-09-25 15:25:39,538 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:39,538 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:39,558 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:39,558 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:39,558 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_sales 2014-09-25 15:25:39,558 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,569 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,587 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,588 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,588 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 12, for type: SORTED_OUTPUT 2014-09-25 15:25:39,588 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: UNSORTED_INPUT 2014-09-25 15:25:39,588 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.045, finalReserveFractionUsed=0.345 2014-09-25 15:25:39,589 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 3, numScaledRequests: 14, TotalRequested: 2576980352, TotalRequestedScaled: 1.0277243154285713E9, TotalJVMHeap: 3837263872, TotalAvailable: 2513407836, TotalRequested/TotalJVMHeap:0.67 2014-09-25 15:25:39,589 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_sales, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,590 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Reducer 20, org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput: requested=1073741824, allocated=1073741824 2014-09-25 15:25:39,590 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, Map 42, org.apache.tez.runtime.library.input.UnorderedKVInput: requested=1503238528, allocated=262594844 2014-09-25 15:25:39,590 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,591 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_sales being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,591 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_sales 2014-09-25 15:25:39,591 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_sales 2014-09-25 15:25:39,592 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: Map 42 being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,592 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: Map 42 2014-09-25 15:25:39,593 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 2 2014-09-25 15:25:39,593 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 IOs to start 2014-09-25 15:25:39,593 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,596 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: RequestedMem=1503238528, Allocated: 262594844 2014-09-25 15:25:39,596 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: SimpleInputManager -> MemoryLimit: 262594844, maxSingleMemLimit: 65648712 2014-09-25 15:25:39,611 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: ShuffleManager : numInputs=44, compressionCodec=NoCompressionCodec, numFetchers=30, ifileBufferSize=131072, ifileReadAheadEnabled=true, ifileReadAheadLength=4194304, keepAlive=false, keepAliveMaxConnections=20, connectionTimeout=180000, readTimeout=180000, bufferSize=8192, sslShuffle=false 2014-09-25 15:25:39,626 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: Map 42 2014-09-25 15:25:39,626 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,628 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_22_000138_0 2014-09-25 15:25:39,628 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,628 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_22_000138_0_10001 2014-09-25 15:25:39,791 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,791 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,809 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,810 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@4e70a141 2014-09-25 15:25:40,815 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,816 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,816 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_sales, Map 42] 2014-09-25 15:25:40,818 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_sales 2014-09-25 15:25:40,818 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,834 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@22eaa01b 2014-09-25 15:25:40,854 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,916 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,010 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:42,011 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451910/000202_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,206 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,207 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451910/000202_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 17885241, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,231 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,248 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 40, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000040_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,251 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,256 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003]] 2014-09-25 15:25:42,264 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451910/000202_0 2014-09-25 15:25:42,264 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@22eaa01b 2014-09-25 15:25:42,267 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:42,274 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: keySerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@3c162fb3; valueSerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@5495af96; comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@2f3acc3c; conf=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2014-09-25 15:25:42,280 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Instantiating Partitioner: [org.apache.tez.mapreduce.partition.MRPartitioner] 2014-09-25 15:25:42,283 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: Using partitioner class: org.apache.tez.mapreduce.partition.MRPartitioner 2014-09-25 15:25:42,285 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: No combiner specified via tez.runtime.combiner.class. Combiner will not be used 2014-09-25 15:25:42,388 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000040_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,352 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: tez.runtime.io.sort.mb = 1024 2014-09-25 15:25:43,353 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1357296 : 1357296 2014-09-25 15:25:43,355 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.remaining() = 1073741824 2014-09-25 15:25:43,355 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.size = 16777216 2014-09-25 15:25:43,356 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] decomp: 1357296 len: 1357300 to MEMORY 2014-09-25 15:25:43,362 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 19 2014-09-25 15:25:43,370 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 41, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000041_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,370 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 42, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000042_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,370 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,371 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003]] 2014-09-25 15:25:43,382 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,382 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 43, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000043_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,382 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003]] 2014-09-25 15:25:43,395 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,395 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 38, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000038_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,395 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003]] 2014-09-25 15:25:43,397 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,397 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003]] 2014-09-25 15:25:43,399 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000041_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,399 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000042_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,399 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 629820 : 1987116 2014-09-25 15:25:43,399 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 309644 : 2296760 2014-09-25 15:25:43,400 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000043_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,399 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] decomp: 629820 len: 629824 to MEMORY 2014-09-25 15:25:43,408 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] decomp: 309644 len: 309648 to MEMORY 2014-09-25 15:25:43,409 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1555518 : 3852278 2014-09-25 15:25:43,409 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000038_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,410 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 677484 : 4529762 2014-09-25 15:25:43,410 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] decomp: 1555518 len: 1555522 to MEMORY 2014-09-25 15:25:43,410 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] decomp: 677484 len: 677488 to MEMORY 2014-09-25 15:25:43,442 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 309644 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] 2014-09-25 15:25:43,444 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] to MEMORY, CompressedSize=309648, DecompressedSize=309644,EndTime=1411673143444, TimeTaken=44, Rate=6.71 MB/s 2014-09-25 15:25:43,444 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(43 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.07 MB/s) 2014-09-25 15:25:43,446 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 2 2014-09-25 15:25:43,452 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 677484 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] 2014-09-25 15:25:43,453 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] to MEMORY, CompressedSize=677488, DecompressedSize=677484,EndTime=1411673143453, TimeTaken=44, Rate=14.68 MB/s 2014-09-25 15:25:43,453 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(42 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.24 MB/s) 2014-09-25 15:25:43,453 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 4 2014-09-25 15:25:43,458 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 629820 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] 2014-09-25 15:25:43,458 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] to MEMORY, CompressedSize=629824, DecompressedSize=629820,EndTime=1411673143458, TimeTaken=59, Rate=10.18 MB/s 2014-09-25 15:25:43,458 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(41 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.39 MB/s) 2014-09-25 15:25:43,458 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 1 2014-09-25 15:25:43,459 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1357296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] 2014-09-25 15:25:43,459 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] to MEMORY, CompressedSize=1357300, DecompressedSize=1357296,EndTime=1411673143459, TimeTaken=107, Rate=12.10 MB/s 2014-09-25 15:25:43,459 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(40 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.71 MB/s) 2014-09-25 15:25:43,459 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 0 2014-09-25 15:25:43,463 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1555518 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] 2014-09-25 15:25:43,463 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] to MEMORY, CompressedSize=1555522, DecompressedSize=1555518,EndTime=1411673143463, TimeTaken=55, Rate=26.97 MB/s 2014-09-25 15:25:43,464 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(39 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.08 MB/s) 2014-09-25 15:25:43,464 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 3 2014-09-25 15:25:43,881 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 39, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000039_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,881 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,881 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003]] 2014-09-25 15:25:43,889 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000039_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,890 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1822690 : 6352452 2014-09-25 15:25:43,891 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] decomp: 1822690 len: 1822694 to MEMORY 2014-09-25 15:25:43,966 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:44,021 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1822690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] 2014-09-25 15:25:44,021 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] to MEMORY, CompressedSize=1822694, DecompressedSize=1822690,EndTime=1411673144021, TimeTaken=131, Rate=13.27 MB/s 2014-09-25 15:25:44,021 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(38 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.21 MB/s) 2014-09-25 15:25:44,022 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 5 2014-09-25 15:25:44,081 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =8 Id =0 Id =1 Id =2 Id =3 Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\RS> <\Children> Id = 4 null<\Parent> <\GBY> <\Children> Id = 3 null<\Parent> <\SEL> <\Children> Id = 2 nullId = 7 Id =7 null <\Children> <\Parent> <\HASHTABLEDUMMY><\Parent> <\MAPJOIN> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 8 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:44,087 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[8] 2014-09-25 15:25:44,088 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:44,088 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:44,088 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:44,088 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:44,088 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:44,089 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:44,089 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:44,089 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:44,089 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:44,120 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 8 MAP 2014-09-25 15:25:44,120 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[7] 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Operator 7 HASHTABLEDUMMY initialized 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing children of 7 HASHTABLEDUMMY 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing Self MAPJOIN[3] 2014-09-25 15:25:44,159 INFO [TezChild] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: JOIN struct<_col0:int,_col2:float,_col5:float,_col6:float,_col7:float> totalsz = 5 2014-09-25 15:25:44,159 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Operator 3 MAPJOIN initialized 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing children of 3 MAPJOIN 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 4 SEL 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[4] 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 4 SEL initialized 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 4 SEL 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing child 5 GBY 2014-09-25 15:25:44,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing Self GBY[5] 2014-09-25 15:25:44,167 WARN [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2014-09-25 15:25:44,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Operator 5 GBY initialized 2014-09-25 15:25:44,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing children of 5 GBY 2014-09-25 15:25:44,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 6 RS 2014-09-25 15:25:44,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[6] 2014-09-25 15:25:44,177 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = -1 2014-09-25 15:25:44,177 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 6 RS 2014-09-25 15:25:44,180 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: using hash aggregation processing mode 2014-09-25 15:25:44,180 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initialization Done 5 GBY 2014-09-25 15:25:44,180 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 4 SEL 2014-09-25 15:25:44,183 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Try to retrieve from cache 2014-09-25 15:25:44,183 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Did not find tables in cache 2014-09-25 15:25:44,187 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initialization Done 3 MAPJOIN 2014-09-25 15:25:44,187 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initialization Done 7 HASHTABLEDUMMY 2014-09-25 15:25:44,189 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[6] --> Reducer 20 2014-09-25 15:25:44,189 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,247 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_sales for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451910 2014-09-25 15:25:44,252 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,259 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper: Key count from statistics is 7199721; setting map size to 9599628 2014-09-25 15:25:44,347 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe 2014-09-25 15:25:44,349 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Tag found in keys and will be removed. This should not happen. 2014-09-25 15:25:44,437 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 37, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000037_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,437 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,437 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003]] 2014-09-25 15:25:44,452 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000037_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,452 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 3583040 : 9935492 2014-09-25 15:25:44,455 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] decomp: 3583040 len: 3583044 to MEMORY 2014-09-25 15:25:44,564 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 309644 : 9625848 2014-09-25 15:25:44,696 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 677484 : 8948364 2014-09-25 15:25:44,700 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 3583040 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] 2014-09-25 15:25:44,700 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] to MEMORY, CompressedSize=3583044, DecompressedSize=3583040,EndTime=1411673144700, TimeTaken=248, Rate=13.78 MB/s 2014-09-25 15:25:44,701 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(37 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.58 MB/s) 2014-09-25 15:25:44,701 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 6 2014-09-25 15:25:44,720 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 629820 : 8318544 2014-09-25 15:25:44,743 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 36, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000036_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,743 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,743 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003]] 2014-09-25 15:25:44,774 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1357296 : 6961248 2014-09-25 15:25:44,795 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000036_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,795 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 4541346 : 11502594 2014-09-25 15:25:44,798 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] decomp: 4541346 len: 4541350 to MEMORY 2014-09-25 15:25:44,807 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1555518 : 9947076 2014-09-25 15:25:44,844 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1822690 : 8124386 2014-09-25 15:25:44,949 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 3583040 : 4541346 2014-09-25 15:25:45,046 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 4541346 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] 2014-09-25 15:25:45,046 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] to MEMORY, CompressedSize=4541350, DecompressedSize=4541346,EndTime=1411673145046, TimeTaken=251, Rate=17.25 MB/s 2014-09-25 15:25:45,046 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(36 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.30 MB/s) 2014-09-25 15:25:45,046 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 7 2014-09-25 15:25:45,365 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 4541346 : 0 2014-09-25 15:25:46,051 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 32, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000032_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,051 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,051 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003]] 2014-09-25 15:25:46,056 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000032_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,056 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 12798650 : 12798650 2014-09-25 15:25:46,060 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] decomp: 12798650 len: 12798654 to MEMORY 2014-09-25 15:25:46,254 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 33, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000033_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,255 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000138_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 35, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000035_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003]] 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003]] 2014-09-25 15:25:46,286 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000035_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,286 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 10228342 : 23026992 2014-09-25 15:25:46,288 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] decomp: 10228342 len: 10228346 to MEMORY 2014-09-25 15:25:46,303 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000033_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,303 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11624860 : 34651852 2014-09-25 15:25:46,305 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] decomp: 11624860 len: 11624864 to MEMORY 2014-09-25 15:25:46,602 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 12798650 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] 2014-09-25 15:25:46,603 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] to MEMORY, CompressedSize=12798654, DecompressedSize=12798650,EndTime=1411673146602, TimeTaken=546, Rate=22.35 MB/s 2014-09-25 15:25:46,603 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(35 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 3.25 MB/s) 2014-09-25 15:25:46,603 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 8 2014-09-25 15:25:46,864 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Received should die response from AM 2014-09-25 15:25:46,864 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Asked to die via task heartbeat 2014-09-25 15:25:46,864 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Interrupted while waiting for task to complete. Interrupting task 2014-09-25 15:25:46,864 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Shutdown requested... returning 2014-09-25 15:25:46,864 INFO [main] org.apache.tez.runtime.task.TezChild: Got a shouldDie notification via hearbeats. Shutting down 2014-09-25 15:25:46,930 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 12798650 : 21853202 2014-09-25 15:25:46,931 WARN [TezChild] org.apache.tez.runtime.library.common.readers.UnorderedKVReader: Interrupted while waiting for next available input java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219) at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:439) at org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput(ShuffleManager.java:621) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:176) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next(UnorderedKVReader.java:117) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:112) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:185) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:211) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1038) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:85) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70) at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:154) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:142) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2014-09-25 15:25:46,946 FATAL [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordSource: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.lang.InterruptedException at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:121) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.loadHashTable(MapJoinOperator.java:185) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.cleanUpInputFileChangedOp(MapJoinOperator.java:211) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1038) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.Operator.cleanUpInputFileChanged(Operator.java:1042) at org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:37) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:85) at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70) at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:272) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:154) at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:142) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:324) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:180) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:172) at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:167) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.io.IOException: java.lang.InterruptedException at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:179) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.next(UnorderedKVReader.java:117) at org.apache.hadoop.hive.ql.exec.tez.HashTableLoader.load(HashTableLoader.java:112) ... 25 more Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1219) at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:340) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:439) at org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager.getNextInput(ShuffleManager.java:621) at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:176) ... 27 more 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: 8 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: DESERIALIZE_ERRORS:0 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: 1 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: PASSED:0 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: FILTERED:0 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 2 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 2 Close done 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: 1 Close done 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 Close done 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: 8 Close done 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: 7 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: 3 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 4 finished. closing... 2014-09-25 15:25:46,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: 5 finished. closing... 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: 6 finished. closing... 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: 6 Close done 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: 5 Close done 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: 4 Close done 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: 3 Close done 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: 7 Close done 2014-09-25 15:25:46,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: TezProcessor: processed 0 rows/groups: used memory = 1386681432 2014-09-25 15:25:46,965 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping TezTask metrics system... 2014-09-25 15:25:46,966 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system stopped. 2014-09-25 15:25:46,966 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system shutdown complete. Container: container_1406566393272_6236_01_000243 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 0 Log Contents: LogType: stdout LogLength: 1521 Log Contents: 4.685: [GC [PSYoungGen: 159386K->25594K(204288K)] 159386K->25666K(2068480K), 0.0350790 secs] [Times: user=0.18 sys=0.02, real=0.03 secs] 7.519: [GC [PSYoungGen: 143927K->28667K(204288K)] 1192575K->1077484K(2068480K), 0.0300250 secs] [Times: user=0.18 sys=0.03, real=0.03 secs] 8.829: [GC [PSYoungGen: 125296K->28640K(204288K)] 1305185K->1259992K(2068480K), 0.0297210 secs] [Times: user=0.30 sys=0.05, real=0.03 secs] 11.352: [GC [PSYoungGen: 203439K->28654K(379904K)] 1434792K->1433521K(2244096K), 0.1078830 secs] [Times: user=0.86 sys=0.28, real=0.10 secs] Heap PSYoungGen total 379904K, used 60542K [0x00000007e5980000, 0x00000007fe880000, 0x0000000800000000) eden space 351232K, 9% used [0x00000007e5980000,0x00000007f20f29e0,0x00000007fb080000) lgrp 0 space 175616K, 1% used [0x00000007e5980000,0x00000007e5cb16e0,0x00000007f0500000) lgrp 1 space 175616K, 16% used [0x00000007f0500000,0x00000007f20f29e0,0x00000007fb080000) from space 28672K, 99% used [0x00000007fcc80000,0x00000007fe87ba88,0x00000007fe880000) to space 28672K, 0% used [0x00000007fb080000,0x00000007fb080000,0x00000007fcc80000) ParOldGen total 1864192K, used 1404867K [0x0000000712800000, 0x0000000784480000, 0x00000007e5980000) object space 1864192K, 75% used [0x0000000712800000,0x00000007683f0ce8,0x0000000784480000) PSPermGen total 29696K, used 29276K [0x000000070d600000, 0x000000070f300000, 0x0000000712800000) object space 29696K, 98% used [0x000000070d600000,0x000000070f2973c0,0x000000070f300000) LogType: syslog LogLength: 1114 Log Contents: 2014-09-25 15:25:36,659 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,578 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 27218, container_1406566393272_6236_01_000243 2014-09-25 15:25:37,691 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,833 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,833 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:38,048 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,717 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_22_000118_0 2014-09-25 15:25:38,717 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_22_000118_0 LogType: syslog_attempt_1406566393272_6236_1_22_000118_0 LogLength: 68993 Log Contents: 2014-09-25 15:25:38,726 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,726 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,727 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,749 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:38,996 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:39,461 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 19, VertexParallelism: 223, TaskAttemptID:attempt_1406566393272_6236_1_22_000118_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=2, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, {{ sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2014-09-25 15:25:39,466 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=2, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:39,507 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_22_000118_0 2014-09-25 15:25:39,507 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:39,507 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,543 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:39,543 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput } 2014-09-25 15:25:39,544 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,544 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput } 2014-09-25 15:25:39,544 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,546 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,546 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:39,546 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,555 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: Map 42 2014-09-25 15:25:39,556 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_sales 2014-09-25 15:25:39,559 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Reducer 20 2014-09-25 15:25:39,560 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_sales 2014-09-25 15:25:39,569 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1503238528, type: INPUT, componentVertexName: Map 42 2014-09-25 15:25:39,570 INFO [Initializer 2] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Requested SortBufferSize (io.sort.mb): 1024 2014-09-25 15:25:39,570 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:39,570 INFO [Initializer 2] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1073741824, type: OUTPUT, componentVertexName: Reducer 20 2014-09-25 15:25:39,570 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Reducer 20 2014-09-25 15:25:39,578 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: Map 42 2014-09-25 15:25:39,602 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:39,618 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:39,631 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 3 initializers to finish 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:39,662 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:39,662 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:39,662 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_sales 2014-09-25 15:25:39,663 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,672 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,686 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,687 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,687 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: UNSORTED_INPUT 2014-09-25 15:25:39,687 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 12, for type: SORTED_OUTPUT 2014-09-25 15:25:39,687 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.045, finalReserveFractionUsed=0.345 2014-09-25 15:25:39,688 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 3, numScaledRequests: 14, TotalRequested: 2576980352, TotalRequestedScaled: 1.0277243154285713E9, TotalJVMHeap: 3837263872, TotalAvailable: 2513407836, TotalRequested/TotalJVMHeap:0.67 2014-09-25 15:25:39,688 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_sales, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,688 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, Map 42, org.apache.tez.runtime.library.input.UnorderedKVInput: requested=1503238528, allocated=262594844 2014-09-25 15:25:39,688 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Reducer 20, org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput: requested=1073741824, allocated=1073741824 2014-09-25 15:25:39,689 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,690 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_sales being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,690 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_sales 2014-09-25 15:25:39,690 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_sales 2014-09-25 15:25:39,691 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: Map 42 being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,691 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: Map 42 2014-09-25 15:25:39,694 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 2 2014-09-25 15:25:39,694 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 IOs to start 2014-09-25 15:25:39,694 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,695 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: RequestedMem=1503238528, Allocated: 262594844 2014-09-25 15:25:39,696 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: SimpleInputManager -> MemoryLimit: 262594844, maxSingleMemLimit: 65648712 2014-09-25 15:25:39,711 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: ShuffleManager : numInputs=44, compressionCodec=NoCompressionCodec, numFetchers=30, ifileBufferSize=131072, ifileReadAheadEnabled=true, ifileReadAheadLength=4194304, keepAlive=false, keepAliveMaxConnections=20, connectionTimeout=180000, readTimeout=180000, bufferSize=8192, sslShuffle=false 2014-09-25 15:25:39,725 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: Map 42 2014-09-25 15:25:39,725 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,726 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_22_000118_0 2014-09-25 15:25:39,726 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,727 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_22_000118_0_10001 2014-09-25 15:25:39,908 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,908 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,794 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,794 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@5c9c0715 2014-09-25 15:25:40,798 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,799 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,799 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_sales, Map 42] 2014-09-25 15:25:40,800 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_sales 2014-09-25 15:25:40,800 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,811 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@514a4dab 2014-09-25 15:25:40,825 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,874 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,969 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:41,970 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451802/000225_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,080 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,081 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451802/000225_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 11790479, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,103 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,129 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451802/000225_0 2014-09-25 15:25:42,129 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@514a4dab 2014-09-25 15:25:42,131 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:42,138 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: keySerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@13bab1a1; valueSerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@45e3cb25; comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@6e2e0dfb; conf=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2014-09-25 15:25:42,143 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Instantiating Partitioner: [org.apache.tez.mapreduce.partition.MRPartitioner] 2014-09-25 15:25:42,144 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: Using partitioner class: org.apache.tez.mapreduce.partition.MRPartitioner 2014-09-25 15:25:42,146 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: No combiner specified via tez.runtime.combiner.class. Combiner will not be used 2014-09-25 15:25:42,320 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 40, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000040_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,162 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: tez.runtime.io.sort.mb = 1024 2014-09-25 15:25:43,165 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.remaining() = 1073741824 2014-09-25 15:25:43,165 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.size = 16777216 2014-09-25 15:25:43,165 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,165 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 41, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000041_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,170 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003]] 2014-09-25 15:25:43,171 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 19 2014-09-25 15:25:43,172 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 42, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000042_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,172 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003]] 2014-09-25 15:25:43,187 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,187 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 43, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000043_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,187 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003]] 2014-09-25 15:25:43,195 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,195 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003]] 2014-09-25 15:25:43,276 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 38, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000038_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,286 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,286 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003]] 2014-09-25 15:25:43,377 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000043_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,377 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000041_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,394 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000042_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,394 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000040_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,401 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 629820 : 629820 2014-09-25 15:25:43,400 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000038_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 677484 : 1307304 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] decomp: 629820 len: 629824 to MEMORY 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1357296 : 2664600 2014-09-25 15:25:43,417 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 309644 : 2974244 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] decomp: 677484 len: 677488 to MEMORY 2014-09-25 15:25:43,418 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] decomp: 309644 len: 309648 to MEMORY 2014-09-25 15:25:43,417 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] decomp: 1357296 len: 1357300 to MEMORY 2014-09-25 15:25:43,431 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1555518 : 4529762 2014-09-25 15:25:43,432 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] decomp: 1555518 len: 1555522 to MEMORY 2014-09-25 15:25:43,470 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 309644 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] 2014-09-25 15:25:43,471 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] to MEMORY, CompressedSize=309648, DecompressedSize=309644,EndTime=1411673143471, TimeTaken=68, Rate=4.34 MB/s 2014-09-25 15:25:43,471 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(43 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.07 MB/s) 2014-09-25 15:25:43,473 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 2 2014-09-25 15:25:43,491 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 677484 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] 2014-09-25 15:25:43,491 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] to MEMORY, CompressedSize=677488, DecompressedSize=677484,EndTime=1411673143491, TimeTaken=89, Rate=7.26 MB/s 2014-09-25 15:25:43,492 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(42 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.24 MB/s) 2014-09-25 15:25:43,492 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 4 2014-09-25 15:25:43,509 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1555518 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] 2014-09-25 15:25:43,509 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] to MEMORY, CompressedSize=1555522, DecompressedSize=1555518,EndTime=1411673143509, TimeTaken=132, Rate=11.24 MB/s 2014-09-25 15:25:43,509 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(41 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.61 MB/s) 2014-09-25 15:25:43,509 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 3 2014-09-25 15:25:43,535 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1357296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] 2014-09-25 15:25:43,535 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] to MEMORY, CompressedSize=1357300, DecompressedSize=1357296,EndTime=1411673143535, TimeTaken=133, Rate=9.73 MB/s 2014-09-25 15:25:43,535 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(40 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.93 MB/s) 2014-09-25 15:25:43,535 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 0 2014-09-25 15:25:43,558 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 629820 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] 2014-09-25 15:25:43,559 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] to MEMORY, CompressedSize=629824, DecompressedSize=629820,EndTime=1411673143559, TimeTaken=164, Rate=3.66 MB/s 2014-09-25 15:25:43,559 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(39 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.08 MB/s) 2014-09-25 15:25:43,559 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 1 2014-09-25 15:25:43,895 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 39, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000039_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,896 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,896 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003]] 2014-09-25 15:25:43,899 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000039_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,899 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1822690 : 6352452 2014-09-25 15:25:43,900 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] decomp: 1822690 len: 1822694 to MEMORY 2014-09-25 15:25:44,010 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1822690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] 2014-09-25 15:25:44,010 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] to MEMORY, CompressedSize=1822694, DecompressedSize=1822690,EndTime=1411673144010, TimeTaken=111, Rate=15.66 MB/s 2014-09-25 15:25:44,010 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(38 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.21 MB/s) 2014-09-25 15:25:44,010 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 5 2014-09-25 15:25:44,021 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:44,139 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =8 Id =0 Id =1 Id =2 Id =3 Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\RS> <\Children> Id = 4 null<\Parent> <\GBY> <\Children> Id = 3 null<\Parent> <\SEL> <\Children> Id = 2 nullId = 7 Id =7 null <\Children> <\Parent> <\HASHTABLEDUMMY><\Parent> <\MAPJOIN> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 8 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:44,145 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[8] 2014-09-25 15:25:44,146 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:44,146 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:44,146 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:44,146 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:44,146 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:44,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:44,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:44,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:44,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:44,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:44,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:44,174 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 8 MAP 2014-09-25 15:25:44,174 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[7] 2014-09-25 15:25:44,200 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Operator 7 HASHTABLEDUMMY initialized 2014-09-25 15:25:44,200 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing children of 7 HASHTABLEDUMMY 2014-09-25 15:25:44,200 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,200 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing Self MAPJOIN[3] 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: JOIN struct<_col0:int,_col2:float,_col5:float,_col6:float,_col7:float> totalsz = 5 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Operator 3 MAPJOIN initialized 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing children of 3 MAPJOIN 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 4 SEL 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[4] 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 4 SEL initialized 2014-09-25 15:25:44,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 4 SEL 2014-09-25 15:25:44,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing child 5 GBY 2014-09-25 15:25:44,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing Self GBY[5] 2014-09-25 15:25:44,223 WARN [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2014-09-25 15:25:44,229 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Operator 5 GBY initialized 2014-09-25 15:25:44,229 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing children of 5 GBY 2014-09-25 15:25:44,229 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 6 RS 2014-09-25 15:25:44,229 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[6] 2014-09-25 15:25:44,236 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = -1 2014-09-25 15:25:44,236 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 6 RS 2014-09-25 15:25:44,239 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: using hash aggregation processing mode 2014-09-25 15:25:44,239 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initialization Done 5 GBY 2014-09-25 15:25:44,239 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 4 SEL 2014-09-25 15:25:44,242 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Try to retrieve from cache 2014-09-25 15:25:44,242 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Did not find tables in cache 2014-09-25 15:25:44,246 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initialization Done 3 MAPJOIN 2014-09-25 15:25:44,246 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initialization Done 7 HASHTABLEDUMMY 2014-09-25 15:25:44,248 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[6] --> Reducer 20 2014-09-25 15:25:44,248 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,308 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_sales for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451802 2014-09-25 15:25:44,312 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,319 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper: Key count from statistics is 7199721; setting map size to 9599628 2014-09-25 15:25:44,405 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 37, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000037_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,438 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,438 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003]] 2014-09-25 15:25:44,443 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe 2014-09-25 15:25:44,446 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Tag found in keys and will be removed. This should not happen. 2014-09-25 15:25:44,450 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000037_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,450 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 3583040 : 9935492 2014-09-25 15:25:44,451 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] decomp: 3583040 len: 3583044 to MEMORY 2014-09-25 15:25:44,625 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 3583040 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] 2014-09-25 15:25:44,625 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] to MEMORY, CompressedSize=3583044, DecompressedSize=3583040,EndTime=1411673144625, TimeTaken=175, Rate=19.53 MB/s 2014-09-25 15:25:44,625 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(37 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.90 MB/s) 2014-09-25 15:25:44,625 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 6 2014-09-25 15:25:44,657 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 309644 : 9625848 2014-09-25 15:25:44,709 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 36, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000036_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,709 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,709 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003]] 2014-09-25 15:25:44,716 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000036_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,717 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 4541346 : 14167194 2014-09-25 15:25:44,717 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] decomp: 4541346 len: 4541350 to MEMORY 2014-09-25 15:25:44,838 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 677484 : 13489710 2014-09-25 15:25:44,927 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1555518 : 11934192 2014-09-25 15:25:44,963 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1357296 : 10576896 2014-09-25 15:25:44,980 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 629820 : 9947076 2014-09-25 15:25:45,024 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1822690 : 8124386 2014-09-25 15:25:45,140 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 3583040 : 4541346 2014-09-25 15:25:45,198 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 4541346 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] 2014-09-25 15:25:45,199 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] to MEMORY, CompressedSize=4541350, DecompressedSize=4541346,EndTime=1411673145199, TimeTaken=482, Rate=8.99 MB/s 2014-09-25 15:25:45,199 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(36 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.30 MB/s) 2014-09-25 15:25:45,199 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 7 2014-09-25 15:25:45,336 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 4541346 : 0 2014-09-25 15:25:46,051 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 32, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000032_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,052 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,052 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003]] 2014-09-25 15:25:46,057 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000032_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,057 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 12798650 : 12798650 2014-09-25 15:25:46,059 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] decomp: 12798650 len: 12798654 to MEMORY 2014-09-25 15:25:46,255 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 33, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000033_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,255 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 35, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000035_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003]] 2014-09-25 15:25:46,256 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,256 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003]] 2014-09-25 15:25:46,280 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000035_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,280 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 10228342 : 23026992 2014-09-25 15:25:46,282 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] decomp: 10228342 len: 10228346 to MEMORY 2014-09-25 15:25:46,313 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000033_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,314 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11624860 : 34651852 2014-09-25 15:25:46,316 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] decomp: 11624860 len: 11624864 to MEMORY 2014-09-25 15:25:46,652 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11624860 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] 2014-09-25 15:25:46,653 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] to MEMORY, CompressedSize=11624864, DecompressedSize=11624860,EndTime=1411673146653, TimeTaken=339, Rate=32.70 MB/s 2014-09-25 15:25:46,653 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(35 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 3.56 MB/s) 2014-09-25 15:25:46,653 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 9 2014-09-25 15:25:46,864 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 34, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000034_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,864 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,865 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002]] 2014-09-25 15:25:46,869 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000034_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,869 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11982854 : 46634706 2014-09-25 15:25:46,873 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] decomp: 11982854 len: 11982858 to MEMORY 2014-09-25 15:25:46,962 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11624860 : 35009846 2014-09-25 15:25:47,081 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 10228342 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] 2014-09-25 15:25:47,081 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] to MEMORY, CompressedSize=10228346, DecompressedSize=10228342,EndTime=1411673147081, TimeTaken=801, Rate=12.18 MB/s 2014-09-25 15:25:47,081 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(34 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 4.33 MB/s) 2014-09-25 15:25:47,082 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 10 2014-09-25 15:25:47,168 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 11, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn111-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000011_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,168 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn111-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,168 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn111-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003]] 2014-09-25 15:25:47,182 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000011_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,183 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21492158 : 56502004 2014-09-25 15:25:47,187 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] decomp: 21492158 len: 21492162 to MEMORY 2014-09-25 15:25:47,313 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 10228342 : 46273662 2014-09-25 15:25:47,437 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 12798650 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] 2014-09-25 15:25:47,438 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] to MEMORY, CompressedSize=12798654, DecompressedSize=12798650,EndTime=1411673147437, TimeTaken=1380, Rate=8.84 MB/s 2014-09-25 15:25:47,438 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(33 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 5.86 MB/s) 2014-09-25 15:25:47,438 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 8 2014-09-25 15:25:47,473 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 15, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn119-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000015_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,473 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn119-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,473 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn119-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003]] 2014-09-25 15:25:47,477 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000015_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,477 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21462624 : 67736286 2014-09-25 15:25:47,485 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] decomp: 21462624 len: 21462628 to MEMORY 2014-09-25 15:25:47,575 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000118_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 7, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000007_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,575 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,576 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002]] 2014-09-25 15:25:47,592 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000007_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,592 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21726070 : 89462356 2014-09-25 15:25:47,718 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002] decomp: 21726070 len: 21726074 to MEMORY 2014-09-25 15:25:47,721 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Received should die response from AM 2014-09-25 15:25:47,721 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Asked to die via task heartbeat 2014-09-25 15:25:47,722 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Interrupted while waiting for task to complete. Interrupting task 2014-09-25 15:25:47,722 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Shutdown requested... returning 2014-09-25 15:25:47,722 INFO [main] org.apache.tez.runtime.task.TezChild: Got a shouldDie notification via hearbeats. Shutting down 2014-09-25 15:25:47,823 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping TezTask metrics system... 2014-09-25 15:25:47,824 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system stopped. 2014-09-25 15:25:47,824 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system shutdown complete. Container: container_1406566393272_6236_01_000241 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 0 Log Contents: LogType: stdout LogLength: 1880 Log Contents: 3.675: [GC [PSYoungGen: 121317K->16690K(204288K)] 121317K->16762K(2068480K), 0.0263790 secs] [Times: user=0.12 sys=0.02, real=0.03 secs] 5.246: [GC [PSYoungGen: 108028K->28667K(204288K)] 108100K->30011K(2068480K), 0.0383050 secs] [Times: user=0.30 sys=0.03, real=0.03 secs] 7.111: [GC [PSYoungGen: 121175K->27941K(204288K)] 1171096K->1077870K(2068480K), 0.0527920 secs] [Times: user=0.28 sys=0.02, real=0.05 secs] 9.887: [GC [PSYoungGen: 110666K->28643K(379904K)] 1291666K->1263954K(2244096K), 0.0493820 secs] [Times: user=0.34 sys=0.11, real=0.04 secs] 11.710: [GC [PSYoungGen: 262769K->28657K(379904K)] 1498080K->1495838K(2244096K), 0.1462580 secs] [Times: user=0.76 sys=0.31, real=0.14 secs] 11.857: [Full GC [PSYoungGen: 28657K->0K(379904K)] [ParOldGen: 1467181K->1402613K(2074112K)] 1495838K->1402613K(2454016K) [PSPermGen: 29289K->29267K(58880K)], 0.2549670 secs] [Times: user=0.63 sys=0.06, real=0.25 secs] Heap PSYoungGen total 379904K, used 192084K [0x00000007e5980000, 0x0000000800000000, 0x0000000800000000) eden space 351232K, 54% used [0x00000007e5980000,0x00000007f8d13718,0x00000007fb080000) lgrp 0 space 292416K, 57% used [0x00000007e5980000,0x00000007eff11bd0,0x00000007f7710000) lgrp 1 space 58816K, 38% used [0x00000007f7710000,0x00000007f8d13718,0x00000007fb080000) from space 28672K, 0% used [0x00000007fb080000,0x00000007fb080000,0x00000007fcc80000) to space 52736K, 0% used [0x00000007fcc80000,0x00000007fcc80000,0x0000000800000000) ParOldGen total 2074112K, used 1402613K [0x0000000712800000, 0x0000000791180000, 0x00000007e5980000) object space 2074112K, 67% used [0x0000000712800000,0x00000007681bd670,0x0000000791180000) PSPermGen total 58880K, used 29372K [0x000000070d600000, 0x0000000710f80000, 0x0000000712800000) object space 58880K, 49% used [0x000000070d600000,0x000000070f2af0a8,0x0000000710f80000) LogType: syslog LogLength: 1114 Log Contents: 2014-09-25 15:25:36,707 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,511 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 27205, container_1406566393272_6236_01_000241 2014-09-25 15:25:37,649 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,808 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,809 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:38,069 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,729 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_22_000098_0 2014-09-25 15:25:38,730 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_22_000098_0 LogType: syslog_attempt_1406566393272_6236_1_22_000098_0 LogLength: 95660 Log Contents: 2014-09-25 15:25:38,740 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,740 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,740 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,746 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:38,988 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:39,400 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 19, VertexParallelism: 223, TaskAttemptID:attempt_1406566393272_6236_1_22_000098_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=2, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, {{ sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2014-09-25 15:25:39,406 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=2, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:39,432 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_22_000098_0 2014-09-25 15:25:39,433 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:39,433 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,458 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:39,458 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput } 2014-09-25 15:25:39,460 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,460 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput } 2014-09-25 15:25:39,460 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,462 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,462 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:39,463 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,473 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: Map 42 2014-09-25 15:25:39,473 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_sales 2014-09-25 15:25:39,473 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Reducer 20 2014-09-25 15:25:39,475 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_sales 2014-09-25 15:25:39,494 INFO [Initializer 2] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Requested SortBufferSize (io.sort.mb): 1024 2014-09-25 15:25:39,494 INFO [Initializer 2] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1073741824, type: OUTPUT, componentVertexName: Reducer 20 2014-09-25 15:25:39,494 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Reducer 20 2014-09-25 15:25:39,495 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1503238528, type: INPUT, componentVertexName: Map 42 2014-09-25 15:25:39,496 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:39,504 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: Map 42 2014-09-25 15:25:39,512 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:39,526 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:39,538 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:39,539 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:39,539 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,539 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,539 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 3 initializers to finish 2014-09-25 15:25:39,539 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:39,539 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:39,569 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:39,569 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:39,569 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_sales 2014-09-25 15:25:39,569 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,581 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,601 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,602 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,602 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 12, for type: SORTED_OUTPUT 2014-09-25 15:25:39,602 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: UNSORTED_INPUT 2014-09-25 15:25:39,602 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.045, finalReserveFractionUsed=0.345 2014-09-25 15:25:39,603 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 3, numScaledRequests: 14, TotalRequested: 2576980352, TotalRequestedScaled: 1.0277243154285713E9, TotalJVMHeap: 3837263872, TotalAvailable: 2513407836, TotalRequested/TotalJVMHeap:0.67 2014-09-25 15:25:39,603 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_sales, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,603 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Reducer 20, org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput: requested=1073741824, allocated=1073741824 2014-09-25 15:25:39,603 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, Map 42, org.apache.tez.runtime.library.input.UnorderedKVInput: requested=1503238528, allocated=262594844 2014-09-25 15:25:39,603 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,605 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_sales being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,605 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_sales 2014-09-25 15:25:39,605 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_sales 2014-09-25 15:25:39,606 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: Map 42 being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,606 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: Map 42 2014-09-25 15:25:39,606 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 2 2014-09-25 15:25:39,606 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 IOs to start 2014-09-25 15:25:39,606 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,610 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: RequestedMem=1503238528, Allocated: 262594844 2014-09-25 15:25:39,610 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: SimpleInputManager -> MemoryLimit: 262594844, maxSingleMemLimit: 65648712 2014-09-25 15:25:39,623 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: ShuffleManager : numInputs=44, compressionCodec=NoCompressionCodec, numFetchers=30, ifileBufferSize=131072, ifileReadAheadEnabled=true, ifileReadAheadLength=4194304, keepAlive=false, keepAliveMaxConnections=20, connectionTimeout=180000, readTimeout=180000, bufferSize=8192, sslShuffle=false 2014-09-25 15:25:39,638 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: Map 42 2014-09-25 15:25:39,638 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,642 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_22_000098_0 2014-09-25 15:25:39,642 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,642 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_22_000098_0_10001 2014-09-25 15:25:39,794 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,794 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,492 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,493 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@7b78ce2d 2014-09-25 15:25:40,497 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,498 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,498 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_sales, Map 42] 2014-09-25 15:25:40,499 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_sales 2014-09-25 15:25:40,499 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,512 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@2081bc03 2014-09-25 15:25:40,526 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,441 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,558 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:41,559 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451543/000208_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:41,683 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,683 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451543/000208_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 17931433, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:41,702 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,725 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451543/000208_0 2014-09-25 15:25:41,725 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@2081bc03 2014-09-25 15:25:41,727 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:41,731 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: keySerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@1a82bd28; valueSerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@7d509ab0; comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@36dbd916; conf=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2014-09-25 15:25:41,734 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Instantiating Partitioner: [org.apache.tez.mapreduce.partition.MRPartitioner] 2014-09-25 15:25:41,736 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: Using partitioner class: org.apache.tez.mapreduce.partition.MRPartitioner 2014-09-25 15:25:41,737 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: No combiner specified via tez.runtime.combiner.class. Combiner will not be used 2014-09-25 15:25:42,247 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 40, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000040_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,674 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: tez.runtime.io.sort.mb = 1024 2014-09-25 15:25:42,677 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 41, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000041_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,677 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,678 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.remaining() = 1073741824 2014-09-25 15:25:42,678 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.size = 16777216 2014-09-25 15:25:42,682 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 19 2014-09-25 15:25:42,683 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003]] 2014-09-25 15:25:42,685 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,685 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 42, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000042_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:42,685 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003]] 2014-09-25 15:25:42,686 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:42,687 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003]] 2014-09-25 15:25:42,921 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000042_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:42,921 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000040_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:42,921 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000041_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:42,922 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 629820 : 629820 2014-09-25 15:25:42,925 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1357296 : 1987116 2014-09-25 15:25:42,925 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] decomp: 629820 len: 629824 to MEMORY 2014-09-25 15:25:42,925 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 309644 : 2296760 2014-09-25 15:25:42,925 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] decomp: 1357296 len: 1357300 to MEMORY 2014-09-25 15:25:42,926 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] decomp: 309644 len: 309648 to MEMORY 2014-09-25 15:25:43,003 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 309644 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] 2014-09-25 15:25:43,011 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] to MEMORY, CompressedSize=309648, DecompressedSize=309644,EndTime=1411673143011, TimeTaken=89, Rate=3.32 MB/s 2014-09-25 15:25:43,012 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(43 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.07 MB/s) 2014-09-25 15:25:43,013 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 2 2014-09-25 15:25:43,055 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 629820 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] 2014-09-25 15:25:43,056 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] to MEMORY, CompressedSize=629824, DecompressedSize=629820,EndTime=1411673143056, TimeTaken=135, Rate=4.45 MB/s 2014-09-25 15:25:43,056 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(42 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.22 MB/s) 2014-09-25 15:25:43,056 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 1 2014-09-25 15:25:43,090 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1357296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] 2014-09-25 15:25:43,091 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] to MEMORY, CompressedSize=1357300, DecompressedSize=1357296,EndTime=1411673143091, TimeTaken=170, Rate=7.61 MB/s 2014-09-25 15:25:43,091 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(41 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.55 MB/s) 2014-09-25 15:25:43,091 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 0 2014-09-25 15:25:43,192 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 43, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000043_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,192 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,193 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003]] 2014-09-25 15:25:43,198 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000043_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,199 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1555518 : 3852278 2014-09-25 15:25:43,199 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] decomp: 1555518 len: 1555522 to MEMORY 2014-09-25 15:25:43,234 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1555518 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] 2014-09-25 15:25:43,234 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] to MEMORY, CompressedSize=1555522, DecompressedSize=1555518,EndTime=1411673143234, TimeTaken=36, Rate=41.21 MB/s 2014-09-25 15:25:43,234 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(40 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.92 MB/s) 2014-09-25 15:25:43,234 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 3 2014-09-25 15:25:43,294 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 38, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000038_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,295 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,295 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003]] 2014-09-25 15:25:43,299 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000038_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,299 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 677484 : 4529762 2014-09-25 15:25:43,300 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] decomp: 677484 len: 677488 to MEMORY 2014-09-25 15:25:43,307 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 677484 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] 2014-09-25 15:25:43,307 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] to MEMORY, CompressedSize=677488, DecompressedSize=677484,EndTime=1411673143307, TimeTaken=8, Rate=80.76 MB/s 2014-09-25 15:25:43,307 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(39 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.08 MB/s) 2014-09-25 15:25:43,307 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 4 2014-09-25 15:25:43,417 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:43,591 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =8 Id =0 Id =1 Id =2 Id =3 Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\RS> <\Children> Id = 4 null<\Parent> <\GBY> <\Children> Id = 3 null<\Parent> <\SEL> <\Children> Id = 2 nullId = 7 Id =7 null <\Children> <\Parent> <\HASHTABLEDUMMY><\Parent> <\MAPJOIN> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 8 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:43,596 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[8] 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:43,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:43,598 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:43,598 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:43,603 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:43,604 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:43,604 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:43,623 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 8 MAP 2014-09-25 15:25:43,623 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[7] 2014-09-25 15:25:43,644 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Operator 7 HASHTABLEDUMMY initialized 2014-09-25 15:25:43,644 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing children of 7 HASHTABLEDUMMY 2014-09-25 15:25:43,644 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:43,644 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing Self MAPJOIN[3] 2014-09-25 15:25:43,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: JOIN struct<_col0:int,_col2:float,_col5:float,_col6:float,_col7:float> totalsz = 5 2014-09-25 15:25:43,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Operator 3 MAPJOIN initialized 2014-09-25 15:25:43,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing children of 3 MAPJOIN 2014-09-25 15:25:43,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 4 SEL 2014-09-25 15:25:43,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[4] 2014-09-25 15:25:43,656 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 4 SEL initialized 2014-09-25 15:25:43,656 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 4 SEL 2014-09-25 15:25:43,656 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing child 5 GBY 2014-09-25 15:25:43,656 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing Self GBY[5] 2014-09-25 15:25:43,664 WARN [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2014-09-25 15:25:43,669 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Operator 5 GBY initialized 2014-09-25 15:25:43,669 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing children of 5 GBY 2014-09-25 15:25:43,669 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 6 RS 2014-09-25 15:25:43,669 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[6] 2014-09-25 15:25:43,675 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = -1 2014-09-25 15:25:43,675 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 6 RS 2014-09-25 15:25:43,678 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: using hash aggregation processing mode 2014-09-25 15:25:43,678 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initialization Done 5 GBY 2014-09-25 15:25:43,678 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 4 SEL 2014-09-25 15:25:43,680 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Try to retrieve from cache 2014-09-25 15:25:43,680 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Did not find tables in cache 2014-09-25 15:25:43,684 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initialization Done 3 MAPJOIN 2014-09-25 15:25:43,684 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initialization Done 7 HASHTABLEDUMMY 2014-09-25 15:25:43,685 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[6] --> Reducer 20 2014-09-25 15:25:43,685 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:43,726 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_sales for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451543 2014-09-25 15:25:43,729 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:43,734 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper: Key count from statistics is 7199721; setting map size to 9599628 2014-09-25 15:25:43,857 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe 2014-09-25 15:25:43,859 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Tag found in keys and will be removed. This should not happen. 2014-09-25 15:25:43,903 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 39, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000039_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,903 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,903 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003]] 2014-09-25 15:25:43,917 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000039_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,917 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1822690 : 6352452 2014-09-25 15:25:43,917 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] decomp: 1822690 len: 1822694 to MEMORY 2014-09-25 15:25:43,994 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1822690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] 2014-09-25 15:25:43,994 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] to MEMORY, CompressedSize=1822694, DecompressedSize=1822690,EndTime=1411673143994, TimeTaken=77, Rate=22.57 MB/s 2014-09-25 15:25:43,995 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(38 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.21 MB/s) 2014-09-25 15:25:43,995 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 5 2014-09-25 15:25:44,096 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 309644 : 6042808 2014-09-25 15:25:44,229 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 629820 : 5412988 2014-09-25 15:25:44,322 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1357296 : 4055692 2014-09-25 15:25:44,366 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1555518 : 2500174 2014-09-25 15:25:44,382 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 677484 : 1822690 2014-09-25 15:25:44,410 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 37, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000037_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,410 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,410 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003]] 2014-09-25 15:25:44,415 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000037_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,415 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 3583040 : 5405730 2014-09-25 15:25:44,416 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] decomp: 3583040 len: 3583044 to MEMORY 2014-09-25 15:25:44,423 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1822690 : 3583040 2014-09-25 15:25:44,597 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 3583040 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] 2014-09-25 15:25:44,597 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] to MEMORY, CompressedSize=3583044, DecompressedSize=3583040,EndTime=1411673144597, TimeTaken=182, Rate=18.78 MB/s 2014-09-25 15:25:44,597 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(37 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.90 MB/s) 2014-09-25 15:25:44,597 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 6 2014-09-25 15:25:44,689 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 3583040 : 0 2014-09-25 15:25:44,718 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 36, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000036_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,719 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,719 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003]] 2014-09-25 15:25:44,734 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000036_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,735 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 4541346 : 4541346 2014-09-25 15:25:44,737 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] decomp: 4541346 len: 4541350 to MEMORY 2014-09-25 15:25:45,050 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 4541346 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] 2014-09-25 15:25:45,050 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] to MEMORY, CompressedSize=4541350, DecompressedSize=4541346,EndTime=1411673145050, TimeTaken=315, Rate=13.75 MB/s 2014-09-25 15:25:45,050 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(36 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.30 MB/s) 2014-09-25 15:25:45,050 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 7 2014-09-25 15:25:45,165 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 4541346 : 0 2014-09-25 15:25:46,055 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 32, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000032_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,055 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,055 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003]] 2014-09-25 15:25:46,112 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000032_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,112 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 12798650 : 12798650 2014-09-25 15:25:46,164 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] decomp: 12798650 len: 12798654 to MEMORY 2014-09-25 15:25:46,280 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 33, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000033_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,280 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 35, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000035_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,280 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,280 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003]] 2014-09-25 15:25:46,281 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,281 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003]] 2014-09-25 15:25:46,355 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000035_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,355 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 10228342 : 23026992 2014-09-25 15:25:46,357 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] decomp: 10228342 len: 10228346 to MEMORY 2014-09-25 15:25:46,358 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000033_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,358 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11624860 : 34651852 2014-09-25 15:25:46,360 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] decomp: 11624860 len: 11624864 to MEMORY 2014-09-25 15:25:46,887 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 34, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000034_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,887 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,887 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002]] 2014-09-25 15:25:46,959 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11624860 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] 2014-09-25 15:25:46,959 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] to MEMORY, CompressedSize=11624864, DecompressedSize=11624860,EndTime=1411673146959, TimeTaken=601, Rate=18.45 MB/s 2014-09-25 15:25:46,960 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(35 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 3.11 MB/s) 2014-09-25 15:25:46,960 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 9 2014-09-25 15:25:47,008 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000034_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,008 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11982854 : 46634706 2014-09-25 15:25:47,010 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] decomp: 11982854 len: 11982858 to MEMORY 2014-09-25 15:25:47,090 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 11, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn111-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000011_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,090 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn111-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,090 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn111-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003]] 2014-09-25 15:25:47,095 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000011_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,095 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21492158 : 68126864 2014-09-25 15:25:47,099 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] decomp: 21492158 len: 21492162 to MEMORY 2014-09-25 15:25:47,157 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 10228342 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] 2014-09-25 15:25:47,157 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] to MEMORY, CompressedSize=10228346, DecompressedSize=10228342,EndTime=1411673147157, TimeTaken=802, Rate=12.16 MB/s 2014-09-25 15:25:47,157 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(34 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 4.33 MB/s) 2014-09-25 15:25:47,157 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 10 2014-09-25 15:25:47,210 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11624860 : 56502004 2014-09-25 15:25:47,429 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 10228342 : 46273662 2014-09-25 15:25:47,494 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 15, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn119-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000015_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,495 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn119-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,495 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn119-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003]] 2014-09-25 15:25:47,596 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000015_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,597 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21462624 : 67736286 2014-09-25 15:25:47,599 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 7, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000007_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,600 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,600 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002]] 2014-09-25 15:25:47,611 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000007_0_10002 sent hash and receievd reply 3 ms 2014-09-25 15:25:47,618 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] decomp: 21462624 len: 21462628 to MEMORY 2014-09-25 15:25:47,619 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21726070 : 89462356 2014-09-25 15:25:47,639 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002] decomp: 21726070 len: 21726074 to MEMORY 2014-09-25 15:25:47,750 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 12798650 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] 2014-09-25 15:25:47,751 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] to MEMORY, CompressedSize=12798654, DecompressedSize=12798650,EndTime=1411673147750, TimeTaken=1638, Rate=7.45 MB/s 2014-09-25 15:25:47,751 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(33 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 5.21 MB/s) 2014-09-25 15:25:47,751 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 8 2014-09-25 15:25:47,805 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 31, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn117-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000031_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,805 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 9, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000009_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,805 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn117-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,806 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn117-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003]] 2014-09-25 15:25:47,810 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,810 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002]] 2014-09-25 15:25:47,818 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000009_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,818 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21487146 : 110949502 2014-09-25 15:25:47,820 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000031_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,847 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 14226648 : 125176150 2014-09-25 15:25:47,847 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] decomp: 21487146 len: 21487150 to MEMORY 2014-09-25 15:25:47,860 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] decomp: 14226648 len: 14226652 to MEMORY 2014-09-25 15:25:47,907 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 8, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000008_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,907 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,907 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 26, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000026_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,908 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003]] 2014-09-25 15:25:47,908 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,908 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003]] 2014-09-25 15:25:47,914 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000008_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,915 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21409352 : 146585502 2014-09-25 15:25:47,933 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003] decomp: 21409352 len: 21409356 to MEMORY 2014-09-25 15:25:48,339 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000026_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,340 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21650394 : 168235896 2014-09-25 15:25:48,342 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 27, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000027_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,342 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 23, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000023_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,342 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,342 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003]] 2014-09-25 15:25:48,343 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,343 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 13, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000013_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,343 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003]] 2014-09-25 15:25:48,344 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,344 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003]] 2014-09-25 15:25:48,348 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000023_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,350 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000013_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,360 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21335172 : 189571068 2014-09-25 15:25:48,360 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003] decomp: 21650394 len: 21650398 to MEMORY 2014-09-25 15:25:48,363 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000027_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,364 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21550870 : 211121938 2014-09-25 15:25:48,364 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003] decomp: 21335172 len: 21335176 to MEMORY 2014-09-25 15:25:48,367 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003] decomp: 21550870 len: 21550874 to MEMORY 2014-09-25 15:25:48,367 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21563834 : 232685772 2014-09-25 15:25:48,371 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003] decomp: 21563834 len: 21563838 to MEMORY 2014-09-25 15:25:48,389 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11982854 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] 2014-09-25 15:25:48,389 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] to MEMORY, CompressedSize=11982858, DecompressedSize=11982854,EndTime=1411673148389, TimeTaken=1381, Rate=8.27 MB/s 2014-09-25 15:25:48,389 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(32 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 6.48 MB/s) 2014-09-25 15:25:48,390 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 11 2014-09-25 15:25:48,535 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 12798650 : 219887122 2014-09-25 15:25:48,546 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 2, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000002_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,547 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,547 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 18, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn109-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000018_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,547 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003]] 2014-09-25 15:25:48,549 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn109-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,549 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 22, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000022_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,549 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn109-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002]] 2014-09-25 15:25:48,550 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,550 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 17, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000017_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,550 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003]] 2014-09-25 15:25:48,550 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,551 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003]] 2014-09-25 15:25:48,553 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000002_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,554 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21829100 : 241716222 2014-09-25 15:25:48,554 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000018_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,555 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000017_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,559 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000022_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,561 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003] decomp: 21829100 len: 21829104 to MEMORY 2014-09-25 15:25:48,578 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21492158 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] 2014-09-25 15:25:48,582 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] decomp: 21656508 len: 21656512 to DISK 2014-09-25 15:25:48,585 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002] decomp: 21427646 len: 21427650 to DISK 2014-09-25 15:25:48,585 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] to MEMORY, CompressedSize=21492162, DecompressedSize=21492158,EndTime=1411673148585, TimeTaken=1483, Rate=13.82 MB/s 2014-09-25 15:25:48,586 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(31 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 8.75 MB/s) 2014-09-25 15:25:48,586 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 12 2014-09-25 15:25:48,586 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003] decomp: 21741640 len: 21741644 to DISK 2014-09-25 15:25:48,649 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 10, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn108-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000010_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,649 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn108-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,649 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn108-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003]] 2014-09-25 15:25:48,661 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000010_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,663 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003] decomp: 21678686 len: 21678690 to DISK 2014-09-25 15:25:48,857 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000098_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 25, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000025_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,857 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,858 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003]] 2014-09-25 15:25:48,877 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000025_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,878 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003] decomp: 21512292 len: 21512296 to DISK 2014-09-25 15:25:48,923 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11982854 : 229733368 2014-09-25 15:25:49,082 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 14226648 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] 2014-09-25 15:25:49,082 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] to MEMORY, CompressedSize=14226652, DecompressedSize=14226648,EndTime=1411673149082, TimeTaken=1262, Rate=10.75 MB/s 2014-09-25 15:25:49,082 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(30 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 9.23 MB/s) 2014-09-25 15:25:49,083 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 15 2014-09-25 15:25:49,131 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21656512 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] 2014-09-25 15:25:49,133 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] to DISK, CompressedSize=21656512, DecompressedSize=21656508,EndTime=1411673149133, TimeTaken=575, Rate=35.92 MB/s 2014-09-25 15:25:49,133 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(29 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 11.30 MB/s) 2014-09-25 15:25:49,133 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 25 2014-09-25 15:25:49,161 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Received should die response from AM 2014-09-25 15:25:49,161 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Asked to die via task heartbeat 2014-09-25 15:25:49,161 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Interrupted while waiting for task to complete. Interrupting task 2014-09-25 15:25:49,161 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Shutdown requested... returning 2014-09-25 15:25:49,161 INFO [main] org.apache.tez.runtime.task.TezChild: Got a shouldDie notification via hearbeats. Shutting down 2014-09-25 15:25:49,262 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping TezTask metrics system... 2014-09-25 15:25:49,263 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system stopped. 2014-09-25 15:25:49,263 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system shutdown complete. Container: container_1406566393272_6236_01_000244 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 0 Log Contents: LogType: stdout LogLength: 1885 Log Contents: 4.447: [GC [PSYoungGen: 149016K->21993K(204288K)] 149016K->22065K(2068480K), 0.0543750 secs] [Times: user=0.31 sys=0.02, real=0.06 secs] 6.996: [GC [PSYoungGen: 115656K->26619K(379904K)] 1164305K->1075275K(2244096K), 0.0952830 secs] [Times: user=0.49 sys=0.07, real=0.10 secs] 7.998: [GC [PSYoungGen: 135499K->28666K(379904K)] 1184155K->1083743K(2244096K), 0.0602300 secs] [Times: user=0.35 sys=0.04, real=0.06 secs] 10.046: [GC [PSYoungGen: 235760K->28643K(403968K)] 1290837K->1284853K(2268160K), 0.4284760 secs] [Times: user=3.16 sys=0.30, real=0.43 secs] 12.156: [GC [PSYoungGen: 317115K->28663K(403968K)] 1573324K->1574229K(2268160K), 0.1530560 secs] [Times: user=1.31 sys=0.43, real=0.16 secs] 12.309: [Full GC [PSYoungGen: 28663K->0K(403968K)] [ParOldGen: 1545566K->1474319K(2217472K)] 1574229K->1474319K(2621440K) [PSPermGen: 29260K->29241K(58880K)], 0.4225820 secs] [Times: user=2.76 sys=0.13, real=0.42 secs] Heap PSYoungGen total 403968K, used 105273K [0x00000007e5980000, 0x0000000800000000, 0x0000000800000000) eden space 375296K, 28% used [0x00000007e5980000,0x00000007f4f31e58,0x00000007fc800000) lgrp 0 space 175732K, 16% used [0x00000007e5980000,0x00000007e76396a0,0x00000007f051d000) lgrp 1 space 199564K, 38% used [0x00000007f051d000,0x00000007f4f31e58,0x00000007fc800000) from space 28672K, 0% used [0x00000007fc800000,0x00000007fc800000,0x00000007fe400000) to space 28672K, 0% used [0x00000007fe400000,0x00000007fe400000,0x0000000800000000) ParOldGen total 2217472K, used 1474319K [0x0000000712800000, 0x0000000799d80000, 0x00000007e5980000) object space 2217472K, 66% used [0x0000000712800000,0x000000076c7c3c38,0x0000000799d80000) PSPermGen total 58880K, used 29341K [0x000000070d600000, 0x0000000710f80000, 0x0000000712800000) object space 58880K, 49% used [0x000000070d600000,0x000000070f2a7528,0x0000000710f80000) LogType: syslog LogLength: 1114 Log Contents: 2014-09-25 15:25:36,721 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,658 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 27208, container_1406566393272_6236_01_000244 2014-09-25 15:25:37,799 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,959 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,959 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:38,190 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,809 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_22_000078_0 2014-09-25 15:25:38,810 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_22_000078_0 LogType: syslog_attempt_1406566393272_6236_1_22_000078_0 LogLength: 99912 Log Contents: 2014-09-25 15:25:38,818 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,819 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,819 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,829 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:39,117 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:39,500 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 19, VertexParallelism: 223, TaskAttemptID:attempt_1406566393272_6236_1_22_000078_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=2, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, {{ sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2014-09-25 15:25:39,503 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=2, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:39,525 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_22_000078_0 2014-09-25 15:25:39,525 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:39,525 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,557 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:39,558 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput } 2014-09-25 15:25:39,559 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,559 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput } 2014-09-25 15:25:39,559 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,560 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,560 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,561 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:39,571 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: Map 42 2014-09-25 15:25:39,571 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_sales 2014-09-25 15:25:39,572 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Reducer 20 2014-09-25 15:25:39,574 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_sales 2014-09-25 15:25:39,582 INFO [Initializer 2] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Requested SortBufferSize (io.sort.mb): 1024 2014-09-25 15:25:39,583 INFO [Initializer 2] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1073741824, type: OUTPUT, componentVertexName: Reducer 20 2014-09-25 15:25:39,583 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Reducer 20 2014-09-25 15:25:39,584 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1503238528, type: INPUT, componentVertexName: Map 42 2014-09-25 15:25:39,585 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:39,591 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: Map 42 2014-09-25 15:25:39,610 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:39,621 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 3 initializers to finish 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:39,674 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:39,674 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:39,674 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_sales 2014-09-25 15:25:39,674 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,686 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,704 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,705 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,705 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 12, for type: SORTED_OUTPUT 2014-09-25 15:25:39,705 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: UNSORTED_INPUT 2014-09-25 15:25:39,705 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.045, finalReserveFractionUsed=0.345 2014-09-25 15:25:39,706 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 3, numScaledRequests: 14, TotalRequested: 2576980352, TotalRequestedScaled: 1.0277243154285713E9, TotalJVMHeap: 3837263872, TotalAvailable: 2513407836, TotalRequested/TotalJVMHeap:0.67 2014-09-25 15:25:39,706 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_sales, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,706 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Reducer 20, org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput: requested=1073741824, allocated=1073741824 2014-09-25 15:25:39,707 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, Map 42, org.apache.tez.runtime.library.input.UnorderedKVInput: requested=1503238528, allocated=262594844 2014-09-25 15:25:39,707 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,708 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_sales being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,708 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_sales 2014-09-25 15:25:39,708 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_sales 2014-09-25 15:25:39,709 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: Map 42 being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,709 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: Map 42 2014-09-25 15:25:39,709 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 2 2014-09-25 15:25:39,710 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 IOs to start 2014-09-25 15:25:39,710 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,713 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: RequestedMem=1503238528, Allocated: 262594844 2014-09-25 15:25:39,713 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: SimpleInputManager -> MemoryLimit: 262594844, maxSingleMemLimit: 65648712 2014-09-25 15:25:39,723 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: ShuffleManager : numInputs=44, compressionCodec=NoCompressionCodec, numFetchers=30, ifileBufferSize=131072, ifileReadAheadEnabled=true, ifileReadAheadLength=4194304, keepAlive=false, keepAliveMaxConnections=20, connectionTimeout=180000, readTimeout=180000, bufferSize=8192, sslShuffle=false 2014-09-25 15:25:39,733 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: Map 42 2014-09-25 15:25:39,733 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,735 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_22_000078_0 2014-09-25 15:25:39,735 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,735 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_22_000078_0_10001 2014-09-25 15:25:39,908 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,908 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,854 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,855 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@d9e151f 2014-09-25 15:25:40,860 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,860 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,861 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_sales, Map 42] 2014-09-25 15:25:40,863 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_sales 2014-09-25 15:25:40,863 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,874 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@78549e9a 2014-09-25 15:25:40,889 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,847 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,932 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:41,932 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451487/000171_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,021 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,021 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451487/000171_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 17803137, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,039 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,067 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451487/000171_0 2014-09-25 15:25:42,067 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@78549e9a 2014-09-25 15:25:42,070 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:42,075 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: keySerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@66aae949; valueSerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@5eb9ec47; comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@4759e7; conf=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2014-09-25 15:25:42,080 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Instantiating Partitioner: [org.apache.tez.mapreduce.partition.MRPartitioner] 2014-09-25 15:25:42,081 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: Using partitioner class: org.apache.tez.mapreduce.partition.MRPartitioner 2014-09-25 15:25:42,083 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: No combiner specified via tez.runtime.combiner.class. Combiner will not be used 2014-09-25 15:25:42,309 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 40, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000040_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,112 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: tez.runtime.io.sort.mb = 1024 2014-09-25 15:25:43,115 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.remaining() = 1073741824 2014-09-25 15:25:43,115 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.size = 16777216 2014-09-25 15:25:43,115 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 41, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000041_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,115 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,121 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003]] 2014-09-25 15:25:43,122 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 19 2014-09-25 15:25:43,122 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,122 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 42, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000042_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,123 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003]] 2014-09-25 15:25:43,136 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,136 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003]] 2014-09-25 15:25:43,216 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 43, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000043_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,216 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,216 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003]] 2014-09-25 15:25:43,387 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 38, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000038_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,387 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,387 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003]] 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000043_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000042_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000040_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,407 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000038_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,408 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000041_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,409 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 629820 : 629820 2014-09-25 15:25:43,412 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] decomp: 629820 len: 629824 to MEMORY 2014-09-25 15:25:43,413 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 309644 : 939464 2014-09-25 15:25:43,413 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] decomp: 309644 len: 309648 to MEMORY 2014-09-25 15:25:43,422 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1357296 : 2296760 2014-09-25 15:25:43,422 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] decomp: 1357296 len: 1357300 to MEMORY 2014-09-25 15:25:43,422 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1555518 : 3852278 2014-09-25 15:25:43,423 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] decomp: 1555518 len: 1555522 to MEMORY 2014-09-25 15:25:43,426 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 677484 : 4529762 2014-09-25 15:25:43,426 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] decomp: 677484 len: 677488 to MEMORY 2014-09-25 15:25:43,503 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 309644 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] 2014-09-25 15:25:43,504 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] to MEMORY, CompressedSize=309648, DecompressedSize=309644,EndTime=1411673143504, TimeTaken=95, Rate=3.11 MB/s 2014-09-25 15:25:43,504 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(43 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.07 MB/s) 2014-09-25 15:25:43,506 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 2 2014-09-25 15:25:43,509 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 677484 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] 2014-09-25 15:25:43,510 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] to MEMORY, CompressedSize=677488, DecompressedSize=677484,EndTime=1411673143509, TimeTaken=101, Rate=6.40 MB/s 2014-09-25 15:25:43,510 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(42 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.24 MB/s) 2014-09-25 15:25:43,510 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 4 2014-09-25 15:25:43,546 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 629820 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] 2014-09-25 15:25:43,546 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] to MEMORY, CompressedSize=629824, DecompressedSize=629820,EndTime=1411673143546, TimeTaken=138, Rate=4.35 MB/s 2014-09-25 15:25:43,546 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(41 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.39 MB/s) 2014-09-25 15:25:43,546 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 1 2014-09-25 15:25:43,578 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1357296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] 2014-09-25 15:25:43,578 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] to MEMORY, CompressedSize=1357300, DecompressedSize=1357296,EndTime=1411673143578, TimeTaken=170, Rate=7.61 MB/s 2014-09-25 15:25:43,578 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(40 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.71 MB/s) 2014-09-25 15:25:43,578 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 0 2014-09-25 15:25:43,588 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1555518 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] 2014-09-25 15:25:43,588 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] to MEMORY, CompressedSize=1555522, DecompressedSize=1555518,EndTime=1411673143588, TimeTaken=181, Rate=8.20 MB/s 2014-09-25 15:25:43,588 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(39 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.08 MB/s) 2014-09-25 15:25:43,588 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 3 2014-09-25 15:25:43,901 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 39, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000039_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,902 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,902 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003]] 2014-09-25 15:25:43,917 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000039_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,917 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1822690 : 6352452 2014-09-25 15:25:43,918 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] decomp: 1822690 len: 1822694 to MEMORY 2014-09-25 15:25:43,940 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:44,067 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1822690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] 2014-09-25 15:25:44,067 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] to MEMORY, CompressedSize=1822694, DecompressedSize=1822690,EndTime=1411673144067, TimeTaken=150, Rate=11.59 MB/s 2014-09-25 15:25:44,068 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(38 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.21 MB/s) 2014-09-25 15:25:44,068 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 5 2014-09-25 15:25:44,106 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =8 Id =0 Id =1 Id =2 Id =3 Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\RS> <\Children> Id = 4 null<\Parent> <\GBY> <\Children> Id = 3 null<\Parent> <\SEL> <\Children> Id = 2 nullId = 7 Id =7 null <\Children> <\Parent> <\HASHTABLEDUMMY><\Parent> <\MAPJOIN> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 8 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:44,110 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[8] 2014-09-25 15:25:44,111 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:44,111 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:44,111 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:44,111 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:44,111 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:44,111 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:44,112 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:44,112 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:44,112 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:44,139 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 8 MAP 2014-09-25 15:25:44,139 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[7] 2014-09-25 15:25:44,158 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Operator 7 HASHTABLEDUMMY initialized 2014-09-25 15:25:44,158 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing children of 7 HASHTABLEDUMMY 2014-09-25 15:25:44,158 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,158 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing Self MAPJOIN[3] 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: JOIN struct<_col0:int,_col2:float,_col5:float,_col6:float,_col7:float> totalsz = 5 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Operator 3 MAPJOIN initialized 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing children of 3 MAPJOIN 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 4 SEL 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[4] 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 4 SEL initialized 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 4 SEL 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing child 5 GBY 2014-09-25 15:25:44,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing Self GBY[5] 2014-09-25 15:25:44,173 WARN [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2014-09-25 15:25:44,177 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Operator 5 GBY initialized 2014-09-25 15:25:44,178 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing children of 5 GBY 2014-09-25 15:25:44,178 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 6 RS 2014-09-25 15:25:44,178 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[6] 2014-09-25 15:25:44,185 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = -1 2014-09-25 15:25:44,185 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 6 RS 2014-09-25 15:25:44,188 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: using hash aggregation processing mode 2014-09-25 15:25:44,188 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initialization Done 5 GBY 2014-09-25 15:25:44,188 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 4 SEL 2014-09-25 15:25:44,190 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Try to retrieve from cache 2014-09-25 15:25:44,190 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Did not find tables in cache 2014-09-25 15:25:44,195 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initialization Done 3 MAPJOIN 2014-09-25 15:25:44,195 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initialization Done 7 HASHTABLEDUMMY 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[6] --> Reducer 20 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,232 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_sales for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451487 2014-09-25 15:25:44,235 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,240 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper: Key count from statistics is 7199721; setting map size to 9599628 2014-09-25 15:25:44,388 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 37, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000037_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,388 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,388 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003]] 2014-09-25 15:25:44,389 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe 2014-09-25 15:25:44,391 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Tag found in keys and will be removed. This should not happen. 2014-09-25 15:25:44,393 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000037_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,393 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 3583040 : 9935492 2014-09-25 15:25:44,395 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] decomp: 3583040 len: 3583044 to MEMORY 2014-09-25 15:25:44,532 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 3583040 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] 2014-09-25 15:25:44,532 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] to MEMORY, CompressedSize=3583044, DecompressedSize=3583040,EndTime=1411673144532, TimeTaken=139, Rate=24.58 MB/s 2014-09-25 15:25:44,533 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(37 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.90 MB/s) 2014-09-25 15:25:44,533 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 6 2014-09-25 15:25:44,596 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 309644 : 9625848 2014-09-25 15:25:44,693 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 36, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000036_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,693 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,694 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003]] 2014-09-25 15:25:44,700 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000036_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,700 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 4541346 : 14167194 2014-09-25 15:25:44,704 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] decomp: 4541346 len: 4541350 to MEMORY 2014-09-25 15:25:44,765 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 677484 : 13489710 2014-09-25 15:25:44,798 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 629820 : 12859890 2014-09-25 15:25:44,838 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1357296 : 11502594 2014-09-25 15:25:44,868 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1555518 : 9947076 2014-09-25 15:25:44,907 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1822690 : 8124386 2014-09-25 15:25:44,978 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 3583040 : 4541346 2014-09-25 15:25:45,196 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 4541346 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] 2014-09-25 15:25:45,197 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] to MEMORY, CompressedSize=4541350, DecompressedSize=4541346,EndTime=1411673145196, TimeTaken=496, Rate=8.73 MB/s 2014-09-25 15:25:45,197 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(36 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.30 MB/s) 2014-09-25 15:25:45,197 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 7 2014-09-25 15:25:45,336 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 4541346 : 0 2014-09-25 15:25:46,051 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 32, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000032_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,051 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,051 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003]] 2014-09-25 15:25:46,055 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000032_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,055 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 12798650 : 12798650 2014-09-25 15:25:46,065 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] decomp: 12798650 len: 12798654 to MEMORY 2014-09-25 15:25:46,254 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 33, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000033_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,254 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,254 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 35, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000035_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,254 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003]] 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,255 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003]] 2014-09-25 15:25:46,281 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000035_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,281 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 10228342 : 23026992 2014-09-25 15:25:46,284 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000033_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,289 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] decomp: 10228342 len: 10228346 to MEMORY 2014-09-25 15:25:46,289 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11624860 : 34651852 2014-09-25 15:25:46,721 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] decomp: 11624860 len: 11624864 to MEMORY 2014-09-25 15:25:46,925 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 34, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000034_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,925 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,925 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002]] 2014-09-25 15:25:47,034 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000034_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,035 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11982854 : 46634706 2014-09-25 15:25:47,037 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] decomp: 11982854 len: 11982858 to MEMORY 2014-09-25 15:25:47,128 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 11, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn111-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000011_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,128 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn111-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,128 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn111-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003]] 2014-09-25 15:25:47,134 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000011_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,134 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21492158 : 68126864 2014-09-25 15:25:47,138 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] decomp: 21492158 len: 21492162 to MEMORY 2014-09-25 15:25:47,431 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 15, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn119-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000015_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,432 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn119-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,432 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn119-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003]] 2014-09-25 15:25:47,438 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000015_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,438 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21462624 : 89589488 2014-09-25 15:25:47,442 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] decomp: 21462624 len: 21462628 to MEMORY 2014-09-25 15:25:47,456 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 10228342 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] 2014-09-25 15:25:47,456 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] to MEMORY, CompressedSize=10228346, DecompressedSize=10228342,EndTime=1411673147456, TimeTaken=1175, Rate=8.30 MB/s 2014-09-25 15:25:47,457 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(35 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.95 MB/s) 2014-09-25 15:25:47,457 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 10 2014-09-25 15:25:47,541 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11982854 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] 2014-09-25 15:25:47,541 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] to MEMORY, CompressedSize=11982858, DecompressedSize=11982854,EndTime=1411673147541, TimeTaken=507, Rate=22.54 MB/s 2014-09-25 15:25:47,541 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(34 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 4.37 MB/s) 2014-09-25 15:25:47,541 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 11 2014-09-25 15:25:47,629 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11624860 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] 2014-09-25 15:25:47,630 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] to MEMORY, CompressedSize=11624864, DecompressedSize=11624860,EndTime=1411673147629, TimeTaken=1345, Rate=8.24 MB/s 2014-09-25 15:25:47,630 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(33 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 5.76 MB/s) 2014-09-25 15:25:47,630 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 9 2014-09-25 15:25:47,638 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 7, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000007_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,638 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,639 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002]] 2014-09-25 15:25:47,658 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000007_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,658 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21726070 : 111315558 2014-09-25 15:25:47,662 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002] decomp: 21726070 len: 21726074 to MEMORY 2014-09-25 15:25:47,711 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 10228342 : 101087216 2014-09-25 15:25:47,736 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 31, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn117-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000031_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,737 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn117-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,737 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn117-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003]] 2014-09-25 15:25:47,738 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 12798650 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] 2014-09-25 15:25:47,738 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] to MEMORY, CompressedSize=12798654, DecompressedSize=12798650,EndTime=1411673147738, TimeTaken=1683, Rate=7.25 MB/s 2014-09-25 15:25:47,738 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(32 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 6.48 MB/s) 2014-09-25 15:25:47,738 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 8 2014-09-25 15:25:47,742 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000031_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,743 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 14226648 : 115313864 2014-09-25 15:25:47,746 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] decomp: 14226648 len: 14226652 to MEMORY 2014-09-25 15:25:47,840 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 9, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000009_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,840 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,840 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 8, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000008_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,840 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002]] 2014-09-25 15:25:47,842 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,842 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 26, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000026_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,842 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003]] 2014-09-25 15:25:47,843 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,843 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003]] 2014-09-25 15:25:47,846 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000008_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,846 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21409352 : 136723216 2014-09-25 15:25:47,850 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003] decomp: 21409352 len: 21409356 to MEMORY 2014-09-25 15:25:47,885 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000009_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,886 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21487146 : 158210362 2014-09-25 15:25:47,892 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000026_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,914 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] decomp: 21487146 len: 21487150 to MEMORY 2014-09-25 15:25:47,914 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21650394 : 179860756 2014-09-25 15:25:47,919 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003] decomp: 21650394 len: 21650398 to MEMORY 2014-09-25 15:25:47,956 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 27, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000027_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,956 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,956 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003]] 2014-09-25 15:25:47,970 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000027_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,971 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21563834 : 201424590 2014-09-25 15:25:47,980 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003] decomp: 21563834 len: 21563838 to MEMORY 2014-09-25 15:25:48,091 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11982854 : 189441736 2014-09-25 15:25:48,368 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 23, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000023_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,369 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,369 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 13, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000013_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,369 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003]] 2014-09-25 15:25:48,369 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,370 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003]] 2014-09-25 15:25:48,381 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000013_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,381 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21335172 : 210776908 2014-09-25 15:25:48,385 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003] decomp: 21335172 len: 21335176 to MEMORY 2014-09-25 15:25:48,399 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000023_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,399 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21550870 : 232327778 2014-09-25 15:25:48,986 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003] decomp: 21550870 len: 21550874 to MEMORY 2014-09-25 15:25:48,987 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21492158 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] 2014-09-25 15:25:48,987 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] to MEMORY, CompressedSize=21492162, DecompressedSize=21492158,EndTime=1411673148987, TimeTaken=1853, Rate=11.06 MB/s 2014-09-25 15:25:48,987 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(31 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 7.88 MB/s) 2014-09-25 15:25:48,987 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 12 2014-09-25 15:25:48,992 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 2, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000002_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,992 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,992 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 18, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn109-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000018_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,992 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003]] 2014-09-25 15:25:48,993 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn109-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,993 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 22, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000022_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,993 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn109-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002]] 2014-09-25 15:25:48,993 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,993 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 17, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000017_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,993 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003]] 2014-09-25 15:25:48,994 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,994 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 10, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn108-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000010_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,994 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003]] 2014-09-25 15:25:48,995 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn108-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,995 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 25, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000025_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,995 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn108-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003]] 2014-09-25 15:25:48,995 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,995 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003]] 2014-09-25 15:25:48,998 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000010_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,998 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21678686 : 254006464 2014-09-25 15:25:49,001 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000018_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,002 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003] decomp: 21678686 len: 21678690 to MEMORY 2014-09-25 15:25:49,005 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000002_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,007 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000017_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,009 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000022_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,012 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000025_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,026 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002] decomp: 21427646 len: 21427650 to DISK 2014-09-25 15:25:49,028 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003] decomp: 21512292 len: 21512296 to DISK 2014-09-25 15:25:49,028 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003] decomp: 21741640 len: 21741644 to DISK 2014-09-25 15:25:49,028 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11624860 : 242381604 2014-09-25 15:25:49,029 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] decomp: 21656508 len: 21656512 to DISK 2014-09-25 15:25:49,030 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003] decomp: 21829100 len: 21829104 to DISK 2014-09-25 15:25:49,093 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 20, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000020_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,094 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,094 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=20], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000020_0_10003]] 2014-09-25 15:25:49,100 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000020_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,101 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=20], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000020_0_10003] decomp: 21570030 len: 21570034 to DISK 2014-09-25 15:25:49,115 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21487146 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] 2014-09-25 15:25:49,115 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] to MEMORY, CompressedSize=21487150, DecompressedSize=21487146,EndTime=1411673149115, TimeTaken=1230, Rate=16.66 MB/s 2014-09-25 15:25:49,115 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(30 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 9.93 MB/s) 2014-09-25 15:25:49,116 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 16 2014-09-25 15:25:49,240 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21462624 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] 2014-09-25 15:25:49,240 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] to MEMORY, CompressedSize=21462628, DecompressedSize=21462624,EndTime=1411673149240, TimeTaken=1802, Rate=11.36 MB/s 2014-09-25 15:25:49,240 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(29 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 11.97 MB/s) 2014-09-25 15:25:49,240 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 13 2014-09-25 15:25:49,296 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000078_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 16, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn106-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000016_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,297 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn106-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,297 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn106-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=16], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000016_0_10003]] 2014-09-25 15:25:49,301 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000016_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,302 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=16], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000016_0_10003] decomp: 21371486 len: 21371490 to DISK 2014-09-25 15:25:49,350 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 12798650 : 229582954 2014-09-25 15:25:49,397 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Received should die response from AM 2014-09-25 15:25:49,397 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Asked to die via task heartbeat 2014-09-25 15:25:49,397 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Interrupted while waiting for task to complete. Interrupting task 2014-09-25 15:25:49,398 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Shutdown requested... returning 2014-09-25 15:25:49,398 INFO [main] org.apache.tez.runtime.task.TezChild: Got a shouldDie notification via hearbeats. Shutting down 2014-09-25 15:25:49,398 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 14226648 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] 2014-09-25 15:25:49,398 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] to MEMORY, CompressedSize=14226652, DecompressedSize=14226648,EndTime=1411673149398, TimeTaken=1656, Rate=8.19 MB/s 2014-09-25 15:25:49,398 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(28 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 13.33 MB/s) 2014-09-25 15:25:49,398 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 15 2014-09-25 15:25:49,499 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping TezTask metrics system... 2014-09-25 15:25:49,500 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system stopped. 2014-09-25 15:25:49,500 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system shutdown complete. Container: container_1406566393272_6236_01_000237 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 0 Log Contents: LogType: stdout LogLength: 2166 Log Contents: 3.606: [GC [PSYoungGen: 117255K->16172K(204288K)] 117255K->16244K(2068480K), 0.0295710 secs] [Times: user=0.15 sys=0.01, real=0.03 secs] 5.670: [GC [PSYoungGen: 110373K->27228K(204288K)] 110445K->27308K(2068480K), 0.0427290 secs] [Times: user=0.27 sys=0.04, real=0.05 secs] 7.703: [GC [PSYoungGen: 126605K->27186K(204288K)] 1175261K->1075858K(2068480K), 0.0262710 secs] [Times: user=0.17 sys=0.02, real=0.03 secs] 9.732: [GC [PSYoungGen: 108357K->28655K(379904K)] 1288101K->1261668K(2244096K), 0.0915090 secs] [Times: user=0.59 sys=0.11, real=0.10 secs] 11.607: [GC [PSYoungGen: 222434K->27664K(379392K)] 1455447K->1447776K(2243584K), 0.1652600 secs] [Times: user=1.50 sys=0.26, real=0.16 secs] 12.965: [GC [PSYoungGen: 282558K->51988K(333312K)] 1702669K->1670590K(2197504K), 0.1098450 secs] [Times: user=1.13 sys=0.27, real=0.11 secs] 13.075: [Full GC [PSYoungGen: 51988K->0K(333312K)] [ParOldGen: 1618602K->1543965K(2246144K)] 1670590K->1543965K(2579456K) [PSPermGen: 29355K->29336K(58880K)], 0.2526470 secs] [Times: user=0.91 sys=0.07, real=0.25 secs] 14.472: [GC [PSYoungGen: 126405K->73821K(354304K)] 1670370K->1648507K(2600448K), 0.0671380 secs] [Times: user=0.51 sys=0.13, real=0.07 secs] Heap PSYoungGen total 354304K, used 206335K [0x00000007e5980000, 0x0000000800000000, 0x0000000800000000) eden space 280064K, 47% used [0x00000007e5980000,0x00000007f4d68a78,0x00000007f6b00000) lgrp 0 space 141112K, 16% used [0x00000007e5980000,0x00000007e70cdd90,0x00000007ee34e000) lgrp 1 space 138952K, 78% used [0x00000007ee34e000,0x00000007f4d68a78,0x00000007f6b00000) from space 74240K, 99% used [0x00000007f6b00000,0x00000007fb317728,0x00000007fb380000) to space 78336K, 0% used [0x00000007fb380000,0x00000007fb380000,0x0000000800000000) ParOldGen total 2246144K, used 1574685K [0x0000000712800000, 0x000000079b980000, 0x00000007e5980000) object space 2246144K, 70% used [0x0000000712800000,0x00000007729c7630,0x000000079b980000) PSPermGen total 58880K, used 29389K [0x000000070d600000, 0x0000000710f80000, 0x0000000712800000) object space 58880K, 49% used [0x000000070d600000,0x000000070f2b34d8,0x0000000710f80000) LogType: syslog LogLength: 1114 Log Contents: 2014-09-25 15:25:36,674 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,648 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 27216, container_1406566393272_6236_01_000237 2014-09-25 15:25:37,785 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,950 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,950 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:38,131 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,790 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_22_000058_0 2014-09-25 15:25:38,790 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_22_000058_0 LogType: syslog_attempt_1406566393272_6236_1_22_000058_0 LogLength: 150201 Log Contents: 2014-09-25 15:25:38,801 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,801 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,802 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,809 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:39,008 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:39,400 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 19, VertexParallelism: 223, TaskAttemptID:attempt_1406566393272_6236_1_22_000058_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=2, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, {{ sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput }}, ], outputSpecList=[{{ destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput }}, ] 2014-09-25 15:25:39,403 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=2, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:39,457 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_22_000058_0 2014-09-25 15:25:39,458 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:39,458 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,496 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_sales, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:39,496 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=Map 42, physicalEdgeCount=44, inputClassName=org.apache.tez.runtime.library.input.UnorderedKVInput } 2014-09-25 15:25:39,497 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,497 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Reducer 20, physicalEdgeCount=104, outputClassName=org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput } 2014-09-25 15:25:39,498 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,499 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,499 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:39,499 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:39,508 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: Map 42 2014-09-25 15:25:39,508 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_sales 2014-09-25 15:25:39,511 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_sales 2014-09-25 15:25:39,511 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Reducer 20 2014-09-25 15:25:39,522 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1503238528, type: INPUT, componentVertexName: Map 42 2014-09-25 15:25:39,523 INFO [Initializer 2] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Requested SortBufferSize (io.sort.mb): 1024 2014-09-25 15:25:39,523 INFO [Initializer 2] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 1073741824, type: OUTPUT, componentVertexName: Reducer 20 2014-09-25 15:25:39,523 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:39,524 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Reducer 20 2014-09-25 15:25:39,532 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: Map 42 2014-09-25 15:25:39,549 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:39,566 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:39,578 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:39,578 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:39,579 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,579 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:39,579 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 3 initializers to finish 2014-09-25 15:25:39,579 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:39,579 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:39,600 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:39,600 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:39,600 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_sales 2014-09-25 15:25:39,600 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,612 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,630 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,630 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,630 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: UNSORTED_INPUT 2014-09-25 15:25:39,631 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 12, for type: SORTED_OUTPUT 2014-09-25 15:25:39,631 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.045, finalReserveFractionUsed=0.345 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 3, numScaledRequests: 14, TotalRequested: 2576980352, TotalRequestedScaled: 1.0277243154285713E9, TotalJVMHeap: 3837263872, TotalAvailable: 2513407836, TotalRequested/TotalJVMHeap:0.67 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_sales, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, Map 42, org.apache.tez.runtime.library.input.UnorderedKVInput: requested=1503238528, allocated=262594844 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Reducer 20, org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput: requested=1073741824, allocated=1073741824 2014-09-25 15:25:39,632 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,634 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_sales being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,634 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_sales 2014-09-25 15:25:39,634 INFO [Initializer 2] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_sales 2014-09-25 15:25:39,635 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: Map 42 being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,635 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: Map 42 2014-09-25 15:25:39,635 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 2 2014-09-25 15:25:39,635 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 IOs to start 2014-09-25 15:25:39,635 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,639 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: RequestedMem=1503238528, Allocated: 262594844 2014-09-25 15:25:39,639 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: SimpleInputManager -> MemoryLimit: 262594844, maxSingleMemLimit: 65648712 2014-09-25 15:25:39,652 INFO [Initializer 1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: ShuffleManager : numInputs=44, compressionCodec=NoCompressionCodec, numFetchers=30, ifileBufferSize=131072, ifileReadAheadEnabled=true, ifileReadAheadLength=4194304, keepAlive=false, keepAliveMaxConnections=20, connectionTimeout=180000, readTimeout=180000, bufferSize=8192, sslShuffle=false 2014-09-25 15:25:39,665 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: Map 42 2014-09-25 15:25:39,668 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,670 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_22_000058_0 2014-09-25 15:25:39,670 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,670 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_22_000058_0_10001 2014-09-25 15:25:39,832 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,832 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,785 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,785 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@3436ae91 2014-09-25 15:25:40,790 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,791 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,791 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_sales, Map 42] 2014-09-25 15:25:40,793 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_sales 2014-09-25 15:25:40,793 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,808 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@25ec74eb 2014-09-25 15:25:40,828 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,893 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,033 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:42,033 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451274/000241_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,140 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,140 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451274/000241_0 with {include: [true, false, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, true, false, false, false, false, false, false, false, true, false, false, false, false, false, false, false, false], offset: 0, length: 5190014, sarg: leaf-0 = (IS_NULL cs_item_sk) leaf-1 = (IS_NULL cs_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_item_sk', 'null', 'cs_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cs_ext_list_price', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null']} 2014-09-25 15:25:42,154 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,183 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451274/000241_0 2014-09-25 15:25:42,183 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@25ec74eb 2014-09-25 15:25:42,186 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:42,193 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: keySerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@17faf07e; valueSerializer=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization$TezBytesWritableSerializer@5bc2ec7e; comparator=org.apache.tez.runtime.library.common.comparator.TezBytesComparator@5a347342; conf=org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.tez.runtime.library.common.serializer.TezBytesWritableSerialization,org.apache.hadoop.io.serializer.WritableSerialization 2014-09-25 15:25:42,197 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.ExternalSorter: Instantiating Partitioner: [org.apache.tez.mapreduce.partition.MRPartitioner] 2014-09-25 15:25:42,200 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: Using partitioner class: org.apache.tez.mapreduce.partition.MRPartitioner 2014-09-25 15:25:42,202 INFO [TezChild] org.apache.tez.runtime.library.common.TezRuntimeUtils: No combiner specified via tez.runtime.combiner.class. Combiner will not be used 2014-09-25 15:25:42,272 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 40, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000040_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,303 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: tez.runtime.io.sort.mb = 1024 2014-09-25 15:25:43,306 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.remaining() = 1073741824 2014-09-25 15:25:43,306 INFO [TezChild] org.apache.tez.runtime.library.common.sort.impl.PipelinedSorter: reserved.size = 16777216 2014-09-25 15:25:43,306 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,306 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 41, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000041_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,312 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003]] 2014-09-25 15:25:43,313 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 19 2014-09-25 15:25:43,314 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,314 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 42, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000042_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,314 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003]] 2014-09-25 15:25:43,314 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,315 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 43, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000043_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,315 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003]] 2014-09-25 15:25:43,315 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,315 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 38, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000038_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,315 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003]] 2014-09-25 15:25:43,316 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,316 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003]] 2014-09-25 15:25:43,588 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000042_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,588 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000038_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,592 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000041_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,592 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000043_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,593 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 309644 : 309644 2014-09-25 15:25:43,594 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000040_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,595 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1357296 : 1666940 2014-09-25 15:25:43,595 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] decomp: 309644 len: 309648 to MEMORY 2014-09-25 15:25:43,595 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 677484 : 2344424 2014-09-25 15:25:43,595 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] decomp: 1357296 len: 1357300 to MEMORY 2014-09-25 15:25:43,608 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] decomp: 677484 len: 677488 to MEMORY 2014-09-25 15:25:43,608 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 629820 : 2974244 2014-09-25 15:25:43,608 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] decomp: 629820 len: 629824 to MEMORY 2014-09-25 15:25:43,608 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1555518 : 4529762 2014-09-25 15:25:43,608 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] decomp: 1555518 len: 1555522 to MEMORY 2014-09-25 15:25:43,663 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 309644 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] 2014-09-25 15:25:43,664 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=42], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000042_0_10003] to MEMORY, CompressedSize=309648, DecompressedSize=309644,EndTime=1411673143664, TimeTaken=75, Rate=3.94 MB/s 2014-09-25 15:25:43,664 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(43 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.06 MB/s) 2014-09-25 15:25:43,665 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 2 2014-09-25 15:25:43,697 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 629820 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] 2014-09-25 15:25:43,697 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=41], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000041_0_10003] to MEMORY, CompressedSize=629824, DecompressedSize=629820,EndTime=1411673143697, TimeTaken=105, Rate=5.72 MB/s 2014-09-25 15:25:43,697 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(42 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.18 MB/s) 2014-09-25 15:25:43,698 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 1 2014-09-25 15:25:43,709 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 677484 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] 2014-09-25 15:25:43,709 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=38], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000038_0_10003] to MEMORY, CompressedSize=677488, DecompressedSize=677484,EndTime=1411673143709, TimeTaken=121, Rate=5.34 MB/s 2014-09-25 15:25:43,709 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(41 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.31 MB/s) 2014-09-25 15:25:43,709 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 4 2014-09-25 15:25:43,710 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1357296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] 2014-09-25 15:25:43,710 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=40], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000040_0_10003] to MEMORY, CompressedSize=1357300, DecompressedSize=1357296,EndTime=1411673143710, TimeTaken=116, Rate=11.16 MB/s 2014-09-25 15:25:43,710 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(40 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.57 MB/s) 2014-09-25 15:25:43,710 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 0 2014-09-25 15:25:43,712 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1555518 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] 2014-09-25 15:25:43,712 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=43], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000043_0_10003] to MEMORY, CompressedSize=1555522, DecompressedSize=1555518,EndTime=1411673143712, TimeTaken=120, Rate=12.36 MB/s 2014-09-25 15:25:43,712 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(39 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 0.86 MB/s) 2014-09-25 15:25:43,712 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 3 2014-09-25 15:25:43,836 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 39, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000039_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:43,836 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:43,836 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003]] 2014-09-25 15:25:43,842 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000039_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:43,842 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 1822690 : 6352452 2014-09-25 15:25:43,843 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] decomp: 1822690 len: 1822694 to MEMORY 2014-09-25 15:25:43,903 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:43,969 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 1822690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] 2014-09-25 15:25:43,969 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=39], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000039_0_10003] to MEMORY, CompressedSize=1822694, DecompressedSize=1822690,EndTime=1411673143969, TimeTaken=127, Rate=13.69 MB/s 2014-09-25 15:25:43,969 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(38 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.21 MB/s) 2014-09-25 15:25:43,969 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 5 2014-09-25 15:25:44,120 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =8 Id =0 Id =1 Id =2 Id =3 Id =4 Id =5 Id =6 <\Children> Id = 5 null<\Parent> <\RS> <\Children> Id = 4 null<\Parent> <\GBY> <\Children> Id = 3 null<\Parent> <\SEL> <\Children> Id = 2 nullId = 7 Id =7 null <\Children> <\Parent> <\HASHTABLEDUMMY><\Parent> <\MAPJOIN> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 8 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:44,125 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[8] 2014-09-25 15:25:44,126 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:44,126 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:44,126 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:44,126 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:44,126 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:44,127 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:44,127 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:44,127 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:44,127 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:44,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:44,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:44,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:44,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:44,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:44,155 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 8 MAP 2014-09-25 15:25:44,155 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing Self HASHTABLEDUMMY[7] 2014-09-25 15:25:44,181 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Operator 7 HASHTABLEDUMMY initialized 2014-09-25 15:25:44,182 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initializing children of 7 HASHTABLEDUMMY 2014-09-25 15:25:44,182 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing child 3 MAPJOIN 2014-09-25 15:25:44,182 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing Self MAPJOIN[3] 2014-09-25 15:25:44,195 INFO [TezChild] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: JOIN struct<_col0:int,_col2:float,_col5:float,_col6:float,_col7:float> totalsz = 5 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Operator 3 MAPJOIN initialized 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initializing children of 3 MAPJOIN 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 4 SEL 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[4] 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 4 SEL initialized 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 4 SEL 2014-09-25 15:25:44,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing child 5 GBY 2014-09-25 15:25:44,197 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing Self GBY[5] 2014-09-25 15:25:44,207 WARN [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: VectorGroupByOperator is vector output true 2014-09-25 15:25:44,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Operator 5 GBY initialized 2014-09-25 15:25:44,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initializing children of 5 GBY 2014-09-25 15:25:44,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 6 RS 2014-09-25 15:25:44,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[6] 2014-09-25 15:25:44,222 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = -1 2014-09-25 15:25:44,222 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 6 RS 2014-09-25 15:25:44,225 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: using hash aggregation processing mode 2014-09-25 15:25:44,226 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator: Initialization Done 5 GBY 2014-09-25 15:25:44,226 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 4 SEL 2014-09-25 15:25:44,228 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Try to retrieve from cache 2014-09-25 15:25:44,228 INFO [TezChild] org.apache.hadoop.hive.ql.exec.MapJoinOperator: Did not find tables in cache 2014-09-25 15:25:44,233 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapJoinOperator: Initialization Done 3 MAPJOIN 2014-09-25 15:25:44,234 INFO [TezChild] org.apache.hadoop.hive.ql.exec.HashTableDummyOperator: Initialization Done 7 HASHTABLEDUMMY 2014-09-25 15:25:44,235 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[6] --> Reducer 20 2014-09-25 15:25:44,235 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,295 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_sales for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_sales/cs_sold_date_sk=2451274 2014-09-25 15:25:44,302 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:44,310 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.HashMapWrapper: Key count from statistics is 7199721; setting map size to 9599628 2014-09-25 15:25:44,439 INFO [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Initializing container with org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe and org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe 2014-09-25 15:25:44,441 ERROR [TezChild] org.apache.hadoop.hive.ql.exec.persistence.MapJoinTableContainer: Tag found in keys and will be removed. This should not happen. 2014-09-25 15:25:44,445 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 37, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000037_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,445 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,446 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003]] 2014-09-25 15:25:44,450 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000037_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,450 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 3583040 : 9935492 2014-09-25 15:25:44,453 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] decomp: 3583040 len: 3583044 to MEMORY 2014-09-25 15:25:44,652 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 3583040 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] 2014-09-25 15:25:44,652 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=37], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000037_0_10003] to MEMORY, CompressedSize=3583044, DecompressedSize=3583040,EndTime=1411673144652, TimeTaken=202, Rate=16.92 MB/s 2014-09-25 15:25:44,652 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(37 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 1.58 MB/s) 2014-09-25 15:25:44,652 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 6 2014-09-25 15:25:44,667 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 309644 : 9625848 2014-09-25 15:25:44,750 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 36, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000036_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:44,750 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:44,750 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003]] 2014-09-25 15:25:44,806 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000036_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:44,806 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 4541346 : 14167194 2014-09-25 15:25:44,811 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] decomp: 4541346 len: 4541350 to MEMORY 2014-09-25 15:25:44,832 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 629820 : 13537374 2014-09-25 15:25:44,864 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 677484 : 12859890 2014-09-25 15:25:44,916 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1357296 : 11502594 2014-09-25 15:25:44,949 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1555518 : 9947076 2014-09-25 15:25:44,985 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 1822690 : 8124386 2014-09-25 15:25:44,993 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 4541346 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] 2014-09-25 15:25:44,993 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=36], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000036_0_10003] to MEMORY, CompressedSize=4541350, DecompressedSize=4541346,EndTime=1411673144993, TimeTaken=187, Rate=23.16 MB/s 2014-09-25 15:25:44,993 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(36 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 2.30 MB/s) 2014-09-25 15:25:44,993 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 7 2014-09-25 15:25:45,066 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 3583040 : 4541346 2014-09-25 15:25:45,193 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 4541346 : 0 2014-09-25 15:25:45,966 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 32, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000032_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:45,966 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:45,966 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003]] 2014-09-25 15:25:45,970 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000032_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:45,971 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 12798650 : 12798650 2014-09-25 15:25:46,066 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] decomp: 12798650 len: 12798654 to MEMORY 2014-09-25 15:25:46,280 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 33, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000033_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,280 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 35, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000035_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,280 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,280 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003]] 2014-09-25 15:25:46,281 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,281 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003]] 2014-09-25 15:25:46,329 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000033_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,329 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11624860 : 24423510 2014-09-25 15:25:46,348 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] decomp: 11624860 len: 11624864 to MEMORY 2014-09-25 15:25:46,357 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000035_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:46,357 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 10228342 : 34651852 2014-09-25 15:25:46,359 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] decomp: 10228342 len: 10228346 to MEMORY 2014-09-25 15:25:46,634 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11624860 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] 2014-09-25 15:25:46,634 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=33], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000033_0_10003] to MEMORY, CompressedSize=11624864, DecompressedSize=11624860,EndTime=1411673146634, TimeTaken=305, Rate=36.35 MB/s 2014-09-25 15:25:46,634 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(35 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 3.56 MB/s) 2014-09-25 15:25:46,635 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 9 2014-09-25 15:25:46,888 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 34, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000034_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:46,889 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:46,889 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002]] 2014-09-25 15:25:46,910 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11624860 : 23026992 2014-09-25 15:25:47,035 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000034_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,035 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 11982854 : 35009846 2014-09-25 15:25:47,037 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] decomp: 11982854 len: 11982858 to MEMORY 2014-09-25 15:25:47,091 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 11, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn111-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000011_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,091 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn111-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,091 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn111-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003]] 2014-09-25 15:25:47,100 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000011_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,100 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21492158 : 56502004 2014-09-25 15:25:47,113 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] decomp: 21492158 len: 21492162 to MEMORY 2014-09-25 15:25:47,234 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 10228342 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] 2014-09-25 15:25:47,234 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=35], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000035_0_10003] to MEMORY, CompressedSize=10228346, DecompressedSize=10228342,EndTime=1411673147234, TimeTaken=877, Rate=11.12 MB/s 2014-09-25 15:25:47,234 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(34 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 4.33 MB/s) 2014-09-25 15:25:47,234 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 10 2014-09-25 15:25:47,456 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 10228342 : 46273662 2014-09-25 15:25:47,496 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 15, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn119-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000015_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,497 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn119-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,497 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn119-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003]] 2014-09-25 15:25:47,505 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000015_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,506 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21462624 : 67736286 2014-09-25 15:25:47,520 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] decomp: 21462624 len: 21462628 to MEMORY 2014-09-25 15:25:47,558 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 12798650 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] 2014-09-25 15:25:47,558 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=32], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000032_0_10003] to MEMORY, CompressedSize=12798654, DecompressedSize=12798650,EndTime=1411673147558, TimeTaken=1587, Rate=7.69 MB/s 2014-09-25 15:25:47,558 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(33 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 5.86 MB/s) 2014-09-25 15:25:47,558 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 8 2014-09-25 15:25:47,607 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 7, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000007_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,607 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,607 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002]] 2014-09-25 15:25:47,634 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000007_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,634 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21726070 : 89462356 2014-09-25 15:25:47,663 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002] decomp: 21726070 len: 21726074 to MEMORY 2014-09-25 15:25:47,817 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 31, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn117-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000031_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,817 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 9, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000009_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,817 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 8, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000008_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:47,817 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn117-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,817 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn117-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003]] 2014-09-25 15:25:47,820 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 11982854 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] 2014-09-25 15:25:47,827 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,827 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002]] 2014-09-25 15:25:47,831 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:47,831 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003]] 2014-09-25 15:25:47,835 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=34], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000034_0_10002] to MEMORY, CompressedSize=11982858, DecompressedSize=11982854,EndTime=1411673147835, TimeTaken=785, Rate=14.56 MB/s 2014-09-25 15:25:47,836 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(32 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 6.48 MB/s) 2014-09-25 15:25:47,836 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 11 2014-09-25 15:25:47,845 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000008_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:47,845 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21409352 : 110871708 2014-09-25 15:25:48,015 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003] decomp: 21409352 len: 21409356 to MEMORY 2014-09-25 15:25:48,016 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000009_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,016 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21487146 : 132358854 2014-09-25 15:25:48,016 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000031_0_10003 sent hash and receievd reply 4 ms 2014-09-25 15:25:48,019 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 14226648 : 146585502 2014-09-25 15:25:48,019 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] decomp: 21487146 len: 21487150 to MEMORY 2014-09-25 15:25:48,021 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] decomp: 14226648 len: 14226652 to MEMORY 2014-09-25 15:25:48,026 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 26, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn107-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000026_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,027 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 27, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn122-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000027_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,027 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn107-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,027 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn107-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003]] 2014-09-25 15:25:48,037 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn122-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,037 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn122-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003]] 2014-09-25 15:25:48,078 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000026_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,078 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21650394 : 168235896 2014-09-25 15:25:48,108 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 12798650 : 155437246 2014-09-25 15:25:48,108 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003] decomp: 21650394 len: 21650398 to MEMORY 2014-09-25 15:25:48,183 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000027_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,183 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21563834 : 177001080 2014-09-25 15:25:48,188 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003] decomp: 21563834 len: 21563838 to MEMORY 2014-09-25 15:25:48,331 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 23, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000023_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,331 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 13, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn112-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000013_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,331 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,332 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003]] 2014-09-25 15:25:48,333 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn112-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,333 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn112-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003]] 2014-09-25 15:25:48,341 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000023_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,341 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21550870 : 198551950 2014-09-25 15:25:48,341 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000013_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,345 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003] decomp: 21550870 len: 21550874 to MEMORY 2014-09-25 15:25:48,345 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21335172 : 219887122 2014-09-25 15:25:48,364 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003] decomp: 21335172 len: 21335176 to MEMORY 2014-09-25 15:25:48,423 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 11982854 : 207904268 2014-09-25 15:25:48,536 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 2, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000002_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,536 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,536 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003]] 2014-09-25 15:25:48,536 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 18, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn109-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000018_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,541 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn109-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,541 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 22, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn124-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000022_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,541 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn109-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002]] 2014-09-25 15:25:48,544 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000002_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,545 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21829100 : 229733368 2014-09-25 15:25:48,549 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn124-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,549 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn124-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003]] 2014-09-25 15:25:48,552 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000018_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,553 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000022_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,561 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003] decomp: 21829100 len: 21829104 to MEMORY 2014-09-25 15:25:48,562 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21741640 : 251475008 2014-09-25 15:25:48,568 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003] decomp: 21741640 len: 21741644 to MEMORY 2014-09-25 15:25:48,570 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21492158 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] 2014-09-25 15:25:48,586 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002] decomp: 21427646 len: 21427650 to DISK 2014-09-25 15:25:48,586 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=11], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000011_0_10003] to MEMORY, CompressedSize=21492162, DecompressedSize=21492158,EndTime=1411673148586, TimeTaken=1470, Rate=13.94 MB/s 2014-09-25 15:25:48,587 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(31 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 8.75 MB/s) 2014-09-25 15:25:48,588 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 12 2014-09-25 15:25:48,620 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 14226648 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] 2014-09-25 15:25:48,620 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=31], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000031_0_10003] to MEMORY, CompressedSize=14226652, DecompressedSize=14226648,EndTime=1411673148620, TimeTaken=604, Rate=22.46 MB/s 2014-09-25 15:25:48,620 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(30 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 10.26 MB/s) 2014-09-25 15:25:48,620 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 15 2014-09-25 15:25:48,641 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 17, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn123-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000017_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,641 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 10, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn108-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000010_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,641 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn123-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,641 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn123-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003]] 2014-09-25 15:25:48,642 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn108-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,642 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn108-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003]] 2014-09-25 15:25:48,649 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000010_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,657 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003] decomp: 21678686 len: 21678690 to DISK 2014-09-25 15:25:48,668 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000017_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,669 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] decomp: 21656508 len: 21656512 to DISK 2014-09-25 15:25:48,767 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21550870 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003] 2014-09-25 15:25:48,767 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=23], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000023_0_10003] to MEMORY, CompressedSize=21550874, DecompressedSize=21550870,EndTime=1411673148767, TimeTaken=426, Rate=48.25 MB/s 2014-09-25 15:25:48,767 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(29 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 11.29 MB/s) 2014-09-25 15:25:48,767 INFO [Fetcher [Map_42] #20] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 20 2014-09-25 15:25:48,857 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 25, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000025_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:48,857 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:48,857 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003]] 2014-09-25 15:25:48,862 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000025_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:48,863 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003] decomp: 21512292 len: 21512296 to DISK 2014-09-25 15:25:48,945 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21650394 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003] 2014-09-25 15:25:48,946 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=26], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000026_0_10003] to MEMORY, CompressedSize=21650398, DecompressedSize=21650394,EndTime=1411673148945, TimeTaken=867, Rate=23.81 MB/s 2014-09-25 15:25:48,946 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(28 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 13.35 MB/s) 2014-09-25 15:25:48,946 INFO [Fetcher [Map_42] #18] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 18 2014-09-25 15:25:48,947 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21678690 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003] 2014-09-25 15:25:48,950 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=10], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000010_0_10003] to DISK, CompressedSize=21678690, DecompressedSize=21678686,EndTime=1411673148950, TimeTaken=298, Rate=69.38 MB/s 2014-09-25 15:25:48,950 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(27 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 15.42 MB/s) 2014-09-25 15:25:48,950 INFO [Fetcher [Map_42] #26] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 26 2014-09-25 15:25:48,965 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21335172 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003] 2014-09-25 15:25:48,965 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=13], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000013_0_10003] to MEMORY, CompressedSize=21335176, DecompressedSize=21335172,EndTime=1411673148965, TimeTaken=624, Rate=32.61 MB/s 2014-09-25 15:25:48,966 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(26 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 17.46 MB/s) 2014-09-25 15:25:48,966 INFO [Fetcher [Map_42] #21] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 21 2014-09-25 15:25:49,014 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21563834 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003] 2014-09-25 15:25:49,016 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=27], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000027_0_10003] to MEMORY, CompressedSize=21563838, DecompressedSize=21563834,EndTime=1411673149016, TimeTaken=832, Rate=24.72 MB/s 2014-09-25 15:25:49,016 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(25 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 19.51 MB/s) 2014-09-25 15:25:49,016 INFO [Fetcher [Map_42] #19] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 19 2014-09-25 15:25:49,161 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 20, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000020_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,162 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,162 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=20], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000020_0_10003]] 2014-09-25 15:25:49,567 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000020_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,568 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=20], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000020_0_10003] decomp: 21570030 len: 21570034 to DISK 2014-09-25 15:25:49,570 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 16, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn106-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000016_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,570 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn106-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,570 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 6, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn121-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000006_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,570 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn106-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=16], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000016_0_10003]] 2014-09-25 15:25:49,571 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn121-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,571 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 3, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn120-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000003_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,571 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn121-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=6], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000006_0_10003]] 2014-09-25 15:25:49,571 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn120-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,571 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 30, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn111-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000030_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,571 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn120-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=3], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000003_0_10003]] 2014-09-25 15:25:49,577 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn111-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,577 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 5, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn115-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000005_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,577 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn111-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=30], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000030_0_10003]] 2014-09-25 15:25:49,578 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn115-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,578 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 14, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn110-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000014_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,578 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn115-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=5], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000005_0_10003]] 2014-09-25 15:25:49,578 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn110-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,578 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn110-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=14], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000014_0_10003]] 2014-09-25 15:25:49,579 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21462624 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] 2014-09-25 15:25:49,579 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=15], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000015_0_10003] to MEMORY, CompressedSize=21462628, DecompressedSize=21462624,EndTime=1411673149579, TimeTaken=2073, Rate=9.87 MB/s 2014-09-25 15:25:49,579 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(24 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 21.56 MB/s) 2014-09-25 15:25:49,579 INFO [Fetcher [Map_42] #13] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 13 2014-09-25 15:25:49,582 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000014_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,583 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=14], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000014_0_10003] decomp: 21641866 len: 21641870 to DISK 2014-09-25 15:25:49,587 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000003_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,587 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000016_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,588 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=3], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000003_0_10003] decomp: 21666720 len: 21666724 to DISK 2014-09-25 15:25:49,591 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000005_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,592 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=16], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000016_0_10003] decomp: 21371486 len: 21371490 to DISK 2014-09-25 15:25:49,593 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=5], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000005_0_10003] decomp: 21820346 len: 21820350 to DISK 2014-09-25 15:25:49,595 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000030_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,597 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=30], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000030_0_10003] decomp: 21786106 len: 21786110 to DISK 2014-09-25 15:25:49,648 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21656512 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] 2014-09-25 15:25:49,649 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=17], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000017_0_10003] to DISK, CompressedSize=21656512, DecompressedSize=21656508,EndTime=1411673149649, TimeTaken=980, Rate=21.07 MB/s 2014-09-25 15:25:49,649 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(23 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 21.48 MB/s) 2014-09-25 15:25:49,649 INFO [Fetcher [Map_42] #25] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 25 2014-09-25 15:25:49,666 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000006_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,667 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=6], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000006_0_10003] decomp: 20388408 len: 20388412 to DISK 2014-09-25 15:25:49,672 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 4, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000004_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,672 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,672 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 19, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn105-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000019_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,672 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=4], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000004_0_10003]] 2014-09-25 15:25:49,672 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn105-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,672 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn105-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=19], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000019_0_10003]] 2014-09-25 15:25:49,676 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000019_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,677 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=19], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000019_0_10003] decomp: 21686402 len: 21686406 to DISK 2014-09-25 15:25:49,679 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000004_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,680 INFO [Fetcher [Map_42] #5] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=4], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000004_0_10003] decomp: 21660766 len: 21660770 to DISK 2014-09-25 15:25:49,713 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21741640 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003] 2014-09-25 15:25:49,713 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=22], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000022_0_10003] to MEMORY, CompressedSize=21741644, DecompressedSize=21741640,EndTime=1411673149713, TimeTaken=1160, Rate=17.87 MB/s 2014-09-25 15:25:49,714 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(22 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 23.36 MB/s) 2014-09-25 15:25:49,714 INFO [Fetcher [Map_42] #24] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 24 2014-09-25 15:25:49,767 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21686406 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=19], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000019_0_10003] 2014-09-25 15:25:49,769 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=19], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000019_0_10003] to DISK, CompressedSize=21686406, DecompressedSize=21686402,EndTime=1411673149769, TimeTaken=92, Rate=224.80 MB/s 2014-09-25 15:25:49,770 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(21 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 25.24 MB/s) 2014-09-25 15:25:49,770 INFO [Fetcher [Map_42] #6] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 36 2014-09-25 15:25:49,773 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 21492158 : 229982850 2014-09-25 15:25:49,774 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 1, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000001_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,774 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,774 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=1], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000001_0_10003]] 2014-09-25 15:25:49,779 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000001_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:49,779 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21696282 : 251679132 2014-09-25 15:25:49,789 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=1], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000001_0_10003] decomp: 21696282 len: 21696286 to MEMORY 2014-09-25 15:25:49,799 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21829100 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003] 2014-09-25 15:25:49,799 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=2], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000002_0_10003] to MEMORY, CompressedSize=21829104, DecompressedSize=21829100,EndTime=1411673149799, TimeTaken=1254, Rate=16.60 MB/s 2014-09-25 15:25:49,799 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(20 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 27.14 MB/s) 2014-09-25 15:25:49,799 INFO [Fetcher [Map_42] #22] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 22 2014-09-25 15:25:49,868 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21641870 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=14], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000014_0_10003] 2014-09-25 15:25:49,869 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=14], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000014_0_10003] to DISK, CompressedSize=21641870, DecompressedSize=21641866,EndTime=1411673149869, TimeTaken=287, Rate=71.91 MB/s 2014-09-25 15:25:49,870 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(19 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 29.01 MB/s) 2014-09-25 15:25:49,870 INFO [Fetcher [Map_42] #3] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 34 2014-09-25 15:25:49,956 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21696282 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=1], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000001_0_10003] 2014-09-25 15:25:49,956 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=1], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000001_0_10003] to MEMORY, CompressedSize=21696286, DecompressedSize=21696282,EndTime=1411673149956, TimeTaken=177, Rate=116.90 MB/s 2014-09-25 15:25:49,956 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(18 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 30.89 MB/s) 2014-09-25 15:25:49,956 INFO [Fetcher [Map_42] #7] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 37 2014-09-25 15:25:49,977 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 21, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn118-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000021_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:49,978 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn118-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:49,978 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn118-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=21], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000021_0_10003]] 2014-09-25 15:25:50,023 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21371490 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=16], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000016_0_10003] 2014-09-25 15:25:50,027 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=16], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000016_0_10003] to DISK, CompressedSize=21371490, DecompressedSize=21371486,EndTime=1411673150027, TimeTaken=439, Rate=46.43 MB/s 2014-09-25 15:25:50,027 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(17 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 32.75 MB/s) 2014-09-25 15:25:50,027 INFO [Fetcher [Map_42] #29] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 29 2014-09-25 15:25:50,037 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21487146 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] 2014-09-25 15:25:50,037 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=9], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000009_0_10002] to MEMORY, CompressedSize=21487150, DecompressedSize=21487146,EndTime=1411673150037, TimeTaken=2021, Rate=10.14 MB/s 2014-09-25 15:25:50,037 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(16 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 34.61 MB/s) 2014-09-25 15:25:50,038 INFO [Fetcher [Map_42] #16] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 16 2014-09-25 15:25:50,080 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 12, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn117-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000012_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:50,081 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn117-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:50,081 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn117-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=12], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000012_0_10003]] 2014-09-25 15:25:50,086 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000012_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:50,088 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=12], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000012_0_10003] decomp: 21613238 len: 21613242 to DISK 2014-09-25 15:25:50,099 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000021_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:50,101 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=21], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000021_0_10003] decomp: 21574980 len: 21574984 to DISK 2014-09-25 15:25:50,182 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21570034 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=20], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000020_0_10003] 2014-09-25 15:25:50,183 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=20], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000020_0_10003] to DISK, CompressedSize=21570034, DecompressedSize=21570030,EndTime=1411673150183, TimeTaken=615, Rate=33.45 MB/s 2014-09-25 15:25:50,184 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(15 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 36.48 MB/s) 2014-09-25 15:25:50,184 INFO [Fetcher [Map_42] #28] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 28 2014-09-25 15:25:50,190 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 0, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn113-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000000_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:50,191 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn113-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:50,191 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn113-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=0], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000000_0_10002]] 2014-09-25 15:25:50,204 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000000_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:50,206 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=0], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000000_0_10002] decomp: 21421732 len: 21421736 to DISK 2014-09-25 15:25:50,249 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 14226648 : 237452484 2014-09-25 15:25:50,289 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21427650 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002] 2014-09-25 15:25:50,291 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=18], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000018_0_10002] to DISK, CompressedSize=21427650, DecompressedSize=21427646,EndTime=1411673150291, TimeTaken=1738, Rate=11.76 MB/s 2014-09-25 15:25:50,292 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(14 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 38.34 MB/s) 2014-09-25 15:25:50,292 INFO [Fetcher [Map_42] #23] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 23 2014-09-25 15:25:50,292 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 29, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn108-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000029_0_10002, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:50,292 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn108-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:50,292 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn108-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=29], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000029_0_10002]] 2014-09-25 15:25:50,307 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000029_0_10002 sent hash and receievd reply 0 ms 2014-09-25 15:25:50,307 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 19785298 : 257237782 2014-09-25 15:25:50,311 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=29], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000029_0_10002] decomp: 19785298 len: 19785302 to MEMORY 2014-09-25 15:25:50,544 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21820350 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=5], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000005_0_10003] 2014-09-25 15:25:50,546 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=5], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000005_0_10003] to DISK, CompressedSize=21820350, DecompressedSize=21820346,EndTime=1411673150546, TimeTaken=954, Rate=21.81 MB/s 2014-09-25 15:25:50,546 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(13 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 40.23 MB/s) 2014-09-25 15:25:50,546 INFO [Fetcher [Map_42] #0] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 33 2014-09-25 15:25:50,597 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 28, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn114-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000028_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:50,597 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn114-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:50,597 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn114-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=28], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000028_0_10003]] 2014-09-25 15:25:50,654 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000028_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:50,655 INFO [Fetcher [Map_42] #12] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=28], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000028_0_10003] decomp: 21538168 len: 21538172 to DISK 2014-09-25 15:25:50,837 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21786110 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=30], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000030_0_10003] 2014-09-25 15:25:50,841 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=30], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000030_0_10003] to DISK, CompressedSize=21786110, DecompressedSize=21786106,EndTime=1411673150841, TimeTaken=1243, Rate=16.72 MB/s 2014-09-25 15:25:50,841 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(12 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 38.61 MB/s) 2014-09-25 15:25:50,842 INFO [Fetcher [Map_42] #4] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 32 2014-09-25 15:25:50,876 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21421736 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=0], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000000_0_10002] 2014-09-25 15:25:50,879 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=0], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000000_0_10002] to DISK, CompressedSize=21421736, DecompressedSize=21421732,EndTime=1411673150878, TimeTaken=672, Rate=30.40 MB/s 2014-09-25 15:25:50,879 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(11 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 40.31 MB/s) 2014-09-25 15:25:50,879 INFO [Fetcher [Map_42] #8] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 40 2014-09-25 15:25:51,014 INFO [TezTaskEventRouter[attempt_1406566393272_6236_1_22_000058_0]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleInputEventHandlerImpl: Processing DataMovementEvent with srcIndex: 0, targetIndex: 24, attemptNum: 0, payload: [hasEmptyPartitions: false, host: cn116-10.l42scl.hortonworks.com, port: 13562, pathComponent: attempt_1406566393272_6236_1_09_000024_0_10003, runDuration: 0, hasDataInEvent: false] 2014-09-25 15:25:51,015 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Scheduling fetch for inputHost: cn116-10.l42scl.hortonworks.com:13562 2014-09-25 15:25:51,015 INFO [ShuffleRunner [Map_42]] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Created Fetcher for host: cn116-10.l42scl.hortonworks.com, with inputs: [InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=24], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000024_0_10003]] 2014-09-25 15:25:51,032 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 21550870 : 235686912 2014-09-25 15:25:51,040 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.HttpConnection: for url=13562/mapOutput?job=job_1406566393272_6236&reduce=0&map=attempt_1406566393272_6236_1_09_000024_0_10003 sent hash and receievd reply 0 ms 2014-09-25 15:25:51,040 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after allocating 21769574 : 257456486 2014-09-25 15:25:51,045 INFO [Fetcher [Map_42] #15] org.apache.tez.runtime.library.shuffle.common.Fetcher: fetcher about to shuffle output of srcAttempt InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=24], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000024_0_10003] decomp: 21769574 len: 21769578 to MEMORY 2014-09-25 15:25:51,096 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 20388412 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=6], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000006_0_10003] 2014-09-25 15:25:51,097 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=6], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000006_0_10003] to DISK, CompressedSize=20388412, DecompressedSize=20388408,EndTime=1411673151097, TimeTaken=1430, Rate=13.60 MB/s 2014-09-25 15:25:51,097 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(10 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 41.93 MB/s) 2014-09-25 15:25:51,097 INFO [Fetcher [Map_42] #2] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 30 2014-09-25 15:25:51,125 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21613242 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=12], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000012_0_10003] 2014-09-25 15:25:51,127 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=12], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000012_0_10003] to DISK, CompressedSize=21613242, DecompressedSize=21613238,EndTime=1411673151126, TimeTaken=1038, Rate=19.86 MB/s 2014-09-25 15:25:51,127 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(9 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 43.65 MB/s) 2014-09-25 15:25:51,127 INFO [Fetcher [Map_42] #10] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 39 2014-09-25 15:25:51,153 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21512296 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003] 2014-09-25 15:25:51,155 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=25], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000025_0_10003] to DISK, CompressedSize=21512296, DecompressedSize=21512292,EndTime=1411673151155, TimeTaken=2292, Rate=8.95 MB/s 2014-09-25 15:25:51,155 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(8 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 45.36 MB/s) 2014-09-25 15:25:51,155 INFO [Fetcher [Map_42] #27] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 27 2014-09-25 15:25:51,166 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21726070 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002] 2014-09-25 15:25:51,167 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=7], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000007_0_10002] to MEMORY, CompressedSize=21726074, DecompressedSize=21726070,EndTime=1411673151167, TimeTaken=3532, Rate=5.87 MB/s 2014-09-25 15:25:51,167 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(7 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 47.08 MB/s) 2014-09-25 15:25:51,167 INFO [Fetcher [Map_42] #14] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 14 2014-09-25 15:25:51,171 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21409352 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003] 2014-09-25 15:25:51,171 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=8], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000008_0_10003] to MEMORY, CompressedSize=21409356, DecompressedSize=21409352,EndTime=1411673151171, TimeTaken=3326, Rate=6.14 MB/s 2014-09-25 15:25:51,171 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(6 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 48.79 MB/s) 2014-09-25 15:25:51,171 INFO [Fetcher [Map_42] #17] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 17 2014-09-25 15:25:51,194 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 19785298 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=29], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000029_0_10002] 2014-09-25 15:25:51,195 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=29], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000029_0_10002] to MEMORY, CompressedSize=19785302, DecompressedSize=19785298,EndTime=1411673151195, TimeTaken=888, Rate=21.25 MB/s 2014-09-25 15:25:51,195 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(5 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 50.36 MB/s) 2014-09-25 15:25:51,195 INFO [Fetcher [Map_42] #11] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 41 2014-09-25 15:25:51,264 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21574984 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=21], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000021_0_10003] 2014-09-25 15:25:51,265 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=21], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000021_0_10003] to DISK, CompressedSize=21574984, DecompressedSize=21574980,EndTime=1411673151265, TimeTaken=1164, Rate=17.68 MB/s 2014-09-25 15:25:51,266 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(4 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 52.07 MB/s) 2014-09-25 15:25:51,266 INFO [Fetcher [Map_42] #9] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 38 2014-09-25 15:25:51,298 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.Fetcher: Read 21666724 bytes from input for InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=3], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000003_0_10003] 2014-09-25 15:25:51,299 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: Completed fetch for attempt: InputAttemptIdentifier [inputIdentifier=InputIdentifier [inputIndex=3], attemptNumber=0, pathComponent=attempt_1406566393272_6236_1_09_000003_0_10003] to DISK, CompressedSize=21666724, DecompressedSize=21666720,EndTime=1411673151299, TimeTaken=1711, Rate=12.08 MB/s 2014-09-25 15:25:51,299 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.impl.ShuffleManager: copy(3 of 44. Transfer rate (CumulativeDataFetched/TimeSinceInputStarted)) 53.79 MB/s) 2014-09-25 15:25:51,300 INFO [Fetcher [Map_42] #1] org.apache.tez.runtime.library.shuffle.common.HttpConnection: Closing connection on fetcher [Map_42] 31 2014-09-25 15:25:51,572 INFO [TezChild] org.apache.tez.runtime.library.shuffle.common.impl.SimpleFetchedInputAllocator: Used memory after freeing 21650394 : 235806092 2014-09-25 15:25:52,230 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Received should die response from AM 2014-09-25 15:25:52,230 INFO [TaskHeartbeatThread] org.apache.tez.runtime.task.TaskReporter: Asked to die via task heartbeat 2014-09-25 15:25:52,230 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Interrupted while waiting for task to complete. Interrupting task 2014-09-25 15:25:52,230 INFO [main] org.apache.tez.runtime.task.TezTaskRunner: Shutdown requested... returning 2014-09-25 15:25:52,230 INFO [main] org.apache.tez.runtime.task.TezChild: Got a shouldDie notification via hearbeats. Shutting down 2014-09-25 15:25:52,331 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping TezTask metrics system... 2014-09-25 15:25:52,332 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system stopped. 2014-09-25 15:25:52,332 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system shutdown complete. Container: container_1406566393272_6236_01_000117 on cn105-10.l42scl.hortonworks.com_45454 ============================================================================================ LogType: stderr LogLength: 0 Log Contents: LogType: stdout LogLength: 21068 Log Contents: 3.173: [GC [PSYoungGen: 108914K->15654K(204288K)] 108914K->15662K(2068480K), 0.0735290 secs] [Times: user=0.30 sys=0.02, real=0.08 secs] 5.106: [GC [PSYoungGen: 106623K->25187K(379904K)] 106631K->25267K(2244096K), 0.0522090 secs] [Times: user=0.17 sys=0.06, real=0.05 secs] 7.117: [GC [PSYoungGen: 202026K->27757K(379904K)] 202106K->27853K(2244096K), 0.0583710 secs] [Times: user=0.26 sys=0.03, real=0.06 secs] 8.262: [GC [PSYoungGen: 206475K->24734K(403968K)] 206571K->24838K(2268160K), 0.0282450 secs] [Times: user=0.10 sys=0.03, real=0.03 secs] 9.147: [GC [PSYoungGen: 214946K->27149K(402944K)] 215050K->27261K(2267136K), 0.0268200 secs] [Times: user=0.32 sys=0.02, real=0.02 secs] 10.996: [GC [PSYoungGen: 386693K->28132K(394752K)] 386805K->28252K(2258944K), 0.0187190 secs] [Times: user=0.16 sys=0.01, real=0.02 secs] 12.874: [GC [PSYoungGen: 385280K->11794K(377344K)] 385400K->27802K(2241536K), 0.0581730 secs] [Times: user=0.27 sys=0.04, real=0.06 secs] 14.081: [GC [PSYoungGen: 220970K->6890K(394240K)] 236978K->31358K(2258432K), 0.0642570 secs] [Times: user=0.41 sys=0.04, real=0.07 secs] 17.640: [GC [PSYoungGen: 358323K->24622K(395776K)] 382791K->49554K(2259968K), 0.0150120 secs] [Times: user=0.06 sys=0.02, real=0.01 secs] 20.356: [GC [PSYoungGen: 264870K->17207K(393728K)] 289802K->44600K(2257920K), 0.0088020 secs] [Times: user=0.07 sys=0.00, real=0.01 secs] 20.540: [GC [PSYoungGen: 48085K->34347K(393728K)] 75479K->77681K(2257920K), 0.0347590 secs] [Times: user=0.42 sys=0.03, real=0.03 secs] 20.592: [GC [PSYoungGen: 39669K->608K(388608K)] 83003K->141216K(2252800K), 0.0355180 secs] [Times: user=0.30 sys=0.12, real=0.04 secs] 20.680: [GC [PSYoungGen: 17778K->40827K(390656K)] 158386K->202012K(2254848K), 0.0377850 secs] [Times: user=0.45 sys=0.04, real=0.04 secs] 20.784: [GC [PSYoungGen: 59009K->96K(378368K)] 220193K->191754K(2242560K), 0.0263940 secs] [Times: user=0.14 sys=0.03, real=0.03 secs] 20.949: [GC [PSYoungGen: 27516K->3648K(384512K)] 219174K->195314K(2248704K), 0.0107830 secs] [Times: user=0.04 sys=0.01, real=0.01 secs] 21.588: [GC [PSYoungGen: 48447K->8032K(382464K)] 240113K->203194K(2246656K), 0.0136970 secs] [Times: user=0.05 sys=0.02, real=0.01 secs] 22.525: [GC [PSYoungGen: 83132K->224K(383488K)] 278294K->203264K(2247680K), 0.0131870 secs] [Times: user=0.03 sys=0.02, real=0.02 secs] 24.444: [GC [PSYoungGen: 122237K->192K(384512K)] 325277K->203232K(2248704K), 0.0165090 secs] [Times: user=0.01 sys=0.01, real=0.02 secs] 25.107: [GC [PSYoungGen: 297067K->46584K(385024K)] 500107K->408498K(2249216K), 0.1045600 secs] [Times: user=1.09 sys=0.18, real=0.10 secs] 27.220: [GC [PSYoungGen: 235063K->32595K(268288K)] 1645553K->1532026K(2132480K), 0.1630700 secs] [Times: user=0.89 sys=0.17, real=0.16 secs] 28.054: [GC [PSYoungGen: 180347K->30976K(326656K)] 1679778K->1693046K(2190848K), 0.2639410 secs] [Times: user=4.14 sys=0.27, real=0.27 secs] 28.318: [Full GC [PSYoungGen: 30976K->0K(326656K)] [ParOldGen: 1662070K->1473150K(1929728K)] 1693046K->1473150K(2256384K) [PSPermGen: 30286K->30264K(60928K)], 0.2756830 secs] [Times: user=1.90 sys=0.08, real=0.27 secs] 31.405: [GC [PSYoungGen: 158894K->92576K(302592K)] 1632045K->1575966K(2232320K), 0.0354930 secs] [Times: user=0.57 sys=0.05, real=0.04 secs] 33.528: [GC [PSYoungGen: 253192K->113088K(316416K)] 1736582K->1668214K(2246144K), 0.0402300 secs] [Times: user=0.61 sys=0.09, real=0.04 secs] 36.147: [GC [PSYoungGen: 277929K->112960K(261120K)] 1833056K->1760262K(2190848K), 0.0532550 secs] [Times: user=0.41 sys=0.04, real=0.06 secs] 36.200: [Full GC [PSYoungGen: 112960K->0K(261120K)] [ParOldGen: 1647302K->1610535K(2145792K)] 1760262K->1610535K(2406912K) [PSPermGen: 30291K->30291K(68608K)], 0.1825990 secs] [Times: user=1.63 sys=0.01, real=0.18 secs] 38.593: [GC [PSYoungGen: 126128K->102720K(288768K)] 1736663K->1713255K(2434560K), 0.0383890 secs] [Times: user=0.54 sys=0.06, real=0.04 secs] 44.868: [GC [PSYoungGen: 230676K->92288K(288768K)] 2103355K->2046911K(2434560K), 0.0584480 secs] [Times: user=0.45 sys=0.11, real=0.06 secs] 44.927: [Full GC [PSYoungGen: 92288K->0K(288768K)] [ParOldGen: 1954623K->1863536K(2478592K)] 2046911K->1863536K(2767360K) [PSPermGen: 30300K->30300K(66048K)], 0.6086710 secs] [Times: user=7.45 sys=0.08, real=0.61 secs] 47.094: [GC [PSYoungGen: 126232K->102688K(288768K)] 1989769K->1966225K(2767360K), 0.0127270 secs] [Times: user=0.19 sys=0.01, real=0.01 secs] 48.979: [GC [PSYoungGen: 229592K->92576K(288768K)] 2093129K->2038057K(2767360K), 0.0146240 secs] [Times: user=0.24 sys=0.00, real=0.02 secs] 51.517: [GC [PSYoungGen: 220273K->92416K(288768K)] 2165754K->2109593K(2767360K), 0.0331230 secs] [Times: user=0.33 sys=0.06, real=0.04 secs] 53.687: [GC [PSYoungGen: 230484K->102720K(288768K)] 2247661K->2263265K(2767360K), 0.0397110 secs] [Times: user=0.51 sys=0.18, real=0.04 secs] 53.727: [Full GC [PSYoungGen: 102720K->0K(288768K)] [ParOldGen: 2160545K->2097216K(2879488K)] 2263265K->2097216K(3168256K) [PSPermGen: 30302K->30302K(62976K)], 0.2352060 secs] [Times: user=2.49 sys=0.04, real=0.24 secs] 65.769: [GC [PSYoungGen: 135136K->92448K(288768K)] 2756640K->2713952K(3168256K), 0.0118650 secs] [Times: user=0.19 sys=0.00, real=0.01 secs] 65.781: [Full GC [PSYoungGen: 92448K->0K(288768K)] [ParOldGen: 2621504K->2430904K(3289600K)] 2713952K->2430904K(3578368K) [PSPermGen: 30305K->30305K(59904K)], 0.1272440 secs] [Times: user=1.19 sys=0.03, real=0.13 secs] 68.103: [GC [PSYoungGen: 140396K->102752K(288768K)] 2571300K->2533656K(3578368K), 0.0201880 secs] [Times: user=0.22 sys=0.00, real=0.02 secs] 69.989: [GC [PSYoungGen: 243885K->30594K(288768K)] 2674790K->2543443K(3578368K), 0.0317890 secs] [Times: user=0.48 sys=0.00, real=0.03 secs] 72.060: [GC [PSYoungGen: 172914K->672K(288768K)] 2685763K->2536674K(3578368K), 0.0203180 secs] [Times: user=0.18 sys=0.01, real=0.02 secs] 72.146: [GC [PSYoungGen: 7304K->1029K(288768K)] 2543306K->2537143K(3578368K), 0.0434190 secs] [Times: user=0.29 sys=0.00, real=0.04 secs] 72.210: [GC [PSYoungGen: 3978K->285K(288768K)] 2540092K->2537023K(3578368K), 0.0490270 secs] [Times: user=0.25 sys=0.01, real=0.05 secs] 72.282: [GC [PSYoungGen: 4141K->192K(288768K)] 2540880K->2537034K(3578368K), 0.0311330 secs] [Times: user=0.18 sys=0.00, real=0.03 secs] 72.339: [GC [PSYoungGen: 5528K->192K(288768K)] 2542370K->2537098K(3578368K), 0.0136550 secs] [Times: user=0.13 sys=0.00, real=0.01 secs] 72.395: [GC [PSYoungGen: 7996K->512K(288768K)] 2544902K->2537550K(3578368K), 0.0189720 secs] [Times: user=0.15 sys=0.00, real=0.02 secs] 72.482: [GC [PSYoungGen: 118663K->102419K(288768K)] 2655702K->2639594K(3578368K), 0.0588820 secs] [Times: user=0.97 sys=0.01, real=0.06 secs] 72.541: [GC [PSYoungGen: 102419K->0K(288768K)] 2639594K->2639260K(3578368K), 0.0552620 secs] [Times: user=0.73 sys=0.04, real=0.06 secs] 72.597: [Full GC [PSYoungGen: 0K->0K(288768K)] [ParOldGen: 2639260K->112816K(895488K)] 2639260K->112816K(1184256K) [PSPermGen: 30643K->30642K(57344K)], 0.6349460 secs] [Times: user=0.27 sys=0.44, real=0.63 secs] 73.252: [GC [PSYoungGen: 105437K->102499K(288768K)] 218253K->262511K(1184256K), 0.0915850 secs] [Times: user=1.11 sys=0.04, real=0.09 secs] 73.363: [GC [PSYoungGen: 213125K->107960K(288768K)] 373136K->322762K(1184256K), 0.0646800 secs] [Times: user=0.80 sys=0.01, real=0.07 secs] 73.464: [GC [PSYoungGen: 210104K->100992K(288768K)] 424905K->462853K(1184256K), 0.0733390 secs] [Times: user=1.01 sys=0.03, real=0.08 secs] 73.537: [GC [PSYoungGen: 100992K->0K(288768K)] 462853K->515788K(1184256K), 0.1137040 secs] [Times: user=1.40 sys=0.05, real=0.11 secs] 73.651: [Full GC [PSYoungGen: 0K->0K(288768K)] [ParOldGen: 515788K->415626K(1262592K)] 515788K->415626K(1551360K) [PSPermGen: 30663K->30663K(54272K)], 0.0991630 secs] [Times: user=0.43 sys=0.02, real=0.10 secs] 74.204: [GC [PSYoungGen: 122637K->137752K(288768K)] 846800K->861915K(1551360K), 0.0847470 secs] [Times: user=0.90 sys=0.03, real=0.09 secs] 75.064: [GC [PSYoungGen: 163141K->34624K(288768K)] 887304K->874707K(1551360K), 0.0354960 secs] [Times: user=0.46 sys=0.01, real=0.04 secs] 75.693: [GC [PSYoungGen: 58929K->34528K(288768K)] 899012K->887429K(1551360K), 0.0259410 secs] [Times: user=0.31 sys=0.01, real=0.03 secs] 76.237: [GC [PSYoungGen: 72700K->45136K(288768K)] 925600K->911674K(1551360K), 0.0129530 secs] [Times: user=0.13 sys=0.01, real=0.01 secs] 76.897: [GC [PSYoungGen: 98104K->55792K(288768K)] 964642K->946004K(1551360K), 0.0145070 secs] [Times: user=0.22 sys=0.01, real=0.01 secs] 77.657: [GC [PSYoungGen: 110933K->43216K(288768K)] 1001145K->977013K(1551360K), 0.0264460 secs] [Times: user=0.37 sys=0.04, real=0.02 secs] 77.683: [Full GC [PSYoungGen: 43216K->0K(288768K)] [ParOldGen: 933797K->944316K(1821696K)] 977013K->944316K(2110464K) [PSPermGen: 30707K->30707K(51712K)], 0.0747680 secs] [Times: user=0.55 sys=0.03, real=0.08 secs] 78.522: [GC [PSYoungGen: 78953K->82368K(288768K)] 1023270K->1026684K(2110464K), 0.0203390 secs] [Times: user=0.20 sys=0.00, real=0.02 secs] 79.321: [GC [PSYoungGen: 166409K->71840K(288768K)] 1110725K->1087932K(2110464K), 0.0356560 secs] [Times: user=0.62 sys=0.07, real=0.04 secs] 80.260: [GC [PSYoungGen: 168098K->82240K(288768K)] 1184190K->1149548K(2110464K), 0.0305140 secs] [Times: user=0.47 sys=0.06, real=0.03 secs] 81.292: [GC [PSYoungGen: 193620K->102560K(288768K)] 1260929K->1292772K(2110464K), 0.0274230 secs] [Times: user=0.37 sys=0.15, real=0.03 secs] 82.268: [GC [PSYoungGen: 226162K->92320K(288768K)] 1416375K->1364461K(2110464K), 0.0218320 secs] [Times: user=0.29 sys=0.09, real=0.02 secs] 83.522: [GC [PSYoungGen: 221636K->102656K(288768K)] 1493777K->1538637K(2110464K), 0.0276520 secs] [Times: user=0.36 sys=0.23, real=0.03 secs] 84.978: [GC [PSYoungGen: 231609K->92480K(288768K)] 1667591K->1610413K(2110464K), 0.0225270 secs] [Times: user=0.37 sys=0.10, real=0.02 secs] 86.226: [GC [PSYoungGen: 220677K->122976K(288768K)] 1738610K->1804757K(2110464K), 0.0362000 secs] [Times: user=0.48 sys=0.23, real=0.03 secs] 86.263: [Full GC [PSYoungGen: 122976K->0K(288768K)] [ParOldGen: 1681781K->973313K(1887232K)] 1804757K->973313K(2176000K) [PSPermGen: 30708K->30708K(49152K)], 0.0971070 secs] [Times: user=1.12 sys=0.00, real=0.10 secs] 87.730: [GC [PSYoungGen: 138350K->112832K(288768K)] 1111664K->1086145K(2176000K), 0.0115540 secs] [Times: user=0.22 sys=0.00, real=0.01 secs] 89.308: [GC [PSYoungGen: 246227K->92320K(288768K)] 1219540K->1157801K(2176000K), 0.0233960 secs] [Times: user=0.44 sys=0.00, real=0.02 secs] 90.954: [GC [PSYoungGen: 233365K->102720K(288768K)] 1298846K->1260369K(2176000K), 0.0146060 secs] [Times: user=0.29 sys=0.01, real=0.02 secs] 92.757: [GC [PSYoungGen: 244641K->123072K(288768K)] 1402290K->1454809K(2176000K), 0.0195960 secs] [Times: user=0.37 sys=0.00, real=0.02 secs] 94.480: [GC [PSYoungGen: 255956K->92416K(288768K)] 1587694K->1547042K(2176000K), 0.0157360 secs] [Times: user=0.31 sys=0.00, real=0.01 secs] 96.588: [GC [PSYoungGen: 235400K->102752K(288768K)] 1690026K->1639314K(2176000K), 0.0142430 secs] [Times: user=0.28 sys=0.01, real=0.01 secs] 98.591: [GC [PSYoungGen: 246186K->102752K(288768K)] 1782748K->1731482K(2176000K), 0.0156260 secs] [Times: user=0.26 sys=0.00, real=0.01 secs] 100.578: [GC [PSYoungGen: 246563K->102688K(288768K)] 1875293K->1823602K(2176000K), 0.0229870 secs] [Times: user=0.44 sys=0.04, real=0.03 secs] 100.601: [Full GC [PSYoungGen: 102688K->0K(288768K)] [ParOldGen: 1720914K->1549209K(2458112K)] 1823602K->1549209K(2746880K) [PSPermGen: 30709K->30709K(46592K)], 0.1188280 secs] [Times: user=1.57 sys=0.01, real=0.12 secs] 102.712: [GC [PSYoungGen: 144035K->143840K(288768K)] 1693245K->1703290K(2746880K), 0.0139180 secs] [Times: user=0.27 sys=0.01, real=0.01 secs] 104.661: [GC [PSYoungGen: 288051K->102752K(288768K)] 1847501K->1785106K(2746880K), 0.0147310 secs] [Times: user=0.30 sys=0.00, real=0.01 secs] 106.696: [GC [PSYoungGen: 247107K->112960K(288768K)] 1929461K->1887482K(2746880K), 0.0223050 secs] [Times: user=0.41 sys=0.05, real=0.02 secs] 108.780: [GC [PSYoungGen: 257433K->102784K(288768K)] 2031955K->1969474K(2746880K), 0.0233400 secs] [Times: user=0.40 sys=0.10, real=0.02 secs] 110.827: [GC [PSYoungGen: 247287K->113024K(288768K)] 2113977K->2071882K(2746880K), 0.0242570 secs] [Times: user=0.41 sys=0.11, real=0.03 secs] 113.189: [GC [PSYoungGen: 257552K->102688K(288768K)] 2216410K->2153714K(2746880K), 0.0240300 secs] [Times: user=0.41 sys=0.10, real=0.03 secs] 113.671: [GC [PSYoungGen: 134014K->30976K(288768K)] 2185040K->2174170K(2746880K), 0.0208940 secs] [Times: user=0.35 sys=0.10, real=0.02 secs] 113.708: [GC [PSYoungGen: 31324K->0K(288768K)] 2174518K->2174078K(2746880K), 0.0185950 secs] [Times: user=0.37 sys=0.02, real=0.02 secs] 113.747: [GC [PSYoungGen: 464K->64K(288768K)] 2174543K->2174142K(2746880K), 0.0042170 secs] [Times: user=0.05 sys=0.00, real=0.01 secs] 113.779: [GC [PSYoungGen: 684K->0K(288768K)] 2174762K->2174110K(2746880K), 0.0035830 secs] [Times: user=0.05 sys=0.00, real=0.01 secs] 113.824: [GC [PSYoungGen: 912K->0K(288768K)] 2175022K->2174110K(2746880K), 0.0044690 secs] [Times: user=0.06 sys=0.00, real=0.00 secs] 113.851: [GC [PSYoungGen: 598K->64K(288768K)] 2174709K->2174174K(2746880K), 0.0041450 secs] [Times: user=0.06 sys=0.00, real=0.00 secs] 113.968: [GC [PSYoungGen: 12788K->20576K(288768K)] 2186899K->2194710K(2746880K), 0.0096830 secs] [Times: user=0.15 sys=0.00, real=0.01 secs] 114.124: [GC [PSYoungGen: 23940K->64K(288768K)] 2198074K->2194686K(2746880K), 0.0195480 secs] [Times: user=0.36 sys=0.03, real=0.02 secs] 114.144: [GC [PSYoungGen: 64K->0K(288768K)] 2194686K->2194646K(2746880K), 0.0054990 secs] [Times: user=0.05 sys=0.00, real=0.00 secs] 114.149: [Full GC [PSYoungGen: 0K->0K(288768K)] [ParOldGen: 2194646K->2133034K(3001856K)] 2194646K->2133034K(3290624K) [PSPermGen: 30714K->30714K(44544K)], 0.0877270 secs] [Times: user=0.71 sys=0.01, real=0.09 secs] 114.491: [GC [PSYoungGen: 16165K->20544K(288768K)] 2149200K->2153578K(3290624K), 0.0120370 secs] [Times: user=0.15 sys=0.01, real=0.01 secs] 114.824: [GC [PSYoungGen: 53100K->30816K(288768K)] 2186134K->2174106K(3290624K), 0.0135710 secs] [Times: user=0.16 sys=0.01, real=0.01 secs] 115.635: [GC [PSYoungGen: 95371K->51456K(196608K)] 2238662K->2215226K(3198464K), 0.0171920 secs] [Times: user=0.17 sys=0.00, real=0.02 secs] 117.241: [GC [PSYoungGen: 148754K->72000K(282624K)] 2312524K->2276738K(3284480K), 0.0350690 secs] [Times: user=0.36 sys=0.04, real=0.03 secs] 119.091: [GC [PSYoungGen: 185398K->133472K(284672K)] 2390137K->2461099K(3286528K), 0.0372180 secs] [Times: user=0.40 sys=0.37, real=0.04 secs] 121.115: [GC [PSYoungGen: 260000K->92480K(288768K)] 2587627K->2543003K(3290624K), 0.0290220 secs] [Times: user=0.42 sys=0.16, real=0.03 secs] 123.341: [GC [PSYoungGen: 222886K->92416K(288768K)] 2673410K->2624875K(3290624K), 0.0264910 secs] [Times: user=0.44 sys=0.11, real=0.03 secs] 125.482: [GC [PSYoungGen: 221138K->92384K(288768K)] 2753598K->2706771K(3290624K), 0.0253300 secs] [Times: user=0.39 sys=0.09, real=0.03 secs] 127.667: [GC [PSYoungGen: 231880K->102688K(288768K)] 2846268K->2799011K(3290624K), 0.0264170 secs] [Times: user=0.46 sys=0.10, real=0.03 secs] 129.953: [GC [PSYoungGen: 236539K->92448K(288768K)] 2932862K->2880939K(3290624K), 0.0276460 secs] [Times: user=0.45 sys=0.12, real=0.02 secs] 132.158: [GC [PSYoungGen: 234347K->102656K(288768K)] 3022839K->2983316K(3290624K), 0.0273040 secs] [Times: user=0.47 sys=0.13, real=0.03 secs] 132.185: [Full GC [PSYoungGen: 102656K->0K(288768K)] [ParOldGen: 2880659K->2794372K(3458560K)] 2983316K->2794372K(3747328K) [PSPermGen: 30717K->30717K(42496K)], 0.1946930 secs] [Times: user=2.87 sys=0.02, real=0.19 secs] 134.654: [GC [PSYoungGen: 142631K->102816K(288768K)] 2937004K->2897189K(3747328K), 0.0146030 secs] [Times: user=0.30 sys=0.00, real=0.01 secs] 136.942: [GC [PSYoungGen: 236522K->92448K(288768K)] 3030895K->2979005K(3747328K), 0.0200240 secs] [Times: user=0.39 sys=0.01, real=0.02 secs] 139.275: [GC [PSYoungGen: 235991K->102816K(288768K)] 3122548K->3071301K(3747328K), 0.0254280 secs] [Times: user=0.42 sys=0.10, real=0.02 secs] 141.585: [GC [PSYoungGen: 246655K->102784K(288768K)] 3215140K->3163437K(3747328K), 0.0281710 secs] [Times: user=0.47 sys=0.12, real=0.02 secs] 143.947: [GC [PSYoungGen: 246850K->102720K(288768K)] 3307503K->3255541K(3747328K), 0.0254740 secs] [Times: user=0.42 sys=0.12, real=0.02 secs] 146.289: [GC [PSYoungGen: 246971K->102752K(288768K)] 3399792K->3347741K(3747328K), 0.0283160 secs] [Times: user=0.50 sys=0.11, real=0.03 secs] 148.617: [GC [PSYoungGen: 247126K->102784K(288768K)] 3492115K->3532102K(3747328K), 0.0321000 secs] [Times: user=0.36 sys=0.33, real=0.03 secs] 148.649: [Full GC [PSYoungGen: 102784K->0K(288768K)] [ParOldGen: 3429317K->3429452K(3458560K)] 3532102K->3429452K(3747328K) [PSPermGen: 30719K->30719K(40960K)], 0.0991260 secs] [Times: user=0.55 sys=0.02, real=0.10 secs] 151.069: [Full GC [PSYoungGen: 144483K->71820K(288768K)] [ParOldGen: 3429452K->3449521K(3458560K)] 3573936K->3521341K(3747328K) [PSPermGen: 30719K->30719K(39424K)], 0.8394570 secs] [Times: user=17.18 sys=0.14, real=0.84 secs] 153.046: [Full GC [PSYoungGen: 139163K->112780K(288768K)] [ParOldGen: 3449521K->3449518K(3458560K)] 3588684K->3562298K(3747328K) [PSPermGen: 30719K->30719K(37888K)], 0.7540800 secs] [Times: user=15.54 sys=0.06, real=0.75 secs] 154.305: [Full GC [PSYoungGen: 144310K->133259K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593829K->3582777K(3747328K) [PSPermGen: 30719K->30719K(36864K)], 0.8009230 secs] [Times: user=16.63 sys=0.08, real=0.80 secs] 155.128: [Full GC [PSYoungGen: 134496K->133259K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3584014K->3582777K(3747328K) [PSPermGen: 30719K->30719K(35840K)], 0.8177250 secs] [Times: user=16.89 sys=0.10, real=0.81 secs] 155.985: [Full GC [PSYoungGen: 144276K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593794K->3593017K(3747328K) [PSPermGen: 30719K->30719K(35328K)], 0.0864990 secs] [Times: user=0.57 sys=0.00, real=0.09 secs] 156.105: [Full GC [PSYoungGen: 144276K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593794K->3593017K(3747328K) [PSPermGen: 30719K->30719K(34304K)], 0.0862650 secs] [Times: user=0.59 sys=0.00, real=0.09 secs] 156.226: [Full GC [PSYoungGen: 144276K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593794K->3593017K(3747328K) [PSPermGen: 30719K->30719K(33792K)], 0.0853680 secs] [Times: user=0.56 sys=0.01, real=0.09 secs] 156.344: [Full GC [PSYoungGen: 144286K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593804K->3593017K(3747328K) [PSPermGen: 30719K->30719K(33280K)], 0.0874640 secs] [Times: user=0.62 sys=0.01, real=0.09 secs] 156.466: [Full GC [PSYoungGen: 144276K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593794K->3593017K(3747328K) [PSPermGen: 30719K->30719K(33280K)], 0.0800880 secs] [Times: user=0.47 sys=0.00, real=0.09 secs] 156.582: [Full GC [PSYoungGen: 144276K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593794K->3593017K(3747328K) [PSPermGen: 30719K->30719K(32768K)], 0.0841950 secs] [Times: user=0.55 sys=0.00, real=0.09 secs] 156.701: [Full GC [PSYoungGen: 144276K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593794K->3593017K(3747328K) [PSPermGen: 30719K->30719K(32256K)], 0.0876900 secs] [Times: user=0.59 sys=0.01, real=0.09 secs] 156.808: [Full GC [PSYoungGen: 143946K->143499K(288768K)] [ParOldGen: 3449518K->3449518K(3458560K)] 3593464K->3593017K(3747328K) [PSPermGen: 30719K->30719K(32256K)], 0.0857730 secs] [Times: user=0.58 sys=0.00, real=0.08 secs] 156.894: [Full GC [PSYoungGen: 143499K->143499K(288768K)] [ParOldGen: 3449518K->3448916K(3458560K)] 3593017K->3592416K(3747328K) [PSPermGen: 30719K->30699K(31744K)], 0.8965060 secs] [Times: user=18.47 sys=0.09, real=0.90 secs] 157.802: [Full GC [PSYoungGen: 144276K->0K(288768K)] [ParOldGen: 3448918K->68314K(1510400K)] 3593195K->68314K(1799168K) [PSPermGen: 30737K->30737K(31744K)], 0.3405140 secs] [Times: user=0.26 sys=0.27, real=0.34 secs] Heap PSYoungGen total 288768K, used 23653K [0x00000007e5980000, 0x0000000800000000, 0x0000000800000000) eden space 144896K, 16% used [0x00000007e5980000,0x00000007ee6685f8,0x00000007ee700000) lgrp 0 space 144264K, 16% used [0x00000007e5980000,0x00000007e7093130,0x00000007ee662000) lgrp 1 space 632K, 4% used [0x00000007ee662000,0x00000007ee6685f8,0x00000007ee700000) from space 143872K, 0% used [0x00000007f7380000,0x00000007f7380000,0x0000000800000000) to space 143872K, 0% used [0x00000007ee700000,0x00000007ee700000,0x00000007f7380000) ParOldGen total 1510400K, used 68314K [0x0000000712800000, 0x000000076eb00000, 0x00000007e5980000) object space 1510400K, 4% used [0x0000000712800000,0x0000000716ab6850,0x000000076eb00000) PSPermGen total 31744K, used 30805K [0x000000070d600000, 0x000000070f500000, 0x0000000712800000) object space 31744K, 97% used [0x000000070d600000,0x000000070f4155f0,0x000000070f500000) LogType: syslog LogLength: 3092 Log Contents: 2014-09-25 15:25:36,203 INFO [main] org.apache.tez.runtime.task.TezChild: TezChild starting 2014-09-25 15:25:37,176 INFO [main] org.apache.tez.runtime.task.TezChild: PID, containerIdentifier: 26913, container_1406566393272_6236_01_000117 2014-09-25 15:25:37,283 INFO [main] org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2014-09-25 15:25:37,441 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 60 second(s). 2014-09-25 15:25:37,441 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TezTask metrics system started 2014-09-25 15:25:37,632 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:38,160 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_09_000019_0 2014-09-25 15:25:38,161 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_09_000019_0 2014-09-25 15:25:49,669 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:49,675 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_15_000038_0 2014-09-25 15:25:49,675 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_15_000038_0 2014-09-25 15:25:55,469 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:25:56,069 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 593 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_15_000098_0 2014-09-25 15:25:56,069 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_15_000098_0 2014-09-25 15:26:00,482 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:26:00,489 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_28_000018_0 2014-09-25 15:26:00,489 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_28_000018_0 2014-09-25 15:26:47,974 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Attempting to fetch new task 2014-09-25 15:26:47,980 INFO [TezChild] org.apache.tez.runtime.task.ContainerReporter: Got TaskUpdate: 0 ms after starting to poll. TaskInfo: shouldDie: false, currentTaskAttemptId: attempt_1406566393272_6236_1_26_000000_0 2014-09-25 15:26:47,980 INFO [main] org.apache.tez.common.TezUtilsInternal: Redirecting log file based on addend: attempt_1406566393272_6236_1_26_000000_0 LogType: syslog_attempt_1406566393272_6236_1_09_000019_0 LogLength: 412535 Log Contents: 2014-09-25 15:25:38,169 INFO [main] org.apache.tez.runtime.task.TezChild: Refreshing UGI since Credentials have changed 2014-09-25 15:25:38,169 INFO [main] org.apache.tez.runtime.task.TezChild: Credentials : #Tokens=1, #SecretKeys=0 2014-09-25 15:25:38,170 INFO [main] org.apache.tez.runtime.task.TezChild: Localizing additional local resources for Task : {} 2014-09-25 15:25:38,174 INFO [main] org.apache.tez.runtime.task.TezChild: Done localizing additional resources 2014-09-25 15:25:38,361 INFO [main] org.apache.tez.runtime.metrics.TaskCounterUpdater: Using ResourceCalculatorProcessTree : [ ] 2014-09-25 15:25:38,647 INFO [main] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalIOProcessorRuntimeTask with TaskSpec: DAGName : mmokhtar_20140925152424_2a2aba5a-d40c-42e4-82fe-42357fe0b3a6:1, VertexName: Map 42, VertexParallelism: 44, TaskAttemptID:attempt_1406566393272_6236_1_09_000019_0, processorName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor, inputSpecListSize=1, outputSpecListSize=1, inputSpecList=[{{ sourceVertexName=catalog_returns, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy }}, ], outputSpecList=[{{ destinationVertexName=Map 19, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.UnorderedKVOutput }}, ] 2014-09-25 15:25:38,652 INFO [main] org.apache.tez.runtime.common.resources.MemoryDistributor: InitialMemoryDistributor (isEnabled=true) invoked with: numInputs=1, numOutputs=1, JVM.maxFree=3837263872 2014-09-25 15:25:38,679 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Initializing task, taskAttemptId=attempt_1406566393272_6236_1_09_000019_0 2014-09-25 15:25:38,679 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing LogicalProcessorIORuntimeTask 2014-09-25 15:25:38,679 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:38,738 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input using InputSpec: { sourceVertexName=catalog_returns, physicalEdgeCount=1, inputClassName=org.apache.tez.mapreduce.input.MRInputLegacy } 2014-09-25 15:25:38,740 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:38,740 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:38,742 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output using OutputSpec: { destinationVertexName=Map 19, physicalEdgeCount=1, outputClassName=org.apache.tez.runtime.library.output.UnorderedKVOutput } 2014-09-25 15:25:38,744 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Output 2014-09-25 15:25:38,753 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Output with dest edge: Map 19 2014-09-25 15:25:38,755 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Creating Input 2014-09-25 15:25:38,766 INFO [Initializer 1] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: OUTPUT, componentVertexName: Map 19 2014-09-25 15:25:38,767 INFO [Initializer 1] org.apache.tez.runtime.library.output.UnorderedKVOutput: UnorderedKVOutput running with params -> dataViaEventsEnabled: false, dataViaEventsMaxSize: 204800 2014-09-25 15:25:38,768 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initializing Input with src edge: catalog_returns 2014-09-25 15:25:38,768 INFO [Initializer 0] org.apache.tez.runtime.common.resources.MemoryDistributor$RequestorInfo: Received request: 0, type: INPUT, componentVertexName: catalog_returns 2014-09-25 15:25:38,769 INFO [Initializer 1] org.apache.tez.common.counters.Limits: Counter limits initialized with parameters: GROUP_NAME_MAX=128, MAX_GROUPS=500, COUNTER_NAME_MAX=64, MAX_COUNTERS=1200 2014-09-25 15:25:38,837 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed 2014-09-25 15:25:38,852 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive 2014-09-25 15:25:38,863 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id 2014-09-25 15:25:38,863 INFO [TezChild] org.apache.hadoop.conf.Configuration.deprecation: mapred.task.partition is deprecated. Instead, use mapreduce.task.partition 2014-09-25 15:25:38,863 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:38,864 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized processor, processorClassName=org.apache.hadoop.hive.ql.exec.tez.MapTezProcessor 2014-09-25 15:25:38,864 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 2 initializers to finish 2014-09-25 15:25:38,866 INFO [Initializer 1] org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter: Created KVWriter -> compressionCodec: NoCompressionCodec 2014-09-25 15:25:38,882 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInput: Using New mapreduce API: false, split information via event: true 2014-09-25 15:25:38,882 INFO [Initializer 0] org.apache.tez.mapreduce.input.MRInputLegacy: MRInputLegacy deferring initialization 2014-09-25 15:25:38,882 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Input with src edge: catalog_returns 2014-09-25 15:25:38,882 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 initializers to finish 2014-09-25 15:25:38,889 INFO [Initializer 1] org.apache.tez.runtime.library.broadcast.output.FileBasedKVWriter: Writing data file: /grid/3/cluster/yarn/local/usercache/mmokhtar/appcache/application_1406566393272_6236/output/attempt_1406566393272_6236_1_09_000019_0_10003/file.out 2014-09-25 15:25:38,910 INFO [Initializer 1] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Initialized Output with dest edge: Map 19 2014-09-25 15:25:38,910 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: All initializers finished 2014-09-25 15:25:39,015 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Using Allocator class: org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor 2014-09-25 15:25:39,108 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.runtime.library.output.UnorderedKVOutput 2014-09-25 15:25:39,109 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,109 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Falling back to RequestType.OTHER for class: org.apache.tez.mapreduce.input.MRInputLegacy 2014-09-25 15:25:39,109 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: ScaleFactor: 1, for type: OTHER 2014-09-25 15:25:39,111 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: InitialReservationFraction=0.3, AdditionalReservationFractionForIOs=0.03, finalReserveFractionUsed=0.32999999999999996 2014-09-25 15:25:39,111 INFO [TezChild] org.apache.tez.runtime.library.resources.WeightedScalingMemoryDistributor: Scaling Requests. NumRequests: 2, numScaledRequests: 2, TotalRequested: 0, TotalRequestedScaled: 0.0, TotalJVMHeap: 3837263872, TotalAvailable: 2570966794, TotalRequested/TotalJVMHeap:0.00 2014-09-25 15:25:39,111 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: OUTPUT, Map 19, org.apache.tez.runtime.library.output.UnorderedKVOutput: requested=0, allocated=0 2014-09-25 15:25:39,111 INFO [TezChild] org.apache.tez.runtime.common.resources.MemoryDistributor: Informing: INPUT, catalog_returns, org.apache.tez.mapreduce.input.MRInputLegacy: requested=0, allocated=0 2014-09-25 15:25:39,111 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Inputs/Outputs 2014-09-25 15:25:39,113 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Input: catalog_returns being auto started by the framework. Subsequent instances will not be auto-started 2014-09-25 15:25:39,113 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Starting Input with src edge: catalog_returns 2014-09-25 15:25:39,113 INFO [Initializer 0] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Started Input with src edge: catalog_returns 2014-09-25 15:25:39,113 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Num IOs determined for AutoStart: 1 2014-09-25 15:25:39,113 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: Waiting for 1 IOs to start 2014-09-25 15:25:39,113 INFO [TezChild] org.apache.tez.runtime.LogicalIOProcessorRuntimeTask: AutoStartComplete 2014-09-25 15:25:39,116 INFO [TezChild] org.apache.tez.runtime.task.TezTaskRunner: Running task, taskAttemptId=attempt_1406566393272_6236_1_09_000019_0 2014-09-25 15:25:39,116 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.TezProcessor: Running task: attempt_1406566393272_6236_1_09_000019_0_10001 2014-09-25 15:25:39,306 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:39,306 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Deserializing MapWork via kryo 2014-09-25 15:25:40,021 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,021 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.ObjectCache: Adding __MAP_PLAN__ to cache with value org.apache.hadoop.hive.ql.plan.MapWork@7eb37922 2014-09-25 15:25:40,027 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:40,028 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: maximum memory = 3837263872 2014-09-25 15:25:40,028 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: The input names are: [catalog_returns] 2014-09-25 15:25:40,029 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialzed MRInput: catalog_returns 2014-09-25 15:25:40,029 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initializing RecordReader from event 2014-09-25 15:25:40,078 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Split Details -> SplitClass: org.apache.hadoop.mapred.split.TezGroupedSplit, OldSplit: org.apache.hadoop.mapred.split.TezGroupedSplit@7ae72156 2014-09-25 15:25:40,096 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,052 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,137 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:41,137 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684/000023_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:41,231 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:41,231 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684/000023_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1114598, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:41,242 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:41,261 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684/000023_0 2014-09-25 15:25:41,261 INFO [TezChild] org.apache.tez.mapreduce.lib.MRReaderMapred: Processing split: org.apache.hadoop.mapred.split.TezGroupedSplit@7ae72156 2014-09-25 15:25:41,263 INFO [TezChild] org.apache.tez.mapreduce.input.MRInput: Initialized RecordReader from event 2014-09-25 15:25:41,265 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Main input name is Map 42 2014-09-25 15:25:41,814 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: dump TS[0] struct 2014-09-25 15:25:41,983 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor: Id =4 Id =0 Id =1 Id =2 Id =3 <\Children> Id = 2 null<\Parent> <\RS> <\Children> Id = 1 null<\Parent> <\SEL> <\Children> Id = 0 null<\Parent> <\FIL> <\Children> Id = 4 null<\Parent> <\TS> <\Children> <\Parent> <\MAP> 2014-09-25 15:25:41,989 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initializing Self MAP[4] 2014-09-25 15:25:41,990 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing Self TS[0] 2014-09-25 15:25:41,990 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Operator 0 TS initialized 2014-09-25 15:25:41,990 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initializing children of 0 TS 2014-09-25 15:25:41,990 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing child 1 FIL 2014-09-25 15:25:41,990 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing Self FIL[1] 2014-09-25 15:25:41,991 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Operator 1 FIL initialized 2014-09-25 15:25:41,991 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initializing children of 1 FIL 2014-09-25 15:25:41,991 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing child 2 SEL 2014-09-25 15:25:41,991 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing Self SEL[2] 2014-09-25 15:25:41,998 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Operator 2 SEL initialized 2014-09-25 15:25:41,998 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initializing children of 2 SEL 2014-09-25 15:25:41,998 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing child 3 RS 2014-09-25 15:25:41,998 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initializing Self RS[3] 2014-09-25 15:25:42,032 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Using tag = 1 2014-09-25 15:25:42,033 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorReduceSinkOperator: Initialization Done 3 RS 2014-09-25 15:25:42,033 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator: Initialization Done 2 SEL 2014-09-25 15:25:42,033 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator: Initialization Done 1 FIL 2014-09-25 15:25:42,033 INFO [TezChild] org.apache.hadoop.hive.ql.exec.TableScanOperator: Initialization Done 0 TS 2014-09-25 15:25:42,057 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Initialization Done 4 MAP 2014-09-25 15:25:42,059 INFO [TezChild] org.apache.hadoop.hive.ql.exec.OperatorUtils: Setting output collector: RS[3] --> Map 19 2014-09-25 15:25:42,059 INFO [TezChild] org.apache.hadoop.hive.ql.log.PerfLogger: 2014-09-25 15:25:42,109 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,165 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: TezProcessor: processing 1 rows/groups: used memory = 149396088 2014-09-25 15:25:42,173 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,245 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,313 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,366 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,401 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,430 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,456 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,479 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,501 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,517 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: TezProcessor: processing 10 rows/groups: used memory = 157094200 2014-09-25 15:25:42,523 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,544 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,562 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,577 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,591 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,605 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,612 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,619 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,624 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451684 2014-09-25 15:25:42,629 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,639 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,678 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:42,678 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:42,710 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,710 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1094580, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:42,719 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,722 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688/000025_0 2014-09-25 15:25:42,732 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,738 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,744 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,750 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,755 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,760 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,766 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,772 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,777 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,783 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,788 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,793 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,799 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,804 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,810 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,815 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,820 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,825 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451688 2014-09-25 15:25:42,831 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,841 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,879 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:42,879 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699/000020_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:42,923 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:42,923 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699/000020_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1026105, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:42,932 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:42,935 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699/000020_0 2014-09-25 15:25:42,945 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:42,949 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:42,954 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:42,959 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:42,964 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:42,969 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:42,973 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,039 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,043 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,047 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,051 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,054 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,056 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,059 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,063 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,067 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,072 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451699 2014-09-25 15:25:43,077 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,088 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,117 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,117 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731/000008_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,141 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,141 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731/000008_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 864593, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,149 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,152 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731/000008_0 2014-09-25 15:25:43,158 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,160 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,164 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,168 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,172 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,176 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,180 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,184 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,189 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,193 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,197 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,201 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,205 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,209 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451731 2014-09-25 15:25:43,215 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,231 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,265 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,265 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742/000016_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,306 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,306 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742/000016_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 782543, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,314 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,317 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742/000016_0 2014-09-25 15:25:43,323 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,327 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,331 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,334 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,338 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,342 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,347 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,350 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,354 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,358 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,361 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,364 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,368 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451742 2014-09-25 15:25:43,372 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,388 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,418 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,418 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776/000005_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,453 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,453 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776/000005_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 616625, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,469 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,471 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776/000005_0 2014-09-25 15:25:43,477 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,490 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,494 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,507 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,511 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,515 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,519 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,522 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,526 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,531 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451776 2014-09-25 15:25:43,536 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,545 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,581 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,581 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818/000000_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,610 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,610 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818/000000_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 631357, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,616 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,619 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818/000000_0 2014-09-25 15:25:43,626 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,630 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,634 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,638 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,642 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,647 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,651 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,660 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,662 INFO [TezChild] org.apache.hadoop.hive.ql.exec.tez.RecordProcessor: TezProcessor: processing 100 rows/groups: used memory = 125008640 2014-09-25 15:25:43,664 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,668 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451818 2014-09-25 15:25:43,671 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,680 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,709 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,710 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,729 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,729 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 686553, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,735 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,738 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840/000012_0 2014-09-25 15:25:43,744 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,749 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,753 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,757 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,761 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,766 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,771 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,775 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,780 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,784 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,789 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,793 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451840 2014-09-25 15:25:43,796 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,805 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,834 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,834 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,858 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,858 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 678441, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,865 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,868 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839/000025_0 2014-09-25 15:25:43,873 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,878 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,882 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,886 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,889 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,894 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,898 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,902 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,907 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,911 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,915 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451839 2014-09-25 15:25:43,920 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,929 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,960 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:43,960 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845/000010_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,978 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:43,979 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845/000010_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 705315, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:43,983 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:43,984 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845/000010_0 2014-09-25 15:25:43,989 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:43,991 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:43,993 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:43,995 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:43,999 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,002 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,005 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,007 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,009 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,011 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,013 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,015 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451845 2014-09-25 15:25:44,019 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,028 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,047 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,048 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,073 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,074 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 787096, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,078 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,080 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866/000012_0 2014-09-25 15:25:44,086 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,088 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,090 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,093 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,097 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,099 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,101 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,105 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,109 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,112 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,114 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,118 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451866 2014-09-25 15:25:44,152 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,161 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,189 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,189 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902/000013_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,211 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,212 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902/000013_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 977777, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,216 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,217 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902/000013_0 2014-09-25 15:25:44,223 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,228 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,233 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,237 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,242 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,246 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,250 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,254 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,258 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,261 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,266 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,270 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,278 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,282 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,286 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,289 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451902 2014-09-25 15:25:44,294 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,302 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,322 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,322 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901/000005_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,335 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,335 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901/000005_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 983554, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,339 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,341 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901/000005_0 2014-09-25 15:25:44,345 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,348 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,350 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,352 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,355 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,357 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,359 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,361 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,363 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,365 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,368 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,370 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,372 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,374 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,376 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,378 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451901 2014-09-25 15:25:44,381 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,387 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,404 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,404 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913/000023_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,428 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,428 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913/000023_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1046234, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,431 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,433 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913/000023_0 2014-09-25 15:25:44,438 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,440 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,443 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,445 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,447 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,450 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,452 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,454 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,457 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,459 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,461 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,463 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,465 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,467 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,469 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,472 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,474 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451913 2014-09-25 15:25:44,476 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,482 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,498 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,498 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920/000023_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,514 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,514 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920/000023_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1091130, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,519 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,522 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920/000023_0 2014-09-25 15:25:44,529 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,533 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,536 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,540 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,543 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,547 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,551 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,554 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,557 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,559 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,561 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,563 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,565 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,567 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,569 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,571 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,574 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,576 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451920 2014-09-25 15:25:44,578 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,583 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,607 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,607 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943/000008_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,624 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,624 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943/000008_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1212090, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,629 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,631 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943/000008_0 2014-09-25 15:25:44,638 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,642 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,646 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,649 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,654 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,658 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,661 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,665 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,669 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,673 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,676 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,680 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,684 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,687 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,691 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,694 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,696 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,699 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,701 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,703 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451943 2014-09-25 15:25:44,705 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,712 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,747 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,747 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946/000024_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,761 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,761 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946/000024_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1228169, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,765 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,766 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946/000024_0 2014-09-25 15:25:44,772 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,774 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,776 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,778 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,781 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,783 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,785 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,787 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,789 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,792 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,794 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,796 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,798 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,800 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,803 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,805 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,807 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,809 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,811 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,814 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451946 2014-09-25 15:25:44,816 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,823 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,853 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,853 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962/000007_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,876 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,876 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962/000007_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1291120, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:44,882 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,885 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962/000007_0 2014-09-25 15:25:44,894 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,899 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,903 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,908 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,914 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,918 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,922 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,924 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,927 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,929 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,932 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,934 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,938 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,942 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,950 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,953 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,956 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,958 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,961 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,963 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451962 2014-09-25 15:25:44,966 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:44,971 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:44,994 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:44,994 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977/000013_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,040 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,040 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977/000013_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1319392, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,045 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,047 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977/000013_0 2014-09-25 15:25:45,054 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,057 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,059 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,062 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,064 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,067 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,069 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,071 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,074 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,077 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,079 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,082 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,084 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,087 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,091 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,094 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,097 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,100 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,103 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,105 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,108 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,112 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2451977 2014-09-25 15:25:45,116 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,125 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,179 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,179 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,235 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,236 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1288915, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,242 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,244 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001/000015_0 2014-09-25 15:25:45,265 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,275 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,282 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,286 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,290 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,292 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,295 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,297 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,300 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,302 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,304 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,307 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,309 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,312 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,314 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,317 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,319 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,322 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,324 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,327 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,329 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452001 2014-09-25 15:25:45,332 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,337 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,360 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,360 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,378 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,378 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1226791, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,382 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,384 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022/000015_0 2014-09-25 15:25:45,392 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,394 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,397 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,399 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,402 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,404 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,407 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,409 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,411 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,414 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,416 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,419 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,421 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,424 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,426 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,429 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,431 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,434 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,436 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,438 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452022 2014-09-25 15:25:45,441 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,446 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,469 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,469 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,489 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,490 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1185989, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,494 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,495 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034/000015_0 2014-09-25 15:25:45,502 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,505 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,507 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,510 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,512 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,515 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,517 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,520 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,522 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,525 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,527 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,530 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,532 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,534 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,537 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,539 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,542 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,544 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,547 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,549 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452034 2014-09-25 15:25:45,551 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,556 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,579 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,579 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035/000003_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,612 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,612 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035/000003_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1180697, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,617 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,618 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035/000003_0 2014-09-25 15:25:45,625 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,627 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,630 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,632 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,635 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,637 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,640 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,642 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,645 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,647 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,650 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,652 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,655 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,657 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,659 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,662 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,665 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,667 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,669 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,672 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452035 2014-09-25 15:25:45,673 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,679 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,702 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,702 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,724 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,724 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1161309, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,728 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,730 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036/000012_0 2014-09-25 15:25:45,736 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,739 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,741 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,744 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,746 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,749 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,751 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,754 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,756 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,759 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,761 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,763 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,766 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,768 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,771 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,773 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,776 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,778 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,781 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452036 2014-09-25 15:25:45,783 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,789 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,812 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,812 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,834 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,835 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1099219, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,839 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,840 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050/000025_0 2014-09-25 15:25:45,847 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,849 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,852 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,855 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,857 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,860 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,862 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,864 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,867 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,869 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,872 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,874 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,877 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,879 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,882 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,884 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,887 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,889 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452050 2014-09-25 15:25:45,892 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,897 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,914 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:45,914 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067/000000_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,933 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:45,933 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067/000000_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1014353, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:45,936 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,938 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067/000000_0 2014-09-25 15:25:45,943 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,945 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,947 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,949 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,951 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,953 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,956 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,958 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,960 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,962 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,964 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,967 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,969 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,971 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,973 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,975 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,977 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452067 2014-09-25 15:25:45,979 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:45,989 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,009 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,009 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,041 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,041 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 925976, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,044 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,045 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086/000025_0 2014-09-25 15:25:46,050 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,053 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,055 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,057 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,060 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,062 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,064 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,066 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,068 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,070 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,073 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,075 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,077 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,079 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,081 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452086 2014-09-25 15:25:46,084 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,089 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,105 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,105 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,117 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,117 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 895750, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,120 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,121 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089/000025_0 2014-09-25 15:25:46,126 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,128 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,131 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,133 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,135 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,138 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,140 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,144 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,147 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,150 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,152 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,155 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,157 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,159 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,161 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452089 2014-09-25 15:25:46,163 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,168 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,185 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,185 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,197 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,197 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 875263, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,200 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,202 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091/000025_0 2014-09-25 15:25:46,206 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,209 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,211 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,214 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,216 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,219 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,222 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,224 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,226 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,228 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,230 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,233 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,235 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,237 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,239 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452091 2014-09-25 15:25:46,241 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,245 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,263 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,264 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,294 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,294 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 887326, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,353 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,355 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090/000025_0 2014-09-25 15:25:46,363 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,368 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,375 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,386 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,394 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,404 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,408 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,428 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,442 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,446 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,460 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,463 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,474 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,478 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,486 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452090 2014-09-25 15:25:46,494 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,505 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,564 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,564 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118/000011_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,591 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,591 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118/000011_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 722899, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,603 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118/000011_0 2014-09-25 15:25:46,609 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,614 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,618 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,621 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,625 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,629 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,632 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,639 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,643 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,646 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,650 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452118 2014-09-25 15:25:46,654 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,662 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,695 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,695 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133/000027_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,712 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,712 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133/000027_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 654593, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,715 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,716 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133/000027_0 2014-09-25 15:25:46,721 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,723 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,726 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,728 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,731 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,733 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,736 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,738 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,741 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,743 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,746 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452133 2014-09-25 15:25:46,748 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,754 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,773 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,773 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135/000014_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,801 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,801 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135/000014_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 636254, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,805 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,806 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135/000014_0 2014-09-25 15:25:46,810 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,813 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,816 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,818 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,821 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,824 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,827 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,829 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,832 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,834 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,836 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452135 2014-09-25 15:25:46,838 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,843 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,889 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,889 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137/000010_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,910 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,911 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137/000010_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 630184, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,915 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,917 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137/000010_0 2014-09-25 15:25:46,923 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,928 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,932 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,936 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,940 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,943 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,945 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,949 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,953 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,961 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,964 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452137 2014-09-25 15:25:46,966 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:46,971 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,987 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:46,988 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146/000029_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:46,998 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:46,998 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146/000029_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 613636, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,001 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,003 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146/000029_0 2014-09-25 15:25:47,007 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,009 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,011 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,014 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,016 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,018 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,020 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,022 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,025 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,028 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452146 2014-09-25 15:25:47,030 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,035 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,052 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,052 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162/000016_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,078 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,078 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162/000016_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 589592, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,081 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,083 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162/000016_0 2014-09-25 15:25:47,087 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,089 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,092 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,095 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,097 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,099 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,102 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,105 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,108 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,112 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452162 2014-09-25 15:25:47,114 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,119 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,141 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,142 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,163 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,163 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 600173, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,167 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,169 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177/000015_0 2014-09-25 15:25:47,174 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,179 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,183 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,188 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,192 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,196 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,200 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,203 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,208 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,212 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452177 2014-09-25 15:25:47,216 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,221 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,238 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,238 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203/000004_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,249 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,249 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203/000004_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 677718, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,253 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,254 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203/000004_0 2014-09-25 15:25:47,258 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,261 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,264 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,266 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,269 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,271 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,274 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,276 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,278 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,281 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,283 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452203 2014-09-25 15:25:47,286 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,291 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,308 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,308 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211/000026_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,318 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,318 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211/000026_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 697139, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,321 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,323 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211/000026_0 2014-09-25 15:25:47,327 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,330 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,333 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,336 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,341 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,346 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,351 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,355 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,360 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,364 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,366 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,368 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452211 2014-09-25 15:25:47,370 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,375 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,392 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,392 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204/000029_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,411 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,411 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204/000029_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 669262, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,414 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,415 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204/000029_0 2014-09-25 15:25:47,420 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,422 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,424 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,427 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,429 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,431 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,433 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,436 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,438 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,440 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,443 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452204 2014-09-25 15:25:47,445 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,450 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,470 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,470 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217/000008_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,491 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,491 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217/000008_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 720123, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,496 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,498 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217/000008_0 2014-09-25 15:25:47,502 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,505 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,509 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,511 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,514 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,516 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,518 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,522 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,524 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,526 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,528 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,531 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452217 2014-09-25 15:25:47,533 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,539 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,556 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,556 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248/000021_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,575 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,575 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248/000021_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 863215, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,580 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,582 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248/000021_0 2014-09-25 15:25:47,589 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,592 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,597 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,601 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,606 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,612 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,616 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,621 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,626 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,631 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,636 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,640 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,644 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,648 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452248 2014-09-25 15:25:47,652 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,658 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,679 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,679 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284/000004_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,710 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,710 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284/000004_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1068479, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,714 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,715 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284/000004_0 2014-09-25 15:25:47,721 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,724 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,727 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,730 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,733 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,736 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,739 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,743 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,746 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,748 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,751 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,754 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,757 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,760 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,762 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,765 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,769 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,771 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452284 2014-09-25 15:25:47,773 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,782 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,811 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:47,811 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,841 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:47,841 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286/000012_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1084415, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:47,847 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:47,849 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286/000012_0 2014-09-25 15:25:47,855 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,860 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,865 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,870 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,876 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,885 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,895 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,903 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,914 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,922 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,927 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,941 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,946 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,957 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,965 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,976 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,985 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:47,993 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452286 2014-09-25 15:25:48,002 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,010 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,039 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:48,039 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,101 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,102 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1131741, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,121 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,123 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295/000025_0 2014-09-25 15:25:48,138 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,142 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,146 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,153 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,157 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,162 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,166 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,171 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,175 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,180 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,185 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,189 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,194 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,198 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,202 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,208 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,212 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,216 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,221 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452295 2014-09-25 15:25:48,223 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,230 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,259 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:48,260 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291/000004_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,290 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,291 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291/000004_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1113004, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,296 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,298 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291/000004_0 2014-09-25 15:25:48,306 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,314 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,320 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,326 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,331 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,336 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,341 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,347 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,352 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,357 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,362 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,367 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,373 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,377 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,382 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,385 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,387 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,390 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452291 2014-09-25 15:25:48,393 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,398 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,426 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:48,426 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,476 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,477 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300/000015_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1173199, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,481 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,483 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300/000015_0 2014-09-25 15:25:48,491 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,496 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,500 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,504 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,509 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,513 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,518 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,522 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,527 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,531 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,536 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,540 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,544 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,549 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,554 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,558 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,563 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,568 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,572 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452300 2014-09-25 15:25:48,577 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,582 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,613 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:48,613 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,646 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,646 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1219057, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,651 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,653 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308/000025_0 2014-09-25 15:25:48,662 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,667 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,671 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,675 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,679 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,683 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,687 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,690 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,693 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,695 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,698 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,702 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,707 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,712 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,714 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,717 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,722 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,727 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,791 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,794 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452308 2014-09-25 15:25:48,797 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,802 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,821 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:48,821 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304/000026_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,836 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,837 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304/000026_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1185066, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,841 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,843 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304/000026_0 2014-09-25 15:25:48,850 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,855 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,860 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,864 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,869 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,873 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,875 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,878 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,883 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,888 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,893 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,897 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,901 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,907 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,912 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,918 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,923 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,927 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,932 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,937 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452304 2014-09-25 15:25:48,940 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:48,949 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,978 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:48,979 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315/000007_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:48,997 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:48,997 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315/000007_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1248302, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:49,001 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:49,003 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315/000007_0 2014-09-25 15:25:49,010 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,014 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,017 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,020 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,023 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,026 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,028 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,031 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,035 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,039 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,044 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,049 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,054 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,059 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,064 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,066 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,069 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,071 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,074 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,077 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,080 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452315 2014-09-25 15:25:49,082 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:49,088 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:49,116 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:49,116 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:49,139 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:49,139 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 1283170, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)), columns: ['null', 'null', 'cr_item_sk', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_order_number', 'null', 'null', 'null', 'null', 'null', 'null', 'cr_refunded_cash', 'cr_reversed_charge', 'cr_store_credit', 'null']} 2014-09-25 15:25:49,144 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:49,146 INFO [TezChild] org.apache.hadoop.hive.ql.io.HiveContextAwareRecordReader: Processing file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328/000025_0 2014-09-25 15:25:49,155 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,161 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,165 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,168 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,172 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,176 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,181 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,185 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,189 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,193 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,197 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,201 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,204 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,209 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,213 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,217 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,223 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,228 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,233 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,238 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,243 INFO [TezChild] org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator: Processing alias catalog_returns for file hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452328 2014-09-25 15:25:49,246 INFO [TezChild] org.apache.hadoop.hive.ql.exec.Utilities: Could not find plan string in conf 2014-09-25 15:25:49,253 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicate: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number) expr = (and (not leaf-0) (not leaf-1)) 2014-09-25 15:25:49,282 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.OrcRawRecordMerger: min key = null, max key = null 2014-09-25 15:25:49,282 INFO [TezChild] org.apache.hadoop.hive.ql.io.orc.ReaderImpl: Reading ORC rows from hdfs://cn105-10.l42scl.hortonworks.com:8020/apps/hive/warehouse/tpcds_bin_partitioned_orc_200_orig.db/catalog_returns/cr_returned_date_sk=2452319/000025_0 with {include: [true, false, true, false, false, false, false, false, false, false, false, false, false, false, false, false, true, false, false, false, false, false, false, true, true, true, false], offset: 0, length: 9223372036854775807, sarg: leaf-0 = (IS_NULL cr_item_sk) leaf-1 = (IS_NULL cr_order_number)