2014-09-30 22:16:20,747 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 135 2014-09-30 22:16:20,747 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,747 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:20,747 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,748 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.VariableSubstitution (VariableSubstitution.java:substitute(53)) - Substitution is on: select distinct id from foo7 2014-09-30 22:16:20,749 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,749 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.VariableSubstitution (VariableSubstitution.java:substitute(53)) - Substitution is on: select distinct id from foo7 2014-09-30 22:16:20,750 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,750 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: select distinct id from foo7 2014-09-30 22:16:20,752 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.ParseDriver (ParseDriver.java:parse(206)) - Parse Completed 2014-09-30 22:16:20,753 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,753 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,754 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(9810)) - Starting Semantic Analysis 2014-09-30 22:16:20,754 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(9845)) - Completed phase 1 of Semantic Analysis 2014-09-30 22:16:20,754 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(1498)) - Get metadata for source tables 2014-09-30 22:16:20,769 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,769 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,770 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(1646)) - Get metadata for subqueries 2014-09-30 22:16:20,770 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:getMetaData(1670)) - Get metadata for destination tables 2014-09-30 22:16:20,771 DEBUG [HiveServer2-Handler-Pool: Thread-253]: hdfs.DFSClient (DFSClient.java:primitiveMkdir(2550)) - /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-8: masked=rwx------ 2014-09-30 22:16:20,771 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.Client (Client.java:(424)) - The ping interval is 60000 ms. 2014-09-30 22:16:20,772 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.Client (Client.java:setupIOstreams(693)) - Connecting to nc-h04/192.168.20.6:8020 2014-09-30 22:16:20,773 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:run(944)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser: starting, having connections 1 2014-09-30 22:16:20,773 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,773 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1233 2014-09-30 22:16:20,773 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,776 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1233 2014-09-30 22:16:20,776 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,776 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: mkdirs took 5ms 2014-09-30 22:16:20,777 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1234 2014-09-30 22:16:20,777 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,778 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1234 2014-09-30 22:16:20,778 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,778 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 2ms 2014-09-30 22:16:20,778 INFO [HiveServer2-Handler-Pool: Thread-253]: ql.Context (Context.java:getMRScratchDir(266)) - New scratch dir is hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-8 2014-09-30 22:16:20,779 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(9848)) - Completed getting MetaData in Semantic Analysis 2014-09-30 22:16:20,779 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:canHandleQuery(12184)) - Can not invoke CBO; query contains operators not supported for CBO. 2014-09-30 22:16:20,779 DEBUG [HiveServer2-Handler-Pool: Thread-253]: hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(770)) - DDL: struct foo7 { i32 id} 2014-09-30 22:16:20,780 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genTablePlan(9402)) - Created Table Plan for foo7 TS[50] 2014-09-30 22:16:20,782 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(3372)) - tree: (TOK_SELECTDI (TOK_SELEXPR (TOK_TABLE_OR_COL id))) 2014-09-30 22:16:20,783 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(3479)) - genSelectPlan: input = {((tok_table_or_col id),_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,783 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(3634)) - Created Select Plan row schema: null{(id,_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,783 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genSelectPlan(3361)) - Created Select Plan for clause: insclause-0 2014-09-30 22:16:20,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(208)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0] columnTypes=[int] separator=[[B@2b9835cb] nullstring=\N lastColumnTakesRest=false 2014-09-30 22:16:20,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(208)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0] columnTypes=[int] separator=[[B@15f3b8c9] nullstring=\N lastColumnTakesRest=false 2014-09-30 22:16:20,786 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genFileSinkPlan(6367)) - Created FileSink Plan for clause: insclause-0dest_path: hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-8/-mr-10000 row schema: null{(id,_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,786 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genBodyPlan(8779)) - Created Body Plan for Query Block null 2014-09-30 22:16:20,786 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:genPlan(9604)) - Created Plan for Query Block null 2014-09-30 22:16:20,788 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(9971)) - Before logical optimization TS[50]-SEL[51]-GBY[52]-RS[53]-GBY[54]-SEL[55]-FS[56] 2014-09-30 22:16:20,797 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(752)) - Processing for FS(56) 2014-09-30 22:16:20,797 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(752)) - Processing for SEL(55) 2014-09-30 22:16:20,798 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(752)) - Processing for GBY(54) 2014-09-30 22:16:20,798 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(752)) - Processing for RS(53) 2014-09-30 22:16:20,798 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(752)) - Processing for GBY(52) 2014-09-30 22:16:20,799 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(752)) - Processing for SEL(51) 2014-09-30 22:16:20,799 INFO [HiveServer2-Handler-Pool: Thread-253]: ppd.OpProcFactory (OpProcFactory.java:process(390)) - Processing for TS(50) 2014-09-30 22:16:20,799 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ppd.PredicatePushDown (PredicatePushDown.java:transform(133)) - After PPD: TS[50]-SEL[51]-GBY[52]-RS[53]-GBY[54]-SEL[55]-FS[56] 2014-09-30 22:16:20,802 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:TS[50] with rr:foo7{(id,id: int)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)(row__id,ROW__ID: struct)} 2014-09-30 22:16:20,803 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator TS[50] 2014-09-30 22:16:20,803 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:SEL[51] with rr:foo7{(id,id: int)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)(row__id,ROW__ID: struct)} 2014-09-30 22:16:20,803 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator SEL[51] 2014-09-30 22:16:20,803 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcFactory (ConstantPropagateProcFactory.java:process(683)) - New column list:(Column[id] Column[BLOCK__OFFSET__INSIDE__FILE] Column[INPUT__FILE__NAME] Column[ROW__ID]) 2014-09-30 22:16:20,804 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:GBY[52] with rr:{((tok_table_or_col id),_col0: int)} 2014-09-30 22:16:20,804 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator GBY[52] 2014-09-30 22:16:20,804 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:RS[53] with rr:{((tok_table_or_col id),KEY._col0: int)} 2014-09-30 22:16:20,804 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator RS[53] 2014-09-30 22:16:20,805 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:GBY[54] with rr:{((tok_table_or_col id),_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,805 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator GBY[54] 2014-09-30 22:16:20,805 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:SEL[55] with rr:null{(id,_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,805 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator SEL[55] 2014-09-30 22:16:20,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcFactory (ConstantPropagateProcFactory.java:process(683)) - New column list:(Column[_col0]) 2014-09-30 22:16:20,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:FS[56] with rr:null{(id,_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator FS[56] 2014-09-30 22:16:20,808 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:process(451)) - Reduce Sink Operator 53 key:[Column[_col0]] 2014-09-30 22:16:20,808 INFO [HiveServer2-Handler-Pool: Thread-253]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:pruneReduceSinkOperator(744)) - RS 53 oldColExprMap: {KEY._col0=Column[_col0]} 2014-09-30 22:16:20,809 INFO [HiveServer2-Handler-Pool: Thread-253]: optimizer.ColumnPrunerProcFactory (ColumnPrunerProcFactory.java:pruneReduceSinkOperator(795)) - RS 53 newColExprMap: {KEY._col0=Column[_col0]} 2014-09-30 22:16:20,813 DEBUG [HiveServer2-Handler-Pool: Thread-253]: index.RewriteGBUsingIndex (RewriteGBUsingIndex.java:shouldApplyOptimization(162)) - No Valid Index Found to apply Rewrite, skipping RewriteGBUsingIndex optimization 2014-09-30 22:16:20,820 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(9982)) - After logical optimization TS[50]-SEL[51]-GBY[52]-RS[53]-GBY[54]-SEL[55]-FS[56] 2014-09-30 22:16:20,821 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:TS[50] with rr:foo7{(id,id: int)(block__offset__inside__file,BLOCK__OFFSET__INSIDE__FILE: bigint)(input__file__name,INPUT__FILE__NAME: string)(row__id,ROW__ID: struct)} 2014-09-30 22:16:20,821 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator TS[50] 2014-09-30 22:16:20,822 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:SEL[51] with rr:foo7{(id,id: int)} 2014-09-30 22:16:20,822 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator SEL[51] 2014-09-30 22:16:20,822 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcFactory (ConstantPropagateProcFactory.java:process(683)) - New column list:(Column[id]) 2014-09-30 22:16:20,823 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:GBY[52] with rr:{((tok_table_or_col id),_col0: int)} 2014-09-30 22:16:20,823 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator GBY[52] 2014-09-30 22:16:20,823 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:RS[53] with rr:{((tok_table_or_col id),KEY._col0: int)} 2014-09-30 22:16:20,824 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator RS[53] 2014-09-30 22:16:20,824 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:GBY[54] with rr:{((tok_table_or_col id),_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,824 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator GBY[54] 2014-09-30 22:16:20,825 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:SEL[55] with rr:null{(id,_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,825 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator SEL[55] 2014-09-30 22:16:20,825 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcFactory (ConstantPropagateProcFactory.java:process(683)) - New column list:(Column[_col0]) 2014-09-30 22:16:20,825 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(125)) - Getting constants of op:FS[56] with rr:null{(id,_col0: int)} foo7{(id,_col0: int)} 2014-09-30 22:16:20,826 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.ConstantPropagateProcCtx (ConstantPropagateProcCtx.java:getPropagatedConstants(189)) - Offerring constants [] to operator FS[56] 2014-09-30 22:16:20,826 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,827 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,843 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.TableScanOperator (Operator.java:setStatistics(1281)) - Setting stats (Num rows: 1 Data size: 1214 Basic stats: COMPLETE Column stats: NONE) on TS[50] 2014-09-30 22:16:20,843 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(115)) - [0] STATS-TS[50] (foo7): numRows: 1 dataSize: 1214 basicStatsState: COMPLETE colStatsState: NONE colStats: {} 2014-09-30 22:16:20,844 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.SelectOperator (Operator.java:setStatistics(1281)) - Setting stats (Num rows: 1 Data size: 1214 Basic stats: COMPLETE Column stats: NONE) on SEL[51] 2014-09-30 22:16:20,844 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(655)) - STATS-GBY[52]: inputSize: 1214 maxSplitSize: 256000000 parallelism: 1 containsGroupingSet: false sizeOfGroupingSet: 1 2014-09-30 22:16:20,844 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(803)) - [Case 1] STATS-GBY[52]: cardinality: 1 2014-09-30 22:16:20,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.GroupByOperator (Operator.java:setStatistics(1281)) - Setting stats (Num rows: 1 Data size: 1214 Basic stats: COMPLETE Column stats: NONE) on GBY[52] 2014-09-30 22:16:20,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(866)) - [0] STATS-GBY[52]: numRows: 1 dataSize: 1214 basicStatsState: COMPLETE colStatsState: NONE colStats: {} 2014-09-30 22:16:20,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.ReduceSinkOperator (Operator.java:setStatistics(1281)) - Setting stats (Num rows: 1 Data size: 1214 Basic stats: COMPLETE Column stats: NONE) on RS[53] 2014-09-30 22:16:20,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(1510)) - [0] STATS-RS[53]: numRows: 1 dataSize: 1214 basicStatsState: COMPLETE colStatsState: NONE colStats: {} 2014-09-30 22:16:20,846 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(655)) - STATS-GBY[54]: inputSize: 1 maxSplitSize: 256000000 parallelism: 1 containsGroupingSet: false sizeOfGroupingSet: 1 2014-09-30 22:16:20,846 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(813)) - [Case 7] STATS-GBY[54]: cardinality: 0 2014-09-30 22:16:20,846 INFO [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:updateStats(1626)) - STATS-GBY[54]: Overflow in number of rows.0 rows will be set to Long.MAX_VALUE 2014-09-30 22:16:20,846 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.GroupByOperator (Operator.java:setStatistics(1281)) - Setting stats (Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE) on GBY[54] 2014-09-30 22:16:20,847 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(866)) - [0] STATS-GBY[54]: numRows: 0 dataSize: 0 basicStatsState: NONE colStatsState: NONE colStats: {} 2014-09-30 22:16:20,847 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.SelectOperator (Operator.java:setStatistics(1281)) - Setting stats (Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE) on SEL[55] 2014-09-30 22:16:20,847 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(186)) - [1] STATS-SEL[55]: numRows: 0 dataSize: 0 basicStatsState: NONE colStatsState: NONE colStats: {} 2014-09-30 22:16:20,848 DEBUG [HiveServer2-Handler-Pool: Thread-253]: annotation.StatsRulesProcFactory (StatsRulesProcFactory.java:process(1551)) - [0] STATS-FS[56]: numRows: 0 dataSize: 0 basicStatsState: NONE colStatsState: NONE colStats: {} 2014-09-30 22:16:20,849 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1235 2014-09-30 22:16:20,849 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,850 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1235 2014-09-30 22:16:20,850 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,850 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getListing took 1ms 2014-09-30 22:16:20,851 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.TableScanOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@424402c7) on TS[50] 2014-09-30 22:16:20,852 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.SelectOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@7f1278cd) on SEL[51] 2014-09-30 22:16:20,852 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.GroupByOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@15b91be8) on GBY[52] 2014-09-30 22:16:20,852 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.ReduceSinkOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@2bd7277c) on RS[53] 2014-09-30 22:16:20,853 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.GroupByOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@3a615460) on GBY[54] 2014-09-30 22:16:20,853 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.SelectOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@4bea8891) on SEL[55] 2014-09-30 22:16:20,854 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.FileSinkOperator (Operator.java:setOpTraits(1270)) - Setting traits (org.apache.hadoop.hive.ql.plan.OpTraits@4bea8891) on FS[56] 2014-09-30 22:16:20,855 INFO [HiveServer2-Handler-Pool: Thread-253]: optimizer.SetReducerParallelism (SetReducerParallelism.java:process(87)) - Set parallelism for reduce sink RS[53] to: 1 2014-09-30 22:16:20,855 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,855 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: TS, 50 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: SEL, 51 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: GBY, 52 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: RS, 53 2014-09-30 22:16:20,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: GBY, 54 2014-09-30 22:16:20,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: SEL, 55 2014-09-30 22:16:20,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(144)) - Component: 2014-09-30 22:16:20,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(146)) - Operator: FS, 56 2014-09-30 22:16:20,857 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:runCycleAnalysisForPartitionPruning(155)) - Cycle free: true 2014-09-30 22:16:20,859 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(91)) - Root operator: TS[50] 2014-09-30 22:16:20,859 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(92)) - Leaf operator: RS[53] 2014-09-30 22:16:20,859 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezUtils (GenTezUtils.java:createMapWork(182)) - Adding map work (Map 1) for TS[50] 2014-09-30 22:16:20,859 DEBUG [HiveServer2-Handler-Pool: Thread-253]: hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(770)) - DDL: struct foo7 { i32 id} 2014-09-30 22:16:20,860 DEBUG [HiveServer2-Handler-Pool: Thread-253]: hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(770)) - DDL: struct foo7 { i32 id} 2014-09-30 22:16:20,860 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,860 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,860 DEBUG [HiveServer2-Handler-Pool: Thread-253]: hive.log (MetaStoreUtils.java:getDDLFromFieldSchema(770)) - DDL: struct foo7 { i32 id} 2014-09-30 22:16:20,861 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.GenMapRedUtils (GenMapRedUtils.java:setMapWork(673)) - Adding hdfs://nc-h04/user/hive/warehouse/casino.db/foo7 of tablefoo7 2014-09-30 22:16:20,861 DEBUG [HiveServer2-Handler-Pool: Thread-253]: optimizer.GenMapRedUtils (GenMapRedUtils.java:setMapWork(711)) - Information added for path hdfs://nc-h04/user/hive/warehouse/casino.db/foo7 2014-09-30 22:16:20,861 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(368)) - First pass. Leaf operator: RS[53] 2014-09-30 22:16:20,862 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(91)) - Root operator: GBY[54] 2014-09-30 22:16:20,862 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(92)) - Leaf operator: FS[56] 2014-09-30 22:16:20,862 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezUtils (GenTezUtils.java:createReduceWork(107)) - Adding reduce work (Reducer 2) for GBY[54] 2014-09-30 22:16:20,863 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezUtils (GenTezUtils.java:setupReduceSink(163)) - Setting up reduce sink: RS[53] with following reduce work: Reducer 2 2014-09-30 22:16:20,863 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(281)) - Removing RS[53] as parent from GBY[54] 2014-09-30 22:16:20,863 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.GenTezWork (GenTezWork.java:process(368)) - First pass. Leaf operator: FS[56] 2014-09-30 22:16:20,863 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:generateTaskTree(378)) - There are 0 app master events. 2014-09-30 22:16:20,864 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(140)) - Looking at: Map 1 2014-09-30 22:16:20,864 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(148)) - Looking for table scans where optimization is applicable 2014-09-30 22:16:20,865 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(172)) - Found 0 null table scans 2014-09-30 22:16:20,865 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(140)) - Looking at: Map 1 2014-09-30 22:16:20,865 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(148)) - Looking for table scans where optimization is applicable 2014-09-30 22:16:20,866 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(172)) - Found 0 null table scans 2014-09-30 22:16:20,866 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(140)) - Looking at: Map 1 2014-09-30 22:16:20,866 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(148)) - Looking for table scans where optimization is applicable 2014-09-30 22:16:20,867 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.NullScanTaskDispatcher (NullScanTaskDispatcher.java:dispatch(172)) - Found 0 null table scans 2014-09-30 22:16:20,869 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateMapWork(330)) - Validating MapWork... 2014-09-30 22:16:20,870 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,870 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,870 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1050)) - Downstream operators of map-side GROUP BY will be vectorized: true 2014-09-30 22:16:20,870 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,871 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,871 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,871 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,871 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1050)) - Downstream operators of map-side GROUP BY will be vectorized: true 2014-09-30 22:16:20,872 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,872 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeMapWork(364)) - Vectorizing MapWork... 2014-09-30 22:16:20,873 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(650)) - MapWorkVectorizationNodeProcessor processing Operator: TS... 2014-09-30 22:16:20,873 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(668)) - Vectorized MapWork operator TS with vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7, vectorTypes: {}, columnMap: {id=0} 2014-09-30 22:16:20,873 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(702)) - Vectorized MapWork operator TS with vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7, vectorTypes: {}, columnMap: {id=0} 2014-09-30 22:16:20,873 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(650)) - MapWorkVectorizationNodeProcessor processing Operator: SEL... 2014-09-30 22:16:20,874 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,874 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(702)) - Vectorized MapWork operator SEL with vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7, vectorTypes: {}, columnMap: {id=0} 2014-09-30 22:16:20,874 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(709)) - Vectorized MapWork operator SEL added new vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_, vectorTypes: {}, columnMap: {id=0} 2014-09-30 22:16:20,875 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(650)) - MapWorkVectorizationNodeProcessor processing Operator: GBY... 2014-09-30 22:16:20,875 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,875 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(702)) - Vectorized MapWork operator GBY with vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_, vectorTypes: {}, columnMap: {id=0} 2014-09-30 22:16:20,875 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(709)) - Vectorized MapWork operator GBY added new vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_/_GROUPBY_, vectorTypes: {}, columnMap: {_col0=0} 2014-09-30 22:16:20,876 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(650)) - MapWorkVectorizationNodeProcessor processing Operator: RS... 2014-09-30 22:16:20,876 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,876 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,877 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(702)) - Vectorized MapWork operator RS with vectorization context key=hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_/_GROUPBY_, vectorTypes: {}, columnMap: {_col0=0} 2014-09-30 22:16:20,877 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeMapWork(383)) - vectorTypes: {hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_={}, hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_/_GROUPBY_={}, hdfs://nc-h04/user/hive/warehouse/casino.db/foo7={}} 2014-09-30 22:16:20,877 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeMapWork(384)) - columnMap: {hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_={id=0}, hdfs://nc-h04/user/hive/warehouse/casino.db/foo7/_SELECT_/_GROUPBY_={_col0=0}, hdfs://nc-h04/user/hive/warehouse/casino.db/foo7={id=0}} 2014-09-30 22:16:20,878 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateReduceWork(434)) - Validating ReduceWork... 2014-09-30 22:16:20,878 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,878 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,879 DEBUG [HiveServer2-Handler-Pool: Thread-253]: lazybinary.LazyBinarySerDe (LazyBinarySerDe.java:initialize(128)) - LazyBinarySerDe initialized with: columnNames=[] columnTypes=[] 2014-09-30 22:16:20,879 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,879 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1033)) - Reduce GROUP BY mode is MERGEPARTIAL 2014-09-30 22:16:20,880 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1043)) - Reduce-side GROUP BY will process key groups 2014-09-30 22:16:20,880 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,880 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,881 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1033)) - Reduce GROUP BY mode is MERGEPARTIAL 2014-09-30 22:16:20,881 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1043)) - Reduce-side GROUP BY will process key groups 2014-09-30 22:16:20,881 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,881 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,882 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1033)) - Reduce GROUP BY mode is MERGEPARTIAL 2014-09-30 22:16:20,882 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:validateGroupByOperator(1043)) - Reduce-side GROUP BY will process key groups 2014-09-30 22:16:20,882 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeReduceWork(462)) - Vectorizing ReduceWork... 2014-09-30 22:16:20,882 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeReduceWork(477)) - vectorizeReduceWork reducer Operator: GBY... 2014-09-30 22:16:20,883 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(750)) - ReduceWorkVectorizationNodeProcessor processing Operator: GBY... 2014-09-30 22:16:20,883 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(765)) - Vectorized ReduceWork reduce shuffle vectorization context key=_REDUCE_SHUFFLE_, vectorTypes: {}, columnMap: {KEY._col0=0} 2014-09-30 22:16:20,883 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,883 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(794)) - Vectorized ReduceWork operator GBY with vectorization context key=_REDUCE_SHUFFLE_, vectorTypes: {}, columnMap: {KEY._col0=0} 2014-09-30 22:16:20,884 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(801)) - Vectorized ReduceWork operator GBY added new vectorization context key=_REDUCE_SHUFFLE_/_GROUPBY_, vectorTypes: {}, columnMap: {_col0=0} 2014-09-30 22:16:20,884 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(750)) - ReduceWorkVectorizationNodeProcessor processing Operator: SEL... 2014-09-30 22:16:20,884 DEBUG [HiveServer2-Handler-Pool: Thread-253]: vector.VectorizationContext (VectorizationContext.java:getVectorExpression(357)) - Input Expression = int, Vectorized Expression = IdentityExpression[0] 2014-09-30 22:16:20,884 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(794)) - Vectorized ReduceWork operator SEL with vectorization context key=_REDUCE_SHUFFLE_/_GROUPBY_, vectorTypes: {}, columnMap: {_col0=0} 2014-09-30 22:16:20,885 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(801)) - Vectorized ReduceWork operator SEL added new vectorization context key=_REDUCE_SHUFFLE_/_GROUPBY_/_SELECT_, vectorTypes: {}, columnMap: {_col0=0} 2014-09-30 22:16:20,885 INFO [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(750)) - ReduceWorkVectorizationNodeProcessor processing Operator: FS... 2014-09-30 22:16:20,885 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:process(794)) - Vectorized ReduceWork operator FS with vectorization context key=_REDUCE_SHUFFLE_/_GROUPBY_/_SELECT_, vectorTypes: {}, columnMap: {_col0=0} 2014-09-30 22:16:20,886 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeReduceWork(497)) - vectorTypes: {_REDUCE_SHUFFLE_/_GROUPBY_/_SELECT_={}, _REDUCE_SHUFFLE_={}, _REDUCE_SHUFFLE_/_GROUPBY_={}} 2014-09-30 22:16:20,886 DEBUG [HiveServer2-Handler-Pool: Thread-253]: physical.Vectorizer (Vectorizer.java:vectorizeReduceWork(498)) - columnMap: {_REDUCE_SHUFFLE_/_GROUPBY_/_SELECT_={_col0=0}, _REDUCE_SHUFFLE_={KEY._col0=0}, _REDUCE_SHUFFLE_/_GROUPBY_={_col0=0}} 2014-09-30 22:16:20,886 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.TezCompiler (TezCompiler.java:optimizeTaskPlan(473)) - Skipping stage id rearranger 2014-09-30 22:16:20,886 INFO [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:analyzeInternal(10005)) - Completed plan generation 2014-09-30 22:16:20,887 INFO [HiveServer2-Handler-Pool: Thread-253]: ql.Driver (Driver.java:compile(422)) - Semantic Analysis Completed 2014-09-30 22:16:20,887 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:validate(10343)) - validation start 2014-09-30 22:16:20,887 DEBUG [HiveServer2-Handler-Pool: Thread-253]: parse.SemanticAnalyzer (SemanticAnalyzer.java:validate(10399)) - not validating writeEntity, because entity is neither table nor partition 2014-09-30 22:16:20,887 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,888 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,889 DEBUG [HiveServer2-Handler-Pool: Thread-253]: lazy.LazySimpleSerDe (LazySimpleSerDe.java:initialize(208)) - org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe initialized with: columnNames=[_col0] columnTypes=[int] separator=[[B@3947ea7f] nullstring=\N lastColumnTakesRest=false 2014-09-30 22:16:20,889 INFO [HiveServer2-Handler-Pool: Thread-253]: exec.ListSinkOperator (Operator.java:initialize(342)) - Initializing Self OP[63] 2014-09-30 22:16:20,889 DEBUG [HiveServer2-Handler-Pool: Thread-253]: exec.Utilities (Utilities.java:getSessionSpecifiedClassLoader(2050)) - Use session specified class loader 2014-09-30 22:16:20,889 INFO [HiveServer2-Handler-Pool: Thread-253]: exec.ListSinkOperator (Operator.java:initializeChildren(415)) - Operator 63 OP initialized 2014-09-30 22:16:20,889 INFO [HiveServer2-Handler-Pool: Thread-253]: exec.ListSinkOperator (Operator.java:initialize(390)) - Initialization Done 63 OP 2014-09-30 22:16:20,890 INFO [HiveServer2-Handler-Pool: Thread-253]: ql.Driver (Driver.java:getSchema(235)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null)], properties:null) 2014-09-30 22:16:20,890 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,891 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:executeStatementAsync(244)) - SessionHandle [1dc4a291-8600-41e6-b9ba-5bb4c1d53662]: executeStatementAsync() 2014-09-30 22:16:20,891 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,891 DEBUG [HiveServer2-Background-Pool: Thread-296]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:20,891 DEBUG [HiveServer2-Background-Pool: Thread-296]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Background-Pool: Thread-296 2014-09-30 22:16:20,891 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 109 2014-09-30 22:16:20,891 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,892 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,892 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,892 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,892 DEBUG [HiveServer2-Background-Pool: Thread-296]: lockmgr.DbTxnManager (DbTxnManager.java:acquireLocks(88)) - Setting lock request transaction to 0 2014-09-30 22:16:20,893 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:20,893 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,893 DEBUG [HiveServer2-Background-Pool: Thread-296]: lockmgr.DbTxnManager (DbTxnManager.java:acquireLocks(127)) - Adding lock component to lock request LockComponent(type:SHARED_READ, level:TABLE, dbname:casino, tablename:foo7) 2014-09-30 22:16:20,893 DEBUG [HiveServer2-Background-Pool: Thread-296]: lockmgr.DbLockManager (DbLockManager.java:lock(79)) - Requesting lock 2014-09-30 22:16:20,893 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:20,893 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,894 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:20,894 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,895 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 5215 2014-09-30 22:16:20,895 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,898 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 100 2014-09-30 22:16:20,898 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:20,912 DEBUG [HiveServer2-Background-Pool: Thread-296]: ql.Driver (Driver.java:recordValidTxns(881)) - Encoding valid txns info 557:396:399:402:410:411:412:414:418:445:462:468:469:470:471:472:483:503:543:555 2014-09-30 22:16:20,913 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,913 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,913 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Driver (Driver.java:execute(1284)) - Starting command: select distinct id from foo7 2014-09-30 22:16:20,913 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Driver (SessionState.java:printInfo(816)) - Query ID = hduser_20140930221616_83c14441-902d-4694-8f75-76e437873d26 2014-09-30 22:16:20,914 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Driver (SessionState.java:printInfo(816)) - Total jobs = 1 2014-09-30 22:16:20,914 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,914 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,914 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,915 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Driver (SessionState.java:printInfo(816)) - Launching Job 1 out of 1 2014-09-30 22:16:20,915 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Driver (Driver.java:launchTask(1601)) - Starting task [Stage-1:MAPRED] in serial mode 2014-09-30 22:16:20,916 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezSessionPoolManager (TezSessionPoolManager.java:canWorkWithSameSession(215)) - The current user: hduser, session user: hduser 2014-09-30 22:16:20,918 DEBUG [HiveServer2-Background-Pool: Thread-296]: hdfs.DFSClient (DFSClient.java:primitiveMkdir(2550)) - /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10: masked=rwx------ 2014-09-30 22:16:20,918 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1236 2014-09-30 22:16:20,918 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,920 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1236 2014-09-30 22:16:20,920 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,920 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: mkdirs took 2ms 2014-09-30 22:16:20,921 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1237 2014-09-30 22:16:20,921 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,922 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1237 2014-09-30 22:16:20,922 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,922 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 1ms 2014-09-30 22:16:20,923 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Context (Context.java:getMRScratchDir(266)) - New scratch dir is hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10 2014-09-30 22:16:20,923 DEBUG [HiveServer2-Background-Pool: Thread-296]: tez.DagUtils (DagUtils.java:createTezDir(1114)) - TezDir path set hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10/hduser/_tez_scratch_dir for user: hduser 2014-09-30 22:16:20,924 DEBUG [HiveServer2-Background-Pool: Thread-296]: hdfs.DFSClient (DFSClient.java:primitiveMkdir(2550)) - /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10/hduser/_tez_scratch_dir: masked=rwxr-xr-x 2014-09-30 22:16:20,924 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1238 2014-09-30 22:16:20,924 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,926 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1238 2014-09-30 22:16:20,926 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,926 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: mkdirs took 2ms 2014-09-30 22:16:20,926 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:updateSession(232)) - Session is already open 2014-09-30 22:16:20,928 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1239 2014-09-30 22:16:20,928 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,929 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1239 2014-09-30 22:16:20,929 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,929 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 1ms 2014-09-30 22:16:20,930 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1240 2014-09-30 22:16:20,930 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,931 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1240 2014-09-30 22:16:20,931 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,931 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 1ms 2014-09-30 22:16:20,932 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1241 2014-09-30 22:16:20,932 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,933 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1241 2014-09-30 22:16:20,933 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,933 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 1ms 2014-09-30 22:16:20,933 INFO [HiveServer2-Background-Pool: Thread-296]: tez.DagUtils (DagUtils.java:createLocalResource(704)) - Resource modification time: 1412108091590 2014-09-30 22:16:20,934 DEBUG [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(143)) - Adding local resource: scheme: "hdfs" host: "nc-h04" port: -1 file: "/tmp/hive/hduser/_tez_session_dir/89421977-42b8-4467-a0c1-66dda3d1b6b8/postgresql-8.4-703.jdbc4.jar" 2014-09-30 22:16:20,934 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,935 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,936 DEBUG [HiveServer2-Background-Pool: Thread-296]: hdfs.DFSClient (DFSClient.java:primitiveMkdir(2550)) - /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10/hduser/_tez_scratch_dir/613e4f08-34be-4034-a450-088bc3acf8d1: masked=rwxr-xr-x 2014-09-30 22:16:20,936 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1242 2014-09-30 22:16:20,936 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,938 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1242 2014-09-30 22:16:20,938 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,938 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: mkdirs took 2ms 2014-09-30 22:16:20,938 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,939 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Utilities (Utilities.java:serializePlan(897)) - Serializing ReduceWork via kryo 2014-09-30 22:16:20,989 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,989 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Utilities (Utilities.java:setBaseWork(674)) - Setting plan: /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10/hduser/_tez_scratch_dir/613e4f08-34be-4034-a450-088bc3acf8d1/reduce.xml 2014-09-30 22:16:20,990 DEBUG [HiveServer2-Background-Pool: Thread-296]: hdfs.DFSClient (DFSClient.java:primitiveMkdir(2550)) - /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-8/_tmp.-ext-10001: masked=rwxr-xr-x 2014-09-30 22:16:20,991 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1243 2014-09-30 22:16:20,991 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:20,992 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1243 2014-09-30 22:16:20,992 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:20,992 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: mkdirs took 2ms 2014-09-30 22:16:20,998 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:20,999 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:20,999 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Context (Context.java:getMRScratchDir(266)) - New scratch dir is hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10 2014-09-30 22:16:21,000 DEBUG [HiveServer2-Background-Pool: Thread-296]: hdfs.DFSClient (DFSClient.java:primitiveMkdir(2550)) - /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10/hduser/_tez_scratch_dir/41389c12-de43-4273-9c96-9f954c95c2e0: masked=rwxr-xr-x 2014-09-30 22:16:21,001 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1244 2014-09-30 22:16:21,001 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,002 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1244 2014-09-30 22:16:21,002 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:21,002 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: mkdirs took 2ms 2014-09-30 22:16:21,003 INFO [HiveServer2-Background-Pool: Thread-296]: tez.DagUtils (DagUtils.java:createVertex(545)) - Vertex has custom input? false 2014-09-30 22:16:21,003 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:21,003 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Utilities (Utilities.java:serializePlan(897)) - Serializing MapWork via kryo 2014-09-30 22:16:21,024 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:21,024 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Utilities (Utilities.java:setBaseWork(674)) - Setting plan: /tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-10/hduser/_tez_scratch_dir/41389c12-de43-4273-9c96-9f954c95c2e0/map.xml 2014-09-30 22:16:21,025 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:setStageKeysFromBaseConf(139)) - Setting mapreduce.map.output.key.class for stage: unknown based on job level configuration. Value: org.apache.hadoop.hive.ql.io.HiveKey 2014-09-30 22:16:21,025 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:setStageKeysFromBaseConf(156)) - Setting mapreduce.map.output.value.class for stage: unknown based on job level configuration. Value: org.apache.hadoop.io.BytesWritable 2014-09-30 22:16:21,025 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.shuffle.merge.percent, mr initial value=0.66, tez:tez.runtime.shuffle.merge.percent=0.66 2014-09-30 22:16:21,025 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.shuffle.input.buffer.percent, mr initial value=0.70, tez:tez.runtime.shuffle.fetch.buffer.percent=0.70 2014-09-30 22:16:21,026 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.task.io.sort.mb, mr initial value=100, tez:tez.runtime.io.sort.mb=100 2014-09-30 22:16:21,026 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.shuffle.memory.limit.percent, mr initial value=0.25, tez:tez.runtime.shuffle.memory.limit.percent=0.25 2014-09-30 22:16:21,026 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.task.io.sort.factor, mr initial value=10, tez:tez.runtime.io.sort.factor=10 2014-09-30 22:16:21,026 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.shuffle.connect.timeout, mr initial value=180000, tez:tez.runtime.shuffle.connect.timeout=180000 2014-09-30 22:16:21,026 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):map.sort.class, mr initial value=org.apache.hadoop.util.QuickSort, tez:tez.runtime.internal.sorter.class=org.apache.hadoop.util.QuickSort 2014-09-30 22:16:21,027 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.task.merge.progress.records, mr initial value=10000, tez:tez.runtime.merge.progress.records=10000 2014-09-30 22:16:21,027 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.map.output.compress, mr initial value=false, tez:tez.runtime.compress=false 2014-09-30 22:16:21,027 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.map.output.key.class, mr initial value=org.apache.hadoop.hive.ql.io.HiveKey, tez:tez.runtime.key.class=org.apache.hadoop.hive.ql.io.HiveKey 2014-09-30 22:16:21,027 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.map.sort.spill.percent, mr initial value=0.80, tez:tez.runtime.sort.spill.percent=0.80 2014-09-30 22:16:21,027 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.shuffle.ssl.enabled, mr initial value=false, tez:tez.runtime.shuffle.ssl.enable=false 2014-09-30 22:16:21,028 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.ifile.readahead, mr initial value=true, tez:tez.runtime.ifile.readahead=true 2014-09-30 22:16:21,028 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.shuffle.parallelcopies, mr initial value=5, tez:tez.runtime.shuffle.parallel.copies=5 2014-09-30 22:16:21,028 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.ifile.readahead.bytes, mr initial value=4194304, tez:tez.runtime.ifile.readahead.bytes=4194304 2014-09-30 22:16:21,028 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.input.buffer.percent, mr initial value=0.0, tez:tez.runtime.task.input.post-merge.buffer.percent=0.0 2014-09-30 22:16:21,028 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.reduce.shuffle.read.timeout, mr initial value=180000, tez:tez.runtime.shuffle.read.timeout=180000 2014-09-30 22:16:21,029 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.map.output.value.class, mr initial value=org.apache.hadoop.io.BytesWritable, tez:tez.runtime.value.class=org.apache.hadoop.io.BytesWritable 2014-09-30 22:16:21,029 DEBUG [HiveServer2-Background-Pool: Thread-296]: hadoop.MRHelpers (MRHelpers.java:processDirectConversion(178)) - Config: mr(unset):mapreduce.map.output.compress.codec, mr initial value=org.apache.hadoop.io.compress.DefaultCodec, tez:tez.runtime.compress.codec=org.apache.hadoop.io.compress.DefaultCodec 2014-09-30 22:16:21,035 DEBUG [HiveServer2-Background-Pool: Thread-296]: tez.DagUtils (DagUtils.java:addCredentials(163)) - Marking URI as needing credentials: hdfs://nc-h04/user/hive/warehouse/casino.db/foo7 2014-09-30 22:16:21,035 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:21,048 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:21,048 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:21,048 INFO [HiveServer2-Background-Pool: Thread-296]: client.TezClient (TezClient.java:submitDAGSession(356)) - Submitting dag to TezSession, sessionName=HIVE-89421977-42b8-4467-a0c1-66dda3d1b6b8, applicationId=application_1412065018660_0041, dagName=hduser_20140930221616_83c14441-902d-4694-8f75-76e437873d26:8 2014-09-30 22:16:21,048 DEBUG [HiveServer2-Background-Pool: Thread-296]: client.TezClientUtils (TezCommonUtils.java:logCredentials(343)) - #sessionTokens=1, Services: application_1412065018660_0041, 2014-09-30 22:16:21,052 DEBUG [HiveServer2-Background-Pool: Thread-296]: api.DAG (TezCommonUtils.java:logCredentials(343)) - #dagTokens=1, Services: application_1412065018660_0041, 2014-09-30 22:16:21,053 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (Client.java:(424)) - The ping interval is 60000 ms. 2014-09-30 22:16:21,053 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (Client.java:setupIOstreams(693)) - Connecting to nc-h04/192.168.20.6:8032 2014-09-30 22:16:21,054 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser]: ipc.Client (Client.java:run(944)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser: starting, having connections 2 2014-09-30 22:16:21,055 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser 2014-09-30 22:16:21,054 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser sending #1245 2014-09-30 22:16:21,055 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,056 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser got value #1245 2014-09-30 22:16:21,056 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser 2014-09-30 22:16:21,056 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getApplicationReport took 3ms 2014-09-30 22:16:21,057 DEBUG [HiveServer2-Background-Pool: Thread-296]: client.TezClientUtils (TezClientUtils.java:getAMProxy(825)) - Connecting to Tez AM at nc-h04/192.168.20.6:33468 2014-09-30 22:16:21,057 DEBUG [HiveServer2-Background-Pool: Thread-296]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.tez.client.TezClientUtils.getAMProxy(TezClientUtils.java:829) 2014-09-30 22:16:21,058 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (ClientCache.java:getClient(63)) - getting client out of cache: org.apache.hadoop.ipc.Client@35b102dd 2014-09-30 22:16:21,059 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (Client.java:(424)) - The ping interval is 60000 ms. 2014-09-30 22:16:21,059 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (Client.java:setupIOstreams(693)) - Connecting to nc-h04/192.168.20.6:33468 2014-09-30 22:16:21,060 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:run(944)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser: starting, having connections 3 2014-09-30 22:16:21,060 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,061 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1246 2014-09-30 22:16:21,062 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,191 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1246 2014-09-30 22:16:21,191 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,191 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: submitDAG took 132ms 2014-09-30 22:16:21,191 INFO [HiveServer2-Background-Pool: Thread-296]: client.TezClient (TezClient.java:submitDAGSession(409)) - Submitted dag to TezSession, sessionName=HIVE-89421977-42b8-4467-a0c1-66dda3d1b6b8, applicationId=application_1412065018660_0041, dagName=hduser_20140930221616_83c14441-902d-4694-8f75-76e437873d26:8 2014-09-30 22:16:21,192 DEBUG [HiveServer2-Background-Pool: Thread-296]: service.AbstractService (AbstractService.java:enterState(452)) - Service: org.apache.hadoop.yarn.client.api.impl.YarnClientImpl entered state INITED 2014-09-30 22:16:21,253 INFO [HiveServer2-Background-Pool: Thread-296]: client.RMProxy (RMProxy.java:createRMProxy(92)) - Connecting to ResourceManager at nc-h04/192.168.20.6:8032 2014-09-30 22:16:21,254 DEBUG [HiveServer2-Background-Pool: Thread-296]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.yarn.client.RMProxy.getProxy(RMProxy.java:130) 2014-09-30 22:16:21,254 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.YarnRPC (YarnRPC.java:create(59)) - Creating YarnRPC for org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC 2014-09-30 22:16:21,255 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.HadoopYarnProtoRPC (HadoopYarnProtoRPC.java:getProxy(47)) - Creating a HadoopYarnProtoRpc proxy for protocol interface org.apache.hadoop.yarn.api.ApplicationClientProtocol 2014-09-30 22:16:21,256 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (ClientCache.java:getClient(63)) - getting client out of cache: org.apache.hadoop.ipc.Client@35b102dd 2014-09-30 22:16:21,258 DEBUG [HiveServer2-Background-Pool: Thread-296]: service.AbstractService (AbstractService.java:start(197)) - Service org.apache.hadoop.yarn.client.api.impl.YarnClientImpl is started 2014-09-30 22:16:21,258 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:21,258 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezJobMonitor (SessionState.java:printInfo(816)) - 2014-09-30 22:16:21,258 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:21,259 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:21,259 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser sending #1247 2014-09-30 22:16:21,259 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,262 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser got value #1247 2014-09-30 22:16:21,262 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8032 from hduser 2014-09-30 22:16:21,262 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getApplicationReport took 3ms 2014-09-30 22:16:21,263 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getAppReport(290)) - App: application_1412065018660_0041 in state: RUNNING 2014-09-30 22:16:21,264 DEBUG [HiveServer2-Background-Pool: Thread-296]: client.TezClientUtils (TezClientUtils.java:getAMProxy(825)) - Connecting to Tez AM at nc-h04/192.168.20.6:33468 2014-09-30 22:16:21,264 DEBUG [HiveServer2-Background-Pool: Thread-296]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.tez.client.TezClientUtils.getAMProxy(TezClientUtils.java:829) 2014-09-30 22:16:21,265 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (ClientCache.java:getClient(63)) - getting client out of cache: org.apache.hadoop.ipc.Client@35b102dd 2014-09-30 22:16:21,265 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:21,265 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (Client.java:(424)) - The ping interval is 60000 ms. 2014-09-30 22:16:21,266 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.Client (Client.java:setupIOstreams(693)) - Connecting to nc-h04/192.168.20.6:33468 2014-09-30 22:16:21,267 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1248 2014-09-30 22:16:21,267 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,267 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:run(944)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser: starting, having connections 4 2014-09-30 22:16:21,268 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,283 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1248 2014-09-30 22:16:21,284 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,284 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 19ms 2014-09-30 22:16:21,284 DEBUG [HiveServer2-Background-Pool: Thread-296]: exec.Heartbeater (Heartbeater.java:heartbeat(80)) - heartbeating 2014-09-30 22:16:21,285 DEBUG [HiveServer2-Background-Pool: Thread-296]: lockmgr.DbTxnManager (DbTxnManager.java:heartbeat(253)) - Heartbeating lock and transaction 0 2014-09-30 22:16:21,293 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:21,294 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezJobMonitor (SessionState.java:printInfo(816)) - Status: Running (Executing on YARN cluster with App id application_1412065018660_0041) 2014-09-30 22:16:21,294 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:21,294 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:21,295 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezJobMonitor (SessionState.java:printInfo(816)) - Map 1: -/- Reducer 2: 0/1 2014-09-30 22:16:21,495 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:21,496 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1249 2014-09-30 22:16:21,496 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,498 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1249 2014-09-30 22:16:21,499 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,499 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 4ms 2014-09-30 22:16:21,500 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezJobMonitor (SessionState.java:printInfo(816)) - Map 1: -/- Reducer 2: 0(+1)/1 2014-09-30 22:16:21,700 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:21,701 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1250 2014-09-30 22:16:21,701 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,704 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1250 2014-09-30 22:16:21,704 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,704 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 3ms 2014-09-30 22:16:21,905 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:21,906 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1251 2014-09-30 22:16:21,906 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:21,908 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1251 2014-09-30 22:16:21,908 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:21,908 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 3ms 2014-09-30 22:16:22,109 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:22,110 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1252 2014-09-30 22:16:22,110 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,112 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1252 2014-09-30 22:16:22,112 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:22,113 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 3ms 2014-09-30 22:16:22,314 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:22,314 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1253 2014-09-30 22:16:22,314 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,316 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1253 2014-09-30 22:16:22,316 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:22,316 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 2ms 2014-09-30 22:16:22,517 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:22,518 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1254 2014-09-30 22:16:22,518 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,520 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1254 2014-09-30 22:16:22,521 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:22,521 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 3ms 2014-09-30 22:16:22,722 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:22,722 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1255 2014-09-30 22:16:22,723 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,725 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1255 2014-09-30 22:16:22,725 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:22,725 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 3ms 2014-09-30 22:16:22,726 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,726 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezJobMonitor (SessionState.java:printInfo(816)) - Map 1: -/- Reducer 2: 1/1 2014-09-30 22:16:22,727 INFO [HiveServer2-Background-Pool: Thread-296]: tez.TezJobMonitor (SessionState.java:printInfo(816)) - Status: Finished successfully in 1.43 seconds 2014-09-30 22:16:22,727 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,727 DEBUG [HiveServer2-Background-Pool: Thread-296]: rpc.DAGClientRPCImpl (DAGClientRPCImpl.java:getDAGStatusViaAM(172)) - GetDAGStatus via AM for app: application_1412065018660_0041 dag:dag_1412065018660_0041_3 2014-09-30 22:16:22,727 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser sending #1256 2014-09-30 22:16:22,727 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,733 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser got value #1256 2014-09-30 22:16:22,733 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:33468 from hduser 2014-09-30 22:16:22,733 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getDAGStatus took 6ms 2014-09-30 22:16:22,735 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(173)) - org.apache.tez.common.counters.DAGCounter: 2014-09-30 22:16:22,735 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - TOTAL_LAUNCHED_TASKS: 1 2014-09-30 22:16:22,735 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(173)) - File System Counters: 2014-09-30 22:16:22,735 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - HDFS: BYTES_READ: 0 2014-09-30 22:16:22,736 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - HDFS: BYTES_WRITTEN: 0 2014-09-30 22:16:22,736 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - HDFS: READ_OPS: 2 2014-09-30 22:16:22,736 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - HDFS: LARGE_READ_OPS: 0 2014-09-30 22:16:22,736 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - HDFS: WRITE_OPS: 2 2014-09-30 22:16:22,737 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(173)) - org.apache.tez.common.counters.TaskCounter: 2014-09-30 22:16:22,737 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - GC_TIME_MILLIS: 14 2014-09-30 22:16:22,737 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - CPU_MILLISECONDS: 1160 2014-09-30 22:16:22,737 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - PHYSICAL_MEMORY_BYTES: 155549696 2014-09-30 22:16:22,738 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - VIRTUAL_MEMORY_BYTES: 881426432 2014-09-30 22:16:22,738 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - COMMITTED_HEAP_BYTES: 201326592 2014-09-30 22:16:22,738 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - OUTPUT_RECORDS: 0 2014-09-30 22:16:22,738 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(173)) - HIVE: 2014-09-30 22:16:22,738 INFO [HiveServer2-Background-Pool: Thread-296]: exec.Task (TezTask.java:execute(175)) - CREATED_FILES: 1 2014-09-30 22:16:22,740 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1257 2014-09-30 22:16:22,740 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,741 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1257 2014-09-30 22:16:22,741 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,741 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 1ms 2014-09-30 22:16:22,742 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1258 2014-09-30 22:16:22,742 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,742 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1258 2014-09-30 22:16:22,742 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,742 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getListing took 1ms 2014-09-30 22:16:22,743 DEBUG [HiveServer2-Background-Pool: Thread-296]: exec.Utilities (Utilities.java:getIdFromFilename(1670)) - TaskId for 000000_0 = 000000 2014-09-30 22:16:22,743 INFO [HiveServer2-Background-Pool: Thread-296]: vector.VectorFileSinkOperator (Utilities.java:mvFileToFinalPath(1802)) - Moving tmp dir: hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-8/_tmp.-ext-10001 to: hdfs://nc-h04/tmp/hive/hduser/1dc4a291-8600-41e6-b9ba-5bb4c1d53662/hive_2014-09-30_22-16-20_750_2154185057436475060-8/-ext-10001 2014-09-30 22:16:22,744 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1259 2014-09-30 22:16:22,744 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,744 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1259 2014-09-30 22:16:22,744 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,745 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 1ms 2014-09-30 22:16:22,745 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1260 2014-09-30 22:16:22,745 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,747 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1260 2014-09-30 22:16:22,747 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,747 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: rename took 2ms 2014-09-30 22:16:22,748 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1261 2014-09-30 22:16:22,748 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,749 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1261 2014-09-30 22:16:22,749 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,750 DEBUG [HiveServer2-Background-Pool: Thread-296]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: delete took 2ms 2014-09-30 22:16:22,750 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,750 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,750 INFO [HiveServer2-Background-Pool: Thread-296]: ql.Driver (SessionState.java:printInfo(816)) - OK 2014-09-30 22:16:22,750 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:22,751 DEBUG [HiveServer2-Background-Pool: Thread-296]: lockmgr.DbLockManager (DbLockManager.java:unlock(110)) - Unlocking id:418761 2014-09-30 22:16:22,765 DEBUG [HiveServer2-Background-Pool: Thread-296]: lockmgr.DbLockManager (DbLockManager.java:unlock(113)) - Removed a lock true 2014-09-30 22:16:22,765 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,765 INFO [HiveServer2-Background-Pool: Thread-296]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,765 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:getOperationStatus(371)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: getOperationStatus() 2014-09-30 22:16:22,765 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,765 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 53 2014-09-30 22:16:22,766 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,766 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,767 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,767 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,767 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,768 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,768 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,768 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 6825 2014-09-30 22:16:22,768 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,771 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 102 2014-09-30 22:16:22,772 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,772 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,772 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,773 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:getResultSetMetadata(405)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: getResultSetMetadata() 2014-09-30 22:16:22,773 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,773 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 101 2014-09-30 22:16:22,773 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,775 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 112 2014-09-30 22:16:22,775 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,776 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,776 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,778 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1262 2014-09-30 22:16:22,778 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,779 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1262 2014-09-30 22:16:22,779 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,779 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getFileInfo took 2ms 2014-09-30 22:16:22,779 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,780 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1263 2014-09-30 22:16:22,780 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,780 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1263 2014-09-30 22:16:22,780 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,781 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: getListing took 1ms 2014-09-30 22:16:22,781 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,781 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,781 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,782 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 96 2014-09-30 22:16:22,782 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,784 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 4628 2014-09-30 22:16:22,785 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,794 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,794 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,794 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,795 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,795 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,795 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,796 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 6380 2014-09-30 22:16:22,796 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,804 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,804 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,805 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,805 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 6011 2014-09-30 22:16:22,806 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,814 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,814 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,815 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,815 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,816 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,816 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,816 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 7656 2014-09-30 22:16:22,816 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,824 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,824 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,825 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,825 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,826 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,826 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,826 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 5881 2014-09-30 22:16:22,826 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,834 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,834 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,835 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,835 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,836 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,836 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,836 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 4943 2014-09-30 22:16:22,836 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,844 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 117 2014-09-30 22:16:22,844 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:fetchResults(424)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: fetchResults() 2014-09-30 22:16:22,845 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,846 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 96 2014-09-30 22:16:22,846 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,847 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:readFrame(429)) - SERVER: reading data length: 96 2014-09-30 22:16:22,847 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(252)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,847 DEBUG [HiveServer2-Handler-Pool: Thread-253]: security.UserGroupInformation (UserGroupInformation.java:logPrivilegedAction(1572)) - PrivilegedAction as:hduser (auth:SIMPLE) from:org.apache.hadoop.hive.shims.HadoopShimsSecure.doAs(HadoopShimsSecure.java:508) 2014-09-30 22:16:22,848 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,848 INFO [HiveServer2-Handler-Pool: Thread-253]: exec.ListSinkOperator (Operator.java:close(581)) - 63 finished. closing... 2014-09-30 22:16:22,848 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:info(176)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,848 INFO [HiveServer2-Handler-Pool: Thread-253]: exec.ListSinkOperator (Operator.java:close(599)) - 63 Close done 2014-09-30 22:16:22,848 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:info(176)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,848 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ql.Driver (DriverContext.java:shutdown(132)) - Shutting down query select distinct id from foo7 2014-09-30 22:16:22,848 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,849 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1264 2014-09-30 22:16:22,849 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,850 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1264 2014-09-30 22:16:22,850 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,850 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: delete took 1ms 2014-09-30 22:16:22,850 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,851 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1265 2014-09-30 22:16:22,851 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,853 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1265 2014-09-30 22:16:22,853 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,853 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: delete took 2ms 2014-09-30 22:16:22,853 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,854 DEBUG [IPC Parameter Sending Thread #9]: ipc.Client (Client.java:run(1007)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser sending #1266 2014-09-30 22:16:22,854 DEBUG [IPC Parameter Sending Thread #9]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Parameter Sending Thread #9 2014-09-30 22:16:22,855 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: ipc.Client (Client.java:receiveRpcResponse(1064)) - IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser got value #1266 2014-09-30 22:16:22,856 DEBUG [IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread IPC Client (343751645) connection to nc-h04/192.168.20.6:8020 from hduser 2014-09-30 22:16:22,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: ipc.ProtobufRpcEngine (ProtobufRpcEngine.java:invoke(221)) - Call: delete took 2ms 2014-09-30 22:16:22,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,856 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogBegin(108)) - 2014-09-30 22:16:22,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:info(176)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,856 INFO [HiveServer2-Handler-Pool: Thread-253]: log.PerfLogger (PerfLogger.java:PerfLogEnd(135)) - 2014-09-30 22:16:22,856 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:info(176)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: cli.CLIService (CLIService.java:closeOperation(394)) - OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=a00694ff-fc06-4801-8a49-0b3eaaf2342f]: closeOperation 2014-09-30 22:16:22,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4JLogger.java:debug(155)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253 2014-09-30 22:16:22,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: transport.TSaslTransport (TSaslTransport.java:flush(468)) - writing data length: 42 2014-09-30 22:16:22,857 DEBUG [HiveServer2-Handler-Pool: Thread-253]: operation.LogDivertAppender (Log4jLoggerAdapter.java:debug(229)) - ---+++=== Dropped log event from thread HiveServer2-Handler-Pool: Thread-253