2015-05-12 15:31:15,134 INFO [main]: SessionState (SessionState.java:printInfo(948)) - Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties 2015-05-12 15:31:15,791 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:31:15,846 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:31:17,388 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/54adfa99-ebe5-41cf-9aed-22d898183080_resources 2015-05-12 15:31:17,401 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/54adfa99-ebe5-41cf-9aed-22d898183080 2015-05-12 15:31:17,403 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/hive/54adfa99-ebe5-41cf-9aed-22d898183080 2015-05-12 15:31:17,407 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/54adfa99-ebe5-41cf-9aed-22d898183080/_tmp_space.db 2015-05-12 15:31:19,900 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:19,901 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:19,901 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,041 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,049 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use default 2015-05-12 15:31:20,792 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:31:20,794 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,799 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,884 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:31:20,888 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,898 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:31:20,899 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,899 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:31:20,899 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,899 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512153119_faae9c0d-3d7b-4237-b88f-42fffebf80c6): use default 2015-05-12 15:31:20,905 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,905 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,905 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,912 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:31:20,924 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,925 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,925 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:31:20,925 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,926 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,926 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:20,931 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 1.031 seconds 2015-05-12 15:31:20,932 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:20,932 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:21,669 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:21,670 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:21,670 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:21,672 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:21,672 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export_sql4' 2015-05-12 15:31:21,676 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:31:21,676 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:21,676 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:21,683 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export_sql4 2015-05-12 15:31:21,683 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export_sql4 2015-05-12 15:31:22,029 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 15:31:22,077 INFO [main]: sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:(95)) - Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=54adfa99-ebe5-41cf-9aed-22d898183080, clientType=HIVECLI] 2015-05-12 15:31:22,079 INFO [main]: hive.metastore (HiveMetaStoreClient.java:isCompatibleWith(291)) - Mestastore configuration hive.metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook 2015-05-12 15:31:22,087 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:31:22,089 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:31:22,099 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-21_671_6462438380420896498-1 2015-05-12 15:31:22,110 ERROR [main]: ql.Driver (SessionState.java:printError(957)) - FAILED: SemanticException Exception while processing org.apache.hadoop.hive.ql.parse.SemanticException: Exception while processing at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.analyzeInternal(ImportSemanticAnalyzer.java:240) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.RuntimeException: Cannot create staging directory 'hdfs://node-4.example.com:8020/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-21_671_6462438380420896498-1': Permission denied: user=hive, access=WRITE, inode="/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-21_671_6462438380420896498-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.hive.ql.Context.getStagingDir(Context.java:244) at org.apache.hadoop.hive.ql.Context.getExternalScratchDir(Context.java:341) at org.apache.hadoop.hive.ql.Context.getExternalTmpPath(Context.java:416) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.addSinglePartition(ImportSemanticAnalyzer.java:392) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.createReplImportTasks(ImportSemanticAnalyzer.java:806) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.analyzeInternal(ImportSemanticAnalyzer.java:232) ... 19 more Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-21_671_6462438380420896498-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3009) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2977) at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:1047) at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:1043) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:1043) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:1036) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1877) at org.apache.hadoop.hive.common.FileUtils.mkdir(FileUtils.java:519) at org.apache.hadoop.hive.ql.Context.getStagingDir(Context.java:236) ... 24 more Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=hive, access=WRITE, inode="/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-21_671_6462438380420896498-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy11.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:558) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy12.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3007) ... 33 more 2015-05-12 15:31:22,110 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:22,110 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:22,111 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:22,114 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:22,114 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:30,706 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,706 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,706 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,708 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,708 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables 2015-05-12 15:31:30,709 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:31:30,710 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:30,710 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,721 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:31:30,721 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:30,967 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[0] 2015-05-12 15:31:30,969 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 0 OP 2015-05-12 15:31:30,969 INFO [main]: exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 0 OP initialized 2015-05-12 15:31:30,973 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2015-05-12 15:31:30,973 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:30,974 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:31:30,974 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,974 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512153130_2077dfc4-27b2-4f79-b3a3-2b091119c5d3): show tables 2015-05-12 15:31:30,974 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:30,974 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,974 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:30,975 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:31:31,044 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:31,044 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:31,044 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:31:31,044 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:31,044 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:31,044 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:31,052 INFO [main]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir 2015-05-12 15:31:31,070 INFO [main]: lzo.GPLNativeCodeLoader (GPLNativeCodeLoader.java:(34)) - Loaded native gpl library 2015-05-12 15:31:31,076 INFO [main]: lzo.LzoCodec (LzoCodec.java:(76)) - Successfully loaded & initialized native-lzo library [hadoop-lzo rev d7a6d650878ef8a5a4ce8ce40ccf2c974b4f4b44] 2015-05-12 15:31:31,101 INFO [main]: mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2015-05-12 15:31:31,125 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 0 finished. closing... 2015-05-12 15:31:31,125 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 0 Close done 2015-05-12 15:31:31,128 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 0.338 seconds, Fetched: 3 row(s) 2015-05-12 15:31:31,129 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:31,129 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:40,418 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,419 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,419 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,428 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,428 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export_sql4' 2015-05-12 15:31:40,429 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:31:40,429 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:40,429 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,429 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export_sql4 2015-05-12 15:31:40,429 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export_sql4 2015-05-12 15:31:40,459 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 15:31:40,472 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-40_426_4392768366245393352-1 2015-05-12 15:31:40,480 ERROR [main]: ql.Driver (SessionState.java:printError(957)) - FAILED: SemanticException Exception while processing org.apache.hadoop.hive.ql.parse.SemanticException: Exception while processing at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.analyzeInternal(ImportSemanticAnalyzer.java:240) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.RuntimeException: Cannot create staging directory 'hdfs://node-4.example.com:8020/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-40_426_4392768366245393352-1': Permission denied: user=hive, access=WRITE, inode="/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-40_426_4392768366245393352-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.hive.ql.Context.getStagingDir(Context.java:244) at org.apache.hadoop.hive.ql.Context.getExternalScratchDir(Context.java:341) at org.apache.hadoop.hive.ql.Context.getExternalTmpPath(Context.java:416) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.addSinglePartition(ImportSemanticAnalyzer.java:392) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.createReplImportTasks(ImportSemanticAnalyzer.java:806) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.analyzeInternal(ImportSemanticAnalyzer.java:232) ... 19 more Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-40_426_4392768366245393352-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3009) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2977) at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:1047) at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:1043) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:1043) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:1036) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1877) at org.apache.hadoop.hive.common.FileUtils.mkdir(FileUtils.java:519) at org.apache.hadoop.hive.ql.Context.getStagingDir(Context.java:236) ... 24 more Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=hive, access=WRITE, inode="/tmp/export_sql4/.hive-staging_hive_2015-05-12_15-31-40_426_4392768366245393352-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy11.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:558) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy12.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3007) ... 33 more 2015-05-12 15:31:40,480 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:40,480 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,480 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:31:40,480 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:31:40,480 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:29,328 INFO [main]: SessionState (SessionState.java:printInfo(948)) - Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties 2015-05-12 15:47:30,026 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:47:30,085 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:47:31,657 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/141d7611-d874-4fbc-823a-115d96213685_resources 2015-05-12 15:47:31,671 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/141d7611-d874-4fbc-823a-115d96213685 2015-05-12 15:47:31,674 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/hive/141d7611-d874-4fbc-823a-115d96213685 2015-05-12 15:47:31,677 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/141d7611-d874-4fbc-823a-115d96213685/_tmp_space.db 2015-05-12 15:47:34,359 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:34,359 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:34,359 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:34,435 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:34,447 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use default 2015-05-12 15:47:35,272 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:47:35,273 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,278 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:35,376 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:47:35,382 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,395 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:47:35,395 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,396 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:47:35,397 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:35,397 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512154734_a66640dc-c381-4e52-b79d-a45f5cfe183d): use default 2015-05-12 15:47:35,403 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,403 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:35,403 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:35,412 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:47:35,425 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,425 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,427 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:47:35,428 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:35,428 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,428 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:35,433 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 1.079 seconds 2015-05-12 15:47:35,434 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:35,434 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:47,424 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,425 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,425 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,427 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,427 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export4' 2015-05-12 15:47:47,431 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:47:47,431 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:47,431 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,437 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export4 2015-05-12 15:47:47,438 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export4 2015-05-12 15:47:47,714 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 15:47:47,769 INFO [main]: sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:(95)) - Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=141d7611-d874-4fbc-823a-115d96213685, clientType=HIVECLI] 2015-05-12 15:47:47,771 INFO [main]: hive.metastore (HiveMetaStoreClient.java:isCompatibleWith(291)) - Mestastore configuration hive.metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook 2015-05-12 15:47:47,781 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:47:47,784 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:47:47,791 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-47-47_426_5983472846034638390-1 2015-05-12 15:47:47,801 ERROR [main]: ql.Driver (SessionState.java:printError(957)) - FAILED: SemanticException Exception while processing org.apache.hadoop.hive.ql.parse.SemanticException: Exception while processing at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.analyzeInternal(ImportSemanticAnalyzer.java:240) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308) at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.RuntimeException: Cannot create staging directory 'hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-47-47_426_5983472846034638390-1': Permission denied: user=hive, access=WRITE, inode="/tmp/export4/.hive-staging_hive_2015-05-12_15-47-47_426_5983472846034638390-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.hive.ql.Context.getStagingDir(Context.java:244) at org.apache.hadoop.hive.ql.Context.getExternalScratchDir(Context.java:341) at org.apache.hadoop.hive.ql.Context.getExternalTmpPath(Context.java:416) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.addSinglePartition(ImportSemanticAnalyzer.java:392) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.createReplImportTasks(ImportSemanticAnalyzer.java:806) at org.apache.hadoop.hive.ql.parse.ImportSemanticAnalyzer.analyzeInternal(ImportSemanticAnalyzer.java:232) ... 19 more Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hive, access=WRITE, inode="/tmp/export4/.hive-staging_hive_2015-05-12_15-47-47_426_5983472846034638390-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:73) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3009) at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:2977) at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:1047) at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:1043) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirsInternal(DistributedFileSystem.java:1043) at org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:1036) at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1877) at org.apache.hadoop.hive.common.FileUtils.mkdir(FileUtils.java:519) at org.apache.hadoop.hive.ql.Context.getStagingDir(Context.java:236) ... 24 more Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=hive, access=WRITE, inode="/tmp/export4/.hive-staging_hive_2015-05-12_15-47-47_426_5983472846034638390-1":root:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:319) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:292) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:213) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1698) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1682) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1665) at org.apache.hadoop.hdfs.server.namenode.FSDirMkdirOp.mkdirs(FSDirMkdirOp.java:71) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:3915) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:977) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.mkdirs(ClientNamenodeProtocolServerSideTranslatorPB.java:622) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043) at org.apache.hadoop.ipc.Client.call(Client.java:1476) at org.apache.hadoop.ipc.Client.call(Client.java:1407) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy11.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.mkdirs(ClientNamenodeProtocolTranslatorPB.java:558) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102) at com.sun.proxy.$Proxy12.mkdirs(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.primitiveMkdir(DFSClient.java:3007) ... 33 more 2015-05-12 15:47:47,801 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:47,803 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,803 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:47,867 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:47,868 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,452 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,452 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,452 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,455 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,456 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables 2015-05-12 15:47:53,457 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:47:53,457 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,458 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,465 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:47:53,465 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,741 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[0] 2015-05-12 15:47:53,746 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 0 OP 2015-05-12 15:47:53,746 INFO [main]: exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 0 OP initialized 2015-05-12 15:47:53,752 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2015-05-12 15:47:53,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,753 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:47:53,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,753 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512154753_ba566572-6e93-4104-b0a7-32916c5509b3): show tables 2015-05-12 15:47:53,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,753 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,753 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:47:53,806 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,807 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,807 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:47:53,807 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,807 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,807 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:47:53,814 INFO [main]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir 2015-05-12 15:47:53,832 INFO [main]: lzo.GPLNativeCodeLoader (GPLNativeCodeLoader.java:(34)) - Loaded native gpl library 2015-05-12 15:47:53,845 INFO [main]: lzo.LzoCodec (LzoCodec.java:(76)) - Successfully loaded & initialized native-lzo library [hadoop-lzo rev d7a6d650878ef8a5a4ce8ce40ccf2c974b4f4b44] 2015-05-12 15:47:53,869 INFO [main]: mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2015-05-12 15:47:53,894 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 0 finished. closing... 2015-05-12 15:47:53,894 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 0 Close done 2015-05-12 15:47:53,899 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 0.355 seconds, Fetched: 3 row(s) 2015-05-12 15:47:53,899 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:47:53,899 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:50:14,115 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,115 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,115 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,118 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,118 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export4' 2015-05-12 15:50:14,119 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:50:14,119 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:50:14,119 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,122 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export4 2015-05-12 15:50:14,122 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export4 2015-05-12 15:50:14,161 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 15:50:14,183 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1 2015-05-12 15:50:14,314 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:50:14,314 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:50:14,314 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:50:14,316 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:50:14,316 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:50:14,316 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,316 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155014_b784c7a5-426e-4b30-b308-ab94f1a939f2): import table page_view4 from '/tmp/export4' 2015-05-12 15:50:14,317 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:50:14,317 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,317 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,317 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-1:COPY] in serial mode 2015-05-12 15:50:14,318 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1/-ext-10000 2015-05-12 15:50:14,324 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1/-ext-10000 2015-05-12 15:50:14,344 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying file: hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa/000000_0 2015-05-12 15:50:14,691 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,692 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-4:COPY] in serial mode 2015-05-12 15:50:14,692 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=2/country=india to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1/-ext-10001 2015-05-12 15:50:14,694 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,694 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-7:COPY] in serial mode 2015-05-12 15:50:14,694 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=4/country=uk to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1/-ext-10002 2015-05-12 15:50:14,696 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,697 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:50:14,839 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:14,841 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-2:DDL] in serial mode 2015-05-12 15:50:15,031 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:15,032 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-5:DDL] in serial mode 2015-05-12 15:50:15,124 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:15,125 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-8:DDL] in serial mode 2015-05-12 15:50:15,229 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:50:15,230 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-3:MOVE] in serial mode 2015-05-12 15:50:15,230 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Loading data to table default.page_view4 partition (country=usa, dt=1) from hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1/-ext-10000 2015-05-12 15:50:15,251 INFO [main]: exec.MoveTask (MoveTask.java:execute(307)) - Partition is: {country=usa, dt=1} 2015-05-12 15:50:15,406 ERROR [main]: hdfs.KeyProviderCache (KeyProviderCache.java:createKeyProviderURI(87)) - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 2015-05-12 15:50:15,435 INFO [main]: metadata.Hive (Hive.java:moveFile(2636)) - Replacing src:hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-50-14_118_3755298899952758370-1/-ext-10000/000000_0, dest: hdfs://node-4.example.com:8020/apps/hive/warehouse/page_view4/country=usa/dt=1/000000_0, Status:true 2015-05-12 15:50:15,722 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:20,723 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:20,726 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:20,726 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:25,727 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:25,729 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:25,729 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:30,731 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:30,733 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:30,733 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:35,734 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:35,736 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:35,737 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:40,739 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:40,741 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:40,741 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:45,746 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:45,748 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:45,748 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:50,750 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:50,751 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:50,751 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:50:55,752 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:50:55,759 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:50:55,760 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:00,760 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:00,762 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:00,762 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:05,763 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:05,765 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:05,765 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:07,388 INFO [SIGINT handler]: CliDriver (SessionState.java:printInfo(948)) - Interrupting... Be patient, this might take some time. 2015-05-12 15:51:07,388 INFO [SIGINT handler]: CliDriver (SessionState.java:printInfo(948)) - Press Ctrl+C again to kill JVM 2015-05-12 15:51:09,466 INFO [SIGINT handler]: CliDriver (SessionState.java:printInfo(948)) - Exiting the JVM 2015-05-12 15:51:14,684 INFO [main]: SessionState (SessionState.java:printInfo(948)) - Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties 2015-05-12 15:51:15,399 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:15,465 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:17,121 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/6ed36525-e3dd-4156-80ae-56c599f00224_resources 2015-05-12 15:51:17,134 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/6ed36525-e3dd-4156-80ae-56c599f00224 2015-05-12 15:51:17,136 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/hive/6ed36525-e3dd-4156-80ae-56c599f00224 2015-05-12 15:51:17,138 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/6ed36525-e3dd-4156-80ae-56c599f00224/_tmp_space.db 2015-05-12 15:51:18,458 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:18,462 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:18,462 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:18,573 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:18,584 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: use default 2015-05-12 15:51:19,370 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:51:19,370 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,376 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:19,462 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:51:19,469 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,479 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:51:19,480 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,481 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:51:19,481 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:19,481 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155118_cd21de81-18eb-4ae4-bfc4-7d61a7d63b20): use default 2015-05-12 15:51:19,488 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,488 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:19,488 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:19,497 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:51:19,510 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,510 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,511 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:51:19,511 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:19,511 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,511 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:19,517 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 1.067 seconds 2015-05-12 15:51:19,517 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:19,517 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:32,819 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,819 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,819 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,821 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,821 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: drop table page_view4 2015-05-12 15:51:32,823 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:51:32,823 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:32,824 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,955 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:51:32,955 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:32,955 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:51:32,955 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:32,956 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:51:32,956 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,956 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155132_454f92d6-923e-4a7b-9d66-5ba7bc96bc42): drop table page_view4 2015-05-12 15:51:32,956 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:32,956 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,956 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:32,956 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:51:33,799 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:33,799 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:33,799 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:51:33,799 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:33,799 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:33,799 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:33,799 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 0.98 seconds 2015-05-12 15:51:33,800 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:33,800 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:36,946 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:36,946 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:36,946 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:36,948 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:36,948 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export4' 2015-05-12 15:51:36,951 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:51:36,951 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:36,951 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:36,957 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export4 2015-05-12 15:51:36,957 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export4 2015-05-12 15:51:37,204 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 15:51:37,257 INFO [main]: sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:(95)) - Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=6ed36525-e3dd-4156-80ae-56c599f00224, clientType=HIVECLI] 2015-05-12 15:51:37,259 INFO [main]: hive.metastore (HiveMetaStoreClient.java:isCompatibleWith(291)) - Mestastore configuration hive.metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook 2015-05-12 15:51:37,270 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:37,272 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:37,281 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1 2015-05-12 15:51:37,401 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:51:37,401 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:37,401 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:51:37,402 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:37,402 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:51:37,402 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:37,402 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155136_7d67947e-aedb-44ba-82fb-46cf78fae982): import table page_view4 from '/tmp/export4' 2015-05-12 15:51:37,402 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:51:37,402 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:37,402 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:37,406 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-1:COPY] in serial mode 2015-05-12 15:51:37,406 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1/-ext-10000 2015-05-12 15:51:37,413 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1/-ext-10000 2015-05-12 15:51:37,429 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying file: hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa/000000_0 2015-05-12 15:51:37,737 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:37,738 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-4:COPY] in serial mode 2015-05-12 15:51:37,738 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=2/country=india to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1/-ext-10001 2015-05-12 15:51:37,743 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:37,744 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-7:COPY] in serial mode 2015-05-12 15:51:37,744 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=4/country=uk to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1/-ext-10002 2015-05-12 15:51:37,748 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:37,748 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:51:38,025 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:38,027 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-2:DDL] in serial mode 2015-05-12 15:51:38,185 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:38,186 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-5:DDL] in serial mode 2015-05-12 15:51:38,332 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:38,334 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-8:DDL] in serial mode 2015-05-12 15:51:38,495 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:51:38,496 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-3:MOVE] in serial mode 2015-05-12 15:51:38,498 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Loading data to table default.page_view4 partition (country=usa, dt=1) from hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1/-ext-10000 2015-05-12 15:51:38,518 INFO [main]: exec.MoveTask (MoveTask.java:execute(307)) - Partition is: {country=usa, dt=1} 2015-05-12 15:51:38,665 ERROR [main]: hdfs.KeyProviderCache (KeyProviderCache.java:createKeyProviderURI(87)) - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 2015-05-12 15:51:38,706 INFO [main]: metadata.Hive (Hive.java:moveFile(2636)) - Replacing src:hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-51-36_947_7761477879108703020-1/-ext-10000/000000_0, dest: hdfs://node-4.example.com:8020/apps/hive/warehouse/page_view4/country=usa/dt=1/000000_0, Status:true 2015-05-12 15:51:39,161 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:44,168 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:44,170 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:44,170 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:49,170 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:49,174 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:49,174 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:54,178 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:54,180 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:54,180 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:51:59,181 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:51:59,183 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:51:59,183 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:04,184 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:04,185 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:04,186 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:09,187 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:09,189 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:09,189 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:14,190 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:14,192 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:14,193 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:19,193 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:19,197 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:19,199 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:24,199 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:24,201 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:24,201 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:29,202 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:29,204 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:29,205 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:34,206 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:34,208 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:34,209 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:39,210 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:39,216 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:39,216 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:44,218 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:44,220 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:44,220 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:49,221 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:49,224 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:49,224 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:54,227 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:54,229 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:54,231 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:52:59,232 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:52:59,233 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:52:59,234 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:53:04,236 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:53:04,238 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:53:04,239 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:53:09,239 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:53:09,242 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:53:09,243 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:53:14,243 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:53:14,246 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:53:14,247 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:53:15,733 INFO [SIGINT handler]: CliDriver (SessionState.java:printInfo(948)) - Interrupting... Be patient, this might take some time. 2015-05-12 15:53:15,733 INFO [SIGINT handler]: CliDriver (SessionState.java:printInfo(948)) - Press Ctrl+C again to kill JVM 2015-05-12 15:53:17,237 INFO [SIGINT handler]: CliDriver (SessionState.java:printInfo(948)) - Exiting the JVM 2015-05-12 15:53:25,250 INFO [main]: SessionState (SessionState.java:printInfo(948)) - Logging initialized using configuration in file:/etc/hive/conf/hive-log4j.properties 2015-05-12 15:53:25,980 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:53:26,045 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:53:27,629 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/c8bc77d4-8be9-4b4f-9bc2-81131e76f714_resources 2015-05-12 15:53:27,641 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/c8bc77d4-8be9-4b4f-9bc2-81131e76f714 2015-05-12 15:53:27,643 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created local directory: /tmp/hive/c8bc77d4-8be9-4b4f-9bc2-81131e76f714 2015-05-12 15:53:27,645 INFO [main]: session.SessionState (SessionState.java:createPath(638)) - Created HDFS directory: /tmp/hive/hive/c8bc77d4-8be9-4b4f-9bc2-81131e76f714/_tmp_space.db 2015-05-12 15:53:32,664 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:32,664 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:32,664 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:32,738 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:32,744 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: drop table page_view4 2015-05-12 15:53:33,569 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:53:33,572 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:33,578 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:33,767 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:53:33,771 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:33,785 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:53:33,785 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:33,787 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:53:33,787 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:33,787 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155332_47e320d1-25f1-449e-b0f4-ba9f9aa76a8d): drop table page_view4 2015-05-12 15:53:33,793 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:33,793 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:33,793 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:33,802 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:53:34,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:34,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:34,162 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:53:34,162 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:34,162 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:34,162 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:53:34,165 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 1.507 seconds 2015-05-12 15:53:34,165 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:53:34,165 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:54:03,975 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:03,975 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:03,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:03,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:03,976 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export4' 2015-05-12 15:54:03,983 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:54:03,983 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:54:03,983 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:03,988 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export4 2015-05-12 15:54:03,988 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export4 2015-05-12 15:54:04,186 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 15:54:04,327 INFO [main]: sqlstd.SQLStdHiveAccessController (SQLStdHiveAccessController.java:(95)) - Created SQLStdHiveAccessController for session context : HiveAuthzSessionContext [sessionString=c8bc77d4-8be9-4b4f-9bc2-81131e76f714, clientType=HIVECLI] 2015-05-12 15:54:04,329 INFO [main]: hive.metastore (HiveMetaStoreClient.java:isCompatibleWith(291)) - Mestastore configuration hive.metastore.filter.hook changed from org.apache.hadoop.hive.metastore.DefaultMetaStoreFilterHookImpl to org.apache.hadoop.hive.ql.security.authorization.plugin.AuthorizationMetaStoreFilterHook 2015-05-12 15:54:04,341 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:04,342 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:04,351 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1 2015-05-12 15:54:04,481 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:54:04,482 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:54:04,482 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 15:54:04,482 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:54:04,482 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:54:04,482 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:04,482 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155403_1a8771a0-4f75-456f-829c-1ebf33cff448): import table page_view4 from '/tmp/export4' 2015-05-12 15:54:04,482 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:54:04,482 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:04,483 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:04,483 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-1:COPY] in serial mode 2015-05-12 15:54:04,483 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1/-ext-10000 2015-05-12 15:54:04,492 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1/-ext-10000 2015-05-12 15:54:04,506 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying file: hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa/000000_0 2015-05-12 15:54:04,819 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:04,820 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-4:COPY] in serial mode 2015-05-12 15:54:04,820 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=2/country=india to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1/-ext-10001 2015-05-12 15:54:04,823 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:04,823 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-7:COPY] in serial mode 2015-05-12 15:54:04,823 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=4/country=uk to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1/-ext-10002 2015-05-12 15:54:04,828 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:04,828 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:54:05,085 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:05,085 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-2:DDL] in serial mode 2015-05-12 15:54:05,211 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:05,213 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-5:DDL] in serial mode 2015-05-12 15:54:05,287 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:05,288 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-8:DDL] in serial mode 2015-05-12 15:54:05,378 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:54:05,379 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-3:MOVE] in serial mode 2015-05-12 15:54:05,379 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Loading data to table default.page_view4 partition (country=usa, dt=1) from hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1/-ext-10000 2015-05-12 15:54:05,399 INFO [main]: exec.MoveTask (MoveTask.java:execute(307)) - Partition is: {country=usa, dt=1} 2015-05-12 15:54:05,522 ERROR [main]: hdfs.KeyProviderCache (KeyProviderCache.java:createKeyProviderURI(87)) - Could not find uri with key [dfs.encryption.key.provider.uri] to create a keyProvider !! 2015-05-12 15:54:05,542 INFO [main]: metadata.Hive (Hive.java:moveFile(2636)) - Replacing src:hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_15-54-03_976_8941719431743729994-1/-ext-10000/000000_0, dest: hdfs://node-4.example.com:8020/apps/hive/warehouse/page_view4/country=usa/dt=1/000000_0, Status:true 2015-05-12 15:54:05,786 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:10,788 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:10,790 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:10,790 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:15,790 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:15,792 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:15,792 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:20,793 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:20,795 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:20,796 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:25,796 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:25,799 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:25,799 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:30,803 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:30,805 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:30,806 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:35,806 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:35,809 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:35,809 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:40,811 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:40,815 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:40,815 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:45,817 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:45,819 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:45,819 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:50,820 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:50,823 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:50,823 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:54:55,825 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:54:55,830 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:54:55,831 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:00,832 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:00,834 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:00,835 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:05,836 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:05,838 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:05,838 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:10,839 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:10,841 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:10,841 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:15,842 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:15,843 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:15,843 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:20,844 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:20,846 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:20,848 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:25,849 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:25,852 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:25,852 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:30,853 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:30,855 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:30,855 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:35,857 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:35,859 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:35,860 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:40,860 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:40,862 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:40,862 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:45,863 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:45,866 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:45,866 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:50,867 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:50,870 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:50,870 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:55:55,872 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:55:55,879 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:55:55,879 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:56:00,882 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:56:00,884 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:56:00,884 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:56:05,885 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:56:05,888 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:56:05,888 ERROR [main]: metadata.Hive (Hive.java:getPartition(1883)) - org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1947) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) ... 23 more 2015-05-12 15:56:05,889 ERROR [main]: exec.Task (SessionState.java:printError(957)) - Failed with exception org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1884) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1947) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) ... 22 more Caused by: org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) ... 23 more 2015-05-12 15:56:05,889 ERROR [main]: ql.Driver (SessionState.java:printError(957)) - FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask 2015-05-12 15:56:05,889 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:05,889 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:05,890 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:05,898 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:05,899 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:43,315 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,317 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,317 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,320 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,320 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: show tables 2015-05-12 15:56:43,321 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:56:43,322 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:43,322 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,326 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:56:43,326 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:43,450 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[0] 2015-05-12 15:56:43,457 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 0 OP 2015-05-12 15:56:43,458 INFO [main]: exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 0 OP initialized 2015-05-12 15:56:43,462 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from deserializer)], properties:null) 2015-05-12 15:56:43,463 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:43,463 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:56:43,463 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,463 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155643_266ba6cb-c9c4-416b-b99e-a07acd0d3878): show tables 2015-05-12 15:56:43,463 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:43,463 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,463 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:43,464 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 15:56:43,483 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.TApplicationException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.thrift.TApplicationException.read(TApplicationException.java:111) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMetastore.java:654) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastore.java:641) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:1158) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.getDatabase(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1301) at org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1290) at org.apache.hadoop.hive.ql.exec.DDLTask.showTables(DDLTask.java:2261) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:390) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 15:56:48,483 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 15:56:48,485 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 15:56:48,537 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:48,537 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:48,537 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:56:48,537 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:48,537 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:48,538 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:56:48,544 INFO [main]: Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir 2015-05-12 15:56:48,557 INFO [main]: lzo.GPLNativeCodeLoader (GPLNativeCodeLoader.java:(34)) - Loaded native gpl library 2015-05-12 15:56:48,563 INFO [main]: lzo.LzoCodec (LzoCodec.java:(76)) - Successfully loaded & initialized native-lzo library [hadoop-lzo rev d7a6d650878ef8a5a4ce8ce40ccf2c974b4f4b44] 2015-05-12 15:56:48,569 INFO [main]: mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2015-05-12 15:56:48,590 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 0 finished. closing... 2015-05-12 15:56:48,590 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 0 Close done 2015-05-12 15:56:48,591 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 5.223 seconds, Fetched: 4 row(s) 2015-05-12 15:56:48,592 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:56:48,592 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:12,347 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:12,347 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:12,347 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:12,348 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:12,349 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: select * from page_view4 2015-05-12 15:57:12,365 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 15:57:12,366 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:12,366 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:12,396 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10042)) - Starting Semantic Analysis 2015-05-12 15:57:12,397 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10025)) - Completed phase 1 of Semantic Analysis 2015-05-12 15:57:12,397 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1530)) - Get metadata for source tables 2015-05-12 15:57:12,437 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1682)) - Get metadata for subqueries 2015-05-12 15:57:12,464 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:getMetaData(1706)) - Get metadata for destination tables 2015-05-12 15:57:12,482 INFO [main]: ql.Context (Context.java:getMRScratchDir(330)) - New scratch dir is hdfs://node-4.example.com:8020/tmp/hive/hive/c8bc77d4-8be9-4b4f-9bc2-81131e76f714/hive_2015-05-12_15-57-12_348_1456730555694897494-1 2015-05-12 15:57:12,482 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:genResolvedParseTree(10029)) - Completed getting MetaData in Semantic Analysis 2015-05-12 15:57:12,516 INFO [main]: parse.BaseSemanticAnalyzer (CalcitePlanner.java:canCBOHandleAst(385)) - Not invoking CBO because the statement has too few joins 2015-05-12 15:57:12,536 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/hive/hive/c8bc77d4-8be9-4b4f-9bc2-81131e76f714/hive_2015-05-12_15-57-12_348_1456730555694897494-1/-mr-10000/.hive-staging_hive_2015-05-12_15-57-12_348_1456730555694897494-1 2015-05-12 15:57:12,605 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:genFileSinkPlan(6630)) - Set stats collection dir : hdfs://node-4.example.com:8020/tmp/hive/hive/c8bc77d4-8be9-4b4f-9bc2-81131e76f714/hive_2015-05-12_15-57-12_348_1456730555694897494-1/-mr-10000/.hive-staging_hive_2015-05-12_15-57-12_348_1456730555694897494-1/-ext-10002 2015-05-12 15:57:12,810 INFO [main]: ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for FS(2) 2015-05-12 15:57:12,810 INFO [main]: ppd.OpProcFactory (OpProcFactory.java:process(655)) - Processing for SEL(1) 2015-05-12 15:57:12,810 INFO [main]: ppd.OpProcFactory (OpProcFactory.java:process(382)) - Processing for TS(0) 2015-05-12 15:57:12,881 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:12,944 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,009 INFO [main]: parse.CalcitePlanner (SemanticAnalyzer.java:analyzeInternal(10128)) - Completed plan generation 2015-05-12 15:57:13,009 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 15:57:13,009 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,028 INFO [main]: exec.TableScanOperator (Operator.java:initialize(332)) - Initializing operator TS[0] 2015-05-12 15:57:13,028 INFO [main]: exec.TableScanOperator (Operator.java:initialize(372)) - Initialization Done 0 TS 2015-05-12 15:57:13,028 INFO [main]: exec.TableScanOperator (Operator.java:initializeChildren(429)) - Operator 0 TS initialized 2015-05-12 15:57:13,028 INFO [main]: exec.TableScanOperator (Operator.java:initializeChildren(435)) - Initializing children of 0 TS 2015-05-12 15:57:13,028 INFO [main]: exec.SelectOperator (Operator.java:initialize(469)) - Initializing child 1 SEL 2015-05-12 15:57:13,029 INFO [main]: exec.SelectOperator (Operator.java:initialize(332)) - Initializing operator SEL[1] 2015-05-12 15:57:13,153 INFO [main]: exec.SelectOperator (SelectOperator.java:initializeOp(65)) - SELECT struct 2015-05-12 15:57:13,154 INFO [main]: exec.SelectOperator (Operator.java:initialize(372)) - Initialization Done 1 SEL 2015-05-12 15:57:13,154 INFO [main]: exec.SelectOperator (Operator.java:initializeChildren(429)) - Operator 1 SEL initialized 2015-05-12 15:57:13,154 INFO [main]: exec.SelectOperator (Operator.java:initializeChildren(435)) - Initializing children of 1 SEL 2015-05-12 15:57:13,154 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(469)) - Initializing child 3 OP 2015-05-12 15:57:13,154 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[3] 2015-05-12 15:57:13,154 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 3 OP 2015-05-12 15:57:13,154 INFO [main]: exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 3 OP initialized 2015-05-12 15:57:13,159 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:page_view4.viewtime, type:int, comment:null), FieldSchema(name:page_view4.userid, type:bigint, comment:null), FieldSchema(name:page_view4.page_url, type:string, comment:null), FieldSchema(name:page_view4.referrer_url, type:string, comment:null), FieldSchema(name:page_view4.ip, type:string, comment:null), FieldSchema(name:page_view4.dt, type:string, comment:null), FieldSchema(name:page_view4.country, type:string, comment:null)], properties:null) 2015-05-12 15:57:13,159 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,160 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 15:57:13,160 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:13,160 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512155712_205f7734-c7fa-4ffb-9830-c69ba21fd361): select * from page_view4 2015-05-12 15:57:13,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:13,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,161 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 15:57:13,161 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:13,162 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,162 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 15:57:13,177 INFO [main]: mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2015-05-12 15:57:13,220 INFO [main]: exec.TableScanOperator (Operator.java:close(612)) - 0 finished. closing... 2015-05-12 15:57:13,220 INFO [main]: exec.SelectOperator (Operator.java:close(612)) - 1 finished. closing... 2015-05-12 15:57:13,220 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 3 finished. closing... 2015-05-12 15:57:13,220 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 3 Close done 2015-05-12 15:57:13,220 INFO [main]: exec.SelectOperator (Operator.java:close(634)) - 1 Close done 2015-05-12 15:57:13,220 INFO [main]: exec.TableScanOperator (Operator.java:close(634)) - 0 Close done 2015-05-12 15:57:13,226 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 0.816 seconds, Fetched: 1 row(s) 2015-05-12 15:57:13,226 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 15:57:13,226 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,757 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,760 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,760 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,761 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,761 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: describe extended page_view4 2015-05-12 16:13:37,764 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 16:13:37,764 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,764 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,838 INFO [main]: parse.DDLSemanticAnalyzer (DDLSemanticAnalyzer.java:analyzeDescribeTable(2045)) - analyzeDescribeTable done 2015-05-12 16:13:37,838 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 16:13:37,838 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,844 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(332)) - Initializing operator OP[0] 2015-05-12 16:13:37,845 INFO [main]: exec.ListSinkOperator (Operator.java:initialize(372)) - Initialization Done 0 OP 2015-05-12 16:13:37,845 INFO [main]: exec.ListSinkOperator (Operator.java:initializeChildren(429)) - Operator 0 OP initialized 2015-05-12 16:13:37,845 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:col_name, type:string, comment:from deserializer), FieldSchema(name:data_type, type:string, comment:from deserializer), FieldSchema(name:comment, type:string, comment:from deserializer)], properties:null) 2015-05-12 16:13:37,845 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,845 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 16:13:37,846 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,847 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512161337_1d5c09d2-334d-43fc-bde8-c0a7352b85fc): describe extended page_view4 2015-05-12 16:13:37,847 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,847 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,847 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,848 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 16:13:37,898 INFO [main]: exec.DDLTask (DDLTask.java:describeTable(3145)) - DDLTask: got data for page_view4 2015-05-12 16:13:37,900 INFO [main]: exec.DDLTask (DDLTask.java:describeTable(3195)) - DDLTask: written data for page_view4 2015-05-12 16:13:37,903 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,904 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,904 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 16:13:37,906 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,906 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,907 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:13:37,909 INFO [main]: mapred.FileInputFormat (FileInputFormat.java:listStatus(249)) - Total input paths to process : 1 2015-05-12 16:13:37,921 INFO [main]: lazy.LazyStruct (LazyStruct.java:parse(158)) - Missing fields! Expected 3 fields but only got 1! Ignoring similar problems. 2015-05-12 16:13:37,921 WARN [main]: lazy.LazyStruct (LazyStruct.java:parse(151)) - Extra bytes detected at the end of the row! Ignoring similar problems. 2015-05-12 16:13:37,923 INFO [main]: exec.ListSinkOperator (Operator.java:close(612)) - 0 finished. closing... 2015-05-12 16:13:37,923 INFO [main]: exec.ListSinkOperator (Operator.java:close(634)) - 0 Close done 2015-05-12 16:13:37,930 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 0.15 seconds, Fetched: 15 row(s) 2015-05-12 16:13:37,931 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:13:37,931 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,759 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,759 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,760 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,760 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,761 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: drop table page_view4 2015-05-12 16:39:41,761 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 16:39:41,761 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,761 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,785 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 16:39:41,785 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,785 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 16:39:41,785 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,785 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 16:39:41,786 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,786 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512163941_d65d020c-dada-47fd-a8a6-4a79d0c9428a): drop table page_view4 2015-05-12 16:39:41,786 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,786 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,786 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,786 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 16:39:41,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,976 INFO [main]: ql.Driver (SessionState.java:printInfo(948)) - OK 2015-05-12 16:39:41,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,976 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:41,977 INFO [main]: CliDriver (SessionState.java:printInfo(948)) - Time taken: 0.217 seconds 2015-05-12 16:39:41,977 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:41,977 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:45,167 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,168 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,169 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,170 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,170 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: import table page_view4 from '/tmp/export4' 2015-05-12 16:39:45,170 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed 2015-05-12 16:39:45,170 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:45,170 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,171 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(84)) - Path before norm :/tmp/export4 2015-05-12 16:39:45,174 INFO [main]: parse.EximUtil (EximUtil.java:getValidatedURI(111)) - Scheme:hdfs, authority:node-4.example.com:8020, path:/tmp/export4 2015-05-12 16:39:45,201 ERROR [main]: metadata.Hive (Hive.java:getTable(1118)) - Table page_view4 not found: default.page_view4 table not found 2015-05-12 16:39:45,208 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1 2015-05-12 16:39:45,222 INFO [main]: ql.Driver (Driver.java:compile(436)) - Semantic Analysis Completed 2015-05-12 16:39:45,222 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:45,223 INFO [main]: ql.Driver (Driver.java:getSchema(240)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null) 2015-05-12 16:39:45,223 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:45,223 INFO [main]: ql.Driver (Driver.java:checkConcurrency(160)) - Concurrency mode is disabled, not creating a lock manager 2015-05-12 16:39:45,223 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,223 INFO [main]: ql.Driver (Driver.java:execute(1325)) - Starting command(queryId=hive_20150512163945_ce586631-3457-4046-b3ae-18eafe3c159a): import table page_view4 from '/tmp/export4' 2015-05-12 16:39:45,223 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(148)) - 2015-05-12 16:39:45,223 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,223 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,224 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-1:COPY] in serial mode 2015-05-12 16:39:45,224 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1/-ext-10000 2015-05-12 16:39:45,235 INFO [main]: common.FileUtils (FileUtils.java:mkdir(501)) - Creating directory if it doesn't exist: hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1/-ext-10000 2015-05-12 16:39:45,245 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying file: hdfs://node-4.example.com:8020/tmp/export4/dt=1/country=usa/000000_0 2015-05-12 16:39:45,274 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,275 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-4:COPY] in serial mode 2015-05-12 16:39:45,275 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=2/country=india to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1/-ext-10001 2015-05-12 16:39:45,277 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,277 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-7:COPY] in serial mode 2015-05-12 16:39:45,277 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Copying data from hdfs://node-4.example.com:8020/tmp/export4/dt=4/country=uk to hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1/-ext-10002 2015-05-12 16:39:45,279 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,279 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-0:DDL] in serial mode 2015-05-12 16:39:45,336 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,337 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-2:DDL] in serial mode 2015-05-12 16:39:45,451 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,451 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-5:DDL] in serial mode 2015-05-12 16:39:45,533 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,534 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-8:DDL] in serial mode 2015-05-12 16:39:45,606 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(121)) - 2015-05-12 16:39:45,607 INFO [main]: ql.Driver (Driver.java:launchTask(1648)) - Starting task [Stage-3:MOVE] in serial mode 2015-05-12 16:39:45,607 INFO [main]: exec.Task (SessionState.java:printInfo(948)) - Loading data to table default.page_view4 partition (country=usa, dt=1) from hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1/-ext-10000 2015-05-12 16:39:45,626 INFO [main]: exec.MoveTask (MoveTask.java:execute(307)) - Partition is: {country=usa, dt=1} 2015-05-12 16:39:45,694 INFO [main]: metadata.Hive (Hive.java:moveFile(2636)) - Replacing src:hdfs://node-4.example.com:8020/tmp/export4/.hive-staging_hive_2015-05-12_16-39-45_169_2357235876777014039-1/-ext-10000/000000_0, dest: hdfs://node-4.example.com:8020/apps/hive/warehouse/page_view4/country=usa/dt=1/000000_0, Status:true 2015-05-12 16:39:45,831 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 16:39:50,832 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 16:39:50,838 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore. 2015-05-12 16:39:50,838 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.protocol.TProtocolException: Required field 'filesAdded' is unset! Struct:InsertEventRequestData(filesAdded:null) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.validate(InsertEventRequestData.java:310) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:378) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData$InsertEventRequestDataStandardScheme.write(InsertEventRequestData.java:338) at org.apache.hadoop.hive.metastore.api.InsertEventRequestData.write(InsertEventRequestData.java:288) at org.apache.hadoop.hive.metastore.api.FireEventRequestData.standardSchemeWriteValue(FireEventRequestData.java:168) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:244) at org.apache.thrift.TUnion$TUnionStandardScheme.write(TUnion.java:213) at org.apache.thrift.TUnion.write(TUnion.java:152) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:748) at org.apache.hadoop.hive.metastore.api.FireEventRequest$FireEventRequestStandardScheme.write(FireEventRequest.java:667) at org.apache.hadoop.hive.metastore.api.FireEventRequest.write(FireEventRequest.java:577) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args$fire_listener_event_argsStandardScheme.write(ThriftHiveMetastore.java) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$fire_listener_event_args.write(ThriftHiveMetastore.java) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:63) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.send_fire_listener_event(ThriftHiveMetastore.java:4176) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.fire_listener_event(ThriftHiveMetastore.java:4168) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.fireListenerEvent(HiveMetaStoreClient.java:1954) at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:156) at com.sun.proxy.$Proxy5.fireListenerEvent(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.fireInsertEvent(Hive.java:1945) at org.apache.hadoop.hive.ql.metadata.Hive.getPartition(Hive.java:1876) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1407) at org.apache.hadoop.hive.ql.metadata.Hive.loadPartition(Hive.java:1324) at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:438) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 2015-05-12 16:39:55,840 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(376)) - Trying to connect to metastore with URI thrift://node-4.example.com:9083 2015-05-12 16:39:55,842 INFO [main]: hive.metastore (HiveMetaStoreClient.java:open(472)) - Connected to metastore.